2024-09-22T08:00:39.147 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-22T08:00:39.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T08:00:39.263 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034 branch: wip-skoduri-cloud-restore description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7915034' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-skoduri-cloud-restore ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 8852379c050c686f4605f33f0129009b2029ca9d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8852379c050c686f4605f33f0129009b2029ca9d rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-skoduri-cloud-restore sha1: 8852379c050c686f4605f33f0129009b2029ca9d owner: scheduled_soumyakoduri@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 sha1: 8852379c050c686f4605f33f0129009b2029ca9d sleep_before_teardown: 0 suite: rgw suite_branch: wip-skoduri-cloud-restore suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8852379c050c686f4605f33f0129009b2029ca9d targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHfFlQm3ll1QQAJSUO+BzFsiSOTJQtQd8JnDp6UzWoJhKqDMz4OK0N9oOI5FfZV5WN7Upb7tJbH3cOGx4vutYjQ= smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLSTggLxTN5Ec9T54ELqwixlhd57iWbVv9SxhBLRLZiIzqgY3dO2CsgjiDkYZhQFMJn3fh+uUtKivl5cQbbEwro= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-22_06:37:27 tube: smithi user: soumyakoduri verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-22T08:00:39.263 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa; will attempt to use it 2024-09-22T08:00:39.264 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa/tasks 2024-09-22T08:00:39.264 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-22T08:00:39.265 INFO:teuthology.task.internal:Checking packages... 2024-09-22T08:00:39.286 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8852379c050c686f4605f33f0129009b2029ca9d' 2024-09-22T08:00:39.286 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-22T08:00:39.286 INFO:teuthology.packaging:ref: None 2024-09-22T08:00:39.286 INFO:teuthology.packaging:tag: None 2024-09-22T08:00:39.286 INFO:teuthology.packaging:branch: wip-skoduri-cloud-restore 2024-09-22T08:00:39.286 INFO:teuthology.packaging:sha1: 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:00:39.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-skoduri-cloud-restore 2024-09-22T08:00:39.428 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5106.g8852379c 2024-09-22T08:00:39.430 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-22T08:00:39.436 INFO:teuthology.task.internal:no buildpackages task found 2024-09-22T08:00:39.436 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-22T08:00:39.470 INFO:teuthology.task.internal:Saving configuration 2024-09-22T08:00:39.482 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-22T08:00:39.489 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-22T08:00:39.515 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 07:55:35.392168', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHfFlQm3ll1QQAJSUO+BzFsiSOTJQtQd8JnDp6UzWoJhKqDMz4OK0N9oOI5FfZV5WN7Upb7tJbH3cOGx4vutYjQ='} 2024-09-22T08:00:39.537 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 07:55:35.389349', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLSTggLxTN5Ec9T54ELqwixlhd57iWbVv9SxhBLRLZiIzqgY3dO2CsgjiDkYZhQFMJn3fh+uUtKivl5cQbbEwro='} 2024-09-22T08:00:39.537 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-22T08:00:39.543 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-22T08:00:39.543 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-22T08:00:39.543 INFO:teuthology.run_tasks:Running task console_log... 2024-09-22T08:00:39.606 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa6b9a98280>, signals=[15]) 2024-09-22T08:00:39.606 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-22T08:00:39.612 INFO:teuthology.task.internal:Opening connections... 2024-09-22T08:00:39.612 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-09-22T08:00:39.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:00:39.693 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-09-22T08:00:39.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:00:39.769 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-22T08:00:39.776 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-09-22T08:00:39.794 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-09-22T08:00:39.794 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T08:00:39.852 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-09-22T08:00:39.853 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T08:00:39.853 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T08:00:39.853 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T08:00:39.853 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-09-22T08:00:39.870 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-09-22T08:00:39.889 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-09-22T08:00:39.889 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-09-22T08:00:39.947 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T08:00:39.948 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T08:00:39.949 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-09-22T08:00:39.970 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-22T08:00:39.979 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-22T08:00:39.984 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-22T08:00:39.984 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-09-22T08:00:39.986 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-09-22T08:00:40.004 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-22T08:00:40.010 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-22T08:00:40.010 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-09-22T08:00:40.044 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-09-22T08:00:40.071 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-22T08:00:40.127 INFO:teuthology.run_tasks:Running task kernel... 2024-09-22T08:00:40.143 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-22T08:00:40.143 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-22T08:00:40.143 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T08:00:40.144 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T08:00:40.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:00:40.161 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-22T08:00:40.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:00:40.162 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-22T08:00:40.220 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-503.el9.x86_64 2024-09-22T08:00:40.220 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.14.0-503.el9.x86_64 2024-09-22T08:00:40.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum install -y kernel 2024-09-22T08:00:40.222 INFO:teuthology.orchestra.run.smithi165.stdout:5.14.0-503.el9.x86_64 2024-09-22T08:00:40.222 INFO:teuthology.task.kernel:Running kernel on smithi165: 5.14.0-503.el9.x86_64 2024-09-22T08:00:40.222 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum install -y kernel 2024-09-22T08:00:42.609 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-22T08:00:43.282 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.3 MB 00:01 2024-09-22T08:00:45.333 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-22T08:00:45.710 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-22T08:00:50.519 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.5 MB 00:00 2024-09-22T08:00:50.691 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-22T08:00:52.125 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-22T08:00:52.303 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-22T08:00:53.071 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-22T08:00:53.274 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-22T08:00:58.485 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-09-22T08:00:58.896 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-22T08:01:00.324 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T08:01:00.325 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T08:01:00.415 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:01:00.427 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:01:00.427 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-22T08:01:00.427 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:01:00.427 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:01:00.427 INFO:teuthology.orchestra.run.smithi165.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T08:01:00.427 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-22T08:01:00.427 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T08:01:00.428 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T08:01:00.428 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T08:01:00.428 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:01:00.428 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:01:00.428 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:01:00.428 INFO:teuthology.orchestra.run.smithi165.stdout:Install 4 Packages 2024-09-22T08:01:00.428 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:01:00.428 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 79 M 2024-09-22T08:01:00.429 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 126 M 2024-09-22T08:01:00.429 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:01:00.778 INFO:teuthology.orchestra.run.smithi165.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 505 kB/s | 36 kB 00:00 2024-09-22T08:01:00.844 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T08:01:00.845 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T08:01:00.953 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:01:00.958 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:01:00.959 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:01:00.959 INFO:teuthology.orchestra.run.smithi053.stdout:Install 4 Packages 2024-09-22T08:01:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:01:00.959 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 79 M 2024-09-22T08:01:00.959 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 126 M 2024-09-22T08:01:00.959 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:01:01.278 INFO:teuthology.orchestra.run.smithi165.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-22T08:01:01.356 INFO:teuthology.orchestra.run.smithi053.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 259 kB/s | 36 kB 00:00 2024-09-22T08:01:01.862 INFO:teuthology.orchestra.run.smithi165.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-22T08:01:02.187 INFO:teuthology.orchestra.run.smithi165.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-22T08:01:02.187 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:01:02.187 INFO:teuthology.orchestra.run.smithi165.stdout:Total 45 MB/s | 79 MB 00:01 2024-09-22T08:01:02.872 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:01:03.215 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:01:03.215 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:01:04.177 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:01:04.177 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:01:06.601 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:01:07.273 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:01:07.363 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:01:08.214 INFO:teuthology.orchestra.run.smithi053.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:06 2024-09-22T08:01:10.123 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:01:10.271 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:01:14.347 INFO:teuthology.orchestra.run.smithi053.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:12 2024-09-22T08:01:15.109 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:01:15.279 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:01:16.531 INFO:teuthology.orchestra.run.smithi053.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.3 MB/s | 35 MB 00:15 2024-09-22T08:01:16.531 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:01:16.531 INFO:teuthology.orchestra.run.smithi053.stdout:Total 5.1 MB/s | 79 MB 00:15 2024-09-22T08:01:17.242 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:01:17.650 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:01:17.650 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:01:18.610 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:01:18.610 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:01:20.115 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:01:21.177 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:01:21.933 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:01:22.015 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:01:24.767 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:01:24.894 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:01:30.020 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:01:30.062 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:01:35.201 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:01:58.041 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:01:58.080 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:01:58.398 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:01:58.398 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:01:58.398 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:01:58.398 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:01:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:01:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:01:59.270 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:01:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T08:01:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T08:01:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T08:01:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T08:01:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:01:59.270 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:01:59.632 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:01:59.712 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:01:59.712 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:01:59.712 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T08:01:59.713 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T08:01:59.713 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T08:01:59.713 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-22T08:01:59.713 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi165.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T08:01:59.713 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:01:59.771 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:01:59.771 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:01:59.771 DEBUG:teuthology.orchestra.run.smithi165:> sudo rpm -qi grub2-tools 2024-09-22T08:01:59.811 INFO:teuthology.orchestra.run.smithi165.stdout:Name : grub2-tools 2024-09-22T08:01:59.811 INFO:teuthology.orchestra.run.smithi165.stdout:Epoch : 1 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Version : 2.06 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Release : 82.el9 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Architecture: x86_64 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Group : Unspecified 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Size : 8274670 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:License : GPLv3+ 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Packager : builder@centos.org 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:Vendor : CentOS 2024-09-22T08:01:59.812 INFO:teuthology.orchestra.run.smithi165.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T08:01:59.813 INFO:teuthology.orchestra.run.smithi165.stdout:Summary : Support tools for GRUB. 2024-09-22T08:01:59.813 INFO:teuthology.orchestra.run.smithi165.stdout:Description : 2024-09-22T08:01:59.813 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:01:59.813 INFO:teuthology.orchestra.run.smithi165.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T08:01:59.813 INFO:teuthology.orchestra.run.smithi165.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T08:01:59.813 INFO:teuthology.orchestra.run.smithi165.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T08:01:59.813 INFO:teuthology.orchestra.run.smithi165.stdout:hardware devices. 2024-09-22T08:01:59.813 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:01:59.813 INFO:teuthology.orchestra.run.smithi165.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T08:01:59.814 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T08:01:59.814 INFO:teuthology.task.kernel:Updating grub on smithi165 to boot 5.14.0-508.el9.x86_64 2024-09-22T08:01:59.814 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T08:02:00.428 INFO:teuthology.orchestra.run.smithi165.stderr:Generating grub configuration file ... 2024-09-22T08:02:01.828 INFO:teuthology.orchestra.run.smithi165.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T08:02:01.854 INFO:teuthology.orchestra.run.smithi165.stderr:done 2024-09-22T08:02:01.859 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-09-22T08:02:01.875 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.ccCeom9Sy8 2024-09-22T08:02:01.876 DEBUG:teuthology.orchestra.run.smithi165:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ccCeom9Sy8 2024-09-22T08:02:01.944 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.ccCeom9Sy8 2024-09-22T08:02:02.076 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.ccCeom9Sy8 is 6KB 2024-09-22T08:02:02.125 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.ccCeom9Sy8 2024-09-22T08:02:02.140 DEBUG:teuthology.orchestra.run.smithi165:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T08:02:02.202 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T08:02:02.202 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T08:02:02.202 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T08:02:02.202 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T08:02:02.203 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T08:02:02.359 DEBUG:teuthology.orchestra.run.smithi165:> sudo shutdown -r now 2024-09-22T08:02:13.975 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:02:14.015 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:02:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:02:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:02:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:02:14.367 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:02:15.234 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:02:15.234 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:02:15.234 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:02:15.234 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T08:02:15.234 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T08:02:15.234 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T08:02:15.235 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T08:02:15.235 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:02:15.235 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:02:15.550 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:02:15.640 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:02:15.640 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:02:15.640 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T08:02:15.640 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T08:02:15.640 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T08:02:15.640 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-22T08:02:15.640 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T08:02:15.641 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:02:15.699 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:02:15.699 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:02:15.699 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -qi grub2-tools 2024-09-22T08:02:15.734 INFO:teuthology.orchestra.run.smithi053.stdout:Name : grub2-tools 2024-09-22T08:02:15.734 INFO:teuthology.orchestra.run.smithi053.stdout:Epoch : 1 2024-09-22T08:02:15.734 INFO:teuthology.orchestra.run.smithi053.stdout:Version : 2.06 2024-09-22T08:02:15.734 INFO:teuthology.orchestra.run.smithi053.stdout:Release : 82.el9 2024-09-22T08:02:15.734 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: x86_64 2024-09-22T08:02:15.734 INFO:teuthology.orchestra.run.smithi053.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T08:02:15.734 INFO:teuthology.orchestra.run.smithi053.stdout:Group : Unspecified 2024-09-22T08:02:15.734 INFO:teuthology.orchestra.run.smithi053.stdout:Size : 8274670 2024-09-22T08:02:15.734 INFO:teuthology.orchestra.run.smithi053.stdout:License : GPLv3+ 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:Packager : builder@centos.org 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:Vendor : CentOS 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:Summary : Support tools for GRUB. 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:Description : 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout:hardware devices. 2024-09-22T08:02:15.735 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:02:15.736 INFO:teuthology.orchestra.run.smithi053.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T08:02:15.736 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T08:02:15.737 INFO:teuthology.task.kernel:Updating grub on smithi053 to boot 5.14.0-508.el9.x86_64 2024-09-22T08:02:15.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T08:02:16.357 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-09-22T08:02:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T08:02:17.792 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-09-22T08:02:17.794 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-22T08:02:17.809 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.Bn0t4YsdVD 2024-09-22T08:02:17.809 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Bn0t4YsdVD 2024-09-22T08:02:17.875 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.Bn0t4YsdVD 2024-09-22T08:02:18.016 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.Bn0t4YsdVD is 6KB 2024-09-22T08:02:18.064 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.Bn0t4YsdVD 2024-09-22T08:02:18.078 DEBUG:teuthology.orchestra.run.smithi053:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T08:02:18.141 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T08:02:18.141 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T08:02:18.141 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T08:02:18.141 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T08:02:18.142 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T08:02:18.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-09-22T08:02:32.374 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-22T08:02:32.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-22T08:02:32.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:02:48.306 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-22T08:02:48.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-22T08:02:48.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:02:50.737 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-22T08:02:59.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-22T08:02:59.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:03:02.799 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-22T08:03:06.863 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-09-22T08:03:14.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-22T08:03:14.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:03:15.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-22T08:03:15.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:03:33.235 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-22T08:03:34.258 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-09-22T08:03:46.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-22T08:03:46.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:03:47.409 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-22T08:03:47.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-22T08:03:47.830 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-22T08:03:47.830 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-22T08:03:47.845 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-508.el9.x86_64 2024-09-22T08:03:47.845 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T08:03:47.845 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T08:03:47.846 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T08:03:48.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-22T08:03:48.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:03:48.846 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-22T08:03:48.846 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T08:03:48.894 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-22T08:03:48.950 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-09-22T08:03:48.976 DEBUG:teuthology.parallel:result is None 2024-09-22T08:03:49.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-22T08:03:49.299 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-22T08:03:49.299 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-22T08:03:49.314 INFO:teuthology.orchestra.run.smithi165.stdout:5.14.0-508.el9.x86_64 2024-09-22T08:03:49.314 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T08:03:49.314 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T08:03:49.314 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T08:03:50.315 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-22T08:03:50.315 DEBUG:teuthology.orchestra.run.smithi165:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T08:03:50.404 INFO:teuthology.orchestra.run.smithi165.stdout:ttyS1 2024-09-22T08:03:50.437 DEBUG:teuthology.parallel:result is None 2024-09-22T08:03:50.437 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-22T08:03:50.444 INFO:teuthology.task.internal:Creating test directory... 2024-09-22T08:03:50.445 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T08:03:50.450 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T08:03:50.465 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-22T08:03:50.473 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-22T08:03:50.485 INFO:teuthology.task.internal:Creating archive directory... 2024-09-22T08:03:50.485 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T08:03:50.505 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T08:03:50.537 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-22T08:03:50.548 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-22T08:03:50.548 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T08:03:50.568 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T08:03:50.597 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:03:50.606 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:03:50.607 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:03:50.616 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:03:50.618 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-22T08:03:50.625 INFO:teuthology.task.internal:Configuring sudo... 2024-09-22T08:03:50.625 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T08:03:50.653 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T08:03:50.688 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-22T08:03:50.698 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-22T08:03:50.699 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T08:03:50.721 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T08:03:50.747 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:03:50.820 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:03:50.866 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:03:50.950 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:03:50.991 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:03:50.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T08:03:51.057 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:03:51.100 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:03:51.154 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:03:51.233 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:03:51.276 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:03:51.276 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T08:03:51.343 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-09-22T08:03:51.345 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-09-22T08:03:51.400 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:03:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:03:51.927 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-22T08:03:51.940 INFO:teuthology.task.internal:Starting timer... 2024-09-22T08:03:51.940 INFO:teuthology.run_tasks:Running task pcp... 2024-09-22T08:03:51.970 INFO:teuthology.run_tasks:Running task selinux... 2024-09-22T08:03:51.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2024-09-22T08:03:52.055 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2024-09-22T08:03:52.056 DEBUG:teuthology.orchestra.run.smithi165:> sudo service auditd rotate 2024-09-22T08:03:52.103 INFO:teuthology.orchestra.run.smithi165.stdout:Rotating logs: 2024-09-22T08:03:52.105 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-22T08:03:52.105 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2024-09-22T08:03:52.126 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2024-09-22T08:03:52.126 DEBUG:teuthology.orchestra.run.smithi165:> /usr/sbin/getenforce 2024-09-22T08:03:52.145 INFO:teuthology.orchestra.run.smithi165.stdout:Permissive 2024-09-22T08:03:52.145 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi053.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi165.front.sepia.ceph.com': 'permissive'} 2024-09-22T08:03:52.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:03:52.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:03:52.195 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:03:52.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:03:52.220 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-22T08:03:52.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2024-09-22T08:03:52.362 DEBUG:teuthology.orchestra.run.smithi165:> sudo /usr/sbin/setenforce permissive 2024-09-22T08:03:52.401 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-22T08:03:52.411 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-22T08:03:52.422 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-22T08:03:52.422 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi165.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-22T08:07:38.840 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com')] 2024-09-22T08:07:38.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-22T08:07:38.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:07:38.933 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-22T08:07:39.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-22T08:07:39.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-22T08:07:39.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:07:39.086 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-22T08:07:39.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-22T08:07:39.167 INFO:teuthology.run_tasks:Running task clock... 2024-09-22T08:07:39.184 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-22T08:07:39.184 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T08:07:39.184 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:07:39.187 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T08:07:39.187 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:07:39.215 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T08:07:39.229 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T08:07:39.238 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T08:07:39.253 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T08:07:39.254 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2024-09-22T08:07:39.266 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2024-09-22T08:07:39.278 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: ntpd: command not found 2024-09-22T08:07:39.280 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T08:07:39.290 INFO:teuthology.orchestra.run.smithi165.stdout:506 Cannot talk to daemon 2024-09-22T08:07:39.295 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T08:07:39.304 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T08:07:39.318 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T08:07:39.354 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:07:39.356 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:07:39.357 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-09-22T08:07:39.357 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:07:39.357 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:07:39.357 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:07:39.357 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:07:39.376 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:07:39.379 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:07:39.379 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-22T08:07:39.379 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:07:39.379 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:07:39.379 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:07:39.379 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:07:39.380 INFO:teuthology.run_tasks:Running task install... 2024-09-22T08:07:39.389 DEBUG:teuthology.task.install:project ceph 2024-09-22T08:07:39.389 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}} 2024-09-22T08:07:39.389 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'} 2024-09-22T08:07:39.390 INFO:teuthology.task.install:Using flavor: default 2024-09-22T08:07:39.395 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-22T08:07:39.395 INFO:teuthology.task.install:extra packages: [] 2024-09-22T08:07:39.395 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'tag': None, 'wait_for_package': False} 2024-09-22T08:07:39.396 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:07:39.397 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'tag': None, 'wait_for_package': False} 2024-09-22T08:07:39.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:07:39.536 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/ 2024-09-22T08:07:39.537 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5106.g8852379c 2024-09-22T08:07:39.548 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/ 2024-09-22T08:07:39.549 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5106.g8852379c 2024-09-22T08:07:39.645 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T08:07:39.645 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:07:39.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T08:07:39.655 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T08:07:39.655 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:07:39.655 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T08:07:39.672 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T08:07:39.672 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8852379c050c686f4605f33f0129009b2029ca9d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T08:07:39.682 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T08:07:39.682 DEBUG:teuthology.orchestra.run.smithi165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8852379c050c686f4605f33f0129009b2029ca9d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T08:07:39.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T08:07:39.748 DEBUG:teuthology.orchestra.run.smithi165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T08:07:39.817 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T08:07:39.823 DEBUG:teuthology.orchestra.run.smithi165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T08:07:39.882 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2024-09-22T08:07:39.884 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2024-09-22T08:07:39.887 INFO:teuthology.orchestra.run.smithi165.stdout:check_obsoletes = 1 2024-09-22T08:07:39.889 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum clean all 2024-09-22T08:07:40.115 INFO:teuthology.orchestra.run.smithi165.stdout:45 files removed 2024-09-22T08:07:40.116 INFO:teuthology.orchestra.run.smithi053.stdout:45 files removed 2024-09-22T08:07:40.143 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-radosgw 2024-09-22T08:07:40.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw 2024-09-22T08:07:40.711 INFO:teuthology.orchestra.run.smithi165.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-22T08:07:40.713 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-22T08:07:41.003 INFO:teuthology.orchestra.run.smithi165.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-22T08:07:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-22T08:07:41.279 INFO:teuthology.orchestra.run.smithi165.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-22T08:07:41.289 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-22T08:07:41.787 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-22T08:07:43.131 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-22T08:07:43.880 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-22T08:07:49.198 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-22T08:07:49.732 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 3.7 MB/s | 20 MB 00:05 2024-09-22T08:07:50.715 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-22T08:07:51.652 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-22T08:07:54.074 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-22T08:07:56.583 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 19 kB 00:01 2024-09-22T08:07:57.033 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-22T08:07:57.404 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-22T08:07:59.267 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:07:59.275 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:07:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-22T08:07:59.275 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:07:59.275 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 11 M 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: librados2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.5 M 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 22 M 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux x86_64 2:19.3.0-5106.g8852379c.el9 ceph 25 k 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 755 k 2024-09-22T08:07:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 508 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 45 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 148 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs x86_64 2:19.3.0-5106.g8852379c.el9 ceph 162 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados x86_64 2:19.3.0-5106.g8852379c.el9 ceph 320 k 2024-09-22T08:07:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 307 k 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 99 k 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout:Installing weak dependencies: 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout:Install 31 Packages 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 2 Packages 2024-09-22T08:07:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:07:59.279 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 62 M 2024-09-22T08:07:59.279 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:08:00.643 INFO:teuthology.orchestra.run.smithi165.stdout:(1/33): ceph-base-19.3.0-5106.g8852379c.el9.x86 7.2 MB/s | 5.5 MB 00:00 2024-09-22T08:08:00.776 INFO:teuthology.orchestra.run.smithi165.stdout:(2/33): ceph-radosgw-19.3.0-5106.g8852379c.el9. 12 MB/s | 11 MB 00:00 2024-09-22T08:08:00.801 INFO:teuthology.orchestra.run.smithi165.stdout:(3/33): ceph-selinux-19.3.0-5106.g8852379c.el9. 159 kB/s | 25 kB 00:00 2024-09-22T08:08:00.844 INFO:teuthology.orchestra.run.smithi165.stdout:(4/33): libcephfs2-19.3.0-5106.g8852379c.el9.x8 11 MB/s | 755 kB 00:00 2024-09-22T08:08:00.877 INFO:teuthology.orchestra.run.smithi165.stdout:(5/33): libradosstriper1-19.3.0-5106.g8852379c. 6.6 MB/s | 508 kB 00:00 2024-09-22T08:08:00.969 INFO:teuthology.orchestra.run.smithi165.stdout:(6/33): python3-ceph-argparse-19.3.0-5106.g8852 493 kB/s | 45 kB 00:00 2024-09-22T08:08:01.053 INFO:teuthology.orchestra.run.smithi165.stdout:(7/33): python3-ceph-common-19.3.0-5106.g885237 1.7 MB/s | 148 kB 00:00 2024-09-22T08:08:01.153 INFO:teuthology.orchestra.run.smithi165.stdout:(8/33): librgw2-19.3.0-5106.g8852379c.el9.x86_6 18 MB/s | 5.5 MB 00:00 2024-09-22T08:08:01.178 INFO:teuthology.orchestra.run.smithi165.stdout:(9/33): python3-cephfs-19.3.0-5106.g8852379c.el 1.3 MB/s | 162 kB 00:00 2024-09-22T08:08:01.204 INFO:teuthology.orchestra.run.smithi165.stdout:(10/33): python3-rados-19.3.0-5106.g8852379c.el 6.3 MB/s | 320 kB 00:00 2024-09-22T08:08:01.237 INFO:teuthology.orchestra.run.smithi165.stdout:(11/33): python3-rbd-19.3.0-5106.g8852379c.el9. 5.1 MB/s | 307 kB 00:00 2024-09-22T08:08:01.429 INFO:teuthology.orchestra.run.smithi165.stdout:(12/33): ceph-common-19.3.0-5106.g8852379c.el9. 14 MB/s | 22 MB 00:01 2024-09-22T08:08:01.454 INFO:teuthology.orchestra.run.smithi165.stdout:(13/33): python3-rgw-19.3.0-5106.g8852379c.el9. 396 kB/s | 99 kB 00:00 2024-09-22T08:08:01.588 INFO:teuthology.orchestra.run.smithi165.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 305 kB/s | 107 kB 00:00 2024-09-22T08:08:01.613 INFO:teuthology.orchestra.run.smithi165.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-22T08:08:01.630 INFO:teuthology.orchestra.run.smithi165.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 973 kB/s | 171 kB 00:00 2024-09-22T08:08:01.647 INFO:teuthology.orchestra.run.smithi165.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 769 kB/s | 45 kB 00:00 2024-09-22T08:08:01.689 INFO:teuthology.orchestra.run.smithi165.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-22T08:08:01.714 INFO:teuthology.orchestra.run.smithi165.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-22T08:08:01.740 INFO:teuthology.orchestra.run.smithi165.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-22T08:08:01.765 INFO:teuthology.orchestra.run.smithi165.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 713 kB/s | 36 kB 00:00 2024-09-22T08:08:01.790 INFO:teuthology.orchestra.run.smithi165.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-22T08:08:01.816 INFO:teuthology.orchestra.run.smithi165.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-22T08:08:01.874 INFO:teuthology.orchestra.run.smithi165.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-22T08:08:01.899 INFO:teuthology.orchestra.run.smithi165.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-22T08:08:01.924 INFO:teuthology.orchestra.run.smithi165.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 277 kB/s | 26 kB 00:00 2024-09-22T08:08:01.950 INFO:teuthology.orchestra.run.smithi165.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-22T08:08:01.984 INFO:teuthology.orchestra.run.smithi165.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-22T08:08:02.042 INFO:teuthology.orchestra.run.smithi165.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-22T08:08:02.084 INFO:teuthology.orchestra.run.smithi165.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-22T08:08:02.160 INFO:teuthology.orchestra.run.smithi165.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-22T08:08:02.301 INFO:teuthology.orchestra.run.smithi165.stdout:(32/33): librbd1-19.3.0-5106.g8852379c.el9.x86_ 15 MB/s | 3.2 MB 00:00 2024-09-22T08:08:02.368 INFO:teuthology.orchestra.run.smithi165.stdout:(33/33): librados2-19.3.0-5106.g8852379c.el9.x8 11 MB/s | 3.5 MB 00:00 2024-09-22T08:08:02.373 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:08:02.373 INFO:teuthology.orchestra.run.smithi165.stdout:Total 20 MB/s | 62 MB 00:03 2024-09-22T08:08:02.487 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:08:02.525 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:08:02.525 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:08:03.035 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-22T08:08:03.206 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:08:03.207 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:08:04.694 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:08:04.778 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-22T08:08:04.807 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-22T08:08:04.832 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-22T08:08:04.854 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-22T08:08:04.882 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-22T08:08:05.048 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-22T08:08:05.102 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-22T08:08:05.355 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:08:05.359 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:05.359 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-22T08:08:05.359 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:05.359 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:08:05.359 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 11 M 2024-09-22T08:08:05.359 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2024-09-22T08:08:05.359 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.5 M 2024-09-22T08:08:05.360 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:08:05.360 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-22T08:08:05.360 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T08:08:05.360 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:08:05.360 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 22 M 2024-09-22T08:08:05.360 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:19.3.0-5106.g8852379c.el9 ceph 25 k 2024-09-22T08:08:05.360 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T08:08:05.360 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T08:08:05.360 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T08:08:05.360 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 755 k 2024-09-22T08:08:05.361 INFO:teuthology.orchestra.run.smithi053.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T08:08:05.361 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T08:08:05.361 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T08:08:05.361 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T08:08:05.361 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 508 k 2024-09-22T08:08:05.361 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T08:08:05.361 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:08:05.361 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T08:08:05.362 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T08:08:05.362 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T08:08:05.362 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 45 k 2024-09-22T08:08:05.362 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 148 k 2024-09-22T08:08:05.362 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:19.3.0-5106.g8852379c.el9 ceph 162 k 2024-09-22T08:08:05.362 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T08:08:05.362 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:19.3.0-5106.g8852379c.el9 ceph 320 k 2024-09-22T08:08:05.362 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 307 k 2024-09-22T08:08:05.362 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 99 k 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout:Installing weak dependencies: 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout:Install 31 Packages 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 2 Packages 2024-09-22T08:08:05.363 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:05.364 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 62 M 2024-09-22T08:08:05.364 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:08:05.459 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-22T08:08:05.559 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:08:05.652 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:08:05.742 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 8/35 2024-09-22T08:08:05.769 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 9/35 2024-09-22T08:08:05.832 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 9/35 2024-09-22T08:08:05.869 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-22T08:08:05.912 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9. 11/35 2024-09-22T08:08:05.983 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 12/35 2024-09-22T08:08:06.013 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 13/35 2024-09-22T08:08:06.061 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 13/35 2024-09-22T08:08:06.095 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-22T08:08:06.205 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-22T08:08:06.245 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-22T08:08:06.291 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-22T08:08:06.344 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-22T08:08:06.353 INFO:teuthology.orchestra.run.smithi053.stdout:(1/33): ceph-base-19.3.0-5106.g8852379c.el9.x86 8.2 MB/s | 5.5 MB 00:00 2024-09-22T08:08:06.374 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-22T08:08:06.417 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T08:08:06.458 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-22T08:08:06.478 INFO:teuthology.orchestra.run.smithi053.stdout:(2/33): ceph-radosgw-19.3.0-5106.g8852379c.el9. 14 MB/s | 11 MB 00:00 2024-09-22T08:08:06.504 INFO:teuthology.orchestra.run.smithi053.stdout:(3/33): ceph-selinux-19.3.0-5106.g8852379c.el9. 168 kB/s | 25 kB 00:00 2024-09-22T08:08:06.545 INFO:teuthology.orchestra.run.smithi053.stdout:(4/33): libcephfs2-19.3.0-5106.g8852379c.el9.x8 11 MB/s | 755 kB 00:00 2024-09-22T08:08:06.579 INFO:teuthology.orchestra.run.smithi053.stdout:(5/33): libradosstriper1-19.3.0-5106.g8852379c. 6.6 MB/s | 508 kB 00:00 2024-09-22T08:08:06.637 INFO:teuthology.orchestra.run.smithi053.stdout:(6/33): python3-ceph-argparse-19.3.0-5106.g8852 774 kB/s | 45 kB 00:00 2024-09-22T08:08:06.713 INFO:teuthology.orchestra.run.smithi053.stdout:(7/33): python3-ceph-common-19.3.0-5106.g885237 1.9 MB/s | 148 kB 00:00 2024-09-22T08:08:06.779 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-22T08:08:06.813 INFO:teuthology.orchestra.run.smithi053.stdout:(8/33): librgw2-19.3.0-5106.g8852379c.el9.x86_6 21 MB/s | 5.5 MB 00:00 2024-09-22T08:08:06.820 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 23/35 2024-09-22T08:08:06.838 INFO:teuthology.orchestra.run.smithi053.stdout:(9/33): python3-cephfs-19.3.0-5106.g8852379c.el 1.3 MB/s | 162 kB 00:00 2024-09-22T08:08:06.863 INFO:teuthology.orchestra.run.smithi053.stdout:(10/33): python3-rados-19.3.0-5106.g8852379c.el 6.2 MB/s | 320 kB 00:00 2024-09-22T08:08:06.888 INFO:teuthology.orchestra.run.smithi053.stdout:(11/33): python3-rbd-19.3.0-5106.g8852379c.el9. 6.0 MB/s | 307 kB 00:00 2024-09-22T08:08:06.913 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 23/35 2024-09-22T08:08:06.914 INFO:teuthology.orchestra.run.smithi053.stdout:(12/33): python3-rgw-19.3.0-5106.g8852379c.el9. 1.9 MB/s | 99 kB 00:00 2024-09-22T08:08:06.943 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 24/35 2024-09-22T08:08:06.977 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-22T08:08:07.114 INFO:teuthology.orchestra.run.smithi053.stdout:(13/33): ceph-common-19.3.0-5106.g8852379c.el9. 15 MB/s | 22 MB 00:01 2024-09-22T08:08:07.156 INFO:teuthology.orchestra.run.smithi053.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 400 kB/s | 107 kB 00:00 2024-09-22T08:08:07.206 INFO:teuthology.orchestra.run.smithi053.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-22T08:08:07.232 INFO:teuthology.orchestra.run.smithi053.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 538 kB/s | 171 kB 00:00 2024-09-22T08:08:07.257 INFO:teuthology.orchestra.run.smithi053.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-22T08:08:07.299 INFO:teuthology.orchestra.run.smithi053.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-22T08:08:07.334 INFO:teuthology.orchestra.run.smithi053.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-22T08:08:07.349 INFO:teuthology.orchestra.run.smithi053.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 460 kB/s | 42 kB 00:00 2024-09-22T08:08:07.375 INFO:teuthology.orchestra.run.smithi053.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-22T08:08:07.391 INFO:teuthology.orchestra.run.smithi053.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 610 kB/s | 36 kB 00:00 2024-09-22T08:08:07.409 INFO:teuthology.orchestra.run.smithi053.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 806 kB/s | 47 kB 00:00 2024-09-22T08:08:07.467 INFO:teuthology.orchestra.run.smithi053.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.3 MB/s | 308 kB 00:00 2024-09-22T08:08:07.468 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-22T08:08:07.492 INFO:teuthology.orchestra.run.smithi053.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-09-22T08:08:07.497 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 27/35 2024-09-22T08:08:07.518 INFO:teuthology.orchestra.run.smithi053.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-22T08:08:07.543 INFO:teuthology.orchestra.run.smithi053.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-22T08:08:07.561 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 27/35 2024-09-22T08:08:07.576 INFO:teuthology.orchestra.run.smithi053.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-22T08:08:07.619 INFO:teuthology.orchestra.run.smithi053.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-22T08:08:07.643 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 28/35 2024-09-22T08:08:07.692 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x8 29/35 2024-09-22T08:08:07.702 INFO:teuthology.orchestra.run.smithi053.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-22T08:08:07.786 INFO:teuthology.orchestra.run.smithi053.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-22T08:08:08.052 INFO:teuthology.orchestra.run.smithi053.stdout:(32/33): librados2-19.3.0-5106.g8852379c.el9.x8 8.0 MB/s | 3.5 MB 00:00 2024-09-22T08:08:08.111 INFO:teuthology.orchestra.run.smithi053.stdout:(33/33): librbd1-19.3.0-5106.g8852379c.el9.x86_ 7.9 MB/s | 3.2 MB 00:00 2024-09-22T08:08:08.116 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:08:08.116 INFO:teuthology.orchestra.run.smithi053.stdout:Total 22 MB/s | 62 MB 00:02 2024-09-22T08:08:08.229 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:08:08.270 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:08:08.270 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:08:08.969 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:08:08.970 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:08:10.041 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:08:10.080 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:08:10.517 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:08:10.615 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-22T08:08:10.649 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-22T08:08:10.655 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:08:10.674 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-22T08:08:10.692 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 31/35 2024-09-22T08:08:10.697 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-22T08:08:10.724 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-22T08:08:10.783 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 31/35 2024-09-22T08:08:10.783 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T08:08:10.783 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T08:08:10.783 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:10.819 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:08:10.893 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-22T08:08:10.946 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-22T08:08:11.296 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-22T08:08:11.401 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:08:11.477 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:08:11.568 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 8/35 2024-09-22T08:08:11.594 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 9/35 2024-09-22T08:08:11.640 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 9/35 2024-09-22T08:08:11.669 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-22T08:08:11.713 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9. 11/35 2024-09-22T08:08:11.784 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 12/35 2024-09-22T08:08:11.812 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 13/35 2024-09-22T08:08:11.869 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 13/35 2024-09-22T08:08:11.903 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-22T08:08:12.016 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-22T08:08:12.053 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-22T08:08:12.099 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-22T08:08:12.152 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-22T08:08:12.181 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-22T08:08:12.221 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T08:08:12.279 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-22T08:08:12.621 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-22T08:08:12.669 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 23/35 2024-09-22T08:08:12.761 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 23/35 2024-09-22T08:08:12.791 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 24/35 2024-09-22T08:08:12.835 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-22T08:08:13.355 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-22T08:08:13.388 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 27/35 2024-09-22T08:08:13.462 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 27/35 2024-09-22T08:08:13.544 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 28/35 2024-09-22T08:08:13.573 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x8 29/35 2024-09-22T08:08:16.042 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:08:16.121 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:08:16.735 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 30/35 2024-09-22T08:08:16.773 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 31/35 2024-09-22T08:08:16.855 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 31/35 2024-09-22T08:08:16.855 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T08:08:16.855 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T08:08:16.855 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:16.899 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:08:21.037 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:08:21.037 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /sys 2024-09-22T08:08:21.038 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /proc 2024-09-22T08:08:21.038 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /mnt 2024-09-22T08:08:21.038 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /var/tmp 2024-09-22T08:08:21.038 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /home 2024-09-22T08:08:21.038 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /root 2024-09-22T08:08:21.038 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /tmp 2024-09-22T08:08:21.038 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:22.014 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 33/35 2024-09-22T08:08:22.041 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 33/35 2024-09-22T08:08:22.041 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:22.041 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T08:08:22.041 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:08:22.041 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:08:22.041 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:22.043 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T08:08:22.142 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T08:08:22.142 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:08:23.353 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:08:23.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 1/35 2024-09-22T08:08:23.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2/35 2024-09-22T08:08:23.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 3/35 2024-09-22T08:08:23.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 4/35 2024-09-22T08:08:23.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 5/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 6/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9. 8/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x8 9/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 10/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 11/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 12/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 13/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-22T08:08:23.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-22T08:08:23.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-22T08:08:23.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T08:08:23.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-22T08:08:23.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-22T08:08:23.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-22T08:08:23.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-22T08:08:23.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-22T08:08:23.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-22T08:08:23.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-22T08:08:23.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-22T08:08:23.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-22T08:08:23.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-22T08:08:23.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-22T08:08:23.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:08:23.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-22T08:08:23.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 34/35 2024-09-22T08:08:24.506 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:08:24.506 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:24.506 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2024-09-22T08:08:24.506 INFO:teuthology.orchestra.run.smithi165.stdout: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.506 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.506 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T08:08:24.507 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:24.508 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T08:08:24.509 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T08:08:24.509 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T08:08:24.509 INFO:teuthology.orchestra.run.smithi165.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T08:08:24.509 INFO:teuthology.orchestra.run.smithi165.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T08:08:24.509 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:24.509 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:08:24.880 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-test 2024-09-22T08:08:25.460 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:28 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:08:25.590 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:08:25.591 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:25.591 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-22T08:08:25.591 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:25.591 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:08:25.591 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test x86_64 2:19.3.0-5106.g8852379c.el9 ceph 46 M 2024-09-22T08:08:25.592 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-22T08:08:25.592 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite x86_64 2:19.3.0-5106.g8852379c.el9 ceph 161 k 2024-09-22T08:08:25.592 INFO:teuthology.orchestra.run.smithi165.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T08:08:25.592 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T08:08:25.592 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:25.592 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:08:25.592 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:25.592 INFO:teuthology.orchestra.run.smithi165.stdout:Install 4 Packages 2024-09-22T08:08:25.592 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:25.593 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 46 M 2024-09-22T08:08:25.593 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 201 M 2024-09-22T08:08:25.593 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:08:25.834 INFO:teuthology.orchestra.run.smithi165.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-22T08:08:25.859 INFO:teuthology.orchestra.run.smithi165.stdout:(2/4): libcephsqlite-19.3.0-5106.g8852379c.el9. 739 kB/s | 161 kB 00:00 2024-09-22T08:08:25.876 INFO:teuthology.orchestra.run.smithi165.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-22T08:08:27.118 INFO:teuthology.orchestra.run.smithi165.stdout:(4/4): ceph-test-19.3.0-5106.g8852379c.el9.x86_ 31 MB/s | 46 MB 00:01 2024-09-22T08:08:27.120 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:08:27.121 INFO:teuthology.orchestra.run.smithi165.stdout:Total 30 MB/s | 46 MB 00:01 2024-09-22T08:08:27.149 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:08:27.170 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:08:27.170 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:08:27.467 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:08:27.467 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2024-09-22T08:08:27.467 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2024-09-22T08:08:27.467 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2024-09-22T08:08:27.467 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2024-09-22T08:08:27.467 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2024-09-22T08:08:27.467 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /root 2024-09-22T08:08:27.467 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2024-09-22T08:08:27.467 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:27.523 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:08:27.524 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:08:28.037 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:08:28.112 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-22T08:08:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-22T08:08:28.178 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 3/4 2024-09-22T08:08:28.487 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 33/35 2024-09-22T08:08:28.514 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 33/35 2024-09-22T08:08:28.514 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:28.514 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T08:08:28.514 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:08:28.515 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:08:28.515 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:28.516 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T08:08:28.630 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T08:08:28.631 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:08:29.883 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:08:29.883 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 1/35 2024-09-22T08:08:29.883 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2/35 2024-09-22T08:08:29.883 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 3/35 2024-09-22T08:08:29.883 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 4/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 5/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_6 6/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 7/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9. 8/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x8 9/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 10/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 11/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 12/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 13/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-22T08:08:29.884 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-22T08:08:29.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-22T08:08:29.886 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 32/35 2024-09-22T08:08:29.886 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-22T08:08:29.886 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 34/35 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.874 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T08:08:30.875 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:30.876 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:08:31.214 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-test 2024-09-22T08:08:31.818 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:28 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:08:31.954 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:08:31.955 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:31.955 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-22T08:08:31.955 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:31.955 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:08:31.955 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:19.3.0-5106.g8852379c.el9 ceph 46 M 2024-09-22T08:08:31.955 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-22T08:08:31.955 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:19.3.0-5106.g8852379c.el9 ceph 161 k 2024-09-22T08:08:31.955 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T08:08:31.955 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T08:08:31.956 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:31.956 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:08:31.956 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:31.956 INFO:teuthology.orchestra.run.smithi053.stdout:Install 4 Packages 2024-09-22T08:08:31.956 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:31.956 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 46 M 2024-09-22T08:08:31.956 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 201 M 2024-09-22T08:08:31.957 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:08:32.212 INFO:teuthology.orchestra.run.smithi053.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-22T08:08:32.237 INFO:teuthology.orchestra.run.smithi053.stdout:(2/4): libcephsqlite-19.3.0-5106.g8852379c.el9. 624 kB/s | 161 kB 00:00 2024-09-22T08:08:32.263 INFO:teuthology.orchestra.run.smithi053.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-22T08:08:32.542 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 3/4 2024-09-22T08:08:32.627 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 4/4 2024-09-22T08:08:33.463 INFO:teuthology.orchestra.run.smithi053.stdout:(4/4): ceph-test-19.3.0-5106.g8852379c.el9.x86_ 31 MB/s | 46 MB 00:01 2024-09-22T08:08:33.465 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:08:33.465 INFO:teuthology.orchestra.run.smithi053.stdout:Total 31 MB/s | 46 MB 00:01 2024-09-22T08:08:33.494 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:08:33.516 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:08:33.516 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:08:33.890 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:08:33.890 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:08:34.426 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:08:34.517 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-22T08:08:34.562 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-22T08:08:34.590 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 3/4 2024-09-22T08:08:34.789 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 4/4 2024-09-22T08:08:34.789 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 1/4 2024-09-22T08:08:34.789 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2/4 2024-09-22T08:08:34.789 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-22T08:08:35.081 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-22T08:08:35.081 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:35.081 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:08:35.081 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:35.082 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:35.082 INFO:teuthology.orchestra.run.smithi165.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T08:08:35.082 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T08:08:35.082 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:35.082 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:08:35.372 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph 2024-09-22T08:08:35.994 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:38 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:08:36.137 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:08:36.139 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:36.139 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-22T08:08:36.139 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: ceph x86_64 2:19.3.0-5106.g8852379c.el9 ceph 6.6 k 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds x86_64 2:19.3.0-5106.g8852379c.el9 ceph 2.4 M 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr x86_64 2:19.3.0-5106.g8852379c.el9 ceph 1.5 M 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 292 k 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon x86_64 2:19.3.0-5106.g8852379c.el9 ceph 4.8 M 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 17 M 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T08:08:36.140 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T08:08:36.141 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:36.142 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:08:36.143 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:36.143 INFO:teuthology.orchestra.run.smithi165.stdout:Install 37 Packages 2024-09-22T08:08:36.143 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:36.143 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 31 M 2024-09-22T08:08:36.143 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 109 M 2024-09-22T08:08:36.143 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:08:36.813 INFO:teuthology.orchestra.run.smithi165.stdout:(1/37): ceph-19.3.0-5106.g8852379c.el9.x86_64.r 56 kB/s | 6.6 kB 00:00 2024-09-22T08:08:37.030 INFO:teuthology.orchestra.run.smithi165.stdout:(2/37): ceph-mds-19.3.0-5106.g8852379c.el9.x86_ 7.2 MB/s | 2.4 MB 00:00 2024-09-22T08:08:37.063 INFO:teuthology.orchestra.run.smithi165.stdout:(3/37): ceph-mgr-19.3.0-5106.g8852379c.el9.x86_ 4.2 MB/s | 1.5 MB 00:00 2024-09-22T08:08:37.130 INFO:teuthology.orchestra.run.smithi165.stdout:(4/37): ceph-mon-19.3.0-5106.g8852379c.el9.x86_ 15 MB/s | 4.8 MB 00:00 2024-09-22T08:08:37.164 INFO:teuthology.orchestra.run.smithi165.stdout:(5/37): ceph-mgr-modules-core-19.3.0-5106.g8852 2.8 MB/s | 292 kB 00:00 2024-09-22T08:08:37.273 INFO:teuthology.orchestra.run.smithi165.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-22T08:08:37.315 INFO:teuthology.orchestra.run.smithi165.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-22T08:08:37.357 INFO:teuthology.orchestra.run.smithi165.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 6.4 MB/s | 1.2 MB 00:00 2024-09-22T08:08:37.382 INFO:teuthology.orchestra.run.smithi165.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-09-22T08:08:37.407 INFO:teuthology.orchestra.run.smithi165.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-22T08:08:37.433 INFO:teuthology.orchestra.run.smithi165.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-22T08:08:37.625 INFO:teuthology.orchestra.run.smithi165.stdout:(12/37): ceph-osd-19.3.0-5106.g8852379c.el9.x86 29 MB/s | 17 MB 00:00 2024-09-22T08:08:37.917 INFO:teuthology.orchestra.run.smithi165.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 119 kB/s | 35 kB 00:00 2024-09-22T08:08:38.104 INFO:teuthology.orchestra.run.smithi165.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 256 kB/s | 172 kB 00:00 2024-09-22T08:08:38.129 INFO:teuthology.orchestra.run.smithi165.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 261 kB/s | 188 kB 00:00 2024-09-22T08:08:38.154 INFO:teuthology.orchestra.run.smithi165.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 325 kB/s | 77 kB 00:00 2024-09-22T08:08:38.213 INFO:teuthology.orchestra.run.smithi165.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-09-22T08:08:38.246 INFO:teuthology.orchestra.run.smithi165.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-22T08:08:38.272 INFO:teuthology.orchestra.run.smithi165.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 292 kB/s | 42 kB 00:00 2024-09-22T08:08:38.314 INFO:teuthology.orchestra.run.smithi165.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-22T08:08:38.339 INFO:teuthology.orchestra.run.smithi165.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 480 kB/s | 43 kB 00:00 2024-09-22T08:08:38.364 INFO:teuthology.orchestra.run.smithi165.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 434 kB/s | 11 kB 00:00 2024-09-22T08:08:38.390 INFO:teuthology.orchestra.run.smithi165.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-22T08:08:38.415 INFO:teuthology.orchestra.run.smithi165.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-09-22T08:08:38.440 INFO:teuthology.orchestra.run.smithi165.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 234 kB/s | 18 kB 00:00 2024-09-22T08:08:38.457 INFO:teuthology.orchestra.run.smithi165.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 467 kB/s | 19 kB 00:00 2024-09-22T08:08:38.482 INFO:teuthology.orchestra.run.smithi165.stdout:(27/37): python3-jaraco-collections-3.0.0-8.el9 345 kB/s | 23 kB 00:00 2024-09-22T08:08:38.507 INFO:teuthology.orchestra.run.smithi165.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 293 kB/s | 20 kB 00:00 2024-09-22T08:08:38.533 INFO:teuthology.orchestra.run.smithi165.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 613 kB/s | 46 kB 00:00 2024-09-22T08:08:38.583 INFO:teuthology.orchestra.run.smithi165.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 784 kB/s | 79 kB 00:00 2024-09-22T08:08:38.609 INFO:teuthology.orchestra.run.smithi165.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 218 kB/s | 16 kB 00:00 2024-09-22T08:08:38.634 INFO:teuthology.orchestra.run.smithi165.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-22T08:08:38.659 INFO:teuthology.orchestra.run.smithi165.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 710 kB/s | 36 kB 00:00 2024-09-22T08:08:38.684 INFO:teuthology.orchestra.run.smithi165.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-22T08:08:38.710 INFO:teuthology.orchestra.run.smithi165.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-22T08:08:38.735 INFO:teuthology.orchestra.run.smithi165.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-22T08:08:38.760 INFO:teuthology.orchestra.run.smithi165.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-22T08:08:38.765 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:08:38.765 INFO:teuthology.orchestra.run.smithi165.stdout:Total 12 MB/s | 31 MB 00:02 2024-09-22T08:08:38.920 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:08:38.961 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:08:38.961 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:08:39.221 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 3/4 2024-09-22T08:08:39.299 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 4/4 2024-09-22T08:08:39.436 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:08:39.436 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:08:40.802 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:08:40.863 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-22T08:08:40.888 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-22T08:08:40.924 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-22T08:08:40.987 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-22T08:08:41.031 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-22T08:08:41.064 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-22T08:08:41.157 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-22T08:08:41.243 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-22T08:08:41.292 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-22T08:08:41.327 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-22T08:08:41.357 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-22T08:08:41.392 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-22T08:08:41.425 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-22T08:08:41.466 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-22T08:08:41.501 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-22T08:08:41.535 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-22T08:08:41.542 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 4/4 2024-09-22T08:08:41.542 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 1/4 2024-09-22T08:08:41.542 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2/4 2024-09-22T08:08:41.542 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-22T08:08:41.575 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-22T08:08:41.607 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-22T08:08:41.681 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-22T08:08:41.828 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-22T08:08:41.845 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-22T08:08:41.845 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:41.845 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:08:41.846 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:41.846 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:41.846 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T08:08:41.846 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T08:08:41.846 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:41.846 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:08:41.906 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-22T08:08:41.958 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-22T08:08:41.997 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-22T08:08:42.046 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-22T08:08:42.101 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-22T08:08:42.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph 2024-09-22T08:08:42.311 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-22T08:08:42.360 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-22T08:08:42.438 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-22T08:08:42.527 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-22T08:08:42.568 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-22T08:08:42.698 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-22T08:08:42.734 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:39 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:08:42.865 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9. 32/37 2024-09-22T08:08:42.880 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:08:42.883 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-22T08:08:42.883 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:42.883 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:08:42.883 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:19.3.0-5106.g8852379c.el9 ceph 6.6 k 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:19.3.0-5106.g8852379c.el9 ceph 2.4 M 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:19.3.0-5106.g8852379c.el9 ceph 1.5 M 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 292 k 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:19.3.0-5106.g8852379c.el9 ceph 4.8 M 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 17 M 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T08:08:42.884 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T08:08:42.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout:Install 37 Packages 2024-09-22T08:08:42.886 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:42.887 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 31 M 2024-09-22T08:08:42.887 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 109 M 2024-09-22T08:08:42.887 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:08:42.895 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 33/37 2024-09-22T08:08:42.921 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 33/37 2024-09-22T08:08:42.921 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:42.921 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T08:08:42.921 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:08:42.922 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:08:42.922 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:43.547 INFO:teuthology.orchestra.run.smithi053.stdout:(1/37): ceph-19.3.0-5106.g8852379c.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-22T08:08:43.722 INFO:teuthology.orchestra.run.smithi053.stdout:(2/37): ceph-mgr-19.3.0-5106.g8852379c.el9.x86_ 5.0 MB/s | 1.5 MB 00:00 2024-09-22T08:08:43.772 INFO:teuthology.orchestra.run.smithi053.stdout:(3/37): ceph-mds-19.3.0-5106.g8852379c.el9.x86_ 6.7 MB/s | 2.4 MB 00:00 2024-09-22T08:08:43.865 INFO:teuthology.orchestra.run.smithi053.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5106.g8852 3.1 MB/s | 292 kB 00:00 2024-09-22T08:08:43.956 INFO:teuthology.orchestra.run.smithi053.stdout:(5/37): ceph-mon-19.3.0-5106.g8852379c.el9.x86_ 12 MB/s | 4.8 MB 00:00 2024-09-22T08:08:44.090 INFO:teuthology.orchestra.run.smithi053.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-22T08:08:44.291 INFO:teuthology.orchestra.run.smithi053.stdout:(7/37): ceph-osd-19.3.0-5106.g8852379c.el9.x86_ 30 MB/s | 17 MB 00:00 2024-09-22T08:08:44.315 INFO:teuthology.orchestra.run.smithi053.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 473 kB/s | 106 kB 00:00 2024-09-22T08:08:44.366 INFO:teuthology.orchestra.run.smithi053.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-22T08:08:44.379 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 34/37 2024-09-22T08:08:44.406 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 34/37 2024-09-22T08:08:44.406 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:44.406 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T08:08:44.406 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:08:44.407 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:08:44.407 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:44.416 INFO:teuthology.orchestra.run.smithi053.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.7 MB/s | 1.2 MB 00:00 2024-09-22T08:08:44.441 INFO:teuthology.orchestra.run.smithi053.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-22T08:08:44.492 INFO:teuthology.orchestra.run.smithi053.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 673 kB/s | 135 kB 00:00 2024-09-22T08:08:44.854 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 35/37 2024-09-22T08:08:44.879 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 35/37 2024-09-22T08:08:44.879 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:44.879 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T08:08:44.879 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:08:44.879 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:08:44.879 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:45.042 INFO:teuthology.orchestra.run.smithi053.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 63 kB/s | 35 kB 00:00 2024-09-22T08:08:45.105 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 36/37 2024-09-22T08:08:45.130 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 36/37 2024-09-22T08:08:45.130 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:45.130 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T08:08:45.130 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:08:45.130 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:08:45.130 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:45.142 INFO:teuthology.orchestra.run.smithi053.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 260 kB/s | 188 kB 00:00 2024-09-22T08:08:45.167 INFO:teuthology.orchestra.run.smithi053.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 237 kB/s | 172 kB 00:00 2024-09-22T08:08:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 37/37 2024-09-22T08:08:45.668 INFO:teuthology.orchestra.run.smithi053.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 123 kB/s | 77 kB 00:00 2024-09-22T08:08:45.735 INFO:teuthology.orchestra.run.smithi053.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2024-09-22T08:08:45.760 INFO:teuthology.orchestra.run.smithi053.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 83 kB/s | 51 kB 00:00 2024-09-22T08:08:45.785 INFO:teuthology.orchestra.run.smithi053.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-22T08:08:45.843 INFO:teuthology.orchestra.run.smithi053.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 749 kB/s | 43 kB 00:00 2024-09-22T08:08:45.869 INFO:teuthology.orchestra.run.smithi053.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-09-22T08:08:45.894 INFO:teuthology.orchestra.run.smithi053.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 433 kB/s | 11 kB 00:00 2024-09-22T08:08:45.919 INFO:teuthology.orchestra.run.smithi053.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-22T08:08:45.946 INFO:teuthology.orchestra.run.smithi053.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 354 kB/s | 18 kB 00:00 2024-09-22T08:08:45.970 INFO:teuthology.orchestra.run.smithi053.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-22T08:08:45.995 INFO:teuthology.orchestra.run.smithi053.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-22T08:08:46.012 INFO:teuthology.orchestra.run.smithi053.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 471 kB/s | 20 kB 00:00 2024-09-22T08:08:46.040 INFO:teuthology.orchestra.run.smithi053.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.0 MB/s | 46 kB 00:00 2024-09-22T08:08:46.066 INFO:teuthology.orchestra.run.smithi053.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-09-22T08:08:46.091 INFO:teuthology.orchestra.run.smithi053.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 999 kB/s | 79 kB 00:00 2024-09-22T08:08:46.116 INFO:teuthology.orchestra.run.smithi053.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-22T08:08:46.142 INFO:teuthology.orchestra.run.smithi053.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-22T08:08:46.167 INFO:teuthology.orchestra.run.smithi053.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-22T08:08:46.192 INFO:teuthology.orchestra.run.smithi053.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-22T08:08:46.217 INFO:teuthology.orchestra.run.smithi053.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-22T08:08:46.243 INFO:teuthology.orchestra.run.smithi053.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-22T08:08:46.268 INFO:teuthology.orchestra.run.smithi053.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-22T08:08:46.272 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:08:46.273 INFO:teuthology.orchestra.run.smithi053.stdout:Total 9.1 MB/s | 31 MB 00:03 2024-09-22T08:08:46.434 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:08:46.478 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:08:46.478 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:08:46.946 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 37/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 1/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 3/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 4/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 5/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9. 6/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-22T08:08:46.947 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-22T08:08:46.948 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-22T08:08:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-22T08:08:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-22T08:08:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-22T08:08:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-22T08:08:46.949 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-22T08:08:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-22T08:08:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-22T08:08:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-22T08:08:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-22T08:08:46.950 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-22T08:08:46.964 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:08:46.965 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:08:47.942 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-22T08:08:47.942 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:47.942 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:08:47.942 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:47.942 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:47.942 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:47.942 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T08:08:47.943 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T08:08:47.944 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T08:08:47.945 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T08:08:47.945 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T08:08:47.945 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T08:08:47.945 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T08:08:47.945 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:47.945 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:08:48.329 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-base 2024-09-22T08:08:48.367 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:08:48.421 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-22T08:08:48.454 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-22T08:08:48.490 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-22T08:08:48.566 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-22T08:08:48.614 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-22T08:08:48.647 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-22T08:08:48.745 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-22T08:08:48.821 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-22T08:08:48.876 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-22T08:08:48.906 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:51 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:08:48.910 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-22T08:08:48.939 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-22T08:08:48.974 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-22T08:08:48.995 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:08:49.007 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-22T08:08:49.036 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:08:49.037 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-22T08:08:49.037 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:08:49.048 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-22T08:08:49.092 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-22T08:08:49.113 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install cephadm 2024-09-22T08:08:49.125 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-22T08:08:49.184 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-22T08:08:49.223 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-22T08:08:49.300 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-22T08:08:49.454 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-22T08:08:49.535 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-22T08:08:49.601 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-22T08:08:49.638 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-22T08:08:49.681 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:52 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:08:49.697 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-22T08:08:49.769 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-22T08:08:49.810 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:08:49.811 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:49.811 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-22T08:08:49.811 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:49.811 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:08:49.811 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 784 k 2024-09-22T08:08:49.811 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:49.811 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:08:49.811 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:49.811 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-22T08:08:49.811 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:49.812 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 784 k 2024-09-22T08:08:49.812 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 791 k 2024-09-22T08:08:49.812 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:08:49.984 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-22T08:08:50.034 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-22T08:08:50.082 INFO:teuthology.orchestra.run.smithi165.stdout:cephadm-19.3.0-5106.g8852379c.el9.noarch.rpm 2.8 MB/s | 784 kB 00:00 2024-09-22T08:08:50.082 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:08:50.083 INFO:teuthology.orchestra.run.smithi165.stdout:Total 2.8 MB/s | 784 kB 00:00 2024-09-22T08:08:50.083 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:08:50.088 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:08:50.088 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:08:50.094 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:08:50.094 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:08:50.116 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-22T08:08:50.165 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:08:50.214 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-22T08:08:50.249 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-22T08:08:50.388 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-22T08:08:50.570 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9. 32/37 2024-09-22T08:08:50.600 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 33/37 2024-09-22T08:08:50.627 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:08:50.628 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 33/37 2024-09-22T08:08:50.628 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:50.628 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T08:08:50.628 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:08:50.628 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:08:50.628 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:50.718 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:08:51.089 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:08:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:08:51.289 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:51.289 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:08:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:08:51.290 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:51.290 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:08:51.522 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T08:08:52.114 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:55 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:08:52.201 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 34/37 2024-09-22T08:08:52.230 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 34/37 2024-09-22T08:08:52.231 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:52.231 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T08:08:52.231 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:08:52.231 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:08:52.231 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:52.249 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:08:52.250 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:52.250 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-22T08:08:52.250 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:52.250 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:08:52.250 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5106.g8852379c.el9 ceph 145 k 2024-09-22T08:08:52.250 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:52.250 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:08:52.250 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:52.250 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-22T08:08:52.250 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:52.251 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 145 k 2024-09-22T08:08:52.251 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 432 k 2024-09-22T08:08:52.251 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:08:52.464 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-immutable-object-cache-19.3.0-5106.g885237 679 kB/s | 145 kB 00:00 2024-09-22T08:08:52.464 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:08:52.465 INFO:teuthology.orchestra.run.smithi165.stdout:Total 673 kB/s | 145 kB 00:00 2024-09-22T08:08:52.465 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:08:52.473 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:08:52.473 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:08:52.531 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:08:52.531 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:08:52.676 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:08:52.710 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 35/37 2024-09-22T08:08:52.736 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 35/37 2024-09-22T08:08:52.736 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:52.736 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T08:08:52.736 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:08:52.736 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:08:52.736 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:52.757 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:08:52.784 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:08:52.784 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:52.784 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T08:08:52.784 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:52.969 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 36/37 2024-09-22T08:08:52.995 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 36/37 2024-09-22T08:08:52.995 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:08:52.995 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T08:08:52.995 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:08:52.995 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:08:52.995 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:53.061 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 37/37 2024-09-22T08:08:53.730 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:08:53.731 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:53.731 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:08:53.731 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:53.731 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:53.731 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:08:53.953 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr 2024-09-22T08:08:54.540 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:57 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:08:54.633 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:08:54.674 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:08:54.675 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-22T08:08:54.676 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:08:54.751 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T08:08:54.806 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 37/37 2024-09-22T08:08:54.806 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 1/37 2024-09-22T08:08:54.806 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2/37 2024-09-22T08:08:54.806 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 3/37 2024-09-22T08:08:54.806 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 4/37 2024-09-22T08:08:54.806 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 5/37 2024-09-22T08:08:54.806 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9. 6/37 2024-09-22T08:08:54.807 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-22T08:08:54.807 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-22T08:08:54.807 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-22T08:08:54.807 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-22T08:08:54.807 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-22T08:08:54.807 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-22T08:08:54.808 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-22T08:08:54.808 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-22T08:08:54.808 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-22T08:08:54.808 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-22T08:08:54.808 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-22T08:08:54.808 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-22T08:08:54.808 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-22T08:08:54.809 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-22T08:08:54.809 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-22T08:08:54.809 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-22T08:08:54.809 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-22T08:08:54.809 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-22T08:08:54.809 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-22T08:08:54.809 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-22T08:08:54.810 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-22T08:08:54.810 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-22T08:08:54.810 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-22T08:08:54.810 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-22T08:08:54.810 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-22T08:08:54.810 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-22T08:08:54.811 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-22T08:08:54.811 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-22T08:08:54.811 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-22T08:08:54.811 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-22T08:08:55.325 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:58 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:08:55.456 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:08:55.457 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:55.457 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-22T08:08:55.457 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 14 M 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 34 k 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 16 k 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T08:08:55.458 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T08:08:55.459 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T08:08:55.459 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T08:08:55.459 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T08:08:55.459 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:55.459 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:08:55.459 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:08:55.459 INFO:teuthology.orchestra.run.smithi165.stdout:Install 12 Packages 2024-09-22T08:08:55.459 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:08:55.460 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 19 M 2024-09-22T08:08:55.460 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 159 M 2024-09-22T08:08:55.460 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:08:55.674 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-22T08:08:55.674 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:55.674 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:08:55.674 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:55.674 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:55.674 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:55.674 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:08:55.674 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:55.674 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:08:55.674 INFO:teuthology.orchestra.run.smithi053.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T08:08:55.675 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T08:08:55.676 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T08:08:55.677 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T08:08:55.677 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T08:08:55.677 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:55.677 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:08:56.029 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-base 2024-09-22T08:08:56.368 INFO:teuthology.orchestra.run.smithi165.stdout:(1/12): ceph-grafana-dashboards-19.3.0-5106.g88 245 kB/s | 34 kB 00:00 2024-09-22T08:08:56.394 INFO:teuthology.orchestra.run.smithi165.stdout:(2/12): ceph-prometheus-alerts-19.3.0-5106.g885 100 kB/s | 16 kB 00:00 2024-09-22T08:08:56.628 INFO:teuthology.orchestra.run.smithi165.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-22T08:08:56.629 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:53 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:08:56.719 INFO:teuthology.orchestra.run.smithi053.stdout:Package ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:08:56.763 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:08:56.764 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-22T08:08:56.764 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:08:56.778 INFO:teuthology.orchestra.run.smithi165.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 5.6 MB/s | 863 kB 00:00 2024-09-22T08:08:56.825 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install cephadm 2024-09-22T08:08:56.920 INFO:teuthology.orchestra.run.smithi165.stdout:(5/12): ceph-mgr-dashboard-19.3.0-5106.g8852379 21 MB/s | 14 MB 00:00 2024-09-22T08:08:56.979 INFO:teuthology.orchestra.run.smithi165.stdout:(6/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2024-09-22T08:08:57.004 INFO:teuthology.orchestra.run.smithi165.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 256 kB/s | 19 kB 00:00 2024-09-22T08:08:57.037 INFO:teuthology.orchestra.run.smithi165.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.5 MB/s | 144 kB 00:00 2024-09-22T08:08:57.063 INFO:teuthology.orchestra.run.smithi165.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-22T08:08:57.088 INFO:teuthology.orchestra.run.smithi165.stdout:(10/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.7 MB/s | 548 kB 00:00 2024-09-22T08:08:57.114 INFO:teuthology.orchestra.run.smithi165.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-22T08:08:57.172 INFO:teuthology.orchestra.run.smithi165.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-22T08:08:57.177 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:08:57.177 INFO:teuthology.orchestra.run.smithi165.stdout:Total 11 MB/s | 19 MB 00:01 2024-09-22T08:08:57.228 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:08:57.248 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:08:57.248 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:08:57.423 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:54 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:08:57.505 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:08:57.505 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:08:57.558 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 784 k 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 784 k 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 791 k 2024-09-22T08:08:57.559 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:08:57.842 INFO:teuthology.orchestra.run.smithi053.stdout:cephadm-19.3.0-5106.g8852379c.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-22T08:08:57.842 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:08:57.843 INFO:teuthology.orchestra.run.smithi053.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-22T08:08:57.843 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:08:57.849 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:08:57.849 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:08:57.855 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:08:57.855 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:08:57.930 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:08:58.104 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:08:58.181 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-22T08:08:58.224 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-22T08:08:58.272 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-22T08:08:58.310 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-22T08:08:58.408 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-22T08:08:58.432 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:08:58.523 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:08:58.536 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-22T08:08:58.638 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-22T08:08:58.757 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-22T08:08:58.785 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-22T08:08:58.818 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9 10/12 2024-09-22T08:08:58.856 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:08:59.121 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:08:59.122 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:59.122 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:08:59.122 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:08:59.122 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:08:59.122 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:08:59.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T08:08:59.936 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:56 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:00.072 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:00.073 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:00.073 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-09-22T08:09:00.074 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:00.074 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:00.074 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5106.g8852379c.el9 ceph 145 k 2024-09-22T08:09:00.074 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:00.074 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:00.074 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:00.075 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-22T08:09:00.075 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:00.075 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 145 k 2024-09-22T08:09:00.075 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 432 k 2024-09-22T08:09:00.075 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:00.291 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-immutable-object-cache-19.3.0-5106.g885237 667 kB/s | 145 kB 00:00 2024-09-22T08:09:00.292 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:00.292 INFO:teuthology.orchestra.run.smithi053.stdout:Total 662 kB/s | 145 kB 00:00 2024-09-22T08:09:00.292 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:00.300 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:00.300 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:00.363 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:00.363 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:09:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:09:00.635 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:09:00.635 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T08:09:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:01.545 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5106.g8852379c. 1/1 2024-09-22T08:09:01.545 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:01.546 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:01.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:01.546 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:01.546 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:01.786 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr 2024-09-22T08:09:01.992 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el 11/12 2024-09-22T08:09:02.056 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 12/12 2024-09-22T08:09:02.390 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:59 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:02.481 INFO:teuthology.orchestra.run.smithi053.stdout:Package ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:02.526 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:02.528 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-22T08:09:02.528 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:02.588 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T08:09:03.194 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:00 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:03.332 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:03.333 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:03.333 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-22T08:09:03.333 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:03.333 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 14 M 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 34 k 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 16 k 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T08:09:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T08:09:03.335 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:03.335 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:03.335 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:03.335 INFO:teuthology.orchestra.run.smithi053.stdout:Install 12 Packages 2024-09-22T08:09:03.335 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:03.335 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 19 M 2024-09-22T08:09:03.335 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 159 M 2024-09-22T08:09:03.336 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:03.878 INFO:teuthology.orchestra.run.smithi053.stdout:(1/12): ceph-grafana-dashboards-19.3.0-5106.g88 244 kB/s | 34 kB 00:00 2024-09-22T08:09:03.903 INFO:teuthology.orchestra.run.smithi053.stdout:(2/12): ceph-prometheus-alerts-19.3.0-5106.g885 99 kB/s | 16 kB 00:00 2024-09-22T08:09:03.931 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 12/12 2024-09-22T08:09:03.931 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el 1/12 2024-09-22T08:09:03.931 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 2/12 2024-09-22T08:09:03.931 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9 3/12 2024-09-22T08:09:03.932 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-22T08:09:03.932 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-22T08:09:03.932 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-22T08:09:03.932 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-22T08:09:03.932 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-22T08:09:03.932 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-22T08:09:03.932 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-22T08:09:03.932 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-22T08:09:04.045 INFO:teuthology.orchestra.run.smithi053.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-22T08:09:04.095 INFO:teuthology.orchestra.run.smithi053.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-22T08:09:04.154 INFO:teuthology.orchestra.run.smithi053.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-22T08:09:04.179 INFO:teuthology.orchestra.run.smithi053.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-22T08:09:04.244 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T08:09:04.245 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T08:09:04.246 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:04.246 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:04.246 INFO:teuthology.orchestra.run.smithi053.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-22T08:09:04.271 INFO:teuthology.orchestra.run.smithi053.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-22T08:09:04.296 INFO:teuthology.orchestra.run.smithi053.stdout:(9/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.4 MB/s | 863 kB 00:00 2024-09-22T08:09:04.321 INFO:teuthology.orchestra.run.smithi053.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 614 kB/s | 31 kB 00:00 2024-09-22T08:09:04.363 INFO:teuthology.orchestra.run.smithi053.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-09-22T08:09:04.511 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T08:09:04.530 INFO:teuthology.orchestra.run.smithi053.stdout:(12/12): ceph-mgr-dashboard-19.3.0-5106.g885237 18 MB/s | 14 MB 00:00 2024-09-22T08:09:04.534 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:04.534 INFO:teuthology.orchestra.run.smithi053.stdout:Total 16 MB/s | 19 MB 00:01 2024-09-22T08:09:04.584 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:04.604 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:04.604 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:04.885 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:04.886 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:05.090 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:08 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:05.222 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:05.223 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-09-22T08:09:05.223 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 7.4 M 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T08:09:05.224 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T08:09:05.225 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T08:09:05.225 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T08:09:05.225 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T08:09:05.225 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:05.225 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:09:05.225 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-09-22T08:09:05.225 INFO:teuthology.orchestra.run.smithi165.stdout:Install 12 Packages 2024-09-22T08:09:05.225 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:05.226 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 38 M 2024-09-22T08:09:05.226 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 212 M 2024-09-22T08:09:05.226 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:09:05.497 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:05.556 INFO:teuthology.orchestra.run.smithi165.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-22T08:09:05.565 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-22T08:09:05.608 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-22T08:09:05.613 INFO:teuthology.orchestra.run.smithi165.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-22T08:09:05.639 INFO:teuthology.orchestra.run.smithi165.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-22T08:09:05.655 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-22T08:09:05.681 INFO:teuthology.orchestra.run.smithi165.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 438 kB/s | 18 kB 00:00 2024-09-22T08:09:05.693 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-22T08:09:05.739 INFO:teuthology.orchestra.run.smithi165.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 660 kB/s | 38 kB 00:00 2024-09-22T08:09:05.793 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-22T08:09:05.856 INFO:teuthology.orchestra.run.smithi165.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-09-22T08:09:05.925 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-22T08:09:05.948 INFO:teuthology.orchestra.run.smithi165.stdout:(7/12): ceph-mgr-diskprediction-local-19.3.0-51 15 MB/s | 7.4 MB 00:00 2024-09-22T08:09:05.973 INFO:teuthology.orchestra.run.smithi165.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-22T08:09:06.016 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-22T08:09:06.049 INFO:teuthology.orchestra.run.smithi165.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 16 MB/s | 4.9 MB 00:00 2024-09-22T08:09:06.065 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-22T08:09:06.074 INFO:teuthology.orchestra.run.smithi165.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.4 MB/s | 250 kB 00:00 2024-09-22T08:09:06.092 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-22T08:09:06.117 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9 10/12 2024-09-22T08:09:06.316 INFO:teuthology.orchestra.run.smithi165.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 61 MB/s | 16 MB 00:00 2024-09-22T08:09:06.416 INFO:teuthology.orchestra.run.smithi165.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-22T08:09:06.417 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:06.417 INFO:teuthology.orchestra.run.smithi165.stdout:Total 32 MB/s | 38 MB 00:01 2024-09-22T08:09:06.767 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:09:06.793 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:09:06.793 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:09:07.223 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:09:07.224 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:09:08.023 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:09:08.099 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T08:09:08.139 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T08:09:08.241 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T08:09:08.274 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T08:09:08.458 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T08:09:08.490 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T08:09:08.566 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T08:09:09.231 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T08:09:09.345 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T08:09:09.487 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el 11/12 2024-09-22T08:09:09.546 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 12/12 2024-09-22T08:09:10.595 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T08:09:11.364 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 12/12 2024-09-22T08:09:11.364 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el 1/12 2024-09-22T08:09:11.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noa 2/12 2024-09-22T08:09:11.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9 3/12 2024-09-22T08:09:11.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-22T08:09:11.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-22T08:09:11.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-22T08:09:11.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-22T08:09:11.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-22T08:09:11.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-22T08:09:11.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-22T08:09:11.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-22T08:09:11.615 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T08:09:11.640 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 12/12 2024-09-22T08:09:11.695 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-22T08:09:11.695 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:11.695 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:11.695 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T08:09:11.695 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:11.695 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:11.695 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:11.695 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T08:09:11.695 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T08:09:11.695 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T08:09:11.696 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T08:09:11.696 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T08:09:11.696 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T08:09:11.696 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T08:09:11.696 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T08:09:11.696 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:11.696 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:11.949 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T08:09:12.566 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:09 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:12.708 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:12.709 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-09-22T08:09:12.709 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-22T08:09:12.709 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-09-22T08:09:12.709 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:12.709 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 7.4 M 2024-09-22T08:09:12.709 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:12.710 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-09-22T08:09:12.711 INFO:teuthology.orchestra.run.smithi053.stdout:Install 12 Packages 2024-09-22T08:09:12.711 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:12.711 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 38 M 2024-09-22T08:09:12.711 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 212 M 2024-09-22T08:09:12.711 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:13.003 INFO:teuthology.orchestra.run.smithi053.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-22T08:09:13.036 INFO:teuthology.orchestra.run.smithi053.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 5.3 MB/s | 801 kB 00:00 2024-09-22T08:09:13.120 INFO:teuthology.orchestra.run.smithi053.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-09-22T08:09:13.170 INFO:teuthology.orchestra.run.smithi053.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-22T08:09:13.221 INFO:teuthology.orchestra.run.smithi053.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-22T08:09:13.338 INFO:teuthology.orchestra.run.smithi053.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-51 16 MB/s | 7.4 MB 00:00 2024-09-22T08:09:13.571 INFO:teuthology.orchestra.run.smithi053.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.0 MB/s | 245 kB 00:00 2024-09-22T08:09:13.955 INFO:teuthology.orchestra.run.smithi053.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.3 MB/s | 3.0 MB 00:00 2024-09-22T08:09:14.039 INFO:teuthology.orchestra.run.smithi053.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-22T08:09:14.194 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 12/12 2024-09-22T08:09:14.194 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 1/12 2024-09-22T08:09:14.194 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T08:09:14.195 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T08:09:14.195 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T08:09:14.195 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T08:09:14.195 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T08:09:14.195 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T08:09:14.195 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T08:09:14.195 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T08:09:14.195 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T08:09:14.195 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T08:09:14.314 INFO:teuthology.orchestra.run.smithi053.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.5 MB/s | 4.9 MB 00:01 2024-09-22T08:09:14.606 INFO:teuthology.orchestra.run.smithi053.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.9 MB/s | 5.1 MB 00:01 2024-09-22T08:09:14.619 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T08:09:14.619 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:14.619 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:14.619 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:14.619 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T08:09:14.619 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T08:09:14.619 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T08:09:14.620 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T08:09:14.620 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T08:09:14.620 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T08:09:14.620 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T08:09:14.620 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T08:09:14.620 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T08:09:14.620 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T08:09:14.620 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T08:09:14.620 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:14.620 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:15.027 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-rook 2024-09-22T08:09:15.256 INFO:teuthology.orchestra.run.smithi053.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-22T08:09:15.257 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:15.257 INFO:teuthology.orchestra.run.smithi053.stdout:Total 15 MB/s | 38 MB 00:02 2024-09-22T08:09:15.621 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:15.622 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:18 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:15.649 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:15.649 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:15.755 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 49 k 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T08:09:15.757 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout:Install 13 Packages 2024-09-22T08:09:15.758 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:15.759 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 2.2 M 2024-09-22T08:09:15.759 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 26 M 2024-09-22T08:09:15.759 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:09:15.993 INFO:teuthology.orchestra.run.smithi165.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 148 kB/s | 19 kB 00:00 2024-09-22T08:09:16.018 INFO:teuthology.orchestra.run.smithi165.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 165 kB/s | 26 kB 00:00 2024-09-22T08:09:16.044 INFO:teuthology.orchestra.run.smithi165.stdout:(3/13): ceph-mgr-rook-19.3.0-5106.g8852379c.el9 274 kB/s | 49 kB 00:00 2024-09-22T08:09:16.102 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:16.102 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:16.152 INFO:teuthology.orchestra.run.smithi165.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-22T08:09:16.177 INFO:teuthology.orchestra.run.smithi165.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-22T08:09:16.211 INFO:teuthology.orchestra.run.smithi165.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-09-22T08:09:16.245 INFO:teuthology.orchestra.run.smithi165.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-22T08:09:16.270 INFO:teuthology.orchestra.run.smithi165.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 247 kB/s | 14 kB 00:00 2024-09-22T08:09:16.295 INFO:teuthology.orchestra.run.smithi165.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-09-22T08:09:16.321 INFO:teuthology.orchestra.run.smithi165.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.9 MB/s | 220 kB 00:00 2024-09-22T08:09:16.354 INFO:teuthology.orchestra.run.smithi165.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.3 MB/s | 90 kB 00:00 2024-09-22T08:09:16.380 INFO:teuthology.orchestra.run.smithi165.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 704 kB/s | 59 kB 00:00 2024-09-22T08:09:16.413 INFO:teuthology.orchestra.run.smithi165.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-22T08:09:16.416 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:16.416 INFO:teuthology.orchestra.run.smithi165.stdout:Total 3.4 MB/s | 2.2 MB 00:00 2024-09-22T08:09:16.478 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:09:16.493 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:09:16.493 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:09:16.583 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:09:16.583 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:09:16.890 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:16.963 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T08:09:17.028 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T08:09:17.093 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:09:17.133 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T08:09:17.164 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T08:09:17.268 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T08:09:17.332 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T08:09:17.355 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T08:09:17.386 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T08:09:17.387 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T08:09:17.424 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T08:09:17.466 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T08:09:17.466 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T08:09:17.567 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T08:09:17.669 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T08:09:17.734 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T08:09:18.154 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T08:09:18.279 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T08:09:18.456 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T08:09:18.506 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T08:09:18.540 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T08:09:18.589 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T08:09:18.627 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 13/13 2024-09-22T08:09:19.321 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 13/13 2024-09-22T08:09:19.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 1/13 2024-09-22T08:09:19.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T08:09:19.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T08:09:19.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T08:09:19.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T08:09:19.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T08:09:19.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T08:09:19.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T08:09:19.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T08:09:19.323 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T08:09:19.323 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T08:09:19.323 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T08:09:19.593 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T08:09:19.649 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T08:09:19.649 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:19.649 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:19.649 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:19.649 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T08:09:19.649 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T08:09:19.649 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:19.650 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:19.937 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T08:09:20.517 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:23 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:20.651 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:20.651 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 154 k 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:20.652 INFO:teuthology.orchestra.run.smithi165.stdout:Install 6 Packages 2024-09-22T08:09:20.653 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:20.653 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 7.0 M 2024-09-22T08:09:20.653 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 33 M 2024-09-22T08:09:20.653 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:09:20.680 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T08:09:20.711 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 12/12 2024-09-22T08:09:20.925 INFO:teuthology.orchestra.run.smithi165.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-22T08:09:20.950 INFO:teuthology.orchestra.run.smithi165.stdout:(2/6): ceph-mgr-cephadm-19.3.0-5106.g8852379c.e 663 kB/s | 154 kB 00:00 2024-09-22T08:09:21.009 INFO:teuthology.orchestra.run.smithi165.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-22T08:09:21.026 INFO:teuthology.orchestra.run.smithi165.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 767 kB/s | 58 kB 00:00 2024-09-22T08:09:21.060 INFO:teuthology.orchestra.run.smithi165.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-22T08:09:21.168 INFO:teuthology.orchestra.run.smithi165.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-22T08:09:21.171 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:21.171 INFO:teuthology.orchestra.run.smithi165.stdout:Total 14 MB/s | 7.0 MB 00:00 2024-09-22T08:09:21.241 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:09:21.252 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:09:21.253 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:09:21.352 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:09:21.353 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:09:21.664 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:09:21.833 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T08:09:21.887 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T08:09:22.424 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T08:09:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T08:09:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T08:09:22.616 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 6/6 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 12/12 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5106.g88523 1/12 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T08:09:23.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T08:09:23.317 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T08:09:23.393 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 6/6 2024-09-22T08:09:23.394 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/6 2024-09-22T08:09:23.394 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T08:09:23.394 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T08:09:23.394 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T08:09:23.394 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T08:09:23.674 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T08:09:23.674 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:23.674 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:23.674 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:23.674 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T08:09:23.674 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T08:09:23.674 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T08:09:23.674 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T08:09:23.674 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T08:09:23.675 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:23.675 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:23.719 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T08:09:23.719 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:23.719 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:23.719 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:23.719 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T08:09:23.719 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T08:09:23.719 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T08:09:23.719 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T08:09:23.719 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T08:09:23.720 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T08:09:23.720 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T08:09:23.720 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T08:09:23.720 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T08:09:23.720 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T08:09:23.720 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T08:09:23.720 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:23.720 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:23.948 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-fuse 2024-09-22T08:09:24.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-rook 2024-09-22T08:09:24.531 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:27 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:24.665 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:24.666 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:24.666 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-22T08:09:24.666 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:24.666 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:09:24.666 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 900 k 2024-09-22T08:09:24.666 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-22T08:09:24.667 INFO:teuthology.orchestra.run.smithi165.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T08:09:24.667 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:24.667 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:09:24.667 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:24.667 INFO:teuthology.orchestra.run.smithi165.stdout:Install 2 Packages 2024-09-22T08:09:24.667 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:24.667 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 980 k 2024-09-22T08:09:24.668 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 2.9 M 2024-09-22T08:09:24.668 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:09:24.684 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:21 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:24.824 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:24.825 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:24.825 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-22T08:09:24.825 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:24.825 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:24.825 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 49 k 2024-09-22T08:09:24.826 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-22T08:09:24.826 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T08:09:24.826 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T08:09:24.826 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T08:09:24.826 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T08:09:24.826 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T08:09:24.826 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T08:09:24.827 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T08:09:24.827 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T08:09:24.827 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T08:09:24.827 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T08:09:24.827 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T08:09:24.827 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T08:09:24.828 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:24.828 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:24.828 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:24.828 INFO:teuthology.orchestra.run.smithi053.stdout:Install 13 Packages 2024-09-22T08:09:24.828 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:24.829 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 2.2 M 2024-09-22T08:09:24.829 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 26 M 2024-09-22T08:09:24.829 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:24.969 INFO:teuthology.orchestra.run.smithi053.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 218 kB/s | 19 kB 00:00 2024-09-22T08:09:24.994 INFO:teuthology.orchestra.run.smithi053.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 226 kB/s | 26 kB 00:00 2024-09-22T08:09:25.029 INFO:teuthology.orchestra.run.smithi165.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 954 kB/s | 80 kB 00:00 2024-09-22T08:09:25.052 INFO:teuthology.orchestra.run.smithi053.stdout:(3/13): ceph-mgr-rook-19.3.0-5106.g8852379c.el9 287 kB/s | 49 kB 00:00 2024-09-22T08:09:25.078 INFO:teuthology.orchestra.run.smithi053.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-22T08:09:25.103 INFO:teuthology.orchestra.run.smithi053.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-22T08:09:25.128 INFO:teuthology.orchestra.run.smithi053.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-22T08:09:25.170 INFO:teuthology.orchestra.run.smithi053.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-22T08:09:25.195 INFO:teuthology.orchestra.run.smithi053.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-22T08:09:25.220 INFO:teuthology.orchestra.run.smithi053.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-09-22T08:09:25.221 INFO:teuthology.orchestra.run.smithi165.stdout:(2/2): ceph-fuse-19.3.0-5106.g8852379c.el9.x86_ 3.2 MB/s | 900 kB 00:00 2024-09-22T08:09:25.221 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:25.222 INFO:teuthology.orchestra.run.smithi165.stdout:Total 1.7 MB/s | 980 kB 00:00 2024-09-22T08:09:25.234 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:09:25.254 INFO:teuthology.orchestra.run.smithi053.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-22T08:09:25.255 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:09:25.255 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:09:25.288 INFO:teuthology.orchestra.run.smithi053.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.8 MB/s | 90 kB 00:00 2024-09-22T08:09:25.313 INFO:teuthology.orchestra.run.smithi053.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2024-09-22T08:09:25.337 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:09:25.338 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:09:25.346 INFO:teuthology.orchestra.run.smithi053.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-22T08:09:25.349 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:25.349 INFO:teuthology.orchestra.run.smithi053.stdout:Total 4.2 MB/s | 2.2 MB 00:00 2024-09-22T08:09:25.415 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:25.432 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:25.432 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:25.532 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:25.534 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:25.559 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:09:25.691 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T08:09:25.754 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2/2 2024-09-22T08:09:26.088 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:26.271 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T08:09:26.341 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T08:09:26.397 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T08:09:26.430 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2/2 2024-09-22T08:09:26.430 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/2 2024-09-22T08:09:26.432 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T08:09:26.475 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T08:09:26.582 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T08:09:26.692 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T08:09:26.715 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T08:09:26.715 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:26.715 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:26.715 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T08:09:26.715 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:26.715 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:26.744 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T08:09:26.994 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-volume 2024-09-22T08:09:27.516 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T08:09:27.572 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T08:09:27.592 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:30 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:27.598 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T08:09:27.647 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T08:09:27.675 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 13/13 2024-09-22T08:09:27.724 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:27.725 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:27.725 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-22T08:09:27.725 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:27.725 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:09:27.726 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 285 k 2024-09-22T08:09:27.726 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:27.726 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:09:27.726 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:27.726 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-22T08:09:27.726 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:27.726 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 285 k 2024-09-22T08:09:27.726 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 1.3 M 2024-09-22T08:09:27.726 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:09:27.968 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-volume-19.3.0-5106.g8852379c.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-22T08:09:27.969 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:27.969 INFO:teuthology.orchestra.run.smithi165.stdout:Total 1.1 MB/s | 285 kB 00:00 2024-09-22T08:09:27.969 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:09:27.978 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:09:27.978 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:09:28.007 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:09:28.007 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:09:28.230 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:09:28.295 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:09:28.311 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:09:28.311 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:09:28.311 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T08:09:28.311 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:28.450 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 13/13 2024-09-22T08:09:28.450 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 1/13 2024-09-22T08:09:28.450 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T08:09:28.450 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T08:09:28.450 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T08:09:28.451 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T08:09:28.451 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T08:09:28.451 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T08:09:28.451 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T08:09:28.451 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T08:09:28.451 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T08:09:28.451 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T08:09:28.451 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T08:09:28.787 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T08:09:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T08:09:28.789 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T08:09:28.789 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:28.789 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:29.059 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T08:09:29.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:09:29.322 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:29.323 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:29.323 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:29.323 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:29.323 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:29.632 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados-devel 2024-09-22T08:09:29.660 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:26 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:29.800 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:29.800 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:29.800 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 154 k 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout:Install 6 Packages 2024-09-22T08:09:29.801 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:29.802 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 7.0 M 2024-09-22T08:09:29.802 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 33 M 2024-09-22T08:09:29.802 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:30.234 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:33 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:30.239 INFO:teuthology.orchestra.run.smithi053.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.6 MB/s | 248 kB 00:00 2024-09-22T08:09:30.290 INFO:teuthology.orchestra.run.smithi053.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-22T08:09:30.315 INFO:teuthology.orchestra.run.smithi053.stdout:(3/6): ceph-mgr-cephadm-19.3.0-5106.g8852379c.e 670 kB/s | 154 kB 00:00 2024-09-22T08:09:30.340 INFO:teuthology.orchestra.run.smithi053.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-22T08:09:30.372 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:30.373 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-22T08:09:30.373 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:30.373 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:09:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 127 k 2024-09-22T08:09:30.373 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:30.373 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:09:30.373 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:30.374 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-22T08:09:30.374 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:30.374 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 127 k 2024-09-22T08:09:30.374 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 456 k 2024-09-22T08:09:30.374 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:09:30.382 INFO:teuthology.orchestra.run.smithi053.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-22T08:09:30.466 INFO:teuthology.orchestra.run.smithi053.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-22T08:09:30.468 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:30.468 INFO:teuthology.orchestra.run.smithi053.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-22T08:09:30.542 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:30.557 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:30.557 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:30.582 INFO:teuthology.orchestra.run.smithi165.stdout:librados-devel-19.3.0-5106.g8852379c.el9.x86_64 609 kB/s | 127 kB 00:00 2024-09-22T08:09:30.583 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:30.583 INFO:teuthology.orchestra.run.smithi165.stdout:Total 605 kB/s | 127 kB 00:00 2024-09-22T08:09:30.583 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:09:30.588 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:09:30.589 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:09:30.652 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:09:30.652 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:09:30.661 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:30.662 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:30.806 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:09:30.905 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:30.977 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:31.155 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T08:09:31.227 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T08:09:31.347 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:31.622 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:31.623 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:31.623 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:31.623 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:31.623 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:31.623 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:31.782 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T08:09:31.873 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T08:09:31.885 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs2 2024-09-22T08:09:31.949 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T08:09:31.980 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 6/6 2024-09-22T08:09:32.481 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:35 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:32.574 INFO:teuthology.orchestra.run.smithi165.stdout:Package libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:32.619 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:32.620 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-22T08:09:32.620 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:32.693 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs-devel 2024-09-22T08:09:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 6/6 2024-09-22T08:09:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 1/6 2024-09-22T08:09:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T08:09:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T08:09:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T08:09:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T08:09:33.058 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T08:09:33.059 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:33.059 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:33.059 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:33.059 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T08:09:33.059 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T08:09:33.059 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T08:09:33.059 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T08:09:33.059 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T08:09:33.059 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:33.059 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:33.275 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:36 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:33.291 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-fuse 2024-09-22T08:09:33.407 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:33.408 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:33.408 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-22T08:09:33.408 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:33.408 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:09:33.408 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 32 k 2024-09-22T08:09:33.409 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:33.409 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:09:33.409 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:33.409 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-22T08:09:33.409 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:33.409 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 32 k 2024-09-22T08:09:33.409 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 142 k 2024-09-22T08:09:33.409 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:09:33.562 INFO:teuthology.orchestra.run.smithi165.stdout:libcephfs-devel-19.3.0-5106.g8852379c.el9.x86_6 208 kB/s | 32 kB 00:00 2024-09-22T08:09:33.562 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:33.563 INFO:teuthology.orchestra.run.smithi165.stdout:Total 206 kB/s | 32 kB 00:00 2024-09-22T08:09:33.563 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:09:33.566 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:09:33.566 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:09:33.583 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:09:33.583 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:09:33.669 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:09:33.784 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:33.897 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:30 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:34.037 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:34.037 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:34.037 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-22T08:09:34.037 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:34.037 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:34.037 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 900 k 2024-09-22T08:09:34.037 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-22T08:09:34.038 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T08:09:34.038 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:34.038 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:34.038 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:34.038 INFO:teuthology.orchestra.run.smithi053.stdout:Install 2 Packages 2024-09-22T08:09:34.038 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:34.038 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 980 k 2024-09-22T08:09:34.039 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 2.9 M 2024-09-22T08:09:34.039 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:34.149 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:34.388 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:34.388 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:34.388 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:34.388 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:34.388 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:34.388 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:34.451 INFO:teuthology.orchestra.run.smithi053.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 645 kB/s | 80 kB 00:00 2024-09-22T08:09:34.578 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados2 2024-09-22T08:09:34.619 INFO:teuthology.orchestra.run.smithi053.stdout:(2/2): ceph-fuse-19.3.0-5106.g8852379c.el9.x86_ 3.0 MB/s | 900 kB 00:00 2024-09-22T08:09:34.619 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:34.619 INFO:teuthology.orchestra.run.smithi053.stdout:Total 1.6 MB/s | 980 kB 00:00 2024-09-22T08:09:34.632 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:34.656 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:34.656 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:34.741 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:34.745 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:34.935 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:35.075 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T08:09:35.154 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2/2 2024-09-22T08:09:35.162 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:38 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:35.251 INFO:teuthology.orchestra.run.smithi165.stdout:Package librados2-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:35.293 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:35.294 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-22T08:09:35.294 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:35.361 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librbd1 2024-09-22T08:09:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2/2 2024-09-22T08:09:35.840 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/2 2024-09-22T08:09:35.982 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:38 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:36.071 INFO:teuthology.orchestra.run.smithi165.stdout:Package librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:36.114 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:36.115 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-22T08:09:36.116 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:36.167 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T08:09:36.167 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:36.167 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:36.167 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T08:09:36.167 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:36.167 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:36.187 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rados 2024-09-22T08:09:36.445 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-volume 2024-09-22T08:09:36.766 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:39 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:36.856 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:36.901 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:36.902 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-22T08:09:36.902 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:36.969 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rgw 2024-09-22T08:09:37.051 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:34 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:37.190 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:37.191 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-22T08:09:37.191 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:37.191 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 285 k 2024-09-22T08:09:37.191 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:37.192 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:37.192 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:37.192 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-22T08:09:37.192 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:37.192 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 285 k 2024-09-22T08:09:37.192 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 1.3 M 2024-09-22T08:09:37.192 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-volume-19.3.0-5106.g8852379c.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-22T08:09:37.422 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:37.422 INFO:teuthology.orchestra.run.smithi053.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-22T08:09:37.423 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:37.432 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:37.432 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:37.465 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:37.465 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:37.544 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:40 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:37.632 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:37.675 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:37.676 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-22T08:09:37.676 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:37.698 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:37.753 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-cephfs 2024-09-22T08:09:37.765 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:09:37.782 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:09:37.783 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:09:37.783 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T08:09:37.783 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:38.336 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:41 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:38.425 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:38.468 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:38.469 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-22T08:09:38.469 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:38.544 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rbd 2024-09-22T08:09:38.815 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 1/1 2024-09-22T08:09:38.816 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:38.816 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:38.816 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:09:38.816 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:38.816 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:39.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librados-devel 2024-09-22T08:09:39.125 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:42 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:39.215 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:39.259 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:39.260 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-22T08:09:39.260 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:39.333 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-fuse 2024-09-22T08:09:39.697 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:36 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:39.836 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:39.837 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-09-22T08:09:39.837 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:39.837 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:39.837 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 127 k 2024-09-22T08:09:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:39.838 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:39.838 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:39.838 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-22T08:09:39.838 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:39.838 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 127 k 2024-09-22T08:09:39.838 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 456 k 2024-09-22T08:09:39.838 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:39.909 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:42 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:40.040 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:40.041 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:40.041 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-22T08:09:40.041 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:40.041 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:09:40.041 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 85 k 2024-09-22T08:09:40.041 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:40.042 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:09:40.042 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:40.042 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-22T08:09:40.042 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:40.042 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 85 k 2024-09-22T08:09:40.042 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 231 k 2024-09-22T08:09:40.042 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:09:40.043 INFO:teuthology.orchestra.run.smithi053.stdout:librados-devel-19.3.0-5106.g8852379c.el9.x86_64 618 kB/s | 127 kB 00:00 2024-09-22T08:09:40.043 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:40.044 INFO:teuthology.orchestra.run.smithi053.stdout:Total 613 kB/s | 127 kB 00:00 2024-09-22T08:09:40.044 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:40.050 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:40.050 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:40.117 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:40.117 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:40.231 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-fuse-19.3.0-5106.g8852379c.el9.x86_64.rpm 450 kB/s | 85 kB 00:00 2024-09-22T08:09:40.232 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:40.232 INFO:teuthology.orchestra.run.smithi165.stdout:Total 447 kB/s | 85 kB 00:00 2024-09-22T08:09:40.232 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:09:40.239 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:09:40.239 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:09:40.274 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:40.301 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:09:40.302 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:09:40.377 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:40.447 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:09:40.545 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:40.795 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:40.942 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:41.032 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:41.032 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:41.032 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:41.032 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:41.033 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:41.033 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:41.188 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:41.188 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:41.188 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:41.188 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:41.188 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:41.188 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:41.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install libcephfs2 2024-09-22T08:09:41.443 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-mirror 2024-09-22T08:09:41.877 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:38 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:41.969 INFO:teuthology.orchestra.run.smithi053.stdout:Package libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:42.018 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:42.018 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-22T08:09:42.018 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:42.055 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:45 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:42.077 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install libcephfs-devel 2024-09-22T08:09:42.200 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:42.201 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:42.201 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-22T08:09:42.201 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:42.201 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:09:42.201 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:09:42.201 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:42.201 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:09:42.201 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:42.201 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-22T08:09:42.201 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:42.202 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 3.2 M 2024-09-22T08:09:42.202 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 14 M 2024-09-22T08:09:42.202 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:09:42.545 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-mirror-19.3.0-5106.g8852379c.el9.x86_64.rpm 9.3 MB/s | 3.2 MB 00:00 2024-09-22T08:09:42.546 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:42.546 INFO:teuthology.orchestra.run.smithi165.stdout:Total 9.3 MB/s | 3.2 MB 00:00 2024-09-22T08:09:42.546 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:09:42.556 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:09:42.556 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:09:42.641 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:09:42.641 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:09:42.686 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:39 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:42.825 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:42.825 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:42.825 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-09-22T08:09:42.825 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:42.825 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 32 k 2024-09-22T08:09:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:42.826 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:42.826 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:42.826 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-22T08:09:42.826 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:42.826 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 32 k 2024-09-22T08:09:42.827 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 142 k 2024-09-22T08:09:42.827 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:42.979 INFO:teuthology.orchestra.run.smithi053.stdout:libcephfs-devel-19.3.0-5106.g8852379c.el9.x86_6 208 kB/s | 32 kB 00:00 2024-09-22T08:09:42.980 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:42.980 INFO:teuthology.orchestra.run.smithi053.stdout:Total 206 kB/s | 32 kB 00:00 2024-09-22T08:09:42.980 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:42.984 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:42.984 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:42.998 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:42.998 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:43.084 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:43.092 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:09:43.154 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:43.181 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:43.181 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:09:43.181 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T08:09:43.181 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:09:43.181 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:09:43.181 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:43.196 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:43.567 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:43.843 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:43.843 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:43.843 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:43.843 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:43.843 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:43.843 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:44.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librados2 2024-09-22T08:09:44.262 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:44.262 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:44.262 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:44.262 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:44.262 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:44.262 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:44.506 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-nbd 2024-09-22T08:09:44.652 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:41 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:44.746 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:44.792 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-22T08:09:44.793 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:44.852 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librbd1 2024-09-22T08:09:45.104 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:48 ago on Sun 22 Sep 2024 08:07:57 AM UTC. 2024-09-22T08:09:45.237 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 170 k 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 170 k 2024-09-22T08:09:45.238 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 490 k 2024-09-22T08:09:45.239 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-22T08:09:45.449 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-nbd-19.3.0-5106.g8852379c.el9.x86_64.rpm 811 kB/s | 170 kB 00:00 2024-09-22T08:09:45.449 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:45.449 INFO:teuthology.orchestra.run.smithi165.stdout:Total 806 kB/s | 170 kB 00:00 2024-09-22T08:09:45.450 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-22T08:09:45.457 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:42 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:45.457 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-22T08:09:45.457 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-22T08:09:45.520 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-22T08:09:45.521 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-22T08:09:45.550 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:45.595 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:45.596 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-22T08:09:45.596 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:45.656 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rados 2024-09-22T08:09:45.673 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-22T08:09:45.779 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:46.216 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:46.260 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:43 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:46.353 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:46.400 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:46.401 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-22T08:09:46.401 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:46.456 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rgw 2024-09-22T08:09:46.466 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:46.466 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:46.466 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-22T08:09:46.466 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:46.466 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:46.466 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-22T08:09:46.753 DEBUG:teuthology.parallel:result is None 2024-09-22T08:09:47.053 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:44 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:47.146 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:47.191 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:47.192 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-22T08:09:47.192 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:47.250 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-cephfs 2024-09-22T08:09:47.854 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:44 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:47.946 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:47.991 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:47.992 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-22T08:09:47.992 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:48.051 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rbd 2024-09-22T08:09:48.651 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:45 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:48.745 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 is already installed. 2024-09-22T08:09:48.791 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:48.792 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-22T08:09:48.792 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:48.857 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-fuse 2024-09-22T08:09:49.465 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:46 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:49.604 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:49.604 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:49.604 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 85 k 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 85 k 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 231 k 2024-09-22T08:09:49.605 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:49.783 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-fuse-19.3.0-5106.g8852379c.el9.x86_64.rpm 479 kB/s | 85 kB 00:00 2024-09-22T08:09:49.784 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:49.784 INFO:teuthology.orchestra.run.smithi053.stdout:Total 474 kB/s | 85 kB 00:00 2024-09-22T08:09:49.784 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:49.792 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:49.792 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:49.859 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:49.859 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:50.008 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:50.109 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:50.772 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:50.773 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:50.773 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:50.773 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:50.773 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:50.773 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:51.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-mirror 2024-09-22T08:09:51.633 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:48 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:51.775 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:51.775 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 3.2 M 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 14 M 2024-09-22T08:09:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:52.103 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-mirror-19.3.0-5106.g8852379c.el9.x86_64.rpm 9.8 MB/s | 3.2 MB 00:00 2024-09-22T08:09:52.103 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:52.104 INFO:teuthology.orchestra.run.smithi053.stdout:Total 9.7 MB/s | 3.2 MB 00:00 2024-09-22T08:09:52.104 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:52.114 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:52.114 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:52.201 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:52.201 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:52.664 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:52.728 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:52.756 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:52.756 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:09:52.756 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T08:09:52.756 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:09:52.756 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:09:52.756 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:53.805 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:53.806 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:53.806 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:53.806 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:53.806 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:53.806 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:54.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-nbd 2024-09-22T08:09:54.646 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:51 ago on Sun 22 Sep 2024 08:08:03 AM UTC. 2024-09-22T08:09:54.786 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-22T08:09:54.787 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:54.787 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-22T08:09:54.787 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:54.787 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-22T08:09:54.787 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 170 k 2024-09-22T08:09:54.787 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:54.787 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-22T08:09:54.787 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-22T08:09:54.787 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-22T08:09:54.788 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:54.788 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 170 k 2024-09-22T08:09:54.788 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 490 k 2024-09-22T08:09:54.788 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-22T08:09:55.055 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-nbd-19.3.0-5106.g8852379c.el9.x86_64.rpm 638 kB/s | 170 kB 00:00 2024-09-22T08:09:55.056 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:09:55.056 INFO:teuthology.orchestra.run.smithi053.stdout:Total 634 kB/s | 170 kB 00:00 2024-09-22T08:09:55.056 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-22T08:09:55.065 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-22T08:09:55.065 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-22T08:09:55.132 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-22T08:09:55.132 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-22T08:09:55.292 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-22T08:09:55.411 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:55.826 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:56.124 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 1/1 2024-09-22T08:09:56.125 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:56.125 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-22T08:09:56.125 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:09:56.125 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:56.125 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-22T08:09:56.461 DEBUG:teuthology.parallel:result is None 2024-09-22T08:09:56.462 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:09:56.621 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T08:09:56.645 INFO:teuthology.orchestra.run.smithi053.stdout:19.3.0-5106.g8852379c.el9 2024-09-22T08:09:56.646 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5106.g8852379c.el9 2024-09-22T08:09:56.646 INFO:teuthology.task.install:The correct ceph version 19.3.0-5106.g8852379c is installed. 2024-09-22T08:09:56.648 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:09:56.798 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T08:09:56.823 INFO:teuthology.orchestra.run.smithi165.stdout:19.3.0-5106.g8852379c.el9 2024-09-22T08:09:56.824 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5106.g8852379c.el9 2024-09-22T08:09:56.824 INFO:teuthology.task.install:The correct ceph version 19.3.0-5106.g8852379c is installed. 2024-09-22T08:09:56.826 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-22T08:09:56.826 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:09:56.826 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T08:09:56.855 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:09:56.855 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T08:09:56.893 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-22T08:09:56.893 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:09:56.893 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T08:09:56.923 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T08:09:56.991 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:09:56.991 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T08:09:57.020 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T08:09:57.087 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-22T08:09:57.087 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:09:57.087 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T08:09:57.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T08:09:57.184 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:09:57.184 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T08:09:57.211 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T08:09:57.277 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-22T08:09:57.278 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:09:57.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T08:09:57.305 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T08:09:57.372 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:09:57.372 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T08:09:57.398 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T08:09:57.464 INFO:teuthology.run_tasks:Running task ceph... 2024-09-22T08:09:57.537 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-22T08:09:57.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2024-09-22T08:09:57.540 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /var/log/ceph 2024-09-22T08:09:57.566 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-22T08:09:57.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T08:09:57.608 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T08:09:57.633 INFO:tasks.ceph:Creating extra log directories... 2024-09-22T08:09:57.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T08:09:57.675 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T08:09:57.707 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-22T08:09:57.707 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-22T08:09:57.708 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034', 'branch': 'wip-skoduri-cloud-restore', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7915034', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-skoduri-cloud-restore'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-skoduri-cloud-restore', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, 'owner': 'scheduled_soumyakoduri@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-skoduri-cloud-restore', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHfFlQm3ll1QQAJSUO+BzFsiSOTJQtQd8JnDp6UzWoJhKqDMz4OK0N9oOI5FfZV5WN7Upb7tJbH3cOGx4vutYjQ=', 'smithi165.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLSTggLxTN5Ec9T54ELqwixlhd57iWbVv9SxhBLRLZiIzqgY3dO2CsgjiDkYZhQFMJn3fh+uUtKivl5cQbbEwro='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-22_06:37:27', 'tube': 'smithi', 'user': 'soumyakoduri', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-22T08:09:57.708 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T08:09:57.742 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T08:09:57.757 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T08:09:57.797 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T08:09:57.822 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:09:57.822 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T08:09:57.878 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T08:09:57.878 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-09-22T08:09:57.934 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T08:09:57.934 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:09:57.934 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-22T08:09:57.934 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:09:57.934 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:09:57.934 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-22 08:09:53.007413022 +0000 2024-09-22T08:09:57.934 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-22 08:07:20.694717937 +0000 2024-09-22T08:09:57.934 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-22 08:07:20.694717937 +0000 2024-09-22T08:09:57.934 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-22 08:07:20.694717937 +0000 2024-09-22T08:09:57.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T08:09:57.998 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-22T08:09:57.998 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-22T08:09:57.998 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 8.3271e-05 s, 6.1 MB/s 2024-09-22T08:09:57.999 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T08:09:58.056 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-09-22T08:09:58.112 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T08:09:58.112 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:09:58.112 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-22T08:09:58.112 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:09:58.112 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:09:58.113 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-22 08:09:53.007413022 +0000 2024-09-22T08:09:58.113 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-22 08:07:20.994712188 +0000 2024-09-22T08:09:58.113 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-22 08:07:20.994712188 +0000 2024-09-22T08:09:58.113 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-22 08:07:20.994712188 +0000 2024-09-22T08:09:58.113 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T08:09:58.176 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-22T08:09:58.176 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-22T08:09:58.176 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000104852 s, 4.9 MB/s 2024-09-22T08:09:58.177 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T08:09:58.233 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-09-22T08:09:58.289 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T08:09:58.289 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:09:58.289 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-22T08:09:58.289 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:09:58.289 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:09:58.289 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-22 08:09:53.008413003 +0000 2024-09-22T08:09:58.289 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-22 08:07:21.303706268 +0000 2024-09-22T08:09:58.289 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-22 08:07:21.303706268 +0000 2024-09-22T08:09:58.290 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-22 08:07:21.303706268 +0000 2024-09-22T08:09:58.290 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T08:09:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-22T08:09:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-22T08:09:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000116332 s, 4.4 MB/s 2024-09-22T08:09:58.354 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T08:09:58.411 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-09-22T08:09:58.467 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T08:09:58.467 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:09:58.467 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-22T08:09:58.467 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:09:58.467 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:09:58.467 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-22 08:09:53.008413003 +0000 2024-09-22T08:09:58.468 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-22 08:07:21.635699907 +0000 2024-09-22T08:09:58.468 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-22 08:07:21.635699907 +0000 2024-09-22T08:09:58.468 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-22 08:07:21.635699907 +0000 2024-09-22T08:09:58.468 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T08:09:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-22T08:09:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-22T08:09:58.531 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 8.433e-05 s, 6.1 MB/s 2024-09-22T08:09:58.532 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T08:09:58.588 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-22T08:09:58.589 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:09:58.589 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T08:09:58.606 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T08:09:58.606 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-09-22T08:09:58.662 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T08:09:58.663 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:09:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-22T08:09:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:09:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:09:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-22 08:09:43.447299235 +0000 2024-09-22T08:09:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-22 08:07:17.149503263 +0000 2024-09-22T08:09:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-22 08:07:17.149503263 +0000 2024-09-22T08:09:58.663 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-22 08:07:17.149503263 +0000 2024-09-22T08:09:58.663 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T08:09:58.728 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-22T08:09:58.728 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-22T08:09:58.728 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000273738 s, 1.9 MB/s 2024-09-22T08:09:58.730 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T08:09:58.787 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-09-22T08:09:58.842 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T08:09:58.842 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:09:58.843 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-22T08:09:58.843 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:09:58.843 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:09:58.843 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-22 08:09:43.448299219 +0000 2024-09-22T08:09:58.843 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-22 08:07:17.492498387 +0000 2024-09-22T08:09:58.843 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-22 08:07:17.492498387 +0000 2024-09-22T08:09:58.843 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-22 08:07:17.492498387 +0000 2024-09-22T08:09:58.843 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T08:09:58.906 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-22T08:09:58.906 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-22T08:09:58.906 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000177543 s, 2.9 MB/s 2024-09-22T08:09:58.908 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T08:09:58.965 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-09-22T08:09:59.019 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T08:09:59.020 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:09:59.020 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-22T08:09:59.020 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:09:59.020 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:09:59.020 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-22 08:09:43.448299219 +0000 2024-09-22T08:09:59.020 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-22 08:07:17.815493795 +0000 2024-09-22T08:09:59.020 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-22 08:07:17.815493795 +0000 2024-09-22T08:09:59.020 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-22 08:07:17.815493795 +0000 2024-09-22T08:09:59.020 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T08:09:59.082 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-22T08:09:59.083 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-22T08:09:59.083 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.00024323 s, 2.1 MB/s 2024-09-22T08:09:59.084 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T08:09:59.140 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-09-22T08:09:59.195 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T08:09:59.196 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:09:59.196 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-22T08:09:59.196 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:09:59.196 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:09:59.196 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-22 08:09:43.448299219 +0000 2024-09-22T08:09:59.196 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-22 08:07:18.125489388 +0000 2024-09-22T08:09:59.196 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-22 08:07:18.125489388 +0000 2024-09-22T08:09:59.196 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-22 08:07:18.125489388 +0000 2024-09-22T08:09:59.196 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T08:09:59.259 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-22T08:09:59.259 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-22T08:09:59.259 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.00019235 s, 2.7 MB/s 2024-09-22T08:09:59.260 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T08:09:59.316 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-22T08:09:59.317 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-22T08:09:59.317 INFO:tasks.ceph:Generating config... 2024-09-22T08:09:59.318 INFO:tasks.ceph:[client] debug ms = 1 2024-09-22T08:09:59.318 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-22T08:09:59.318 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-22T08:09:59.318 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-22T08:09:59.318 INFO:tasks.ceph:[client] setuser = ceph 2024-09-22T08:09:59.318 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-22T08:09:59.318 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-22T08:09:59.318 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-22T08:09:59.319 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-22T08:09:59.319 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-22T08:09:59.319 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-22T08:09:59.320 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-22T08:09:59.320 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-22T08:09:59.320 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-22T08:09:59.320 INFO:tasks.ceph:Setting up mon.a... 2024-09-22T08:09:59.320 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-22T08:09:59.403 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2024-09-22T08:09:59.406 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-22T08:09:59.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:09:59.477 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53')] 2024-09-22T08:09:59.477 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-22T08:09:59.478 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:09:59.478 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T08:09:59.533 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:09:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:09:59.613 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:09:59.614 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:09:59.614 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid e28b0ed0-1272-43e5-8a68-aa2f8d89bec5 2024-09-22T08:09:59.614 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = quincy 2024-09-22T08:09:59.614 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2024-09-22T08:09:59.614 INFO:teuthology.orchestra.run.smithi053.stdout:fsid e28b0ed0-1272-43e5-8a68-aa2f8d89bec5 2024-09-22T08:09:59.615 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2024-09-22T08:09:59.614468+0000 2024-09-22T08:09:59.615 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-22T08:09:59.614468+0000 2024-09-22T08:09:59.615 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 17 (quincy) 2024-09-22T08:09:59.615 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2024-09-22T08:09:59.615 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-09-22T08:09:59.615 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-22T08:09:59.616 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T08:09:59.672 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e28b0ed0-1272-43e5-8a68-aa2f8d89bec5... 2024-09-22T08:09:59.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T08:09:59.715 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T08:09:59.756 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-09-22T08:09:59.756 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2024-09-22T08:09:59.756 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T08:09:59.756 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2024-09-22T08:09:59.756 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2024-09-22T08:09:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = 172.21.15.53 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = e28b0ed0-1272-43e5-8a68-aa2f8d89bec5 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.759 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug trim objects = true 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: debug objclass = 20 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2024-09-22T08:09:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-22T08:09:59.762 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2024-09-22T08:09:59.763 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2024-09-22T08:09:59.764 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout: rgw gc obj min wait = 15 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout: debug rgw = 20 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout: setgroup = ceph 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout: setuser = ceph 2024-09-22T08:09:59.765 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout:[global] 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: chdir = "" 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: auth supported = cephx 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: filestore xattr use omap = true 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: mon clock drift allowed = 1.000 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: osd crush chooseleaf type = 0 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: auth debug = true 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on old message = true 2024-09-22T08:09:59.766 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on bug = true 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: mon pg warn max object skew = 0 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default size = 2 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow primary affinity = true 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow pg remap = true 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on legacy crush tunables = false 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on crush straw calc version zero = false 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on no sortbitwise = false 2024-09-22T08:09:59.767 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on osd down out interval zero = false 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on too few osds = false 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: mon_allow_pool_size_one = true 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: osd default data pool replay window = 5 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: mon allow pool delete = true 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: mon cluster log file level = debug 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: debug asserts on shutdown = true 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: mon health detail to clog = false 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: mon host = 172.21.15.53 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: fsid = e28b0ed0-1272-43e5-8a68-aa2f8d89bec5 2024-09-22T08:09:59.768 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout:[osd] 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: osd journal size = 100 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub load threshold = 5.0 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub max interval = 600 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock profile = high_recovery_ops 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: osd recover clone overlap = true 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: osd recovery max chunk = 1048576 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug shutdown = true 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug op order = true 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify stray on activate = true 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug trim objects = true 2024-09-22T08:09:59.769 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: osd open classes on start = true 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug pg log writeout = true 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: osd deep scrub update digest min age = 30 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: osd map max advance = 10 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: journal zero on create = true 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: filestore ondisk finisher threads = 3 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: filestore apply finisher threads = 3 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: bdev debug aio = true 2024-09-22T08:09:59.770 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug misdirected ops = true 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: debug objclass = 20 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: bdev async discard = True 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: bdev enable discard = True 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore allocator = bitmap 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore block size = 96636764160 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore fsck on mount = True 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluefs = 1/20 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluestore = 1/20 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: debug osd = 20 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: debug rocksdb = 4/10 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd full ratio = 0.9 2024-09-22T08:09:59.771 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd nearfull ratio = 0.8 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: osd failsafe full ratio = 0.95 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: osd objectstore = bluestore 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr] 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: debug mgr = 20 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: mgr/telemetry/nag = false 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout:[mon] 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-22T08:09:59.772 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: debug paxos = 20 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: mon data avail warn = 5 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: mon mgr mkfs grace = 240 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd reporter subtree level = osd 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd prime pg temp = true 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.773 INFO:teuthology.orchestra.run.smithi165.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: # 1m isn't quite enough 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: mon_down_mkfs_grace = 2m 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_filestore_osds = false 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout:[client] 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: rgw cache enabled = true 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable ops log = true 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable usage log = true 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T08:09:59.774 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-22T08:09:59.775 INFO:teuthology.orchestra.run.smithi165.stdout: rgw gc obj min wait = 15 2024-09-22T08:09:59.775 INFO:teuthology.orchestra.run.smithi165.stdout: debug rgw = 20 2024-09-22T08:09:59.775 INFO:teuthology.orchestra.run.smithi165.stdout: setgroup = ceph 2024-09-22T08:09:59.775 INFO:teuthology.orchestra.run.smithi165.stdout: setuser = ceph 2024-09-22T08:09:59.775 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.a] 2024-09-22T08:09:59.776 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-22T08:09:59.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-22T08:09:59.872 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-22T08:09:59.872 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:09:59.872 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-22T08:09:59.888 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:09:59.888 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-22T08:09:59.943 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2024-09-22T08:09:59.944 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:09:59.944 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T08:09:59.944 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:10:00.020 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:10:00.020 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:10:00.076 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi165.front.sepia.ceph.com 2024-09-22T08:10:00.076 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:10:00.076 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T08:10:00.076 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:10:00.113 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:10:00.113 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:10:00.169 INFO:tasks.ceph:Setting up mon nodes... 2024-09-22T08:10:00.169 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-22T08:10:00.169 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T08:10:00.280 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T08:10:00.282 INFO:tasks.ceph:Setting up mds nodes... 2024-09-22T08:10:00.282 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-22T08:10:00.283 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-22T08:10:00.323 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-22T08:10:00.336 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-22T08:10:00.336 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-22T08:10:00.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-22T08:10:00.362 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-22T08:10:00.362 INFO:tasks.ceph:role: osd.0 2024-09-22T08:10:00.362 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-22T08:10:00.362 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T08:10:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:10:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:10:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:10:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:10:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:10:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:10:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:10:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:10:00.428 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:10:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:10:00.460 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-09-22T08:10:00.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-09-22T08:10:00.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-22T08:10:00.533 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-22T08:10:00.603 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:10:00.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:00.708+0000 7f534840f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-22T08:10:00.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:00.709+0000 7f534840f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-22T08:10:00.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:00.709+0000 7f534840f640 -1 bdev(0x561f9be27800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-22T08:10:00.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:00.709+0000 7f534840f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-22T08:10:03.876 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-22T08:10:03.906 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-22T08:10:03.937 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-22T08:10:03.937 INFO:tasks.ceph:role: osd.1 2024-09-22T08:10:03.937 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-22T08:10:03.937 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T08:10:04.012 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:10:04.012 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:10:04.012 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:10:04.012 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:10:04.012 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:10:04.012 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:10:04.012 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:10:04.012 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:10:04.012 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:10:04.012 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:10:04.527 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-22T08:10:04.529 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-22T08:10:04.529 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-22T08:10:04.675 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-22T08:10:04.710 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-22T08:10:04.777 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-22T08:10:04.777 INFO:tasks.ceph:role: osd.2 2024-09-22T08:10:04.777 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-22T08:10:04.778 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T08:10:04.852 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:10:04.852 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:10:04.852 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:10:04.852 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:10:04.852 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:10:04.852 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:10:04.852 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:10:04.852 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:10:04.852 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:10:04.852 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:10:05.294 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-22T08:10:05.296 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-22T08:10:05.296 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-22T08:10:05.382 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-22T08:10:05.410 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-22T08:10:05.475 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-22T08:10:05.476 INFO:tasks.ceph:role: osd.3 2024-09-22T08:10:05.476 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-22T08:10:05.476 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T08:10:05.548 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:10:05.548 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:10:05.548 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:10:05.548 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:10:05.549 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:10:05.549 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:10:05.549 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:10:05.549 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:10:05.549 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:10:05.549 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:10:06.034 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-22T08:10:06.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-22T08:10:06.036 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-22T08:10:06.184 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-22T08:10:06.213 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:10:06.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:06.309+0000 7f8aec022640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-22T08:10:06.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:06.311+0000 7f8aec022640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-22T08:10:06.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:06.311+0000 7f8aec022640 -1 bdev(0x55dc8f83d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-22T08:10:06.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:06.311+0000 7f8aec022640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-22T08:10:09.243 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-22T08:10:09.272 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:10:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:09.360+0000 7f023a82c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-22T08:10:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:09.361+0000 7f023a82c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-22T08:10:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:09.361+0000 7f023a82c640 -1 bdev(0x55c498f69800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-22T08:10:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:09.361+0000 7f023a82c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-22T08:10:12.774 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-22T08:10:12.804 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:10:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:12.893+0000 7f94d4c0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-22T08:10:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:12.893+0000 7f94d4c0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-22T08:10:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:12.893+0000 7f94d4c0b640 -1 bdev(0x55fe2f76d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-22T08:10:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:12.893+0000 7f94d4c0b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-22T08:10:16.058 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-22T08:10:16.087 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-22T08:10:16.088 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:10:16.088 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-22T08:10:16.119 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:10:16.120 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-22T08:10:16.156 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:10:16.156 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-22T08:10:16.224 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:10:16.224 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-22T08:10:16.291 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:10:16.291 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-22T08:10:16.359 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:10:16.359 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-22T08:10:16.416 INFO:tasks.ceph:Adding keys to all mons... 2024-09-22T08:10:16.416 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T08:10:16.445 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-09-22T08:10:16.445 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDY0O9m3W5IKhAABAEh9kgVVQdM5R/mhI3ePQ== 2024-09-22T08:10:16.445 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2024-09-22T08:10:16.445 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDY0O9mNrq0EBAA9fBNjaBD3roIxBx4jOhFaw== 2024-09-22T08:10:16.445 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-09-22T08:10:16.445 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDe0O9m/a2REhAAes1W2HdsEndYOlO57Pvfrg== 2024-09-22T08:10:16.445 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-09-22T08:10:16.445 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDh0O9mAjicFRAANV+TZMMUnox6fxdg+jIl4A== 2024-09-22T08:10:16.446 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2024-09-22T08:10:16.446 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDk0O9mR9laNRAAzrVXF/LtzgQkeNikGdELMg== 2024-09-22T08:10:16.446 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-09-22T08:10:16.446 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDY0O9mgV9JExAAKrop9QAt6dMKeQx62Ra3kw== 2024-09-22T08:10:16.447 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:10:16.546 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:10:16.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:10:16.654 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:10:16.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:10:16.758 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:10:16.813 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-22T08:10:16.813 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-22T08:10:16.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:10:16.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-22T08:10:16.960 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:10:17.016 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-22T08:10:17.016 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-22T08:10:17.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-22T08:10:17.058 INFO:tasks.ceph.mon.a:Started 2024-09-22T08:10:17.059 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-22T08:10:17.059 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-22T08:10:17.059 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-22T08:10:17.061 INFO:tasks.ceph.mgr.x:Started 2024-09-22T08:10:17.062 DEBUG:tasks.ceph:set 0 configs 2024-09-22T08:10:17.062 INFO:tasks.ceph:Setting crush tunables to default 2024-09-22T08:10:17.062 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2024-09-22T08:10:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.161+0000 7f1696b2b640 1 Processor -- start 2024-09-22T08:10:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.161+0000 7f1696b2b640 1 -- start start 2024-09-22T08:10:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.161+0000 7f1696b2b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f169006e170 0x7f169006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.161+0000 7f1696b2b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1690099ee0 con 0x7f169006ea90 2024-09-22T08:10:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.161+0000 7f1696b2b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1690072bb0 con 0x7f169006e170 2024-09-22T08:10:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.162+0000 7f16948c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f169006e170 0x7f169006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.162+0000 7f16948c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f169006e170 0x7f169006e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55364/0 (socket says 172.21.15.53:55364) 2024-09-22T08:10:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.162+0000 7f168ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f169006ea90 0x7f1690097070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58908/0 (socket says 172.21.15.53:58908) 2024-09-22T08:10:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.162+0000 7f16948c7640 1 -- 172.21.15.53:0/3499204045 learned_addr learned my addr 172.21.15.53:0/3499204045 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.162+0000 7f16948c7640 1 -- 172.21.15.53:0/3499204045 >> v1:172.21.15.53:6789/0 conn(0x7f169006ea90 legacy=0x7f1690097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.162+0000 7f16948c7640 1 -- 172.21.15.53:0/3499204045 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1690063770 con 0x7f169006e170 2024-09-22T08:10:17.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.163+0000 7f16948c7640 1 --2- 172.21.15.53:0/3499204045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 0x7f169006e550 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f16840097f0 tx=0x7f168402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596f40384806dc2b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:17.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.163+0000 7f168f7fe640 1 -- 172.21.15.53:0/3499204045 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1684037070 con 0x7f169006e170 2024-09-22T08:10:17.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.164+0000 7f168f7fe640 1 -- 172.21.15.53:0/3499204045 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1684032440 con 0x7f169006e170 2024-09-22T08:10:17.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.164+0000 7f168f7fe640 1 -- 172.21.15.53:0/3499204045 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f168402ae60 con 0x7f169006e170 2024-09-22T08:10:17.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.164+0000 7f1696b2b640 1 -- 172.21.15.53:0/3499204045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 msgr2=0x7f169006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.164+0000 7f1696b2b640 1 --2- 172.21.15.53:0/3499204045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 0x7f169006e550 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f16840097f0 tx=0x7f168402a1e0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.164+0000 7f1696b2b640 1 -- 172.21.15.53:0/3499204045 shutdown_connections 2024-09-22T08:10:17.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.164+0000 7f1696b2b640 1 --2- 172.21.15.53:0/3499204045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 0x7f169006e550 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.164+0000 7f1696b2b640 1 -- 172.21.15.53:0/3499204045 >> 172.21.15.53:0/3499204045 conn(0x7f169009ad00 msgr2=0x7f1690098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:17.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.164+0000 7f1696b2b640 1 -- 172.21.15.53:0/3499204045 shutdown_connections 2024-09-22T08:10:17.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.164+0000 7f1696b2b640 1 -- 172.21.15.53:0/3499204045 wait complete. 2024-09-22T08:10:17.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.165+0000 7f1696b2b640 1 Processor -- start 2024-09-22T08:10:17.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.165+0000 7f1696b2b640 1 -- start start 2024-09-22T08:10:17.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.165+0000 7f1696b2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 0x7f16901c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:17.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.165+0000 7f1696b2b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1690071570 con 0x7f169006e170 2024-09-22T08:10:17.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f16948c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 0x7f16901c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:17.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f16948c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 0x7f16901c4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55368/0 (socket says 172.21.15.53:55368) 2024-09-22T08:10:17.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f16948c7640 1 -- 172.21.15.53:0/3251953216 learned_addr learned my addr 172.21.15.53:0/3251953216 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:17.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f16948c7640 1 -- 172.21.15.53:0/3251953216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169008fe20 con 0x7f169006e170 2024-09-22T08:10:17.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f16948c7640 1 --2- 172.21.15.53:0/3251953216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 0x7f16901c4470 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1684035040 tx=0x7f16840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f168d7fa640 1 -- 172.21.15.53:0/3251953216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1684041070 con 0x7f169006e170 2024-09-22T08:10:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f168d7fa640 1 -- 172.21.15.53:0/3251953216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168403c7a0 con 0x7f169006e170 2024-09-22T08:10:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f168d7fa640 1 -- 172.21.15.53:0/3251953216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1684037040 con 0x7f169006e170 2024-09-22T08:10:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f1696b2b640 1 -- 172.21.15.53:0/3251953216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169008e470 con 0x7f169006e170 2024-09-22T08:10:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f1696b2b640 1 -- 172.21.15.53:0/3251953216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1690090150 con 0x7f169006e170 2024-09-22T08:10:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f168d7fa640 1 -- 172.21.15.53:0/3251953216 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1684044070 con 0x7f169006e170 2024-09-22T08:10:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.166+0000 7f168d7fa640 1 -- 172.21.15.53:0/3251953216 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1684046d20 con 0x7f169006e170 2024-09-22T08:10:17.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.167+0000 7f1696b2b640 1 -- 172.21.15.53:0/3251953216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169006e550 con 0x7f169006e170 2024-09-22T08:10:17.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.169+0000 7f168d7fa640 1 -- 172.21.15.53:0/3251953216 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1684046450 con 0x7f169006e170 2024-09-22T08:10:17.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.234+0000 7f1696b2b640 1 -- 172.21.15.53:0/3251953216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f169008f500 con 0x7f169006e170 2024-09-22T08:10:17.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.235+0000 7f168d7fa640 1 -- 172.21.15.53:0/3251953216 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f168403ca80 con 0x7f169006e170 2024-09-22T08:10:17.237 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-09-22T08:10:17.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.236+0000 7f1696b2b640 1 -- 172.21.15.53:0/3251953216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 msgr2=0x7f16901c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.236+0000 7f1696b2b640 1 --2- 172.21.15.53:0/3251953216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 0x7f16901c4470 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1684035040 tx=0x7f16840046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.236+0000 7f1696b2b640 1 -- 172.21.15.53:0/3251953216 shutdown_connections 2024-09-22T08:10:17.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.236+0000 7f1696b2b640 1 --2- 172.21.15.53:0/3251953216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169006e170 0x7f16901c4470 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.236+0000 7f1696b2b640 1 -- 172.21.15.53:0/3251953216 >> 172.21.15.53:0/3251953216 conn(0x7f169009ad00 msgr2=0x7f169009c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:17.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.236+0000 7f1696b2b640 1 -- 172.21.15.53:0/3251953216 shutdown_connections 2024-09-22T08:10:17.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:17.236+0000 7f1696b2b640 1 -- 172.21.15.53:0/3251953216 wait complete. 2024-09-22T08:10:17.247 INFO:tasks.ceph:check_enable_crimson: False 2024-09-22T08:10:17.248 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-22T08:10:17.248 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-22T08:10:17.248 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-22T08:10:17.273 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:10:17.273 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-22T08:10:17.300 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:10:17.300 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-22T08:10:17.366 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-22T08:10:17.366 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-22T08:10:17.432 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new b0004653-b98d-4b1a-a928-2f6ef86bf15c 0 2024-09-22T08:10:17.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.569+0000 7f8e74975640 1 Processor -- start 2024-09-22T08:10:17.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.569+0000 7f8e74975640 1 -- start start 2024-09-22T08:10:17.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.570+0000 7f8e74975640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e70116bf0 0x7f8e70116fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:17.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.570+0000 7f8e74975640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e701176f0 con 0x7f8e70112da0 2024-09-22T08:10:17.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.570+0000 7f8e74975640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8e70113940 con 0x7f8e70116bf0 2024-09-22T08:10:17.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.570+0000 7f8e6e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e70116bf0 0x7f8e70116fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:17.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.570+0000 7f8e67fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8e70112da0 0x7f8e70113230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:48048/0 (socket says 172.21.15.165:48048) 2024-09-22T08:10:17.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.570+0000 7f8e6e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e70116bf0 0x7f8e70116fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46306/0 (socket says 172.21.15.165:46306) 2024-09-22T08:10:17.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.570+0000 7f8e67fff640 1 -- 172.21.15.165:0/4250883645 learned_addr learned my addr 172.21.15.165:0/4250883645 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:10:17.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.570+0000 7f8e6e59c640 1 -- 172.21.15.165:0/4250883645 >> v1:172.21.15.53:6789/0 conn(0x7f8e70112da0 legacy=0x7f8e70113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.570+0000 7f8e6dd9b640 1 -- 172.21.15.165:0/4250883645 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1482104195 0 0) 0x7f8e701176f0 con 0x7f8e70112da0 2024-09-22T08:10:17.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.570+0000 7f8e6e59c640 1 -- 172.21.15.165:0/4250883645 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e70113af0 con 0x7f8e70116bf0 2024-09-22T08:10:17.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.571+0000 7f8e6e59c640 1 --2- 172.21.15.165:0/4250883645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70116bf0 0x7f8e70116fd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009720 tx=0x7f8e6002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbfdb5386b1e346 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:17.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.571+0000 7f8e6dd9b640 1 -- 172.21.15.165:0/4250883645 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e60037070 con 0x7f8e70116bf0 2024-09-22T08:10:17.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.571+0000 7f8e6dd9b640 1 -- 172.21.15.165:0/4250883645 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6002ad90 con 0x7f8e70116bf0 2024-09-22T08:10:17.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.571+0000 7f8e6dd9b640 1 -- 172.21.15.165:0/4250883645 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e60032590 con 0x7f8e70116bf0 2024-09-22T08:10:17.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.572+0000 7f8e74975640 1 -- 172.21.15.165:0/4250883645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70116bf0 msgr2=0x7f8e70116fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.572+0000 7f8e74975640 1 --2- 172.21.15.165:0/4250883645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70116bf0 0x7f8e70116fd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009720 tx=0x7f8e6002a110 comp rx=0 tx=0).stop 2024-09-22T08:10:17.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.572+0000 7f8e74975640 1 -- 172.21.15.165:0/4250883645 shutdown_connections 2024-09-22T08:10:17.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.572+0000 7f8e74975640 1 --2- 172.21.15.165:0/4250883645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70116bf0 0x7f8e70116fd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.572+0000 7f8e74975640 1 -- 172.21.15.165:0/4250883645 >> 172.21.15.165:0/4250883645 conn(0x7f8e7006f820 msgr2=0x7f8e7006fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:17.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.572+0000 7f8e74975640 1 -- 172.21.15.165:0/4250883645 shutdown_connections 2024-09-22T08:10:17.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.572+0000 7f8e74975640 1 -- 172.21.15.165:0/4250883645 wait complete. 2024-09-22T08:10:17.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.573+0000 7f8e74975640 1 Processor -- start 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.573+0000 7f8e74975640 1 -- start start 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.573+0000 7f8e74975640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70112da0 0x7f8e701a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.573+0000 7f8e74975640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7011f040 con 0x7f8e70112da0 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.573+0000 7f8e6e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70112da0 0x7f8e701a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.573+0000 7f8e6e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70112da0 0x7f8e701a7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46318/0 (socket says 172.21.15.165:46318) 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.574+0000 7f8e6e59c640 1 -- 172.21.15.165:0/1251868008 learned_addr learned my addr 172.21.15.165:0/1251868008 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.574+0000 7f8e6e59c640 1 -- 172.21.15.165:0/1251868008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e701a7d60 con 0x7f8e70112da0 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.574+0000 7f8e6e59c640 1 --2- 172.21.15.165:0/1251868008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70112da0 0x7f8e701a7790 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009720 tx=0x7f8e600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.574+0000 7f8e66ffd640 1 -- 172.21.15.165:0/1251868008 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e60037040 con 0x7f8e70112da0 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.574+0000 7f8e66ffd640 1 -- 172.21.15.165:0/1251868008 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e60004160 con 0x7f8e70112da0 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.574+0000 7f8e74975640 1 -- 172.21.15.165:0/1251868008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e701a7ff0 con 0x7f8e70112da0 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.574+0000 7f8e66ffd640 1 -- 172.21.15.165:0/1251868008 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e60004440 con 0x7f8e70112da0 2024-09-22T08:10:17.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.574+0000 7f8e74975640 1 -- 172.21.15.165:0/1251868008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e701acfc0 con 0x7f8e70112da0 2024-09-22T08:10:17.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.574+0000 7f8e66ffd640 1 -- 172.21.15.165:0/1251868008 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8e600039a0 con 0x7f8e70112da0 2024-09-22T08:10:17.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.574+0000 7f8e66ffd640 1 -- 172.21.15.165:0/1251868008 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f8e6003e420 con 0x7f8e70112da0 2024-09-22T08:10:17.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.575+0000 7f8e74975640 1 -- 172.21.15.165:0/1251868008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e700769e0 con 0x7f8e70112da0 2024-09-22T08:10:17.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.577+0000 7f8e66ffd640 1 -- 172.21.15.165:0/1251868008 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8e6002ace0 con 0x7f8e70112da0 2024-09-22T08:10:17.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.647+0000 7f8e74975640 1 -- 172.21.15.165:0/1251868008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b0004653-b98d-4b1a-a928-2f6ef86bf15c", "id": 0} v 0) -- 0x7f8e70116bf0 con 0x7f8e70112da0 2024-09-22T08:10:17.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.649+0000 7f8e66ffd640 1 -- 172.21.15.165:0/1251868008 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0004653-b98d-4b1a-a928-2f6ef86bf15c", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f8e6003d470 con 0x7f8e70112da0 2024-09-22T08:10:17.650 INFO:teuthology.orchestra.run.smithi165.stdout:0 2024-09-22T08:10:17.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.649+0000 7f8e74975640 1 -- 172.21.15.165:0/1251868008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70112da0 msgr2=0x7f8e701a7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.649+0000 7f8e74975640 1 --2- 172.21.15.165:0/1251868008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70112da0 0x7f8e701a7790 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009720 tx=0x7f8e600046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.650+0000 7f8e74975640 1 -- 172.21.15.165:0/1251868008 shutdown_connections 2024-09-22T08:10:17.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.650+0000 7f8e74975640 1 --2- 172.21.15.165:0/1251868008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e70112da0 0x7f8e701a7790 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.650+0000 7f8e74975640 1 -- 172.21.15.165:0/1251868008 >> 172.21.15.165:0/1251868008 conn(0x7f8e7006f820 msgr2=0x7f8e70111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:17.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.650+0000 7f8e74975640 1 -- 172.21.15.165:0/1251868008 shutdown_connections 2024-09-22T08:10:17.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.650+0000 7f8e74975640 1 -- 172.21.15.165:0/1251868008 wait complete. 2024-09-22T08:10:17.660 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new c85ab72a-9b5c-4d4d-a0d1-3d32724a8d29 1 2024-09-22T08:10:17.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.758+0000 7f9dd55b4640 1 Processor -- start 2024-09-22T08:10:17.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.758+0000 7f9dd55b4640 1 -- start start 2024-09-22T08:10:17.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.758+0000 7f9dd55b4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9dd0115ac0 0x7f9dd006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:17.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.758+0000 7f9dd55b4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd006e0a0 con 0x7f9dd0115ea0 2024-09-22T08:10:17.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.758+0000 7f9dd55b4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd0123be0 con 0x7f9dd0115ac0 2024-09-22T08:10:17.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.759+0000 7f9dceffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9dd0115ac0 0x7f9dd006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:17.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.759+0000 7f9dceffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9dd0115ac0 0x7f9dd006d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46326/0 (socket says 172.21.15.165:46326) 2024-09-22T08:10:17.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.759+0000 7f9dceffd640 1 -- 172.21.15.165:0/2019326392 learned_addr learned my addr 172.21.15.165:0/2019326392 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:17.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.759+0000 7f9dc7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9dd0115ea0 0x7f9dd006d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:48058/0 (socket says 172.21.15.165:48058) 2024-09-22T08:10:17.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.759+0000 7f9dceffd640 1 -- 172.21.15.165:0/2019326392 >> v1:172.21.15.53:6789/0 conn(0x7f9dd0115ea0 legacy=0x7f9dd006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.759+0000 7f9dceffd640 1 -- 172.21.15.165:0/2019326392 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd0123d60 con 0x7f9dd0115ac0 2024-09-22T08:10:17.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.759+0000 7f9dce7fc640 1 -- 172.21.15.165:0/2019326392 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731712477 0 0) 0x7f9dd006e0a0 con 0x7f9dd0115ea0 2024-09-22T08:10:17.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.760+0000 7f9dceffd640 1 --2- 172.21.15.165:0/2019326392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 0x7f9dd006d3c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00097f0 tx=0x7f9dc002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d013314cf7ca0d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:17.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.760+0000 7f9dce7fc640 1 -- 172.21.15.165:0/2019326392 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0037070 con 0x7f9dd0115ac0 2024-09-22T08:10:17.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.760+0000 7f9dce7fc640 1 -- 172.21.15.165:0/2019326392 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc0032440 con 0x7f9dd0115ac0 2024-09-22T08:10:17.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.760+0000 7f9dce7fc640 1 -- 172.21.15.165:0/2019326392 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc002ae60 con 0x7f9dd0115ac0 2024-09-22T08:10:17.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.761+0000 7f9dd55b4640 1 -- 172.21.15.165:0/2019326392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 msgr2=0x7f9dd006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.761+0000 7f9dd55b4640 1 --2- 172.21.15.165:0/2019326392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 0x7f9dd006d3c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00097f0 tx=0x7f9dc002a1e0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.761+0000 7f9dd55b4640 1 -- 172.21.15.165:0/2019326392 shutdown_connections 2024-09-22T08:10:17.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.761+0000 7f9dd55b4640 1 --2- 172.21.15.165:0/2019326392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 0x7f9dd006d3c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.761+0000 7f9dd55b4640 1 -- 172.21.15.165:0/2019326392 >> 172.21.15.165:0/2019326392 conn(0x7f9dd00711f0 msgr2=0x7f9dd0073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:17.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.761+0000 7f9dd55b4640 1 -- 172.21.15.165:0/2019326392 shutdown_connections 2024-09-22T08:10:17.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.761+0000 7f9dd55b4640 1 -- 172.21.15.165:0/2019326392 wait complete. 2024-09-22T08:10:17.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.761+0000 7f9dd55b4640 1 Processor -- start 2024-09-22T08:10:17.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.761+0000 7f9dd55b4640 1 -- start start 2024-09-22T08:10:17.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.762+0000 7f9dd55b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 0x7f9dd01abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.762+0000 7f9dd55b4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd01230b0 con 0x7f9dd0115ac0 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.762+0000 7f9dceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 0x7f9dd01abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.762+0000 7f9dceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 0x7f9dd01abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46328/0 (socket says 172.21.15.165:46328) 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.762+0000 7f9dceffd640 1 -- 172.21.15.165:0/3195543178 learned_addr learned my addr 172.21.15.165:0/3195543178 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.762+0000 7f9dceffd640 1 -- 172.21.15.165:0/3195543178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd01ac210 con 0x7f9dd0115ac0 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.762+0000 7f9dceffd640 1 --2- 172.21.15.165:0/3195543178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 0x7f9dd01abc40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0035040 tx=0x7f9dc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.762+0000 7f9dc77fe640 1 -- 172.21.15.165:0/3195543178 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0041070 con 0x7f9dd0115ac0 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.763+0000 7f9dc77fe640 1 -- 172.21.15.165:0/3195543178 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc003c7a0 con 0x7f9dd0115ac0 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.763+0000 7f9dd55b4640 1 -- 172.21.15.165:0/3195543178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd01ac4a0 con 0x7f9dd0115ac0 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.763+0000 7f9dc77fe640 1 -- 172.21.15.165:0/3195543178 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0037040 con 0x7f9dd0115ac0 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.763+0000 7f9dd55b4640 1 -- 172.21.15.165:0/3195543178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd01b1470 con 0x7f9dd0115ac0 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.763+0000 7f9dc77fe640 1 -- 172.21.15.165:0/3195543178 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9dc0044070 con 0x7f9dd0115ac0 2024-09-22T08:10:17.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.763+0000 7f9dc77fe640 1 -- 172.21.15.165:0/3195543178 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f9dc003d3f0 con 0x7f9dd0115ac0 2024-09-22T08:10:17.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.763+0000 7f9dd55b4640 1 -- 172.21.15.165:0/3195543178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd0123730 con 0x7f9dd0115ac0 2024-09-22T08:10:17.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.766+0000 7f9dc77fe640 1 -- 172.21.15.165:0/3195543178 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9dc0046450 con 0x7f9dd0115ac0 2024-09-22T08:10:17.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.837+0000 7f9dd55b4640 1 -- 172.21.15.165:0/3195543178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c85ab72a-9b5c-4d4d-a0d1-3d32724a8d29", "id": 1} v 0) -- 0x7f9dd0115ea0 con 0x7f9dd0115ac0 2024-09-22T08:10:17.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.838+0000 7f9dc77fe640 1 -- 172.21.15.165:0/3195543178 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c85ab72a-9b5c-4d4d-a0d1-3d32724a8d29", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f9dc003caa0 con 0x7f9dd0115ac0 2024-09-22T08:10:17.839 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-22T08:10:17.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.839+0000 7f9dd55b4640 1 -- 172.21.15.165:0/3195543178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 msgr2=0x7f9dd01abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.839+0000 7f9dd55b4640 1 --2- 172.21.15.165:0/3195543178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 0x7f9dd01abc40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0035040 tx=0x7f9dc00046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.839+0000 7f9dd55b4640 1 -- 172.21.15.165:0/3195543178 shutdown_connections 2024-09-22T08:10:17.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.839+0000 7f9dd55b4640 1 --2- 172.21.15.165:0/3195543178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9dd0115ac0 0x7f9dd01abc40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.839+0000 7f9dd55b4640 1 -- 172.21.15.165:0/3195543178 >> 172.21.15.165:0/3195543178 conn(0x7f9dd00711f0 msgr2=0x7f9dd01213a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:17.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.839+0000 7f9dd55b4640 1 -- 172.21.15.165:0/3195543178 shutdown_connections 2024-09-22T08:10:17.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.839+0000 7f9dd55b4640 1 -- 172.21.15.165:0/3195543178 wait complete. 2024-09-22T08:10:17.850 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new f0698e09-e99e-43f6-840b-999b20fc7d32 2 2024-09-22T08:10:17.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.949+0000 7f0555dda640 1 Processor -- start 2024-09-22T08:10:17.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.949+0000 7f0555dda640 1 -- start start 2024-09-22T08:10:17.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.949+0000 7f0555dda640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0550116bf0 0x7f0550116fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:17.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.949+0000 7f0555dda640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05501176f0 con 0x7f0550112da0 2024-09-22T08:10:17.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.949+0000 7f0555dda640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f0550113940 con 0x7f0550116bf0 2024-09-22T08:10:17.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.950+0000 7f054f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0550116bf0 0x7f0550116fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:17.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.950+0000 7f0546ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0550112da0 0x7f0550113230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:48068/0 (socket says 172.21.15.165:48068) 2024-09-22T08:10:17.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.950+0000 7f0546ffd640 1 -- 172.21.15.165:0/1140213849 learned_addr learned my addr 172.21.15.165:0/1140213849 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:10:17.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.950+0000 7f054effd640 1 -- 172.21.15.165:0/1140213849 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996372837 0 0) 0x7f05501176f0 con 0x7f0550112da0 2024-09-22T08:10:17.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.950+0000 7f054effd640 1 -- 172.21.15.165:0/1140213849 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f053c003520 con 0x7f0550112da0 2024-09-22T08:10:17.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.950+0000 7f054f7fe640 1 -- 172.21.15.165:0/1140213849 >> v1:172.21.15.53:6789/0 conn(0x7f0550112da0 legacy=0x7f0550113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.950+0000 7f054f7fe640 1 -- 172.21.15.165:0/1140213849 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0550113af0 con 0x7f0550116bf0 2024-09-22T08:10:17.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.951+0000 7f054f7fe640 1 --2- 172.21.15.165:0/1140213849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550116bf0 0x7f0550116fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0540009720 tx=0x7f054002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a892bed05212523a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:17.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.951+0000 7f054effd640 1 -- 172.21.15.165:0/1140213849 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0540037070 con 0x7f0550116bf0 2024-09-22T08:10:17.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.951+0000 7f054effd640 1 -- 172.21.15.165:0/1140213849 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054002ad90 con 0x7f0550116bf0 2024-09-22T08:10:17.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.951+0000 7f054effd640 1 -- 172.21.15.165:0/1140213849 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0540032590 con 0x7f0550116bf0 2024-09-22T08:10:17.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.952+0000 7f0555dda640 1 -- 172.21.15.165:0/1140213849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550116bf0 msgr2=0x7f0550116fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:17.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.952+0000 7f0555dda640 1 --2- 172.21.15.165:0/1140213849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550116bf0 0x7f0550116fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0540009720 tx=0x7f054002a110 comp rx=0 tx=0).stop 2024-09-22T08:10:17.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.952+0000 7f0555dda640 1 -- 172.21.15.165:0/1140213849 shutdown_connections 2024-09-22T08:10:17.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.952+0000 7f0555dda640 1 --2- 172.21.15.165:0/1140213849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550116bf0 0x7f0550116fd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:17.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.952+0000 7f0555dda640 1 -- 172.21.15.165:0/1140213849 >> 172.21.15.165:0/1140213849 conn(0x7f055006f820 msgr2=0x7f055006fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:17.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.952+0000 7f0555dda640 1 -- 172.21.15.165:0/1140213849 shutdown_connections 2024-09-22T08:10:17.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.952+0000 7f0555dda640 1 -- 172.21.15.165:0/1140213849 wait complete. 2024-09-22T08:10:17.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.952+0000 7f0555dda640 1 Processor -- start 2024-09-22T08:10:17.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.952+0000 7f0555dda640 1 -- start start 2024-09-22T08:10:17.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.953+0000 7f0555dda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550112da0 0x7f05501a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:17.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.953+0000 7f0555dda640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f055011f040 con 0x7f0550112da0 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.953+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550112da0 0x7f05501a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.953+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550112da0 0x7f05501a77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46338/0 (socket says 172.21.15.165:46338) 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.953+0000 7f054f7fe640 1 -- 172.21.15.165:0/405510939 learned_addr learned my addr 172.21.15.165:0/405510939 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.953+0000 7f054f7fe640 1 -- 172.21.15.165:0/405510939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05501a7dc0 con 0x7f0550112da0 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.954+0000 7f054f7fe640 1 --2- 172.21.15.165:0/405510939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550112da0 0x7f05501a77f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0540009720 tx=0x7f05400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.954+0000 7f054cff9640 1 -- 172.21.15.165:0/405510939 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0540041070 con 0x7f0550112da0 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.954+0000 7f054cff9640 1 -- 172.21.15.165:0/405510939 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054003c460 con 0x7f0550112da0 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.954+0000 7f054cff9640 1 -- 172.21.15.165:0/405510939 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0540037040 con 0x7f0550112da0 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.954+0000 7f0555dda640 1 -- 172.21.15.165:0/405510939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05501a8050 con 0x7f0550112da0 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.954+0000 7f0555dda640 1 -- 172.21.15.165:0/405510939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05501ad020 con 0x7f0550112da0 2024-09-22T08:10:17.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.954+0000 7f054cff9640 1 -- 172.21.15.165:0/405510939 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0540044070 con 0x7f0550112da0 2024-09-22T08:10:17.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.954+0000 7f054cff9640 1 -- 172.21.15.165:0/405510939 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f054003cb80 con 0x7f0550112da0 2024-09-22T08:10:17.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.955+0000 7f0555dda640 1 -- 172.21.15.165:0/405510939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05500769e0 con 0x7f0550112da0 2024-09-22T08:10:17.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:17.957+0000 7f054cff9640 1 -- 172.21.15.165:0/405510939 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f054003c760 con 0x7f0550112da0 2024-09-22T08:10:18.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.027+0000 7f0555dda640 1 -- 172.21.15.165:0/405510939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f0698e09-e99e-43f6-840b-999b20fc7d32", "id": 2} v 0) -- 0x7f0550116bf0 con 0x7f0550112da0 2024-09-22T08:10:18.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.028+0000 7f054cff9640 1 -- 172.21.15.165:0/405510939 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0698e09-e99e-43f6-840b-999b20fc7d32", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f054003c980 con 0x7f0550112da0 2024-09-22T08:10:18.029 INFO:teuthology.orchestra.run.smithi165.stdout:2 2024-09-22T08:10:18.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.030+0000 7f0555dda640 1 -- 172.21.15.165:0/405510939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550112da0 msgr2=0x7f05501a77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:18.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.030+0000 7f0555dda640 1 --2- 172.21.15.165:0/405510939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550112da0 0x7f05501a77f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0540009720 tx=0x7f05400046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:18.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.030+0000 7f0555dda640 1 -- 172.21.15.165:0/405510939 shutdown_connections 2024-09-22T08:10:18.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.030+0000 7f0555dda640 1 --2- 172.21.15.165:0/405510939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0550112da0 0x7f05501a77f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:18.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.030+0000 7f0555dda640 1 -- 172.21.15.165:0/405510939 >> 172.21.15.165:0/405510939 conn(0x7f055006f820 msgr2=0x7f0550111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:18.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.030+0000 7f0555dda640 1 -- 172.21.15.165:0/405510939 shutdown_connections 2024-09-22T08:10:18.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.030+0000 7f0555dda640 1 -- 172.21.15.165:0/405510939 wait complete. 2024-09-22T08:10:18.041 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 413ad162-0b9b-437b-a3b4-0c4e1170cd61 3 2024-09-22T08:10:18.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.140+0000 7f2d2919f640 1 Processor -- start 2024-09-22T08:10:18.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.140+0000 7f2d2919f640 1 -- start start 2024-09-22T08:10:18.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d2919f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d2406eb80 0x7f2d2411e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:18.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d2919f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d2406f010 con 0x7f2d240701e0 2024-09-22T08:10:18.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d2919f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2d2406f1e0 con 0x7f2d2406eb80 2024-09-22T08:10:18.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d237fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d2406eb80 0x7f2d2411e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:18.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d23fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2d240701e0 0x7f2d2406e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:48084/0 (socket says 172.21.15.165:48084) 2024-09-22T08:10:18.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d237fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d2406eb80 0x7f2d2411e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46340/0 (socket says 172.21.15.165:46340) 2024-09-22T08:10:18.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d23fff640 1 -- 172.21.15.165:0/3323985674 learned_addr learned my addr 172.21.15.165:0/3323985674 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:10:18.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d22ffd640 1 -- 172.21.15.165:0/3323985674 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352830087 0 0) 0x7f2d2406f010 con 0x7f2d240701e0 2024-09-22T08:10:18.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d22ffd640 1 -- 172.21.15.165:0/3323985674 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d0c003520 con 0x7f2d240701e0 2024-09-22T08:10:18.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d237fe640 1 -- 172.21.15.165:0/3323985674 >> v1:172.21.15.53:6789/0 conn(0x7f2d240701e0 legacy=0x7f2d2406e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:18.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.141+0000 7f2d237fe640 1 -- 172.21.15.165:0/3323985674 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2411f760 con 0x7f2d2406eb80 2024-09-22T08:10:18.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.142+0000 7f2d237fe640 1 --2- 172.21.15.165:0/3323985674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 0x7f2d2411e210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009720 tx=0x7f2d1802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba213a9d4e9c5624 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:18.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.142+0000 7f2d22ffd640 1 -- 172.21.15.165:0/3323985674 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d18037070 con 0x7f2d2406eb80 2024-09-22T08:10:18.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.142+0000 7f2d22ffd640 1 -- 172.21.15.165:0/3323985674 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1802ad90 con 0x7f2d2406eb80 2024-09-22T08:10:18.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.142+0000 7f2d22ffd640 1 -- 172.21.15.165:0/3323985674 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d18032590 con 0x7f2d2406eb80 2024-09-22T08:10:18.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.143+0000 7f2d2919f640 1 -- 172.21.15.165:0/3323985674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 msgr2=0x7f2d2411e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:18.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.143+0000 7f2d2919f640 1 --2- 172.21.15.165:0/3323985674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 0x7f2d2411e210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009720 tx=0x7f2d1802a110 comp rx=0 tx=0).stop 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.143+0000 7f2d2919f640 1 -- 172.21.15.165:0/3323985674 shutdown_connections 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.143+0000 7f2d2919f640 1 --2- 172.21.15.165:0/3323985674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 0x7f2d2411e210 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.143+0000 7f2d2919f640 1 -- 172.21.15.165:0/3323985674 >> 172.21.15.165:0/3323985674 conn(0x7f2d24071fe0 msgr2=0x7f2d24074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.143+0000 7f2d2919f640 1 -- 172.21.15.165:0/3323985674 shutdown_connections 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.143+0000 7f2d2919f640 1 -- 172.21.15.165:0/3323985674 wait complete. 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.144+0000 7f2d2919f640 1 Processor -- start 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.144+0000 7f2d2919f640 1 -- start start 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.144+0000 7f2d2919f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 0x7f2d241a7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.144+0000 7f2d2919f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2411eba0 con 0x7f2d2406eb80 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.144+0000 7f2d23fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 0x7f2d241a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.144+0000 7f2d23fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 0x7f2d241a7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46348/0 (socket says 172.21.15.165:46348) 2024-09-22T08:10:18.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.144+0000 7f2d23fff640 1 -- 172.21.15.165:0/1327985548 learned_addr learned my addr 172.21.15.165:0/1327985548 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:18.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.145+0000 7f2d23fff640 1 -- 172.21.15.165:0/1327985548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d241a7b50 con 0x7f2d2406eb80 2024-09-22T08:10:18.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.145+0000 7f2d23fff640 1 --2- 172.21.15.165:0/1327985548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 0x7f2d241a7580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c480 tx=0x7f2d1400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:18.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.145+0000 7f2d20ff9640 1 -- 172.21.15.165:0/1327985548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d14017070 con 0x7f2d2406eb80 2024-09-22T08:10:18.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.145+0000 7f2d20ff9640 1 -- 172.21.15.165:0/1327985548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d14005cd0 con 0x7f2d2406eb80 2024-09-22T08:10:18.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.145+0000 7f2d20ff9640 1 -- 172.21.15.165:0/1327985548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d14007200 con 0x7f2d2406eb80 2024-09-22T08:10:18.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.145+0000 7f2d2919f640 1 -- 172.21.15.165:0/1327985548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d241a7e40 con 0x7f2d2406eb80 2024-09-22T08:10:18.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.145+0000 7f2d2919f640 1 -- 172.21.15.165:0/1327985548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d241ad010 con 0x7f2d2406eb80 2024-09-22T08:10:18.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.145+0000 7f2d20ff9640 1 -- 172.21.15.165:0/1327985548 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2d1401a070 con 0x7f2d2406eb80 2024-09-22T08:10:18.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.146+0000 7f2d20ff9640 1 -- 172.21.15.165:0/1327985548 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f2d1401c440 con 0x7f2d2406eb80 2024-09-22T08:10:18.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.146+0000 7f2d2919f640 1 -- 172.21.15.165:0/1327985548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d241a8180 con 0x7f2d2406eb80 2024-09-22T08:10:18.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.148+0000 7f2d20ff9640 1 -- 172.21.15.165:0/1327985548 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2d1401cb50 con 0x7f2d2406eb80 2024-09-22T08:10:18.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.217+0000 7f2d2919f640 1 -- 172.21.15.165:0/1327985548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "413ad162-0b9b-437b-a3b4-0c4e1170cd61", "id": 3} v 0) -- 0x7f2d2411f200 con 0x7f2d2406eb80 2024-09-22T08:10:18.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.218+0000 7f2d20ff9640 1 -- 172.21.15.165:0/1327985548 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "413ad162-0b9b-437b-a3b4-0c4e1170cd61", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f2d1401ce10 con 0x7f2d2406eb80 2024-09-22T08:10:18.219 INFO:teuthology.orchestra.run.smithi165.stdout:3 2024-09-22T08:10:18.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.219+0000 7f2d2919f640 1 -- 172.21.15.165:0/1327985548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 msgr2=0x7f2d241a7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:18.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.219+0000 7f2d2919f640 1 --2- 172.21.15.165:0/1327985548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 0x7f2d241a7580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c480 tx=0x7f2d1400c940 comp rx=0 tx=0).stop 2024-09-22T08:10:18.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.219+0000 7f2d2919f640 1 -- 172.21.15.165:0/1327985548 shutdown_connections 2024-09-22T08:10:18.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.219+0000 7f2d2919f640 1 --2- 172.21.15.165:0/1327985548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d2406eb80 0x7f2d241a7580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:18.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.219+0000 7f2d2919f640 1 -- 172.21.15.165:0/1327985548 >> 172.21.15.165:0/1327985548 conn(0x7f2d24071fe0 msgr2=0x7f2d24118000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:18.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.219+0000 7f2d2919f640 1 -- 172.21.15.165:0/1327985548 shutdown_connections 2024-09-22T08:10:18.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:18.219+0000 7f2d2919f640 1 -- 172.21.15.165:0/1327985548 wait complete. 2024-09-22T08:10:18.230 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-22T08:10:18.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-22T08:10:18.233 INFO:tasks.ceph.osd.0:Started 2024-09-22T08:10:18.233 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-22T08:10:18.233 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-22T08:10:18.235 INFO:tasks.ceph.osd.1:Started 2024-09-22T08:10:18.235 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-22T08:10:18.235 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-22T08:10:18.237 INFO:tasks.ceph.osd.2:Started 2024-09-22T08:10:18.237 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-22T08:10:18.238 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-22T08:10:18.239 INFO:tasks.ceph.osd.3:Started 2024-09-22T08:10:18.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:10:18.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.344+0000 7f3a25d2b640 1 Processor -- start 2024-09-22T08:10:18.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.344+0000 7f3a25d2b640 1 -- start start 2024-09-22T08:10:18.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.345+0000 7f3a25d2b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a2006fd70 0x7f3a20131660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:18.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.345+0000 7f3a25d2b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a20099ee0 con 0x7f3a2006f280 2024-09-22T08:10:18.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.345+0000 7f3a25d2b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3a20070d00 con 0x7f3a2006fd70 2024-09-22T08:10:18.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.345+0000 7f3a16ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a2006fd70 0x7f3a20131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:18.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.345+0000 7f3a1f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3a2006f280 0x7f3a2006f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58918/0 (socket says 172.21.15.53:58918) 2024-09-22T08:10:18.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.345+0000 7f3a1f7fe640 1 -- 172.21.15.53:0/3211797818 learned_addr learned my addr 172.21.15.53:0/3211797818 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:18.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.345+0000 7f3a16ffd640 1 -- 172.21.15.53:0/3211797818 >> v1:172.21.15.53:6789/0 conn(0x7f3a2006f280 legacy=0x7f3a2006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:18.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.345+0000 7f3a16ffd640 1 -- 172.21.15.53:0/3211797818 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a20070f40 con 0x7f3a2006fd70 2024-09-22T08:10:18.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.346+0000 7f3a16ffd640 1 --2- 172.21.15.53:0/3211797818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006fd70 0x7f3a20131660 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009720 tx=0x7f3a0802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cae5b988347efd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.346+0000 7f3a1effd640 1 -- 172.21.15.53:0/3211797818 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a08037070 con 0x7f3a2006fd70 2024-09-22T08:10:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.346+0000 7f3a1effd640 1 -- 172.21.15.53:0/3211797818 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0802ad90 con 0x7f3a2006fd70 2024-09-22T08:10:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.346+0000 7f3a1effd640 1 -- 172.21.15.53:0/3211797818 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a08032590 con 0x7f3a2006fd70 2024-09-22T08:10:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.347+0000 7f3a25d2b640 1 -- 172.21.15.53:0/3211797818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006fd70 msgr2=0x7f3a20131660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.347+0000 7f3a25d2b640 1 --2- 172.21.15.53:0/3211797818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006fd70 0x7f3a20131660 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009720 tx=0x7f3a0802a110 comp rx=0 tx=0).stop 2024-09-22T08:10:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.347+0000 7f3a25d2b640 1 -- 172.21.15.53:0/3211797818 shutdown_connections 2024-09-22T08:10:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.347+0000 7f3a25d2b640 1 --2- 172.21.15.53:0/3211797818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006fd70 0x7f3a20131660 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.347+0000 7f3a25d2b640 1 -- 172.21.15.53:0/3211797818 >> 172.21.15.53:0/3211797818 conn(0x7f3a2009ac80 msgr2=0x7f3a20098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.347+0000 7f3a25d2b640 1 -- 172.21.15.53:0/3211797818 shutdown_connections 2024-09-22T08:10:18.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.347+0000 7f3a25d2b640 1 -- 172.21.15.53:0/3211797818 wait complete. 2024-09-22T08:10:18.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.348+0000 7f3a25d2b640 1 Processor -- start 2024-09-22T08:10:18.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.348+0000 7f3a25d2b640 1 -- start start 2024-09-22T08:10:18.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.348+0000 7f3a25d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006f280 0x7f3a20124be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:18.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.348+0000 7f3a25d2b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20131d20 con 0x7f3a2006f280 2024-09-22T08:10:18.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.348+0000 7f3a1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006f280 0x7f3a20124be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:18.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.348+0000 7f3a1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006f280 0x7f3a20124be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55398/0 (socket says 172.21.15.53:55398) 2024-09-22T08:10:18.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.348+0000 7f3a1f7fe640 1 -- 172.21.15.53:0/1778929767 learned_addr learned my addr 172.21.15.53:0/1778929767 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:18.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.349+0000 7f3a1f7fe640 1 -- 172.21.15.53:0/1778929767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a20127bb0 con 0x7f3a2006f280 2024-09-22T08:10:18.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.349+0000 7f3a1f7fe640 1 --2- 172.21.15.53:0/1778929767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006f280 0x7f3a20124be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c480 tx=0x7f3a1000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:18.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.349+0000 7f3a1cff9640 1 -- 172.21.15.53:0/1778929767 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a10017070 con 0x7f3a2006f280 2024-09-22T08:10:18.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.349+0000 7f3a1cff9640 1 -- 172.21.15.53:0/1778929767 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a10005c10 con 0x7f3a2006f280 2024-09-22T08:10:18.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.349+0000 7f3a25d2b640 1 -- 172.21.15.53:0/1778929767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a20073fb0 con 0x7f3a2006f280 2024-09-22T08:10:18.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.349+0000 7f3a1cff9640 1 -- 172.21.15.53:0/1778929767 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a10007070 con 0x7f3a2006f280 2024-09-22T08:10:18.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.349+0000 7f3a25d2b640 1 -- 172.21.15.53:0/1778929767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a201274d0 con 0x7f3a2006f280 2024-09-22T08:10:18.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.349+0000 7f3a1cff9640 1 -- 172.21.15.53:0/1778929767 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a1001a070 con 0x7f3a2006f280 2024-09-22T08:10:18.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.349+0000 7f3a1cff9640 1 -- 172.21.15.53:0/1778929767 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f3a1001cb60 con 0x7f3a2006f280 2024-09-22T08:10:18.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.350+0000 7f3a25d2b640 1 -- 172.21.15.53:0/1778929767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2006f660 con 0x7f3a2006f280 2024-09-22T08:10:18.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.352+0000 7f3a1cff9640 1 -- 172.21.15.53:0/1778929767 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3a20127bb0 con 0x7f3a2006f280 2024-09-22T08:10:18.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.412+0000 7f3a25d2b640 1 -- 172.21.15.53:0/1778929767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a20076560 con 0x7f3a2006f280 2024-09-22T08:10:18.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.412+0000 7f3a1cff9640 1 -- 172.21.15.53:0/1778929767 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f3a1001c440 con 0x7f3a2006f280 2024-09-22T08:10:18.414 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:10:18.415 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":6,"fsid":"e28b0ed0-1272-43e5-8a68-aa2f8d89bec5","created":"2024-09-22T08:10:17.147434+0000","modified":"2024-09-22T08:10:18.218936+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:10:18.218936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b0004653-b98d-4b1a-a928-2f6ef86bf15c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c85ab72a-9b5c-4d4d-a0d1-3d32724a8d29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0698e09-e99e-43f6-840b-999b20fc7d32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"413ad162-0b9b-437b-a3b4-0c4e1170cd61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:10:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.413+0000 7f3a25d2b640 1 -- 172.21.15.53:0/1778929767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006f280 msgr2=0x7f3a20124be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.413+0000 7f3a25d2b640 1 --2- 172.21.15.53:0/1778929767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006f280 0x7f3a20124be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c480 tx=0x7f3a1000c940 comp rx=0 tx=0).stop 2024-09-22T08:10:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.413+0000 7f3a25d2b640 1 -- 172.21.15.53:0/1778929767 shutdown_connections 2024-09-22T08:10:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.413+0000 7f3a25d2b640 1 --2- 172.21.15.53:0/1778929767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a2006f280 0x7f3a20124be0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.413+0000 7f3a25d2b640 1 -- 172.21.15.53:0/1778929767 >> 172.21.15.53:0/1778929767 conn(0x7f3a2009ac80 msgr2=0x7f3a2009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.413+0000 7f3a25d2b640 1 -- 172.21.15.53:0/1778929767 shutdown_connections 2024-09-22T08:10:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:18.413+0000 7f3a25d2b640 1 -- 172.21.15.53:0/1778929767 wait complete. 2024-09-22T08:10:18.425 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-22T08:10:18.425 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-22T08:10:18.827 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:10:18.921 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.920+0000 7efd572b6640 1 Processor -- start 2024-09-22T08:10:18.922 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.920+0000 7efd572b6640 1 -- start start 2024-09-22T08:10:18.922 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.920+0000 7efd572b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd501325e0 0x7efd501349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:18.922 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.920+0000 7efd572b6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5009bcf0 con 0x7efd50099b60 2024-09-22T08:10:18.923 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.920+0000 7efd572b6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7efd5009af10 con 0x7efd501325e0 2024-09-22T08:10:18.923 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.921+0000 7efd54851640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd501325e0 0x7efd501349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:18.923 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.921+0000 7efd55052640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efd50099b60 0x7efd50099f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33888/0 (socket says 172.21.15.53:33888) 2024-09-22T08:10:18.923 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.921+0000 7efd55052640 1 -- 172.21.15.53:0/2135405013 learned_addr learned my addr 172.21.15.53:0/2135405013 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:18.923 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.921+0000 7efd54851640 1 -- 172.21.15.53:0/2135405013 >> v1:172.21.15.53:6789/0 conn(0x7efd50099b60 legacy=0x7efd50099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:18.923 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.921+0000 7efd54851640 1 -- 172.21.15.53:0/2135405013 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5009a650 con 0x7efd501325e0 2024-09-22T08:10:18.923 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.921+0000 7efd47fff640 1 -- 172.21.15.53:0/2135405013 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3092687288 0 0) 0x7efd5009bcf0 con 0x7efd50099b60 2024-09-22T08:10:18.924 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.921+0000 7efd54851640 1 --2- 172.21.15.53:0/2135405013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd501325e0 0x7efd501349d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd40009720 tx=0x7efd4002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbd886ca19aab9f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:18.924 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.922+0000 7efd47fff640 1 -- 172.21.15.53:0/2135405013 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd40037070 con 0x7efd501325e0 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.922+0000 7efd47fff640 1 -- 172.21.15.53:0/2135405013 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4002ad90 con 0x7efd501325e0 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.922+0000 7efd47fff640 1 -- 172.21.15.53:0/2135405013 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd40032590 con 0x7efd501325e0 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.922+0000 7efd572b6640 1 -- 172.21.15.53:0/2135405013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd501325e0 msgr2=0x7efd501349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.922+0000 7efd572b6640 1 --2- 172.21.15.53:0/2135405013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd501325e0 0x7efd501349d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd40009720 tx=0x7efd4002a110 comp rx=0 tx=0).stop 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.922+0000 7efd572b6640 1 -- 172.21.15.53:0/2135405013 shutdown_connections 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.922+0000 7efd572b6640 1 --2- 172.21.15.53:0/2135405013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd501325e0 0x7efd501349d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.922+0000 7efd572b6640 1 -- 172.21.15.53:0/2135405013 >> 172.21.15.53:0/2135405013 conn(0x7efd500a0100 msgr2=0x7efd500a0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.922+0000 7efd572b6640 1 -- 172.21.15.53:0/2135405013 shutdown_connections 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.922+0000 7efd572b6640 1 -- 172.21.15.53:0/2135405013 wait complete. 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.923+0000 7efd572b6640 1 Processor -- start 2024-09-22T08:10:18.925 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.923+0000 7efd572b6640 1 -- start start 2024-09-22T08:10:18.927 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.923+0000 7efd572b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd50099b60 0x7efd501c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:18.927 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd572b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efd50135090 con 0x7efd50099b60 2024-09-22T08:10:18.927 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd55052640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd50099b60 0x7efd501c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:18.927 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd55052640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd50099b60 0x7efd501c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45728/0 (socket says 172.21.15.53:45728) 2024-09-22T08:10:18.927 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd55052640 1 -- 172.21.15.53:0/2906712487 learned_addr learned my addr 172.21.15.53:0/2906712487 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:18.927 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd55052640 1 -- 172.21.15.53:0/2906712487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd500929d0 con 0x7efd50099b60 2024-09-22T08:10:18.927 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd55052640 1 --2- 172.21.15.53:0/2906712487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd50099b60 0x7efd501c43b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00c3d0 tx=0x7efd4c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:18.928 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd45ffb640 1 -- 172.21.15.53:0/2906712487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd4c0074d0 con 0x7efd50099b60 2024-09-22T08:10:18.928 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd45ffb640 1 -- 172.21.15.53:0/2906712487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4c0047e0 con 0x7efd50099b60 2024-09-22T08:10:18.928 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd572b6640 1 -- 172.21.15.53:0/2906712487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd50093550 con 0x7efd50099b60 2024-09-22T08:10:18.928 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd45ffb640 1 -- 172.21.15.53:0/2906712487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd4c007670 con 0x7efd50099b60 2024-09-22T08:10:18.928 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.924+0000 7efd572b6640 1 -- 172.21.15.53:0/2906712487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd50093a80 con 0x7efd50099b60 2024-09-22T08:10:18.928 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.925+0000 7efd45ffb640 1 -- 172.21.15.53:0/2906712487 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efd4c011070 con 0x7efd50099b60 2024-09-22T08:10:18.928 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.925+0000 7efd45ffb640 1 -- 172.21.15.53:0/2906712487 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7efd4c01d900 con 0x7efd50099b60 2024-09-22T08:10:18.928 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.925+0000 7efd572b6640 1 -- 172.21.15.53:0/2906712487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd50093d60 con 0x7efd50099b60 2024-09-22T08:10:18.928 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.927+0000 7efd45ffb640 1 -- 172.21.15.53:0/2906712487 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7efd50093d60 con 0x7efd50099b60 2024-09-22T08:10:18.989 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.988+0000 7efd572b6640 1 -- 172.21.15.53:0/2906712487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd50131400 con 0x7efd50099b60 2024-09-22T08:10:18.990 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.989+0000 7efd45ffb640 1 -- 172.21.15.53:0/2906712487 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7efd50131400 con 0x7efd50099b60 2024-09-22T08:10:18.990 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-22T08:10:18.990 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":6,"fsid":"e28b0ed0-1272-43e5-8a68-aa2f8d89bec5","created":"2024-09-22T08:10:17.147434+0000","modified":"2024-09-22T08:10:18.218936+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:10:18.218936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b0004653-b98d-4b1a-a928-2f6ef86bf15c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c85ab72a-9b5c-4d4d-a0d1-3d32724a8d29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0698e09-e99e-43f6-840b-999b20fc7d32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"413ad162-0b9b-437b-a3b4-0c4e1170cd61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:10:18.991 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.989+0000 7efd572b6640 1 -- 172.21.15.53:0/2906712487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd50099b60 msgr2=0x7efd501c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:18.991 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.989+0000 7efd572b6640 1 --2- 172.21.15.53:0/2906712487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd50099b60 0x7efd501c43b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00c3d0 tx=0x7efd4c00c890 comp rx=0 tx=0).stop 2024-09-22T08:10:18.991 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.989+0000 7efd572b6640 1 -- 172.21.15.53:0/2906712487 shutdown_connections 2024-09-22T08:10:18.991 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.989+0000 7efd572b6640 1 --2- 172.21.15.53:0/2906712487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd50099b60 0x7efd501c43b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:18.991 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.989+0000 7efd572b6640 1 -- 172.21.15.53:0/2906712487 >> 172.21.15.53:0/2906712487 conn(0x7efd500a0100 msgr2=0x7efd5009de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:18.992 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.989+0000 7efd572b6640 1 -- 172.21.15.53:0/2906712487 shutdown_connections 2024-09-22T08:10:18.992 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:18.989+0000 7efd572b6640 1 -- 172.21.15.53:0/2906712487 wait complete. 2024-09-22T08:10:19.000 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-22T08:10:19.657 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-22T08:10:19.655+0000 7fc4c1f20640 -1 Falling back to public interface 2024-09-22T08:10:19.703 INFO:tasks.ceph.osd.3.smithi165.stderr:2024-09-22T08:10:19.702+0000 7f614549c640 -1 Falling back to public interface 2024-09-22T08:10:19.924 INFO:tasks.ceph.osd.2.smithi165.stderr:2024-09-22T08:10:19.923+0000 7f8965af1640 -1 Falling back to public interface 2024-09-22T08:10:19.937 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-09-22T08:10:19.936+0000 7fa07cc10640 -1 Falling back to public interface 2024-09-22T08:10:22.560 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-22T08:10:22.559+0000 7f94e2afd640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-22T08:10:23.168 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-22T08:10:23.166+0000 7fc4c1f20640 -1 osd.0 0 log_to_monitors true 2024-09-22T08:10:23.508 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-09-22T08:10:23.508+0000 7fa07cc10640 -1 osd.1 0 log_to_monitors true 2024-09-22T08:10:23.523 INFO:tasks.ceph.osd.3.smithi165.stderr:2024-09-22T08:10:23.522+0000 7f614549c640 -1 osd.3 0 log_to_monitors true 2024-09-22T08:10:23.966 INFO:tasks.ceph.osd.2.smithi165.stderr:2024-09-22T08:10:23.966+0000 7f8965af1640 -1 osd.2 0 log_to_monitors true 2024-09-22T08:10:25.359 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-22T08:10:25.358+0000 7fc4bdeaf640 -1 osd.0 0 waiting for initial osdmap 2024-09-22T08:10:25.373 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-22T08:10:25.372+0000 7fc4b5cce640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:10:25.404 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:10:25.497 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.495+0000 7f12a7260640 1 Processor -- start 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.495+0000 7f12a7260640 1 -- start start 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.495+0000 7f12a7260640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f12a0073240 0x7f12a0073620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.495+0000 7f12a7260640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a006f940 con 0x7f12a00721a0 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.495+0000 7f12a7260640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f12a0074180 con 0x7f12a0073240 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.495+0000 7f12a4ffc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f12a0073240 0x7f12a0073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.496+0000 7f129ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f12a00721a0 0x7f12a012d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33902/0 (socket says 172.21.15.53:33902) 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.496+0000 7f129ffff640 1 -- 172.21.15.53:0/115627113 learned_addr learned my addr 172.21.15.53:0/115627113 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.496+0000 7f129f7fe640 1 -- 172.21.15.53:0/115627113 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188072835 0 0) 0x7f12a006f940 con 0x7f12a00721a0 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.496+0000 7f129f7fe640 1 -- 172.21.15.53:0/115627113 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1290003520 con 0x7f12a00721a0 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.496+0000 7f12a4ffc640 1 -- 172.21.15.53:0/115627113 >> v1:172.21.15.53:6789/0 conn(0x7f12a00721a0 legacy=0x7f12a012d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:25.498 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.496+0000 7f12a4ffc640 1 -- 172.21.15.53:0/115627113 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a0072910 con 0x7f12a0073240 2024-09-22T08:10:25.502 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f12a4ffc640 1 --2- 172.21.15.53:0/115627113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a0073240 0x7f12a0073620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1294009720 tx=0x7f129402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca45a2861a4eecb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:25.502 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f129f7fe640 1 -- 172.21.15.53:0/115627113 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1294037070 con 0x7f12a0073240 2024-09-22T08:10:25.502 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f129f7fe640 1 -- 172.21.15.53:0/115627113 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129402ad90 con 0x7f12a0073240 2024-09-22T08:10:25.502 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f129f7fe640 1 -- 172.21.15.53:0/115627113 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1294032590 con 0x7f12a0073240 2024-09-22T08:10:25.502 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f12a7260640 1 -- 172.21.15.53:0/115627113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a0073240 msgr2=0x7f12a0073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:25.502 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f12a7260640 1 --2- 172.21.15.53:0/115627113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a0073240 0x7f12a0073620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1294009720 tx=0x7f129402a110 comp rx=0 tx=0).stop 2024-09-22T08:10:25.502 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f12a7260640 1 -- 172.21.15.53:0/115627113 shutdown_connections 2024-09-22T08:10:25.502 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f12a7260640 1 --2- 172.21.15.53:0/115627113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a0073240 0x7f12a0073620 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:25.502 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f12a7260640 1 -- 172.21.15.53:0/115627113 >> 172.21.15.53:0/115627113 conn(0x7f12a009ba10 msgr2=0x7f12a009be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f12a7260640 1 -- 172.21.15.53:0/115627113 shutdown_connections 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.497+0000 7f12a7260640 1 -- 172.21.15.53:0/115627113 wait complete. 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.498+0000 7f12a7260640 1 Processor -- start 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.498+0000 7f12a7260640 1 -- start start 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f12a7260640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a00721a0 0x7f12a01c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f12a7260640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f12a0073ef0 con 0x7f12a00721a0 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f12a4ffc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a00721a0 0x7f12a01c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f12a4ffc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a00721a0 0x7f12a01c21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45758/0 (socket says 172.21.15.53:45758) 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f12a4ffc640 1 -- 172.21.15.53:0/1516189059 learned_addr learned my addr 172.21.15.53:0/1516189059 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f12a4ffc640 1 -- 172.21.15.53:0/1516189059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a008e320 con 0x7f12a00721a0 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f12a4ffc640 1 --2- 172.21.15.53:0/1516189059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a00721a0 0x7f12a01c21a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1294000c00 tx=0x7f12940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f129d7fa640 1 -- 172.21.15.53:0/1516189059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1294041070 con 0x7f12a00721a0 2024-09-22T08:10:25.503 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f129d7fa640 1 -- 172.21.15.53:0/1516189059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129403c460 con 0x7f12a00721a0 2024-09-22T08:10:25.504 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f129d7fa640 1 -- 172.21.15.53:0/1516189059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1294037040 con 0x7f12a00721a0 2024-09-22T08:10:25.504 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f12a7260640 1 -- 172.21.15.53:0/1516189059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a008d570 con 0x7f12a00721a0 2024-09-22T08:10:25.504 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.499+0000 7f12a7260640 1 -- 172.21.15.53:0/1516189059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a01c26e0 con 0x7f12a00721a0 2024-09-22T08:10:25.504 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.500+0000 7f129d7fa640 1 -- 172.21.15.53:0/1516189059 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 50975+0+0 (secure 0 0 0) 0x7f1294044070 con 0x7f12a00721a0 2024-09-22T08:10:25.504 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.500+0000 7f12a7260640 1 -- 172.21.15.53:0/1516189059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a012df20 con 0x7f12a00721a0 2024-09-22T08:10:25.504 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.501+0000 7f129d7fa640 1 --2- 172.21.15.53:0/1516189059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f128403e680 0x7f1284040b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:25.504 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.501+0000 7f129d7fa640 1 -- 172.21.15.53:0/1516189059 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1607+0+0 (secure 0 0 0) 0x7f1294072b80 con 0x7f12a00721a0 2024-09-22T08:10:25.504 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.501+0000 7f129ffff640 1 --2- 172.21.15.53:0/1516189059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f128403e680 0x7f1284040b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:25.505 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.501+0000 7f129ffff640 1 --2- 172.21.15.53:0/1516189059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f128403e680 0x7f1284040b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f128c001610 tx=0x7f128c0078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:25.507 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.506+0000 7f129d7fa640 1 -- 172.21.15.53:0/1516189059 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f129403c760 con 0x7f12a00721a0 2024-09-22T08:10:25.699 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.697+0000 7f12a7260640 1 -- 172.21.15.53:0/1516189059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12a0097e30 con 0x7f12a00721a0 2024-09-22T08:10:25.699 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.698+0000 7f129d7fa640 1 -- 172.21.15.53:0/1516189059 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+4649 (secure 0 0 0) 0x7f129403cc80 con 0x7f12a00721a0 2024-09-22T08:10:25.700 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-22T08:10:25.700 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":9,"fsid":"e28b0ed0-1272-43e5-8a68-aa2f8d89bec5","created":"2024-09-22T08:10:17.147434+0000","modified":"2024-09-22T08:10:25.560886+0000","last_up_change":"2024-09-22T08:10:25.560886+0000","last_in_change":"2024-09-22T08:10:18.218936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b0004653-b98d-4b1a-a928-2f6ef86bf15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6801","nonce":2902972477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6803","nonce":2902972477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6807","nonce":2902972477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6805","nonce":2902972477}]},"public_addr":"172.21.15.53:6801/2902972477","cluster_addr":"172.21.15.53:6803/2902972477","heartbeat_back_addr":"172.21.15.53:6807/2902972477","heartbeat_front_addr":"172.21.15.53:6805/2902972477","state":["exists","up"]},{"osd":1,"uuid":"c85ab72a-9b5c-4d4d-a0d1-3d32724a8d29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0698e09-e99e-43f6-840b-999b20fc7d32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"413ad162-0b9b-437b-a3b4-0c4e1170cd61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:10:25.702 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.701+0000 7f12a7260640 1 -- 172.21.15.53:0/1516189059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f128403e680 msgr2=0x7f1284040b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:25.702 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.701+0000 7f12a7260640 1 --2- 172.21.15.53:0/1516189059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f128403e680 0x7f1284040b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f128c001610 tx=0x7f128c0078f0 comp rx=0 tx=0).stop 2024-09-22T08:10:25.703 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.701+0000 7f12a7260640 1 -- 172.21.15.53:0/1516189059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a00721a0 msgr2=0x7f12a01c21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:25.703 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.701+0000 7f12a7260640 1 --2- 172.21.15.53:0/1516189059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a00721a0 0x7f12a01c21a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1294000c00 tx=0x7f12940046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:25.703 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.701+0000 7f12a7260640 1 -- 172.21.15.53:0/1516189059 shutdown_connections 2024-09-22T08:10:25.703 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.701+0000 7f12a7260640 1 --2- 172.21.15.53:0/1516189059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f128403e680 0x7f1284040b40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:25.703 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.701+0000 7f12a7260640 1 --2- 172.21.15.53:0/1516189059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12a00721a0 0x7f12a01c21a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:25.703 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.701+0000 7f12a7260640 1 -- 172.21.15.53:0/1516189059 >> 172.21.15.53:0/1516189059 conn(0x7f12a009ba10 msgr2=0x7f12a0129e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:25.703 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.701+0000 7f12a7260640 1 -- 172.21.15.53:0/1516189059 shutdown_connections 2024-09-22T08:10:25.703 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:25.701+0000 7f12a7260640 1 -- 172.21.15.53:0/1516189059 wait complete. 2024-09-22T08:10:25.712 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-09-22T08:10:25.895 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-09-22T08:10:25.894+0000 7fa0784fe640 -1 osd.1 0 waiting for initial osdmap 2024-09-22T08:10:25.916 INFO:tasks.ceph.osd.1.smithi165.stderr:2024-09-22T08:10:25.916+0000 7fa07031d640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:10:25.919 INFO:tasks.ceph.osd.3.smithi165.stderr:2024-09-22T08:10:25.919+0000 7f6141c3f640 -1 osd.3 0 waiting for initial osdmap 2024-09-22T08:10:25.942 INFO:tasks.ceph.osd.3.smithi165.stderr:2024-09-22T08:10:25.942+0000 7f613924a640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:10:26.507 INFO:tasks.ceph.osd.2.smithi165.stderr:2024-09-22T08:10:26.506+0000 7f8961a80640 -1 osd.2 0 waiting for initial osdmap 2024-09-22T08:10:26.521 INFO:tasks.ceph.osd.2.smithi165.stderr:2024-09-22T08:10:26.521+0000 7f895989f640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:10:32.116 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:10:32.221 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.220+0000 7fce13e1f640 1 Processor -- start 2024-09-22T08:10:32.222 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.220+0000 7fce13e1f640 1 -- start start 2024-09-22T08:10:32.222 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.221+0000 7fce13e1f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fce0c12cd50 0x7fce0c131790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:32.223 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.221+0000 7fce13e1f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c06cd10 con 0x7fce0c12c260 2024-09-22T08:10:32.223 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.221+0000 7fce13e1f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fce0c0713d0 con 0x7fce0c12cd50 2024-09-22T08:10:32.223 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.221+0000 7fce113ba640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fce0c12cd50 0x7fce0c131790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:32.223 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.221+0000 7fce11bbb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fce0c12c260 0x7fce0c12c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52142/0 (socket says 172.21.15.53:52142) 2024-09-22T08:10:32.223 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.221+0000 7fce11bbb640 1 -- 172.21.15.53:0/3364337226 learned_addr learned my addr 172.21.15.53:0/3364337226 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:32.223 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.221+0000 7fce113ba640 1 -- 172.21.15.53:0/3364337226 >> v1:172.21.15.53:6789/0 conn(0x7fce0c12c260 legacy=0x7fce0c12c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:32.223 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.221+0000 7fce10bb9640 1 -- 172.21.15.53:0/3364337226 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2743843355 0 0) 0x7fce0c06cd10 con 0x7fce0c12c260 2024-09-22T08:10:32.223 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.221+0000 7fce113ba640 1 -- 172.21.15.53:0/3364337226 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c06e390 con 0x7fce0c12cd50 2024-09-22T08:10:32.224 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.222+0000 7fce113ba640 1 --2- 172.21.15.53:0/3364337226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12cd50 0x7fce0c131790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009720 tx=0x7fcdfc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e024765d7333c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:32.224 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.222+0000 7fce10bb9640 1 -- 172.21.15.53:0/3364337226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc037070 con 0x7fce0c12cd50 2024-09-22T08:10:32.224 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.222+0000 7fce10bb9640 1 -- 172.21.15.53:0/3364337226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdfc02ad90 con 0x7fce0c12cd50 2024-09-22T08:10:32.224 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.222+0000 7fce10bb9640 1 -- 172.21.15.53:0/3364337226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdfc032590 con 0x7fce0c12cd50 2024-09-22T08:10:32.224 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.223+0000 7fce13e1f640 1 -- 172.21.15.53:0/3364337226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12cd50 msgr2=0x7fce0c131790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:32.225 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.223+0000 7fce13e1f640 1 --2- 172.21.15.53:0/3364337226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12cd50 0x7fce0c131790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009720 tx=0x7fcdfc02a110 comp rx=0 tx=0).stop 2024-09-22T08:10:32.225 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.223+0000 7fce13e1f640 1 -- 172.21.15.53:0/3364337226 shutdown_connections 2024-09-22T08:10:32.225 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.223+0000 7fce13e1f640 1 --2- 172.21.15.53:0/3364337226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12cd50 0x7fce0c131790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:32.225 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.223+0000 7fce13e1f640 1 -- 172.21.15.53:0/3364337226 >> 172.21.15.53:0/3364337226 conn(0x7fce0c09ba10 msgr2=0x7fce0c09be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:32.225 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.223+0000 7fce13e1f640 1 -- 172.21.15.53:0/3364337226 shutdown_connections 2024-09-22T08:10:32.225 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.223+0000 7fce13e1f640 1 -- 172.21.15.53:0/3364337226 wait complete. 2024-09-22T08:10:32.226 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.224+0000 7fce13e1f640 1 Processor -- start 2024-09-22T08:10:32.226 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.224+0000 7fce13e1f640 1 -- start start 2024-09-22T08:10:32.226 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.224+0000 7fce13e1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12c260 0x7fce0c097670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.224+0000 7fce13e1f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c131e50 con 0x7fce0c12c260 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.224+0000 7fce11bbb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12c260 0x7fce0c097670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.224+0000 7fce11bbb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12c260 0x7fce0c097670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48224/0 (socket says 172.21.15.53:48224) 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.224+0000 7fce11bbb640 1 -- 172.21.15.53:0/625494218 learned_addr learned my addr 172.21.15.53:0/625494218 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.224+0000 7fce11bbb640 1 -- 172.21.15.53:0/625494218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c128550 con 0x7fce0c12c260 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.225+0000 7fce11bbb640 1 --2- 172.21.15.53:0/625494218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12c260 0x7fce0c097670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fce0800c3d0 tx=0x7fce0800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.225+0000 7fce027fc640 1 -- 172.21.15.53:0/625494218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce080074d0 con 0x7fce0c12c260 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.225+0000 7fce027fc640 1 -- 172.21.15.53:0/625494218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce080047e0 con 0x7fce0c12c260 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.225+0000 7fce13e1f640 1 -- 172.21.15.53:0/625494218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce0c12ddc0 con 0x7fce0c12c260 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.225+0000 7fce027fc640 1 -- 172.21.15.53:0/625494218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce08007670 con 0x7fce0c12c260 2024-09-22T08:10:32.227 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.225+0000 7fce13e1f640 1 -- 172.21.15.53:0/625494218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce0c097d90 con 0x7fce0c12c260 2024-09-22T08:10:32.228 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.226+0000 7fce027fc640 1 -- 172.21.15.53:0/625494218 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fce08011070 con 0x7fce0c12c260 2024-09-22T08:10:32.228 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.226+0000 7fce13e1f640 1 -- 172.21.15.53:0/625494218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce0c12e8d0 con 0x7fce0c12c260 2024-09-22T08:10:32.228 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.226+0000 7fce027fc640 1 --2- 172.21.15.53:0/625494218 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcdf003e710 0x7fcdf0040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:32.228 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.226+0000 7fce027fc640 1 -- 172.21.15.53:0/625494218 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7fce080527a0 con 0x7fce0c12c260 2024-09-22T08:10:32.228 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.226+0000 7fce113ba640 1 --2- 172.21.15.53:0/625494218 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcdf003e710 0x7fcdf0040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:32.229 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.227+0000 7fce113ba640 1 --2- 172.21.15.53:0/625494218 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcdf003e710 0x7fcdf0040bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc034000 tx=0x7fcdfc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:32.232 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.231+0000 7fce027fc640 1 -- 172.21.15.53:0/625494218 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fce08012dd0 con 0x7fce0c12c260 2024-09-22T08:10:32.420 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.418+0000 7fce13e1f640 1 -- 172.21.15.53:0/625494218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce0c12d970 con 0x7fce0c12c260 2024-09-22T08:10:32.421 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.419+0000 7fce027fc640 1 -- 172.21.15.53:0/625494218 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8002 (secure 0 0 0) 0x7fce08010d40 con 0x7fce0c12c260 2024-09-22T08:10:32.421 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-22T08:10:32.421 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":13,"fsid":"e28b0ed0-1272-43e5-8a68-aa2f8d89bec5","created":"2024-09-22T08:10:17.147434+0000","modified":"2024-09-22T08:10:29.900909+0000","last_up_change":"2024-09-22T08:10:26.896360+0000","last_in_change":"2024-09-22T08:10:18.218936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:10:27.573518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0004653-b98d-4b1a-a928-2f6ef86bf15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6801","nonce":2902972477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6803","nonce":2902972477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6807","nonce":2902972477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6805","nonce":2902972477}]},"public_addr":"172.21.15.53:6801/2902972477","cluster_addr":"172.21.15.53:6803/2902972477","heartbeat_back_addr":"172.21.15.53:6807/2902972477","heartbeat_front_addr":"172.21.15.53:6805/2902972477","state":["exists","up"]},{"osd":1,"uuid":"c85ab72a-9b5c-4d4d-a0d1-3d32724a8d29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6817","nonce":2347568643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6819","nonce":2347568643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6823","nonce":2347568643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6821","nonce":2347568643}]},"public_addr":"172.21.15.165:6817/2347568643","cluster_addr":"172.21.15.165:6819/2347568643","heartbeat_back_addr":"172.21.15.165:6823/2347568643","heartbeat_front_addr":"172.21.15.165:6821/2347568643","state":["exists","up"]},{"osd":2,"uuid":"f0698e09-e99e-43f6-840b-999b20fc7d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6809","nonce":3197121696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6811","nonce":3197121696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6815","nonce":3197121696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6813","nonce":3197121696}]},"public_addr":"172.21.15.165:6809/3197121696","cluster_addr":"172.21.15.165:6811/3197121696","heartbeat_back_addr":"172.21.15.165:6815/3197121696","heartbeat_front_addr":"172.21.15.165:6813/3197121696","state":["exists","up"]},{"osd":3,"uuid":"413ad162-0b9b-437b-a3b4-0c4e1170cd61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6801","nonce":215521179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6803","nonce":215521179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6807","nonce":215521179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6805","nonce":215521179}]},"public_addr":"172.21.15.165:6801/215521179","cluster_addr":"172.21.15.165:6803/215521179","heartbeat_back_addr":"172.21.15.165:6807/215521179","heartbeat_front_addr":"172.21.15.165:6805/215521179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.156688+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.537972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.998790+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:25.920032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:10:32.423 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.421+0000 7fce13e1f640 1 -- 172.21.15.53:0/625494218 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcdf003e710 msgr2=0x7fcdf0040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:32.423 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.421+0000 7fce13e1f640 1 --2- 172.21.15.53:0/625494218 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcdf003e710 0x7fcdf0040bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc034000 tx=0x7fcdfc02e000 comp rx=0 tx=0).stop 2024-09-22T08:10:32.423 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.421+0000 7fce13e1f640 1 -- 172.21.15.53:0/625494218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12c260 msgr2=0x7fce0c097670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:32.423 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.421+0000 7fce13e1f640 1 --2- 172.21.15.53:0/625494218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12c260 0x7fce0c097670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fce0800c3d0 tx=0x7fce0800c890 comp rx=0 tx=0).stop 2024-09-22T08:10:32.423 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.421+0000 7fce13e1f640 1 -- 172.21.15.53:0/625494218 shutdown_connections 2024-09-22T08:10:32.423 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.421+0000 7fce13e1f640 1 --2- 172.21.15.53:0/625494218 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcdf003e710 0x7fcdf0040bd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:32.423 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.421+0000 7fce13e1f640 1 --2- 172.21.15.53:0/625494218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce0c12c260 0x7fce0c097670 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:32.424 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.421+0000 7fce13e1f640 1 -- 172.21.15.53:0/625494218 >> 172.21.15.53:0/625494218 conn(0x7fce0c09ba10 msgr2=0x7fce0c072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:32.424 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.421+0000 7fce13e1f640 1 -- 172.21.15.53:0/625494218 shutdown_connections 2024-09-22T08:10:32.424 INFO:teuthology.misc.health.smithi053.stderr:2024-09-22T08:10:32.421+0000 7fce13e1f640 1 -- 172.21.15.53:0/625494218 wait complete. 2024-09-22T08:10:32.433 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-22T08:10:32.433 INFO:tasks.ceph:Creating RBD pool 2024-09-22T08:10:32.433 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-22T08:10:32.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.532+0000 7f4b9be85640 1 Processor -- start 2024-09-22T08:10:32.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.532+0000 7f4b9be85640 1 -- start start 2024-09-22T08:10:32.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.533+0000 7f4b9be85640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4b9406f4c0 0x7f4b94134900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:32.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.533+0000 7f4b9be85640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9406f940 con 0x7f4b9406e9d0 2024-09-22T08:10:32.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.533+0000 7f4b9be85640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4b940a2ed0 con 0x7f4b9406f4c0 2024-09-22T08:10:32.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.533+0000 7f4b99420640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4b9406f4c0 0x7f4b94134900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:32.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.533+0000 7f4b99c21640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4b9406e9d0 0x7f4b9406edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52156/0 (socket says 172.21.15.53:52156) 2024-09-22T08:10:32.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.533+0000 7f4b99c21640 1 -- 172.21.15.53:0/2423053452 learned_addr learned my addr 172.21.15.53:0/2423053452 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:32.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.533+0000 7f4b99420640 1 -- 172.21.15.53:0/2423053452 >> v1:172.21.15.53:6789/0 conn(0x7f4b9406e9d0 legacy=0x7f4b9406edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:32.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.533+0000 7f4b99420640 1 -- 172.21.15.53:0/2423053452 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b94099ba0 con 0x7f4b9406f4c0 2024-09-22T08:10:32.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.534+0000 7f4b99420640 1 --2- 172.21.15.53:0/2423053452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406f4c0 0x7f4b94134900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009750 tx=0x7f4b8802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd0dd1875864173 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.534+0000 7f4b98c1f640 1 -- 172.21.15.53:0/2423053452 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b88037070 con 0x7f4b9406f4c0 2024-09-22T08:10:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.534+0000 7f4b98c1f640 1 -- 172.21.15.53:0/2423053452 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8802ad80 con 0x7f4b9406f4c0 2024-09-22T08:10:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.534+0000 7f4b98c1f640 1 -- 172.21.15.53:0/2423053452 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b88032590 con 0x7f4b9406f4c0 2024-09-22T08:10:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.535+0000 7f4b9be85640 1 -- 172.21.15.53:0/2423053452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406f4c0 msgr2=0x7f4b94134900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.535+0000 7f4b9be85640 1 --2- 172.21.15.53:0/2423053452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406f4c0 0x7f4b94134900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009750 tx=0x7f4b8802a140 comp rx=0 tx=0).stop 2024-09-22T08:10:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.535+0000 7f4b9be85640 1 -- 172.21.15.53:0/2423053452 shutdown_connections 2024-09-22T08:10:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.535+0000 7f4b9be85640 1 --2- 172.21.15.53:0/2423053452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406f4c0 0x7f4b94134900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.535+0000 7f4b9be85640 1 -- 172.21.15.53:0/2423053452 >> 172.21.15.53:0/2423053452 conn(0x7f4b940a02a0 msgr2=0x7f4b940a06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.535+0000 7f4b9be85640 1 -- 172.21.15.53:0/2423053452 shutdown_connections 2024-09-22T08:10:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.535+0000 7f4b9be85640 1 -- 172.21.15.53:0/2423053452 wait complete. 2024-09-22T08:10:32.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.536+0000 7f4b9be85640 1 Processor -- start 2024-09-22T08:10:32.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.536+0000 7f4b9be85640 1 -- start start 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.536+0000 7f4b9be85640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406e9d0 0x7f4b940982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.536+0000 7f4b9be85640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4b941351d0 con 0x7f4b9406e9d0 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.536+0000 7f4b99c21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406e9d0 0x7f4b940982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.536+0000 7f4b99c21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406e9d0 0x7f4b940982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48242/0 (socket says 172.21.15.53:48242) 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.536+0000 7f4b99c21640 1 -- 172.21.15.53:0/2110093675 learned_addr learned my addr 172.21.15.53:0/2110093675 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.536+0000 7f4b99c21640 1 -- 172.21.15.53:0/2110093675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b94131f40 con 0x7f4b9406e9d0 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.537+0000 7f4b99c21640 1 --2- 172.21.15.53:0/2110093675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406e9d0 0x7f4b940982f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000c480 tx=0x7f4b9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.537+0000 7f4b867fc640 1 -- 172.21.15.53:0/2110093675 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b90017070 con 0x7f4b9406e9d0 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.537+0000 7f4b867fc640 1 -- 172.21.15.53:0/2110093675 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b90005c10 con 0x7f4b9406e9d0 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.537+0000 7f4b9be85640 1 -- 172.21.15.53:0/2110093675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b94133c20 con 0x7f4b9406e9d0 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.537+0000 7f4b867fc640 1 -- 172.21.15.53:0/2110093675 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b90007070 con 0x7f4b9406e9d0 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.537+0000 7f4b9be85640 1 -- 172.21.15.53:0/2110093675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b94098830 con 0x7f4b9406e9d0 2024-09-22T08:10:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.538+0000 7f4b9be85640 1 -- 172.21.15.53:0/2110093675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9406edb0 con 0x7f4b9406e9d0 2024-09-22T08:10:32.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.538+0000 7f4b867fc640 1 -- 172.21.15.53:0/2110093675 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4b9001a070 con 0x7f4b9406e9d0 2024-09-22T08:10:32.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.538+0000 7f4b867fc640 1 --2- 172.21.15.53:0/2110093675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4b7803e710 0x7f4b78040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:32.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.538+0000 7f4b867fc640 1 -- 172.21.15.53:0/2110093675 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f4b90051ed0 con 0x7f4b9406e9d0 2024-09-22T08:10:32.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.538+0000 7f4b99420640 1 --2- 172.21.15.53:0/2110093675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4b7803e710 0x7f4b78040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:32.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.539+0000 7f4b99420640 1 --2- 172.21.15.53:0/2110093675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4b7803e710 0x7f4b78040bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4b88034000 tx=0x7f4b8802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.543+0000 7f4b867fc640 1 -- 172.21.15.53:0/2110093675 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4b90050f00 con 0x7f4b9406e9d0 2024-09-22T08:10:32.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.730+0000 7f4b9be85640 1 -- 172.21.15.53:0/2110093675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f4b94132b40 con 0x7f4b9406e9d0 2024-09-22T08:10:32.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.904+0000 7f4b867fc640 1 -- 172.21.15.53:0/2110093675 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7f4b90019cd0 con 0x7f4b9406e9d0 2024-09-22T08:10:32.906 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'rbd' created 2024-09-22T08:10:32.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.907+0000 7f4b9be85640 1 -- 172.21.15.53:0/2110093675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4b7803e710 msgr2=0x7f4b78040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:32.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.907+0000 7f4b9be85640 1 --2- 172.21.15.53:0/2110093675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4b7803e710 0x7f4b78040bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4b88034000 tx=0x7f4b8802e000 comp rx=0 tx=0).stop 2024-09-22T08:10:32.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.907+0000 7f4b9be85640 1 -- 172.21.15.53:0/2110093675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406e9d0 msgr2=0x7f4b940982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:32.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.907+0000 7f4b9be85640 1 --2- 172.21.15.53:0/2110093675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406e9d0 0x7f4b940982f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000c480 tx=0x7f4b9000c940 comp rx=0 tx=0).stop 2024-09-22T08:10:32.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.908+0000 7f4b9be85640 1 -- 172.21.15.53:0/2110093675 shutdown_connections 2024-09-22T08:10:32.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.908+0000 7f4b9be85640 1 --2- 172.21.15.53:0/2110093675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4b7803e710 0x7f4b78040bd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:32.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.908+0000 7f4b9be85640 1 --2- 172.21.15.53:0/2110093675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9406e9d0 0x7f4b940982f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:32.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.908+0000 7f4b9be85640 1 -- 172.21.15.53:0/2110093675 >> 172.21.15.53:0/2110093675 conn(0x7f4b940a02a0 msgr2=0x7f4b9412c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:32.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.908+0000 7f4b9be85640 1 -- 172.21.15.53:0/2110093675 shutdown_connections 2024-09-22T08:10:32.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.908+0000 7f4b9be85640 1 -- 172.21.15.53:0/2110093675 wait complete. 2024-09-22T08:10:32.921 DEBUG:teuthology.orchestra.run.smithi053:> rbd --cluster ceph pool init rbd 2024-09-22T08:10:32.999 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:10:32.999 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:10:33.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.999+0000 7f352e43b140 1 Processor -- start 2024-09-22T08:10:33.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.999+0000 7f352e43b140 1 -- start start 2024-09-22T08:10:33.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.999+0000 7f352e43b140 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56385f71e800 0x56385f71ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:33.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.999+0000 7f352e43b140 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56385f5a57d0 con 0x56385f71f120 2024-09-22T08:10:33.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.999+0000 7f352e43b140 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56385f60c0c0 con 0x56385f71e800 2024-09-22T08:10:33.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.999+0000 7f352c45a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56385f71e800 0x56385f71ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:33.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.999+0000 7f352bc59640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56385f71f120 0x56385f7c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52166/0 (socket says 172.21.15.53:52166) 2024-09-22T08:10:33.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.999+0000 7f352c45a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56385f71e800 0x56385f71ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48256/0 (socket says 172.21.15.53:48256) 2024-09-22T08:10:33.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:32.999+0000 7f352bc59640 1 -- 172.21.15.53:0/3245891927 learned_addr learned my addr 172.21.15.53:0/3245891927 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:33.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.000+0000 7f352c45a640 1 -- 172.21.15.53:0/3245891927 >> v1:172.21.15.53:6789/0 conn(0x56385f71f120 legacy=0x56385f7c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:33.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.000+0000 7f352c45a640 1 -- 172.21.15.53:0/3245891927 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56385f5d3410 con 0x56385f71e800 2024-09-22T08:10:33.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.001+0000 7f352c45a640 1 --2- 172.21.15.53:0/3245891927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 0x56385f71ebe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f351c00a470 tx=0x7f351c045ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7d993f1fbb95e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.002+0000 7f352b458640 1 -- 172.21.15.53:0/3245891927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351c056020 con 0x56385f71e800 2024-09-22T08:10:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.002+0000 7f352b458640 1 -- 172.21.15.53:0/3245891927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f351c052590 con 0x56385f71e800 2024-09-22T08:10:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.002+0000 7f352b458640 1 -- 172.21.15.53:0/3245891927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351c0528b0 con 0x56385f71e800 2024-09-22T08:10:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.002+0000 7f352e43b140 1 -- 172.21.15.53:0/3245891927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 msgr2=0x56385f71ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.002+0000 7f352e43b140 1 --2- 172.21.15.53:0/3245891927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 0x56385f71ebe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f351c00a470 tx=0x7f351c045ae0 comp rx=0 tx=0).stop 2024-09-22T08:10:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.002+0000 7f352e43b140 1 -- 172.21.15.53:0/3245891927 shutdown_connections 2024-09-22T08:10:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.002+0000 7f352e43b140 1 --2- 172.21.15.53:0/3245891927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 0x56385f71ebe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.002+0000 7f352e43b140 1 -- 172.21.15.53:0/3245891927 >> 172.21.15.53:0/3245891927 conn(0x56385f738210 msgr2=0x56385f73b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.002+0000 7f352e43b140 1 -- 172.21.15.53:0/3245891927 shutdown_connections 2024-09-22T08:10:33.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.002+0000 7f352e43b140 1 -- 172.21.15.53:0/3245891927 wait complete. 2024-09-22T08:10:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.003+0000 7f352e43b140 1 Processor -- start 2024-09-22T08:10:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.003+0000 7f352e43b140 1 -- start start 2024-09-22T08:10:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.003+0000 7f352e43b140 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 0x56385f7bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.003+0000 7f352e43b140 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56385f610100 con 0x56385f71e800 2024-09-22T08:10:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.003+0000 7f352c45a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 0x56385f7bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.003+0000 7f352c45a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 0x56385f7bc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48268/0 (socket says 172.21.15.53:48268) 2024-09-22T08:10:33.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.003+0000 7f352c45a640 1 -- 172.21.15.53:0/95082643 learned_addr learned my addr 172.21.15.53:0/95082643 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.004+0000 7f352c45a640 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56385f58a720 con 0x56385f71e800 2024-09-22T08:10:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.004+0000 7f352c45a640 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 0x56385f7bc5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f351c025ce0 tx=0x7f351c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.004+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351c052bc0 con 0x56385f71e800 2024-09-22T08:10:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.004+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f351c052d60 con 0x56385f71e800 2024-09-22T08:10:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.004+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351c067570 con 0x56385f71e800 2024-09-22T08:10:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.004+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56385f7bf670 con 0x56385f71e800 2024-09-22T08:10:33.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.004+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56385f7bdcc0 con 0x56385f71e800 2024-09-22T08:10:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.005+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f351c059020 con 0x56385f71e800 2024-09-22T08:10:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.005+0000 7f3528c53640 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f351003cfb0 0x7f351003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.005+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7f351c096020 con 0x56385f71e800 2024-09-22T08:10:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.005+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x56385f7bcb20 con 0x56385f71e800 2024-09-22T08:10:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.005+0000 7f352bc59640 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f351003cfb0 0x7f351003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.006+0000 7f352bc59640 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f351003cfb0 0x7f351003f470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3520004170 tx=0x7f3520001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:33.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.910+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x7f351c0760a0 con 0x56385f71e800 2024-09-22T08:10:33.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.910+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f351c052590 con 0x56385f71e800 2024-09-22T08:10:33.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.912+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f351c065390 con 0x56385f71e800 2024-09-22T08:10:33.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.913+0000 7f352ac57640 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f3508002ae0 con 0x56385f71e800 2024-09-22T08:10:33.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.913+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7f351c05d440 con 0x56385f71e800 2024-09-22T08:10:33.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.913+0000 7f352e43b140 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56385f71f120 0x56385f7db0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:33.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.913+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x56385f7dfa80 con 0x56385f71f120 2024-09-22T08:10:33.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.913+0000 7f352d6bc640 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56385f71f120 0x56385f7db0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:33.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.914+0000 7f352d6bc640 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56385f71f120 0x56385f7db0e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:33.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.924+0000 7f352d6bc640 1 -- 172.21.15.53:0/95082643 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f3524002040 con 0x56385f71f120 2024-09-22T08:10:33.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.926+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x56385f8321e0 con 0x56385f71f120 2024-09-22T08:10:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.927+0000 7f352d6bc640 1 -- 172.21.15.53:0/95082643 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3524002040 con 0x56385f71f120 2024-09-22T08:10:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.927+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x56385f8312f0 con 0x56385f71f120 2024-09-22T08:10:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.927+0000 7f352d6bc640 1 -- 172.21.15.53:0/95082643 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3524002040 con 0x56385f71f120 2024-09-22T08:10:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:33.927+0000 7f352a456640 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f350c001f00 con 0x56385f71e800 2024-09-22T08:10:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:34.915+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7f351c018cf0 con 0x56385f71e800 2024-09-22T08:10:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:34.915+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f3510042b60 con 0x56385f71e800 2024-09-22T08:10:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:34.915+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7f351c05a590 con 0x56385f71e800 2024-09-22T08:10:34.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:34.915+0000 7f352ac57640 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f3508005780 con 0x56385f71f120 2024-09-22T08:10:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:34.919+0000 7f352d6bc640 1 -- 172.21.15.53:0/95082643 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f3524002040 con 0x56385f71f120 2024-09-22T08:10:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:34.919+0000 7f352a456640 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7f350c003350 con 0x56385f71e800 2024-09-22T08:10:35.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.918+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7f351c089070 con 0x56385f71e800 2024-09-22T08:10:35.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.918+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f3510042c10 con 0x56385f71e800 2024-09-22T08:10:35.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.918+0000 7f3528c53640 1 -- 172.21.15.53:0/95082643 <== mon.0 v2:172.21.15.53:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7f351c05a860 con 0x56385f71e800 2024-09-22T08:10:35.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.918+0000 7f352ac57640 1 -- 172.21.15.53:0/95082643 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f3508005b40 con 0x56385f71f120 2024-09-22T08:10:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.923+0000 7f352d6bc640 1 -- 172.21.15.53:0/95082643 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3524002040 con 0x56385f71f120 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56385f71f120 msgr2=0x56385f7db0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56385f71f120 0x56385f7db0e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f351003cfb0 msgr2=0x7f351003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f351003cfb0 0x7f351003f470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3520004170 tx=0x7f3520001330 comp rx=0 tx=0).stop 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 msgr2=0x56385f7bc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 0x56385f7bc5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f351c025ce0 tx=0x7f351c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 shutdown_connections 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56385f71f120 0x56385f7db0e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f351003cfb0 0x7f351003f470 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 --2- 172.21.15.53:0/95082643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56385f71e800 0x56385f7bc5e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 >> 172.21.15.53:0/95082643 conn(0x56385f738210 msgr2=0x56385f7ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:35.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 shutdown_connections 2024-09-22T08:10:35.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:35.924+0000 7f352e43b140 1 -- 172.21.15.53:0/95082643 wait complete. 2024-09-22T08:10:35.930 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-22T08:10:35.931 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-22T08:10:35.931 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-22T08:10:36.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.042+0000 7efd70789640 1 Processor -- start 2024-09-22T08:10:36.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.042+0000 7efd70789640 1 -- start start 2024-09-22T08:10:36.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.043+0000 7efd70789640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd68071e30 0x7efd68132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:36.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.043+0000 7efd70789640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd68071770 con 0x7efd6806e170 2024-09-22T08:10:36.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.043+0000 7efd70789640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7efd68099ee0 con 0x7efd68071e30 2024-09-22T08:10:36.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.043+0000 7efd6dd24640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd68071e30 0x7efd68132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:36.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.043+0000 7efd6e525640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efd6806e170 0x7efd6806e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52174/0 (socket says 172.21.15.53:52174) 2024-09-22T08:10:36.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.043+0000 7efd6e525640 1 -- 172.21.15.53:0/3397291839 learned_addr learned my addr 172.21.15.53:0/3397291839 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:36.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.043+0000 7efd6dd24640 1 -- 172.21.15.53:0/3397291839 >> v1:172.21.15.53:6789/0 conn(0x7efd6806e170 legacy=0x7efd6806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.043+0000 7efd6dd24640 1 -- 172.21.15.53:0/3397291839 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd68072530 con 0x7efd68071e30 2024-09-22T08:10:36.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.044+0000 7efd6dd24640 1 --2- 172.21.15.53:0/3397291839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd68071e30 0x7efd68132790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd58009750 tx=0x7efd5802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8660eadc706b6c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:36.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.044+0000 7efd6d523640 1 -- 172.21.15.53:0/3397291839 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd58037070 con 0x7efd68071e30 2024-09-22T08:10:36.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.044+0000 7efd6d523640 1 -- 172.21.15.53:0/3397291839 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5802ad80 con 0x7efd68071e30 2024-09-22T08:10:36.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.044+0000 7efd6d523640 1 -- 172.21.15.53:0/3397291839 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd58032590 con 0x7efd68071e30 2024-09-22T08:10:36.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.044+0000 7efd70789640 1 -- 172.21.15.53:0/3397291839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd68071e30 msgr2=0x7efd68132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.044+0000 7efd70789640 1 --2- 172.21.15.53:0/3397291839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd68071e30 0x7efd68132790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd58009750 tx=0x7efd5802a140 comp rx=0 tx=0).stop 2024-09-22T08:10:36.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.045+0000 7efd70789640 1 -- 172.21.15.53:0/3397291839 shutdown_connections 2024-09-22T08:10:36.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.045+0000 7efd70789640 1 --2- 172.21.15.53:0/3397291839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd68071e30 0x7efd68132790 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:36.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.045+0000 7efd70789640 1 -- 172.21.15.53:0/3397291839 >> 172.21.15.53:0/3397291839 conn(0x7efd6809ac80 msgr2=0x7efd68098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:36.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.045+0000 7efd70789640 1 -- 172.21.15.53:0/3397291839 shutdown_connections 2024-09-22T08:10:36.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.045+0000 7efd70789640 1 -- 172.21.15.53:0/3397291839 wait complete. 2024-09-22T08:10:36.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.045+0000 7efd70789640 1 Processor -- start 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.046+0000 7efd70789640 1 -- start start 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.046+0000 7efd70789640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd6806e170 0x7efd68129380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.046+0000 7efd70789640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efd6806ee70 con 0x7efd6806e170 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.046+0000 7efd6e525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd6806e170 0x7efd68129380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.046+0000 7efd6e525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd6806e170 0x7efd68129380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48280/0 (socket says 172.21.15.53:48280) 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.046+0000 7efd6e525640 1 -- 172.21.15.53:0/711538614 learned_addr learned my addr 172.21.15.53:0/711538614 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.046+0000 7efd6e525640 1 -- 172.21.15.53:0/711538614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd68074170 con 0x7efd6806e170 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.046+0000 7efd6e525640 1 --2- 172.21.15.53:0/711538614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd6806e170 0x7efd68129380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd6400cbd0 tx=0x7efd6400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.047+0000 7efd5effd640 1 -- 172.21.15.53:0/711538614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd64017070 con 0x7efd6806e170 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.047+0000 7efd5effd640 1 -- 172.21.15.53:0/711538614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6400abc0 con 0x7efd6806e170 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.047+0000 7efd70789640 1 -- 172.21.15.53:0/711538614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd680711a0 con 0x7efd6806e170 2024-09-22T08:10:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.047+0000 7efd5effd640 1 -- 172.21.15.53:0/711538614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd64012400 con 0x7efd6806e170 2024-09-22T08:10:36.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.047+0000 7efd70789640 1 -- 172.21.15.53:0/711538614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd681298c0 con 0x7efd6806e170 2024-09-22T08:10:36.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.048+0000 7efd5effd640 1 -- 172.21.15.53:0/711538614 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efd6401a070 con 0x7efd6806e170 2024-09-22T08:10:36.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.048+0000 7efd70789640 1 -- 172.21.15.53:0/711538614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd68070f90 con 0x7efd6806e170 2024-09-22T08:10:36.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.048+0000 7efd5effd640 1 --2- 172.21.15.53:0/711538614 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efd4c03e710 0x7efd4c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:36.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.048+0000 7efd5effd640 1 -- 172.21.15.53:0/711538614 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7efd64052cb0 con 0x7efd6806e170 2024-09-22T08:10:36.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.048+0000 7efd6dd24640 1 --2- 172.21.15.53:0/711538614 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efd4c03e710 0x7efd4c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:36.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.049+0000 7efd6dd24640 1 --2- 172.21.15.53:0/711538614 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efd4c03e710 0x7efd4c040bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efd58034000 tx=0x7efd5802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:36.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.053+0000 7efd5effd640 1 -- 172.21.15.53:0/711538614 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efd640078c0 con 0x7efd6806e170 2024-09-22T08:10:36.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.240+0000 7efd70789640 1 -- 172.21.15.53:0/711538614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7efd6806e550 con 0x7efd6806e170 2024-09-22T08:10:36.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.241+0000 7efd5effd640 1 -- 172.21.15.53:0/711538614 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7efd6401a360 con 0x7efd6806e170 2024-09-22T08:10:36.243 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:10:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.243+0000 7efd70789640 1 -- 172.21.15.53:0/711538614 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efd4c03e710 msgr2=0x7efd4c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.243+0000 7efd70789640 1 --2- 172.21.15.53:0/711538614 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efd4c03e710 0x7efd4c040bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efd58034000 tx=0x7efd5802e000 comp rx=0 tx=0).stop 2024-09-22T08:10:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.243+0000 7efd70789640 1 -- 172.21.15.53:0/711538614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd6806e170 msgr2=0x7efd68129380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.243+0000 7efd70789640 1 --2- 172.21.15.53:0/711538614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd6806e170 0x7efd68129380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd6400cbd0 tx=0x7efd6400a430 comp rx=0 tx=0).stop 2024-09-22T08:10:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.243+0000 7efd70789640 1 -- 172.21.15.53:0/711538614 shutdown_connections 2024-09-22T08:10:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.243+0000 7efd70789640 1 --2- 172.21.15.53:0/711538614 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efd4c03e710 0x7efd4c040bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.243+0000 7efd70789640 1 --2- 172.21.15.53:0/711538614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd6806e170 0x7efd68129380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.243+0000 7efd70789640 1 -- 172.21.15.53:0/711538614 >> 172.21.15.53:0/711538614 conn(0x7efd6809ac80 msgr2=0x7efd68097280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.243+0000 7efd70789640 1 -- 172.21.15.53:0/711538614 shutdown_connections 2024-09-22T08:10:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.243+0000 7efd70789640 1 -- 172.21.15.53:0/711538614 wait complete. 2024-09-22T08:10:36.255 INFO:teuthology.orchestra.run.smithi053.stdout:[{"version":5,"timestamp":"2024-09-22T08:10:26.508166+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"7395.988604"}]}] 2024-09-22T08:10:36.255 INFO:tasks.ceph_manager:config epoch is 5 2024-09-22T08:10:36.256 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-22T08:10:36.256 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-22T08:10:36.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-22T08:10:36.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.355+0000 7f0729ea2640 1 Processor -- start 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.355+0000 7f0729ea2640 1 -- start start 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.356+0000 7f0729ea2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0724132960 0x7f0724134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.356+0000 7f0729ea2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f072406ff50 con 0x7f072406e8e0 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.356+0000 7f0729ea2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f0724099c10 con 0x7f0724132960 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.356+0000 7f07237fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f072406e8e0 0x7f072406ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52186/0 (socket says 172.21.15.53:52186) 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.356+0000 7f07237fe640 1 -- 172.21.15.53:0/2027780424 learned_addr learned my addr 172.21.15.53:0/2027780424 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.356+0000 7f0722ffd640 1 --2- 172.21.15.53:0/2027780424 >> v2:172.21.15.53:3300/0 conn(0x7f0724132960 0x7f0724134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.356+0000 7f07227fc640 1 -- 172.21.15.53:0/2027780424 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374338216 0 0) 0x7f072406ff50 con 0x7f072406e8e0 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.356+0000 7f07227fc640 1 -- 172.21.15.53:0/2027780424 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f070c003520 con 0x7f072406e8e0 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.356+0000 7f0722ffd640 1 -- 172.21.15.53:0/2027780424 >> v1:172.21.15.53:6789/0 conn(0x7f072406e8e0 legacy=0x7f072406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.356+0000 7f0722ffd640 1 -- 172.21.15.53:0/2027780424 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072406f3d0 con 0x7f0724132960 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.357+0000 7f0722ffd640 1 --2- 172.21.15.53:0/2027780424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0724132960 0x7f0724134d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0718009720 tx=0x7f071802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de5198b804d7dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.357+0000 7f07227fc640 1 -- 172.21.15.53:0/2027780424 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0718037070 con 0x7f0724132960 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.357+0000 7f07227fc640 1 -- 172.21.15.53:0/2027780424 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071802ad90 con 0x7f0724132960 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.357+0000 7f07227fc640 1 -- 172.21.15.53:0/2027780424 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0718032570 con 0x7f0724132960 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.358+0000 7f0729ea2640 1 -- 172.21.15.53:0/2027780424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0724132960 msgr2=0x7f0724134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.358+0000 7f0729ea2640 1 --2- 172.21.15.53:0/2027780424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0724132960 0x7f0724134d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0718009720 tx=0x7f071802a110 comp rx=0 tx=0).stop 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.358+0000 7f0729ea2640 1 -- 172.21.15.53:0/2027780424 shutdown_connections 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.358+0000 7f0729ea2640 1 --2- 172.21.15.53:0/2027780424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0724132960 0x7f0724134d50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.358+0000 7f0729ea2640 1 -- 172.21.15.53:0/2027780424 >> 172.21.15.53:0/2027780424 conn(0x7f07240a01c0 msgr2=0x7f07240a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.358+0000 7f0729ea2640 1 -- 172.21.15.53:0/2027780424 shutdown_connections 2024-09-22T08:10:36.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.358+0000 7f0729ea2640 1 -- 172.21.15.53:0/2027780424 wait complete. 2024-09-22T08:10:36.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.358+0000 7f0729ea2640 1 Processor -- start 2024-09-22T08:10:36.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.359+0000 7f0729ea2640 1 -- start start 2024-09-22T08:10:36.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.359+0000 7f0729ea2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072406e8e0 0x7f072412bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:36.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.359+0000 7f0729ea2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0724135410 con 0x7f072406e8e0 2024-09-22T08:10:36.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.359+0000 7f07237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072406e8e0 0x7f072412bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:36.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.359+0000 7f07237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072406e8e0 0x7f072412bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48292/0 (socket says 172.21.15.53:48292) 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.359+0000 7f07237fe640 1 -- 172.21.15.53:0/1089681931 learned_addr learned my addr 172.21.15.53:0/1089681931 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.359+0000 7f07237fe640 1 -- 172.21.15.53:0/1089681931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072412f460 con 0x7f072406e8e0 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.360+0000 7f07237fe640 1 --2- 172.21.15.53:0/1089681931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072406e8e0 0x7f072412bdf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f071400c390 tx=0x7f071400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.360+0000 7f070bfff640 1 -- 172.21.15.53:0/1089681931 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0714017070 con 0x7f072406e8e0 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.360+0000 7f070bfff640 1 -- 172.21.15.53:0/1089681931 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0714005cd0 con 0x7f072406e8e0 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.360+0000 7f0729ea2640 1 -- 172.21.15.53:0/1089681931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072412de60 con 0x7f072406e8e0 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.360+0000 7f070bfff640 1 -- 172.21.15.53:0/1089681931 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0714007200 con 0x7f072406e8e0 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.360+0000 7f0729ea2640 1 -- 172.21.15.53:0/1089681931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072412c330 con 0x7f072406e8e0 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.361+0000 7f070bfff640 1 -- 172.21.15.53:0/1089681931 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f071401a070 con 0x7f072406e8e0 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.361+0000 7f0729ea2640 1 -- 172.21.15.53:0/1089681931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072406ecc0 con 0x7f072406e8e0 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.361+0000 7f070bfff640 1 --2- 172.21.15.53:0/1089681931 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f071003e710 0x7f0710040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:36.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.361+0000 7f070bfff640 1 -- 172.21.15.53:0/1089681931 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f0714051f80 con 0x7f072406e8e0 2024-09-22T08:10:36.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.361+0000 7f0722ffd640 1 --2- 172.21.15.53:0/1089681931 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f071003e710 0x7f0710040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:36.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.362+0000 7f0722ffd640 1 --2- 172.21.15.53:0/1089681931 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f071003e710 0x7f0710040bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0718034000 tx=0x7f071802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:36.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.365+0000 7f070bfff640 1 -- 172.21.15.53:0/1089681931 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f071401b3b0 con 0x7f072406e8e0 2024-09-22T08:10:36.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.603+0000 7f0729ea2640 1 -- 172.21.15.53:0/1089681931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f072406fbb0 con 0x7f072406e8e0 2024-09-22T08:10:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.605+0000 7f070bfff640 1 -- 172.21.15.53:0/1089681931 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+98094 (secure 0 0 0) 0x7f071401b730 con 0x7f072406e8e0 2024-09-22T08:10:36.607 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:10:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.607+0000 7f0729ea2640 1 -- 172.21.15.53:0/1089681931 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f071003e710 msgr2=0x7f0710040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.607+0000 7f0729ea2640 1 --2- 172.21.15.53:0/1089681931 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f071003e710 0x7f0710040bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0718034000 tx=0x7f071802e000 comp rx=0 tx=0).stop 2024-09-22T08:10:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.607+0000 7f0729ea2640 1 -- 172.21.15.53:0/1089681931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072406e8e0 msgr2=0x7f072412bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.607+0000 7f0729ea2640 1 --2- 172.21.15.53:0/1089681931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072406e8e0 0x7f072412bdf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f071400c390 tx=0x7f071400c850 comp rx=0 tx=0).stop 2024-09-22T08:10:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.607+0000 7f0729ea2640 1 -- 172.21.15.53:0/1089681931 shutdown_connections 2024-09-22T08:10:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.607+0000 7f0729ea2640 1 --2- 172.21.15.53:0/1089681931 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f071003e710 0x7f0710040bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.607+0000 7f0729ea2640 1 --2- 172.21.15.53:0/1089681931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f072406e8e0 0x7f072412bdf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.607+0000 7f0729ea2640 1 -- 172.21.15.53:0/1089681931 >> 172.21.15.53:0/1089681931 conn(0x7f07240a01c0 msgr2=0x7f072409b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.607+0000 7f0729ea2640 1 -- 172.21.15.53:0/1089681931 shutdown_connections 2024-09-22T08:10:36.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.607+0000 7f0729ea2640 1 -- 172.21.15.53:0/1089681931 wait complete. 2024-09-22T08:10:36.619 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2210654445},{"type":"v1","addr":"172.21.15.165:6825","nonce":2210654445}]},"active_addr":"172.21.15.165:6825/2210654445","active_change":"2024-09-22T08:10:21.552550+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.165:0","nonce":350421105}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.165:0","nonce":1772591995}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.165:0","nonce":3442698212}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.165:0","nonce":2499243029}]}]} 2024-09-22T08:10:36.622 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-22T08:10:36.622 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T08:10:36.623 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:10:36.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.722+0000 7f40ebbd3640 1 Processor -- start 2024-09-22T08:10:36.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.722+0000 7f40ebbd3640 1 -- start start 2024-09-22T08:10:36.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.722+0000 7f40ebbd3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f40e4071e30 0x7f40e4132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:36.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.722+0000 7f40ebbd3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e4071770 con 0x7f40e406e170 2024-09-22T08:10:36.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.722+0000 7f40ebbd3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f40e4099ee0 con 0x7f40e4071e30 2024-09-22T08:10:36.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.723+0000 7f40e916e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f40e4071e30 0x7f40e4132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:36.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.723+0000 7f40e996f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f40e406e170 0x7f40e406e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52198/0 (socket says 172.21.15.53:52198) 2024-09-22T08:10:36.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.723+0000 7f40e996f640 1 -- 172.21.15.53:0/2773701073 learned_addr learned my addr 172.21.15.53:0/2773701073 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:36.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.723+0000 7f40e916e640 1 -- 172.21.15.53:0/2773701073 >> v1:172.21.15.53:6789/0 conn(0x7f40e406e170 legacy=0x7f40e406e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.723+0000 7f40e916e640 1 -- 172.21.15.53:0/2773701073 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e4072530 con 0x7f40e4071e30 2024-09-22T08:10:36.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40e916e640 1 --2- 172.21.15.53:0/2773701073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071e30 0x7f40e4132790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009750 tx=0x7f40d802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f8e1439538fcfa server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:36.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40e896d640 1 -- 172.21.15.53:0/2773701073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d8037070 con 0x7f40e4071e30 2024-09-22T08:10:36.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40e896d640 1 -- 172.21.15.53:0/2773701073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d802ad80 con 0x7f40e4071e30 2024-09-22T08:10:36.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40e896d640 1 -- 172.21.15.53:0/2773701073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d8032590 con 0x7f40e4071e30 2024-09-22T08:10:36.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40ebbd3640 1 -- 172.21.15.53:0/2773701073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071e30 msgr2=0x7f40e4132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40ebbd3640 1 --2- 172.21.15.53:0/2773701073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071e30 0x7f40e4132790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009750 tx=0x7f40d802a140 comp rx=0 tx=0).stop 2024-09-22T08:10:36.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40ebbd3640 1 -- 172.21.15.53:0/2773701073 shutdown_connections 2024-09-22T08:10:36.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40ebbd3640 1 --2- 172.21.15.53:0/2773701073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071e30 0x7f40e4132790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:36.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40ebbd3640 1 -- 172.21.15.53:0/2773701073 >> 172.21.15.53:0/2773701073 conn(0x7f40e409ac80 msgr2=0x7f40e4098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:36.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40ebbd3640 1 -- 172.21.15.53:0/2773701073 shutdown_connections 2024-09-22T08:10:36.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.724+0000 7f40ebbd3640 1 -- 172.21.15.53:0/2773701073 wait complete. 2024-09-22T08:10:36.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.725+0000 7f40ebbd3640 1 Processor -- start 2024-09-22T08:10:36.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.725+0000 7f40ebbd3640 1 -- start start 2024-09-22T08:10:36.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40ebbd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e406e170 0x7f40e4129b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:36.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40ebbd3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f40e406ee70 con 0x7f40e406e170 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40e996f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e406e170 0x7f40e4129b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40e996f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e406e170 0x7f40e4129b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48312/0 (socket says 172.21.15.53:48312) 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40e996f640 1 -- 172.21.15.53:0/865956570 learned_addr learned my addr 172.21.15.53:0/865956570 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40e996f640 1 -- 172.21.15.53:0/865956570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e41278b0 con 0x7f40e406e170 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40e996f640 1 --2- 172.21.15.53:0/865956570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e406e170 0x7f40e4129b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c480 tx=0x7f40e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40d67fc640 1 -- 172.21.15.53:0/865956570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e0017070 con 0x7f40e406e170 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40d67fc640 1 -- 172.21.15.53:0/865956570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e0005c10 con 0x7f40e406e170 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40ebbd3640 1 -- 172.21.15.53:0/865956570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e4129590 con 0x7f40e406e170 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40d67fc640 1 -- 172.21.15.53:0/865956570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e0007070 con 0x7f40e406e170 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.726+0000 7f40ebbd3640 1 -- 172.21.15.53:0/865956570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e41289e0 con 0x7f40e406e170 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.727+0000 7f40d67fc640 1 -- 172.21.15.53:0/865956570 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f40e001a070 con 0x7f40e406e170 2024-09-22T08:10:36.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.727+0000 7f40ebbd3640 1 -- 172.21.15.53:0/865956570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e4128c70 con 0x7f40e406e170 2024-09-22T08:10:36.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.727+0000 7f40d67fc640 1 --2- 172.21.15.53:0/865956570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f40c803e710 0x7f40c8040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:36.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.727+0000 7f40d67fc640 1 -- 172.21.15.53:0/865956570 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f40e0051fe0 con 0x7f40e406e170 2024-09-22T08:10:36.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.728+0000 7f40e916e640 1 --2- 172.21.15.53:0/865956570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f40c803e710 0x7f40c8040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:36.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.728+0000 7f40e916e640 1 --2- 172.21.15.53:0/865956570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f40c803e710 0x7f40c8040bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f40d8034000 tx=0x7f40d802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:36.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.732+0000 7f40d67fc640 1 -- 172.21.15.53:0/865956570 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f40e001ac60 con 0x7f40e406e170 2024-09-22T08:10:36.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.919+0000 7f40ebbd3640 1 -- 172.21.15.53:0/865956570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40e406e550 con 0x7f40e406e170 2024-09-22T08:10:36.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.920+0000 7f40d67fc640 1 -- 172.21.15.53:0/865956570 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9902 (secure 0 0 0) 0x7f40e0050ed0 con 0x7f40e406e170 2024-09-22T08:10:36.922 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:10:36.922 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":17,"fsid":"e28b0ed0-1272-43e5-8a68-aa2f8d89bec5","created":"2024-09-22T08:10:17.147434+0000","modified":"2024-09-22T08:10:35.915607+0000","last_up_change":"2024-09-22T08:10:26.896360+0000","last_in_change":"2024-09-22T08:10:18.218936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:10:27.573518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:10:32.734377+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0004653-b98d-4b1a-a928-2f6ef86bf15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6801","nonce":2902972477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6803","nonce":2902972477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6807","nonce":2902972477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6805","nonce":2902972477}]},"public_addr":"172.21.15.53:6801/2902972477","cluster_addr":"172.21.15.53:6803/2902972477","heartbeat_back_addr":"172.21.15.53:6807/2902972477","heartbeat_front_addr":"172.21.15.53:6805/2902972477","state":["exists","up"]},{"osd":1,"uuid":"c85ab72a-9b5c-4d4d-a0d1-3d32724a8d29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6817","nonce":2347568643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6819","nonce":2347568643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6823","nonce":2347568643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6821","nonce":2347568643}]},"public_addr":"172.21.15.165:6817/2347568643","cluster_addr":"172.21.15.165:6819/2347568643","heartbeat_back_addr":"172.21.15.165:6823/2347568643","heartbeat_front_addr":"172.21.15.165:6821/2347568643","state":["exists","up"]},{"osd":2,"uuid":"f0698e09-e99e-43f6-840b-999b20fc7d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6809","nonce":3197121696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6811","nonce":3197121696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6815","nonce":3197121696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6813","nonce":3197121696}]},"public_addr":"172.21.15.165:6809/3197121696","cluster_addr":"172.21.15.165:6811/3197121696","heartbeat_back_addr":"172.21.15.165:6815/3197121696","heartbeat_front_addr":"172.21.15.165:6813/3197121696","state":["exists","up"]},{"osd":3,"uuid":"413ad162-0b9b-437b-a3b4-0c4e1170cd61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6801","nonce":215521179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6803","nonce":215521179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6807","nonce":215521179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6805","nonce":215521179}]},"public_addr":"172.21.15.165:6801/215521179","cluster_addr":"172.21.15.165:6803/215521179","heartbeat_back_addr":"172.21.15.165:6807/215521179","heartbeat_front_addr":"172.21.15.165:6805/215521179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.156688+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.537972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.998790+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:25.920032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:10:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.922+0000 7f40ebbd3640 1 -- 172.21.15.53:0/865956570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f40c803e710 msgr2=0x7f40c8040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.922+0000 7f40ebbd3640 1 --2- 172.21.15.53:0/865956570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f40c803e710 0x7f40c8040bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f40d8034000 tx=0x7f40d802e000 comp rx=0 tx=0).stop 2024-09-22T08:10:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.922+0000 7f40ebbd3640 1 -- 172.21.15.53:0/865956570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e406e170 msgr2=0x7f40e4129b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.922+0000 7f40ebbd3640 1 --2- 172.21.15.53:0/865956570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e406e170 0x7f40e4129b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c480 tx=0x7f40e000c940 comp rx=0 tx=0).stop 2024-09-22T08:10:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.922+0000 7f40ebbd3640 1 -- 172.21.15.53:0/865956570 shutdown_connections 2024-09-22T08:10:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.922+0000 7f40ebbd3640 1 --2- 172.21.15.53:0/865956570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f40c803e710 0x7f40c8040bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.922+0000 7f40ebbd3640 1 --2- 172.21.15.53:0/865956570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e406e170 0x7f40e4129b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.922+0000 7f40ebbd3640 1 -- 172.21.15.53:0/865956570 >> 172.21.15.53:0/865956570 conn(0x7f40e409ac80 msgr2=0x7f40e412b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.922+0000 7f40ebbd3640 1 -- 172.21.15.53:0/865956570 shutdown_connections 2024-09-22T08:10:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:36.922+0000 7f40ebbd3640 1 -- 172.21.15.53:0/865956570 wait complete. 2024-09-22T08:10:36.934 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T08:10:36.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:10:37.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.034+0000 7f8399394640 1 Processor -- start 2024-09-22T08:10:37.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.034+0000 7f8399394640 1 -- start start 2024-09-22T08:10:37.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.035+0000 7f8399394640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f839406e8e0 0x7f839406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.035+0000 7f8399394640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839406ff50 con 0x7f839406f200 2024-09-22T08:10:37.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.035+0000 7f8399394640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8394099c10 con 0x7f839406e8e0 2024-09-22T08:10:37.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.035+0000 7f8392ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f839406e8e0 0x7f839406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.035+0000 7f838bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f839406f200 0x7f839412f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52212/0 (socket says 172.21.15.53:52212) 2024-09-22T08:10:37.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.035+0000 7f8392ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f839406e8e0 0x7f839406ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48316/0 (socket says 172.21.15.53:48316) 2024-09-22T08:10:37.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.035+0000 7f838bfff640 1 -- 172.21.15.53:0/4276604521 learned_addr learned my addr 172.21.15.53:0/4276604521 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:37.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.035+0000 7f8392ffd640 1 -- 172.21.15.53:0/4276604521 >> v1:172.21.15.53:6789/0 conn(0x7f839406f200 legacy=0x7f839412f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.035+0000 7f8392ffd640 1 -- 172.21.15.53:0/4276604521 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8394099710 con 0x7f839406e8e0 2024-09-22T08:10:37.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.036+0000 7f8392ffd640 1 --2- 172.21.15.53:0/4276604521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 0x7f839406ecc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8384009720 tx=0x7f838402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efe572f1c22e3ad server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.036+0000 7f83927fc640 1 -- 172.21.15.53:0/4276604521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8384037070 con 0x7f839406e8e0 2024-09-22T08:10:37.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.036+0000 7f83927fc640 1 -- 172.21.15.53:0/4276604521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838402ae20 con 0x7f839406e8e0 2024-09-22T08:10:37.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.036+0000 7f83927fc640 1 -- 172.21.15.53:0/4276604521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8384032590 con 0x7f839406e8e0 2024-09-22T08:10:37.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.037+0000 7f8399394640 1 -- 172.21.15.53:0/4276604521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 msgr2=0x7f839406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.037+0000 7f8399394640 1 --2- 172.21.15.53:0/4276604521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 0x7f839406ecc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8384009720 tx=0x7f838402a1a0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.037+0000 7f8399394640 1 -- 172.21.15.53:0/4276604521 shutdown_connections 2024-09-22T08:10:37.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.037+0000 7f8399394640 1 --2- 172.21.15.53:0/4276604521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 0x7f839406ecc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.037+0000 7f8399394640 1 -- 172.21.15.53:0/4276604521 >> 172.21.15.53:0/4276604521 conn(0x7f83940a01c0 msgr2=0x7f83940a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.037+0000 7f8399394640 1 -- 172.21.15.53:0/4276604521 shutdown_connections 2024-09-22T08:10:37.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.037+0000 7f8399394640 1 -- 172.21.15.53:0/4276604521 wait complete. 2024-09-22T08:10:37.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.038+0000 7f8399394640 1 Processor -- start 2024-09-22T08:10:37.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.038+0000 7f8399394640 1 -- start start 2024-09-22T08:10:37.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.038+0000 7f8399394640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 0x7f83941c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.038+0000 7f8399394640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f83941300f0 con 0x7f839406e8e0 2024-09-22T08:10:37.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.038+0000 7f8392ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 0x7f83941c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.038+0000 7f8392ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 0x7f83941c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48320/0 (socket says 172.21.15.53:48320) 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.038+0000 7f8392ffd640 1 -- 172.21.15.53:0/4179213989 learned_addr learned my addr 172.21.15.53:0/4179213989 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.038+0000 7f8392ffd640 1 -- 172.21.15.53:0/4179213989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839408ea60 con 0x7f839406e8e0 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.038+0000 7f8392ffd640 1 --2- 172.21.15.53:0/4179213989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 0x7f83941c4780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f838402a1e0 tx=0x7f83840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.039+0000 7f838b7fe640 1 -- 172.21.15.53:0/4179213989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8384042070 con 0x7f839406e8e0 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.039+0000 7f838b7fe640 1 -- 172.21.15.53:0/4179213989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838403e590 con 0x7f839406e8e0 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.039+0000 7f8399394640 1 -- 172.21.15.53:0/4179213989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839408f4b0 con 0x7f839406e8e0 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.039+0000 7f838b7fe640 1 -- 172.21.15.53:0/4179213989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8384037040 con 0x7f839406e8e0 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.039+0000 7f8399394640 1 -- 172.21.15.53:0/4179213989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83941c4ea0 con 0x7f839406e8e0 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.040+0000 7f838b7fe640 1 -- 172.21.15.53:0/4179213989 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8384045070 con 0x7f839406e8e0 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.040+0000 7f8399394640 1 -- 172.21.15.53:0/4179213989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839408e380 con 0x7f839406e8e0 2024-09-22T08:10:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.040+0000 7f838b7fe640 1 --2- 172.21.15.53:0/4179213989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f837403e740 0x7f8374040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.040+0000 7f838b7fe640 1 -- 172.21.15.53:0/4179213989 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f8384073620 con 0x7f839406e8e0 2024-09-22T08:10:37.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.040+0000 7f838bfff640 1 --2- 172.21.15.53:0/4179213989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f837403e740 0x7f8374040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.041+0000 7f838bfff640 1 --2- 172.21.15.53:0/4179213989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f837403e740 0x7f8374040c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f837c007fd0 tx=0x7f837c007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.045+0000 7f838b7fe640 1 -- 172.21.15.53:0/4179213989 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8384045d30 con 0x7f839406e8e0 2024-09-22T08:10:37.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.231+0000 7f8399394640 1 -- 172.21.15.53:0/4179213989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f839406ecc0 con 0x7f839406e8e0 2024-09-22T08:10:37.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.231+0000 7f838b7fe640 1 -- 172.21.15.53:0/4179213989 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9902 (secure 0 0 0) 0x7f838402ae20 con 0x7f839406e8e0 2024-09-22T08:10:37.233 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:10:37.233 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":17,"fsid":"e28b0ed0-1272-43e5-8a68-aa2f8d89bec5","created":"2024-09-22T08:10:17.147434+0000","modified":"2024-09-22T08:10:35.915607+0000","last_up_change":"2024-09-22T08:10:26.896360+0000","last_in_change":"2024-09-22T08:10:18.218936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:10:27.573518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:10:32.734377+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0004653-b98d-4b1a-a928-2f6ef86bf15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6801","nonce":2902972477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6803","nonce":2902972477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6807","nonce":2902972477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6805","nonce":2902972477}]},"public_addr":"172.21.15.53:6801/2902972477","cluster_addr":"172.21.15.53:6803/2902972477","heartbeat_back_addr":"172.21.15.53:6807/2902972477","heartbeat_front_addr":"172.21.15.53:6805/2902972477","state":["exists","up"]},{"osd":1,"uuid":"c85ab72a-9b5c-4d4d-a0d1-3d32724a8d29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6817","nonce":2347568643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6819","nonce":2347568643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6823","nonce":2347568643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6821","nonce":2347568643}]},"public_addr":"172.21.15.165:6817/2347568643","cluster_addr":"172.21.15.165:6819/2347568643","heartbeat_back_addr":"172.21.15.165:6823/2347568643","heartbeat_front_addr":"172.21.15.165:6821/2347568643","state":["exists","up"]},{"osd":2,"uuid":"f0698e09-e99e-43f6-840b-999b20fc7d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6809","nonce":3197121696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6811","nonce":3197121696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6815","nonce":3197121696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6813","nonce":3197121696}]},"public_addr":"172.21.15.165:6809/3197121696","cluster_addr":"172.21.15.165:6811/3197121696","heartbeat_back_addr":"172.21.15.165:6815/3197121696","heartbeat_front_addr":"172.21.15.165:6813/3197121696","state":["exists","up"]},{"osd":3,"uuid":"413ad162-0b9b-437b-a3b4-0c4e1170cd61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6801","nonce":215521179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6803","nonce":215521179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6807","nonce":215521179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6805","nonce":215521179}]},"public_addr":"172.21.15.165:6801/215521179","cluster_addr":"172.21.15.165:6803/215521179","heartbeat_back_addr":"172.21.15.165:6807/215521179","heartbeat_front_addr":"172.21.15.165:6805/215521179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.156688+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.537972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.998790+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:25.920032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:10:37.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.233+0000 7f8399394640 1 -- 172.21.15.53:0/4179213989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f837403e740 msgr2=0x7f8374040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.233+0000 7f8399394640 1 --2- 172.21.15.53:0/4179213989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f837403e740 0x7f8374040c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f837c007fd0 tx=0x7f837c007aa0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.233+0000 7f8399394640 1 -- 172.21.15.53:0/4179213989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 msgr2=0x7f83941c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.233+0000 7f8399394640 1 --2- 172.21.15.53:0/4179213989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 0x7f83941c4780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f838402a1e0 tx=0x7f83840046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.233+0000 7f8399394640 1 -- 172.21.15.53:0/4179213989 shutdown_connections 2024-09-22T08:10:37.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.233+0000 7f8399394640 1 --2- 172.21.15.53:0/4179213989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f837403e740 0x7f8374040c00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.233+0000 7f8399394640 1 --2- 172.21.15.53:0/4179213989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f839406e8e0 0x7f83941c4780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.233+0000 7f8399394640 1 -- 172.21.15.53:0/4179213989 >> 172.21.15.53:0/4179213989 conn(0x7f83940a01c0 msgr2=0x7f839409dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.233+0000 7f8399394640 1 -- 172.21.15.53:0/4179213989 shutdown_connections 2024-09-22T08:10:37.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.233+0000 7f8399394640 1 -- 172.21.15.53:0/4179213989 wait complete. 2024-09-22T08:10:37.246 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T08:10:37.246 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T08:10:37.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T08:10:37.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T08:10:37.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7fcbb3abd640 1 Processor -- start 2024-09-22T08:10:37.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7f985cf33640 1 Processor -- start 2024-09-22T08:10:37.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7f985cf33640 1 -- start start 2024-09-22T08:10:37.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7fbd35ac6640 1 Processor -- start 2024-09-22T08:10:37.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7f2bddd94640 1 Processor -- start 2024-09-22T08:10:37.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7fcbb3abd640 1 -- start start 2024-09-22T08:10:37.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7fbd35ac6640 1 -- start start 2024-09-22T08:10:37.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7f2bddd94640 1 -- start start 2024-09-22T08:10:37.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7fcbb3abd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcbac06f960 0x7fcbac130ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7f985cf33640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f985806e170 0x7f985806e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7f2bddd94640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2bd812bf10 0x7f2bd812c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7f985cf33640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9858099ee0 con 0x7f985806ea90 2024-09-22T08:10:37.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7f985cf33640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9858072780 con 0x7f985806e170 2024-09-22T08:10:37.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.352+0000 7fbd35ac6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd3006e8e0 0x7fbd3006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fbd35ac6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3006ff50 con 0x7fbd3006f200 2024-09-22T08:10:37.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fbd35ac6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbd30099c10 con 0x7fbd3006e8e0 2024-09-22T08:10:37.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fcbb3abd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbac070d70 con 0x7fcbac12bd00 2024-09-22T08:10:37.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fcbb3abd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fcbac0704f0 con 0x7fcbac06f960 2024-09-22T08:10:37.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f985659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f985806e170 0x7f985806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fcbb1859640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcbac12bd00 0x7fcbac12c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52214/0 (socket says 172.21.15.53:52214) 2024-09-22T08:10:37.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fcbb1859640 1 -- 172.21.15.53:0/1623855473 learned_addr learned my addr 172.21.15.53:0/1623855473 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:37.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f2bddd94640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd806f8f0 con 0x7f2bd812c830 2024-09-22T08:10:37.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f2bddd94640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd8071030 con 0x7f2bd812bf10 2024-09-22T08:10:37.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f985659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f985806e170 0x7f985806e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48324/0 (socket says 172.21.15.53:48324) 2024-09-22T08:10:37.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f985659c640 1 -- 172.21.15.53:0/468943052 learned_addr learned my addr 172.21.15.53:0/468943052 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fbd2effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbd3006f200 0x7fbd3012f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52226/0 (socket says 172.21.15.53:52226) 2024-09-22T08:10:37.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fcbb1058640 1 --2- 172.21.15.53:0/1623855473 >> v2:172.21.15.53:3300/0 conn(0x7fcbac06f960 0x7fcbac130ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f2bd6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2bd812c830 0x7f2bd806e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52236/0 (socket says 172.21.15.53:52236) 2024-09-22T08:10:37.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f2bd6ffd640 1 -- 172.21.15.53:0/2749183608 learned_addr learned my addr 172.21.15.53:0/2749183608 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:37.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f2bd77fe640 1 --2- 172.21.15.53:0/2749183608 >> v2:172.21.15.53:3300/0 conn(0x7f2bd812bf10 0x7f2bd812c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fbd2effd640 1 -- 172.21.15.53:0/954734359 learned_addr learned my addr 172.21.15.53:0/954734359 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:37.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fbd2f7fe640 1 --2- 172.21.15.53:0/954734359 >> v2:172.21.15.53:3300/0 conn(0x7fbd3006e8e0 0x7fbd3006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f985659c640 1 -- 172.21.15.53:0/468943052 >> v1:172.21.15.53:6789/0 conn(0x7f985806ea90 legacy=0x7f9858097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-22T08:10:37.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f985659c640 1 -- 172.21.15.53:0/468943052 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9858071490 con 0x7f985806e170 2024-09-22T08:10:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fcbb1058640 1 -- 172.21.15.53:0/1623855473 >> v1:172.21.15.53:6789/0 conn(0x7fcbac12bd00 legacy=0x7fcbac12c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fbd2e7fc640 1 -- 172.21.15.53:0/954734359 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195760536 0 0) 0x7fbd3006ff50 con 0x7fbd3006f200 2024-09-22T08:10:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fcbb1058640 1 -- 172.21.15.53:0/1623855473 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbac0710a0 con 0x7fcbac06f960 2024-09-22T08:10:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fbd2e7fc640 1 -- 172.21.15.53:0/954734359 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd18003520 con 0x7fbd3006f200 2024-09-22T08:10:37.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f2bd77fe640 1 -- 172.21.15.53:0/2749183608 >> v1:172.21.15.53:6789/0 conn(0x7f2bd812c830 legacy=0x7f2bd806e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7f2bd77fe640 1 -- 172.21.15.53:0/2749183608 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd8070760 con 0x7f2bd812bf10 2024-09-22T08:10:37.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.353+0000 7fbd2f7fe640 1 -- 172.21.15.53:0/954734359 >> v1:172.21.15.53:6789/0 conn(0x7fbd3006f200 legacy=0x7fbd3012f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7fbd2f7fe640 1 -- 172.21.15.53:0/954734359 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd30099710 con 0x7fbd3006e8e0 2024-09-22T08:10:37.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7f985659c640 1 --2- 172.21.15.53:0/468943052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 0x7f985806e550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9848009820 tx=0x7f984802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14dc0ef5234408de server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7fbd2f7fe640 1 --2- 172.21.15.53:0/954734359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 0x7fbd3006ecc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009720 tx=0x7fbd2002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58c150189408def server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7f985559a640 1 -- 172.21.15.53:0/468943052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9848037070 con 0x7f985806e170 2024-09-22T08:10:37.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7f985559a640 1 -- 172.21.15.53:0/468943052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984802adc0 con 0x7f985806e170 2024-09-22T08:10:37.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7f985559a640 1 -- 172.21.15.53:0/468943052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9848032590 con 0x7f985806e170 2024-09-22T08:10:37.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7fcbb1058640 1 --2- 172.21.15.53:0/1623855473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 0x7fcbac130ee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00b9c0 tx=0x7fcb9c02c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc89943ea6a489eb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7fbd2e7fc640 1 -- 172.21.15.53:0/954734359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20037070 con 0x7fbd3006e8e0 2024-09-22T08:10:37.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7f2bd77fe640 1 --2- 172.21.15.53:0/2749183608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 0x7f2bd812c2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009720 tx=0x7f2bc802c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb99e5a3fb1dcd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7fbd2e7fc640 1 -- 172.21.15.53:0/954734359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2002ae20 con 0x7fbd3006e8e0 2024-09-22T08:10:37.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.354+0000 7fbd2e7fc640 1 -- 172.21.15.53:0/954734359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20032590 con 0x7fbd3006e8e0 2024-09-22T08:10:37.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7fcbb0857640 1 -- 172.21.15.53:0/1623855473 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c03a070 con 0x7fcbac06f960 2024-09-22T08:10:37.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7fcbb0857640 1 -- 172.21.15.53:0/1623855473 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c0325b0 con 0x7fcbac06f960 2024-09-22T08:10:37.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7fcbb0857640 1 -- 172.21.15.53:0/1623855473 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c0328b0 con 0x7fcbac06f960 2024-09-22T08:10:37.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f2bd67fc640 1 -- 172.21.15.53:0/2749183608 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc8038070 con 0x7f2bd812bf10 2024-09-22T08:10:37.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f2bd67fc640 1 -- 172.21.15.53:0/2749183608 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc8031640 con 0x7f2bd812bf10 2024-09-22T08:10:37.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f2bd67fc640 1 -- 172.21.15.53:0/2749183608 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc8031940 con 0x7f2bd812bf10 2024-09-22T08:10:37.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f985cf33640 1 -- 172.21.15.53:0/468943052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 msgr2=0x7f985806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f985cf33640 1 --2- 172.21.15.53:0/468943052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 0x7f985806e550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9848009820 tx=0x7f984802a180 comp rx=0 tx=0).stop 2024-09-22T08:10:37.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f985cf33640 1 -- 172.21.15.53:0/468943052 shutdown_connections 2024-09-22T08:10:37.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f985cf33640 1 --2- 172.21.15.53:0/468943052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 0x7f985806e550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f985cf33640 1 -- 172.21.15.53:0/468943052 >> 172.21.15.53:0/468943052 conn(0x7f985809ac80 msgr2=0x7f9858098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f985cf33640 1 -- 172.21.15.53:0/468943052 shutdown_connections 2024-09-22T08:10:37.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f985cf33640 1 -- 172.21.15.53:0/468943052 wait complete. 2024-09-22T08:10:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f2bddd94640 1 -- 172.21.15.53:0/2749183608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 msgr2=0x7f2bd812c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.355+0000 7f2bddd94640 1 --2- 172.21.15.53:0/2749183608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 0x7f2bd812c2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009720 tx=0x7f2bc802c430 comp rx=0 tx=0).stop 2024-09-22T08:10:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7f2bddd94640 1 -- 172.21.15.53:0/2749183608 shutdown_connections 2024-09-22T08:10:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fbd35ac6640 1 -- 172.21.15.53:0/954734359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 msgr2=0x7fbd3006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7f2bddd94640 1 --2- 172.21.15.53:0/2749183608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 0x7f2bd812c2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fcbb3abd640 1 -- 172.21.15.53:0/1623855473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 msgr2=0x7fcbac130ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7f2bddd94640 1 -- 172.21.15.53:0/2749183608 >> 172.21.15.53:0/2749183608 conn(0x7f2bd809ac80 msgr2=0x7f2bd8098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fbd35ac6640 1 --2- 172.21.15.53:0/954734359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 0x7fbd3006ecc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009720 tx=0x7fbd2002a1a0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fcbb3abd640 1 --2- 172.21.15.53:0/1623855473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 0x7fcbac130ee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00b9c0 tx=0x7fcb9c02c5c0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fbd35ac6640 1 -- 172.21.15.53:0/954734359 shutdown_connections 2024-09-22T08:10:37.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7f2bddd94640 1 -- 172.21.15.53:0/2749183608 shutdown_connections 2024-09-22T08:10:37.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fbd35ac6640 1 --2- 172.21.15.53:0/954734359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 0x7fbd3006ecc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fbd35ac6640 1 -- 172.21.15.53:0/954734359 >> 172.21.15.53:0/954734359 conn(0x7fbd300a01c0 msgr2=0x7fbd300a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fcbb3abd640 1 -- 172.21.15.53:0/1623855473 shutdown_connections 2024-09-22T08:10:37.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fcbb3abd640 1 --2- 172.21.15.53:0/1623855473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 0x7fcbac130ee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fcbb3abd640 1 -- 172.21.15.53:0/1623855473 >> 172.21.15.53:0/1623855473 conn(0x7fcbac09ac80 msgr2=0x7fcbac098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7f2bddd94640 1 -- 172.21.15.53:0/2749183608 wait complete. 2024-09-22T08:10:37.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fbd35ac6640 1 -- 172.21.15.53:0/954734359 shutdown_connections 2024-09-22T08:10:37.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fbd35ac6640 1 -- 172.21.15.53:0/954734359 wait complete. 2024-09-22T08:10:37.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fcbb3abd640 1 -- 172.21.15.53:0/1623855473 shutdown_connections 2024-09-22T08:10:37.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.356+0000 7fcbb3abd640 1 -- 172.21.15.53:0/1623855473 wait complete. 2024-09-22T08:10:37.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7fbd35ac6640 1 Processor -- start 2024-09-22T08:10:37.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7f985cf33640 1 Processor -- start 2024-09-22T08:10:37.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7f2bddd94640 1 Processor -- start 2024-09-22T08:10:37.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7fbd35ac6640 1 -- start start 2024-09-22T08:10:37.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7f985cf33640 1 -- start start 2024-09-22T08:10:37.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7f2bddd94640 1 -- start start 2024-09-22T08:10:37.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7fbd35ac6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 0x7fbd3008ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7fbd35ac6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbd301300f0 con 0x7fbd3006e8e0 2024-09-22T08:10:37.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7f985cf33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 0x7f985808bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7f985cf33640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9858072060 con 0x7f985806e170 2024-09-22T08:10:37.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.357+0000 7f985659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 0x7f985808bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f985659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 0x7f985808bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48366/0 (socket says 172.21.15.53:48366) 2024-09-22T08:10:37.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f985659c640 1 -- 172.21.15.53:0/829726655 learned_addr learned my addr 172.21.15.53:0/829726655 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7fbd2f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 0x7fbd3008ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7fbd2f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 0x7fbd3008ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48364/0 (socket says 172.21.15.53:48364) 2024-09-22T08:10:37.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7fbd2f7fe640 1 -- 172.21.15.53:0/2549617570 learned_addr learned my addr 172.21.15.53:0/2549617570 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7fcbb3abd640 1 Processor -- start 2024-09-22T08:10:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7fcbb3abd640 1 -- start start 2024-09-22T08:10:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f985659c640 1 -- 172.21.15.53:0/829726655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985808e370 con 0x7f985806e170 2024-09-22T08:10:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7fbd2f7fe640 1 -- 172.21.15.53:0/2549617570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3008e8d0 con 0x7fbd3006e8e0 2024-09-22T08:10:37.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f2bddd94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 0x7f2bd8127630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f985659c640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 0x7f985808bfc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9848035040 tx=0x7f98480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7fbd2f7fe640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 0x7fbd3008ca50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009720 tx=0x7fbd200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f2bd77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 0x7f2bd8127630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f2bd77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 0x7f2bd8127630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48386/0 (socket says 172.21.15.53:48386) 2024-09-22T08:10:37.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f2bd77fe640 1 -- 172.21.15.53:0/2829673527 learned_addr learned my addr 172.21.15.53:0/2829673527 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd8099df0 con 0x7f2bd812bf10 2024-09-22T08:10:37.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f9846ffd640 1 -- 172.21.15.53:0/829726655 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9848041070 con 0x7f985806e170 2024-09-22T08:10:37.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f9846ffd640 1 -- 172.21.15.53:0/829726655 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984803c590 con 0x7f985806e170 2024-09-22T08:10:37.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7fbd17fff640 1 -- 172.21.15.53:0/2549617570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20042070 con 0x7fbd3006e8e0 2024-09-22T08:10:37.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3008f2b0 con 0x7fbd3006e8e0 2024-09-22T08:10:37.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.358+0000 7f985cf33640 1 -- 172.21.15.53:0/829726655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985812ab10 con 0x7f985806e170 2024-09-22T08:10:37.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7fbd17fff640 1 -- 172.21.15.53:0/2549617570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2003e460 con 0x7fbd3006e8e0 2024-09-22T08:10:37.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3008f580 con 0x7fbd3006e8e0 2024-09-22T08:10:37.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7fcbb3abd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 0x7fcbac08bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7f985cf33640 1 -- 172.21.15.53:0/829726655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9858129b30 con 0x7f985806e170 2024-09-22T08:10:37.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7fbd17fff640 1 -- 172.21.15.53:0/2549617570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd20037040 con 0x7fbd3006e8e0 2024-09-22T08:10:37.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7f2bd77fe640 1 -- 172.21.15.53:0/2829673527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd8129e90 con 0x7f2bd812bf10 2024-09-22T08:10:37.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7fcbb1859640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 0x7fcbac08bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7fcbb3abd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac12c970 con 0x7fcbac06f960 2024-09-22T08:10:37.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7fcbb1859640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 0x7fcbac08bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48396/0 (socket says 172.21.15.53:48396) 2024-09-22T08:10:37.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7fcbb1859640 1 -- 172.21.15.53:0/2879133797 learned_addr learned my addr 172.21.15.53:0/2879133797 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.359+0000 7f2bd77fe640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 0x7f2bd8127630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8000c00 tx=0x7f2bc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd3008e180 con 0x7fbd3006e8e0 2024-09-22T08:10:37.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7f9846ffd640 1 -- 172.21.15.53:0/829726655 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9848037040 con 0x7f985806e170 2024-09-22T08:10:37.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7f9844ff9640 1 -- 172.21.15.53:0/829726655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9830000f80 con 0x7f985806e170 2024-09-22T08:10:37.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7f2bbffff640 1 -- 172.21.15.53:0/2829673527 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc8042020 con 0x7f2bd812bf10 2024-09-22T08:10:37.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7fcbb1859640 1 -- 172.21.15.53:0/2879133797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbac12ab60 con 0x7fcbac06f960 2024-09-22T08:10:37.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd812a120 con 0x7f2bd812bf10 2024-09-22T08:10:37.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7f2bbffff640 1 -- 172.21.15.53:0/2829673527 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc803e420 con 0x7f2bd812bf10 2024-09-22T08:10:37.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7fbd17fff640 1 -- 172.21.15.53:0/2549617570 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbd20045070 con 0x7fbd3006e8e0 2024-09-22T08:10:37.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7fcbb1859640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 0x7fcbac08bfc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c480 tx=0x7fcba800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7f2bbffff640 1 -- 172.21.15.53:0/2829673527 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc8038040 con 0x7f2bd812bf10 2024-09-22T08:10:37.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd8127d50 con 0x7f2bd812bf10 2024-09-22T08:10:37.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7fbd17fff640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbd1c03e6c0 0x7fbd1c040b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7fbd17fff640 1 -- 172.21.15.53:0/2549617570 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fbd20073700 con 0x7fbd3006e8e0 2024-09-22T08:10:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.360+0000 7f9846ffd640 1 -- 172.21.15.53:0/829726655 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9848044070 con 0x7f985806e170 2024-09-22T08:10:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fbd17fff640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbd1c043e40 0x7fbd1c0462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fbd17fff640 1 -- 172.21.15.53:0/2549617570 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd20031ec0 con 0x7fbd1c043e40 2024-09-22T08:10:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fbd17fff640 1 -- 172.21.15.53:0/2549617570 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fbd2007a050 con 0x7fbd3006e8e0 2024-09-22T08:10:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fcba27fc640 1 -- 172.21.15.53:0/2879133797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcba8017070 con 0x7fcbac06f960 2024-09-22T08:10:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fbd2effd640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbd1c03e6c0 0x7fbd1c040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7f9846ffd640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f983803e710 0x7f9838040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fcba27fc640 1 -- 172.21.15.53:0/2879133797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba8005c10 con 0x7fcbac06f960 2024-09-22T08:10:37.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbac12ba40 con 0x7fcbac06f960 2024-09-22T08:10:37.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fcba27fc640 1 -- 172.21.15.53:0/2879133797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcba8017070 con 0x7fcbac06f960 2024-09-22T08:10:37.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbac08c6e0 con 0x7fcbac06f960 2024-09-22T08:10:37.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7f9846ffd640 1 -- 172.21.15.53:0/829726655 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9848073df0 con 0x7f985806e170 2024-09-22T08:10:37.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7f9855d9b640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f983803e710 0x7f9838040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fbd2ffff640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbd1c043e40 0x7fbd1c0462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7f9846ffd640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f9838043e90 0x7f9838046310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7f9846ffd640 1 -- 172.21.15.53:0/829726655 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98380469e0 con 0x7f9838043e90 2024-09-22T08:10:37.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7f9846ffd640 1 -- 172.21.15.53:0/829726655 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9848074170 con 0x7f985806e170 2024-09-22T08:10:37.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7fbd2ffff640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbd1c043e40 0x7fbd1c0462c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7fbd2effd640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbd1c03e6c0 0x7fbd1c040b80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbd24001610 tx=0x7fbd240078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7f2bbffff640 1 -- 172.21.15.53:0/2829673527 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2bc8045020 con 0x7f2bd812bf10 2024-09-22T08:10:37.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.361+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2bd8073580 con 0x7f2bd812bf10 2024-09-22T08:10:37.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7f2bbffff640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bc403e760 0x7f2bc4040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7f9855d9b640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f983803e710 0x7f9838040bd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f984c003cd0 tx=0x7f984c007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7f2bbffff640 1 -- 172.21.15.53:0/2829673527 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f2bc8073bb0 con 0x7f2bd812bf10 2024-09-22T08:10:37.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7f2bbffff640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7f2bc4043ee0 0x7f2bc4046360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7f2bbffff640 1 -- 172.21.15.53:0/2829673527 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bc8046e70 con 0x7f2bc4043ee0 2024-09-22T08:10:37.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7f2bbffff640 1 -- 172.21.15.53:0/2829673527 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2bc8033790 con 0x7f2bd812bf10 2024-09-22T08:10:37.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcbac12b630 con 0x7fcbac06f960 2024-09-22T08:10:37.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7f9856d9d640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f9838043e90 0x7f9838046310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7f2bd7fff640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7f2bc4043ee0 0x7f2bc4046360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7f2bd6ffd640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bc403e760 0x7f2bc4040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.362+0000 7fcba27fc640 1 -- 172.21.15.53:0/2879133797 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcba801a070 con 0x7fcbac06f960 2024-09-22T08:10:37.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7f9856d9d640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f9838043e90 0x7f9838046310 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7fbd17fff640 1 -- 172.21.15.53:0/2549617570 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd20031ec0 con 0x7fbd1c043e40 2024-09-22T08:10:37.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7f2bd7fff640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7f2bc4043ee0 0x7f2bc4046360 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7f2bd6ffd640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bc403e760 0x7f2bc4040c20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc007fd0 tx=0x7f2bcc007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7fcba27fc640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb9003e8d0 0x7fcb90040d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7fcba27fc640 1 -- 172.21.15.53:0/2879133797 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fcba805b3a0 con 0x7fcbac06f960 2024-09-22T08:10:37.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7fcba27fc640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7fcb90044050 0x7fcb900464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7fcba27fc640 1 -- 172.21.15.53:0/2879133797 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcba801be50 con 0x7fcb90044050 2024-09-22T08:10:37.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7fcba27fc640 1 -- 172.21.15.53:0/2879133797 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fcba8057060 con 0x7fcbac06f960 2024-09-22T08:10:37.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7fcbb1058640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb9003e8d0 0x7fcb90040d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7fcbb205a640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7fcb90044050 0x7fcb900464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.363+0000 7f9846ffd640 1 -- 172.21.15.53:0/829726655 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f98380469e0 con 0x7f9838043e90 2024-09-22T08:10:37.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.364+0000 7fcbb205a640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7fcb90044050 0x7fcb900464d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.364+0000 7f2bbffff640 1 -- 172.21.15.53:0/2829673527 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2bc8046e70 con 0x7f2bc4043ee0 2024-09-22T08:10:37.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.364+0000 7fcbb1058640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb9003e8d0 0x7fcb90040d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c037000 tx=0x7fcb9c006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.364+0000 7fcba27fc640 1 -- 172.21.15.53:0/2879133797 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcba801be50 con 0x7fcb90044050 2024-09-22T08:10:37.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.377+0000 7f9844ff9640 1 -- 172.21.15.53:0/829726655 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9830002c70 con 0x7f9838043e90 2024-09-22T08:10:37.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9846ffd640 1 -- 172.21.15.53:0/829726655 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9830002c70 con 0x7f9838043e90 2024-09-22T08:10:37.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 -- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f9838043e90 msgr2=0x7f9838046310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f9838043e90 0x7f9838046310 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 -- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f983803e710 msgr2=0x7f9838040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f983803e710 0x7f9838040bd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f984c003cd0 tx=0x7f984c007a30 comp rx=0 tx=0).stop 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 -- 172.21.15.53:0/829726655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 msgr2=0x7f985808bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 0x7f985808bfc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9848035040 tx=0x7f98480046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 -- 172.21.15.53:0/829726655 shutdown_connections 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f9838043e90 0x7f9838046310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f983803e710 0x7f9838040bd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 --2- 172.21.15.53:0/829726655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f985806e170 0x7f985808bfc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 -- 172.21.15.53:0/829726655 >> 172.21.15.53:0/829726655 conn(0x7f985809ac80 msgr2=0x7f9858122c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 -- 172.21.15.53:0/829726655 shutdown_connections 2024-09-22T08:10:37.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7f9844ff9640 1 -- 172.21.15.53:0/829726655 wait complete. 2024-09-22T08:10:37.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.378+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcbac073760 con 0x7fcb90044050 2024-09-22T08:10:37.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcba27fc640 1 -- 172.21.15.53:0/2879133797 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcbac073760 con 0x7fcb90044050 2024-09-22T08:10:37.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7fcb90044050 msgr2=0x7fcb900464d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7fcb90044050 0x7fcb900464d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb9003e8d0 msgr2=0x7fcb90040d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb9003e8d0 0x7fcb90040d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c037000 tx=0x7fcb9c006f90 comp rx=0 tx=0).stop 2024-09-22T08:10:37.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 msgr2=0x7fcbac08bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 0x7fcbac08bfc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c480 tx=0x7fcba800c940 comp rx=0 tx=0).stop 2024-09-22T08:10:37.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 shutdown_connections 2024-09-22T08:10:37.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7fcb90044050 0x7fcb900464d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb9003e8d0 0x7fcb90040d90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 --2- 172.21.15.53:0/2879133797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbac06f960 0x7fcbac08bfc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 >> 172.21.15.53:0/2879133797 conn(0x7fcbac09ac80 msgr2=0x7fcbac0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.379+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 shutdown_connections 2024-09-22T08:10:37.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.380+0000 7fcbb3abd640 1 -- 172.21.15.53:0/2879133797 wait complete. 2024-09-22T08:10:37.400 INFO:teuthology.orchestra.run.smithi053.stdout:42949672966 2024-09-22T08:10:37.400 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T08:10:37.401 INFO:teuthology.orchestra.run.smithi053.stdout:42949672965 2024-09-22T08:10:37.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T08:10:37.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.394+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd3008fd50 con 0x7fbd1c043e40 2024-09-22T08:10:37.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.395+0000 7fbd17fff640 1 -- 172.21.15.53:0/2549617570 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbd3008fd50 con 0x7fbd1c043e40 2024-09-22T08:10:37.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.395+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2bd812c2f0 con 0x7f2bc4043ee0 2024-09-22T08:10:37.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.395+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbd1c043e40 msgr2=0x7fbd1c0462c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.395+0000 7fbd35ac6640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbd1c043e40 0x7fbd1c0462c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.395+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbd1c03e6c0 msgr2=0x7fbd1c040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.395+0000 7fbd35ac6640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbd1c03e6c0 0x7fbd1c040b80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbd24001610 tx=0x7fbd240078f0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.395+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 msgr2=0x7fbd3008ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.395+0000 7fbd35ac6640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 0x7fbd3008ca50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009720 tx=0x7fbd200046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.395+0000 7f2bbffff640 1 -- 172.21.15.53:0/2829673527 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2bd812c2f0 con 0x7f2bc4043ee0 2024-09-22T08:10:37.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 shutdown_connections 2024-09-22T08:10:37.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7fbd35ac6640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbd1c043e40 0x7fbd1c0462c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7fbd35ac6640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbd1c03e6c0 0x7fbd1c040b80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7fbd35ac6640 1 --2- 172.21.15.53:0/2549617570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd3006e8e0 0x7fbd3008ca50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 >> 172.21.15.53:0/2549617570 conn(0x7fbd300a01c0 msgr2=0x7fbd3009dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 shutdown_connections 2024-09-22T08:10:37.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7fbd35ac6640 1 -- 172.21.15.53:0/2549617570 wait complete. 2024-09-22T08:10:37.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7f2bc4043ee0 msgr2=0x7f2bc4046360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7f2bc4043ee0 0x7f2bc4046360 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bc403e760 msgr2=0x7f2bc4040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bc403e760 0x7f2bc4040c20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc007fd0 tx=0x7f2bcc007aa0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 msgr2=0x7f2bd8127630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 0x7f2bd8127630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8000c00 tx=0x7f2bc80046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 shutdown_connections 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7f2bc4043ee0 0x7f2bc4046360 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bc403e760 0x7f2bc4040c20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 --2- 172.21.15.53:0/2829673527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd812bf10 0x7f2bd8127630 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 >> 172.21.15.53:0/2829673527 conn(0x7f2bd809ac80 msgr2=0x7f2bd8071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 shutdown_connections 2024-09-22T08:10:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.396+0000 7f2bddd94640 1 -- 172.21.15.53:0/2829673527 wait complete. 2024-09-22T08:10:37.411 INFO:teuthology.orchestra.run.smithi053.stdout:38654705670 2024-09-22T08:10:37.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T08:10:37.413 INFO:teuthology.orchestra.run.smithi053.stdout:42949672965 2024-09-22T08:10:37.413 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T08:10:37.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.514+0000 7f68bcb9f640 1 Processor -- start 2024-09-22T08:10:37.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.514+0000 7f68bcb9f640 1 -- start start 2024-09-22T08:10:37.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.515+0000 7f68bcb9f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68b809f1a0 0x7f68b812d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.515+0000 7f68bcb9f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b8072a90 con 0x7f68b812dc10 2024-09-22T08:10:37.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.515+0000 7f68bcb9f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f68b8072da0 con 0x7f68b809f1a0 2024-09-22T08:10:37.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.515+0000 7f68b77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68b809f1a0 0x7f68b812d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.515+0000 7f68b77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68b809f1a0 0x7f68b812d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48398/0 (socket says 172.21.15.53:48398) 2024-09-22T08:10:37.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.515+0000 7f68b77fe640 1 -- 172.21.15.53:0/4043889950 learned_addr learned my addr 172.21.15.53:0/4043889950 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.516+0000 7f68b77fe640 1 -- 172.21.15.53:0/4043889950 >> v1:172.21.15.53:6789/0 conn(0x7f68b812dc10 legacy=0x7f68b80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.516+0000 7f68b77fe640 1 -- 172.21.15.53:0/4043889950 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b812e020 con 0x7f68b809f1a0 2024-09-22T08:10:37.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.517+0000 7f68b77fe640 1 --2- 172.21.15.53:0/4043889950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 0x7f68b812d6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f68a80097f0 tx=0x7f68a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d87f952fde4e11e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.517+0000 7f68b67fc640 1 -- 172.21.15.53:0/4043889950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a8037070 con 0x7f68b809f1a0 2024-09-22T08:10:37.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.517+0000 7f68b67fc640 1 -- 172.21.15.53:0/4043889950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a8032440 con 0x7f68b809f1a0 2024-09-22T08:10:37.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.517+0000 7f68b67fc640 1 -- 172.21.15.53:0/4043889950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a8032740 con 0x7f68b809f1a0 2024-09-22T08:10:37.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.518+0000 7f68bcb9f640 1 -- 172.21.15.53:0/4043889950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 msgr2=0x7f68b812d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.518+0000 7f68bcb9f640 1 --2- 172.21.15.53:0/4043889950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 0x7f68b812d6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f68a80097f0 tx=0x7f68a802a270 comp rx=0 tx=0).stop 2024-09-22T08:10:37.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.518+0000 7f68bcb9f640 1 -- 172.21.15.53:0/4043889950 shutdown_connections 2024-09-22T08:10:37.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.518+0000 7f68bcb9f640 1 --2- 172.21.15.53:0/4043889950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 0x7f68b812d6d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.518+0000 7f68bcb9f640 1 -- 172.21.15.53:0/4043889950 >> 172.21.15.53:0/4043889950 conn(0x7f68b809e030 msgr2=0x7f68b809e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.518+0000 7f68bcb9f640 1 -- 172.21.15.53:0/4043889950 shutdown_connections 2024-09-22T08:10:37.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.518+0000 7f68bcb9f640 1 -- 172.21.15.53:0/4043889950 wait complete. 2024-09-22T08:10:37.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.519+0000 7f68bcb9f640 1 Processor -- start 2024-09-22T08:10:37.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.519+0000 7f68bcb9f640 1 -- start start 2024-09-22T08:10:37.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.520+0000 7f68bcb9f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 0x7f68b81c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.520+0000 7f68bcb9f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68b8071e70 con 0x7f68b809f1a0 2024-09-22T08:10:37.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.520+0000 7f68b77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 0x7f68b81c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.520+0000 7f68b77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 0x7f68b81c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48406/0 (socket says 172.21.15.53:48406) 2024-09-22T08:10:37.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.520+0000 7f68b77fe640 1 -- 172.21.15.53:0/648045188 learned_addr learned my addr 172.21.15.53:0/648045188 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.520+0000 7f68b77fe640 1 -- 172.21.15.53:0/648045188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b8092f30 con 0x7f68b809f1a0 2024-09-22T08:10:37.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.521+0000 7f68b77fe640 1 --2- 172.21.15.53:0/648045188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 0x7f68b81c4230 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f68a8035040 tx=0x7f68a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.521+0000 7f689ffff640 1 -- 172.21.15.53:0/648045188 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a8041070 con 0x7f68b809f1a0 2024-09-22T08:10:37.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.521+0000 7f689ffff640 1 -- 172.21.15.53:0/648045188 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a803c7a0 con 0x7f68b809f1a0 2024-09-22T08:10:37.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.521+0000 7f68bcb9f640 1 -- 172.21.15.53:0/648045188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b8092500 con 0x7f68b809f1a0 2024-09-22T08:10:37.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.521+0000 7f689ffff640 1 -- 172.21.15.53:0/648045188 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a8037040 con 0x7f68b809f1a0 2024-09-22T08:10:37.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.521+0000 7f68bcb9f640 1 -- 172.21.15.53:0/648045188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b8093370 con 0x7f68b809f1a0 2024-09-22T08:10:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.522+0000 7f689ffff640 1 -- 172.21.15.53:0/648045188 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f68a8044070 con 0x7f68b809f1a0 2024-09-22T08:10:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.522+0000 7f689ffff640 1 --2- 172.21.15.53:0/648045188 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f68a403e740 0x7f68a4040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.522+0000 7f68bcb9f640 1 -- 172.21.15.53:0/648045188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b812d6d0 con 0x7f68b809f1a0 2024-09-22T08:10:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.522+0000 7f689ffff640 1 -- 172.21.15.53:0/648045188 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f68a80737a0 con 0x7f68b809f1a0 2024-09-22T08:10:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.523+0000 7f68b6ffd640 1 --2- 172.21.15.53:0/648045188 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f68a403e740 0x7f68a4040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.523+0000 7f68b6ffd640 1 --2- 172.21.15.53:0/648045188 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f68a403e740 0x7f68a4040c00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68ac001600 tx=0x7f68ac0079f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.528+0000 7f689ffff640 1 -- 172.21.15.53:0/648045188 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f68a803d3f0 con 0x7f68b809f1a0 2024-09-22T08:10:37.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.558+0000 7f52f8b24640 1 Processor -- start 2024-09-22T08:10:37.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.558+0000 7f52f8b24640 1 -- start start 2024-09-22T08:10:37.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.559+0000 7f52f8b24640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52f4132960 0x7f52f4134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.559+0000 7f52f8b24640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f406ff50 con 0x7f52f406e8e0 2024-09-22T08:10:37.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.559+0000 7f52f8b24640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f52f4099c10 con 0x7f52f4132960 2024-09-22T08:10:37.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.559+0000 7f52f1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52f4132960 0x7f52f4134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.559+0000 7f52f1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52f4132960 0x7f52f4134d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48420/0 (socket says 172.21.15.53:48420) 2024-09-22T08:10:37.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.559+0000 7f52f259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f52f406e8e0 0x7f52f406ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52266/0 (socket says 172.21.15.53:52266) 2024-09-22T08:10:37.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.559+0000 7f52f1d9b640 1 -- 172.21.15.53:0/3096630357 learned_addr learned my addr 172.21.15.53:0/3096630357 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.559+0000 7f52f1d9b640 1 -- 172.21.15.53:0/3096630357 >> v1:172.21.15.53:6789/0 conn(0x7f52f406e8e0 legacy=0x7f52f406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.559+0000 7f52f1d9b640 1 -- 172.21.15.53:0/3096630357 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f406f3d0 con 0x7f52f4132960 2024-09-22T08:10:37.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.560+0000 7f52f1d9b640 1 --2- 172.21.15.53:0/3096630357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f4132960 0x7f52f4134d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f52e80097f0 tx=0x7f52e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9946b11f7dadef server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.560+0000 7f52f159a640 1 -- 172.21.15.53:0/3096630357 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52e8037070 con 0x7f52f4132960 2024-09-22T08:10:37.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.560+0000 7f52f159a640 1 -- 172.21.15.53:0/3096630357 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e8032440 con 0x7f52f4132960 2024-09-22T08:10:37.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.560+0000 7f52f159a640 1 -- 172.21.15.53:0/3096630357 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52e802ae60 con 0x7f52f4132960 2024-09-22T08:10:37.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.561+0000 7f52f8b24640 1 -- 172.21.15.53:0/3096630357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f4132960 msgr2=0x7f52f4134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.561+0000 7f52f8b24640 1 --2- 172.21.15.53:0/3096630357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f4132960 0x7f52f4134d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f52e80097f0 tx=0x7f52e802a1e0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.561+0000 7f52f8b24640 1 -- 172.21.15.53:0/3096630357 shutdown_connections 2024-09-22T08:10:37.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.561+0000 7f52f8b24640 1 --2- 172.21.15.53:0/3096630357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f4132960 0x7f52f4134d50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.561+0000 7f52f8b24640 1 -- 172.21.15.53:0/3096630357 >> 172.21.15.53:0/3096630357 conn(0x7f52f40a01c0 msgr2=0x7f52f40a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.561+0000 7f52f8b24640 1 -- 172.21.15.53:0/3096630357 shutdown_connections 2024-09-22T08:10:37.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.561+0000 7f52f8b24640 1 -- 172.21.15.53:0/3096630357 wait complete. 2024-09-22T08:10:37.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.562+0000 7f8b207a0640 1 Processor -- start 2024-09-22T08:10:37.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.562+0000 7f8b207a0640 1 -- start start 2024-09-22T08:10:37.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.562+0000 7f52f8b24640 1 Processor -- start 2024-09-22T08:10:37.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.562+0000 7f8b207a0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8b18132960 0x7f8b18134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.562+0000 7f8b207a0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1806ff50 con 0x7f8b1806e8e0 2024-09-22T08:10:37.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.562+0000 7f8b207a0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8b18099c10 con 0x7f8b18132960 2024-09-22T08:10:37.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.562+0000 7f52f8b24640 1 -- start start 2024-09-22T08:10:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.562+0000 7f8b1dd3b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8b18132960 0x7f8b18134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.562+0000 7f8b1e53c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8b1806e8e0 0x7f8b1806ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52278/0 (socket says 172.21.15.53:52278) 2024-09-22T08:10:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.562+0000 7f8b1e53c640 1 -- 172.21.15.53:0/3099045549 learned_addr learned my addr 172.21.15.53:0/3099045549 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.563+0000 7f8b1d53a640 1 -- 172.21.15.53:0/3099045549 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826818928 0 0) 0x7f8b1806ff50 con 0x7f8b1806e8e0 2024-09-22T08:10:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.563+0000 7f8b1d53a640 1 -- 172.21.15.53:0/3099045549 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b04003520 con 0x7f8b1806e8e0 2024-09-22T08:10:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.563+0000 7f8b1dd3b640 1 -- 172.21.15.53:0/3099045549 >> v1:172.21.15.53:6789/0 conn(0x7f8b1806e8e0 legacy=0x7f8b1806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.563+0000 7f8b1dd3b640 1 -- 172.21.15.53:0/3099045549 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1806f3d0 con 0x7f8b18132960 2024-09-22T08:10:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.563+0000 7f52f8b24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f406e8e0 0x7f52f412be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.563+0000 7f52f8b24640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f52f4135410 con 0x7f52f406e8e0 2024-09-22T08:10:37.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.563+0000 7f52f259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f406e8e0 0x7f52f412be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.563+0000 7f52f259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f406e8e0 0x7f52f412be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48446/0 (socket says 172.21.15.53:48446) 2024-09-22T08:10:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.563+0000 7f52f259c640 1 -- 172.21.15.53:0/2236456601 learned_addr learned my addr 172.21.15.53:0/2236456601 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.564+0000 7f52f259c640 1 -- 172.21.15.53:0/2236456601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f4129f90 con 0x7f52f406e8e0 2024-09-22T08:10:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.564+0000 7f52f259c640 1 --2- 172.21.15.53:0/2236456601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f406e8e0 0x7f52f412be90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f52e4001eb0 tx=0x7f52e400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.564+0000 7f52e2ffd640 1 -- 172.21.15.53:0/2236456601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52e4007410 con 0x7f52f406e8e0 2024-09-22T08:10:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.564+0000 7f52f8b24640 1 -- 172.21.15.53:0/2236456601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f412e950 con 0x7f52f406e8e0 2024-09-22T08:10:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.564+0000 7f52e2ffd640 1 -- 172.21.15.53:0/2236456601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e40075b0 con 0x7f52f406e8e0 2024-09-22T08:10:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.564+0000 7f52e2ffd640 1 -- 172.21.15.53:0/2236456601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52e4004910 con 0x7f52f406e8e0 2024-09-22T08:10:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.564+0000 7f52f8b24640 1 -- 172.21.15.53:0/2236456601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f412c5b0 con 0x7f52f406e8e0 2024-09-22T08:10:37.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.564+0000 7f8b1dd3b640 1 --2- 172.21.15.53:0/3099045549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b18132960 0x7f8b18134d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009720 tx=0x7f8b0802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ac3ada67e7dc00 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.564+0000 7f8b1d53a640 1 -- 172.21.15.53:0/3099045549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b08037070 con 0x7f8b18132960 2024-09-22T08:10:37.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.565+0000 7f8b1d53a640 1 -- 172.21.15.53:0/3099045549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0802ad90 con 0x7f8b18132960 2024-09-22T08:10:37.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.565+0000 7f8b1d53a640 1 -- 172.21.15.53:0/3099045549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b08032570 con 0x7f8b18132960 2024-09-22T08:10:37.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.565+0000 7f52f8b24640 1 -- 172.21.15.53:0/2236456601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f412f460 con 0x7f52f406e8e0 2024-09-22T08:10:37.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f8b207a0640 1 -- 172.21.15.53:0/3099045549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b18132960 msgr2=0x7f8b18134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f8b207a0640 1 --2- 172.21.15.53:0/3099045549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b18132960 0x7f8b18134d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009720 tx=0x7f8b0802a110 comp rx=0 tx=0).stop 2024-09-22T08:10:37.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f52e2ffd640 1 -- 172.21.15.53:0/2236456601 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f52e401a020 con 0x7f52f406e8e0 2024-09-22T08:10:37.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f8b207a0640 1 -- 172.21.15.53:0/3099045549 shutdown_connections 2024-09-22T08:10:37.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f8b207a0640 1 --2- 172.21.15.53:0/3099045549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b18132960 0x7f8b18134d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f8b207a0640 1 -- 172.21.15.53:0/3099045549 >> 172.21.15.53:0/3099045549 conn(0x7f8b180a01c0 msgr2=0x7f8b180a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f8b207a0640 1 -- 172.21.15.53:0/3099045549 shutdown_connections 2024-09-22T08:10:37.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f8b207a0640 1 -- 172.21.15.53:0/3099045549 wait complete. 2024-09-22T08:10:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f52e2ffd640 1 --2- 172.21.15.53:0/2236456601 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f52d403e6c0 0x7f52d4040b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f52e2ffd640 1 -- 172.21.15.53:0/2236456601 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f52e40524d0 con 0x7f52f406e8e0 2024-09-22T08:10:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.566+0000 7f52f1d9b640 1 --2- 172.21.15.53:0/2236456601 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f52d403e6c0 0x7f52d4040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.567+0000 7f52f1d9b640 1 --2- 172.21.15.53:0/2236456601 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f52d403e6c0 0x7f52d4040b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f52e8034000 tx=0x7f52e802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.567+0000 7f8b207a0640 1 Processor -- start 2024-09-22T08:10:37.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.567+0000 7f8b207a0640 1 -- start start 2024-09-22T08:10:37.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.568+0000 7f8b207a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b1806e8e0 0x7f8b1812d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.568+0000 7f8b207a0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8b18135410 con 0x7f8b1806e8e0 2024-09-22T08:10:37.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.569+0000 7f8b1e53c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b1806e8e0 0x7f8b1812d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.569+0000 7f8b1e53c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b1806e8e0 0x7f8b1812d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48452/0 (socket says 172.21.15.53:48452) 2024-09-22T08:10:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.569+0000 7f8b1e53c640 1 -- 172.21.15.53:0/2705810880 learned_addr learned my addr 172.21.15.53:0/2705810880 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.569+0000 7f8b1e53c640 1 -- 172.21.15.53:0/2705810880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b18129f50 con 0x7f8b1806e8e0 2024-09-22T08:10:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.569+0000 7f8b1e53c640 1 --2- 172.21.15.53:0/2705810880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b1806e8e0 0x7f8b1812d450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400c390 tx=0x7f8b1400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.571+0000 7f8b0effd640 1 -- 172.21.15.53:0/2705810880 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b14017070 con 0x7f8b1806e8e0 2024-09-22T08:10:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.571+0000 7f8b0effd640 1 -- 172.21.15.53:0/2705810880 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b14005cd0 con 0x7f8b1806e8e0 2024-09-22T08:10:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.571+0000 7f8b207a0640 1 -- 172.21.15.53:0/2705810880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1812bf90 con 0x7f8b1806e8e0 2024-09-22T08:10:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.571+0000 7f8b207a0640 1 -- 172.21.15.53:0/2705810880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1812e550 con 0x7f8b1806e8e0 2024-09-22T08:10:37.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.571+0000 7f52e2ffd640 1 -- 172.21.15.53:0/2236456601 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f52e40113a0 con 0x7f52f406e8e0 2024-09-22T08:10:37.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.571+0000 7f8b0effd640 1 -- 172.21.15.53:0/2705810880 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b14007200 con 0x7f8b1806e8e0 2024-09-22T08:10:37.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.572+0000 7f8b0effd640 1 -- 172.21.15.53:0/2705810880 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8b1401a070 con 0x7f8b1806e8e0 2024-09-22T08:10:37.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.572+0000 7f8b0effd640 1 --2- 172.21.15.53:0/2705810880 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8afc03e710 0x7f8afc040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.572+0000 7f8b0effd640 1 -- 172.21.15.53:0/2705810880 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f8b14052000 con 0x7f8b1806e8e0 2024-09-22T08:10:37.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.573+0000 7f8b207a0640 1 -- 172.21.15.53:0/2705810880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b00005080 con 0x7f8b1806e8e0 2024-09-22T08:10:37.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.573+0000 7f8b1dd3b640 1 --2- 172.21.15.53:0/2705810880 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8afc03e710 0x7f8afc040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.573+0000 7f8b1dd3b640 1 --2- 172.21.15.53:0/2705810880 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8afc03e710 0x7f8afc040bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8b08034000 tx=0x7f8b0802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.574+0000 7f5f7f87f640 1 Processor -- start 2024-09-22T08:10:37.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.574+0000 7f5f7f87f640 1 -- start start 2024-09-22T08:10:37.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.574+0000 7f5f7f87f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5f78132960 0x7f5f78134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.574+0000 7f5f7f87f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7806ff50 con 0x7f5f7806e8e0 2024-09-22T08:10:37.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.574+0000 7f5f7f87f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5f78099c10 con 0x7f5f78132960 2024-09-22T08:10:37.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.575+0000 7f5f7ce1a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5f78132960 0x7f5f78134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.575+0000 7f5f7ce1a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5f78132960 0x7f5f78134d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48464/0 (socket says 172.21.15.53:48464) 2024-09-22T08:10:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.575+0000 7f5f7ce1a640 1 -- 172.21.15.53:0/434667955 learned_addr learned my addr 172.21.15.53:0/434667955 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.575+0000 7f5f7d61b640 1 --1- 172.21.15.53:0/434667955 >> v1:172.21.15.53:6789/0 conn(0x7f5f7806e8e0 0x7f5f7806ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52292/0 (socket says 172.21.15.53:52292) 2024-09-22T08:10:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.575+0000 7f5f7ce1a640 1 -- 172.21.15.53:0/434667955 >> v1:172.21.15.53:6789/0 conn(0x7f5f7806e8e0 legacy=0x7f5f7806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.575+0000 7f5f7ce1a640 1 -- 172.21.15.53:0/434667955 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7806f3d0 con 0x7f5f78132960 2024-09-22T08:10:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.576+0000 7f5f7ce1a640 1 --2- 172.21.15.53:0/434667955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f78132960 0x7f5f78134d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f680097f0 tx=0x7f5f6802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec10f36ae979e236 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.581+0000 7f5f6ffff640 1 -- 172.21.15.53:0/434667955 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f68037070 con 0x7f5f78132960 2024-09-22T08:10:37.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.581+0000 7f5f6ffff640 1 -- 172.21.15.53:0/434667955 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f68032440 con 0x7f5f78132960 2024-09-22T08:10:37.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.582+0000 7f5f6ffff640 1 -- 172.21.15.53:0/434667955 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f68032740 con 0x7f5f78132960 2024-09-22T08:10:37.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.582+0000 7f8b0effd640 1 -- 172.21.15.53:0/2705810880 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8b1401b3b0 con 0x7f8b1806e8e0 2024-09-22T08:10:37.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.582+0000 7f5f7f87f640 1 -- 172.21.15.53:0/434667955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f78132960 msgr2=0x7f5f78134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.582+0000 7f5f7f87f640 1 --2- 172.21.15.53:0/434667955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f78132960 0x7f5f78134d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f680097f0 tx=0x7f5f6802a200 comp rx=0 tx=0).stop 2024-09-22T08:10:37.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.583+0000 7f5f7f87f640 1 -- 172.21.15.53:0/434667955 shutdown_connections 2024-09-22T08:10:37.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.583+0000 7f5f7f87f640 1 --2- 172.21.15.53:0/434667955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f78132960 0x7f5f78134d50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.583+0000 7f5f7f87f640 1 -- 172.21.15.53:0/434667955 >> 172.21.15.53:0/434667955 conn(0x7f5f780a01c0 msgr2=0x7f5f780a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.583+0000 7f5f7f87f640 1 -- 172.21.15.53:0/434667955 shutdown_connections 2024-09-22T08:10:37.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.583+0000 7f5f7f87f640 1 -- 172.21.15.53:0/434667955 wait complete. 2024-09-22T08:10:37.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.584+0000 7f5f7f87f640 1 Processor -- start 2024-09-22T08:10:37.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.584+0000 7f5f7f87f640 1 -- start start 2024-09-22T08:10:37.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.585+0000 7f5f7f87f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f7806e8e0 0x7f5f7812d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.585+0000 7f5f7f87f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5f78135410 con 0x7f5f7806e8e0 2024-09-22T08:10:37.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.585+0000 7f5f7d61b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f7806e8e0 0x7f5f7812d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.585+0000 7f5f7d61b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f7806e8e0 0x7f5f7812d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48478/0 (socket says 172.21.15.53:48478) 2024-09-22T08:10:37.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.585+0000 7f5f7d61b640 1 -- 172.21.15.53:0/1679422301 learned_addr learned my addr 172.21.15.53:0/1679422301 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:37.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.586+0000 7f5f7d61b640 1 -- 172.21.15.53:0/1679422301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f78129f90 con 0x7f5f7806e8e0 2024-09-22T08:10:37.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.586+0000 7f5f7d61b640 1 --2- 172.21.15.53:0/1679422301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f7806e8e0 0x7f5f7812d450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f74001eb0 tx=0x7f5f7400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.586+0000 7f5f6dffb640 1 -- 172.21.15.53:0/1679422301 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f74007410 con 0x7f5f7806e8e0 2024-09-22T08:10:37.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.586+0000 7f5f6dffb640 1 -- 172.21.15.53:0/1679422301 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f740075b0 con 0x7f5f7806e8e0 2024-09-22T08:10:37.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.586+0000 7f5f7f87f640 1 -- 172.21.15.53:0/1679422301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7812e510 con 0x7f5f7806e8e0 2024-09-22T08:10:37.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.586+0000 7f5f6dffb640 1 -- 172.21.15.53:0/1679422301 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f74004910 con 0x7f5f7806e8e0 2024-09-22T08:10:37.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.586+0000 7f5f7f87f640 1 -- 172.21.15.53:0/1679422301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7812cf20 con 0x7f5f7806e8e0 2024-09-22T08:10:37.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.587+0000 7f5f6dffb640 1 -- 172.21.15.53:0/1679422301 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5f7401a020 con 0x7f5f7806e8e0 2024-09-22T08:10:37.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.588+0000 7f5f6dffb640 1 --2- 172.21.15.53:0/1679422301 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5f5c03e710 0x7f5f5c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:37.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.588+0000 7f5f6dffb640 1 -- 172.21.15.53:0/1679422301 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f5f740562f0 con 0x7f5f7806e8e0 2024-09-22T08:10:37.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.588+0000 7f5f7f87f640 1 -- 172.21.15.53:0/1679422301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7806ecc0 con 0x7f5f7806e8e0 2024-09-22T08:10:37.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.588+0000 7f5f7ce1a640 1 --2- 172.21.15.53:0/1679422301 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5f5c03e710 0x7f5f5c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:37.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.589+0000 7f5f7ce1a640 1 --2- 172.21.15.53:0/1679422301 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5f5c03e710 0x7f5f5c040bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5f68034000 tx=0x7f5f6802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:37.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.598+0000 7f5f6dffb640 1 -- 172.21.15.53:0/1679422301 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5f74056070 con 0x7f5f7806e8e0 2024-09-22T08:10:37.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.757+0000 7f68bcb9f640 1 -- 172.21.15.53:0/648045188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f68b8069070 con 0x7f68b809f1a0 2024-09-22T08:10:37.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.757+0000 7f689ffff640 1 -- 172.21.15.53:0/648045188 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f68a804ece0 con 0x7f68b809f1a0 2024-09-22T08:10:37.759 INFO:teuthology.orchestra.run.smithi053.stdout:42949672965 2024-09-22T08:10:37.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.760+0000 7f68bcb9f640 1 -- 172.21.15.53:0/648045188 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f68a403e740 msgr2=0x7f68a4040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.760+0000 7f68bcb9f640 1 --2- 172.21.15.53:0/648045188 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f68a403e740 0x7f68a4040c00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68ac001600 tx=0x7f68ac0079f0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.760+0000 7f68bcb9f640 1 -- 172.21.15.53:0/648045188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 msgr2=0x7f68b81c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.760+0000 7f68bcb9f640 1 --2- 172.21.15.53:0/648045188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 0x7f68b81c4230 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f68a8035040 tx=0x7f68a80046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.760+0000 7f68bcb9f640 1 -- 172.21.15.53:0/648045188 shutdown_connections 2024-09-22T08:10:37.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.760+0000 7f68bcb9f640 1 --2- 172.21.15.53:0/648045188 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f68a403e740 0x7f68a4040c00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.760+0000 7f68bcb9f640 1 --2- 172.21.15.53:0/648045188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b809f1a0 0x7f68b81c4230 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.760+0000 7f68bcb9f640 1 -- 172.21.15.53:0/648045188 >> 172.21.15.53:0/648045188 conn(0x7f68b809e030 msgr2=0x7f68b809a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.760+0000 7f68bcb9f640 1 -- 172.21.15.53:0/648045188 shutdown_connections 2024-09-22T08:10:37.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.760+0000 7f68bcb9f640 1 -- 172.21.15.53:0/648045188 wait complete. 2024-09-22T08:10:37.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.3 2024-09-22T08:10:37.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.774+0000 7f52f8b24640 1 -- 172.21.15.53:0/2236456601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f52f406ecc0 con 0x7f52f406e8e0 2024-09-22T08:10:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.774+0000 7f52e2ffd640 1 -- 172.21.15.53:0/2236456601 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52e4012e10 con 0x7f52f406e8e0 2024-09-22T08:10:37.776 INFO:teuthology.orchestra.run.smithi053.stdout:38654705668 2024-09-22T08:10:37.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.776+0000 7f8b207a0640 1 -- 172.21.15.53:0/2705810880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8b00005370 con 0x7f8b1806e8e0 2024-09-22T08:10:37.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.776+0000 7f8b0effd640 1 -- 172.21.15.53:0/2705810880 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b1401b730 con 0x7f8b1806e8e0 2024-09-22T08:10:37.778 INFO:teuthology.orchestra.run.smithi053.stdout:42949672964 2024-09-22T08:10:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.777+0000 7f52f8b24640 1 -- 172.21.15.53:0/2236456601 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f52d403e6c0 msgr2=0x7f52d4040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.777+0000 7f52f8b24640 1 --2- 172.21.15.53:0/2236456601 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f52d403e6c0 0x7f52d4040b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f52e8034000 tx=0x7f52e802e000 comp rx=0 tx=0).stop 2024-09-22T08:10:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.777+0000 7f52f8b24640 1 -- 172.21.15.53:0/2236456601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f406e8e0 msgr2=0x7f52f412be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.777+0000 7f52f8b24640 1 --2- 172.21.15.53:0/2236456601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f406e8e0 0x7f52f412be90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f52e4001eb0 tx=0x7f52e400c810 comp rx=0 tx=0).stop 2024-09-22T08:10:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.777+0000 7f52f8b24640 1 -- 172.21.15.53:0/2236456601 shutdown_connections 2024-09-22T08:10:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.777+0000 7f52f8b24640 1 --2- 172.21.15.53:0/2236456601 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f52d403e6c0 0x7f52d4040b80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.777+0000 7f52f8b24640 1 --2- 172.21.15.53:0/2236456601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f406e8e0 0x7f52f412be90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.777+0000 7f52f8b24640 1 -- 172.21.15.53:0/2236456601 >> 172.21.15.53:0/2236456601 conn(0x7f52f40a01c0 msgr2=0x7f52f4132d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.777+0000 7f52f8b24640 1 -- 172.21.15.53:0/2236456601 shutdown_connections 2024-09-22T08:10:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.777+0000 7f52f8b24640 1 -- 172.21.15.53:0/2236456601 wait complete. 2024-09-22T08:10:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.779+0000 7f8b207a0640 1 -- 172.21.15.53:0/2705810880 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8afc03e710 msgr2=0x7f8afc040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.779+0000 7f8b207a0640 1 --2- 172.21.15.53:0/2705810880 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8afc03e710 0x7f8afc040bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8b08034000 tx=0x7f8b0802e000 comp rx=0 tx=0).stop 2024-09-22T08:10:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.779+0000 7f8b207a0640 1 -- 172.21.15.53:0/2705810880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b1806e8e0 msgr2=0x7f8b1812d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.779+0000 7f8b207a0640 1 --2- 172.21.15.53:0/2705810880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b1806e8e0 0x7f8b1812d450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400c390 tx=0x7f8b1400c850 comp rx=0 tx=0).stop 2024-09-22T08:10:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.779+0000 7f8b207a0640 1 -- 172.21.15.53:0/2705810880 shutdown_connections 2024-09-22T08:10:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.779+0000 7f8b207a0640 1 --2- 172.21.15.53:0/2705810880 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8afc03e710 0x7f8afc040bd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.779+0000 7f8b207a0640 1 --2- 172.21.15.53:0/2705810880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b1806e8e0 0x7f8b1812d450 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.779+0000 7f8b207a0640 1 -- 172.21.15.53:0/2705810880 >> 172.21.15.53:0/2705810880 conn(0x7f8b180a01c0 msgr2=0x7f8b18134440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.779+0000 7f8b207a0640 1 -- 172.21.15.53:0/2705810880 shutdown_connections 2024-09-22T08:10:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.779+0000 7f8b207a0640 1 -- 172.21.15.53:0/2705810880 wait complete. 2024-09-22T08:10:37.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2024-09-22T08:10:37.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-09-22T08:10:37.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.802+0000 7f5f7f87f640 1 -- 172.21.15.53:0/1679422301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5f7806fbb0 con 0x7f5f7806e8e0 2024-09-22T08:10:37.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.803+0000 7f5f6dffb640 1 -- 172.21.15.53:0/1679422301 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f78129f90 con 0x7f5f7806e8e0 2024-09-22T08:10:37.804 INFO:teuthology.orchestra.run.smithi053.stdout:42949672964 2024-09-22T08:10:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.805+0000 7f5f7f87f640 1 -- 172.21.15.53:0/1679422301 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5f5c03e710 msgr2=0x7f5f5c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.805+0000 7f5f7f87f640 1 --2- 172.21.15.53:0/1679422301 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5f5c03e710 0x7f5f5c040bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5f68034000 tx=0x7f5f6802e000 comp rx=0 tx=0).stop 2024-09-22T08:10:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.805+0000 7f5f7f87f640 1 -- 172.21.15.53:0/1679422301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f7806e8e0 msgr2=0x7f5f7812d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.805+0000 7f5f7f87f640 1 --2- 172.21.15.53:0/1679422301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f7806e8e0 0x7f5f7812d450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f74001eb0 tx=0x7f5f7400c810 comp rx=0 tx=0).stop 2024-09-22T08:10:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.805+0000 7f5f7f87f640 1 -- 172.21.15.53:0/1679422301 shutdown_connections 2024-09-22T08:10:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.805+0000 7f5f7f87f640 1 --2- 172.21.15.53:0/1679422301 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5f5c03e710 0x7f5f5c040bd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.805+0000 7f5f7f87f640 1 --2- 172.21.15.53:0/1679422301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f7806e8e0 0x7f5f7812d450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.805+0000 7f5f7f87f640 1 -- 172.21.15.53:0/1679422301 >> 172.21.15.53:0/1679422301 conn(0x7f5f780a01c0 msgr2=0x7f5f78132d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.805+0000 7f5f7f87f640 1 -- 172.21.15.53:0/1679422301 shutdown_connections 2024-09-22T08:10:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:37.805+0000 7f5f7f87f640 1 -- 172.21.15.53:0/1679422301 wait complete. 2024-09-22T08:10:37.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.2 2024-09-22T08:10:38.774 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T08:10:38.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T08:10:38.795 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T08:10:38.818 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T08:10:38.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.893+0000 7f75ba510640 1 Processor -- start 2024-09-22T08:10:38.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.893+0000 7f75ba510640 1 -- start start 2024-09-22T08:10:38.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.893+0000 7f75ba510640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75b406e8e0 0x7f75b406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.894+0000 7f75ba510640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b406ff50 con 0x7f75b406f200 2024-09-22T08:10:38.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.894+0000 7f75ba510640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f75b4099c10 con 0x7f75b406e8e0 2024-09-22T08:10:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.894+0000 7f75b3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75b406e8e0 0x7f75b406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.894+0000 7f75b37fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f75b406f200 0x7f75b412f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46114/0 (socket says 172.21.15.53:46114) 2024-09-22T08:10:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.894+0000 7f75b37fe640 1 -- 172.21.15.53:0/3589908285 learned_addr learned my addr 172.21.15.53:0/3589908285 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.894+0000 7f75b3fff640 1 -- 172.21.15.53:0/3589908285 >> v1:172.21.15.53:6789/0 conn(0x7f75b406f200 legacy=0x7f75b412f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:38.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.894+0000 7f75b3fff640 1 -- 172.21.15.53:0/3589908285 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b4099710 con 0x7f75b406e8e0 2024-09-22T08:10:38.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.895+0000 7f75b3fff640 1 --2- 172.21.15.53:0/3589908285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 0x7f75b406ecc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009720 tx=0x7f75a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee6babf80425b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.895+0000 7f75b2ffd640 1 -- 172.21.15.53:0/3589908285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a4037070 con 0x7f75b406e8e0 2024-09-22T08:10:38.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.895+0000 7f75b2ffd640 1 -- 172.21.15.53:0/3589908285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a402ae20 con 0x7f75b406e8e0 2024-09-22T08:10:38.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.895+0000 7f75b2ffd640 1 -- 172.21.15.53:0/3589908285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a4032590 con 0x7f75b406e8e0 2024-09-22T08:10:38.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.896+0000 7f75ba510640 1 -- 172.21.15.53:0/3589908285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 msgr2=0x7f75b406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:38.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.896+0000 7f75ba510640 1 --2- 172.21.15.53:0/3589908285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 0x7f75b406ecc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009720 tx=0x7f75a402a1a0 comp rx=0 tx=0).stop 2024-09-22T08:10:38.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.896+0000 7f75ba510640 1 -- 172.21.15.53:0/3589908285 shutdown_connections 2024-09-22T08:10:38.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.896+0000 7f75ba510640 1 --2- 172.21.15.53:0/3589908285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 0x7f75b406ecc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:38.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.896+0000 7f75ba510640 1 -- 172.21.15.53:0/3589908285 >> 172.21.15.53:0/3589908285 conn(0x7f75b40a01c0 msgr2=0x7f75b40a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:38.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.896+0000 7f75ba510640 1 -- 172.21.15.53:0/3589908285 shutdown_connections 2024-09-22T08:10:38.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.896+0000 7f75ba510640 1 -- 172.21.15.53:0/3589908285 wait complete. 2024-09-22T08:10:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.898+0000 7f75ba510640 1 Processor -- start 2024-09-22T08:10:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.898+0000 7f75ba510640 1 -- start start 2024-09-22T08:10:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.899+0000 7f75ba510640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 0x7f75b41c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.899+0000 7f75ba510640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f75b41300f0 con 0x7f75b406e8e0 2024-09-22T08:10:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.899+0000 7f75b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 0x7f75b41c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.899+0000 7f75b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 0x7f75b41c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50986/0 (socket says 172.21.15.53:50986) 2024-09-22T08:10:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.899+0000 7f75b3fff640 1 -- 172.21.15.53:0/926508833 learned_addr learned my addr 172.21.15.53:0/926508833 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.899+0000 7f75b3fff640 1 -- 172.21.15.53:0/926508833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b408ea60 con 0x7f75b406e8e0 2024-09-22T08:10:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.899+0000 7f75b3fff640 1 --2- 172.21.15.53:0/926508833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 0x7f75b41c4780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75a402a1e0 tx=0x7f75a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.900+0000 7f75b0ff9640 1 -- 172.21.15.53:0/926508833 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a4042070 con 0x7f75b406e8e0 2024-09-22T08:10:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.900+0000 7f75b0ff9640 1 -- 172.21.15.53:0/926508833 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a403e590 con 0x7f75b406e8e0 2024-09-22T08:10:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.900+0000 7f75ba510640 1 -- 172.21.15.53:0/926508833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b408f4b0 con 0x7f75b406e8e0 2024-09-22T08:10:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.900+0000 7f75b0ff9640 1 -- 172.21.15.53:0/926508833 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a4037040 con 0x7f75b406e8e0 2024-09-22T08:10:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.900+0000 7f75ba510640 1 -- 172.21.15.53:0/926508833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b41c4ea0 con 0x7f75b406e8e0 2024-09-22T08:10:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.901+0000 7f75b0ff9640 1 -- 172.21.15.53:0/926508833 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f75a4045070 con 0x7f75b406e8e0 2024-09-22T08:10:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.901+0000 7f75ba510640 1 -- 172.21.15.53:0/926508833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b408e380 con 0x7f75b406e8e0 2024-09-22T08:10:38.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.901+0000 7f75b0ff9640 1 --2- 172.21.15.53:0/926508833 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f75a003e740 0x7f75a0040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.901+0000 7f75b0ff9640 1 -- 172.21.15.53:0/926508833 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f75a40737e0 con 0x7f75b406e8e0 2024-09-22T08:10:38.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.902+0000 7f75b37fe640 1 --2- 172.21.15.53:0/926508833 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f75a003e740 0x7f75a0040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.902+0000 7f75b37fe640 1 --2- 172.21.15.53:0/926508833 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f75a003e740 0x7f75a0040c00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75a8007fd0 tx=0x7f75a8007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.910+0000 7f75b0ff9640 1 -- 172.21.15.53:0/926508833 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f75a403c430 con 0x7f75b406e8e0 2024-09-22T08:10:38.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.932+0000 7f497fd89640 1 Processor -- start 2024-09-22T08:10:38.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.932+0000 7f497fd89640 1 -- start start 2024-09-22T08:10:38.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.932+0000 7f497fd89640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4978132960 0x7f4978134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.932+0000 7f497fd89640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497806ff50 con 0x7f497806e8e0 2024-09-22T08:10:38.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.932+0000 7f497fd89640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4978099c10 con 0x7f4978132960 2024-09-22T08:10:38.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.932+0000 7f497db25640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f497806e8e0 0x7f497806ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46120/0 (socket says 172.21.15.53:46120) 2024-09-22T08:10:38.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.932+0000 7f497d324640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4978132960 0x7f4978134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.932+0000 7f497db25640 1 -- 172.21.15.53:0/1421854525 learned_addr learned my addr 172.21.15.53:0/1421854525 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:38.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.933+0000 7f497d324640 1 -- 172.21.15.53:0/1421854525 >> v1:172.21.15.53:6789/0 conn(0x7f497806e8e0 legacy=0x7f497806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:38.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.933+0000 7f497d324640 1 -- 172.21.15.53:0/1421854525 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497806f3d0 con 0x7f4978132960 2024-09-22T08:10:38.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.933+0000 7fd78b4ed640 1 Processor -- start 2024-09-22T08:10:38.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7fd78b4ed640 1 -- start start 2024-09-22T08:10:38.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7f497d324640 1 --2- 172.21.15.53:0/1421854525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4978132960 0x7f4978134d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4968009720 tx=0x7f496802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3438fd724260257 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7fe6890e6640 1 Processor -- start 2024-09-22T08:10:38.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7fd78b4ed640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd78406e8e0 0x7fd78406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7fe6890e6640 1 -- start start 2024-09-22T08:10:38.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7f497cb23640 1 -- 172.21.15.53:0/1421854525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4968037070 con 0x7f4978132960 2024-09-22T08:10:38.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7f497cb23640 1 -- 172.21.15.53:0/1421854525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496802ad90 con 0x7f4978132960 2024-09-22T08:10:38.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7f497cb23640 1 -- 172.21.15.53:0/1421854525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4968032590 con 0x7f4978132960 2024-09-22T08:10:38.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7fd78b4ed640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78406ff50 con 0x7fd78406f200 2024-09-22T08:10:38.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7fd789289640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd78406e8e0 0x7fd78406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7fd78b4ed640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd784099c10 con 0x7fd78406e8e0 2024-09-22T08:10:38.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7fd789289640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd78406e8e0 0x7fd78406ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51004/0 (socket says 172.21.15.53:51004) 2024-09-22T08:10:38.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.934+0000 7fd789289640 1 -- 172.21.15.53:0/106666318 learned_addr learned my addr 172.21.15.53:0/106666318 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:38.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fe6890e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe684132960 0x7fe684134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fd789289640 1 -- 172.21.15.53:0/106666318 >> v1:172.21.15.53:6789/0 conn(0x7fd78406f200 legacy=0x7fd78412f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:38.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fe682d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe68406e8e0 0x7fe68406ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46126/0 (socket says 172.21.15.53:46126) 2024-09-22T08:10:38.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fe682d9d640 1 -- 172.21.15.53:0/3737467359 learned_addr learned my addr 172.21.15.53:0/3737467359 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:38.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fe6890e6640 1 -- 172.21.15.53:0/3737467359 --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe68406ff50 con 0x7fe68406e8e0 2024-09-22T08:10:38.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fd789289640 1 -- 172.21.15.53:0/106666318 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd784099710 con 0x7fd78406e8e0 2024-09-22T08:10:38.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fe6890e6640 1 -- 172.21.15.53:0/3737467359 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe684099c10 con 0x7fe684132960 2024-09-22T08:10:38.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fe68259c640 1 --2- 172.21.15.53:0/3737467359 >> v2:172.21.15.53:3300/0 conn(0x7fe684132960 0x7fe684134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7f497fd89640 1 -- 172.21.15.53:0/1421854525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4978132960 msgr2=0x7f4978134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:38.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7f497fd89640 1 --2- 172.21.15.53:0/1421854525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4978132960 0x7f4978134d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4968009720 tx=0x7f496802a110 comp rx=0 tx=0).stop 2024-09-22T08:10:38.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fe681d9b640 1 -- 172.21.15.53:0/3737467359 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854799395 0 0) 0x7fe68406ff50 con 0x7fe68406e8e0 2024-09-22T08:10:38.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fe681d9b640 1 -- 172.21.15.53:0/3737467359 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe66c003520 con 0x7fe68406e8e0 2024-09-22T08:10:38.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fe68259c640 1 -- 172.21.15.53:0/3737467359 >> v1:172.21.15.53:6789/0 conn(0x7fe68406e8e0 legacy=0x7fe68406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:38.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7fe68259c640 1 -- 172.21.15.53:0/3737467359 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68406f3d0 con 0x7fe684132960 2024-09-22T08:10:38.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7f497fd89640 1 -- 172.21.15.53:0/1421854525 shutdown_connections 2024-09-22T08:10:38.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7f497fd89640 1 --2- 172.21.15.53:0/1421854525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4978132960 0x7f4978134d50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:38.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.935+0000 7f497fd89640 1 -- 172.21.15.53:0/1421854525 >> 172.21.15.53:0/1421854525 conn(0x7f49780a01c0 msgr2=0x7f49780a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:38.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.936+0000 7fd789289640 1 --2- 172.21.15.53:0/106666318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 0x7fd78406ecc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7800097f0 tx=0x7fd78002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971f1fb41c3aac96 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.936+0000 7f497fd89640 1 -- 172.21.15.53:0/1421854525 shutdown_connections 2024-09-22T08:10:38.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.936+0000 7fd77bfff640 1 -- 172.21.15.53:0/106666318 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd780037070 con 0x7fd78406e8e0 2024-09-22T08:10:38.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.936+0000 7f497fd89640 1 -- 172.21.15.53:0/1421854525 wait complete. 2024-09-22T08:10:38.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.936+0000 7fd77bfff640 1 -- 172.21.15.53:0/106666318 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd780032440 con 0x7fd78406e8e0 2024-09-22T08:10:38.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.936+0000 7fd77bfff640 1 -- 172.21.15.53:0/106666318 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd780032740 con 0x7fd78406e8e0 2024-09-22T08:10:38.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fe68259c640 1 --2- 172.21.15.53:0/3737467359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684132960 0x7fe684134d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe678009720 tx=0x7fe67802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac713eabcc0010 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fd78b4ed640 1 -- 172.21.15.53:0/106666318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 msgr2=0x7fd78406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:38.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fd78b4ed640 1 --2- 172.21.15.53:0/106666318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 0x7fd78406ecc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7800097f0 tx=0x7fd78002a270 comp rx=0 tx=0).stop 2024-09-22T08:10:38.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fd78b4ed640 1 -- 172.21.15.53:0/106666318 shutdown_connections 2024-09-22T08:10:38.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fd78b4ed640 1 --2- 172.21.15.53:0/106666318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 0x7fd78406ecc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:38.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fe681d9b640 1 -- 172.21.15.53:0/3737467359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe678037070 con 0x7fe684132960 2024-09-22T08:10:38.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fe681d9b640 1 -- 172.21.15.53:0/3737467359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67802ad90 con 0x7fe684132960 2024-09-22T08:10:38.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fe681d9b640 1 -- 172.21.15.53:0/3737467359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe678032590 con 0x7fe684132960 2024-09-22T08:10:38.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fd78b4ed640 1 -- 172.21.15.53:0/106666318 >> 172.21.15.53:0/106666318 conn(0x7fd7840a01c0 msgr2=0x7fd7840a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:38.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fd78b4ed640 1 -- 172.21.15.53:0/106666318 shutdown_connections 2024-09-22T08:10:38.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7fd78b4ed640 1 -- 172.21.15.53:0/106666318 wait complete. 2024-09-22T08:10:38.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7f497fd89640 1 Processor -- start 2024-09-22T08:10:38.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.937+0000 7f497fd89640 1 -- start start 2024-09-22T08:10:38.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7f497fd89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497806e8e0 0x7f49781c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7f497fd89640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4978135410 con 0x7f497806e8e0 2024-09-22T08:10:38.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7fe6890e6640 1 -- 172.21.15.53:0/3737467359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684132960 msgr2=0x7fe684134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:38.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7fe6890e6640 1 --2- 172.21.15.53:0/3737467359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684132960 0x7fe684134d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe678009720 tx=0x7fe67802a110 comp rx=0 tx=0).stop 2024-09-22T08:10:38.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7f497db25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497806e8e0 0x7f49781c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7f497db25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497806e8e0 0x7f49781c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51018/0 (socket says 172.21.15.53:51018) 2024-09-22T08:10:38.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7fe6890e6640 1 -- 172.21.15.53:0/3737467359 shutdown_connections 2024-09-22T08:10:38.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7fe6890e6640 1 --2- 172.21.15.53:0/3737467359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe684132960 0x7fe684134d50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:38.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7f497db25640 1 -- 172.21.15.53:0/4077247709 learned_addr learned my addr 172.21.15.53:0/4077247709 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:38.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7fe6890e6640 1 -- 172.21.15.53:0/3737467359 >> 172.21.15.53:0/3737467359 conn(0x7fe6840a01c0 msgr2=0x7fe6840a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:38.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7fe6890e6640 1 -- 172.21.15.53:0/3737467359 shutdown_connections 2024-09-22T08:10:38.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7fe6890e6640 1 -- 172.21.15.53:0/3737467359 wait complete. 2024-09-22T08:10:38.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7fd78b4ed640 1 Processor -- start 2024-09-22T08:10:38.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7fd78b4ed640 1 -- start start 2024-09-22T08:10:38.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.938+0000 7f497db25640 1 -- 172.21.15.53:0/4077247709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497812f420 con 0x7f497806e8e0 2024-09-22T08:10:38.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7f497db25640 1 --2- 172.21.15.53:0/4077247709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497806e8e0 0x7f49781c4730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4974001eb0 tx=0x7f497400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7f496e7fc640 1 -- 172.21.15.53:0/4077247709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4974017070 con 0x7f497806e8e0 2024-09-22T08:10:38.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7f496e7fc640 1 -- 172.21.15.53:0/4077247709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4974005c10 con 0x7f497806e8e0 2024-09-22T08:10:38.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7f497fd89640 1 -- 172.21.15.53:0/4077247709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497812e870 con 0x7f497806e8e0 2024-09-22T08:10:38.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7f496e7fc640 1 -- 172.21.15.53:0/4077247709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49740070d0 con 0x7f497806e8e0 2024-09-22T08:10:38.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7f497fd89640 1 -- 172.21.15.53:0/4077247709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49781c4e50 con 0x7f497806e8e0 2024-09-22T08:10:38.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7fd78b4ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 0x7fd7841c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7fd78b4ed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd7841300f0 con 0x7fd78406e8e0 2024-09-22T08:10:38.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7fd789289640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 0x7fd7841c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7fd789289640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 0x7fd7841c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51034/0 (socket says 172.21.15.53:51034) 2024-09-22T08:10:38.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.939+0000 7fd789289640 1 -- 172.21.15.53:0/2246516883 learned_addr learned my addr 172.21.15.53:0/2246516883 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:38.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.940+0000 7fd789289640 1 -- 172.21.15.53:0/2246516883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd784098e60 con 0x7fd78406e8e0 2024-09-22T08:10:38.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.940+0000 7fe6890e6640 1 Processor -- start 2024-09-22T08:10:38.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.940+0000 7fd789289640 1 --2- 172.21.15.53:0/2246516883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 0x7fd7841c4780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7800090b0 tx=0x7fd7800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.940+0000 7fe6890e6640 1 -- start start 2024-09-22T08:10:38.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.940+0000 7f497fd89640 1 -- 172.21.15.53:0/4077247709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49780a2f90 con 0x7f497806e8e0 2024-09-22T08:10:38.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.940+0000 7fd779ffb640 1 -- 172.21.15.53:0/2246516883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd780041070 con 0x7fd78406e8e0 2024-09-22T08:10:38.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.940+0000 7fd779ffb640 1 -- 172.21.15.53:0/2246516883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd780030920 con 0x7fd78406e8e0 2024-09-22T08:10:38.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.940+0000 7fd779ffb640 1 -- 172.21.15.53:0/2246516883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd780037040 con 0x7fd78406e8e0 2024-09-22T08:10:38.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.940+0000 7fd78b4ed640 1 -- 172.21.15.53:0/2246516883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78408e210 con 0x7fd78406e8e0 2024-09-22T08:10:38.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7fd78b4ed640 1 -- 172.21.15.53:0/2246516883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78408f520 con 0x7fd78406e8e0 2024-09-22T08:10:38.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7fe6890e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe68406e8e0 0x7fe6841c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7fe6890e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe684135410 con 0x7fe68406e8e0 2024-09-22T08:10:38.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7f496e7fc640 1 -- 172.21.15.53:0/4077247709 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f497401a070 con 0x7f497806e8e0 2024-09-22T08:10:38.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7fe682d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe68406e8e0 0x7fe6841c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7fe682d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe68406e8e0 0x7fe6841c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51046/0 (socket says 172.21.15.53:51046) 2024-09-22T08:10:38.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7fe682d9d640 1 -- 172.21.15.53:0/3701830063 learned_addr learned my addr 172.21.15.53:0/3701830063 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:38.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7fe682d9d640 1 -- 172.21.15.53:0/3701830063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68412f420 con 0x7fe68406e8e0 2024-09-22T08:10:38.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7f496e7fc640 1 --2- 172.21.15.53:0/4077247709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f495c03e760 0x7f495c040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7f496e7fc640 1 -- 172.21.15.53:0/4077247709 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f4974052100 con 0x7f497806e8e0 2024-09-22T08:10:38.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.941+0000 7fe682d9d640 1 --2- 172.21.15.53:0/3701830063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe68406e8e0 0x7fe6841c4730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe67400c380 tx=0x7fe67400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.942+0000 7f497d324640 1 --2- 172.21.15.53:0/4077247709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f495c03e760 0x7f495c040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.942+0000 7fd779ffb640 1 -- 172.21.15.53:0/2246516883 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd780044070 con 0x7fd78406e8e0 2024-09-22T08:10:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.942+0000 7fd78b4ed640 1 -- 172.21.15.53:0/2246516883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78408fe50 con 0x7fd78406e8e0 2024-09-22T08:10:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.942+0000 7f497d324640 1 --2- 172.21.15.53:0/4077247709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f495c03e760 0x7f495c040c20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4968034000 tx=0x7f496802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.942+0000 7fd779ffb640 1 --2- 172.21.15.53:0/2246516883 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd76803e760 0x7fd768040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.942+0000 7fd779ffb640 1 -- 172.21.15.53:0/2246516883 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd780073b90 con 0x7fd78406e8e0 2024-09-22T08:10:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.943+0000 7fd788a88640 1 --2- 172.21.15.53:0/2246516883 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd76803e760 0x7fd768040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.943+0000 7fd788a88640 1 --2- 172.21.15.53:0/2246516883 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd76803e760 0x7fd768040c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd774001600 tx=0x7fd7740079f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.946+0000 7fe66b7fe640 1 -- 172.21.15.53:0/3701830063 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6740074d0 con 0x7fe68406e8e0 2024-09-22T08:10:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.946+0000 7fe6890e6640 1 -- 172.21.15.53:0/3701830063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68412e870 con 0x7fe68406e8e0 2024-09-22T08:10:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.946+0000 7fe6890e6640 1 -- 172.21.15.53:0/3701830063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6841c4e50 con 0x7fe68406e8e0 2024-09-22T08:10:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.946+0000 7f496e7fc640 1 -- 172.21.15.53:0/4077247709 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f497401ad80 con 0x7f497806e8e0 2024-09-22T08:10:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.947+0000 7fe6890e6640 1 -- 172.21.15.53:0/3701830063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6840a2f90 con 0x7fe68406e8e0 2024-09-22T08:10:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.950+0000 7fe66b7fe640 1 -- 172.21.15.53:0/3701830063 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe674007670 con 0x7fe68406e8e0 2024-09-22T08:10:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.951+0000 7fe66b7fe640 1 -- 172.21.15.53:0/3701830063 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe674004910 con 0x7fe68406e8e0 2024-09-22T08:10:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.951+0000 7fd779ffb640 1 -- 172.21.15.53:0/2246516883 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd78408f520 con 0x7fd78406e8e0 2024-09-22T08:10:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.952+0000 7fe66b7fe640 1 -- 172.21.15.53:0/3701830063 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe674011070 con 0x7fe68406e8e0 2024-09-22T08:10:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.952+0000 7fe66b7fe640 1 --2- 172.21.15.53:0/3701830063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe67003e670 0x7fe670040b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.952+0000 7fe66b7fe640 1 -- 172.21.15.53:0/3701830063 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fe6740530b0 con 0x7fe68406e8e0 2024-09-22T08:10:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.953+0000 7fe68259c640 1 --2- 172.21.15.53:0/3701830063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe67003e670 0x7fe670040b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.953+0000 7fe68259c640 1 --2- 172.21.15.53:0/3701830063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe67003e670 0x7fe670040b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe678034000 tx=0x7fe67802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:38.956+0000 7fe66b7fe640 1 -- 172.21.15.53:0/3701830063 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe674012d90 con 0x7fe68406e8e0 2024-09-22T08:10:39.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.107+0000 7f75ba510640 1 -- 172.21.15.53:0/926508833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f75b406ecc0 con 0x7f75b406e8e0 2024-09-22T08:10:39.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.108+0000 7f75b0ff9640 1 -- 172.21.15.53:0/926508833 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f75a403bdf0 con 0x7f75b406e8e0 2024-09-22T08:10:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:42949672966 2024-09-22T08:10:39.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.110+0000 7f75ba510640 1 -- 172.21.15.53:0/926508833 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f75a003e740 msgr2=0x7f75a0040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.110+0000 7f75ba510640 1 --2- 172.21.15.53:0/926508833 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f75a003e740 0x7f75a0040c00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75a8007fd0 tx=0x7f75a8007aa0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.110+0000 7f75ba510640 1 -- 172.21.15.53:0/926508833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 msgr2=0x7f75b41c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.110+0000 7f75ba510640 1 --2- 172.21.15.53:0/926508833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 0x7f75b41c4780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75a402a1e0 tx=0x7f75a40046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.110+0000 7f75ba510640 1 -- 172.21.15.53:0/926508833 shutdown_connections 2024-09-22T08:10:39.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.110+0000 7f75ba510640 1 --2- 172.21.15.53:0/926508833 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f75a003e740 0x7f75a0040c00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.110+0000 7f75ba510640 1 --2- 172.21.15.53:0/926508833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75b406e8e0 0x7f75b41c4780 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.110+0000 7f75ba510640 1 -- 172.21.15.53:0/926508833 >> 172.21.15.53:0/926508833 conn(0x7f75b40a01c0 msgr2=0x7f75b409dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:39.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.110+0000 7f75ba510640 1 -- 172.21.15.53:0/926508833 shutdown_connections 2024-09-22T08:10:39.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.110+0000 7f75ba510640 1 -- 172.21.15.53:0/926508833 wait complete. 2024-09-22T08:10:39.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2024-09-22T08:10:39.124 DEBUG:teuthology.parallel:result is None 2024-09-22T08:10:39.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.137+0000 7f497fd89640 1 -- 172.21.15.53:0/4077247709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f497812f1e0 con 0x7f497806e8e0 2024-09-22T08:10:39.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.138+0000 7f496e7fc640 1 -- 172.21.15.53:0/4077247709 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f497401b8d0 con 0x7f497806e8e0 2024-09-22T08:10:39.139 INFO:teuthology.orchestra.run.smithi053.stdout:42949672965 2024-09-22T08:10:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.140+0000 7f497fd89640 1 -- 172.21.15.53:0/4077247709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f495c03e760 msgr2=0x7f495c040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.140+0000 7f497fd89640 1 --2- 172.21.15.53:0/4077247709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f495c03e760 0x7f495c040c20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4968034000 tx=0x7f496802e000 comp rx=0 tx=0).stop 2024-09-22T08:10:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.140+0000 7f497fd89640 1 -- 172.21.15.53:0/4077247709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497806e8e0 msgr2=0x7f49781c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.140+0000 7f497fd89640 1 --2- 172.21.15.53:0/4077247709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497806e8e0 0x7f49781c4730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4974001eb0 tx=0x7f497400c810 comp rx=0 tx=0).stop 2024-09-22T08:10:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.140+0000 7f497fd89640 1 -- 172.21.15.53:0/4077247709 shutdown_connections 2024-09-22T08:10:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.140+0000 7f497fd89640 1 --2- 172.21.15.53:0/4077247709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f495c03e760 0x7f495c040c20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.140+0000 7f497fd89640 1 --2- 172.21.15.53:0/4077247709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f497806e8e0 0x7f49781c4730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.140+0000 7f497fd89640 1 -- 172.21.15.53:0/4077247709 >> 172.21.15.53:0/4077247709 conn(0x7f49780a01c0 msgr2=0x7f497809d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.140+0000 7f497fd89640 1 -- 172.21.15.53:0/4077247709 shutdown_connections 2024-09-22T08:10:39.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.140+0000 7f497fd89640 1 -- 172.21.15.53:0/4077247709 wait complete. 2024-09-22T08:10:39.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.142+0000 7fd78b4ed640 1 -- 172.21.15.53:0/2246516883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd78409fa90 con 0x7fd78406e8e0 2024-09-22T08:10:39.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.142+0000 7fd779ffb640 1 -- 172.21.15.53:0/2246516883 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd780044c60 con 0x7fd78406e8e0 2024-09-22T08:10:39.144 INFO:teuthology.orchestra.run.smithi053.stdout:38654705670 2024-09-22T08:10:39.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.146+0000 7fe6890e6640 1 -- 172.21.15.53:0/3701830063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe68412f1e0 con 0x7fe68406e8e0 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fd78b4ed640 1 -- 172.21.15.53:0/2246516883 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd76803e760 msgr2=0x7fd768040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fd78b4ed640 1 --2- 172.21.15.53:0/2246516883 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd76803e760 0x7fd768040c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd774001600 tx=0x7fd7740079f0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fd78b4ed640 1 -- 172.21.15.53:0/2246516883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 msgr2=0x7fd7841c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fd78b4ed640 1 --2- 172.21.15.53:0/2246516883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 0x7fd7841c4780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd7800090b0 tx=0x7fd7800046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fd78b4ed640 1 -- 172.21.15.53:0/2246516883 shutdown_connections 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fd78b4ed640 1 --2- 172.21.15.53:0/2246516883 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd76803e760 0x7fd768040c20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fd78b4ed640 1 --2- 172.21.15.53:0/2246516883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd78406e8e0 0x7fd7841c4780 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fd78b4ed640 1 -- 172.21.15.53:0/2246516883 >> 172.21.15.53:0/2246516883 conn(0x7fd7840a01c0 msgr2=0x7fd78409adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fd78b4ed640 1 -- 172.21.15.53:0/2246516883 shutdown_connections 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fd78b4ed640 1 -- 172.21.15.53:0/2246516883 wait complete. 2024-09-22T08:10:39.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.147+0000 7fe66b7fe640 1 -- 172.21.15.53:0/3701830063 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe674010d70 con 0x7fe68406e8e0 2024-09-22T08:10:39.150 INFO:teuthology.orchestra.run.smithi053.stdout:42949672965 2024-09-22T08:10:39.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.149+0000 7fe6890e6640 1 -- 172.21.15.53:0/3701830063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe67003e670 msgr2=0x7fe670040b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.149+0000 7fe6890e6640 1 --2- 172.21.15.53:0/3701830063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe67003e670 0x7fe670040b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe678034000 tx=0x7fe67802e000 comp rx=0 tx=0).stop 2024-09-22T08:10:39.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.149+0000 7fe6890e6640 1 -- 172.21.15.53:0/3701830063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe68406e8e0 msgr2=0x7fe6841c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.149+0000 7fe6890e6640 1 --2- 172.21.15.53:0/3701830063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe68406e8e0 0x7fe6841c4730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe67400c380 tx=0x7fe67400c840 comp rx=0 tx=0).stop 2024-09-22T08:10:39.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.149+0000 7fe6890e6640 1 -- 172.21.15.53:0/3701830063 shutdown_connections 2024-09-22T08:10:39.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.149+0000 7fe6890e6640 1 --2- 172.21.15.53:0/3701830063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe67003e670 0x7fe670040b30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.149+0000 7fe6890e6640 1 --2- 172.21.15.53:0/3701830063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe68406e8e0 0x7fe6841c4730 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.149+0000 7fe6890e6640 1 -- 172.21.15.53:0/3701830063 >> 172.21.15.53:0/3701830063 conn(0x7fe6840a01c0 msgr2=0x7fe68409d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:39.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.149+0000 7fe6890e6640 1 -- 172.21.15.53:0/3701830063 shutdown_connections 2024-09-22T08:10:39.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.149+0000 7fe6890e6640 1 -- 172.21.15.53:0/3701830063 wait complete. 2024-09-22T08:10:39.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.1 2024-09-22T08:10:39.156 DEBUG:teuthology.parallel:result is None 2024-09-22T08:10:39.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-22T08:10:39.162 DEBUG:teuthology.parallel:result is None 2024-09-22T08:10:39.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.2 2024-09-22T08:10:39.162 DEBUG:teuthology.parallel:result is None 2024-09-22T08:10:39.163 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T08:10:39.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:10:39.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.302+0000 7fbe09aa3640 1 Processor -- start 2024-09-22T08:10:39.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.302+0000 7fbe09aa3640 1 -- start start 2024-09-22T08:10:39.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.303+0000 7fbe09aa3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbe0406e8e0 0x7fbe0406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:39.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.303+0000 7fbe09aa3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0406ff50 con 0x7fbe0406f200 2024-09-22T08:10:39.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.303+0000 7fbe09aa3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbe04099c10 con 0x7fbe0406e8e0 2024-09-22T08:10:39.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.303+0000 7fbe037fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbe0406e8e0 0x7fbe0406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:39.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.303+0000 7fbe02ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbe0406f200 0x7fbe0412f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46132/0 (socket says 172.21.15.53:46132) 2024-09-22T08:10:39.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.303+0000 7fbe02ffd640 1 -- 172.21.15.53:0/135578962 learned_addr learned my addr 172.21.15.53:0/135578962 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:39.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.303+0000 7fbe037fe640 1 -- 172.21.15.53:0/135578962 >> v1:172.21.15.53:6789/0 conn(0x7fbe0406f200 legacy=0x7fbe0412f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.303+0000 7fbe037fe640 1 -- 172.21.15.53:0/135578962 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe04099710 con 0x7fbe0406e8e0 2024-09-22T08:10:39.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.303+0000 7fbe027fc640 1 -- 172.21.15.53:0/135578962 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045923314 0 0) 0x7fbe0406ff50 con 0x7fbe0406f200 2024-09-22T08:10:39.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.304+0000 7fbe037fe640 1 --2- 172.21.15.53:0/135578962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 0x7fbe0406ecc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009720 tx=0x7fbdf402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd232c582bdeea48 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:39.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.304+0000 7fbe027fc640 1 -- 172.21.15.53:0/135578962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf4037070 con 0x7fbe0406e8e0 2024-09-22T08:10:39.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.304+0000 7fbe027fc640 1 -- 172.21.15.53:0/135578962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf402ae20 con 0x7fbe0406e8e0 2024-09-22T08:10:39.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.304+0000 7fbe027fc640 1 -- 172.21.15.53:0/135578962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf4032590 con 0x7fbe0406e8e0 2024-09-22T08:10:39.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.305+0000 7fbe09aa3640 1 -- 172.21.15.53:0/135578962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 msgr2=0x7fbe0406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.305+0000 7fbe09aa3640 1 --2- 172.21.15.53:0/135578962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 0x7fbe0406ecc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009720 tx=0x7fbdf402a1a0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.305+0000 7fbe09aa3640 1 -- 172.21.15.53:0/135578962 shutdown_connections 2024-09-22T08:10:39.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.305+0000 7fbe09aa3640 1 --2- 172.21.15.53:0/135578962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 0x7fbe0406ecc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.305+0000 7fbe09aa3640 1 -- 172.21.15.53:0/135578962 >> 172.21.15.53:0/135578962 conn(0x7fbe040a01c0 msgr2=0x7fbe040a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:39.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.305+0000 7fbe09aa3640 1 -- 172.21.15.53:0/135578962 shutdown_connections 2024-09-22T08:10:39.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.305+0000 7fbe09aa3640 1 -- 172.21.15.53:0/135578962 wait complete. 2024-09-22T08:10:39.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.305+0000 7fbe09aa3640 1 Processor -- start 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.306+0000 7fbe09aa3640 1 -- start start 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.306+0000 7fbe09aa3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 0x7fbe041c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.306+0000 7fbe09aa3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041300f0 con 0x7fbe0406e8e0 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.306+0000 7fbe037fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 0x7fbe041c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.306+0000 7fbe037fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 0x7fbe041c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51064/0 (socket says 172.21.15.53:51064) 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.306+0000 7fbe037fe640 1 -- 172.21.15.53:0/3096690714 learned_addr learned my addr 172.21.15.53:0/3096690714 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.306+0000 7fbe037fe640 1 -- 172.21.15.53:0/3096690714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0408eb60 con 0x7fbe0406e8e0 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.306+0000 7fbe037fe640 1 --2- 172.21.15.53:0/3096690714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 0x7fbe041c4780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4035040 tx=0x7fbdf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.307+0000 7fbdebfff640 1 -- 172.21.15.53:0/3096690714 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf4037040 con 0x7fbe0406e8e0 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.307+0000 7fbdebfff640 1 -- 172.21.15.53:0/3096690714 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf4004160 con 0x7fbe0406e8e0 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.307+0000 7fbe09aa3640 1 -- 172.21.15.53:0/3096690714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe041c4cc0 con 0x7fbe0406e8e0 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.307+0000 7fbdebfff640 1 -- 172.21.15.53:0/3096690714 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf4004440 con 0x7fbe0406e8e0 2024-09-22T08:10:39.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.307+0000 7fbe09aa3640 1 -- 172.21.15.53:0/3096690714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe041c5180 con 0x7fbe0406e8e0 2024-09-22T08:10:39.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.308+0000 7fbdebfff640 1 -- 172.21.15.53:0/3096690714 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbdf403a040 con 0x7fbe0406e8e0 2024-09-22T08:10:39.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.308+0000 7fbe09aa3640 1 -- 172.21.15.53:0/3096690714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0409c980 con 0x7fbe0406e8e0 2024-09-22T08:10:39.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.308+0000 7fbdebfff640 1 --2- 172.21.15.53:0/3096690714 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbdf003e6c0 0x7fbdf0040b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:39.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.308+0000 7fbdebfff640 1 -- 172.21.15.53:0/3096690714 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fbdf40734f0 con 0x7fbe0406e8e0 2024-09-22T08:10:39.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.308+0000 7fbe02ffd640 1 --2- 172.21.15.53:0/3096690714 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbdf003e6c0 0x7fbdf0040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:39.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.309+0000 7fbe02ffd640 1 --2- 172.21.15.53:0/3096690714 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbdf003e6c0 0x7fbdf0040b80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8000c00 tx=0x7fbdf80078d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:39.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.312+0000 7fbdebfff640 1 -- 172.21.15.53:0/3096690714 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe0409c980 con 0x7fbe0406e8e0 2024-09-22T08:10:39.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.496+0000 7fbe09aa3640 1 -- 172.21.15.53:0/3096690714 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe04129f90 con 0x7fbdf003e6c0 2024-09-22T08:10:39.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.498+0000 7fbdebfff640 1 -- 172.21.15.53:0/3096690714 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32194 (secure 0 0 0) 0x7fbe04129f90 con 0x7fbdf003e6c0 2024-09-22T08:10:39.499 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:10:39.499 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:10:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.499+0000 7fbe09aa3640 1 -- 172.21.15.53:0/3096690714 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbdf003e6c0 msgr2=0x7fbdf0040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.499+0000 7fbe09aa3640 1 --2- 172.21.15.53:0/3096690714 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbdf003e6c0 0x7fbdf0040b80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8000c00 tx=0x7fbdf80078d0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.499+0000 7fbe09aa3640 1 -- 172.21.15.53:0/3096690714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 msgr2=0x7fbe041c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.499+0000 7fbe09aa3640 1 --2- 172.21.15.53:0/3096690714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 0x7fbe041c4780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4035040 tx=0x7fbdf40046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.499+0000 7fbe09aa3640 1 -- 172.21.15.53:0/3096690714 shutdown_connections 2024-09-22T08:10:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.499+0000 7fbe09aa3640 1 --2- 172.21.15.53:0/3096690714 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbdf003e6c0 0x7fbdf0040b80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.499+0000 7fbe09aa3640 1 --2- 172.21.15.53:0/3096690714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe0406e8e0 0x7fbe041c4780 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.499+0000 7fbe09aa3640 1 -- 172.21.15.53:0/3096690714 >> 172.21.15.53:0/3096690714 conn(0x7fbe040a01c0 msgr2=0x7fbe0409aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.499+0000 7fbe09aa3640 1 -- 172.21.15.53:0/3096690714 shutdown_connections 2024-09-22T08:10:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.499+0000 7fbe09aa3640 1 -- 172.21.15.53:0/3096690714 wait complete. 2024-09-22T08:10:39.511 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-22T08:10:37.559555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118184,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369176,"statfs":{"total":386547056640,"available":386426036224,"internally_reserved":0,"allocated":1785856,"data_stored":1372650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.652904"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.923155+0000","last_change":"2024-09-22T08:10:35.923155+0000","last_active":"2024-09-22T08:10:35.923155+0000","last_peered":"2024-09-22T08:10:35.923155+0000","last_clean":"2024-09-22T08:10:35.923155+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:10:35.923155+0000","last_undegraded":"2024-09-22T08:10:35.923155+0000","last_fullsized":"2024-09-22T08:10:35.923155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:11:54.812723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.924894+0000","last_change":"2024-09-22T08:10:35.924894+0000","last_active":"2024-09-22T08:10:35.924894+0000","last_peered":"2024-09-22T08:10:35.924894+0000","last_clean":"2024-09-22T08:10:35.924894+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:10:35.924894+0000","last_undegraded":"2024-09-22T08:10:35.924894+0000","last_fullsized":"2024-09-22T08:10:35.924894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:31.373918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.922434+0000","last_change":"2024-09-22T08:10:35.922434+0000","last_active":"2024-09-22T08:10:35.922434+0000","last_peered":"2024-09-22T08:10:35.922434+0000","last_clean":"2024-09-22T08:10:35.922434+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:10:35.922434+0000","last_undegraded":"2024-09-22T08:10:35.922434+0000","last_fullsized":"2024-09-22T08:10:35.922434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:36.971498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.924829+0000","last_change":"2024-09-22T08:10:35.924829+0000","last_active":"2024-09-22T08:10:35.924829+0000","last_peered":"2024-09-22T08:10:35.924829+0000","last_clean":"2024-09-22T08:10:35.924829+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:10:35.924829+0000","last_undegraded":"2024-09-22T08:10:35.924829+0000","last_fullsized":"2024-09-22T08:10:35.924829+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:15.126946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.925124+0000","last_change":"2024-09-22T08:10:35.923055+0000","last_active":"2024-09-22T08:10:35.925124+0000","last_peered":"2024-09-22T08:10:35.925124+0000","last_clean":"2024-09-22T08:10:35.925124+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:10:35.925124+0000","last_undegraded":"2024-09-22T08:10:35.925124+0000","last_fullsized":"2024-09-22T08:10:35.925124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:18.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:36.081840+0000","last_change":"2024-09-22T08:10:36.081840+0000","last_active":"2024-09-22T08:10:36.081840+0000","last_peered":"2024-09-22T08:10:36.081840+0000","last_clean":"2024-09-22T08:10:36.081840+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:10:36.081840+0000","last_undegraded":"2024-09-22T08:10:36.081840+0000","last_fullsized":"2024-09-22T08:10:36.081840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:30.701302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.922413+0000","last_change":"2024-09-22T08:10:35.922413+0000","last_active":"2024-09-22T08:10:35.922413+0000","last_peered":"2024-09-22T08:10:35.922413+0000","last_clean":"2024-09-22T08:10:35.922413+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:10:35.922413+0000","last_undegraded":"2024-09-22T08:10:35.922413+0000","last_fullsized":"2024-09-22T08:10:35.922413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:14.955260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.923301+0000","last_change":"2024-09-22T08:10:35.923301+0000","last_active":"2024-09-22T08:10:35.923301+0000","last_peered":"2024-09-22T08:10:35.923301+0000","last_clean":"2024-09-22T08:10:35.923301+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:10:35.923301+0000","last_undegraded":"2024-09-22T08:10:35.923301+0000","last_fullsized":"2024-09-22T08:10:35.923301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:47.170548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.919551+0000","last_change":"2024-09-22T08:10:29.013963+0000","last_active":"2024-09-22T08:10:35.919551+0000","last_peered":"2024-09-22T08:10:35.919551+0000","last_clean":"2024-09-22T08:10:35.919551+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:10:35.919551+0000","last_undegraded":"2024-09-22T08:10:35.919551+0000","last_fullsized":"2024-09-22T08:10:35.919551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_clean_scrub_stamp":"2024-09-22T08:10:27.897500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:09.733603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":151552,"data_stored":47988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":638337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":638337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":151552,"data_stored":47988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:10:39.512 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:10:39.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.611+0000 7fedcfa47640 1 Processor -- start 2024-09-22T08:10:39.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.612+0000 7fedcfa47640 1 -- start start 2024-09-22T08:10:39.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.612+0000 7fedcfa47640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fedc806e8e0 0x7fedc806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:39.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.612+0000 7fedcfa47640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc806ff50 con 0x7fedc806f200 2024-09-22T08:10:39.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.612+0000 7fedcfa47640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fedc8099c10 con 0x7fedc806e8e0 2024-09-22T08:10:39.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.612+0000 7fedcd7e3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fedc806e8e0 0x7fedc806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:39.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.612+0000 7fedccfe2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fedc806f200 0x7fedc812f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46144/0 (socket says 172.21.15.53:46144) 2024-09-22T08:10:39.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.612+0000 7fedccfe2640 1 -- 172.21.15.53:0/3547505825 learned_addr learned my addr 172.21.15.53:0/3547505825 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:39.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.612+0000 7fedcd7e3640 1 -- 172.21.15.53:0/3547505825 >> v1:172.21.15.53:6789/0 conn(0x7fedc806f200 legacy=0x7fedc812f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.613+0000 7fedcd7e3640 1 -- 172.21.15.53:0/3547505825 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc8099710 con 0x7fedc806e8e0 2024-09-22T08:10:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.613+0000 7fedcd7e3640 1 --2- 172.21.15.53:0/3547505825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 0x7fedc806ecc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009720 tx=0x7fedc402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee49e566b1d7070 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.613+0000 7fedbffff640 1 -- 172.21.15.53:0/3547505825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc4037070 con 0x7fedc806e8e0 2024-09-22T08:10:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.613+0000 7fedbffff640 1 -- 172.21.15.53:0/3547505825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc402ae20 con 0x7fedc806e8e0 2024-09-22T08:10:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.613+0000 7fedbffff640 1 -- 172.21.15.53:0/3547505825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc4032590 con 0x7fedc806e8e0 2024-09-22T08:10:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.614+0000 7fedcfa47640 1 -- 172.21.15.53:0/3547505825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 msgr2=0x7fedc806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.614+0000 7fedcfa47640 1 --2- 172.21.15.53:0/3547505825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 0x7fedc806ecc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009720 tx=0x7fedc402a1a0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.614+0000 7fedcfa47640 1 -- 172.21.15.53:0/3547505825 shutdown_connections 2024-09-22T08:10:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.614+0000 7fedcfa47640 1 --2- 172.21.15.53:0/3547505825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 0x7fedc806ecc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.614+0000 7fedcfa47640 1 -- 172.21.15.53:0/3547505825 >> 172.21.15.53:0/3547505825 conn(0x7fedc80a01c0 msgr2=0x7fedc80a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.614+0000 7fedcfa47640 1 -- 172.21.15.53:0/3547505825 shutdown_connections 2024-09-22T08:10:39.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.614+0000 7fedcfa47640 1 -- 172.21.15.53:0/3547505825 wait complete. 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.615+0000 7fedcfa47640 1 Processor -- start 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.615+0000 7fedcfa47640 1 -- start start 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.615+0000 7fedcfa47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 0x7fedc81c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.615+0000 7fedcfa47640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fedc81300f0 con 0x7fedc806e8e0 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.615+0000 7fedcd7e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 0x7fedc81c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.615+0000 7fedcd7e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 0x7fedc81c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51092/0 (socket says 172.21.15.53:51092) 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.615+0000 7fedcd7e3640 1 -- 172.21.15.53:0/3433063796 learned_addr learned my addr 172.21.15.53:0/3433063796 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.616+0000 7fedcd7e3640 1 -- 172.21.15.53:0/3433063796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc808ea60 con 0x7fedc806e8e0 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.616+0000 7fedcd7e3640 1 --2- 172.21.15.53:0/3433063796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 0x7fedc81c4780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fedc402a1e0 tx=0x7fedc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.616+0000 7fedbdffb640 1 -- 172.21.15.53:0/3433063796 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc4042070 con 0x7fedc806e8e0 2024-09-22T08:10:39.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.616+0000 7fedbdffb640 1 -- 172.21.15.53:0/3433063796 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc403e590 con 0x7fedc806e8e0 2024-09-22T08:10:39.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.616+0000 7fedcfa47640 1 -- 172.21.15.53:0/3433063796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc808f4b0 con 0x7fedc806e8e0 2024-09-22T08:10:39.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.616+0000 7fedbdffb640 1 -- 172.21.15.53:0/3433063796 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc4037040 con 0x7fedc806e8e0 2024-09-22T08:10:39.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.616+0000 7fedcfa47640 1 -- 172.21.15.53:0/3433063796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc81c4ea0 con 0x7fedc806e8e0 2024-09-22T08:10:39.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.617+0000 7fedbdffb640 1 -- 172.21.15.53:0/3433063796 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fedc4045070 con 0x7fedc806e8e0 2024-09-22T08:10:39.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.617+0000 7fedcfa47640 1 -- 172.21.15.53:0/3433063796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc808e380 con 0x7fedc806e8e0 2024-09-22T08:10:39.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.617+0000 7fedbdffb640 1 --2- 172.21.15.53:0/3433063796 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fedac03e740 0x7fedac040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:39.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.617+0000 7fedbdffb640 1 -- 172.21.15.53:0/3433063796 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fedc4073620 con 0x7fedc806e8e0 2024-09-22T08:10:39.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.618+0000 7fedccfe2640 1 --2- 172.21.15.53:0/3433063796 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fedac03e740 0x7fedac040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:39.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.618+0000 7fedccfe2640 1 --2- 172.21.15.53:0/3433063796 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fedac03e740 0x7fedac040c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fedb8007fd0 tx=0x7fedb8007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:39.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.622+0000 7fedbdffb640 1 -- 172.21.15.53:0/3433063796 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fedc4045d30 con 0x7fedc806e8e0 2024-09-22T08:10:39.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.808+0000 7fedcfa47640 1 -- 172.21.15.53:0/3433063796 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedc8129f90 con 0x7fedac03e740 2024-09-22T08:10:39.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.810+0000 7fedbdffb640 1 -- 172.21.15.53:0/3433063796 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32158 (secure 0 0 0) 0x7fedb80058b0 con 0x7fedac03e740 2024-09-22T08:10:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:10:39.811 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:10:39.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.811+0000 7fedcfa47640 1 -- 172.21.15.53:0/3433063796 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fedac03e740 msgr2=0x7fedac040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.811+0000 7fedcfa47640 1 --2- 172.21.15.53:0/3433063796 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fedac03e740 0x7fedac040c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fedb8007fd0 tx=0x7fedb8007aa0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.811+0000 7fedcfa47640 1 -- 172.21.15.53:0/3433063796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 msgr2=0x7fedc81c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.811+0000 7fedcfa47640 1 --2- 172.21.15.53:0/3433063796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 0x7fedc81c4780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fedc402a1e0 tx=0x7fedc40046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.811+0000 7fedcfa47640 1 -- 172.21.15.53:0/3433063796 shutdown_connections 2024-09-22T08:10:39.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.811+0000 7fedcfa47640 1 --2- 172.21.15.53:0/3433063796 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fedac03e740 0x7fedac040c00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.811+0000 7fedcfa47640 1 --2- 172.21.15.53:0/3433063796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedc806e8e0 0x7fedc81c4780 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.811+0000 7fedcfa47640 1 -- 172.21.15.53:0/3433063796 >> 172.21.15.53:0/3433063796 conn(0x7fedc80a01c0 msgr2=0x7fedc809dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:39.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.811+0000 7fedcfa47640 1 -- 172.21.15.53:0/3433063796 shutdown_connections 2024-09-22T08:10:39.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.811+0000 7fedcfa47640 1 -- 172.21.15.53:0/3433063796 wait complete. 2024-09-22T08:10:39.824 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-22T08:10:39.559938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118184,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369176,"statfs":{"total":386547056640,"available":386426036224,"internally_reserved":0,"allocated":1785856,"data_stored":1372650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001230"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.923155+0000","last_change":"2024-09-22T08:10:35.923155+0000","last_active":"2024-09-22T08:10:35.923155+0000","last_peered":"2024-09-22T08:10:35.923155+0000","last_clean":"2024-09-22T08:10:35.923155+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:10:35.923155+0000","last_undegraded":"2024-09-22T08:10:35.923155+0000","last_fullsized":"2024-09-22T08:10:35.923155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:11:54.812723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.924894+0000","last_change":"2024-09-22T08:10:35.924894+0000","last_active":"2024-09-22T08:10:35.924894+0000","last_peered":"2024-09-22T08:10:35.924894+0000","last_clean":"2024-09-22T08:10:35.924894+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:10:35.924894+0000","last_undegraded":"2024-09-22T08:10:35.924894+0000","last_fullsized":"2024-09-22T08:10:35.924894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:31.373918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.922434+0000","last_change":"2024-09-22T08:10:35.922434+0000","last_active":"2024-09-22T08:10:35.922434+0000","last_peered":"2024-09-22T08:10:35.922434+0000","last_clean":"2024-09-22T08:10:35.922434+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:10:35.922434+0000","last_undegraded":"2024-09-22T08:10:35.922434+0000","last_fullsized":"2024-09-22T08:10:35.922434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:36.971498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.924829+0000","last_change":"2024-09-22T08:10:35.924829+0000","last_active":"2024-09-22T08:10:35.924829+0000","last_peered":"2024-09-22T08:10:35.924829+0000","last_clean":"2024-09-22T08:10:35.924829+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:10:35.924829+0000","last_undegraded":"2024-09-22T08:10:35.924829+0000","last_fullsized":"2024-09-22T08:10:35.924829+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:15.126946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.925124+0000","last_change":"2024-09-22T08:10:35.923055+0000","last_active":"2024-09-22T08:10:35.925124+0000","last_peered":"2024-09-22T08:10:35.925124+0000","last_clean":"2024-09-22T08:10:35.925124+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:10:35.925124+0000","last_undegraded":"2024-09-22T08:10:35.925124+0000","last_fullsized":"2024-09-22T08:10:35.925124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:18.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:36.081840+0000","last_change":"2024-09-22T08:10:36.081840+0000","last_active":"2024-09-22T08:10:36.081840+0000","last_peered":"2024-09-22T08:10:36.081840+0000","last_clean":"2024-09-22T08:10:36.081840+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:10:36.081840+0000","last_undegraded":"2024-09-22T08:10:36.081840+0000","last_fullsized":"2024-09-22T08:10:36.081840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:30.701302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.922413+0000","last_change":"2024-09-22T08:10:35.922413+0000","last_active":"2024-09-22T08:10:35.922413+0000","last_peered":"2024-09-22T08:10:35.922413+0000","last_clean":"2024-09-22T08:10:35.922413+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:10:35.922413+0000","last_undegraded":"2024-09-22T08:10:35.922413+0000","last_fullsized":"2024-09-22T08:10:35.922413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:14.955260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.923301+0000","last_change":"2024-09-22T08:10:35.923301+0000","last_active":"2024-09-22T08:10:35.923301+0000","last_peered":"2024-09-22T08:10:35.923301+0000","last_clean":"2024-09-22T08:10:35.923301+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:10:35.923301+0000","last_undegraded":"2024-09-22T08:10:35.923301+0000","last_fullsized":"2024-09-22T08:10:35.923301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:47.170548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T08:10:35.919551+0000","last_change":"2024-09-22T08:10:29.013963+0000","last_active":"2024-09-22T08:10:35.919551+0000","last_peered":"2024-09-22T08:10:35.919551+0000","last_clean":"2024-09-22T08:10:35.919551+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:10:35.919551+0000","last_undegraded":"2024-09-22T08:10:35.919551+0000","last_fullsized":"2024-09-22T08:10:35.919551+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_clean_scrub_stamp":"2024-09-22T08:10:27.897500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:09.733603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":151552,"data_stored":47988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":638337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":638337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":151552,"data_stored":47988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:10:39.825 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T08:10:39.825 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-22T08:10:39.825 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-22T08:10:39.825 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-22T08:10:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.923+0000 7fad43d2c640 1 Processor -- start 2024-09-22T08:10:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.924+0000 7fad43d2c640 1 -- start start 2024-09-22T08:10:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.924+0000 7fad43d2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fad3c130160 0x7fad3c130540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.924+0000 7fad43d2c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3c098e80 con 0x7fad3c130a80 2024-09-22T08:10:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.924+0000 7fad43d2c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fad3c099450 con 0x7fad3c130160 2024-09-22T08:10:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.924+0000 7fad41ac8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fad3c130160 0x7fad3c130540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.924+0000 7fad412c7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fad3c130a80 0x7fad3c097280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46154/0 (socket says 172.21.15.53:46154) 2024-09-22T08:10:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.924+0000 7fad412c7640 1 -- 172.21.15.53:0/3781925043 learned_addr learned my addr 172.21.15.53:0/3781925043 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:10:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.925+0000 7fad41ac8640 1 -- 172.21.15.53:0/3781925043 >> v1:172.21.15.53:6789/0 conn(0x7fad3c130a80 legacy=0x7fad3c097280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.925+0000 7fad41ac8640 1 -- 172.21.15.53:0/3781925043 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3c097990 con 0x7fad3c130160 2024-09-22T08:10:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.925+0000 7fad41ac8640 1 --2- 172.21.15.53:0/3781925043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 0x7fad3c130540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009d90 tx=0x7fad2c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141885a9db7cf768 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.925+0000 7fad40ac6640 1 -- 172.21.15.53:0/3781925043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c007670 con 0x7fad3c130160 2024-09-22T08:10:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.925+0000 7fad40ac6640 1 -- 172.21.15.53:0/3781925043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c007810 con 0x7fad3c130160 2024-09-22T08:10:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.925+0000 7fad40ac6640 1 -- 172.21.15.53:0/3781925043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c007b10 con 0x7fad3c130160 2024-09-22T08:10:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.926+0000 7fad43d2c640 1 -- 172.21.15.53:0/3781925043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 msgr2=0x7fad3c130540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.926+0000 7fad43d2c640 1 --2- 172.21.15.53:0/3781925043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 0x7fad3c130540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009d90 tx=0x7fad2c02a660 comp rx=0 tx=0).stop 2024-09-22T08:10:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.926+0000 7fad43d2c640 1 -- 172.21.15.53:0/3781925043 shutdown_connections 2024-09-22T08:10:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.926+0000 7fad43d2c640 1 --2- 172.21.15.53:0/3781925043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 0x7fad3c130540 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.926+0000 7fad43d2c640 1 -- 172.21.15.53:0/3781925043 >> 172.21.15.53:0/3781925043 conn(0x7fad3c09ff60 msgr2=0x7fad3c0a0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.926+0000 7fad43d2c640 1 -- 172.21.15.53:0/3781925043 shutdown_connections 2024-09-22T08:10:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.926+0000 7fad43d2c640 1 -- 172.21.15.53:0/3781925043 wait complete. 2024-09-22T08:10:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.927+0000 7fad43d2c640 1 Processor -- start 2024-09-22T08:10:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.927+0000 7fad43d2c640 1 -- start start 2024-09-22T08:10:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.927+0000 7fad43d2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 0x7fad3c093a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.927+0000 7fad43d2c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fad3c0980a0 con 0x7fad3c130160 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.928+0000 7fad41ac8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 0x7fad3c093a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.928+0000 7fad41ac8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 0x7fad3c093a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51112/0 (socket says 172.21.15.53:51112) 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.928+0000 7fad41ac8640 1 -- 172.21.15.53:0/1137390291 learned_addr learned my addr 172.21.15.53:0/1137390291 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.928+0000 7fad41ac8640 1 -- 172.21.15.53:0/1137390291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3c095a90 con 0x7fad3c130160 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.928+0000 7fad41ac8640 1 --2- 172.21.15.53:0/1137390291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 0x7fad3c093a60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009d90 tx=0x7fad2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.928+0000 7fad3a7fc640 1 -- 172.21.15.53:0/1137390291 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c040070 con 0x7fad3c130160 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.928+0000 7fad3a7fc640 1 -- 172.21.15.53:0/1137390291 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c031a90 con 0x7fad3c130160 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.928+0000 7fad43d2c640 1 -- 172.21.15.53:0/1137390291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3c125ab0 con 0x7fad3c130160 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.928+0000 7fad3a7fc640 1 -- 172.21.15.53:0/1137390291 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c031d70 con 0x7fad3c130160 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.928+0000 7fad43d2c640 1 -- 172.21.15.53:0/1137390291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3c12e9a0 con 0x7fad3c130160 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.929+0000 7fad3a7fc640 1 -- 172.21.15.53:0/1137390291 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fad2c039040 con 0x7fad3c130160 2024-09-22T08:10:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.929+0000 7fad43d2c640 1 -- 172.21.15.53:0/1137390291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad3c12ec20 con 0x7fad3c130160 2024-09-22T08:10:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.929+0000 7fad3a7fc640 1 --2- 172.21.15.53:0/1137390291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fad2803e740 0x7fad28040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.929+0000 7fad3a7fc640 1 -- 172.21.15.53:0/1137390291 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fad2c02ae00 con 0x7fad3c130160 2024-09-22T08:10:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.930+0000 7fad412c7640 1 --2- 172.21.15.53:0/1137390291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fad2803e740 0x7fad28040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.930+0000 7fad412c7640 1 --2- 172.21.15.53:0/1137390291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fad2803e740 0x7fad28040c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad30007fd0 tx=0x7fad30007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:39.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:39.934+0000 7fad3a7fc640 1 -- 172.21.15.53:0/1137390291 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fad2c003990 con 0x7fad3c130160 2024-09-22T08:10:40.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.161+0000 7fad43d2c640 1 -- 172.21.15.53:0/1137390291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fad3c130540 con 0x7fad3c130160 2024-09-22T08:10:40.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.161+0000 7fad3a7fc640 1 -- 172.21.15.53:0/1137390291 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fad2c03cc20 con 0x7fad3c130160 2024-09-22T08:10:40.163 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:10:40.163 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-22T08:10:40.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.163+0000 7fad43d2c640 1 -- 172.21.15.53:0/1137390291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fad2803e740 msgr2=0x7fad28040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:40.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.163+0000 7fad43d2c640 1 --2- 172.21.15.53:0/1137390291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fad2803e740 0x7fad28040c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad30007fd0 tx=0x7fad30007aa0 comp rx=0 tx=0).stop 2024-09-22T08:10:40.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.163+0000 7fad43d2c640 1 -- 172.21.15.53:0/1137390291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 msgr2=0x7fad3c093a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:40.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.163+0000 7fad43d2c640 1 --2- 172.21.15.53:0/1137390291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 0x7fad3c093a60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009d90 tx=0x7fad2c004a40 comp rx=0 tx=0).stop 2024-09-22T08:10:40.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.163+0000 7fad43d2c640 1 -- 172.21.15.53:0/1137390291 shutdown_connections 2024-09-22T08:10:40.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.163+0000 7fad43d2c640 1 --2- 172.21.15.53:0/1137390291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fad2803e740 0x7fad28040c00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:40.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.163+0000 7fad43d2c640 1 --2- 172.21.15.53:0/1137390291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad3c130160 0x7fad3c093a60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:40.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.163+0000 7fad43d2c640 1 -- 172.21.15.53:0/1137390291 >> 172.21.15.53:0/1137390291 conn(0x7fad3c09ff60 msgr2=0x7fad3c09b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:40.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.163+0000 7fad43d2c640 1 -- 172.21.15.53:0/1137390291 shutdown_connections 2024-09-22T08:10:40.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:10:40.163+0000 7fad43d2c640 1 -- 172.21.15.53:0/1137390291 wait complete. 2024-09-22T08:10:40.175 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-22T08:10:40.176 INFO:teuthology.run_tasks:Running task rgw... 2024-09-22T08:10:40.191 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-22T08:10:40.191 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-22T08:10:40.191 INFO:tasks.rgw:Creating data pools 2024-09-22T08:10:40.191 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-22T08:10:40.191 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-22T08:10:40.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.304+0000 7f92094cd640 1 Processor -- start 2024-09-22T08:10:40.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.304+0000 7f92094cd640 1 -- start start 2024-09-22T08:10:40.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.304+0000 7f92094cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f920406eda0 0x7f920411e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:40.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.304+0000 7f92094cd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920406f2b0 con 0x7f92040703b0 2024-09-22T08:10:40.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.304+0000 7f92094cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f920411f760 con 0x7f920406eda0 2024-09-22T08:10:40.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.304+0000 7f91fbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f920406eda0 0x7f920411e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:40.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.304+0000 7f9202ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f92040703b0 0x7f920406e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:44034/0 (socket says 172.21.15.165:44034) 2024-09-22T08:10:40.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.304+0000 7f9202ffd640 1 -- 172.21.15.165:0/2721302138 learned_addr learned my addr 172.21.15.165:0/2721302138 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:10:40.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.304+0000 7f91fbfff640 1 -- 172.21.15.165:0/2721302138 >> v1:172.21.15.53:6789/0 conn(0x7f92040703b0 legacy=0x7f920406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:40.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.304+0000 7f91fbfff640 1 -- 172.21.15.165:0/2721302138 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920411f8e0 con 0x7f920406eda0 2024-09-22T08:10:40.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.305+0000 7f91fbfff640 1 --2- 172.21.15.165:0/2721302138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 0x7f920411e210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009720 tx=0x7f91ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac90c287f5669183 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:40.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.305+0000 7f92027fc640 1 -- 172.21.15.165:0/2721302138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec037070 con 0x7f920406eda0 2024-09-22T08:10:40.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.305+0000 7f92027fc640 1 -- 172.21.15.165:0/2721302138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ec02ad90 con 0x7f920406eda0 2024-09-22T08:10:40.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.305+0000 7f92027fc640 1 -- 172.21.15.165:0/2721302138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec032590 con 0x7f920406eda0 2024-09-22T08:10:40.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.306+0000 7f92094cd640 1 -- 172.21.15.165:0/2721302138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 msgr2=0x7f920411e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:40.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.306+0000 7f92094cd640 1 --2- 172.21.15.165:0/2721302138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 0x7f920411e210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009720 tx=0x7f91ec02a110 comp rx=0 tx=0).stop 2024-09-22T08:10:40.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.306+0000 7f92094cd640 1 -- 172.21.15.165:0/2721302138 shutdown_connections 2024-09-22T08:10:40.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.306+0000 7f92094cd640 1 --2- 172.21.15.165:0/2721302138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 0x7f920411e210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:40.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.306+0000 7f92094cd640 1 -- 172.21.15.165:0/2721302138 >> 172.21.15.165:0/2721302138 conn(0x7f9204072160 msgr2=0x7f9204074580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:40.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.306+0000 7f92094cd640 1 -- 172.21.15.165:0/2721302138 shutdown_connections 2024-09-22T08:10:40.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.306+0000 7f92094cd640 1 -- 172.21.15.165:0/2721302138 wait complete. 2024-09-22T08:10:40.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.307+0000 7f92094cd640 1 Processor -- start 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.307+0000 7f92094cd640 1 -- start start 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.307+0000 7f92094cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 0x7f92041a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.307+0000 7f92094cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f920411ec30 con 0x7f920406eda0 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.307+0000 7f9202ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 0x7f92041a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.307+0000 7f9202ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 0x7f92041a7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:45172/0 (socket says 172.21.15.165:45172) 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.307+0000 7f9202ffd640 1 -- 172.21.15.165:0/1066695998 learned_addr learned my addr 172.21.15.165:0/1066695998 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.308+0000 7f9202ffd640 1 -- 172.21.15.165:0/1066695998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92041a7fe0 con 0x7f920406eda0 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.308+0000 7f9202ffd640 1 --2- 172.21.15.165:0/1066695998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 0x7f92041a7a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91f400c480 tx=0x7f91f400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.308+0000 7f91fb7fe640 1 -- 172.21.15.165:0/1066695998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91f4017070 con 0x7f920406eda0 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.308+0000 7f91fb7fe640 1 -- 172.21.15.165:0/1066695998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f4005c10 con 0x7f920406eda0 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.308+0000 7f92094cd640 1 -- 172.21.15.165:0/1066695998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92041a82d0 con 0x7f920406eda0 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.308+0000 7f91fb7fe640 1 -- 172.21.15.165:0/1066695998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91f4007070 con 0x7f920406eda0 2024-09-22T08:10:40.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.308+0000 7f92094cd640 1 -- 172.21.15.165:0/1066695998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92041ad4a0 con 0x7f920406eda0 2024-09-22T08:10:40.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.309+0000 7f91fb7fe640 1 -- 172.21.15.165:0/1066695998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f91f401a070 con 0x7f920406eda0 2024-09-22T08:10:40.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.309+0000 7f92094cd640 1 -- 172.21.15.165:0/1066695998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92041a8610 con 0x7f920406eda0 2024-09-22T08:10:40.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.309+0000 7f91fb7fe640 1 --2- 172.21.15.165:0/1066695998 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f91e403e710 0x7f91e4040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:40.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.309+0000 7f91fb7fe640 1 -- 172.21.15.165:0/1066695998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f91f4051fe0 con 0x7f920406eda0 2024-09-22T08:10:40.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.309+0000 7f91fbfff640 1 --2- 172.21.15.165:0/1066695998 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f91e403e710 0x7f91e4040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:40.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.310+0000 7f91fbfff640 1 --2- 172.21.15.165:0/1066695998 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f91e403e710 0x7f91e4040bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91ec034000 tx=0x7f91ec02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:40.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.314+0000 7f91fb7fe640 1 -- 172.21.15.165:0/1066695998 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f91f401ac60 con 0x7f920406eda0 2024-09-22T08:10:40.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.495+0000 7f92094cd640 1 -- 172.21.15.165:0/1066695998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7f920411f290 con 0x7f920406eda0 2024-09-22T08:10:40.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.923+0000 7f91fb7fe640 1 -- 172.21.15.165:0/1066695998 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v18) ==== 171+0+0 (secure 0 0 0) 0x7f91f4050eb0 con 0x7f920406eda0 2024-09-22T08:10:40.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.925+0000 7f92094cd640 1 -- 172.21.15.165:0/1066695998 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f91e403e710 msgr2=0x7f91e4040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:40.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.925+0000 7f92094cd640 1 --2- 172.21.15.165:0/1066695998 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f91e403e710 0x7f91e4040bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91ec034000 tx=0x7f91ec02e000 comp rx=0 tx=0).stop 2024-09-22T08:10:40.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.925+0000 7f92094cd640 1 -- 172.21.15.165:0/1066695998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 msgr2=0x7f92041a7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:40.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.925+0000 7f92094cd640 1 --2- 172.21.15.165:0/1066695998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 0x7f92041a7a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91f400c480 tx=0x7f91f400c940 comp rx=0 tx=0).stop 2024-09-22T08:10:40.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.925+0000 7f92094cd640 1 -- 172.21.15.165:0/1066695998 shutdown_connections 2024-09-22T08:10:40.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.925+0000 7f92094cd640 1 --2- 172.21.15.165:0/1066695998 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f91e403e710 0x7f91e4040bd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:40.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.925+0000 7f92094cd640 1 --2- 172.21.15.165:0/1066695998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f920406eda0 0x7f92041a7a10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:40.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.925+0000 7f92094cd640 1 -- 172.21.15.165:0/1066695998 >> 172.21.15.165:0/1066695998 conn(0x7f9204072160 msgr2=0x7f92041151a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:40.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.925+0000 7f92094cd640 1 -- 172.21.15.165:0/1066695998 shutdown_connections 2024-09-22T08:10:40.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:40.925+0000 7f92094cd640 1 -- 172.21.15.165:0/1066695998 wait complete. 2024-09-22T08:10:40.937 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-22T08:10:41.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.038+0000 7fc88dba0640 1 Processor -- start 2024-09-22T08:10:41.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.038+0000 7fc88dba0640 1 -- start start 2024-09-22T08:10:41.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.038+0000 7fc88dba0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc88811bb20 0x7fc88811df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:41.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.039+0000 7fc88dba0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88811e4e0 con 0x7fc888116ba0 2024-09-22T08:10:41.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.039+0000 7fc88dba0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc88811f6c0 con 0x7fc88811bb20 2024-09-22T08:10:41.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.039+0000 7fc886ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc88811bb20 0x7fc88811df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:41.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.039+0000 7fc8877fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc888116ba0 0x7fc888116f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:44046/0 (socket says 172.21.15.165:44046) 2024-09-22T08:10:41.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.039+0000 7fc886ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc88811bb20 0x7fc88811df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:45178/0 (socket says 172.21.15.165:45178) 2024-09-22T08:10:41.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.039+0000 7fc8877fe640 1 -- 172.21.15.165:0/1552238999 learned_addr learned my addr 172.21.15.165:0/1552238999 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:10:41.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.039+0000 7fc886ffd640 1 -- 172.21.15.165:0/1552238999 >> v1:172.21.15.53:6789/0 conn(0x7fc888116ba0 legacy=0x7fc888116f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:41.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.039+0000 7fc886ffd640 1 -- 172.21.15.165:0/1552238999 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88811f840 con 0x7fc88811bb20 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.040+0000 7fc886ffd640 1 --2- 172.21.15.165:0/1552238999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc88811bb20 0x7fc88811df10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009720 tx=0x7fc87c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728fd62db82f310e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.040+0000 7fc8867fc640 1 -- 172.21.15.165:0/1552238999 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc87c037070 con 0x7fc88811bb20 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.040+0000 7fc8867fc640 1 -- 172.21.15.165:0/1552238999 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c02ad90 con 0x7fc88811bb20 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.040+0000 7fc8867fc640 1 -- 172.21.15.165:0/1552238999 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc87c032590 con 0x7fc88811bb20 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.041+0000 7fc88dba0640 1 -- 172.21.15.165:0/1552238999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc88811bb20 msgr2=0x7fc88811df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.041+0000 7fc88dba0640 1 --2- 172.21.15.165:0/1552238999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc88811bb20 0x7fc88811df10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009720 tx=0x7fc87c02a110 comp rx=0 tx=0).stop 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.041+0000 7fc88dba0640 1 -- 172.21.15.165:0/1552238999 shutdown_connections 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.041+0000 7fc88dba0640 1 --2- 172.21.15.165:0/1552238999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc88811bb20 0x7fc88811df10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.041+0000 7fc88dba0640 1 -- 172.21.15.165:0/1552238999 >> 172.21.15.165:0/1552238999 conn(0x7fc88806f850 msgr2=0x7fc88806fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.041+0000 7fc88dba0640 1 -- 172.21.15.165:0/1552238999 shutdown_connections 2024-09-22T08:10:41.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.041+0000 7fc88dba0640 1 -- 172.21.15.165:0/1552238999 wait complete. 2024-09-22T08:10:41.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.041+0000 7fc88dba0640 1 Processor -- start 2024-09-22T08:10:41.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.042+0000 7fc88dba0640 1 -- start start 2024-09-22T08:10:41.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.042+0000 7fc88dba0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc888116ba0 0x7fc8881a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:41.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.042+0000 7fc88dba0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc88811eb90 con 0x7fc888116ba0 2024-09-22T08:10:41.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.042+0000 7fc8877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc888116ba0 0x7fc8881a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:41.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.042+0000 7fc8877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc888116ba0 0x7fc8881a7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:45180/0 (socket says 172.21.15.165:45180) 2024-09-22T08:10:41.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.042+0000 7fc8877fe640 1 -- 172.21.15.165:0/3069739675 learned_addr learned my addr 172.21.15.165:0/3069739675 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:41.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.042+0000 7fc8877fe640 1 -- 172.21.15.165:0/3069739675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8881a7fd0 con 0x7fc888116ba0 2024-09-22T08:10:41.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.043+0000 7fc8877fe640 1 --2- 172.21.15.165:0/3069739675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc888116ba0 0x7fc8881a7a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc87800cbd0 tx=0x7fc87800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:41.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.043+0000 7fc86ffff640 1 -- 172.21.15.165:0/3069739675 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc878017070 con 0x7fc888116ba0 2024-09-22T08:10:41.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.043+0000 7fc86ffff640 1 -- 172.21.15.165:0/3069739675 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87800abc0 con 0x7fc888116ba0 2024-09-22T08:10:41.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.043+0000 7fc88dba0640 1 -- 172.21.15.165:0/3069739675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8881a82c0 con 0x7fc888116ba0 2024-09-22T08:10:41.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.043+0000 7fc86ffff640 1 -- 172.21.15.165:0/3069739675 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc878012400 con 0x7fc888116ba0 2024-09-22T08:10:41.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.043+0000 7fc88dba0640 1 -- 172.21.15.165:0/3069739675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8881ad490 con 0x7fc888116ba0 2024-09-22T08:10:41.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.044+0000 7fc88dba0640 1 -- 172.21.15.165:0/3069739675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8881a8600 con 0x7fc888116ba0 2024-09-22T08:10:41.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.044+0000 7fc86ffff640 1 -- 172.21.15.165:0/3069739675 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc87801a070 con 0x7fc888116ba0 2024-09-22T08:10:41.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.044+0000 7fc86ffff640 1 --2- 172.21.15.165:0/3069739675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc87403e6f0 0x7fc874040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:41.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.044+0000 7fc86ffff640 1 -- 172.21.15.165:0/3069739675 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3825+0+0 (secure 0 0 0) 0x7fc878052c40 con 0x7fc888116ba0 2024-09-22T08:10:41.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.044+0000 7fc886ffd640 1 --2- 172.21.15.165:0/3069739675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc87403e6f0 0x7fc874040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:41.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.045+0000 7fc886ffd640 1 --2- 172.21.15.165:0/3069739675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc87403e6f0 0x7fc874040bb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc87c034000 tx=0x7fc87c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:41.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.049+0000 7fc86ffff640 1 -- 172.21.15.165:0/3069739675 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc878007910 con 0x7fc888116ba0 2024-09-22T08:10:41.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:41.227+0000 7fc88dba0640 1 -- 172.21.15.165:0/3069739675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fc88811f1f0 con 0x7fc888116ba0 2024-09-22T08:10:42.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.146+0000 7fc86ffff640 1 -- 172.21.15.165:0/3069739675 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) ==== 227+0+0 (secure 0 0 0) 0x7fc87801a360 con 0x7fc888116ba0 2024-09-22T08:10:42.147 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'default.rgw.buckets.data' created 2024-09-22T08:10:42.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.149+0000 7fc88dba0640 1 -- 172.21.15.165:0/3069739675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc87403e6f0 msgr2=0x7fc874040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:42.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.149+0000 7fc88dba0640 1 --2- 172.21.15.165:0/3069739675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc87403e6f0 0x7fc874040bb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc87c034000 tx=0x7fc87c02e000 comp rx=0 tx=0).stop 2024-09-22T08:10:42.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.149+0000 7fc88dba0640 1 -- 172.21.15.165:0/3069739675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc888116ba0 msgr2=0x7fc8881a7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:42.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.149+0000 7fc88dba0640 1 --2- 172.21.15.165:0/3069739675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc888116ba0 0x7fc8881a7a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc87800cbd0 tx=0x7fc87800a430 comp rx=0 tx=0).stop 2024-09-22T08:10:42.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.149+0000 7fc88dba0640 1 -- 172.21.15.165:0/3069739675 shutdown_connections 2024-09-22T08:10:42.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.149+0000 7fc88dba0640 1 --2- 172.21.15.165:0/3069739675 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc87403e6f0 0x7fc874040bb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:42.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.149+0000 7fc88dba0640 1 --2- 172.21.15.165:0/3069739675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc888116ba0 0x7fc8881a7a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:42.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.149+0000 7fc88dba0640 1 -- 172.21.15.165:0/3069739675 >> 172.21.15.165:0/3069739675 conn(0x7fc88806f850 msgr2=0x7fc88811bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:42.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.149+0000 7fc88dba0640 1 -- 172.21.15.165:0/3069739675 shutdown_connections 2024-09-22T08:10:42.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.149+0000 7fc88dba0640 1 -- 172.21.15.165:0/3069739675 wait complete. 2024-09-22T08:10:42.171 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-22T08:10:42.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.274+0000 7f2fc2eef640 1 Processor -- start 2024-09-22T08:10:42.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.274+0000 7f2fc2eef640 1 -- start start 2024-09-22T08:10:42.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.275+0000 7f2fc2eef640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2fbc116ba0 0x7f2fbc116f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:42.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.275+0000 7f2fc2eef640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fbc117670 con 0x7f2fbc112da0 2024-09-22T08:10:42.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.275+0000 7f2fc2eef640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2fbc113960 con 0x7f2fbc116ba0 2024-09-22T08:10:42.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.275+0000 7f2fc0c8b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2fbc116ba0 0x7f2fbc116f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:42.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.275+0000 7f2fbbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2fbc112da0 0x7f2fbc113250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:56792/0 (socket says 172.21.15.165:56792) 2024-09-22T08:10:42.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.275+0000 7f2fc0c8b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2fbc116ba0 0x7f2fbc116f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46210/0 (socket says 172.21.15.165:46210) 2024-09-22T08:10:42.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.275+0000 7f2fbbfff640 1 -- 172.21.15.165:0/887735375 learned_addr learned my addr 172.21.15.165:0/887735375 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:10:42.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.275+0000 7f2fc0c8b640 1 -- 172.21.15.165:0/887735375 >> v1:172.21.15.53:6789/0 conn(0x7f2fbc112da0 legacy=0x7f2fbc113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:42.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.275+0000 7f2fc0c8b640 1 -- 172.21.15.165:0/887735375 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc113b10 con 0x7f2fbc116ba0 2024-09-22T08:10:42.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.276+0000 7f2fc0c8b640 1 --2- 172.21.15.165:0/887735375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc116ba0 0x7f2fbc116f80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009720 tx=0x7f2fb402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786187d334b4415d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:42.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.276+0000 7f2fbb7fe640 1 -- 172.21.15.165:0/887735375 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb4037070 con 0x7f2fbc116ba0 2024-09-22T08:10:42.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.276+0000 7f2fbb7fe640 1 -- 172.21.15.165:0/887735375 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb402ad90 con 0x7f2fbc116ba0 2024-09-22T08:10:42.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.276+0000 7f2fbb7fe640 1 -- 172.21.15.165:0/887735375 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb4032590 con 0x7f2fbc116ba0 2024-09-22T08:10:42.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.277+0000 7f2fc2eef640 1 -- 172.21.15.165:0/887735375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc116ba0 msgr2=0x7f2fbc116f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:42.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.277+0000 7f2fc2eef640 1 --2- 172.21.15.165:0/887735375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc116ba0 0x7f2fbc116f80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009720 tx=0x7f2fb402a110 comp rx=0 tx=0).stop 2024-09-22T08:10:42.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.277+0000 7f2fc2eef640 1 -- 172.21.15.165:0/887735375 shutdown_connections 2024-09-22T08:10:42.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.277+0000 7f2fc2eef640 1 --2- 172.21.15.165:0/887735375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc116ba0 0x7f2fbc116f80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:42.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.277+0000 7f2fc2eef640 1 -- 172.21.15.165:0/887735375 >> 172.21.15.165:0/887735375 conn(0x7f2fbc06f850 msgr2=0x7f2fbc06fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:42.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.277+0000 7f2fc2eef640 1 -- 172.21.15.165:0/887735375 shutdown_connections 2024-09-22T08:10:42.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.277+0000 7f2fc2eef640 1 -- 172.21.15.165:0/887735375 wait complete. 2024-09-22T08:10:42.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.278+0000 7f2fc2eef640 1 Processor -- start 2024-09-22T08:10:42.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.278+0000 7f2fc2eef640 1 -- start start 2024-09-22T08:10:42.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.278+0000 7f2fc2eef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc112da0 0x7f2fbc1a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.278+0000 7f2fc2eef640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc11efc0 con 0x7f2fbc112da0 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.278+0000 7f2fc0c8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc112da0 0x7f2fbc1a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.278+0000 7f2fc0c8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc112da0 0x7f2fbc1a7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46214/0 (socket says 172.21.15.165:46214) 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.278+0000 7f2fc0c8b640 1 -- 172.21.15.165:0/3306250803 learned_addr learned my addr 172.21.15.165:0/3306250803 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.279+0000 7f2fc0c8b640 1 -- 172.21.15.165:0/3306250803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc1a7ee0 con 0x7f2fbc112da0 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.279+0000 7f2fc0c8b640 1 --2- 172.21.15.165:0/3306250803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc112da0 0x7f2fbc1a7910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2fb402a150 tx=0x7f2fb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.279+0000 7f2fb97fa640 1 -- 172.21.15.165:0/3306250803 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb4041070 con 0x7f2fbc112da0 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.279+0000 7f2fb97fa640 1 -- 172.21.15.165:0/3306250803 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb4032e30 con 0x7f2fbc112da0 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.279+0000 7f2fc2eef640 1 -- 172.21.15.165:0/3306250803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc1a81d0 con 0x7f2fbc112da0 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.279+0000 7f2fb97fa640 1 -- 172.21.15.165:0/3306250803 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb4037040 con 0x7f2fbc112da0 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.279+0000 7f2fc2eef640 1 -- 172.21.15.165:0/3306250803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc1ad3a0 con 0x7f2fbc112da0 2024-09-22T08:10:42.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.280+0000 7f2fc2eef640 1 -- 172.21.15.165:0/3306250803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fbc1a8510 con 0x7f2fbc112da0 2024-09-22T08:10:42.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.280+0000 7f2fb97fa640 1 -- 172.21.15.165:0/3306250803 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2fb4044070 con 0x7f2fbc112da0 2024-09-22T08:10:42.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.280+0000 7f2fb97fa640 1 --2- 172.21.15.165:0/3306250803 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03e6f0 0x7f2f9c040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:42.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.280+0000 7f2fb97fa640 1 -- 172.21.15.165:0/3306250803 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4300+0+0 (secure 0 0 0) 0x7f2fb40739c0 con 0x7f2fbc112da0 2024-09-22T08:10:42.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.281+0000 7f2fbbfff640 1 --2- 172.21.15.165:0/3306250803 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03e6f0 0x7f2f9c040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:42.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.281+0000 7f2fbbfff640 1 --2- 172.21.15.165:0/3306250803 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03e6f0 0x7f2f9c040bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2fac002060 tx=0x7f2fac001650 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:42.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.286+0000 7f2fb97fa640 1 -- 172.21.15.165:0/3306250803 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2fb403cdf0 con 0x7f2fbc112da0 2024-09-22T08:10:42.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:42.463+0000 7f2fc2eef640 1 -- 172.21.15.165:0/3306250803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f2fbc117000 con 0x7f2fbc112da0 2024-09-22T08:10:43.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.147+0000 7f2fb97fa640 1 -- 172.21.15.165:0/3306250803 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7f2fb404ed60 con 0x7f2fbc112da0 2024-09-22T08:10:43.148 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-22T08:10:43.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.155+0000 7f2fc2eef640 1 -- 172.21.15.165:0/3306250803 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03e6f0 msgr2=0x7f2f9c040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:43.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.155+0000 7f2fc2eef640 1 --2- 172.21.15.165:0/3306250803 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03e6f0 0x7f2f9c040bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2fac002060 tx=0x7f2fac001650 comp rx=0 tx=0).stop 2024-09-22T08:10:43.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.155+0000 7f2fc2eef640 1 -- 172.21.15.165:0/3306250803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc112da0 msgr2=0x7f2fbc1a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:43.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.155+0000 7f2fc2eef640 1 --2- 172.21.15.165:0/3306250803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc112da0 0x7f2fbc1a7910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2fb402a150 tx=0x7f2fb40046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:43.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.160+0000 7f2fc2eef640 1 -- 172.21.15.165:0/3306250803 shutdown_connections 2024-09-22T08:10:43.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.160+0000 7f2fc2eef640 1 --2- 172.21.15.165:0/3306250803 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03e6f0 0x7f2f9c040bb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:43.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.160+0000 7f2fc2eef640 1 --2- 172.21.15.165:0/3306250803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fbc112da0 0x7f2fbc1a7910 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:43.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.160+0000 7f2fc2eef640 1 -- 172.21.15.165:0/3306250803 >> 172.21.15.165:0/3306250803 conn(0x7f2fbc06f850 msgr2=0x7f2fbc111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:43.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.163+0000 7f2fc2eef640 1 -- 172.21.15.165:0/3306250803 shutdown_connections 2024-09-22T08:10:43.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.164+0000 7f2fc2eef640 1 -- 172.21.15.165:0/3306250803 wait complete. 2024-09-22T08:10:43.189 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-22T08:10:43.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.294+0000 7f1790a85640 1 Processor -- start 2024-09-22T08:10:43.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.294+0000 7f1790a85640 1 -- start start 2024-09-22T08:10:43.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.294+0000 7f1790a85640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f178c074ef0 0x7f178c10fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:43.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.294+0000 7f1790a85640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f178c1107e0 con 0x7f178c1102c0 2024-09-22T08:10:43.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.294+0000 7f1790a85640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f178c1109b0 con 0x7f178c074ef0 2024-09-22T08:10:43.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.294+0000 7f178a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f178c074ef0 0x7f178c10fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:43.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.295+0000 7f178a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f178c074ef0 0x7f178c10fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46226/0 (socket says 172.21.15.165:46226) 2024-09-22T08:10:43.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.295+0000 7f178a59c640 1 -- 172.21.15.165:0/3323213550 learned_addr learned my addr 172.21.15.165:0/3323213550 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:43.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.295+0000 7f178a59c640 1 -- 172.21.15.165:0/3323213550 >> v1:172.21.15.53:6789/0 conn(0x7f178c1102c0 legacy=0x7f178c11b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:43.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.295+0000 7f178a59c640 1 -- 172.21.15.165:0/3323213550 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c110b60 con 0x7f178c074ef0 2024-09-22T08:10:43.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f178a59c640 1 --2- 172.21.15.165:0/3323213550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 0x7f178c10fd80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f177c0097f0 tx=0x7f177c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b03592f059b31f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:43.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f1789d9b640 1 -- 172.21.15.165:0/3323213550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c037070 con 0x7f178c074ef0 2024-09-22T08:10:43.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f1789d9b640 1 -- 172.21.15.165:0/3323213550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c032440 con 0x7f178c074ef0 2024-09-22T08:10:43.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f1789d9b640 1 -- 172.21.15.165:0/3323213550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c02ae60 con 0x7f178c074ef0 2024-09-22T08:10:43.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f1790a85640 1 -- 172.21.15.165:0/3323213550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 msgr2=0x7f178c10fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:43.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f1790a85640 1 --2- 172.21.15.165:0/3323213550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 0x7f178c10fd80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f177c0097f0 tx=0x7f177c02a1e0 comp rx=0 tx=0).stop 2024-09-22T08:10:43.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f1790a85640 1 -- 172.21.15.165:0/3323213550 shutdown_connections 2024-09-22T08:10:43.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f1790a85640 1 --2- 172.21.15.165:0/3323213550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 0x7f178c10fd80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:43.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f1790a85640 1 -- 172.21.15.165:0/3323213550 >> 172.21.15.165:0/3323213550 conn(0x7f178c0702b0 msgr2=0x7f178c0726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:43.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f1790a85640 1 -- 172.21.15.165:0/3323213550 shutdown_connections 2024-09-22T08:10:43.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.296+0000 7f1790a85640 1 -- 172.21.15.165:0/3323213550 wait complete. 2024-09-22T08:10:43.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.297+0000 7f1790a85640 1 Processor -- start 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.297+0000 7f1790a85640 1 -- start start 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.297+0000 7f1790a85640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 0x7f178c110fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.297+0000 7f1790a85640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f178c11cd00 con 0x7f178c074ef0 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.298+0000 7f178a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 0x7f178c110fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.298+0000 7f178a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 0x7f178c110fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46242/0 (socket says 172.21.15.165:46242) 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.298+0000 7f178a59c640 1 -- 172.21.15.165:0/3419171179 learned_addr learned my addr 172.21.15.165:0/3419171179 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.298+0000 7f178a59c640 1 -- 172.21.15.165:0/3419171179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c112eb0 con 0x7f178c074ef0 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.298+0000 7f178a59c640 1 --2- 172.21.15.165:0/3419171179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 0x7f178c110fb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f177c02a220 tx=0x7f177c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.298+0000 7f1782ffd640 1 -- 172.21.15.165:0/3419171179 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c041070 con 0x7f178c074ef0 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.298+0000 7f1782ffd640 1 -- 172.21.15.165:0/3419171179 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c0307d0 con 0x7f178c074ef0 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.298+0000 7f1790a85640 1 -- 172.21.15.165:0/3419171179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178c111550 con 0x7f178c074ef0 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.298+0000 7f1782ffd640 1 -- 172.21.15.165:0/3419171179 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177c037040 con 0x7f178c074ef0 2024-09-22T08:10:43.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.299+0000 7f1790a85640 1 -- 172.21.15.165:0/3419171179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178c111af0 con 0x7f178c074ef0 2024-09-22T08:10:43.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.299+0000 7f1790a85640 1 -- 172.21.15.165:0/3419171179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f178c111e30 con 0x7f178c074ef0 2024-09-22T08:10:43.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.299+0000 7f1782ffd640 1 -- 172.21.15.165:0/3419171179 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f177c044070 con 0x7f178c074ef0 2024-09-22T08:10:43.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.300+0000 7f1782ffd640 1 --2- 172.21.15.165:0/3419171179 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f176c03e6c0 0x7f176c040b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:43.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.300+0000 7f1782ffd640 1 -- 172.21.15.165:0/3419171179 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4283+0+0 (secure 0 0 0) 0x7f177c073da0 con 0x7f178c074ef0 2024-09-22T08:10:43.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.300+0000 7f1783fff640 1 --2- 172.21.15.165:0/3419171179 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f176c03e6c0 0x7f176c040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:43.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.300+0000 7f1783fff640 1 --2- 172.21.15.165:0/3419171179 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f176c03e6c0 0x7f176c040b80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f17740015a0 tx=0x7f1774007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:43.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.304+0000 7f1782ffd640 1 -- 172.21.15.165:0/3419171179 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f177c03ce70 con 0x7f178c074ef0 2024-09-22T08:10:43.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:43.482+0000 7f1790a85640 1 -- 172.21.15.165:0/3419171179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f178c10fe00 con 0x7f178c074ef0 2024-09-22T08:10:44.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.150+0000 7f1782ffd640 1 -- 172.21.15.165:0/3419171179 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7f177c03bcc0 con 0x7f178c074ef0 2024-09-22T08:10:44.151 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'default.rgw.buckets.index' created 2024-09-22T08:10:44.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.154+0000 7f1790a85640 1 -- 172.21.15.165:0/3419171179 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f176c03e6c0 msgr2=0x7f176c040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:44.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.154+0000 7f1790a85640 1 --2- 172.21.15.165:0/3419171179 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f176c03e6c0 0x7f176c040b80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f17740015a0 tx=0x7f1774007a30 comp rx=0 tx=0).stop 2024-09-22T08:10:44.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.154+0000 7f1790a85640 1 -- 172.21.15.165:0/3419171179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 msgr2=0x7f178c110fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:44.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.154+0000 7f1790a85640 1 --2- 172.21.15.165:0/3419171179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 0x7f178c110fb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f177c02a220 tx=0x7f177c0046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:44.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.155+0000 7f1790a85640 1 -- 172.21.15.165:0/3419171179 shutdown_connections 2024-09-22T08:10:44.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.155+0000 7f1790a85640 1 --2- 172.21.15.165:0/3419171179 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f176c03e6c0 0x7f176c040b80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:44.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.155+0000 7f1790a85640 1 --2- 172.21.15.165:0/3419171179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f178c074ef0 0x7f178c110fb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:44.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.155+0000 7f1790a85640 1 -- 172.21.15.165:0/3419171179 >> 172.21.15.165:0/3419171179 conn(0x7f178c0702b0 msgr2=0x7f178c1181a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:44.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.156+0000 7f1790a85640 1 -- 172.21.15.165:0/3419171179 shutdown_connections 2024-09-22T08:10:44.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.157+0000 7f1790a85640 1 -- 172.21.15.165:0/3419171179 wait complete. 2024-09-22T08:10:44.176 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-22T08:10:44.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.275+0000 7f2e69e6a640 1 Processor -- start 2024-09-22T08:10:44.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.275+0000 7f2e69e6a640 1 -- start start 2024-09-22T08:10:44.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.275+0000 7f2e69e6a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e641150b0 0x7f2e64115490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:44.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.275+0000 7f2e69e6a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e64115b50 con 0x7f2e64113dc0 2024-09-22T08:10:44.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.275+0000 7f2e69e6a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2e64114980 con 0x7f2e641150b0 2024-09-22T08:10:44.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.275+0000 7f2e637fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e641150b0 0x7f2e64115490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:44.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.275+0000 7f2e62ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2e64113dc0 0x7f2e64114270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:56808/0 (socket says 172.21.15.165:56808) 2024-09-22T08:10:44.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.275+0000 7f2e62ffd640 1 -- 172.21.15.165:0/3430277657 learned_addr learned my addr 172.21.15.165:0/3430277657 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:10:44.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.276+0000 7f2e637fe640 1 -- 172.21.15.165:0/3430277657 >> v1:172.21.15.53:6789/0 conn(0x7f2e64113dc0 legacy=0x7f2e64114270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:44.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.276+0000 7f2e637fe640 1 -- 172.21.15.165:0/3430277657 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e64114b30 con 0x7f2e641150b0 2024-09-22T08:10:44.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.276+0000 7f2e637fe640 1 --2- 172.21.15.165:0/3430277657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e641150b0 0x7f2e64115490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009720 tx=0x7f2e5402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1337a671086d9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:44.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.277+0000 7f2e627fc640 1 -- 172.21.15.165:0/3430277657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e54037070 con 0x7f2e641150b0 2024-09-22T08:10:44.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.277+0000 7f2e627fc640 1 -- 172.21.15.165:0/3430277657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5402ad90 con 0x7f2e641150b0 2024-09-22T08:10:44.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.277+0000 7f2e627fc640 1 -- 172.21.15.165:0/3430277657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e54032590 con 0x7f2e641150b0 2024-09-22T08:10:44.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.277+0000 7f2e69e6a640 1 -- 172.21.15.165:0/3430277657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e641150b0 msgr2=0x7f2e64115490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:44.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.277+0000 7f2e69e6a640 1 --2- 172.21.15.165:0/3430277657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e641150b0 0x7f2e64115490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009720 tx=0x7f2e5402a110 comp rx=0 tx=0).stop 2024-09-22T08:10:44.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.277+0000 7f2e69e6a640 1 -- 172.21.15.165:0/3430277657 shutdown_connections 2024-09-22T08:10:44.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.277+0000 7f2e69e6a640 1 --2- 172.21.15.165:0/3430277657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e641150b0 0x7f2e64115490 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:44.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.277+0000 7f2e69e6a640 1 -- 172.21.15.165:0/3430277657 >> 172.21.15.165:0/3430277657 conn(0x7f2e640702b0 msgr2=0x7f2e640726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:44.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.277+0000 7f2e69e6a640 1 -- 172.21.15.165:0/3430277657 shutdown_connections 2024-09-22T08:10:44.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.277+0000 7f2e69e6a640 1 -- 172.21.15.165:0/3430277657 wait complete. 2024-09-22T08:10:44.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.278+0000 7f2e69e6a640 1 Processor -- start 2024-09-22T08:10:44.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.278+0000 7f2e69e6a640 1 -- start start 2024-09-22T08:10:44.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.278+0000 7f2e69e6a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e64113dc0 0x7f2e641a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:44.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.278+0000 7f2e69e6a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2e640745a0 con 0x7f2e64113dc0 2024-09-22T08:10:44.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.278+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e64113dc0 0x7f2e641a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:44.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.279+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e64113dc0 0x7f2e641a5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:46264/0 (socket says 172.21.15.165:46264) 2024-09-22T08:10:44.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.279+0000 7f2e637fe640 1 -- 172.21.15.165:0/1508127826 learned_addr learned my addr 172.21.15.165:0/1508127826 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.279+0000 7f2e637fe640 1 -- 172.21.15.165:0/1508127826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e641a5cf0 con 0x7f2e64113dc0 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.279+0000 7f2e637fe640 1 --2- 172.21.15.165:0/1508127826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e64113dc0 0x7f2e641a5720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2e5402a150 tx=0x7f2e540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.279+0000 7f2e4bfff640 1 -- 172.21.15.165:0/1508127826 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e54041070 con 0x7f2e64113dc0 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.279+0000 7f2e4bfff640 1 -- 172.21.15.165:0/1508127826 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e54032e30 con 0x7f2e64113dc0 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.279+0000 7f2e4bfff640 1 -- 172.21.15.165:0/1508127826 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e54037040 con 0x7f2e64113dc0 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.279+0000 7f2e69e6a640 1 -- 172.21.15.165:0/1508127826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e641a5fe0 con 0x7f2e64113dc0 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.279+0000 7f2e69e6a640 1 -- 172.21.15.165:0/1508127826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e641ab130 con 0x7f2e64113dc0 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.280+0000 7f2e69e6a640 1 -- 172.21.15.165:0/1508127826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e641a6320 con 0x7f2e64113dc0 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.280+0000 7f2e4bfff640 1 -- 172.21.15.165:0/1508127826 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2e54044070 con 0x7f2e64113dc0 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.281+0000 7f2e4bfff640 1 --2- 172.21.15.165:0/1508127826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2e5003e740 0x7f2e50040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.281+0000 7f2e4bfff640 1 -- 172.21.15.165:0/1508127826 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4647+0+0 (secure 0 0 0) 0x7f2e54073a40 con 0x7f2e64113dc0 2024-09-22T08:10:44.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.281+0000 7f2e62ffd640 1 --2- 172.21.15.165:0/1508127826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2e5003e740 0x7f2e50040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:10:44.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.281+0000 7f2e62ffd640 1 --2- 172.21.15.165:0/1508127826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2e5003e740 0x7f2e50040c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e58007fd0 tx=0x7f2e58007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:10:44.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.286+0000 7f2e4bfff640 1 -- 172.21.15.165:0/1508127826 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2e5404ed60 con 0x7f2e64113dc0 2024-09-22T08:10:44.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:44.464+0000 7f2e69e6a640 1 -- 172.21.15.165:0/1508127826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f2e64115510 con 0x7f2e64113dc0 2024-09-22T08:10:45.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.151+0000 7f2e4bfff640 1 -- 172.21.15.165:0/1508127826 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7f2e5403cce0 con 0x7f2e64113dc0 2024-09-22T08:10:45.152 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-22T08:10:45.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.155+0000 7f2e69e6a640 1 -- 172.21.15.165:0/1508127826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2e5003e740 msgr2=0x7f2e50040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:45.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.155+0000 7f2e69e6a640 1 --2- 172.21.15.165:0/1508127826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2e5003e740 0x7f2e50040c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e58007fd0 tx=0x7f2e58007aa0 comp rx=0 tx=0).stop 2024-09-22T08:10:45.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.155+0000 7f2e69e6a640 1 -- 172.21.15.165:0/1508127826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e64113dc0 msgr2=0x7f2e641a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:10:45.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.155+0000 7f2e69e6a640 1 --2- 172.21.15.165:0/1508127826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e64113dc0 0x7f2e641a5720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2e5402a150 tx=0x7f2e540046c0 comp rx=0 tx=0).stop 2024-09-22T08:10:45.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.155+0000 7f2e69e6a640 1 -- 172.21.15.165:0/1508127826 shutdown_connections 2024-09-22T08:10:45.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.155+0000 7f2e69e6a640 1 --2- 172.21.15.165:0/1508127826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2e5003e740 0x7f2e50040c00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:45.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.155+0000 7f2e69e6a640 1 --2- 172.21.15.165:0/1508127826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e64113dc0 0x7f2e641a5720 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:10:45.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.155+0000 7f2e69e6a640 1 -- 172.21.15.165:0/1508127826 >> 172.21.15.165:0/1508127826 conn(0x7f2e640702b0 msgr2=0x7f2e64072df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:10:45.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.160+0000 7f2e69e6a640 1 -- 172.21.15.165:0/1508127826 shutdown_connections 2024-09-22T08:10:45.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:10:45.160+0000 7f2e69e6a640 1 -- 172.21.15.165:0/1508127826 wait complete. 2024-09-22T08:10:45.182 DEBUG:tasks.rgw:Pools created 2024-09-22T08:10:45.182 INFO:tasks.rgw:Starting rgw... 2024-09-22T08:10:45.182 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-22T08:10:45.182 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-22T08:10:45.183 DEBUG:teuthology.orchestra.run.smithi165:> sudo echo -n http://smithi165.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-22T08:10:45.211 INFO:teuthology.orchestra.run.smithi165.stdout:http://smithi165.front.sepia.ceph.com:80 2024-09-22T08:10:45.212 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-22T08:10:45.279 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-22T08:10:45.279 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-22T08:10:45.322 INFO:tasks.rgw.client.0:Started 2024-09-22T08:10:45.322 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi165.front.sepia.ceph.com:80/ 2024-09-22T08:10:45.323 DEBUG:teuthology.orchestra.run.smithi165:> curl http://smithi165.front.sepia.ceph.com:80/ 2024-09-22T08:10:45.377 INFO:teuthology.orchestra.run.smithi165.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:10:45.377 INFO:teuthology.orchestra.run.smithi165.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:10:45.377 INFO:teuthology.orchestra.run.smithi165.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:10:45.378 INFO:teuthology.orchestra.run.smithi165.stderr:curl: (7) Failed to connect to smithi165.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:10:45.379 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:10:46.380 DEBUG:teuthology.orchestra.run.smithi165:> curl http://smithi165.front.sepia.ceph.com:80/ 2024-09-22T08:10:46.404 INFO:teuthology.orchestra.run.smithi165.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:10:46.404 INFO:teuthology.orchestra.run.smithi165.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:10:46.404 INFO:teuthology.orchestra.run.smithi165.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:10:46.405 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:10:46.405 INFO:teuthology.orchestra.run.smithi165.stderr:curl: (7) Failed to connect to smithi165.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:10:48.406 DEBUG:teuthology.orchestra.run.smithi165:> curl http://smithi165.front.sepia.ceph.com:80/ 2024-09-22T08:10:48.430 INFO:teuthology.orchestra.run.smithi165.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:10:48.430 INFO:teuthology.orchestra.run.smithi165.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:10:48.430 INFO:teuthology.orchestra.run.smithi165.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:10:48.430 INFO:teuthology.orchestra.run.smithi165.stderr:curl: (7) Failed to connect to smithi165.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:10:48.431 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:10:52.432 DEBUG:teuthology.orchestra.run.smithi165:> curl http://smithi165.front.sepia.ceph.com:80/ 2024-09-22T08:10:52.456 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:10:52.457 INFO:teuthology.orchestra.run.smithi165.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:10:52.457 INFO:teuthology.orchestra.run.smithi165.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:10:52.457 INFO:teuthology.orchestra.run.smithi165.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:10:52.457 INFO:teuthology.orchestra.run.smithi165.stderr:curl: (7) Failed to connect to smithi165.front.sepia.ceph.com port 80: Connection refused 2024-09-22T08:11:00.461 DEBUG:teuthology.orchestra.run.smithi165:> curl http://smithi165.front.sepia.ceph.com:80/ 2024-09-22T08:11:00.484 INFO:teuthology.orchestra.run.smithi165.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:11:00.485 INFO:teuthology.orchestra.run.smithi165.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:11:00.487 INFO:teuthology.orchestra.run.smithi165.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-22T08:11:00.487 INFO:teuthology.orchestra.run.smithi165.stdout:anonymous 2024-09-22T08:11:00.488 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-22T08:11:02.126 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-22T08:11:02.126 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-22T08:11:02.126 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-22T08:11:02.126 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-22T08:11:02.176 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:02.176 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:02.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.176+0000 7f08dbb24800 1 Processor -- start 2024-09-22T08:11:02.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.176+0000 7f08dbb24800 1 -- start start 2024-09-22T08:11:02.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.176+0000 7f08dbb24800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a8959babe0 0x55a8959bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.176+0000 7f08dbb24800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a89583fa20 con 0x55a8959284e0 2024-09-22T08:11:02.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.176+0000 7f08dbb24800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a89583f7d0 con 0x55a8959babe0 2024-09-22T08:11:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.177+0000 7f08d6fd1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a8959babe0 0x55a8959bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.177+0000 7f08d77d2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55a8959284e0 0x55a8959b94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33392/0 (socket says 172.21.15.165:33392) 2024-09-22T08:11:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.177+0000 7f08d6fd1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a8959babe0 0x55a8959bd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50292/0 (socket says 172.21.15.165:50292) 2024-09-22T08:11:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.177+0000 7f08d77d2640 1 -- 172.21.15.165:0/2516410567 learned_addr learned my addr 172.21.15.165:0/2516410567 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.177+0000 7f08d6fd1640 1 -- 172.21.15.165:0/2516410567 >> v1:172.21.15.53:6789/0 conn(0x55a8959284e0 legacy=0x55a8959b94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.177+0000 7f08d6fd1640 1 -- 172.21.15.165:0/2516410567 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8959be760 con 0x55a8959babe0 2024-09-22T08:11:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.179+0000 7f08d6fd1640 1 --2- 172.21.15.165:0/2516410567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959babe0 0x55a8959bd080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00a470 tx=0x7f08cc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87a670c5620ae11 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.179+0000 7f08d67d0640 1 -- 172.21.15.165:0/2516410567 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08cc053570 con 0x55a8959babe0 2024-09-22T08:11:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.179+0000 7f08d67d0640 1 -- 172.21.15.165:0/2516410567 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08cc058070 con 0x55a8959babe0 2024-09-22T08:11:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.179+0000 7f08d67d0640 1 -- 172.21.15.165:0/2516410567 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08cc053880 con 0x55a8959babe0 2024-09-22T08:11:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.180+0000 7f08dbb24800 1 -- 172.21.15.165:0/2516410567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959babe0 msgr2=0x55a8959bd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.180+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2516410567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959babe0 0x55a8959bd080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00a470 tx=0x7f08cc045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.180+0000 7f08dbb24800 1 -- 172.21.15.165:0/2516410567 shutdown_connections 2024-09-22T08:11:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.180+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2516410567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959babe0 0x55a8959bd080 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.180+0000 7f08dbb24800 1 -- 172.21.15.165:0/2516410567 >> 172.21.15.165:0/2516410567 conn(0x55a8959aeb90 msgr2=0x55a8959b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.180+0000 7f08dbb24800 1 -- 172.21.15.165:0/2516410567 shutdown_connections 2024-09-22T08:11:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.180+0000 7f08dbb24800 1 -- 172.21.15.165:0/2516410567 wait complete. 2024-09-22T08:11:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.195+0000 7f08dbb24800 1 Processor -- start 2024-09-22T08:11:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.195+0000 7f08dbb24800 1 -- start start 2024-09-22T08:11:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.195+0000 7f08dbb24800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aa6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.195+0000 7f08dbb24800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a89584cdd0 con 0x55a8959284e0 2024-09-22T08:11:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.196+0000 7f08d77d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aa6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.196+0000 7f08d77d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aa6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50308/0 (socket says 172.21.15.165:50308) 2024-09-22T08:11:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.196+0000 7f08d77d2640 1 -- 172.21.15.165:0/4120895316 learned_addr learned my addr 172.21.15.165:0/4120895316 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.196+0000 7f08d77d2640 1 -- 172.21.15.165:0/4120895316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a895aa6810 con 0x55a8959284e0 2024-09-22T08:11:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.196+0000 7f08d77d2640 1 --2- 172.21.15.165:0/4120895316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aa6220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f08c8001e40 tx=0x7f08c8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8039d3f8a85bccc server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.196+0000 7f07c560a640 1 -- 172.21.15.165:0/4120895316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08c8012020 con 0x55a8959284e0 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.196+0000 7f07c560a640 1 -- 172.21.15.165:0/4120895316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c800e5a0 con 0x55a8959284e0 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.197+0000 7f07c560a640 1 -- 172.21.15.165:0/4120895316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08c800e8a0 con 0x55a8959284e0 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.197+0000 7f08dbb24800 1 -- 172.21.15.165:0/4120895316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 msgr2=0x55a895aa6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.197+0000 7f08dbb24800 1 --2- 172.21.15.165:0/4120895316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aa6220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f08c8001e40 tx=0x7f08c8001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.197+0000 7f08dbb24800 1 -- 172.21.15.165:0/4120895316 shutdown_connections 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.197+0000 7f08dbb24800 1 --2- 172.21.15.165:0/4120895316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aa6220 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.197+0000 7f08dbb24800 1 -- 172.21.15.165:0/4120895316 >> 172.21.15.165:0/4120895316 conn(0x55a8959aeb90 msgr2=0x55a895aa1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.197+0000 7f08dbb24800 1 -- 172.21.15.165:0/4120895316 shutdown_connections 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.197+0000 7f08dbb24800 1 -- 172.21.15.165:0/4120895316 wait complete. 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.198+0000 7f08dbb24800 1 Processor -- start 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.198+0000 7f08dbb24800 1 -- start start 2024-09-22T08:11:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.198+0000 7f08dbb24800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aadd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.198+0000 7f08dbb24800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8959bda00 con 0x55a8959284e0 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.198+0000 7f08d77d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aadd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.198+0000 7f08d77d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aadd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50318/0 (socket says 172.21.15.165:50318) 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.198+0000 7f08d77d2640 1 -- 172.21.15.165:0/2004333864 learned_addr learned my addr 172.21.15.165:0/2004333864 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.199+0000 7f08d77d2640 1 -- 172.21.15.165:0/2004333864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a895aae2f0 con 0x55a8959284e0 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.199+0000 7f08d77d2640 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aadd90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08c800c010 tx=0x7f08c8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.199+0000 7f07c3e07640 1 -- 172.21.15.165:0/2004333864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08c8012030 con 0x55a8959284e0 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.199+0000 7f07c3e07640 1 -- 172.21.15.165:0/2004333864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c80014a0 con 0x55a8959284e0 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.199+0000 7f07c3e07640 1 -- 172.21.15.165:0/2004333864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08c801a7a0 con 0x55a8959284e0 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.199+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a895aae580 con 0x55a8959284e0 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.199+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a895aaef80 con 0x55a8959284e0 2024-09-22T08:11:02.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.200+0000 7f07c3e07640 1 -- 172.21.15.165:0/2004333864 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f08c8015020 con 0x55a8959284e0 2024-09-22T08:11:02.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.200+0000 7f07c3e07640 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07bc03d000 0x7f07bc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.200+0000 7f07c3e07640 1 -- 172.21.15.165:0/2004333864 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f08c8020030 con 0x55a8959284e0 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.201+0000 7f08d6fd1640 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07bc03d000 0x7f07bc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.201+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a8959babe0 0x55a895ab53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.201+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895aafb10 con 0x55a8959babe0 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.201+0000 7f08d7fd3640 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a8959babe0 0x55a895ab53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.201+0000 7f08d6fd1640 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07bc03d000 0x7f07bc03f4c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08cc057000 tx=0x7f08cc052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.201+0000 7f08d7fd3640 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a8959babe0 0x55a895ab53e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.201+0000 7f08d7fd3640 1 -- 172.21.15.165:0/2004333864 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08d000a4d0 con 0x55a8959babe0 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.201+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895aaf410 con 0x55a8959babe0 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.202+0000 7f08d7fd3640 1 -- 172.21.15.165:0/2004333864 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08d000a4d0 con 0x55a8959babe0 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.202+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895ab7850 0x55a895ab9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.202+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895aba310 con 0x55a895ab7850 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.202+0000 7f08d77d2640 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895ab7850 0x55a895ab9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.202+0000 7f08d77d2640 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895ab7850 0x55a895ab9c40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.202+0000 7f08d77d2640 1 -- 172.21.15.165:0/2004333864 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895ab7850 2024-09-22T08:11:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.202+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895ab66f0 con 0x55a8959babe0 2024-09-22T08:11:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.203+0000 7f08d7fd3640 1 -- 172.21.15.165:0/2004333864 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08d000a4d0 con 0x55a8959babe0 2024-09-22T08:11:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.203+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895ab6b90 con 0x55a8959babe0 2024-09-22T08:11:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.203+0000 7f08d7fd3640 1 -- 172.21.15.165:0/2004333864 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f08d000a4d0 con 0x55a8959babe0 2024-09-22T08:11:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.204+0000 7f08dbb24800 1 Processor -- start 2024-09-22T08:11:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.204+0000 7f08dbb24800 1 -- start start 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.204+0000 7f08dbb24800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ac8c90 0x55a895ac90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.204+0000 7f08dbb24800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8958abd50 con 0x55a895ac8c90 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.204+0000 7f08d7fd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ac8c90 0x55a895ac90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.204+0000 7f08d7fd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ac8c90 0x55a895ac90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50320/0 (socket says 172.21.15.165:50320) 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.204+0000 7f08d7fd3640 1 -- 172.21.15.165:0/3399306129 learned_addr learned my addr 172.21.15.165:0/3399306129 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.205+0000 7f08d7fd3640 1 -- 172.21.15.165:0/3399306129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a895ac96f0 con 0x55a895ac8c90 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.205+0000 7f08d7fd3640 1 --2- 172.21.15.165:0/3399306129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ac8c90 0x55a895ac90b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55a895ab5920 tx=0x7f08d0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.205+0000 7f07c1602640 1 -- 172.21.15.165:0/3399306129 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d0014450 con 0x55a895ac8c90 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.205+0000 7f07c1602640 1 -- 172.21.15.165:0/3399306129 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d00145f0 con 0x55a895ac8c90 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.205+0000 7f08dbb24800 1 -- 172.21.15.165:0/3399306129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a895ac9f20 con 0x55a895ac8c90 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.205+0000 7f07c1602640 1 -- 172.21.15.165:0/3399306129 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d0014910 con 0x55a895ac8c90 2024-09-22T08:11:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.205+0000 7f08dbb24800 1 -- 172.21.15.165:0/3399306129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a895aca4c0 con 0x55a895ac8c90 2024-09-22T08:11:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.206+0000 7f07c1602640 1 -- 172.21.15.165:0/3399306129 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f08d0011040 con 0x55a895ac8c90 2024-09-22T08:11:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.206+0000 7f07c1602640 1 --2- 172.21.15.165:0/3399306129 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07b003cfb0 0x7f07b003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.206+0000 7f07c1602640 1 -- 172.21.15.165:0/3399306129 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f08d001e070 con 0x55a895ac8c90 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.206+0000 7f08d77d2640 1 --2- 172.21.15.165:0/3399306129 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07b003cfb0 0x7f07b003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.207+0000 7f08dbb24800 1 Processor -- start 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.207+0000 7f08d77d2640 1 --2- 172.21.15.165:0/3399306129 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07b003cfb0 0x7f07b003f470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55a895ab59c0 tx=0x7f08c8052990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.207+0000 7f08dbb24800 1 -- start start 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.207+0000 7f08dbb24800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895ad5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.207+0000 7f08dbb24800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a895aa6c40 con 0x55a895ad5750 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.207+0000 7f08d7fd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895ad5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.207+0000 7f08d7fd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895ad5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50336/0 (socket says 172.21.15.165:50336) 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.207+0000 7f08d7fd3640 1 -- 172.21.15.165:0/3728491753 learned_addr learned my addr 172.21.15.165:0/3728491753 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f08d7fd3640 1 -- 172.21.15.165:0/3728491753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a895ad6120 con 0x55a895ad5750 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f08d7fd3640 1 --2- 172.21.15.165:0/3728491753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895ad5b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f08d0016fd0 tx=0x7f08d0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94a519d37424d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f07baffd640 1 -- 172.21.15.165:0/3728491753 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d004b070 con 0x55a895ad5750 2024-09-22T08:11:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f07baffd640 1 -- 172.21.15.165:0/3728491753 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d0051070 con 0x55a895ad5750 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f07baffd640 1 -- 172.21.15.165:0/3728491753 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d0053320 con 0x55a895ad5750 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f08dbb24800 1 -- 172.21.15.165:0/3728491753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 msgr2=0x55a895ad5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f08dbb24800 1 --2- 172.21.15.165:0/3728491753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895ad5b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f08d0016fd0 tx=0x7f08d0011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f08dbb24800 1 -- 172.21.15.165:0/3728491753 shutdown_connections 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f08dbb24800 1 --2- 172.21.15.165:0/3728491753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895ad5b30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f08dbb24800 1 -- 172.21.15.165:0/3728491753 >> 172.21.15.165:0/3728491753 conn(0x55a895ad1b50 msgr2=0x55a895acfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f08dbb24800 1 -- 172.21.15.165:0/3728491753 shutdown_connections 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.208+0000 7f08dbb24800 1 -- 172.21.15.165:0/3728491753 wait complete. 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.209+0000 7f08dbb24800 1 Processor -- start 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.209+0000 7f08dbb24800 1 -- start start 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.209+0000 7f08dbb24800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895adcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.209+0000 7f08dbb24800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a895ad6760 con 0x55a895ad5750 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.209+0000 7f08d7fd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895adcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.209+0000 7f08d7fd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895adcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50338/0 (socket says 172.21.15.165:50338) 2024-09-22T08:11:02.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.209+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 learned_addr learned my addr 172.21.15.165:0/129435890 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.210+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a895add260 con 0x55a895ad5750 2024-09-22T08:11:02.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.210+0000 7f08d7fd3640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895adcd00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08d0049040 tx=0x7f08d0054760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.210+0000 7f07b97fa640 1 -- 172.21.15.165:0/129435890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d004b040 con 0x55a895ad5750 2024-09-22T08:11:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.210+0000 7f07b97fa640 1 -- 172.21.15.165:0/129435890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d00168f0 con 0x55a895ad5750 2024-09-22T08:11:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.210+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a895add4f0 con 0x55a895ad5750 2024-09-22T08:11:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.210+0000 7f07b97fa640 1 -- 172.21.15.165:0/129435890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d0011480 con 0x55a895ad5750 2024-09-22T08:11:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.210+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a895ade080 con 0x55a895ad5750 2024-09-22T08:11:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.211+0000 7f07b97fa640 1 -- 172.21.15.165:0/129435890 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f08d0054be0 con 0x55a895ad5750 2024-09-22T08:11:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.211+0000 7f07b97fa640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07a003cf60 0x7f07a003f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.211+0000 7f07b97fa640 1 -- 172.21.15.165:0/129435890 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f08d004de00 con 0x55a895ad5750 2024-09-22T08:11:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.211+0000 7f08d77d2640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07a003cf60 0x7f07a003f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.211+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.211+0000 7f08dbb24800 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a895ae8810 0x55a895aeaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.211+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895aeb3f0 con 0x55a895ae8810 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08d6fd1640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a895ae8810 0x55a895aeaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08d77d2640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07a003cf60 0x7f07a003f420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55a895aba6f0 tx=0x7f08c804e070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08d6fd1640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a895ae8810 0x55a895aeaca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08dbb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08dbb24800 20 realm 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895aeb820 con 0x55a895ae8810 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08dbb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08dbb24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.212+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895aec0f0 con 0x55a895ae8810 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08dbb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895aec490 con 0x55a895ae8810 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08dbb24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08dbb24800 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895aed1f0 0x55a895aef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895aefb20 con 0x55a895aed1f0 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08d7fd3640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895aed1f0 0x55a895aef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.213+0000 7f08d7fd3640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895aed1f0 0x55a895aef5e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.214+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.214+0000 7f08dbb24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.214+0000 7f08dbb24800 20 searching for the correct realm 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.214+0000 7f08dbb24800 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55a895af1b60 0x55a895af4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.214+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895af1b60 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.214+0000 7f08d77d2640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55a895af1b60 0x55a895af4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.214+0000 7f08d77d2640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55a895af1b60 0x55a895af4020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.214+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.214+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895aed1f0 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.215+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.215+0000 7f08d7fd3640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f08d0037070 0x7f08d00459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.215+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x7f08d0037070 2024-09-22T08:11:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.215+0000 7f08d6fd1640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f08d0037070 0x7f08d00459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.216+0000 7f08d6fd1640 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f08d0037070 0x7f08d00459a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.216+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.216+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895ae8810 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.216+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.216+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895ae8810 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.216+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.216+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x7f08d0037070 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.217+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.217+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x7f08d0037070 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.217+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.217+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895aed1f0 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.217+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.217+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895af1b60 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.217+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.218+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895ae8810 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.218+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.218+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x7f08d0037070 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.218+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.218+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895ae8810 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.218+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.218+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895aed1f0 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.219+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.219+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895af1b60 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.219+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.219+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895af1b60 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.219+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.219+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x7f08d0037070 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.219+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.219+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895af1b60 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.220+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.220+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895af1b60 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.220+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.220+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895ae8810 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.220+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.220+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895ae8810 2024-09-22T08:11:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.220+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.220+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x7f08d0037070 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.221+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.221+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895af1b60 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.221+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.221+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895aed1f0 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.221+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.221+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895ae8810 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.222+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.222+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x7f08d0037070 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.222+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.222+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895af1b60 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.223+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.223+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x7f08d0037070 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.223+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.223+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895aed1f0 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.223+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.223+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895af1b60 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.223+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.223+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x7f08d0037070 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895ae8810 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af46f0 con 0x55a895aed1f0 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08dbb24800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08dbb24800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08dbb24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08dbb24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08dbb24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08dbb24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.224+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895af0590 con 0x55a895ae8810 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895af01a0 con 0x55a895ae8810 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895af0f00 con 0x55a895ae8810 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 20 zone default found 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 4 Realm: () 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 20 zonegroup default 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.225+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895af0a60 con 0x7f08d0037070 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08dbb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895af6b60 con 0x55a895af1b60 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08dbb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08dbb24800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895af6f50 con 0x55a895af1b60 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08dbb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08dbb24800 20 started sync module instance, tier type = 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08dbb24800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.226+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895aed1f0 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.227+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.227+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94182554166048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5b60 con 0x55a895aed1f0 2024-09-22T08:11:02.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.227+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af7ea0 con 0x55a895ae8810 2024-09-22T08:11:02.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.228+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94182554166048] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.229+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.229+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94182554170256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af7e60 con 0x55a895ae8810 2024-09-22T08:11:02.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.229+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af8930 con 0x55a895af1b60 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.230+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94182554170256] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.231+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.231+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94182554171824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af7dd0 con 0x55a895af1b60 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.231+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af97f0 con 0x55a895aed1f0 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.234+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94182554171824] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.234+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.234+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94182554178368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af9c10 con 0x55a895aed1f0 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.234+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afa5d0 con 0x55a895ae8810 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.236+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.236+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94182554181920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afa540 con 0x55a895ae8810 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.236+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afb550 con 0x7f08d0037070 2024-09-22T08:11:02.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.237+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94182554178368] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.238+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.238+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94182554185824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afb550 con 0x7f08d0037070 2024-09-22T08:11:02.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.238+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afbf90 con 0x7f08d0037070 2024-09-22T08:11:02.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.238+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94182554181920] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.239+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.239+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94182554184128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afbf90 con 0x7f08d0037070 2024-09-22T08:11:02.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.239+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afc990 con 0x7f08d0037070 2024-09-22T08:11:02.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.239+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94182554185824] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.240+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.240+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94182554184128] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.240+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94182554179424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afc950 con 0x7f08d0037070 2024-09-22T08:11:02.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.240+0000 7f08dbb24800 20 add_watcher() i=0 2024-09-22T08:11:02.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.240+0000 7f08dbb24800 20 add_watcher() i=1 2024-09-22T08:11:02.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.240+0000 7f08dbb24800 20 add_watcher() i=2 2024-09-22T08:11:02.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.240+0000 7f08dbb24800 20 add_watcher() i=3 2024-09-22T08:11:02.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.240+0000 7f08dbb24800 20 add_watcher() i=4 2024-09-22T08:11:02.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.240+0000 7f08dbb24800 20 add_watcher() i=5 2024-09-22T08:11:02.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.240+0000 7f08dbb24800 20 add_watcher() i=6 2024-09-22T08:11:02.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.241+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94182554179424] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.241+0000 7f08dbb24800 20 add_watcher() i=7 2024-09-22T08:11:02.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.241+0000 7f08dbb24800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:02.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.241+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a895aff980 con 0x55a895ae8810 2024-09-22T08:11:02.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.242+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.242+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94182554191008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afce40 con 0x55a895ae8810 2024-09-22T08:11:02.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.243+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94182554191008] v32'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.243+0000 7f078dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:02.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.243+0000 7f08dbb24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:02.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.243+0000 7f08dbb24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:02.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.243+0000 7f08dbb24800 5 note: GC not initialized 2024-09-22T08:11:02.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.243+0000 7f078cfe1640 20 reqs_thread_entry: start 2024-09-22T08:11:02.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.243+0000 7f08dbb24800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:02.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.243+0000 7f08dbb24800 20 Filter name: none 2024-09-22T08:11:02.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.244+0000 7f07067fc640 20 reqs_thread_entry: start 2024-09-22T08:11:02.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.244+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895b323b0 con 0x55a895af1b60 2024-09-22T08:11:02.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.244+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.244+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895b323b0 con 0x55a895af1b60 2024-09-22T08:11:02.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.244+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.244+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895b323b0 con 0x55a895ae8810 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.244+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.244+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af0f00 con 0x55a895ae8810 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.245+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.245+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af0f00 con 0x55a895aed1f0 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.245+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.245+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895af1b60 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.245+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.245+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895ae8810 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.245+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.245+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895af1b60 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.246+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.246+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895aed1f0 2024-09-22T08:11:02.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.246+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.246+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895af1b60 2024-09-22T08:11:02.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.246+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.246+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895ae8810 2024-09-22T08:11:02.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.246+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.246+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x7f08d0037070 2024-09-22T08:11:02.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.247+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.247+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x7f08d0037070 2024-09-22T08:11:02.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.247+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.247+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895af1b60 2024-09-22T08:11:02.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.247+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.247+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x7f08d0037070 2024-09-22T08:11:02.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.248+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.248+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x7f08d0037070 2024-09-22T08:11:02.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.248+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.248+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x7f08d0037070 2024-09-22T08:11:02.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.248+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.248+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895af1b60 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.248+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.248+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895aed1f0 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.249+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.249+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895ae8810 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.249+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.249+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895ae8810 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.249+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.249+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895af1b60 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.249+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.249+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895aed1f0 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.250+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.250+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x7f08d0037070 2024-09-22T08:11:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.250+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.250+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895ae8810 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.250+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.250+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x7f08d0037070 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.251+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.251+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895af1b60 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.251+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.251+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895aed1f0 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.251+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.251+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x7f08d0037070 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.251+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.251+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895ae8810 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.252+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.252+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895af1b60 2024-09-22T08:11:02.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.252+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.252+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a895af5f00 con 0x55a895aed1f0 2024-09-22T08:11:02.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.252+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.253+0000 7f078dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:02.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.253+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94182554191008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af0f00 con 0x55a895ae8810 2024-09-22T08:11:02.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.254+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94182554191008] v32'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.254+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94182554166048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afc4a0 con 0x55a895aed1f0 2024-09-22T08:11:02.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.255+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94182554166048] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.255+0000 7f08dbb24800 20 remove_watcher() i=0 2024-09-22T08:11:02.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.255+0000 7f08dbb24800 2 removed watcher, disabling cache 2024-09-22T08:11:02.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.255+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94182554170256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afc4a0 con 0x55a895ae8810 2024-09-22T08:11:02.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.256+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94182554170256] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.256+0000 7f08dbb24800 20 remove_watcher() i=1 2024-09-22T08:11:02.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.256+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94182554171824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af7390 con 0x55a895af1b60 2024-09-22T08:11:02.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.258+0000 7f08d77d2640 1 -- 172.21.15.165:0/129435890 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94182554171824] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08c80187b0 con 0x55a895af1b60 2024-09-22T08:11:02.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.258+0000 7f08dbb24800 20 remove_watcher() i=2 2024-09-22T08:11:02.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.258+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94182554178368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afc4a0 con 0x55a895aed1f0 2024-09-22T08:11:02.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.259+0000 7f08d7fd3640 1 -- 172.21.15.165:0/129435890 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94182554178368] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d002a070 con 0x55a895aed1f0 2024-09-22T08:11:02.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.259+0000 7f08dbb24800 20 remove_watcher() i=3 2024-09-22T08:11:02.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.259+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94182554181920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af79b0 con 0x55a895ae8810 2024-09-22T08:11:02.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.261+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94182554181920] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x55a895ae8810 2024-09-22T08:11:02.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.261+0000 7f08dbb24800 20 remove_watcher() i=4 2024-09-22T08:11:02.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.261+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94182554185824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895af9340 con 0x7f08d0037070 2024-09-22T08:11:02.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.262+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94182554185824] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.262+0000 7f08dbb24800 20 remove_watcher() i=5 2024-09-22T08:11:02.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.262+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94182554184128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afc4a0 con 0x7f08d0037070 2024-09-22T08:11:02.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.263+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94182554184128] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.263+0000 7f08dbb24800 20 remove_watcher() i=6 2024-09-22T08:11:02.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.263+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94182554179424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a895afa120 con 0x7f08d0037070 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94182554179424] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08cc051070 con 0x7f08d0037070 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 20 remove_watcher() i=7 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f08d0037070 msgr2=0x7f08d00459a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f08d0037070 0x7f08d00459a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a895ae8810 msgr2=0x55a895aeaca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a895ae8810 0x55a895aeaca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895aed1f0 msgr2=0x55a895aef5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895aed1f0 0x55a895aef5e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55a895af1b60 msgr2=0x55a895af4020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55a895af1b60 0x55a895af4020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07a003cf60 msgr2=0x7f07a003f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07a003cf60 0x7f07a003f420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55a895aba6f0 tx=0x7f08c804e070 comp rx=0 tx=0).stop 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 msgr2=0x55a895adcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08d6fd1640 1 -- 172.21.15.165:0/129435890 reap_dead start 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895adcd00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08d0049040 tx=0x7f08d0054760 comp rx=0 tx=0).stop 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 shutdown_connections 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 --2- 172.21.15.165:0/129435890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ad5750 0x55a895adcd00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 >> 172.21.15.165:0/129435890 conn(0x55a895ad1b50 msgr2=0x55a895acfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 shutdown_connections 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.264+0000 7f08dbb24800 1 -- 172.21.15.165:0/129435890 wait complete. 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/3399306129 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07b003cfb0 msgr2=0x7f07b003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/3399306129 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07b003cfb0 0x7f07b003f470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55a895ab59c0 tx=0x7f08c8052990 comp rx=0 tx=0).stop 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/3399306129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ac8c90 msgr2=0x55a895ac90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/3399306129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ac8c90 0x55a895ac90b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55a895ab5920 tx=0x7f08d0018830 comp rx=0 tx=0).stop 2024-09-22T08:11:02.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/3399306129 shutdown_connections 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/3399306129 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07b003cfb0 0x7f07b003f470 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/3399306129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a895ac8c90 0x55a895ac90b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/3399306129 >> 172.21.15.165:0/3399306129 conn(0x55a895abd040 msgr2=0x55a895abd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/3399306129 shutdown_connections 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/3399306129 wait complete. 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a8959babe0 msgr2=0x55a895ab53e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a8959babe0 0x55a895ab53e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895ab7850 msgr2=0x55a895ab9c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895ab7850 0x55a895ab9c40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07bc03d000 msgr2=0x7f07bc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07bc03d000 0x7f07bc03f4c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08cc057000 tx=0x7f08cc052000 comp rx=0 tx=0).stop 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 msgr2=0x55a895aadd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aadd90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08c800c010 tx=0x7f08c8000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 shutdown_connections 2024-09-22T08:11:02.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a895ab7850 0x55a895ab9c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a8959babe0 0x55a895ab53e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f07bc03d000 0x7f07bc03f4c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 --2- 172.21.15.165:0/2004333864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8959284e0 0x55a895aadd90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 >> 172.21.15.165:0/2004333864 conn(0x55a8959aeb90 msgr2=0x55a895aa7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 shutdown_connections 2024-09-22T08:11:02.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.265+0000 7f08dbb24800 1 -- 172.21.15.165:0/2004333864 wait complete. 2024-09-22T08:11:02.340 INFO:teuthology.orchestra.run.smithi165.stdout:[] 2024-09-22T08:11:02.340 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:11:02.341 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-22T08:11:02.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-22T08:11:02.341 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-22T08:11:02.386 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:02.386 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:02.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.386+0000 7f3ed7a14800 1 Processor -- start 2024-09-22T08:11:02.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.386+0000 7f3ed7a14800 1 -- start start 2024-09-22T08:11:02.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.386+0000 7f3ed7a14800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55acbc72c9d0 0x55acbc72ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.386+0000 7f3ed7a14800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55acbc5b3a20 con 0x55acbc69bd30 2024-09-22T08:11:02.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.386+0000 7f3ed7a14800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55acbc5b37d0 con 0x55acbc72c9d0 2024-09-22T08:11:02.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.386+0000 7f3ed29df640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55acbc72c9d0 0x55acbc72ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.386+0000 7f3ed31e0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55acbc69bd30 0x55acbc72b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33402/0 (socket says 172.21.15.165:33402) 2024-09-22T08:11:02.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.386+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2255467272 learned_addr learned my addr 172.21.15.165:0/2255467272 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:02.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.387+0000 7f3ed21de640 1 -- 172.21.15.165:0/2255467272 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631503380 0 0) 0x55acbc5b3a20 con 0x55acbc69bd30 2024-09-22T08:11:02.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.387+0000 7f3ed21de640 1 -- 172.21.15.165:0/2255467272 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ec0001e10 con 0x55acbc69bd30 2024-09-22T08:11:02.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.387+0000 7f3ed29df640 1 -- 172.21.15.165:0/2255467272 >> v1:172.21.15.53:6789/0 conn(0x55acbc69bd30 legacy=0x55acbc72b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.387+0000 7f3ed29df640 1 -- 172.21.15.165:0/2255467272 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acbc730570 con 0x55acbc72c9d0 2024-09-22T08:11:02.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed29df640 1 --2- 172.21.15.165:0/2255467272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 0x55acbc72ee90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00a470 tx=0x7f3ebc045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb98a665f75264e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed21de640 1 -- 172.21.15.165:0/2255467272 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc059070 con 0x55acbc72c9d0 2024-09-22T08:11:02.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed21de640 1 -- 172.21.15.165:0/2255467272 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc054570 con 0x55acbc72c9d0 2024-09-22T08:11:02.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed21de640 1 -- 172.21.15.165:0/2255467272 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc054870 con 0x55acbc72c9d0 2024-09-22T08:11:02.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2255467272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 msgr2=0x55acbc72ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2255467272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 0x55acbc72ee90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00a470 tx=0x7f3ebc045920 comp rx=0 tx=0).stop 2024-09-22T08:11:02.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2255467272 shutdown_connections 2024-09-22T08:11:02.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2255467272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 0x55acbc72ee90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2255467272 >> 172.21.15.165:0/2255467272 conn(0x55acbc722bb0 msgr2=0x55acbc725010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2255467272 shutdown_connections 2024-09-22T08:11:02.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.389+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2255467272 wait complete. 2024-09-22T08:11:02.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.403+0000 7f3ed7a14800 1 Processor -- start 2024-09-22T08:11:02.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.403+0000 7f3ed7a14800 1 -- start start 2024-09-22T08:11:02.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.403+0000 7f3ed7a14800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc69bd30 0x55acbc817ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.403+0000 7f3ed7a14800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55acbc5c0dd0 con 0x55acbc69bd30 2024-09-22T08:11:02.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.404+0000 7f3ed31e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc69bd30 0x55acbc817ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.404+0000 7f3ed31e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc69bd30 0x55acbc817ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50354/0 (socket says 172.21.15.165:50354) 2024-09-22T08:11:02.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.404+0000 7f3ed31e0640 1 -- 172.21.15.165:0/1538805274 learned_addr learned my addr 172.21.15.165:0/1538805274 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.404+0000 7f3ed31e0640 1 -- 172.21.15.165:0/1538805274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acbc818490 con 0x55acbc69bd30 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.404+0000 7f3ed31e0640 1 --2- 172.21.15.165:0/1538805274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc69bd30 0x55acbc817ea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4001e30 tx=0x7f3ec400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3783fa0b151aa46c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.404+0000 7f3dc160a640 1 -- 172.21.15.165:0/1538805274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec4012020 con 0x55acbc69bd30 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.404+0000 7f3dc160a640 1 -- 172.21.15.165:0/1538805274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec400e470 con 0x55acbc69bd30 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.404+0000 7f3dc160a640 1 -- 172.21.15.165:0/1538805274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec400e790 con 0x55acbc69bd30 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.405+0000 7f3ed7a14800 1 -- 172.21.15.165:0/1538805274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc69bd30 msgr2=0x55acbc817ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.405+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/1538805274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc69bd30 0x55acbc817ea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4001e30 tx=0x7f3ec400b780 comp rx=0 tx=0).stop 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.405+0000 7f3ed7a14800 1 -- 172.21.15.165:0/1538805274 shutdown_connections 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.405+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/1538805274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc69bd30 0x55acbc817ea0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.405+0000 7f3ed7a14800 1 -- 172.21.15.165:0/1538805274 >> 172.21.15.165:0/1538805274 conn(0x55acbc722bb0 msgr2=0x55acbc813820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.405+0000 7f3ed7a14800 1 -- 172.21.15.165:0/1538805274 shutdown_connections 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.405+0000 7f3ed7a14800 1 -- 172.21.15.165:0/1538805274 wait complete. 2024-09-22T08:11:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.405+0000 7f3ed7a14800 1 Processor -- start 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.406+0000 7f3ed7a14800 1 -- start start 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.406+0000 7f3ed7a14800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 0x55acbc728830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.406+0000 7f3ed7a14800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55acbc72f810 con 0x55acbc72c9d0 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.406+0000 7f3ed31e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 0x55acbc728830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.406+0000 7f3ed31e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 0x55acbc728830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50362/0 (socket says 172.21.15.165:50362) 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.406+0000 7f3ed31e0640 1 -- 172.21.15.165:0/3316848296 learned_addr learned my addr 172.21.15.165:0/3316848296 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.406+0000 7f3ed31e0640 1 -- 172.21.15.165:0/3316848296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acbc728d90 con 0x55acbc72c9d0 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.406+0000 7f3ed31e0640 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 0x55acbc728830 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4000c00 tx=0x7f3ec40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.407+0000 7f3dbfe07640 1 -- 172.21.15.165:0/3316848296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec4012030 con 0x55acbc72c9d0 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.407+0000 7f3dbfe07640 1 -- 172.21.15.165:0/3316848296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec4018770 con 0x55acbc72c9d0 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.407+0000 7f3dbfe07640 1 -- 172.21.15.165:0/3316848296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec4018a90 con 0x55acbc72c9d0 2024-09-22T08:11:02.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.407+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acbc727140 con 0x55acbc72c9d0 2024-09-22T08:11:02.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.407+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acbc727700 con 0x55acbc72c9d0 2024-09-22T08:11:02.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.408+0000 7f3dbfe07640 1 -- 172.21.15.165:0/3316848296 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3ec4015020 con 0x55acbc72c9d0 2024-09-22T08:11:02.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.408+0000 7f3dbfe07640 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3db803cfb0 0x7f3db803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.408+0000 7f3dbfe07640 1 -- 172.21.15.165:0/3316848296 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3ec4020070 con 0x55acbc72c9d0 2024-09-22T08:11:02.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.408+0000 7f3ed29df640 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3db803cfb0 0x7f3db803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.408+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc8270f0 0x55acbc8294e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.408+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc829a20 con 0x55acbc8270f0 2024-09-22T08:11:02.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.408+0000 7f3ed39e1640 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc8270f0 0x55acbc8294e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.408+0000 7f3ed29df640 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3db803cfb0 0x7f3db803f470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55acbc69b020 tx=0x7f3ebc050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.409+0000 7f3ed39e1640 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc8270f0 0x55acbc8294e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.409+0000 7f3ed39e1640 1 -- 172.21.15.165:0/3316848296 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ecc00a4d0 con 0x55acbc8270f0 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.409+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc727c00 con 0x55acbc8270f0 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.409+0000 7f3ed39e1640 1 -- 172.21.15.165:0/3316848296 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ecc00a4d0 con 0x55acbc8270f0 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.409+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc82bd10 0x55acbc82e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.409+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc82e7d0 con 0x55acbc82bd10 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.409+0000 7f3ed31e0640 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc82bd10 0x55acbc82e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.410+0000 7f3ed31e0640 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc82bd10 0x55acbc82e100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.410+0000 7f3ed31e0640 1 -- 172.21.15.165:0/3316848296 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ec4017900 con 0x55acbc82bd10 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.410+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc82abb0 con 0x55acbc8270f0 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.410+0000 7f3ed39e1640 1 -- 172.21.15.165:0/3316848296 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ecc00a4d0 con 0x55acbc8270f0 2024-09-22T08:11:02.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.410+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc82b030 con 0x55acbc8270f0 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.411+0000 7f3ed39e1640 1 -- 172.21.15.165:0/3316848296 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3ecc00a4d0 con 0x55acbc8270f0 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.411+0000 7f3ed7a14800 1 Processor -- start 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.411+0000 7f3ed7a14800 1 -- start start 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.411+0000 7f3ed7a14800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc83d140 0x55acbc83d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.411+0000 7f3ed7a14800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55acbc61fd50 con 0x55acbc83d140 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.411+0000 7f3ed39e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc83d140 0x55acbc83d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.411+0000 7f3ed39e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc83d140 0x55acbc83d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50366/0 (socket says 172.21.15.165:50366) 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.411+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2800024634 learned_addr learned my addr 172.21.15.165:0/2800024634 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.412+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2800024634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acbc83dba0 con 0x55acbc83d140 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.412+0000 7f3ed39e1640 1 --2- 172.21.15.165:0/2800024634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc83d140 0x55acbc83d560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55acbc829dc0 tx=0x7f3ecc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.412+0000 7f3dbd602640 1 -- 172.21.15.165:0/2800024634 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc014450 con 0x55acbc83d140 2024-09-22T08:11:02.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.412+0000 7f3dbd602640 1 -- 172.21.15.165:0/2800024634 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc0145f0 con 0x55acbc83d140 2024-09-22T08:11:02.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.412+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2800024634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acbc83e3d0 con 0x55acbc83d140 2024-09-22T08:11:02.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.412+0000 7f3dbd602640 1 -- 172.21.15.165:0/2800024634 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc014910 con 0x55acbc83d140 2024-09-22T08:11:02.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.412+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2800024634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acbc83e970 con 0x55acbc83d140 2024-09-22T08:11:02.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.413+0000 7f3dbd602640 1 -- 172.21.15.165:0/2800024634 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3ecc011040 con 0x55acbc83d140 2024-09-22T08:11:02.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.413+0000 7f3dbd602640 1 --2- 172.21.15.165:0/2800024634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3dac03cfb0 0x7f3dac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.413+0000 7f3dbd602640 1 -- 172.21.15.165:0/2800024634 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3ecc01e070 con 0x55acbc83d140 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.413+0000 7f3ed31e0640 1 --2- 172.21.15.165:0/2800024634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3dac03cfb0 0x7f3dac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.413+0000 7f3ed7a14800 1 Processor -- start 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3ed7a14800 1 -- start start 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3ed31e0640 1 --2- 172.21.15.165:0/2800024634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3dac03cfb0 0x7f3dac03f470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55acbc829e60 tx=0x7f3ec4017c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3ed7a14800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc849fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3ed7a14800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55acbc8188c0 con 0x55acbc849be0 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3ed39e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc849fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3ed39e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc849fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50378/0 (socket says 172.21.15.165:50378) 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3ed39e1640 1 -- 172.21.15.165:0/941376815 learned_addr learned my addr 172.21.15.165:0/941376815 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3ed39e1640 1 -- 172.21.15.165:0/941376815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acbc84a5d0 con 0x55acbc849be0 2024-09-22T08:11:02.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3ed39e1640 1 --2- 172.21.15.165:0/941376815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc849fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc016fd0 tx=0x7f3ecc011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97518b82782ac52 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3db6ffd640 1 -- 172.21.15.165:0/941376815 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc04b070 con 0x55acbc849be0 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.414+0000 7f3db6ffd640 1 -- 172.21.15.165:0/941376815 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc051070 con 0x55acbc849be0 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3db6ffd640 1 -- 172.21.15.165:0/941376815 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc022db0 con 0x55acbc849be0 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 -- 172.21.15.165:0/941376815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 msgr2=0x55acbc849fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/941376815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc849fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc016fd0 tx=0x7f3ecc011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 -- 172.21.15.165:0/941376815 shutdown_connections 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/941376815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc849fe0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 -- 172.21.15.165:0/941376815 >> 172.21.15.165:0/941376815 conn(0x55acbc845fe0 msgr2=0x55acbc844220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 -- 172.21.15.165:0/941376815 shutdown_connections 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 -- 172.21.15.165:0/941376815 wait complete. 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 Processor -- start 2024-09-22T08:11:02.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 -- start start 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc851200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.415+0000 7f3ed7a14800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55acbc84abf0 con 0x55acbc849be0 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.416+0000 7f3ed39e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc851200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.416+0000 7f3ed39e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc851200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50392/0 (socket says 172.21.15.165:50392) 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.416+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 learned_addr learned my addr 172.21.15.165:0/2204466436 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.416+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acbc851760 con 0x55acbc849be0 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.416+0000 7f3ed39e1640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc851200 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc053630 tx=0x7f3ecc054740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.416+0000 7f3db57fa640 1 -- 172.21.15.165:0/2204466436 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc04b030 con 0x55acbc849be0 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.416+0000 7f3db57fa640 1 -- 172.21.15.165:0/2204466436 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc011330 con 0x55acbc849be0 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.416+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acbc8519f0 con 0x55acbc849be0 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.416+0000 7f3db57fa640 1 -- 172.21.15.165:0/2204466436 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc056070 con 0x55acbc849be0 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.416+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acbc852580 con 0x55acbc849be0 2024-09-22T08:11:02.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.417+0000 7f3db57fa640 1 -- 172.21.15.165:0/2204466436 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3ecc045980 con 0x55acbc849be0 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.417+0000 7f3db57fa640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3d9c03cfb0 0x7f3d9c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.417+0000 7f3db57fa640 1 -- 172.21.15.165:0/2204466436 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3ecc04c070 con 0x55acbc849be0 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.418+0000 7f3ed31e0640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3d9c03cfb0 0x7f3d9c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.418+0000 7f3ed31e0640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3d9c03cfb0 0x7f3d9c03f470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4023560 tx=0x7f3ec404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.418+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.418+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc85cd00 0x55acbc85f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.418+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc85f910 con 0x55acbc85cd00 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.418+0000 7f3ed29df640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc85cd00 0x55acbc85f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.418+0000 7f3ed29df640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc85cd00 0x55acbc85f1c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 20 realm 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc85fce0 con 0x55acbc85cd00 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc8605b0 con 0x55acbc85cd00 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc860950 con 0x55acbc85cd00 2024-09-22T08:11:02.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc8616b0 0x55acbc863aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.419+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc864060 con 0x55acbc8616b0 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.420+0000 7f3ed39e1640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc8616b0 0x55acbc863aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.420+0000 7f3ed39e1640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc8616b0 0x55acbc863aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.420+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.420+0000 7f3ed7a14800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.420+0000 7f3ed7a14800 20 searching for the correct realm 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.420+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55acbc866030 0x55acbc8684f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.420+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc866030 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.420+0000 7f3ed31e0640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55acbc866030 0x55acbc8684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.420+0000 7f3ed31e0640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55acbc866030 0x55acbc8684f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.421+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.421+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc8616b0 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.421+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.421+0000 7f3ed39e1640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3ecc014070 0x7f3ecc0357d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.421+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x7f3ecc014070 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.421+0000 7f3ed29df640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3ecc014070 0x7f3ecc0357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.422+0000 7f3ed29df640 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3ecc014070 0x7f3ecc0357d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.422+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x7f3ecc014070 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.422+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc85cd00 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.422+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.422+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc85cd00 2024-09-22T08:11:02.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.422+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.423+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x7f3ecc014070 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.423+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x7f3ecc014070 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.423+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x7f3ecc014070 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.423+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x7f3ecc014070 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.423+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc8616b0 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.423+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.423+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc866030 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.424+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.424+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc85cd00 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.424+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.424+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x7f3ecc014070 2024-09-22T08:11:02.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.424+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x7f3ecc014070 2024-09-22T08:11:02.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.424+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc85cd00 2024-09-22T08:11:02.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.424+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.424+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc8616b0 2024-09-22T08:11:02.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.425+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.425+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc866030 2024-09-22T08:11:02.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.425+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.425+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc866030 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.425+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.425+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x7f3ecc014070 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.425+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x7f3ecc014070 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.425+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc866030 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.426+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.426+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc866030 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.426+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.426+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc85cd00 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.426+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.426+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc85cd00 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.426+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.426+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x7f3ecc014070 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.426+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x7f3ecc014070 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.426+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc866030 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.427+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.427+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc8616b0 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.427+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.427+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc85cd00 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.427+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.427+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x7f3ecc014070 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.427+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x7f3ecc014070 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.427+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc866030 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.428+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.428+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x7f3ecc014070 2024-09-22T08:11:02.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.428+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x7f3ecc014070 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.428+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc8616b0 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.428+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.428+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc866030 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.428+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.428+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x7f3ecc014070 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ebc061430 con 0x7f3ecc014070 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc85cd00 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acbc868bc0 con 0x55acbc8616b0 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed7a14800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed7a14800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed7a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed7a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:02.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed7a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed7a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.429+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc864a20 con 0x55acbc85cd00 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc8652c0 con 0x55acbc85cd00 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ebc061430 con 0x55acbc85cd00 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc869040 con 0x55acbc85cd00 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 20 zone default found 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 4 Realm: () 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 20 zonegroup default 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc869040 con 0x7f3ecc014070 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.430+0000 7f3ed7a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86ae20 con 0x55acbc866030 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed7a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86b2e0 con 0x55acbc866030 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed7a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed7a14800 20 started sync module instance, tier type = 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed7a14800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.431+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86a2c0 con 0x55acbc8616b0 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.432+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.432+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94200385676976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc869f20 con 0x55acbc8616b0 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.432+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86c1f0 con 0x55acbc85cd00 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.433+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.433+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94200385682752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86c670 con 0x55acbc85cd00 2024-09-22T08:11:02.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.434+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86d190 con 0x55acbc866030 2024-09-22T08:11:02.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.435+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94200385682752] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.437+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94200385676976] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.437+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.438+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94200385681184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86c160 con 0x55acbc866030 2024-09-22T08:11:02.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.438+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86da70 con 0x55acbc8616b0 2024-09-22T08:11:02.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.438+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94200385681184] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.439+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.439+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94200385686624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86de90 con 0x55acbc8616b0 2024-09-22T08:11:02.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.439+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86e8b0 con 0x55acbc85cd00 2024-09-22T08:11:02.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.441+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.441+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94200385692576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86e870 con 0x55acbc85cd00 2024-09-22T08:11:02.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.441+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86f870 con 0x7f3ecc014070 2024-09-22T08:11:02.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.443+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.443+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94200385686624] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.443+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94200385696624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86f870 con 0x7f3ecc014070 2024-09-22T08:11:02.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.443+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc870280 con 0x7f3ecc014070 2024-09-22T08:11:02.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.444+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94200385692576] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.445+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94200385696624] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.445+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.445+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94200385688960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86fdd0 con 0x7f3ecc014070 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.445+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc870b20 con 0x7f3ecc014070 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.447+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.447+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94200385688960] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.447+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94200385701488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86fdd0 con 0x7f3ecc014070 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.447+0000 7f3ed7a14800 20 add_watcher() i=0 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.447+0000 7f3ed7a14800 20 add_watcher() i=1 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.447+0000 7f3ed7a14800 20 add_watcher() i=2 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.447+0000 7f3ed7a14800 20 add_watcher() i=3 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.447+0000 7f3ed7a14800 20 add_watcher() i=4 2024-09-22T08:11:02.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.447+0000 7f3ed7a14800 20 add_watcher() i=5 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.447+0000 7f3ed7a14800 20 add_watcher() i=6 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.448+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94200385701488] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.448+0000 7f3ed7a14800 20 add_watcher() i=7 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.448+0000 7f3ed7a14800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.448+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc873fa0 con 0x55acbc85cd00 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.448+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.448+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94200385702544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc871420 con 0x55acbc85cd00 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.449+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94200385702544] v32'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.449+0000 7f3d8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.449+0000 7f3ed7a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.449+0000 7f3ed7a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:02.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.449+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87c8e0 con 0x55acbc85cd00 2024-09-22T08:11:02.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.450+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.450+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87ced0 con 0x7f3ecc014070 2024-09-22T08:11:02.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.452+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.452+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87d440 con 0x55acbc866030 2024-09-22T08:11:02.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.453+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.453+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87dc90 con 0x55acbc85cd00 2024-09-22T08:11:02.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.455+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.456+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87bf80 con 0x55acbc8616b0 2024-09-22T08:11:02.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.458+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.458+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87bf80 con 0x55acbc866030 2024-09-22T08:11:02.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.461+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.461+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87e7f0 con 0x55acbc85cd00 2024-09-22T08:11:02.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.464+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.464+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87e7f0 con 0x7f3ecc014070 2024-09-22T08:11:02.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.465+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.465+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87e7f0 con 0x55acbc8616b0 2024-09-22T08:11:02.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.466+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.466+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87e7f0 con 0x55acbc866030 2024-09-22T08:11:02.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.467+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.467+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87e7f0 con 0x55acbc8616b0 2024-09-22T08:11:02.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.468+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.468+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87e7f0 con 0x7f3ecc014070 2024-09-22T08:11:02.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.469+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.469+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87e7f0 con 0x55acbc8616b0 2024-09-22T08:11:02.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.471+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.471+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87e920 con 0x7f3ecc014070 2024-09-22T08:11:02.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.473+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.473+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87e920 con 0x55acbc85cd00 2024-09-22T08:11:02.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.476+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.476+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87e920 con 0x55acbc866030 2024-09-22T08:11:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.479+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'14 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.479+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc8616b0 2024-09-22T08:11:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.482+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.482+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc866030 2024-09-22T08:11:02.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.484+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.484+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc85cd00 2024-09-22T08:11:02.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.487+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.487+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc85cd00 2024-09-22T08:11:02.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.488+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.488+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc866030 2024-09-22T08:11:02.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.490+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.490+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc8616b0 2024-09-22T08:11:02.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.491+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.491+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc866030 2024-09-22T08:11:02.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.492+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.492+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc866030 2024-09-22T08:11:02.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.495+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.495+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc866030 2024-09-22T08:11:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.498+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.498+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc866030 2024-09-22T08:11:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.500+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.500+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x7f3ecc014070 2024-09-22T08:11:02.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.504+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.504+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc866030 2024-09-22T08:11:02.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.505+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.505+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x7f3ecc014070 2024-09-22T08:11:02.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.506+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.506+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc866030 2024-09-22T08:11:02.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.507+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.507+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x7f3ecc014070 2024-09-22T08:11:02.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.508+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.508+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc87edd0 con 0x55acbc8616b0 2024-09-22T08:11:02.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.509+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.509+0000 7f3d897e2640 20 reqs_thread_entry: start 2024-09-22T08:11:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.510+0000 7f3ed7a14800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.510+0000 7f3ed7a14800 20 Filter name: none 2024-09-22T08:11:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.510+0000 7f3d827fc640 20 reqs_thread_entry: start 2024-09-22T08:11:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.510+0000 7f3ed7a14800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-22T08:11:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.510+0000 7f3ed7a14800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.510+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acbc8a98a0 con 0x55acbc8616b0 2024-09-22T08:11:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.510+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.510+0000 7f3ed7a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.510+0000 7f3ed7a14800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-22T08:11:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.510+0000 7f3ed7a14800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:11:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:could not remove user: unable to remove user, user does not exist 2024-09-22T08:11:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.511+0000 7f3d8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.511+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94200385702544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc85a340 con 0x55acbc85cd00 2024-09-22T08:11:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.512+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94200385702544] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.512+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94200385676976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc870a90 con 0x55acbc8616b0 2024-09-22T08:11:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.513+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94200385676976] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.513+0000 7f3ed7a14800 20 remove_watcher() i=0 2024-09-22T08:11:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.513+0000 7f3ed7a14800 2 removed watcher, disabling cache 2024-09-22T08:11:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.513+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94200385682752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc870a90 con 0x55acbc85cd00 2024-09-22T08:11:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.514+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94200385682752] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.514+0000 7f3ed7a14800 20 remove_watcher() i=1 2024-09-22T08:11:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.514+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94200385681184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86bd40 con 0x55acbc866030 2024-09-22T08:11:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.515+0000 7f3ed31e0640 1 -- 172.21.15.165:0/2204466436 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94200385681184] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec4034030 con 0x55acbc866030 2024-09-22T08:11:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.515+0000 7f3ed7a14800 20 remove_watcher() i=2 2024-09-22T08:11:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.516+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94200385686624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc870a90 con 0x55acbc8616b0 2024-09-22T08:11:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.516+0000 7f3ed39e1640 1 -- 172.21.15.165:0/2204466436 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94200385686624] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc03c020 con 0x55acbc8616b0 2024-09-22T08:11:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.516+0000 7f3ed7a14800 20 remove_watcher() i=3 2024-09-22T08:11:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.516+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94200385692576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86b720 con 0x55acbc85cd00 2024-09-22T08:11:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.517+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94200385692576] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x55acbc85cd00 2024-09-22T08:11:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.517+0000 7f3ed7a14800 20 remove_watcher() i=4 2024-09-22T08:11:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.517+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94200385696624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86bd40 con 0x7f3ecc014070 2024-09-22T08:11:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.518+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94200385696624] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.518+0000 7f3ed7a14800 20 remove_watcher() i=5 2024-09-22T08:11:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.518+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94200385688960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc86cc60 con 0x7f3ecc014070 2024-09-22T08:11:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.519+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94200385688960] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.519+0000 7f3ed7a14800 20 remove_watcher() i=6 2024-09-22T08:11:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.519+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94200385701488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acbc870a90 con 0x7f3ecc014070 2024-09-22T08:11:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.520+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94200385701488] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ebc08a1c0 con 0x7f3ecc014070 2024-09-22T08:11:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.520+0000 7f3ed7a14800 20 remove_watcher() i=7 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.520+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3ecc014070 msgr2=0x7f3ecc0357d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.520+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3ecc014070 0x7f3ecc0357d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.520+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc85cd00 msgr2=0x55acbc85f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.520+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc85cd00 0x55acbc85f1c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.520+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc8616b0 msgr2=0x55acbc863aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.520+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc8616b0 0x55acbc863aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.520+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55acbc866030 msgr2=0x55acbc8684f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.520+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55acbc866030 0x55acbc8684f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3d9c03cfb0 msgr2=0x7f3d9c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3d9c03cfb0 0x7f3d9c03f470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4023560 tx=0x7f3ec404e000 comp rx=0 tx=0).stop 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 msgr2=0x55acbc851200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc851200 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc053630 tx=0x7f3ecc054740 comp rx=0 tx=0).stop 2024-09-22T08:11:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed29df640 1 -- 172.21.15.165:0/2204466436 reap_dead start 2024-09-22T08:11:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 shutdown_connections 2024-09-22T08:11:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2204466436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc849be0 0x55acbc851200 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 >> 172.21.15.165:0/2204466436 conn(0x55acbc845fe0 msgr2=0x55acbc8441f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 shutdown_connections 2024-09-22T08:11:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2204466436 wait complete. 2024-09-22T08:11:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2800024634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3dac03cfb0 msgr2=0x7f3dac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2800024634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3dac03cfb0 0x7f3dac03f470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55acbc829e60 tx=0x7f3ec4017c90 comp rx=0 tx=0).stop 2024-09-22T08:11:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2800024634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc83d140 msgr2=0x55acbc83d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2800024634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc83d140 0x55acbc83d560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55acbc829dc0 tx=0x7f3ecc018830 comp rx=0 tx=0).stop 2024-09-22T08:11:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2800024634 shutdown_connections 2024-09-22T08:11:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2800024634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3dac03cfb0 0x7f3dac03f470 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/2800024634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc83d140 0x55acbc83d560 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2800024634 >> 172.21.15.165:0/2800024634 conn(0x55acbc8314f0 msgr2=0x55acbc8318d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2800024634 shutdown_connections 2024-09-22T08:11:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/2800024634 wait complete. 2024-09-22T08:11:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc8270f0 msgr2=0x55acbc8294e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc8270f0 0x55acbc8294e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc82bd10 msgr2=0x55acbc82e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc82bd10 0x55acbc82e100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.521+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3db803cfb0 msgr2=0x7f3db803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3db803cfb0 0x7f3db803f470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55acbc69b020 tx=0x7f3ebc050000 comp rx=0 tx=0).stop 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 msgr2=0x55acbc728830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 0x55acbc728830 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4000c00 tx=0x7f3ec40040e0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 shutdown_connections 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55acbc82bd10 0x55acbc82e100 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55acbc8270f0 0x55acbc8294e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3db803cfb0 0x7f3db803f470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 --2- 172.21.15.165:0/3316848296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55acbc72c9d0 0x55acbc728830 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 >> 172.21.15.165:0/3316848296 conn(0x55acbc722bb0 msgr2=0x55acbc819410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 shutdown_connections 2024-09-22T08:11:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.522+0000 7f3ed7a14800 1 -- 172.21.15.165:0/3316848296 wait complete. 2024-09-22T08:11:02.531 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-22T08:11:02.531 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-22T08:11:02.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-22T08:11:02.531 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-22T08:11:02.576 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:02.576 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:02.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.576+0000 7fda4a375800 1 Processor -- start 2024-09-22T08:11:02.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.576+0000 7fda4a375800 1 -- start start 2024-09-22T08:11:02.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.576+0000 7fda4a375800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55723522bff0 0x55723522e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.576+0000 7fda4a375800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5572350b6a20 con 0x55723522e920 2024-09-22T08:11:02.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.576+0000 7fda4a375800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5572350b67d0 con 0x55723522bff0 2024-09-22T08:11:02.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.576+0000 7fda47e5f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55723522bff0 0x55723522e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.576+0000 7fda4765e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55723522e920 0x557235230d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33414/0 (socket says 172.21.15.165:33414) 2024-09-22T08:11:02.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.576+0000 7fda4765e640 1 -- 172.21.15.165:0/3268515697 learned_addr learned my addr 172.21.15.165:0/3268515697 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:02.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.577+0000 7fda47e5f640 1 -- 172.21.15.165:0/3268515697 >> v1:172.21.15.53:6789/0 conn(0x55723522e920 legacy=0x557235230d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.577+0000 7fda47e5f640 1 -- 172.21.15.165:0/3268515697 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557235233580 con 0x55723522bff0 2024-09-22T08:11:02.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda47e5f640 1 --2- 172.21.15.165:0/3268515697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x55723522e3e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fda3800a470 tx=0x7fda38045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1bbb6590eb2509 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda46e5d640 1 -- 172.21.15.165:0/3268515697 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda38053570 con 0x55723522bff0 2024-09-22T08:11:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda46e5d640 1 -- 172.21.15.165:0/3268515697 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda38058070 con 0x55723522bff0 2024-09-22T08:11:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda46e5d640 1 -- 172.21.15.165:0/3268515697 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda38053880 con 0x55723522bff0 2024-09-22T08:11:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda4a375800 1 -- 172.21.15.165:0/3268515697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 msgr2=0x55723522e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda4a375800 1 --2- 172.21.15.165:0/3268515697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x55723522e3e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fda3800a470 tx=0x7fda38045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda4a375800 1 -- 172.21.15.165:0/3268515697 shutdown_connections 2024-09-22T08:11:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda4a375800 1 --2- 172.21.15.165:0/3268515697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x55723522e3e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda4a375800 1 -- 172.21.15.165:0/3268515697 >> 172.21.15.165:0/3268515697 conn(0x557235225bb0 msgr2=0x557235228010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda4a375800 1 -- 172.21.15.165:0/3268515697 shutdown_connections 2024-09-22T08:11:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.579+0000 7fda4a375800 1 -- 172.21.15.165:0/3268515697 wait complete. 2024-09-22T08:11:02.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.593+0000 7fda4a375800 1 Processor -- start 2024-09-22T08:11:02.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.593+0000 7fda4a375800 1 -- start start 2024-09-22T08:11:02.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.593+0000 7fda4a375800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x55723522b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.593+0000 7fda4a375800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5572350c3dd0 con 0x55723522bff0 2024-09-22T08:11:02.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.593+0000 7fda47e5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x55723522b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.593+0000 7fda47e5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x55723522b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50410/0 (socket says 172.21.15.165:50410) 2024-09-22T08:11:02.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.593+0000 7fda47e5f640 1 -- 172.21.15.165:0/4157085775 learned_addr learned my addr 172.21.15.165:0/4157085775 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.594+0000 7fda47e5f640 1 -- 172.21.15.165:0/4157085775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723522bd50 con 0x55723522bff0 2024-09-22T08:11:02.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.594+0000 7fda47e5f640 1 --2- 172.21.15.165:0/4157085775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x55723522b760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda38025c20 tx=0x7fda38051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b7d0597ec26f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.594+0000 7fd935e0b640 1 -- 172.21.15.165:0/4157085775 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda38053a20 con 0x55723522bff0 2024-09-22T08:11:02.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.594+0000 7fd935e0b640 1 -- 172.21.15.165:0/4157085775 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda38063070 con 0x55723522bff0 2024-09-22T08:11:02.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.594+0000 7fd935e0b640 1 -- 172.21.15.165:0/4157085775 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda38053cf0 con 0x55723522bff0 2024-09-22T08:11:02.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 -- 172.21.15.165:0/4157085775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 msgr2=0x55723522b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 --2- 172.21.15.165:0/4157085775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x55723522b760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda38025c20 tx=0x7fda38051000 comp rx=0 tx=0).stop 2024-09-22T08:11:02.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 -- 172.21.15.165:0/4157085775 shutdown_connections 2024-09-22T08:11:02.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 --2- 172.21.15.165:0/4157085775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x55723522b760 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 -- 172.21.15.165:0/4157085775 >> 172.21.15.165:0/4157085775 conn(0x557235225bb0 msgr2=0x5572353169c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 -- 172.21.15.165:0/4157085775 shutdown_connections 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 -- 172.21.15.165:0/4157085775 wait complete. 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 Processor -- start 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 -- start start 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x557235324c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.595+0000 7fda4a375800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557235232820 con 0x55723522bff0 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.596+0000 7fda47e5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x557235324c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.596+0000 7fda47e5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x557235324c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50422/0 (socket says 172.21.15.165:50422) 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.596+0000 7fda47e5f640 1 -- 172.21.15.165:0/2313236254 learned_addr learned my addr 172.21.15.165:0/2313236254 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.596+0000 7fda47e5f640 1 -- 172.21.15.165:0/2313236254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557235325180 con 0x55723522bff0 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.596+0000 7fda47e5f640 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x557235324c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda38025c20 tx=0x7fda38002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.596+0000 7fd92ffff640 1 -- 172.21.15.165:0/2313236254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3806c030 con 0x55723522bff0 2024-09-22T08:11:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.596+0000 7fd92ffff640 1 -- 172.21.15.165:0/2313236254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda38068660 con 0x55723522bff0 2024-09-22T08:11:02.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.596+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557235325410 con 0x55723522bff0 2024-09-22T08:11:02.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.596+0000 7fd92ffff640 1 -- 172.21.15.165:0/2313236254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda38068940 con 0x55723522bff0 2024-09-22T08:11:02.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.596+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557235325e10 con 0x55723522bff0 2024-09-22T08:11:02.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.597+0000 7fd92ffff640 1 -- 172.21.15.165:0/2313236254 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fda38068ae0 con 0x55723522bff0 2024-09-22T08:11:02.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.597+0000 7fd92ffff640 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd93003cfb0 0x7fd93003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.597+0000 7fd92ffff640 1 -- 172.21.15.165:0/2313236254 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fda38098ab0 con 0x55723522bff0 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.597+0000 7fda4765e640 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd93003cfb0 0x7fd93003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.598+0000 7fda4a375800 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723522e920 0x55723532c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.598+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723532c7b0 con 0x55723522e920 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.598+0000 7fda48660640 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723522e920 0x55723532c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.598+0000 7fda4765e640 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd93003cfb0 0x7fd93003f470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda3c001d70 tx=0x7fda3c0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.598+0000 7fda48660640 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723522e920 0x55723532c270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.598+0000 7fda48660640 1 -- 172.21.15.165:0/2313236254 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda4000a4d0 con 0x55723522e920 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.598+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723532cb50 con 0x55723522e920 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.598+0000 7fda48660640 1 -- 172.21.15.165:0/2313236254 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda4000a4d0 con 0x55723522e920 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.599+0000 7fda4a375800 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55723532e650 0x557235330ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.599+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557235331260 con 0x55723532e650 2024-09-22T08:11:02.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.599+0000 7fda47e5f640 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55723532e650 0x557235330ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.599+0000 7fda47e5f640 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55723532e650 0x557235330ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.599+0000 7fda47e5f640 1 -- 172.21.15.165:0/2313236254 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda38051070 con 0x55723532e650 2024-09-22T08:11:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.599+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723532d3a0 con 0x55723522e920 2024-09-22T08:11:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.600+0000 7fda48660640 1 -- 172.21.15.165:0/2313236254 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda4000a4d0 con 0x55723522e920 2024-09-22T08:11:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.600+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723532d7f0 con 0x55723522e920 2024-09-22T08:11:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.600+0000 7fda48660640 1 -- 172.21.15.165:0/2313236254 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda4000a4d0 con 0x55723522e920 2024-09-22T08:11:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.600+0000 7fda4a375800 1 Processor -- start 2024-09-22T08:11:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.600+0000 7fda4a375800 1 -- start start 2024-09-22T08:11:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.600+0000 7fda4a375800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723533fbe0 0x557235340000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.600+0000 7fda4a375800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557235122d50 con 0x55723533fbe0 2024-09-22T08:11:02.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.601+0000 7fda48660640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723533fbe0 0x557235340000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.601+0000 7fda48660640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723533fbe0 0x557235340000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50438/0 (socket says 172.21.15.165:50438) 2024-09-22T08:11:02.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.601+0000 7fda48660640 1 -- 172.21.15.165:0/3626619534 learned_addr learned my addr 172.21.15.165:0/3626619534 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.601+0000 7fda48660640 1 -- 172.21.15.165:0/3626619534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557235340640 con 0x55723533fbe0 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.601+0000 7fda48660640 1 --2- 172.21.15.165:0/3626619534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723533fbe0 0x557235340000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda4000a2a0 tx=0x7fda40018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.601+0000 7fd92d7fa640 1 -- 172.21.15.165:0/3626619534 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda40014450 con 0x55723533fbe0 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.601+0000 7fd92d7fa640 1 -- 172.21.15.165:0/3626619534 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda400145f0 con 0x55723533fbe0 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.601+0000 7fd92d7fa640 1 -- 172.21.15.165:0/3626619534 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda40014910 con 0x55723533fbe0 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.601+0000 7fda4a375800 1 -- 172.21.15.165:0/3626619534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557235340e70 con 0x55723533fbe0 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.601+0000 7fda4a375800 1 -- 172.21.15.165:0/3626619534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557235341410 con 0x55723533fbe0 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.602+0000 7fd92d7fa640 1 -- 172.21.15.165:0/3626619534 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fda40011040 con 0x55723533fbe0 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.602+0000 7fd92d7fa640 1 --2- 172.21.15.165:0/3626619534 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd92003cfb0 0x7fd92003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.602+0000 7fd92d7fa640 1 -- 172.21.15.165:0/3626619534 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fda4001e070 con 0x55723533fbe0 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.603+0000 7fda47e5f640 1 --2- 172.21.15.165:0/3626619534 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd92003cfb0 0x7fd92003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.603+0000 7fda4a375800 1 Processor -- start 2024-09-22T08:11:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.603+0000 7fda4a375800 1 -- start start 2024-09-22T08:11:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.603+0000 7fda47e5f640 1 --2- 172.21.15.165:0/3626619534 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd92003cfb0 0x7fd92003f470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x557235326d10 tx=0x7fda3807cf90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.603+0000 7fda4a375800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x55723534ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.603+0000 7fda4a375800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55723522a1a0 con 0x55723534c680 2024-09-22T08:11:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.603+0000 7fda48660640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x55723534ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.603+0000 7fda48660640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x55723534ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50442/0 (socket says 172.21.15.165:50442) 2024-09-22T08:11:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.603+0000 7fda48660640 1 -- 172.21.15.165:0/2957484650 learned_addr learned my addr 172.21.15.165:0/2957484650 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fda48660640 1 -- 172.21.15.165:0/2957484650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723534d070 con 0x55723534c680 2024-09-22T08:11:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fda48660640 1 --2- 172.21.15.165:0/2957484650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x55723534ca80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fda40016fd0 tx=0x7fda40011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d8f8930beed372 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fd926ffd640 1 -- 172.21.15.165:0/2957484650 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda4004b070 con 0x55723534c680 2024-09-22T08:11:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fd926ffd640 1 -- 172.21.15.165:0/2957484650 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda40051070 con 0x55723534c680 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fd926ffd640 1 -- 172.21.15.165:0/2957484650 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda40053320 con 0x55723534c680 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fda4a375800 1 -- 172.21.15.165:0/2957484650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 msgr2=0x55723534ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fda4a375800 1 --2- 172.21.15.165:0/2957484650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x55723534ca80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fda40016fd0 tx=0x7fda40011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fda4a375800 1 -- 172.21.15.165:0/2957484650 shutdown_connections 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fda4a375800 1 --2- 172.21.15.165:0/2957484650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x55723534ca80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fda4a375800 1 -- 172.21.15.165:0/2957484650 >> 172.21.15.165:0/2957484650 conn(0x557235348a80 msgr2=0x557235346cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fda4a375800 1 -- 172.21.15.165:0/2957484650 shutdown_connections 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.604+0000 7fda4a375800 1 -- 172.21.15.165:0/2957484650 wait complete. 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.605+0000 7fda4a375800 1 Processor -- start 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.605+0000 7fda4a375800 1 -- start start 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.605+0000 7fda4a375800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x557235353c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.605+0000 7fda4a375800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55723534d690 con 0x55723534c680 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.605+0000 7fda48660640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x557235353c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.605+0000 7fda48660640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x557235353c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50452/0 (socket says 172.21.15.165:50452) 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.605+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 learned_addr learned my addr 172.21.15.165:0/1955056336 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.605+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572353541a0 con 0x55723534c680 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.605+0000 7fda48660640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x557235353c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fda400536a0 tx=0x7fda400547b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.606+0000 7fd9257fa640 1 -- 172.21.15.165:0/1955056336 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda4004b040 con 0x55723534c680 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.606+0000 7fd9257fa640 1 -- 172.21.15.165:0/1955056336 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda4004de50 con 0x55723534c680 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.606+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557235354430 con 0x55723534c680 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.606+0000 7fd9257fa640 1 -- 172.21.15.165:0/1955056336 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda40011460 con 0x55723534c680 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.606+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557235354db0 con 0x55723534c680 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.606+0000 7fd9257fa640 1 -- 172.21.15.165:0/1955056336 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fda400459f0 con 0x55723534c680 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.607+0000 7fd9257fa640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd91003cf60 0x7fd91003f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.607+0000 7fd9257fa640 1 -- 172.21.15.165:0/1955056336 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fda4000e040 con 0x55723534c680 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.607+0000 7fda47e5f640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd91003cf60 0x7fd91003f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.607+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.607+0000 7fda47e5f640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd91003cf60 0x7fd91003f420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda38098010 tx=0x7fda38087000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.607+0000 7fda4a375800 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723535f760 0x557235361c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.607+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557235362370 con 0x55723535f760 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.607+0000 7fda4765e640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723535f760 0x557235361c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4765e640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723535f760 0x557235361c20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda3c009050 con 0x55723535f760 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 20 realm 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723535eab0 con 0x55723535f760 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda3c009050 con 0x55723535f760 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557235362e60 con 0x55723535f760 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda3c009050 con 0x55723535f760 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.608+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557235363730 con 0x55723535f760 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda3c009050 con 0x55723535f760 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda4a375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda4a375800 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557235364150 0x557235366540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557235366c80 con 0x557235364150 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda48660640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557235364150 0x557235366540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda48660640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557235364150 0x557235366540 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda4a375800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda4a375800 20 searching for the correct realm 2024-09-22T08:11:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda4a375800 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557235368c30 0x55723536b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235368c30 2024-09-22T08:11:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.609+0000 7fda47e5f640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557235368c30 0x55723536b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.610+0000 7fda47e5f640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557235368c30 0x55723536b0f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.610+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.610+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235364150 2024-09-22T08:11:02.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.610+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.610+0000 7fda48660640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fda40037070 0x7fda40045140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.610+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x7fda40037070 2024-09-22T08:11:02.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.610+0000 7fda4765e640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fda40037070 0x7fda40045140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.611+0000 7fda4765e640 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fda40037070 0x7fda40045140 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.611+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c009050 con 0x7fda40037070 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.611+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x55723535f760 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.611+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c009050 con 0x55723535f760 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.611+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x55723535f760 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.612+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.612+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x7fda40037070 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.612+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.612+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x7fda40037070 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.612+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.612+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235364150 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.612+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.612+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235368c30 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.613+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.613+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x55723535f760 2024-09-22T08:11:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.613+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.613+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x7fda40037070 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.613+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.613+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x55723535f760 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.613+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.613+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235364150 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.614+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.614+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235368c30 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.614+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.614+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235368c30 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.614+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.614+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x7fda40037070 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.614+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.614+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235368c30 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.615+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.615+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235368c30 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.615+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.615+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x55723535f760 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.615+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.615+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x55723535f760 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.615+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.615+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x7fda40037070 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.616+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.616+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235368c30 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.616+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.616+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235364150 2024-09-22T08:11:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.616+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.616+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x55723535f760 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.616+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.616+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x7fda40037070 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.617+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.617+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235368c30 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.617+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.617+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x7fda40037070 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.617+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.617+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235364150 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.617+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.617+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235368c30 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x7fda40037070 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x55723535f760 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723536b770 con 0x557235364150 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4a375800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4a375800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4a375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4a375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4a375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4a375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.618+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557235367640 con 0x55723535f760 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557235367ee0 con 0x55723535f760 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723536bbf0 con 0x55723535f760 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 20 zone default found 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 4 Realm: () 2024-09-22T08:11:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 20 zonegroup default 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.619+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723536bf90 con 0x7fda40037070 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4a375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723536dda0 con 0x557235368c30 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4a375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723536e210 con 0x557235368c30 2024-09-22T08:11:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4a375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4a375800 20 started sync module instance, tier type = 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4a375800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.620+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536d240 con 0x557235364150 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.621+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.621+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93949007418928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536eb20 con 0x557235364150 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.621+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536f370 con 0x55723535f760 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.622+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93949007418928] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.622+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.623+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93949007423088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536f040 con 0x55723535f760 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.623+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536fb40 con 0x557235368c30 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.624+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.624+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93949007427120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235370410 con 0x557235368c30 2024-09-22T08:11:02.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.624+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235370ee0 con 0x557235364150 2024-09-22T08:11:02.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.624+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93949007423088] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.625+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93949007427120] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.625+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.625+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93949007432144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536ff60 con 0x557235364150 2024-09-22T08:11:02.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.625+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235371780 con 0x55723535f760 2024-09-22T08:11:02.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.626+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.626+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93949007432144] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.626+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93949007434448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235371ba0 con 0x55723535f760 2024-09-22T08:11:02.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.626+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536ea90 con 0x7fda40037070 2024-09-22T08:11:02.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.627+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.627+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93949007436704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235372470 con 0x7fda40037070 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.627+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235372e30 con 0x7fda40037070 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.627+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93949007434448] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.628+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93949007436704] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.628+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.628+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93949007440256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235372470 con 0x7fda40037070 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.628+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235372da0 con 0x7fda40037070 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.629+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93949007440256] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.629+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.629+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93949007437760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572353723e0 con 0x7fda40037070 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.629+0000 7fda4a375800 20 add_watcher() i=0 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.629+0000 7fda4a375800 20 add_watcher() i=1 2024-09-22T08:11:02.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.629+0000 7fda4a375800 20 add_watcher() i=2 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.629+0000 7fda4a375800 20 add_watcher() i=3 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.629+0000 7fda4a375800 20 add_watcher() i=4 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.629+0000 7fda4a375800 20 add_watcher() i=5 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.629+0000 7fda4a375800 20 add_watcher() i=6 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.631+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93949007437760] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.631+0000 7fda4a375800 20 add_watcher() i=7 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.631+0000 7fda4a375800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.631+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572353767a0 con 0x55723535f760 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.631+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.631+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93949007442464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235373af0 con 0x55723535f760 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.632+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93949007442464] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.632+0000 7fd8fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.632+0000 7fda4a375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:02.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.632+0000 7fda4a375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:02.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.633+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723537f2f0 con 0x55723535f760 2024-09-22T08:11:02.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.634+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.634+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723537f920 con 0x7fda40037070 2024-09-22T08:11:02.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.635+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.635+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723537fd80 con 0x557235368c30 2024-09-22T08:11:02.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.636+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.636+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572353754c0 con 0x55723535f760 2024-09-22T08:11:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.639+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.639+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235375010 con 0x557235364150 2024-09-22T08:11:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.641+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.641+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235375010 con 0x557235368c30 2024-09-22T08:11:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.644+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.644+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235375010 con 0x55723535f760 2024-09-22T08:11:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.647+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.647+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380c90 con 0x7fda40037070 2024-09-22T08:11:02.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.648+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.648+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380c90 con 0x557235364150 2024-09-22T08:11:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.650+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.650+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380c90 con 0x557235368c30 2024-09-22T08:11:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.650+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.650+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380c90 con 0x557235364150 2024-09-22T08:11:02.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.651+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.651+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380c90 con 0x7fda40037070 2024-09-22T08:11:02.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.652+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.653+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380c90 con 0x557235364150 2024-09-22T08:11:02.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.654+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.654+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380c90 con 0x7fda40037070 2024-09-22T08:11:02.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.657+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.657+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380c90 con 0x55723535f760 2024-09-22T08:11:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.659+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.659+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380c90 con 0x557235368c30 2024-09-22T08:11:02.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.661+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'17 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.661+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380c90 con 0x557235364150 2024-09-22T08:11:02.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.664+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.664+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cb0 con 0x557235368c30 2024-09-22T08:11:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.667+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.667+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cb0 con 0x55723535f760 2024-09-22T08:11:02.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.670+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.670+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cb0 con 0x55723535f760 2024-09-22T08:11:02.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.671+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.671+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cb0 con 0x557235368c30 2024-09-22T08:11:02.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.672+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.672+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cb0 con 0x557235364150 2024-09-22T08:11:02.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.673+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.673+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cb0 con 0x557235368c30 2024-09-22T08:11:02.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.676+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.676+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cd0 con 0x557235368c30 2024-09-22T08:11:02.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.677+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.677+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cd0 con 0x557235368c30 2024-09-22T08:11:02.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.679+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.679+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cd0 con 0x557235368c30 2024-09-22T08:11:02.681 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.680+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.681 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.680+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cd0 con 0x7fda40037070 2024-09-22T08:11:02.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.681+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.681+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cf0 con 0x557235368c30 2024-09-22T08:11:02.683 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.682+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.683 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.682+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cf0 con 0x7fda40037070 2024-09-22T08:11:02.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.683+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.684+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cf0 con 0x557235368c30 2024-09-22T08:11:02.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.685+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.685+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380cf0 con 0x7fda40037070 2024-09-22T08:11:02.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.686+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.686+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235380d30 con 0x557235364150 2024-09-22T08:11:02.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.687+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.687+0000 7fd8fcfe1640 20 reqs_thread_entry: start 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.687+0000 7fda4a375800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.687+0000 7fda4a375800 20 Filter name: none 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.688+0000 7fd8767fc640 20 reqs_thread_entry: start 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.688+0000 7fda4a375800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.688+0000 7fda4a375800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.688+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572353abc30 con 0x7fda40037070 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.688+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.688+0000 7fda4a375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.688+0000 7fda4a375800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.688+0000 7fda4a375800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-22T08:11:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:could not remove user: unable to remove user, user does not exist 2024-09-22T08:11:02.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.689+0000 7fd8fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:02.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.689+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93949007442464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723537cb80 con 0x55723535f760 2024-09-22T08:11:02.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.690+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93949007442464] v32'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.690+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93949007418928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572353731d0 con 0x557235364150 2024-09-22T08:11:02.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.691+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93949007418928] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.691+0000 7fda4a375800 20 remove_watcher() i=0 2024-09-22T08:11:02.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.691+0000 7fda4a375800 2 removed watcher, disabling cache 2024-09-22T08:11:02.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.691+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93949007423088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536d630 con 0x55723535f760 2024-09-22T08:11:02.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.692+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93949007423088] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.692+0000 7fda4a375800 20 remove_watcher() i=1 2024-09-22T08:11:02.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.692+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93949007427120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536d630 con 0x557235368c30 2024-09-22T08:11:02.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.693+0000 7fda47e5f640 1 -- 172.21.15.165:0/1955056336 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93949007427120] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda38051070 con 0x557235368c30 2024-09-22T08:11:02.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.693+0000 7fda4a375800 20 remove_watcher() i=2 2024-09-22T08:11:02.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.693+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93949007432144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536d630 con 0x557235364150 2024-09-22T08:11:02.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.694+0000 7fda48660640 1 -- 172.21.15.165:0/1955056336 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93949007432144] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda4002a070 con 0x557235364150 2024-09-22T08:11:02.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.694+0000 7fda4a375800 20 remove_watcher() i=3 2024-09-22T08:11:02.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.694+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93949007434448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572353709d0 con 0x55723535f760 2024-09-22T08:11:02.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.695+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93949007434448] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x55723535f760 2024-09-22T08:11:02.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.695+0000 7fda4a375800 20 remove_watcher() i=4 2024-09-22T08:11:02.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.695+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93949007436704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723536d630 con 0x7fda40037070 2024-09-22T08:11:02.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.696+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93949007436704] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.696+0000 7fda4a375800 20 remove_watcher() i=5 2024-09-22T08:11:02.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.696+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93949007440256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572353712d0 con 0x7fda40037070 2024-09-22T08:11:02.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.697+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93949007440256] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.697+0000 7fda4a375800 20 remove_watcher() i=6 2024-09-22T08:11:02.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.697+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93949007437760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557235371ba0 con 0x7fda40037070 2024-09-22T08:11:02.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.698+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93949007437760] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c029040 con 0x7fda40037070 2024-09-22T08:11:02.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.698+0000 7fda4a375800 20 remove_watcher() i=7 2024-09-22T08:11:02.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.698+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fda40037070 msgr2=0x7fda40045140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.698+0000 7fda4a375800 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fda40037070 0x7fda40045140 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.698+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723535f760 msgr2=0x557235361c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.698+0000 7fda4a375800 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723535f760 0x557235361c20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.698+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557235364150 msgr2=0x557235366540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.698+0000 7fda4a375800 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557235364150 0x557235366540 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.698+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557235368c30 msgr2=0x55723536b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.698+0000 7fda4a375800 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557235368c30 0x55723536b0f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd91003cf60 msgr2=0x7fd91003f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd91003cf60 0x7fd91003f420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda38098010 tx=0x7fda38087000 comp rx=0 tx=0).stop 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 msgr2=0x557235353c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x557235353c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fda400536a0 tx=0x7fda400547b0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4765e640 1 -- 172.21.15.165:0/1955056336 reap_dead start 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 shutdown_connections 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 --2- 172.21.15.165:0/1955056336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723534c680 0x557235353c40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 >> 172.21.15.165:0/1955056336 conn(0x557235348a80 msgr2=0x557235346c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 shutdown_connections 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/1955056336 wait complete. 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/3626619534 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd92003cfb0 msgr2=0x7fd92003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 --2- 172.21.15.165:0/3626619534 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd92003cfb0 0x7fd92003f470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x557235326d10 tx=0x7fda3807cf90 comp rx=0 tx=0).stop 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/3626619534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723533fbe0 msgr2=0x557235340000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 --2- 172.21.15.165:0/3626619534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723533fbe0 0x557235340000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda4000a2a0 tx=0x7fda40018830 comp rx=0 tx=0).stop 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/3626619534 shutdown_connections 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 --2- 172.21.15.165:0/3626619534 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd92003cfb0 0x7fd92003f470 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 --2- 172.21.15.165:0/3626619534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723533fbe0 0x557235340000 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/3626619534 >> 172.21.15.165:0/3626619534 conn(0x557235333f90 msgr2=0x557235334370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/3626619534 shutdown_connections 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/3626619534 wait complete. 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723522e920 msgr2=0x55723532c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723522e920 0x55723532c270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.699+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55723532e650 msgr2=0x557235330ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55723532e650 0x557235330ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd93003cfb0 msgr2=0x7fd93003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd93003cfb0 0x7fd93003f470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda3c001d70 tx=0x7fda3c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 msgr2=0x557235324c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x557235324c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda38025c20 tx=0x7fda38002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 shutdown_connections 2024-09-22T08:11:02.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55723532e650 0x557235330ad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55723522e920 0x55723532c270 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd93003cfb0 0x7fd93003f470 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 --2- 172.21.15.165:0/2313236254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723522bff0 0x557235324c20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 >> 172.21.15.165:0/2313236254 conn(0x557235225bb0 msgr2=0x557235316510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 shutdown_connections 2024-09-22T08:11:02.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.700+0000 7fda4a375800 1 -- 172.21.15.165:0/2313236254 wait complete. 2024-09-22T08:11:02.709 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-22T08:11:02.709 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-22T08:11:02.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-22T08:11:02.710 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-22T08:11:02.754 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:02.754 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:02.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.754+0000 7f41743a7800 1 Processor -- start 2024-09-22T08:11:02.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.754+0000 7f41743a7800 1 -- start start 2024-09-22T08:11:02.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.754+0000 7f41743a7800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ef35ac6cf0 0x55ef35b584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.754+0000 7f41743a7800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef359dea20 con 0x55ef35b58a00 2024-09-22T08:11:02.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.754+0000 7f41743a7800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ef359de7d0 con 0x55ef35ac6cf0 2024-09-22T08:11:02.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.754+0000 7f4171e91640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ef35ac6cf0 0x55ef35b584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.754+0000 7f4171690640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55ef35b58a00 0x55ef35b5aec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33422/0 (socket says 172.21.15.165:33422) 2024-09-22T08:11:02.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.754+0000 7f4171690640 1 -- 172.21.15.165:0/1959169790 learned_addr learned my addr 172.21.15.165:0/1959169790 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:02.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.755+0000 7f4171e91640 1 -- 172.21.15.165:0/1959169790 >> v1:172.21.15.53:6789/0 conn(0x55ef35b58a00 legacy=0x55ef35b5aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.755+0000 7f4171e91640 1 -- 172.21.15.165:0/1959169790 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35b5d780 con 0x55ef35ac6cf0 2024-09-22T08:11:02.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.756+0000 7f4171e91640 1 --2- 172.21.15.165:0/1959169790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35b584c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f416400a470 tx=0x7f4164045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3a20b8058ca2fd server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.757+0000 7f4170e8f640 1 -- 172.21.15.165:0/1959169790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164053570 con 0x55ef35ac6cf0 2024-09-22T08:11:02.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.757+0000 7f4170e8f640 1 -- 172.21.15.165:0/1959169790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4164058070 con 0x55ef35ac6cf0 2024-09-22T08:11:02.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.757+0000 7f4170e8f640 1 -- 172.21.15.165:0/1959169790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164053880 con 0x55ef35ac6cf0 2024-09-22T08:11:02.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.757+0000 7f41743a7800 1 -- 172.21.15.165:0/1959169790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 msgr2=0x55ef35b584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.757+0000 7f41743a7800 1 --2- 172.21.15.165:0/1959169790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35b584c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f416400a470 tx=0x7f4164045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:02.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.757+0000 7f41743a7800 1 -- 172.21.15.165:0/1959169790 shutdown_connections 2024-09-22T08:11:02.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.757+0000 7f41743a7800 1 --2- 172.21.15.165:0/1959169790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35b584c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.757+0000 7f41743a7800 1 -- 172.21.15.165:0/1959169790 >> 172.21.15.165:0/1959169790 conn(0x55ef35b4dbb0 msgr2=0x55ef35b50010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.757+0000 7f41743a7800 1 -- 172.21.15.165:0/1959169790 shutdown_connections 2024-09-22T08:11:02.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.757+0000 7f41743a7800 1 -- 172.21.15.165:0/1959169790 wait complete. 2024-09-22T08:11:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.771+0000 7f41743a7800 1 Processor -- start 2024-09-22T08:11:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.771+0000 7f41743a7800 1 -- start start 2024-09-22T08:11:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.771+0000 7f41743a7800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c45230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.771+0000 7f41743a7800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ef359ebdd0 con 0x55ef35ac6cf0 2024-09-22T08:11:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.771+0000 7f4171e91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c45230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.771+0000 7f4171e91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c45230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50476/0 (socket says 172.21.15.165:50476) 2024-09-22T08:11:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.771+0000 7f4171e91640 1 -- 172.21.15.165:0/1828952486 learned_addr learned my addr 172.21.15.165:0/1828952486 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.772+0000 7f4171e91640 1 -- 172.21.15.165:0/1828952486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35c45820 con 0x55ef35ac6cf0 2024-09-22T08:11:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.772+0000 7f4171e91640 1 --2- 172.21.15.165:0/1828952486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c45230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4164025c20 tx=0x7f4164051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4178a1dda7b46c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.772+0000 7f405fe07640 1 -- 172.21.15.165:0/1828952486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164053570 con 0x55ef35ac6cf0 2024-09-22T08:11:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.772+0000 7f405fe07640 1 -- 172.21.15.165:0/1828952486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4164063070 con 0x55ef35ac6cf0 2024-09-22T08:11:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.772+0000 7f405fe07640 1 -- 172.21.15.165:0/1828952486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164053840 con 0x55ef35ac6cf0 2024-09-22T08:11:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 -- 172.21.15.165:0/1828952486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 msgr2=0x55ef35c45230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 --2- 172.21.15.165:0/1828952486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c45230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4164025c20 tx=0x7f4164051000 comp rx=0 tx=0).stop 2024-09-22T08:11:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 -- 172.21.15.165:0/1828952486 shutdown_connections 2024-09-22T08:11:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 --2- 172.21.15.165:0/1828952486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c45230 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 -- 172.21.15.165:0/1828952486 >> 172.21.15.165:0/1828952486 conn(0x55ef35b4dbb0 msgr2=0x55ef35c40bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 -- 172.21.15.165:0/1828952486 shutdown_connections 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 -- 172.21.15.165:0/1828952486 wait complete. 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 Processor -- start 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 -- start start 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c4cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.773+0000 7f41743a7800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ef35b5ca20 con 0x55ef35ac6cf0 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.774+0000 7f4171e91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c4cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.774+0000 7f4171e91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c4cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50490/0 (socket says 172.21.15.165:50490) 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.774+0000 7f4171e91640 1 -- 172.21.15.165:0/4096075470 learned_addr learned my addr 172.21.15.165:0/4096075470 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.774+0000 7f4171e91640 1 -- 172.21.15.165:0/4096075470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35c4d240 con 0x55ef35ac6cf0 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.774+0000 7f4171e91640 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c4cce0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4164025c20 tx=0x7f4164002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.774+0000 7f405e604640 1 -- 172.21.15.165:0/4096075470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164074480 con 0x55ef35ac6cf0 2024-09-22T08:11:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.774+0000 7f405e604640 1 -- 172.21.15.165:0/4096075470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4164074620 con 0x55ef35ac6cf0 2024-09-22T08:11:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.774+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef35c4d4d0 con 0x55ef35ac6cf0 2024-09-22T08:11:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.774+0000 7f405e604640 1 -- 172.21.15.165:0/4096075470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4164074900 con 0x55ef35ac6cf0 2024-09-22T08:11:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.774+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef35c4e0e0 con 0x55ef35ac6cf0 2024-09-22T08:11:02.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.775+0000 7f405e604640 1 -- 172.21.15.165:0/4096075470 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4164074aa0 con 0x55ef35ac6cf0 2024-09-22T08:11:02.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.775+0000 7f405e604640 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803cfb0 0x7f405803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.775+0000 7f405e604640 1 -- 172.21.15.165:0/4096075470 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4164098bd0 con 0x55ef35ac6cf0 2024-09-22T08:11:02.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.775+0000 7f4171690640 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803cfb0 0x7f405803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.776+0000 7f41743a7800 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35b58a00 0x55ef35c54330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.776+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c54870 con 0x55ef35b58a00 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.776+0000 7f4172692640 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35b58a00 0x55ef35c54330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.776+0000 7f4171690640 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803cfb0 0x7f405803f470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4168001d70 tx=0x7f41680012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.776+0000 7f4172692640 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35b58a00 0x55ef35c54330 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.776+0000 7f4172692640 1 -- 172.21.15.165:0/4096075470 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f416c00a4d0 con 0x55ef35b58a00 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.776+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c54c10 con 0x55ef35b58a00 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.776+0000 7f4172692640 1 -- 172.21.15.165:0/4096075470 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f416c00a4d0 con 0x55ef35b58a00 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.776+0000 7f41743a7800 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c566d0 0x55ef35c58b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.776+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c59300 con 0x55ef35c566d0 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.777+0000 7f4171e91640 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c566d0 0x55ef35c58b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.777+0000 7f4171e91640 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c566d0 0x55ef35c58b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.777+0000 7f4171e91640 1 -- 172.21.15.165:0/4096075470 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c566d0 2024-09-22T08:11:02.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.777+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c55460 con 0x55ef35b58a00 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.777+0000 7f4172692640 1 -- 172.21.15.165:0/4096075470 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f416c00a4d0 con 0x55ef35b58a00 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.777+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c55800 con 0x55ef35b58a00 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.778+0000 7f4172692640 1 -- 172.21.15.165:0/4096075470 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f416c00a4d0 con 0x55ef35b58a00 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.778+0000 7f41743a7800 1 Processor -- start 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.778+0000 7f41743a7800 1 -- start start 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.778+0000 7f41743a7800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c67bd0 0x55ef35c67ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.778+0000 7f41743a7800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ef35a4ad50 con 0x55ef35c67bd0 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.778+0000 7f4172692640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c67bd0 0x55ef35c67ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.778+0000 7f4172692640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c67bd0 0x55ef35c67ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50496/0 (socket says 172.21.15.165:50496) 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.778+0000 7f4172692640 1 -- 172.21.15.165:0/2099608072 learned_addr learned my addr 172.21.15.165:0/2099608072 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.779+0000 7f4172692640 1 -- 172.21.15.165:0/2099608072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35c68630 con 0x55ef35c67bd0 2024-09-22T08:11:02.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.779+0000 7f4172692640 1 --2- 172.21.15.165:0/2099608072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c67bd0 0x55ef35c67ff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55ef35c4dce0 tx=0x7f416c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.779+0000 7f40577fe640 1 -- 172.21.15.165:0/2099608072 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c014450 con 0x55ef35c67bd0 2024-09-22T08:11:02.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.779+0000 7f40577fe640 1 -- 172.21.15.165:0/2099608072 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c014610 con 0x55ef35c67bd0 2024-09-22T08:11:02.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.779+0000 7f41743a7800 1 -- 172.21.15.165:0/2099608072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef35c68e60 con 0x55ef35c67bd0 2024-09-22T08:11:02.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.779+0000 7f40577fe640 1 -- 172.21.15.165:0/2099608072 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c014930 con 0x55ef35c67bd0 2024-09-22T08:11:02.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.779+0000 7f41743a7800 1 -- 172.21.15.165:0/2099608072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef35c69400 con 0x55ef35c67bd0 2024-09-22T08:11:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.780+0000 7f40577fe640 1 -- 172.21.15.165:0/2099608072 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f416c011040 con 0x55ef35c67bd0 2024-09-22T08:11:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.780+0000 7f40577fe640 1 --2- 172.21.15.165:0/2099608072 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f404c03cfb0 0x7f404c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.780+0000 7f40577fe640 1 -- 172.21.15.165:0/2099608072 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f416c01e070 con 0x55ef35c67bd0 2024-09-22T08:11:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.780+0000 7f4171e91640 1 --2- 172.21.15.165:0/2099608072 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f404c03cfb0 0x7f404c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.781+0000 7f41743a7800 1 Processor -- start 2024-09-22T08:11:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.781+0000 7f41743a7800 1 -- start start 2024-09-22T08:11:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.781+0000 7f4171e91640 1 --2- 172.21.15.165:0/2099608072 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f404c03cfb0 0x7f404c03f470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4164074fd0 tx=0x7f416405d480 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.781+0000 7f41743a7800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c74a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.781+0000 7f41743a7800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ef35c45bf0 con 0x55ef35c74670 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.781+0000 7f4172692640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c74a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.781+0000 7f4172692640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c74a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50508/0 (socket says 172.21.15.165:50508) 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.781+0000 7f4172692640 1 -- 172.21.15.165:0/2990956588 learned_addr learned my addr 172.21.15.165:0/2990956588 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.781+0000 7f4172692640 1 -- 172.21.15.165:0/2990956588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35c75060 con 0x55ef35c74670 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f4172692640 1 --2- 172.21.15.165:0/2990956588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c74a70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f416c016fd0 tx=0x7f416c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dde63cf2f5ccb3e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f40557fa640 1 -- 172.21.15.165:0/2990956588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c016440 con 0x55ef35c74670 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f40557fa640 1 -- 172.21.15.165:0/2990956588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c011da0 con 0x55ef35c74670 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f40557fa640 1 -- 172.21.15.165:0/2990956588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c0167c0 con 0x55ef35c74670 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f41743a7800 1 -- 172.21.15.165:0/2990956588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 msgr2=0x55ef35c74a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f41743a7800 1 --2- 172.21.15.165:0/2990956588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c74a70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f416c016fd0 tx=0x7f416c011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f41743a7800 1 -- 172.21.15.165:0/2990956588 shutdown_connections 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f41743a7800 1 --2- 172.21.15.165:0/2990956588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c74a70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f41743a7800 1 -- 172.21.15.165:0/2990956588 >> 172.21.15.165:0/2990956588 conn(0x55ef35c70a70 msgr2=0x55ef35c6ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f41743a7800 1 -- 172.21.15.165:0/2990956588 shutdown_connections 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f41743a7800 1 -- 172.21.15.165:0/2990956588 wait complete. 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.782+0000 7f41743a7800 1 Processor -- start 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.783+0000 7f41743a7800 1 -- start start 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.783+0000 7f41743a7800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c7bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.783+0000 7f41743a7800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ef35c75680 con 0x55ef35c74670 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.783+0000 7f4172692640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c7bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.783+0000 7f4172692640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c7bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50510/0 (socket says 172.21.15.165:50510) 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.783+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 learned_addr learned my addr 172.21.15.165:0/1650604769 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.783+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35c7c210 con 0x55ef35c74670 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.783+0000 7f4172692640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c7bcb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f416c016fd0 tx=0x7f416c054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.783+0000 7f40437fe640 1 -- 172.21.15.165:0/1650604769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c031020 con 0x55ef35c74670 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.784+0000 7f40437fe640 1 -- 172.21.15.165:0/1650604769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c0532d0 con 0x55ef35c74670 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.784+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef35c7c4a0 con 0x55ef35c74670 2024-09-22T08:11:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.784+0000 7f40437fe640 1 -- 172.21.15.165:0/1650604769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416c014ad0 con 0x55ef35c74670 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.784+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef35c7ce20 con 0x55ef35c74670 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.784+0000 7f40437fe640 1 -- 172.21.15.165:0/1650604769 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f416c034020 con 0x55ef35c74670 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.785+0000 7f40437fe640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f403c03cfb0 0x7f403c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.785+0000 7f40437fe640 1 -- 172.21.15.165:0/1650604769 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f416c00e040 con 0x55ef35c74670 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.785+0000 7f4171e91640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f403c03cfb0 0x7f403c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.785+0000 7f4171e91640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f403c03cfb0 0x7f403c03f470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f416405c580 tx=0x7f416408a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.785+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.785+0000 7f41743a7800 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35c87770 0x55ef35c89c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.785+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c8a380 con 0x55ef35c87770 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.785+0000 7f4171690640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35c87770 0x55ef35c89c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f4171690640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35c87770 0x55ef35c89c30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4168009050 con 0x55ef35c87770 2024-09-22T08:11:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 20 realm 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c86ac0 con 0x55ef35c87770 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4168009050 con 0x55ef35c87770 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c8ae70 con 0x55ef35c87770 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4168009050 con 0x55ef35c87770 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.786+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c8b740 con 0x55ef35c87770 2024-09-22T08:11:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4168009050 con 0x55ef35c87770 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f41743a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f41743a7800 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c8c160 0x55ef35c8e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c8ec90 con 0x55ef35c8c160 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f4172692640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c8c160 0x55ef35c8e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f4172692640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c8c160 0x55ef35c8e550 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f41743a7800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f41743a7800 20 searching for the correct realm 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f41743a7800 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ef35c90c40 0x55ef35c93100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c90c40 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.787+0000 7f4171e91640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ef35c90c40 0x55ef35c93100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.788+0000 7f4171e91640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ef35c90c40 0x55ef35c93100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.788+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.788+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c8c160 2024-09-22T08:11:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.788+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.788+0000 7f4172692640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f416c036020 0x7f416c017030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.788+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x7f416c036020 2024-09-22T08:11:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.788+0000 7f4171690640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f416c036020 0x7f416c017030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.789+0000 7f4171690640 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f416c036020 0x7f416c017030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.789+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168009050 con 0x7f416c036020 2024-09-22T08:11:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.789+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c87770 2024-09-22T08:11:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.789+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168009050 con 0x55ef35c87770 2024-09-22T08:11:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.789+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c87770 2024-09-22T08:11:02.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.789+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.789+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x7f416c036020 2024-09-22T08:11:02.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.790+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.790+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x7f416c036020 2024-09-22T08:11:02.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.790+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.790+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c8c160 2024-09-22T08:11:02.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.790+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.790+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c90c40 2024-09-22T08:11:02.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.791+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.791+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c87770 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.791+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.791+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x7f416c036020 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.791+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.791+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c87770 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.791+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.791+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c8c160 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.792+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.792+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c90c40 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.792+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.792+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c90c40 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.792+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.792+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x7f416c036020 2024-09-22T08:11:02.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.792+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.792+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c90c40 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.793+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.793+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c90c40 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.793+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.793+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c87770 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.793+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.793+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c87770 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.793+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.793+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x7f416c036020 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.793+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.793+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c90c40 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.794+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.794+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c8c160 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.794+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.794+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c87770 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.794+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.794+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x7f416c036020 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.794+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.794+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c90c40 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.795+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.795+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x7f416c036020 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.795+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.795+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c8c160 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.795+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.795+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c90c40 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.795+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.795+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x7f416c036020 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c87770 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c93780 con 0x55ef35c8c160 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:02.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c8f650 con 0x55ef35c87770 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.796+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c8fef0 con 0x55ef35c87770 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c8f290 con 0x55ef35c87770 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:02.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 20 zone default found 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 4 Realm: () 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 20 zonegroup default 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c940b0 con 0x7f416c036020 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.797+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c95de0 con 0x55ef35c90c40 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.798+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.798+0000 7f41743a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.798+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.798+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c96270 con 0x55ef35c90c40 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.798+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.798+0000 7f41743a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.798+0000 7f41743a7800 20 started sync module instance, tier type = 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.798+0000 7f41743a7800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.798+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c94bb0 con 0x55ef35c8c160 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.799+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.799+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94485887930272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c94810 con 0x55ef35c8c160 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.799+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c971a0 con 0x55ef35c87770 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.800+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94485887930272] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.800+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.800+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94485887936208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c971a0 con 0x55ef35c87770 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.800+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c97ba0 con 0x55ef35c90c40 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.801+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.801+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94485887940272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c98440 con 0x55ef35c90c40 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.801+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c98f20 con 0x55ef35c8c160 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.801+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94485887936208] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.802+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94485887940272] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.802+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.802+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94485887942544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c96cf0 con 0x55ef35c8c160 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.802+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c99800 con 0x55ef35c87770 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.803+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.803+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94485887947536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c99770 con 0x55ef35c87770 2024-09-22T08:11:02.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.803+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c9a760 con 0x7f416c036020 2024-09-22T08:11:02.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.803+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94485887942544] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.805+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94485887947536] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.806+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.806+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94485887945264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c9a760 con 0x7f416c036020 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.806+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c99cd0 con 0x7f416c036020 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.807+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.807+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94485887953744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c99cd0 con 0x7f416c036020 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.807+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c9bb50 con 0x7f416c036020 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.807+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94485887945264] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.808+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94485887953744] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.808+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.808+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94485887954800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c9a240 con 0x7f416c036020 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.808+0000 7f41743a7800 20 add_watcher() i=0 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.808+0000 7f41743a7800 20 add_watcher() i=1 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.808+0000 7f41743a7800 20 add_watcher() i=2 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.808+0000 7f41743a7800 20 add_watcher() i=3 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.808+0000 7f41743a7800 20 add_watcher() i=4 2024-09-22T08:11:02.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.808+0000 7f41743a7800 20 add_watcher() i=5 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.808+0000 7f41743a7800 20 add_watcher() i=6 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.809+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94485887954800] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.809+0000 7f41743a7800 20 add_watcher() i=7 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.809+0000 7f41743a7800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.809+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c9eb40 con 0x55ef35c87770 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.810+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.810+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94485887956544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c9c090 con 0x55ef35c87770 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.811+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94485887956544] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.811+0000 7f40237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.811+0000 7f41743a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.811+0000 7f41743a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.811+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca7660 con 0x55ef35c87770 2024-09-22T08:11:02.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.812+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.812+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca7d10 con 0x7f416c036020 2024-09-22T08:11:02.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.813+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.813+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca8130 con 0x55ef35c90c40 2024-09-22T08:11:02.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.814+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.814+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca86a0 con 0x55ef35c87770 2024-09-22T08:11:02.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.816+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.816+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca8b50 con 0x55ef35c8c160 2024-09-22T08:11:02.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.817+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.817+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca8b50 con 0x55ef35c90c40 2024-09-22T08:11:02.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.818+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.818+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca54a0 con 0x55ef35c87770 2024-09-22T08:11:02.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.820+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.820+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca54a0 con 0x7f416c036020 2024-09-22T08:11:02.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.821+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.821+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca52d0 con 0x55ef35c8c160 2024-09-22T08:11:02.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.822+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.822+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca52d0 con 0x55ef35c90c40 2024-09-22T08:11:02.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.822+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.823+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53e0 con 0x55ef35c8c160 2024-09-22T08:11:02.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.824+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.824+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53e0 con 0x7f416c036020 2024-09-22T08:11:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.825+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.825+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53e0 con 0x55ef35c8c160 2024-09-22T08:11:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.826+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.826+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53c0 con 0x7f416c036020 2024-09-22T08:11:02.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.827+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.827+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c87770 2024-09-22T08:11:02.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.828+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.828+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c90c40 2024-09-22T08:11:02.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.829+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.829+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c8c160 2024-09-22T08:11:02.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.830+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.830+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c90c40 2024-09-22T08:11:02.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.832+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.832+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c87770 2024-09-22T08:11:02.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.833+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.833+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c87770 2024-09-22T08:11:02.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.834+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.834+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c90c40 2024-09-22T08:11:02.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.835+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.835+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c8c160 2024-09-22T08:11:02.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.836+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.836+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c90c40 2024-09-22T08:11:02.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.837+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.837+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c90c40 2024-09-22T08:11:02.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.838+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.838+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c90c40 2024-09-22T08:11:02.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.838+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.839+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c90c40 2024-09-22T08:11:02.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.839+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.839+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x7f416c036020 2024-09-22T08:11:02.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.841+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.841+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c90c40 2024-09-22T08:11:02.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.842+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.842+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x7f416c036020 2024-09-22T08:11:02.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.843+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.843+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c90c40 2024-09-22T08:11:02.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.844+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.844+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x7f416c036020 2024-09-22T08:11:02.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.845+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.845+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca53a0 con 0x55ef35c8c160 2024-09-22T08:11:02.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.846+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.846+0000 7f40227fc640 20 reqs_thread_entry: start 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.846+0000 7f41743a7800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.846+0000 7f41743a7800 20 Filter name: none 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.846+0000 7f3f93fff640 20 reqs_thread_entry: start 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.846+0000 7f41743a7800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.846+0000 7f41743a7800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.846+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef35cd4620 con 0x7f416c036020 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.847+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.847+0000 7f41743a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.847+0000 7f41743a7800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.847+0000 7f41743a7800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:11:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:could not remove user: unable to remove user, user does not exist 2024-09-22T08:11:02.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.848+0000 7f40237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:02.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.848+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94485887956544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35ca64b0 con 0x55ef35c87770 2024-09-22T08:11:02.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.849+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94485887956544] v32'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.849+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94485887930272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c9b640 con 0x55ef35c8c160 2024-09-22T08:11:02.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.850+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94485887930272] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.850+0000 7f41743a7800 20 remove_watcher() i=0 2024-09-22T08:11:02.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.850+0000 7f41743a7800 2 removed watcher, disabling cache 2024-09-22T08:11:02.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.850+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94485887936208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c94fa0 con 0x55ef35c87770 2024-09-22T08:11:02.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.851+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94485887936208] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.851+0000 7f41743a7800 20 remove_watcher() i=1 2024-09-22T08:11:02.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.851+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94485887940272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c94fa0 con 0x55ef35c90c40 2024-09-22T08:11:02.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.852+0000 7f4171e91640 1 -- 172.21.15.165:0/1650604769 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94485887940272] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4164051070 con 0x55ef35c90c40 2024-09-22T08:11:02.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.852+0000 7f41743a7800 20 remove_watcher() i=2 2024-09-22T08:11:02.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.852+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94485887942544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c94fa0 con 0x55ef35c8c160 2024-09-22T08:11:02.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.853+0000 7f4172692640 1 -- 172.21.15.165:0/1650604769 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94485887942544] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f416c02a070 con 0x55ef35c8c160 2024-09-22T08:11:02.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.853+0000 7f41743a7800 20 remove_watcher() i=3 2024-09-22T08:11:02.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.853+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94485887947536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c97f90 con 0x55ef35c87770 2024-09-22T08:11:02.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.854+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94485887947536] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x55ef35c87770 2024-09-22T08:11:02.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.854+0000 7f41743a7800 20 remove_watcher() i=4 2024-09-22T08:11:02.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.854+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94485887945264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c94fa0 con 0x7f416c036020 2024-09-22T08:11:02.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.855+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94485887945264] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.855+0000 7f41743a7800 20 remove_watcher() i=5 2024-09-22T08:11:02.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.855+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94485887953744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c99310 con 0x7f416c036020 2024-09-22T08:11:02.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.856+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94485887953744] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.856+0000 7f41743a7800 20 remove_watcher() i=6 2024-09-22T08:11:02.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.856+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94485887954800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef35c98a30 con 0x7f416c036020 2024-09-22T08:11:02.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94485887954800] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4168029040 con 0x7f416c036020 2024-09-22T08:11:02.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 20 remove_watcher() i=7 2024-09-22T08:11:02.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f416c036020 msgr2=0x7f416c017030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f416c036020 0x7f416c017030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35c87770 msgr2=0x55ef35c89c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35c87770 0x55ef35c89c30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c8c160 msgr2=0x55ef35c8e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c8c160 0x55ef35c8e550 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ef35c90c40 msgr2=0x55ef35c93100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ef35c90c40 0x55ef35c93100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f403c03cfb0 msgr2=0x7f403c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f403c03cfb0 0x7f403c03f470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f416405c580 tx=0x7f416408a000 comp rx=0 tx=0).stop 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 msgr2=0x55ef35c7bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f41743a7800 1 --2- 172.21.15.165:0/1650604769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c74670 0x55ef35c7bcb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f416c016fd0 tx=0x7f416c054720 comp rx=0 tx=0).stop 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.857+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 reap_dead start 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f4171690640 1 -- 172.21.15.165:0/1650604769 reap_dead start 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 shutdown_connections 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 >> 172.21.15.165:0/1650604769 conn(0x55ef35c70a70 msgr2=0x55ef35c6ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 shutdown_connections 2024-09-22T08:11:02.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/1650604769 wait complete. 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/2099608072 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f404c03cfb0 msgr2=0x7f404c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 --2- 172.21.15.165:0/2099608072 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f404c03cfb0 0x7f404c03f470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4164074fd0 tx=0x7f416405d480 comp rx=0 tx=0).stop 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/2099608072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c67bd0 msgr2=0x55ef35c67ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 --2- 172.21.15.165:0/2099608072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c67bd0 0x55ef35c67ff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55ef35c4dce0 tx=0x7f416c018830 comp rx=0 tx=0).stop 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/2099608072 shutdown_connections 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 --2- 172.21.15.165:0/2099608072 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f404c03cfb0 0x7f404c03f470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 --2- 172.21.15.165:0/2099608072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35c67bd0 0x55ef35c67ff0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/2099608072 >> 172.21.15.165:0/2099608072 conn(0x55ef35c5bf80 msgr2=0x55ef35c5c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/2099608072 shutdown_connections 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/2099608072 wait complete. 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35b58a00 msgr2=0x55ef35c54330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35b58a00 0x55ef35c54330 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c566d0 msgr2=0x55ef35c58b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c566d0 0x55ef35c58b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803cfb0 msgr2=0x7f405803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803cfb0 0x7f405803f470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4168001d70 tx=0x7f41680012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 msgr2=0x55ef35c4cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.858+0000 7f41743a7800 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c4cce0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4164025c20 tx=0x7f4164002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.859+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 shutdown_connections 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.859+0000 7f41743a7800 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ef35c566d0 0x55ef35c58b70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.859+0000 7f41743a7800 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ef35b58a00 0x55ef35c54330 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.859+0000 7f41743a7800 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803cfb0 0x7f405803f470 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.859+0000 7f41743a7800 1 --2- 172.21.15.165:0/4096075470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ef35ac6cf0 0x55ef35c4cce0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.859+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 >> 172.21.15.165:0/4096075470 conn(0x55ef35b4dbb0 msgr2=0x55ef35c3f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.859+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 shutdown_connections 2024-09-22T08:11:02.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.859+0000 7f41743a7800 1 -- 172.21.15.165:0/4096075470 wait complete. 2024-09-22T08:11:02.867 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-22T08:11:02.868 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-22T08:11:02.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-22T08:11:02.868 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-22T08:11:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:02.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.912+0000 7fdaf7c40800 1 Processor -- start 2024-09-22T08:11:02.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.912+0000 7fdaf7c40800 1 -- start start 2024-09-22T08:11:02.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.912+0000 7fdaf7c40800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e7bb343b00 0x55e7bb345ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.912+0000 7fdaf7c40800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e7bb1caa20 con 0x55e7bb33fff0 2024-09-22T08:11:02.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.912+0000 7fdaf7c40800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e7bb1ca7d0 con 0x55e7bb343b00 2024-09-22T08:11:02.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.913+0000 7fdaf4f29640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e7bb343b00 0x55e7bb345ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.913+0000 7fdaf572a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e7bb33fff0 0x55e7bb3423e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33424/0 (socket says 172.21.15.165:33424) 2024-09-22T08:11:02.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.913+0000 7fdaf572a640 1 -- 172.21.15.165:0/90810841 learned_addr learned my addr 172.21.15.165:0/90810841 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:02.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.913+0000 7fdaf4f29640 1 -- 172.21.15.165:0/90810841 >> v1:172.21.15.53:6789/0 conn(0x55e7bb33fff0 legacy=0x55e7bb3423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.913+0000 7fdaf4f29640 1 -- 172.21.15.165:0/90810841 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bb347580 con 0x55e7bb343b00 2024-09-22T08:11:02.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.915+0000 7fdaf4f29640 1 --2- 172.21.15.165:0/90810841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb343b00 0x55e7bb345ef0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdae000a470 tx=0x7fdae0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4900e1710d9f4f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.915+0000 7fdaeffff640 1 -- 172.21.15.165:0/90810841 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae0053570 con 0x55e7bb343b00 2024-09-22T08:11:02.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.915+0000 7fdaeffff640 1 -- 172.21.15.165:0/90810841 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae0058070 con 0x55e7bb343b00 2024-09-22T08:11:02.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.915+0000 7fdaeffff640 1 -- 172.21.15.165:0/90810841 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae0053880 con 0x55e7bb343b00 2024-09-22T08:11:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.916+0000 7fdaf7c40800 1 -- 172.21.15.165:0/90810841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb343b00 msgr2=0x55e7bb345ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.916+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/90810841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb343b00 0x55e7bb345ef0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdae000a470 tx=0x7fdae0045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.916+0000 7fdaf7c40800 1 -- 172.21.15.165:0/90810841 shutdown_connections 2024-09-22T08:11:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.916+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/90810841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb343b00 0x55e7bb345ef0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.916+0000 7fdaf7c40800 1 -- 172.21.15.165:0/90810841 >> 172.21.15.165:0/90810841 conn(0x55e7bb339bb0 msgr2=0x55e7bb33c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.916+0000 7fdaf7c40800 1 -- 172.21.15.165:0/90810841 shutdown_connections 2024-09-22T08:11:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.916+0000 7fdaf7c40800 1 -- 172.21.15.165:0/90810841 wait complete. 2024-09-22T08:11:02.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.930+0000 7fdaf7c40800 1 Processor -- start 2024-09-22T08:11:02.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.930+0000 7fdaf7c40800 1 -- start start 2024-09-22T08:11:02.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.930+0000 7fdaf7c40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb33f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.930+0000 7fdaf7c40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e7bb1d7dd0 con 0x55e7bb33fff0 2024-09-22T08:11:02.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.930+0000 7fdaf572a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb33f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.930+0000 7fdaf572a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb33f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50534/0 (socket says 172.21.15.165:50534) 2024-09-22T08:11:02.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.930+0000 7fdaf572a640 1 -- 172.21.15.165:0/2612529208 learned_addr learned my addr 172.21.15.165:0/2612529208 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.930+0000 7fdaf572a640 1 -- 172.21.15.165:0/2612529208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bb33fd70 con 0x55e7bb33fff0 2024-09-22T08:11:02.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.931+0000 7fdaf572a640 1 --2- 172.21.15.165:0/2612529208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb33f780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdae8001800 tx=0x7fdae8001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524b186b37356c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.931+0000 7fd9e3606640 1 -- 172.21.15.165:0/2612529208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae8004520 con 0x55e7bb33fff0 2024-09-22T08:11:02.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.931+0000 7fd9e3606640 1 -- 172.21.15.165:0/2612529208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae80046c0 con 0x55e7bb33fff0 2024-09-22T08:11:02.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.931+0000 7fd9e3606640 1 -- 172.21.15.165:0/2612529208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae80049e0 con 0x55e7bb33fff0 2024-09-22T08:11:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.931+0000 7fdaf7c40800 1 -- 172.21.15.165:0/2612529208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 msgr2=0x55e7bb33f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.931+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/2612529208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb33f780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdae8001800 tx=0x7fdae8001cc0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.931+0000 7fdaf7c40800 1 -- 172.21.15.165:0/2612529208 shutdown_connections 2024-09-22T08:11:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.931+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/2612529208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb33f780 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.931+0000 7fdaf7c40800 1 -- 172.21.15.165:0/2612529208 >> 172.21.15.165:0/2612529208 conn(0x55e7bb339bb0 msgr2=0x55e7bb42a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.932+0000 7fdaf7c40800 1 -- 172.21.15.165:0/2612529208 shutdown_connections 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.932+0000 7fdaf7c40800 1 -- 172.21.15.165:0/2612529208 wait complete. 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.932+0000 7fdaf7c40800 1 Processor -- start 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.932+0000 7fdaf7c40800 1 -- start start 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.932+0000 7fdaf7c40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb438dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.932+0000 7fdaf7c40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e7bb346820 con 0x55e7bb33fff0 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.932+0000 7fdaf572a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb438dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.932+0000 7fdaf572a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb438dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50540/0 (socket says 172.21.15.165:50540) 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.932+0000 7fdaf572a640 1 -- 172.21.15.165:0/1429231387 learned_addr learned my addr 172.21.15.165:0/1429231387 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.933+0000 7fdaf572a640 1 -- 172.21.15.165:0/1429231387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bb439320 con 0x55e7bb33fff0 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.933+0000 7fdaf572a640 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb438dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdae8000f80 tx=0x7fdae8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.933+0000 7fd9e1e03640 1 -- 172.21.15.165:0/1429231387 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae8022020 con 0x55e7bb33fff0 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.933+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7bb4395b0 con 0x55e7bb33fff0 2024-09-22T08:11:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.933+0000 7fd9e1e03640 1 -- 172.21.15.165:0/1429231387 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae8014890 con 0x55e7bb33fff0 2024-09-22T08:11:02.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.933+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7bb439fb0 con 0x55e7bb33fff0 2024-09-22T08:11:02.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.933+0000 7fd9e1e03640 1 -- 172.21.15.165:0/1429231387 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae8014b70 con 0x55e7bb33fff0 2024-09-22T08:11:02.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.934+0000 7fd9e1e03640 1 -- 172.21.15.165:0/1429231387 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdae8025020 con 0x55e7bb33fff0 2024-09-22T08:11:02.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.934+0000 7fd9e1e03640 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9dc03cfb0 0x7fd9dc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.934+0000 7fd9e1e03640 1 -- 172.21.15.165:0/1429231387 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fdae8018030 con 0x55e7bb33fff0 2024-09-22T08:11:02.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.934+0000 7fdaf4f29640 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9dc03cfb0 0x7fd9dc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.935+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb343b00 0x55e7bb440410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.935+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb440950 con 0x55e7bb343b00 2024-09-22T08:11:02.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.935+0000 7fdaf5f2b640 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb343b00 0x55e7bb440410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.935+0000 7fdaf4f29640 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9dc03cfb0 0x7fd9dc03f470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdae0057000 tx=0x7fdae0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.935+0000 7fdaf5f2b640 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb343b00 0x55e7bb440410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.935+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1429231387 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb343b00 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.935+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb440cf0 con 0x55e7bb343b00 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.935+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1429231387 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb343b00 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.935+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb442830 0x55e7bb444cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.935+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb445460 con 0x55e7bb442830 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.936+0000 7fdaf572a640 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb442830 0x55e7bb444cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.936+0000 7fdaf572a640 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb442830 0x55e7bb444cd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.936+0000 7fdaf572a640 1 -- 172.21.15.165:0/1429231387 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb442830 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.936+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb441540 con 0x55e7bb343b00 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.936+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1429231387 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb343b00 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.936+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4419e0 con 0x55e7bb343b00 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.937+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1429231387 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb343b00 2024-09-22T08:11:02.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.937+0000 7fdaf7c40800 1 Processor -- start 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.937+0000 7fdaf7c40800 1 -- start start 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.937+0000 7fdaf7c40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb453e10 0x55e7bb454230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.937+0000 7fdaf7c40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e7bb236d50 con 0x55e7bb453e10 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.937+0000 7fdaf5f2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb453e10 0x55e7bb454230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.937+0000 7fdaf5f2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb453e10 0x55e7bb454230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50546/0 (socket says 172.21.15.165:50546) 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.937+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/3231988794 learned_addr learned my addr 172.21.15.165:0/3231988794 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.938+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/3231988794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bb454870 con 0x55e7bb453e10 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.938+0000 7fdaf5f2b640 1 --2- 172.21.15.165:0/3231988794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb453e10 0x55e7bb454230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55e7bb43ad50 tx=0x7fdaf000af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.938+0000 7fd9daffd640 1 -- 172.21.15.165:0/3231988794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf0007d60 con 0x55e7bb453e10 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.938+0000 7fd9daffd640 1 -- 172.21.15.165:0/3231988794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf001e020 con 0x55e7bb453e10 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.938+0000 7fd9daffd640 1 -- 172.21.15.165:0/3231988794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf0019590 con 0x55e7bb453e10 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.938+0000 7fdaf7c40800 1 -- 172.21.15.165:0/3231988794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7bb4550a0 con 0x55e7bb453e10 2024-09-22T08:11:02.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.938+0000 7fdaf7c40800 1 -- 172.21.15.165:0/3231988794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7bb455640 con 0x55e7bb453e10 2024-09-22T08:11:02.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.939+0000 7fd9daffd640 1 -- 172.21.15.165:0/3231988794 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdaf0016040 con 0x55e7bb453e10 2024-09-22T08:11:02.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.939+0000 7fd9daffd640 1 --2- 172.21.15.165:0/3231988794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9cc03d000 0x7fd9cc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.939+0000 7fd9daffd640 1 -- 172.21.15.165:0/3231988794 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fdaf001f030 con 0x55e7bb453e10 2024-09-22T08:11:02.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.939+0000 7fdaf572a640 1 --2- 172.21.15.165:0/3231988794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9cc03d000 0x7fd9cc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.939+0000 7fdaf7c40800 1 Processor -- start 2024-09-22T08:11:02.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.940+0000 7fdaf7c40800 1 -- start start 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.940+0000 7fdaf572a640 1 --2- 172.21.15.165:0/3231988794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9cc03d000 0x7fd9cc03f4c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdae801dad0 tx=0x7fdae8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.940+0000 7fdaf7c40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb460cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.940+0000 7fdaf7c40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e7bb33e1d0 con 0x55e7bb4608d0 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.940+0000 7fdaf5f2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb460cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.940+0000 7fdaf5f2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb460cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50558/0 (socket says 172.21.15.165:50558) 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.940+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1475379335 learned_addr learned my addr 172.21.15.165:0/1475379335 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.940+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1475379335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bb4612c0 con 0x55e7bb4608d0 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.940+0000 7fdaf5f2b640 1 --2- 172.21.15.165:0/1475379335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb460cd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0054590 tx=0x7fdaf0014b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9b837ec33f76bd server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fd9d8ff9640 1 -- 172.21.15.165:0/1475379335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf001d070 con 0x55e7bb4608d0 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fd9d8ff9640 1 -- 172.21.15.165:0/1475379335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf004dbc0 con 0x55e7bb4608d0 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fd9d8ff9640 1 -- 172.21.15.165:0/1475379335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf0045130 con 0x55e7bb4608d0 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1475379335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 msgr2=0x55e7bb460cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:02.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1475379335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb460cd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0054590 tx=0x7fdaf0014b20 comp rx=0 tx=0).stop 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1475379335 shutdown_connections 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1475379335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb460cd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1475379335 >> 172.21.15.165:0/1475379335 conn(0x55e7bb45ccd0 msgr2=0x55e7bb45af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1475379335 shutdown_connections 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1475379335 wait complete. 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fdaf7c40800 1 Processor -- start 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.941+0000 7fdaf7c40800 1 -- start start 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fdaf7c40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb467ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fdaf7c40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e7bb4618e0 con 0x55e7bb4608d0 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fdaf5f2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb467ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fdaf5f2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb467ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50568/0 (socket says 172.21.15.165:50568) 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 learned_addr learned my addr 172.21.15.165:0/1056067023 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bb468430 con 0x55e7bb4608d0 2024-09-22T08:11:02.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fdaf5f2b640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb467ed0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0014b60 tx=0x7fdaf0054520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fd9caffd640 1 -- 172.21.15.165:0/1056067023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf0044070 con 0x55e7bb4608d0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fd9caffd640 1 -- 172.21.15.165:0/1056067023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf0031070 con 0x55e7bb4608d0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7bb4686c0 con 0x55e7bb4608d0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.942+0000 7fd9caffd640 1 -- 172.21.15.165:0/1056067023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf0014340 con 0x55e7bb4608d0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.943+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7bb469040 con 0x55e7bb4608d0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.943+0000 7fd9caffd640 1 -- 172.21.15.165:0/1056067023 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdaf00145f0 con 0x55e7bb4608d0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.943+0000 7fd9caffd640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9c003cf60 0x7fd9c003f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.944+0000 7fd9caffd640 1 -- 172.21.15.165:0/1056067023 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fdaf0004280 con 0x55e7bb4608d0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.944+0000 7fdaf572a640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9c003cf60 0x7fd9c003f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.944+0000 7fdaf572a640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9c003cf60 0x7fd9c003f420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdae8052b30 tx=0x7fdae8033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.944+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.944+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb4737c0 0x55e7bb475c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.944+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4763d0 con 0x55e7bb4737c0 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.944+0000 7fdaf4f29640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb4737c0 0x55e7bb475c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf4f29640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb4737c0 0x55e7bb475c80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 20 realm 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb476800 con 0x55e7bb4737c0 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4770d0 con 0x55e7bb4737c0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb477470 con 0x55e7bb4737c0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb4781d0 0x55e7bb47a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.945+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47abd0 con 0x55e7bb4781d0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.946+0000 7fdaf5f2b640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb4781d0 0x55e7bb47a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.946+0000 7fdaf5f2b640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb4781d0 0x55e7bb47a5c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.946+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.946+0000 7fdaf7c40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.946+0000 7fdaf7c40800 20 searching for the correct realm 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.946+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e7bb47cb80 0x55e7bb47f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.946+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb47cb80 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.946+0000 7fdaf572a640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e7bb47cb80 0x55e7bb47f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.946+0000 7fdaf572a640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e7bb47cb80 0x55e7bb47f040 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.947+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.947+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4781d0 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.947+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.947+0000 7fdaf5f2b640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fdaf0019040 0x7fdaf002ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.947+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x7fdaf0019040 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.947+0000 7fdaf4f29640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fdaf0019040 0x7fdaf002ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.948+0000 7fdaf4f29640 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fdaf0019040 0x7fdaf002ca80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:02.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.948+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.948+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4737c0 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.948+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.948+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4737c0 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.948+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.948+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x7fdaf0019040 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.949+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.949+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x7fdaf0019040 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.949+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.949+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4781d0 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.949+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.949+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb47cb80 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.949+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.949+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4737c0 2024-09-22T08:11:02.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.949+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.949+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x7fdaf0019040 2024-09-22T08:11:02.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.950+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.950+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4737c0 2024-09-22T08:11:02.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.950+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.950+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4781d0 2024-09-22T08:11:02.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.950+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.950+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb47cb80 2024-09-22T08:11:02.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.950+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.950+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb47cb80 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.951+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.951+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x7fdaf0019040 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.951+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.951+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb47cb80 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.951+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.951+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb47cb80 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.951+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.951+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4737c0 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.952+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.952+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4737c0 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.952+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.952+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x7fdaf0019040 2024-09-22T08:11:02.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.952+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.952+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb47cb80 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.953+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.953+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4781d0 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.953+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.953+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4737c0 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.953+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.953+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x7fdaf0019040 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.953+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.953+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb47cb80 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.954+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.954+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x7fdaf0019040 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.954+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.954+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4781d0 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.954+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.954+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb47cb80 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.954+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.954+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x7fdaf0019040 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4737c0 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47f6c0 con 0x55e7bb4781d0 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf7c40800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf7c40800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf7c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf7c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf7c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf7c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47b590 con 0x55e7bb4737c0 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.955+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47be30 con 0x55e7bb4737c0 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47fb40 con 0x55e7bb4737c0 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 20 zone default found 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 4 Realm: () 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 20 zonegroup default 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb47ff70 con 0x7fdaf0019040 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.956+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb481da0 con 0x55e7bb47cb80 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.957+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.957+0000 7fdaf7c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.957+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.957+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb482280 con 0x55e7bb47cb80 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.957+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.957+0000 7fdaf7c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.957+0000 7fdaf7c40800 20 started sync module instance, tier type = 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.957+0000 7fdaf7c40800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.957+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb481240 con 0x55e7bb4781d0 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.958+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.958+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94453767870272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb481240 con 0x55e7bb4781d0 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.958+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb482d40 con 0x55e7bb4737c0 2024-09-22T08:11:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.959+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94453767870272] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.959+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.959+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94453767874640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb481240 con 0x55e7bb4737c0 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.959+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4837f0 con 0x55e7bb47cb80 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.960+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94453767874640] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.961+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.961+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94453767867792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4811b0 con 0x55e7bb47cb80 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.961+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4846b0 con 0x55e7bb4781d0 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.962+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94453767867792] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.962+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.962+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94453767881216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb484620 con 0x55e7bb4781d0 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.962+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb485570 con 0x55e7bb4737c0 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.963+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.963+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94453767884992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4854e0 con 0x55e7bb4737c0 2024-09-22T08:11:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.963+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4864b0 con 0x7fdaf0019040 2024-09-22T08:11:02.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.963+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94453767881216] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.964+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.964+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94453767888768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb486470 con 0x7fdaf0019040 2024-09-22T08:11:02.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.964+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb486ec0 con 0x7fdaf0019040 2024-09-22T08:11:02.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.964+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94453767884992] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.965+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94453767888768] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.965+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.965+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94453767883424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb486a10 con 0x7fdaf0019040 2024-09-22T08:11:02.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.965+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4873d0 con 0x7fdaf0019040 2024-09-22T08:11:02.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.966+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94453767883424] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.966+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.966+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94453767887200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4873d0 con 0x7fdaf0019040 2024-09-22T08:11:02.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.966+0000 7fdaf7c40800 20 add_watcher() i=0 2024-09-22T08:11:02.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.966+0000 7fdaf7c40800 20 add_watcher() i=1 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.966+0000 7fdaf7c40800 20 add_watcher() i=2 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.966+0000 7fdaf7c40800 20 add_watcher() i=3 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.966+0000 7fdaf7c40800 20 add_watcher() i=4 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.966+0000 7fdaf7c40800 20 add_watcher() i=5 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.966+0000 7fdaf7c40800 20 add_watcher() i=6 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.968+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94453767887200] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.968+0000 7fdaf7c40800 20 add_watcher() i=7 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.968+0000 7fdaf7c40800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.968+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb48a860 con 0x55e7bb4737c0 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.968+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.968+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94453767905824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb487540 con 0x55e7bb4737c0 2024-09-22T08:11:02.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.969+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94453767905824] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.969+0000 7fd9abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:02.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.969+0000 7fdaf7c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:02.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.969+0000 7fdaf7c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:02.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.969+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb493380 con 0x55e7bb4737c0 2024-09-22T08:11:02.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.970+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.970+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb493a10 con 0x7fdaf0019040 2024-09-22T08:11:02.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.972+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.972+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb493f80 con 0x55e7bb47cb80 2024-09-22T08:11:02.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.975+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.975+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb494580 con 0x55e7bb4737c0 2024-09-22T08:11:02.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.978+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.978+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb494a30 con 0x55e7bb4781d0 2024-09-22T08:11:02.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.981+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.981+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb494a30 con 0x55e7bb47cb80 2024-09-22T08:11:02.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.983+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.983+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb494ac0 con 0x55e7bb4737c0 2024-09-22T08:11:02.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.985+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:02.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.985+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb494b50 con 0x7fdaf0019040 2024-09-22T08:11:02.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.986+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.986+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb494c60 con 0x55e7bb4781d0 2024-09-22T08:11:02.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.987+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.987+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb494cf0 con 0x55e7bb47cb80 2024-09-22T08:11:02.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.988+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:02.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.988+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb495280 con 0x55e7bb4781d0 2024-09-22T08:11:02.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.991+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.991+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb495260 con 0x7fdaf0019040 2024-09-22T08:11:02.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.992+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.992+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb495230 con 0x55e7bb4781d0 2024-09-22T08:11:02.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.994+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:02.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.994+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb495230 con 0x7fdaf0019040 2024-09-22T08:11:02.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.998+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:02.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:02.998+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4951a0 con 0x55e7bb4737c0 2024-09-22T08:11:03.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.000+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:03.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.000+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4951a0 con 0x55e7bb47cb80 2024-09-22T08:11:03.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.002+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:03.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.002+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4951a0 con 0x55e7bb4781d0 2024-09-22T08:11:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.005+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.005+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4951a0 con 0x55e7bb47cb80 2024-09-22T08:11:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.006+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.006+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4951a0 con 0x55e7bb4737c0 2024-09-22T08:11:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.007+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.007+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4951a0 con 0x55e7bb4737c0 2024-09-22T08:11:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.008+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.008+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4951a0 con 0x55e7bb47cb80 2024-09-22T08:11:03.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.011+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:03.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.011+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4951a0 con 0x55e7bb4781d0 2024-09-22T08:11:03.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.012+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:03.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.012+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4951a0 con 0x55e7bb47cb80 2024-09-22T08:11:03.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.014+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:03.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.014+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4951e0 con 0x55e7bb47cb80 2024-09-22T08:11:03.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.016+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:03.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.016+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb495220 con 0x55e7bb47cb80 2024-09-22T08:11:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.019+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.019+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb495220 con 0x55e7bb47cb80 2024-09-22T08:11:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.020+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.020+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb495260 con 0x7fdaf0019040 2024-09-22T08:11:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.023+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.023+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4952a0 con 0x55e7bb47cb80 2024-09-22T08:11:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.025+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.025+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4952a0 con 0x7fdaf0019040 2024-09-22T08:11:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.027+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.027+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4952a0 con 0x55e7bb47cb80 2024-09-22T08:11:03.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.028+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:03.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.028+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4952a0 con 0x7fdaf0019040 2024-09-22T08:11:03.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.031+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:03.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.031+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4952e0 con 0x55e7bb4781d0 2024-09-22T08:11:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.033+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.033+0000 7fd9aafe5640 20 reqs_thread_entry: start 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.033+0000 7fdaf7c40800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.033+0000 7fdaf7c40800 20 Filter name: none 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.033+0000 7fd9a8fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.033+0000 7fdaf7c40800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.033+0000 7fdaf7c40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.033+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4c0200 con 0x55e7bb4737c0 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.034+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.034+0000 7fdaf7c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.034+0000 7fdaf7c40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.034+0000 7fdaf7c40800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:could not remove user: unable to remove user, user does not exist 2024-09-22T08:11:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.034+0000 7fd9abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.034+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94453767905824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb489380 con 0x55e7bb4737c0 2024-09-22T08:11:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.035+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94453767905824] v32'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.035+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94453767870272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb48a220 con 0x55e7bb4781d0 2024-09-22T08:11:03.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.036+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94453767870272] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:03.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.036+0000 7fdaf7c40800 20 remove_watcher() i=0 2024-09-22T08:11:03.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.036+0000 7fdaf7c40800 2 removed watcher, disabling cache 2024-09-22T08:11:03.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.036+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94453767874640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb481740 con 0x55e7bb4737c0 2024-09-22T08:11:03.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.037+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94453767874640] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:03.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.037+0000 7fdaf7c40800 20 remove_watcher() i=1 2024-09-22T08:11:03.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.037+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94453767867792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb481740 con 0x55e7bb47cb80 2024-09-22T08:11:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.039+0000 7fdaf572a640 1 -- 172.21.15.165:0/1056067023 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94453767867792] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae801b070 con 0x55e7bb47cb80 2024-09-22T08:11:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.039+0000 7fdaf7c40800 20 remove_watcher() i=2 2024-09-22T08:11:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.039+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94453767881216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb480d90 con 0x55e7bb4781d0 2024-09-22T08:11:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.040+0000 7fdaf5f2b640 1 -- 172.21.15.165:0/1056067023 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94453767881216] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaf00083e0 con 0x55e7bb4781d0 2024-09-22T08:11:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.040+0000 7fdaf7c40800 20 remove_watcher() i=3 2024-09-22T08:11:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.040+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94453767884992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb481740 con 0x55e7bb4737c0 2024-09-22T08:11:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.042+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94453767884992] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x55e7bb4737c0 2024-09-22T08:11:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.042+0000 7fdaf7c40800 20 remove_watcher() i=4 2024-09-22T08:11:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.042+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94453767888768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb484200 con 0x7fdaf0019040 2024-09-22T08:11:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.043+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94453767888768] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.043+0000 7fdaf7c40800 20 remove_watcher() i=5 2024-09-22T08:11:03.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.043+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94453767883424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb480d90 con 0x7fdaf0019040 2024-09-22T08:11:03.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.044+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94453767883424] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:03.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.044+0000 7fdaf7c40800 20 remove_watcher() i=6 2024-09-22T08:11:03.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.044+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94453767887200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e7bb4850c0 con 0x7fdaf0019040 2024-09-22T08:11:03.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94453767887200] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdae0051070 con 0x7fdaf0019040 2024-09-22T08:11:03.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 20 remove_watcher() i=7 2024-09-22T08:11:03.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fdaf0019040 msgr2=0x7fdaf002ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fdaf0019040 0x7fdaf002ca80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb4737c0 msgr2=0x55e7bb475c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb4737c0 0x55e7bb475c80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb4781d0 msgr2=0x55e7bb47a5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb4781d0 0x55e7bb47a5c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e7bb47cb80 msgr2=0x55e7bb47f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e7bb47cb80 0x55e7bb47f040 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9c003cf60 msgr2=0x7fd9c003f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9c003cf60 0x7fd9c003f420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdae8052b30 tx=0x7fdae8033000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 msgr2=0x55e7bb467ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1056067023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb4608d0 0x55e7bb467ed0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0014b60 tx=0x7fdaf0054520 comp rx=0 tx=0).stop 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 reap_dead start 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf4f29640 1 -- 172.21.15.165:0/1056067023 reap_dead start 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 shutdown_connections 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 >> 172.21.15.165:0/1056067023 conn(0x55e7bb45ccd0 msgr2=0x55e7bb45aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 shutdown_connections 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.045+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1056067023 wait complete. 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/3231988794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9cc03d000 msgr2=0x7fd9cc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/3231988794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9cc03d000 0x7fd9cc03f4c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdae801dad0 tx=0x7fdae8016000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/3231988794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb453e10 msgr2=0x55e7bb454230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/3231988794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb453e10 0x55e7bb454230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55e7bb43ad50 tx=0x7fdaf000af20 comp rx=0 tx=0).stop 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/3231988794 shutdown_connections 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/3231988794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9cc03d000 0x7fd9cc03f4c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/3231988794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb453e10 0x55e7bb454230 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/3231988794 >> 172.21.15.165:0/3231988794 conn(0x55e7bb4481c0 msgr2=0x55e7bb4485a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/3231988794 shutdown_connections 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/3231988794 wait complete. 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb343b00 msgr2=0x55e7bb440410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb343b00 0x55e7bb440410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb442830 msgr2=0x55e7bb444cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb442830 0x55e7bb444cd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9dc03cfb0 msgr2=0x7fd9dc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9dc03cfb0 0x7fd9dc03f470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdae0057000 tx=0x7fdae0052000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 msgr2=0x55e7bb438dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb438dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdae8000f80 tx=0x7fdae8001250 comp rx=0 tx=0).stop 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 shutdown_connections 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e7bb442830 0x55e7bb444cd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e7bb343b00 0x55e7bb440410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9dc03cfb0 0x7fd9dc03f470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 --2- 172.21.15.165:0/1429231387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7bb33fff0 0x55e7bb438dc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 >> 172.21.15.165:0/1429231387 conn(0x55e7bb339bb0 msgr2=0x55e7bb42a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 shutdown_connections 2024-09-22T08:11:03.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.046+0000 7fdaf7c40800 1 -- 172.21.15.165:0/1429231387 wait complete. 2024-09-22T08:11:03.055 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-22T08:11:03.055 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-22T08:11:03.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-22T08:11:03.056 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-22T08:11:03.102 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:03.102 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:03.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.102+0000 7f642d81d800 1 Processor -- start 2024-09-22T08:11:03.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.102+0000 7f642d81d800 1 -- start start 2024-09-22T08:11:03.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.102+0000 7f642d81d800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555d2de15cc0 0x555d2de18180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.102+0000 7f642d81d800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555d2dc9aa20 con 0x555d2dd83620 2024-09-22T08:11:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.102+0000 7f642d81d800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555d2dc9a7d0 con 0x555d2de15cc0 2024-09-22T08:11:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.103+0000 7f64287ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555d2de15cc0 0x555d2de18180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.103+0000 7f6428feb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x555d2dd83620 0x555d2de145a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33440/0 (socket says 172.21.15.165:33440) 2024-09-22T08:11:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.103+0000 7f6428feb640 1 -- 172.21.15.165:0/2585837539 learned_addr learned my addr 172.21.15.165:0/2585837539 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:03.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.103+0000 7f6427fe9640 1 -- 172.21.15.165:0/2585837539 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 45095931 0 0) 0x555d2dc9aa20 con 0x555d2dd83620 2024-09-22T08:11:03.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.103+0000 7f6427fe9640 1 -- 172.21.15.165:0/2585837539 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6414001e10 con 0x555d2dd83620 2024-09-22T08:11:03.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.103+0000 7f64287ea640 1 -- 172.21.15.165:0/2585837539 >> v1:172.21.15.53:6789/0 conn(0x555d2dd83620 legacy=0x555d2de145a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.103+0000 7f64287ea640 1 -- 172.21.15.165:0/2585837539 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d2de19860 con 0x555d2de15cc0 2024-09-22T08:11:03.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.105+0000 7f64287ea640 1 --2- 172.21.15.165:0/2585837539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2de15cc0 0x555d2de18180 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f641000a470 tx=0x7f6410045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805c04ea311f78d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.105+0000 7f6427fe9640 1 -- 172.21.15.165:0/2585837539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6410059070 con 0x555d2de15cc0 2024-09-22T08:11:03.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.105+0000 7f6427fe9640 1 -- 172.21.15.165:0/2585837539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6410054570 con 0x555d2de15cc0 2024-09-22T08:11:03.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.105+0000 7f6427fe9640 1 -- 172.21.15.165:0/2585837539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6410054850 con 0x555d2de15cc0 2024-09-22T08:11:03.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.105+0000 7f642d81d800 1 -- 172.21.15.165:0/2585837539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2de15cc0 msgr2=0x555d2de18180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.105+0000 7f642d81d800 1 --2- 172.21.15.165:0/2585837539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2de15cc0 0x555d2de18180 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f641000a470 tx=0x7f6410045920 comp rx=0 tx=0).stop 2024-09-22T08:11:03.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.105+0000 7f642d81d800 1 -- 172.21.15.165:0/2585837539 shutdown_connections 2024-09-22T08:11:03.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.105+0000 7f642d81d800 1 --2- 172.21.15.165:0/2585837539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2de15cc0 0x555d2de18180 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.105+0000 7f642d81d800 1 -- 172.21.15.165:0/2585837539 >> 172.21.15.165:0/2585837539 conn(0x555d2de09cb0 msgr2=0x555d2de0c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.106+0000 7f642d81d800 1 -- 172.21.15.165:0/2585837539 shutdown_connections 2024-09-22T08:11:03.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.106+0000 7f642d81d800 1 -- 172.21.15.165:0/2585837539 wait complete. 2024-09-22T08:11:03.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.119+0000 7f642d81d800 1 Processor -- start 2024-09-22T08:11:03.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.119+0000 7f642d81d800 1 -- start start 2024-09-22T08:11:03.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.119+0000 7f642d81d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df01130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.119+0000 7f642d81d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d2dca7dd0 con 0x555d2dd83620 2024-09-22T08:11:03.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.120+0000 7f6428feb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df01130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.120+0000 7f6428feb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df01130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50586/0 (socket says 172.21.15.165:50586) 2024-09-22T08:11:03.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.120+0000 7f6428feb640 1 -- 172.21.15.165:0/2623435366 learned_addr learned my addr 172.21.15.165:0/2623435366 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.120+0000 7f6428feb640 1 -- 172.21.15.165:0/2623435366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d2df01720 con 0x555d2dd83620 2024-09-22T08:11:03.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.120+0000 7f6428feb640 1 --2- 172.21.15.165:0/2623435366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df01130 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f64180016c0 tx=0x7f6418001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a053212be2038ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.120+0000 7f6316e0d640 1 -- 172.21.15.165:0/2623435366 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6418004520 con 0x555d2dd83620 2024-09-22T08:11:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.120+0000 7f6316e0d640 1 -- 172.21.15.165:0/2623435366 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64180046c0 con 0x555d2dd83620 2024-09-22T08:11:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.120+0000 7f6316e0d640 1 -- 172.21.15.165:0/2623435366 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64180049c0 con 0x555d2dd83620 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.121+0000 7f642d81d800 1 -- 172.21.15.165:0/2623435366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 msgr2=0x555d2df01130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.121+0000 7f642d81d800 1 --2- 172.21.15.165:0/2623435366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df01130 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f64180016c0 tx=0x7f6418001b80 comp rx=0 tx=0).stop 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.121+0000 7f642d81d800 1 -- 172.21.15.165:0/2623435366 shutdown_connections 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.121+0000 7f642d81d800 1 --2- 172.21.15.165:0/2623435366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df01130 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.121+0000 7f642d81d800 1 -- 172.21.15.165:0/2623435366 >> 172.21.15.165:0/2623435366 conn(0x555d2de09cb0 msgr2=0x555d2defcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.121+0000 7f642d81d800 1 -- 172.21.15.165:0/2623435366 shutdown_connections 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.121+0000 7f642d81d800 1 -- 172.21.15.165:0/2623435366 wait complete. 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.121+0000 7f642d81d800 1 Processor -- start 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.121+0000 7f642d81d800 1 -- start start 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.122+0000 7f642d81d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df08c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.122+0000 7f642d81d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d2de18b00 con 0x555d2dd83620 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.122+0000 7f6428feb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df08c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.122+0000 7f6428feb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df08c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50598/0 (socket says 172.21.15.165:50598) 2024-09-22T08:11:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.122+0000 7f6428feb640 1 -- 172.21.15.165:0/967748442 learned_addr learned my addr 172.21.15.165:0/967748442 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.122+0000 7f6428feb640 1 -- 172.21.15.165:0/967748442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d2df09190 con 0x555d2dd83620 2024-09-22T08:11:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.122+0000 7f6428feb640 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df08c30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6418007fd0 tx=0x7f6418004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.123+0000 7f631560a640 1 -- 172.21.15.165:0/967748442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6418022020 con 0x555d2dd83620 2024-09-22T08:11:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.123+0000 7f631560a640 1 -- 172.21.15.165:0/967748442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6418019040 con 0x555d2dd83620 2024-09-22T08:11:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.123+0000 7f631560a640 1 -- 172.21.15.165:0/967748442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6418014940 con 0x555d2dd83620 2024-09-22T08:11:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.123+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d2df09420 con 0x555d2dd83620 2024-09-22T08:11:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.123+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d2df09e20 con 0x555d2dd83620 2024-09-22T08:11:03.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.123+0000 7f642d81d800 1 Processor -- start 2024-09-22T08:11:03.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.123+0000 7f642d81d800 1 -- start start 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.123+0000 7f642d81d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df18610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f642d81d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d2dd06d50 con 0x555d2df16220 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f631560a640 1 -- 172.21.15.165:0/967748442 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6418025020 con 0x555d2dd83620 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f631560a640 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631003d000 0x7f631003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f64297ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df18610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f64297ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df18610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50606/0 (socket says 172.21.15.165:50606) 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f64297ec640 1 -- 172.21.15.165:0/4056030548 learned_addr learned my addr 172.21.15.165:0/4056030548 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f631560a640 1 -- 172.21.15.165:0/967748442 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6418054470 con 0x555d2dd83620 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f6428feb640 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631003d000 0x7f631003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f64297ec640 1 -- 172.21.15.165:0/4056030548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d2df18be0 con 0x555d2df16220 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f64297ec640 1 --2- 172.21.15.165:0/4056030548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df18610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f642000a430 tx=0x7f642000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1b4035efbea05b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f6428feb640 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631003d000 0x7f631003f4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6418026ff0 tx=0x7f6418010590 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f630effd640 1 -- 172.21.15.165:0/4056030548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420008840 con 0x555d2df16220 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f630effd640 1 -- 172.21.15.165:0/4056030548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420008a00 con 0x555d2df16220 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.124+0000 7f630effd640 1 -- 172.21.15.165:0/4056030548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420008d20 con 0x555d2df16220 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.125+0000 7f642d81d800 1 -- 172.21.15.165:0/4056030548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 msgr2=0x555d2df18610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.125+0000 7f642d81d800 1 --2- 172.21.15.165:0/4056030548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df18610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f642000a430 tx=0x7f642000a8f0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.125+0000 7f642d81d800 1 -- 172.21.15.165:0/4056030548 shutdown_connections 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.125+0000 7f642d81d800 1 --2- 172.21.15.165:0/4056030548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df18610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.125+0000 7f642d81d800 1 -- 172.21.15.165:0/4056030548 >> 172.21.15.165:0/4056030548 conn(0x555d2de15cc0 msgr2=0x555d2df10b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.125+0000 7f642d81d800 1 -- 172.21.15.165:0/4056030548 shutdown_connections 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.125+0000 7f642d81d800 1 -- 172.21.15.165:0/4056030548 wait complete. 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.125+0000 7f642d81d800 1 Processor -- start 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.125+0000 7f642d81d800 1 -- start start 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.126+0000 7f642d81d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df1d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.126+0000 7f642d81d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d2df18f30 con 0x555d2df16220 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.126+0000 7f64297ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df1d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.126+0000 7f64297ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df1d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50610/0 (socket says 172.21.15.165:50610) 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.126+0000 7f64297ec640 1 -- 172.21.15.165:0/1546955632 learned_addr learned my addr 172.21.15.165:0/1546955632 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.126+0000 7f64297ec640 1 -- 172.21.15.165:0/1546955632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d2df1d6e0 con 0x555d2df16220 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.127+0000 7f64297ec640 1 --2- 172.21.15.165:0/1546955632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df1d180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f642000adf0 tx=0x7f6420002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.127+0000 7f630d7fa640 1 -- 172.21.15.165:0/1546955632 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420022030 con 0x555d2df16220 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.127+0000 7f630d7fa640 1 -- 172.21.15.165:0/1546955632 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420019040 con 0x555d2df16220 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.127+0000 7f642d81d800 1 -- 172.21.15.165:0/1546955632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d2df1d970 con 0x555d2df16220 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.127+0000 7f630d7fa640 1 -- 172.21.15.165:0/1546955632 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420013970 con 0x555d2df16220 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.127+0000 7f642d81d800 1 -- 172.21.15.165:0/1546955632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d2df1e2f0 con 0x555d2df16220 2024-09-22T08:11:03.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.128+0000 7f630d7fa640 1 -- 172.21.15.165:0/1546955632 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6420025070 con 0x555d2df16220 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.128+0000 7f630d7fa640 1 --2- 172.21.15.165:0/1546955632 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630003cfb0 0x7f630003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.128+0000 7f630d7fa640 1 -- 172.21.15.165:0/1546955632 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6420023070 con 0x555d2df16220 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.128+0000 7f642d81d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.128+0000 7f642d81d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.128+0000 7f64287ea640 1 --2- 172.21.15.165:0/1546955632 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630003cfb0 0x7f630003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.129+0000 7f642d81d800 1 Processor -- start 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.129+0000 7f642d81d800 1 -- start start 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.129+0000 7f64287ea640 1 --2- 172.21.15.165:0/1546955632 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630003cfb0 0x7f630003f470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x555d2dd829b0 tx=0x7f6410050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.129+0000 7f642d81d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df36fe0 0x555d2df37400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.129+0000 7f642d81d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d2df01b50 con 0x555d2df36fe0 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.129+0000 7f6428feb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df36fe0 0x555d2df37400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.129+0000 7f6428feb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df36fe0 0x555d2df37400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50618/0 (socket says 172.21.15.165:50618) 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.129+0000 7f6428feb640 1 -- 172.21.15.165:0/488704167 learned_addr learned my addr 172.21.15.165:0/488704167 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.130+0000 7f6428feb640 1 -- 172.21.15.165:0/488704167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d2df37a40 con 0x555d2df36fe0 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.130+0000 7f6428feb640 1 --2- 172.21.15.165:0/488704167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df36fe0 0x555d2df37400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6418014fd0 tx=0x7f64180527f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.130+0000 7f62ed7e2640 1 -- 172.21.15.165:0/488704167 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641801e420 con 0x555d2df36fe0 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.130+0000 7f62ed7e2640 1 -- 172.21.15.165:0/488704167 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6418042070 con 0x555d2df36fe0 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.130+0000 7f642d81d800 1 -- 172.21.15.165:0/488704167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d2df38270 con 0x555d2df36fe0 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.130+0000 7f62ed7e2640 1 -- 172.21.15.165:0/488704167 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641803ea40 con 0x555d2df36fe0 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.130+0000 7f642d81d800 1 -- 172.21.15.165:0/488704167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d2df38810 con 0x555d2df36fe0 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.131+0000 7f62ed7e2640 1 -- 172.21.15.165:0/488704167 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6418044030 con 0x555d2df36fe0 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.131+0000 7f62ed7e2640 1 --2- 172.21.15.165:0/488704167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f626003cfb0 0x7f626003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.131+0000 7f62ed7e2640 1 -- 172.21.15.165:0/488704167 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6418047cd0 con 0x555d2df36fe0 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.131+0000 7f64287ea640 1 --2- 172.21.15.165:0/488704167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f626003cfb0 0x7f626003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.131+0000 7f626effd640 20 reqs_thread_entry: start 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.131+0000 7f642d81d800 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555d2df44950 0x555d2df46df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.131+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d2df474c0 con 0x555d2df44950 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.131+0000 7f64287ea640 1 --2- 172.21.15.165:0/488704167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f626003cfb0 0x7f626003f470 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6410000c00 tx=0x7f6410005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.131+0000 7f64297ec640 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555d2df44950 0x555d2df46df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.132+0000 7f64297ec640 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555d2df44950 0x555d2df46df0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.132+0000 7f64297ec640 1 -- 172.21.15.165:0/967748442 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f642001e8f0 con 0x555d2df44950 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.132+0000 7f642d81d800 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555d2df49290 0x555d2df4b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.132+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:2 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d2df4bd80 con 0x555d2df49290 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.132+0000 7f6428feb640 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555d2df49290 0x555d2df4b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.132+0000 7f6428feb640 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555d2df49290 0x555d2df4b680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.133+0000 7f6428feb640 1 -- 172.21.15.165:0/967748442 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(2 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f641800f030 con 0x555d2df49290 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.133+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d2df488d0 con 0x555d2df49290 2024-09-22T08:11:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.134+0000 7f6428feb640 1 -- 172.21.15.165:0/967748442 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f641800f030 con 0x555d2df49290 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/1546955632 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630003cfb0 msgr2=0x7f630003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 --2- 172.21.15.165:0/1546955632 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630003cfb0 0x7f630003f470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x555d2dd829b0 tx=0x7f6410050000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/1546955632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 msgr2=0x555d2df1d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 --2- 172.21.15.165:0/1546955632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df1d180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f642000adf0 tx=0x7f6420002ff0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/1546955632 shutdown_connections 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 --2- 172.21.15.165:0/1546955632 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630003cfb0 0x7f630003f470 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 --2- 172.21.15.165:0/1546955632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df16220 0x555d2df1d180 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/1546955632 >> 172.21.15.165:0/1546955632 conn(0x555d2de15cc0 msgr2=0x555d2df10b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/1546955632 shutdown_connections 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/1546955632 wait complete. 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/488704167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f626003cfb0 msgr2=0x7f626003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 --2- 172.21.15.165:0/488704167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f626003cfb0 0x7f626003f470 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6410000c00 tx=0x7f6410005a00 comp rx=0 tx=0).stop 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/488704167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df36fe0 msgr2=0x555d2df37400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 --2- 172.21.15.165:0/488704167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df36fe0 0x555d2df37400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6418014fd0 tx=0x7f64180527f0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/488704167 shutdown_connections 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 --2- 172.21.15.165:0/488704167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f626003cfb0 0x7f626003f470 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 --2- 172.21.15.165:0/488704167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2df36fe0 0x555d2df37400 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/488704167 >> 172.21.15.165:0/488704167 conn(0x555d2df2c560 msgr2=0x555d2df2c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/488704167 shutdown_connections 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.135+0000 7f642d81d800 1 -- 172.21.15.165:0/488704167 wait complete. 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555d2df44950 msgr2=0x555d2df46df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555d2df44950 0x555d2df46df0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555d2df49290 msgr2=0x555d2df4b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555d2df49290 0x555d2df4b680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631003d000 msgr2=0x7f631003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631003d000 0x7f631003f4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6418026ff0 tx=0x7f6418010590 comp rx=0 tx=0).stop 2024-09-22T08:11:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 msgr2=0x555d2df08c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df08c30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6418007fd0 tx=0x7f6418004460 comp rx=0 tx=0).stop 2024-09-22T08:11:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 shutdown_connections 2024-09-22T08:11:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555d2df49290 0x555d2df4b680 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555d2df44950 0x555d2df46df0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631003d000 0x7f631003f4c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 --2- 172.21.15.165:0/967748442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2dd83620 0x555d2df08c30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 >> 172.21.15.165:0/967748442 conn(0x555d2de09cb0 msgr2=0x555d2df02620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 shutdown_connections 2024-09-22T08:11:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.136+0000 7f642d81d800 1 -- 172.21.15.165:0/967748442 wait complete. 2024-09-22T08:11:03.145 INFO:teuthology.orchestra.run.smithi165.stdout:{"id":"cc1223c2-11fd-49fe-8726-a14b177df4cc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:11:03.145 DEBUG:tasks.util.rgw: json result: {'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:11:03.147 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-22T08:11:03.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-22T08:11:03.147 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-22T08:11:03.189 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:03.190 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:03.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.189+0000 7f7ab8726800 1 Processor -- start 2024-09-22T08:11:03.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.189+0000 7f7ab8726800 1 -- start start 2024-09-22T08:11:03.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.190+0000 7f7ab8726800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55993a9b0e80 0x55993a9af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.190+0000 7f7ab8726800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55993a8c6a20 con 0x55993a9af950 2024-09-22T08:11:03.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.190+0000 7f7ab8726800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55993a8c67d0 con 0x55993a9b0e80 2024-09-22T08:11:03.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.190+0000 7f7ab43d9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55993a9b0e80 0x55993a9af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.190+0000 7f7aabfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55993a9af950 0x55993aa433c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33446/0 (socket says 172.21.15.165:33446) 2024-09-22T08:11:03.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.190+0000 7f7aabfff640 1 -- 172.21.15.165:0/3299278780 learned_addr learned my addr 172.21.15.165:0/3299278780 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:03.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.190+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/3299278780 >> v2:172.21.15.53:3300/0 conn(0x55993a9b0e80 0x55993a9af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50626/0 (socket says 172.21.15.165:50626) 2024-09-22T08:11:03.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.190+0000 7f7ab43d9640 1 -- 172.21.15.165:0/3299278780 >> v1:172.21.15.53:6789/0 conn(0x55993a9af950 legacy=0x55993aa433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.190+0000 7f7ab43d9640 1 -- 172.21.15.165:0/3299278780 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993a9aff90 con 0x55993a9b0e80 2024-09-22T08:11:03.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.192+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/3299278780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 0x55993a9af320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400a470 tx=0x7f7aa4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fa1ee69a1d894e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.192+0000 7f7ab3bd8640 1 -- 172.21.15.165:0/3299278780 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4053570 con 0x55993a9b0e80 2024-09-22T08:11:03.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.192+0000 7f7ab3bd8640 1 -- 172.21.15.165:0/3299278780 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4058070 con 0x55993a9b0e80 2024-09-22T08:11:03.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.192+0000 7f7ab3bd8640 1 -- 172.21.15.165:0/3299278780 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4053880 con 0x55993a9b0e80 2024-09-22T08:11:03.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.193+0000 7f7ab8726800 1 -- 172.21.15.165:0/3299278780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 msgr2=0x55993a9af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.193+0000 7f7ab8726800 1 --2- 172.21.15.165:0/3299278780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 0x55993a9af320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400a470 tx=0x7f7aa4045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:03.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.193+0000 7f7ab8726800 1 -- 172.21.15.165:0/3299278780 shutdown_connections 2024-09-22T08:11:03.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.193+0000 7f7ab8726800 1 --2- 172.21.15.165:0/3299278780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 0x55993a9af320 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.193+0000 7f7ab8726800 1 -- 172.21.15.165:0/3299278780 >> 172.21.15.165:0/3299278780 conn(0x55993aa36ce0 msgr2=0x55993aa39100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.193+0000 7f7ab8726800 1 -- 172.21.15.165:0/3299278780 shutdown_connections 2024-09-22T08:11:03.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.193+0000 7f7ab8726800 1 -- 172.21.15.165:0/3299278780 wait complete. 2024-09-22T08:11:03.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.206+0000 7f7ab8726800 1 Processor -- start 2024-09-22T08:11:03.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.206+0000 7f7ab8726800 1 -- start start 2024-09-22T08:11:03.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.206+0000 7f7ab8726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9af950 0x55993ab2d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.206+0000 7f7ab8726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55993a8d3dd0 con 0x55993a9af950 2024-09-22T08:11:03.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.207+0000 7f7ab43d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9af950 0x55993ab2d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.207+0000 7f7ab43d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9af950 0x55993ab2d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50630/0 (socket says 172.21.15.165:50630) 2024-09-22T08:11:03.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.207+0000 7f7ab43d9640 1 -- 172.21.15.165:0/3607740704 learned_addr learned my addr 172.21.15.165:0/3607740704 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.207+0000 7f7ab43d9640 1 -- 172.21.15.165:0/3607740704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993ab2d790 con 0x55993a9af950 2024-09-22T08:11:03.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.207+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/3607740704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9af950 0x55993ab2d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4025c20 tx=0x7f7aa4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cede1f7f76fca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.207+0000 7f79a260c640 1 -- 172.21.15.165:0/3607740704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4053a20 con 0x55993a9af950 2024-09-22T08:11:03.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.207+0000 7f79a260c640 1 -- 172.21.15.165:0/3607740704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4063070 con 0x55993a9af950 2024-09-22T08:11:03.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.207+0000 7f79a260c640 1 -- 172.21.15.165:0/3607740704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4053cf0 con 0x55993a9af950 2024-09-22T08:11:03.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.208+0000 7f7ab8726800 1 -- 172.21.15.165:0/3607740704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9af950 msgr2=0x55993ab2d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.208+0000 7f7ab8726800 1 --2- 172.21.15.165:0/3607740704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9af950 0x55993ab2d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4025c20 tx=0x7f7aa4051000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.208+0000 7f7ab8726800 1 -- 172.21.15.165:0/3607740704 shutdown_connections 2024-09-22T08:11:03.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.208+0000 7f7ab8726800 1 --2- 172.21.15.165:0/3607740704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9af950 0x55993ab2d1a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.208+0000 7f7ab8726800 1 -- 172.21.15.165:0/3607740704 >> 172.21.15.165:0/3607740704 conn(0x55993aa36ce0 msgr2=0x55993ab28b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.208+0000 7f7ab8726800 1 -- 172.21.15.165:0/3607740704 shutdown_connections 2024-09-22T08:11:03.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.208+0000 7f7ab8726800 1 -- 172.21.15.165:0/3607740704 wait complete. 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.208+0000 7f7ab8726800 1 Processor -- start 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f7ab8726800 1 -- start start 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f7ab8726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 0x55993ab34e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f7ab8726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55993aa44cf0 con 0x55993a9b0e80 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f7ab43d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 0x55993ab34e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f7ab43d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 0x55993ab34e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50640/0 (socket says 172.21.15.165:50640) 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f7ab43d9640 1 -- 172.21.15.165:0/1520367245 learned_addr learned my addr 172.21.15.165:0/1520367245 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f7ab43d9640 1 -- 172.21.15.165:0/1520367245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993ab353b0 con 0x55993a9b0e80 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 0x55993ab34e50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4025c20 tx=0x7f7aa4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f79a0e09640 1 -- 172.21.15.165:0/1520367245 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa40745b0 con 0x55993a9b0e80 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f79a0e09640 1 -- 172.21.15.165:0/1520367245 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4074750 con 0x55993a9b0e80 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55993ab35640 con 0x55993a9b0e80 2024-09-22T08:11:03.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.209+0000 7f79a0e09640 1 -- 172.21.15.165:0/1520367245 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4074a30 con 0x55993a9b0e80 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.210+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55993ab36250 con 0x55993a9b0e80 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.210+0000 7f79a0e09640 1 -- 172.21.15.165:0/1520367245 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7aa4074bd0 con 0x55993a9b0e80 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.210+0000 7f79a0e09640 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f799c03cfb0 0x7f799c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.211+0000 7f79a0e09640 1 -- 172.21.15.165:0/1520367245 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7aa4098bc0 con 0x55993a9b0e80 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.211+0000 7f7aabfff640 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f799c03cfb0 0x7f799c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.211+0000 7f7ab8726800 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab3a490 0x55993ab3c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.211+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab3cdc0 con 0x55993ab3a490 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.211+0000 7f7ab4bda640 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab3a490 0x55993ab3c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.211+0000 7f7aabfff640 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f799c03cfb0 0x7f799c03f470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c001d70 tx=0x7f7a9c0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.211+0000 7f7ab4bda640 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab3a490 0x55993ab3c880 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.211+0000 7f7ab4bda640 1 -- 172.21.15.165:0/1520367245 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7aac00a4d0 con 0x55993ab3a490 2024-09-22T08:11:03.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.211+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab3d160 con 0x55993ab3a490 2024-09-22T08:11:03.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.212+0000 7f7ab4bda640 1 -- 172.21.15.165:0/1520367245 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7aac00a4d0 con 0x55993ab3a490 2024-09-22T08:11:03.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.212+0000 7f7ab8726800 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab3ec20 0x55993ab410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.212+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab41850 con 0x55993ab3ec20 2024-09-22T08:11:03.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.212+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab3ec20 0x55993ab410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.212+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab3ec20 0x55993ab410c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.212+0000 7f7ab43d9640 1 -- 172.21.15.165:0/1520367245 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab3ec20 2024-09-22T08:11:03.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.212+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab3d9b0 con 0x55993ab3a490 2024-09-22T08:11:03.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.213+0000 7f7ab4bda640 1 -- 172.21.15.165:0/1520367245 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7aac00a4d0 con 0x55993ab3a490 2024-09-22T08:11:03.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.213+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab3dd50 con 0x55993ab3a490 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.213+0000 7f7ab4bda640 1 -- 172.21.15.165:0/1520367245 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7aac00a4d0 con 0x55993ab3a490 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.213+0000 7f7ab8726800 1 Processor -- start 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.213+0000 7f7ab8726800 1 -- start start 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.213+0000 7f7ab8726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab501e0 0x55993ab50600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.213+0000 7f7ab8726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55993a932d50 con 0x55993ab501e0 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.214+0000 7f7ab4bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab501e0 0x55993ab50600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.214+0000 7f7ab4bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab501e0 0x55993ab50600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50644/0 (socket says 172.21.15.165:50644) 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.214+0000 7f7ab4bda640 1 -- 172.21.15.165:0/3749901708 learned_addr learned my addr 172.21.15.165:0/3749901708 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.214+0000 7f7ab4bda640 1 -- 172.21.15.165:0/3749901708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993ab50c40 con 0x55993ab501e0 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.214+0000 7f7ab4bda640 1 --2- 172.21.15.165:0/3749901708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab501e0 0x55993ab50600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55993ab35e50 tx=0x7f7aac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.214+0000 7f7999ffb640 1 -- 172.21.15.165:0/3749901708 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aac014450 con 0x55993ab501e0 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.214+0000 7f7999ffb640 1 -- 172.21.15.165:0/3749901708 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac014610 con 0x55993ab501e0 2024-09-22T08:11:03.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.214+0000 7f7ab8726800 1 -- 172.21.15.165:0/3749901708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55993ab51470 con 0x55993ab501e0 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.214+0000 7f7999ffb640 1 -- 172.21.15.165:0/3749901708 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aac014930 con 0x55993ab501e0 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.214+0000 7f7ab8726800 1 -- 172.21.15.165:0/3749901708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55993ab51a10 con 0x55993ab501e0 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.215+0000 7f7999ffb640 1 -- 172.21.15.165:0/3749901708 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7aac011040 con 0x55993ab501e0 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.215+0000 7f7999ffb640 1 --2- 172.21.15.165:0/3749901708 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798c03d000 0x7f798c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7999ffb640 1 -- 172.21.15.165:0/3749901708 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7aac01e070 con 0x55993ab501e0 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/3749901708 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798c03d000 0x7f798c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7ab8726800 1 Processor -- start 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7ab8726800 1 -- start start 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/3749901708 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798c03d000 0x7f798c03f4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4045a60 tx=0x7f7aa405d580 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7ab8726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab5d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7ab8726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55993ab2db60 con 0x55993ab5cc20 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7ab4bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab5d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7ab4bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab5d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50646/0 (socket says 172.21.15.165:50646) 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7ab4bda640 1 -- 172.21.15.165:0/490061860 learned_addr learned my addr 172.21.15.165:0/490061860 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.216+0000 7f7ab4bda640 1 -- 172.21.15.165:0/490061860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993ab5d610 con 0x55993ab5cc20 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f7ab4bda640 1 --2- 172.21.15.165:0/490061860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab5d020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7aac054740 tx=0x7f7aac02b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83784c170fb8160c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f79937fe640 1 -- 172.21.15.165:0/490061860 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aac04b070 con 0x55993ab5cc20 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f79937fe640 1 -- 172.21.15.165:0/490061860 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac051070 con 0x55993ab5cc20 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f79937fe640 1 -- 172.21.15.165:0/490061860 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aac011da0 con 0x55993ab5cc20 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f7ab8726800 1 -- 172.21.15.165:0/490061860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 msgr2=0x55993ab5d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f7ab8726800 1 --2- 172.21.15.165:0/490061860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab5d020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7aac054740 tx=0x7f7aac02b4c0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f7ab8726800 1 -- 172.21.15.165:0/490061860 shutdown_connections 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f7ab8726800 1 --2- 172.21.15.165:0/490061860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab5d020 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f7ab8726800 1 -- 172.21.15.165:0/490061860 >> 172.21.15.165:0/490061860 conn(0x55993ab59040 msgr2=0x55993ab57280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f7ab8726800 1 -- 172.21.15.165:0/490061860 shutdown_connections 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.217+0000 7f7ab8726800 1 -- 172.21.15.165:0/490061860 wait complete. 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.218+0000 7f7ab8726800 1 Processor -- start 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.218+0000 7f7ab8726800 1 -- start start 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.218+0000 7f7ab8726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab64200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.218+0000 7f7ab8726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55993ab5dc30 con 0x55993ab5cc20 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.218+0000 7f7ab4bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab64200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.218+0000 7f7ab4bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab64200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50654/0 (socket says 172.21.15.165:50654) 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.218+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 learned_addr learned my addr 172.21.15.165:0/90887426 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.218+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55993ab64760 con 0x55993ab5cc20 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.218+0000 7f7ab4bda640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab64200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7aac022bf0 tx=0x7f7aac0546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.219+0000 7f7991ffb640 1 -- 172.21.15.165:0/90887426 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aac04b040 con 0x55993ab5cc20 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.219+0000 7f7991ffb640 1 -- 172.21.15.165:0/90887426 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac0167c0 con 0x55993ab5cc20 2024-09-22T08:11:03.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.219+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55993ab649f0 con 0x55993ab5cc20 2024-09-22T08:11:03.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.219+0000 7f7991ffb640 1 -- 172.21.15.165:0/90887426 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7aac011330 con 0x55993ab5cc20 2024-09-22T08:11:03.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.219+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55993ab65370 con 0x55993ab5cc20 2024-09-22T08:11:03.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.219+0000 7f7991ffb640 1 -- 172.21.15.165:0/90887426 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7aac0458e0 con 0x55993ab5cc20 2024-09-22T08:11:03.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.220+0000 7f7991ffb640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798403cfb0 0x7f798403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.220+0000 7f7991ffb640 1 -- 172.21.15.165:0/90887426 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7aac00e040 con 0x55993ab5cc20 2024-09-22T08:11:03.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.220+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798403cfb0 0x7f798403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.220+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.220+0000 7f7ab8726800 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab6fcc0 0x55993ab72180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.220+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab728d0 con 0x55993ab6fcc0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.220+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798403cfb0 0x7f798403f470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4045f20 tx=0x7f7aa4088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.220+0000 7f7aabfff640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab6fcc0 0x55993ab72180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.220+0000 7f7aabfff640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab6fcc0 0x55993ab72180 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a9c009050 con 0x55993ab6fcc0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 20 realm 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab6f010 con 0x55993ab6fcc0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a9c009050 con 0x55993ab6fcc0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab733b0 con 0x55993ab6fcc0 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a9c009050 con 0x55993ab6fcc0 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab73c80 con 0x55993ab6fcc0 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a9c009050 con 0x55993ab6fcc0 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab745c0 0x55993ab769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.221+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab770f0 con 0x55993ab745c0 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.222+0000 7f7ab4bda640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab745c0 0x55993ab769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.222+0000 7f7ab4bda640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab745c0 0x55993ab769b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.222+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.222+0000 7f7ab8726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.222+0000 7f7ab8726800 20 searching for the correct realm 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.222+0000 7f7ab8726800 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55993ab79170 0x55993ab7b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.222+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab79170 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.222+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55993ab79170 0x55993ab7b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.223+0000 7f7ab43d9640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55993ab79170 0x55993ab7b630 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.223+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.223+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab745c0 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.223+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.223+0000 7f7ab4bda640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7aac037070 0x7f7aac023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.223+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x7f7aac037070 2024-09-22T08:11:03.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.223+0000 7f7aabfff640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7aac037070 0x7f7aac023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.224+0000 7f7aabfff640 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7aac037070 0x7f7aac023420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.224+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c009050 con 0x7f7aac037070 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.224+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab6fcc0 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.224+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c009050 con 0x55993ab6fcc0 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.224+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab6fcc0 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.224+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.224+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x7f7aac037070 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.225+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.225+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x7f7aac037070 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.225+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.225+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab745c0 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.225+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.225+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab79170 2024-09-22T08:11:03.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.225+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.225+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab6fcc0 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.226+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.226+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x7f7aac037070 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.226+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.226+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab6fcc0 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.226+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.226+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab745c0 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.226+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.226+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab79170 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.227+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.227+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab79170 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.227+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.227+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x7f7aac037070 2024-09-22T08:11:03.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.227+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.227+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab79170 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.227+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.227+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab79170 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.228+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.228+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab6fcc0 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.228+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.228+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab6fcc0 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.228+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.228+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x7f7aac037070 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.228+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.228+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab79170 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.229+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.229+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab745c0 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.229+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.229+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab6fcc0 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.229+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.229+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x7f7aac037070 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.229+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.229+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab79170 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.230+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.230+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x7f7aac037070 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.230+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.230+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab745c0 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.230+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.230+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab79170 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.230+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.230+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x7f7aac037070 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab6fcc0 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7bd00 con 0x55993ab745c0 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:03.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab77b70 con 0x55993ab6fcc0 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.231+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab77780 con 0x55993ab6fcc0 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab78520 con 0x55993ab6fcc0 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 20 zone default found 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 4 Realm: () 2024-09-22T08:11:03.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 20 zonegroup default 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab78010 con 0x7f7aac037070 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.232+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.233+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7e0f0 con 0x55993ab79170 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.233+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.233+0000 7f7ab8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.233+0000 7f7ab8726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.233+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7e5a0 con 0x55993ab79170 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.233+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.233+0000 7f7ab8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.233+0000 7f7ab8726800 20 started sync module instance, tier type = 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.233+0000 7f7ab8726800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.233+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7d540 con 0x55993ab745c0 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.234+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.234+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94116603484464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7eeb0 con 0x55993ab745c0 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.234+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7f700 con 0x55993ab6fcc0 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.235+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94116603484464] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.235+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.235+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94116603488768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7f390 con 0x55993ab6fcc0 2024-09-22T08:11:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.235+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab7feb0 con 0x55993ab79170 2024-09-22T08:11:03.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.237+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94116603488768] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.237+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.238+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94116603492736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab802a0 con 0x55993ab79170 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.238+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab80cd0 con 0x55993ab745c0 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.240+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94116603492736] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.240+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.240+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94116603489824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab80c90 con 0x55993ab745c0 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.240+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab81770 con 0x55993ab6fcc0 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.243+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.243+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94116603499104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab81730 con 0x55993ab6fcc0 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.243+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab82720 con 0x7f7aac037070 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.243+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94116603489824] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.244+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94116603499104] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.246+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.246+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94116603503120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab826e0 con 0x7f7aac037070 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.246+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab81cb0 con 0x7f7aac037070 2024-09-22T08:11:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.247+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94116603503120] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.247+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.247+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94116603496416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab81cb0 con 0x7f7aac037070 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.247+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab835e0 con 0x7f7aac037070 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.248+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94116603496416] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.248+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.248+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94116603505344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab835e0 con 0x7f7aac037070 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.248+0000 7f7ab8726800 20 add_watcher() i=0 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.248+0000 7f7ab8726800 20 add_watcher() i=1 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.248+0000 7f7ab8726800 20 add_watcher() i=2 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.248+0000 7f7ab8726800 20 add_watcher() i=3 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.248+0000 7f7ab8726800 20 add_watcher() i=4 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.248+0000 7f7ab8726800 20 add_watcher() i=5 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.248+0000 7f7ab8726800 20 add_watcher() i=6 2024-09-22T08:11:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.249+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94116603505344] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.249+0000 7f7ab8726800 20 add_watcher() i=7 2024-09-22T08:11:03.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.249+0000 7f7ab8726800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:03.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.249+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993ab86a90 con 0x55993ab6fcc0 2024-09-22T08:11:03.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.249+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.249+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94116603520048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993ab83750 con 0x55993ab6fcc0 2024-09-22T08:11:03.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.252+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94116603520048] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.252+0000 7f796a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.252+0000 7f7ab8726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:03.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.252+0000 7f7ab8726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:03.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.252+0000 7f7ab8726800 5 note: GC not initialized 2024-09-22T08:11:03.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.252+0000 7f79697e2640 20 reqs_thread_entry: start 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.252+0000 7f7ab8726800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.252+0000 7f7ab8726800 20 Filter name: none 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.252+0000 7f78daffd640 20 reqs_thread_entry: start 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.253+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba380 con 0x55993ab6fcc0 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.253+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.253+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba380 con 0x55993ab745c0 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.253+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.253+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba340 con 0x55993ab6fcc0 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.253+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.253+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba340 con 0x55993ab79170 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.253+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.253+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba850 con 0x55993ab79170 2024-09-22T08:11:03.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.254+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.254+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba850 con 0x55993ab79170 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.254+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.254+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba850 con 0x55993ab6fcc0 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.254+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.254+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba850 con 0x55993ab6fcc0 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.254+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.254+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x55993ab79170 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.255+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.255+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x55993ab79170 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.255+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.255+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x7f7aac037070 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.255+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.255+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x55993ab6fcc0 2024-09-22T08:11:03.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.256+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.256+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x55993ab745c0 2024-09-22T08:11:03.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.256+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.256+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x55993ab79170 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.256+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.256+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x7f7aac037070 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.256+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.256+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x7f7aac037070 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.257+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.257+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x55993ab79170 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.257+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.257+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x7f7aac037070 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.257+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.257+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x55993ab6fcc0 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.257+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.257+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x55993ab79170 2024-09-22T08:11:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.257+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.257+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x7f7aac037070 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.258+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.258+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba800 con 0x55993ab745c0 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.258+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.258+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x7f7aac037070 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.258+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.258+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab6fcc0 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.259+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.259+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab6fcc0 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.259+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.259+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab79170 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.259+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.259+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab6fcc0 2024-09-22T08:11:03.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.259+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.259+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab6fcc0 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.259+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.259+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab79170 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.260+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.260+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab79170 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.260+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.260+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab79170 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.260+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.260+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x7f7aac037070 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.260+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.261+0000 7f796a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.261+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94116603520048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab6fcc0 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.262+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94116603520048] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.262+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94116603484464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab745c0 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.263+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94116603484464] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.263+0000 7f7ab8726800 20 remove_watcher() i=0 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.263+0000 7f7ab8726800 2 removed watcher, disabling cache 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.263+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94116603488768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab6fcc0 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.264+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94116603488768] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.264+0000 7f7ab8726800 20 remove_watcher() i=1 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.264+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94116603492736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab79170 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.265+0000 7f7ab43d9640 1 -- 172.21.15.165:0/90887426 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94116603492736] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aa4051070 con 0x55993ab79170 2024-09-22T08:11:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.265+0000 7f7ab8726800 20 remove_watcher() i=2 2024-09-22T08:11:03.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.265+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94116603489824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993abba780 con 0x55993ab745c0 2024-09-22T08:11:03.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.266+0000 7f7ab4bda640 1 -- 172.21.15.165:0/90887426 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94116603489824] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7aac02a070 con 0x55993ab745c0 2024-09-22T08:11:03.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.266+0000 7f7ab8726800 20 remove_watcher() i=3 2024-09-22T08:11:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.266+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94116603499104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993abb7770 con 0x55993ab6fcc0 2024-09-22T08:11:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.268+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94116603499104] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x55993ab6fcc0 2024-09-22T08:11:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.268+0000 7f7ab8726800 20 remove_watcher() i=4 2024-09-22T08:11:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.268+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94116603503120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993abba760 con 0x7f7aac037070 2024-09-22T08:11:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.269+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94116603503120] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.269+0000 7f7ab8726800 20 remove_watcher() i=5 2024-09-22T08:11:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.269+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94116603496416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993abb7770 con 0x7f7aac037070 2024-09-22T08:11:03.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.270+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94116603496416] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.270+0000 7f7ab8726800 20 remove_watcher() i=6 2024-09-22T08:11:03.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.270+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94116603505344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55993abba760 con 0x7f7aac037070 2024-09-22T08:11:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94116603505344] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a9c029040 con 0x7f7aac037070 2024-09-22T08:11:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 20 remove_watcher() i=7 2024-09-22T08:11:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7aac037070 msgr2=0x7f7aac023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7aac037070 0x7f7aac023420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab6fcc0 msgr2=0x55993ab72180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab6fcc0 0x55993ab72180 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab745c0 msgr2=0x55993ab769b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab745c0 0x55993ab769b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55993ab79170 msgr2=0x55993ab7b630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55993ab79170 0x55993ab7b630 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798403cfb0 msgr2=0x7f798403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798403cfb0 0x7f798403f470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4045f20 tx=0x7f7aa4088000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 msgr2=0x55993ab64200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7aabfff640 1 -- 172.21.15.165:0/90887426 reap_dead start 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab64200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7aac022bf0 tx=0x7f7aac0546a0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 shutdown_connections 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 --2- 172.21.15.165:0/90887426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab5cc20 0x55993ab64200 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 >> 172.21.15.165:0/90887426 conn(0x55993ab59040 msgr2=0x55993ab57250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 shutdown_connections 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.271+0000 7f7ab8726800 1 -- 172.21.15.165:0/90887426 wait complete. 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/3749901708 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798c03d000 msgr2=0x7f798c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/3749901708 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798c03d000 0x7f798c03f4c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4045a60 tx=0x7f7aa405d580 comp rx=0 tx=0).stop 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/3749901708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab501e0 msgr2=0x55993ab50600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/3749901708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab501e0 0x55993ab50600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55993ab35e50 tx=0x7f7aac018830 comp rx=0 tx=0).stop 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/3749901708 shutdown_connections 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/3749901708 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f798c03d000 0x7f798c03f4c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/3749901708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993ab501e0 0x55993ab50600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/3749901708 >> 172.21.15.165:0/3749901708 conn(0x55993ab44590 msgr2=0x55993ab44970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/3749901708 shutdown_connections 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/3749901708 wait complete. 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab3a490 msgr2=0x55993ab3c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab3a490 0x55993ab3c880 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab3ec20 msgr2=0x55993ab410c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab3ec20 0x55993ab410c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f799c03cfb0 msgr2=0x7f799c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f799c03cfb0 0x7f799c03f470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c001d70 tx=0x7f7a9c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 msgr2=0x55993ab34e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 0x55993ab34e50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4025c20 tx=0x7f7aa4002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 shutdown_connections 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55993ab3ec20 0x55993ab410c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55993ab3a490 0x55993ab3c880 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f799c03cfb0 0x7f799c03f470 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 --2- 172.21.15.165:0/1520367245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55993a9b0e80 0x55993ab34e50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 >> 172.21.15.165:0/1520367245 conn(0x55993aa36ce0 msgr2=0x55993ab27310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 shutdown_connections 2024-09-22T08:11:03.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.272+0000 7f7ab8726800 1 -- 172.21.15.165:0/1520367245 wait complete. 2024-09-22T08:11:03.282 INFO:teuthology.orchestra.run.smithi165.stdout:{"entries":[],"summary":[]} 2024-09-22T08:11:03.282 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-22T08:11:03.282 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:11:03.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:11:03.282 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:11:03.366 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:03.366 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:03.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.366+0000 7f1340f23800 1 Processor -- start 2024-09-22T08:11:03.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.366+0000 7f1340f23800 1 -- start start 2024-09-22T08:11:03.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.366+0000 7f1340f23800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c412db7cb0 0x55c412dbd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.366+0000 7f1340f23800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c412c41a20 con 0x55c412db69e0 2024-09-22T08:11:03.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.367+0000 7f1340f23800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c412c417d0 con 0x55c412db7cb0 2024-09-22T08:11:03.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.367+0000 7f133440b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c412db7cb0 0x55c412dbd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.367+0000 7f133cc0c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55c412db69e0 0x55c412db75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33450/0 (socket says 172.21.15.165:33450) 2024-09-22T08:11:03.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.367+0000 7f133cc0c640 1 -- 172.21.15.165:0/392903322 learned_addr learned my addr 172.21.15.165:0/392903322 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:03.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.367+0000 7f133440b640 1 -- 172.21.15.165:0/392903322 >> v1:172.21.15.53:6789/0 conn(0x55c412db69e0 legacy=0x55c412db75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.367+0000 7f133440b640 1 -- 172.21.15.165:0/392903322 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c412db70e0 con 0x55c412db7cb0 2024-09-22T08:11:03.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.369+0000 7f133440b640 1 --2- 172.21.15.165:0/392903322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db7cb0 0x55c412dbd640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f132400a470 tx=0x7f1324045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edba3ce085004061 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.369+0000 7f1337fff640 1 -- 172.21.15.165:0/392903322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1324053570 con 0x55c412db7cb0 2024-09-22T08:11:03.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.369+0000 7f1337fff640 1 -- 172.21.15.165:0/392903322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1324058070 con 0x55c412db7cb0 2024-09-22T08:11:03.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.369+0000 7f1337fff640 1 -- 172.21.15.165:0/392903322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1324053880 con 0x55c412db7cb0 2024-09-22T08:11:03.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.370+0000 7f1340f23800 1 -- 172.21.15.165:0/392903322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db7cb0 msgr2=0x55c412dbd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.370+0000 7f1340f23800 1 --2- 172.21.15.165:0/392903322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db7cb0 0x55c412dbd640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f132400a470 tx=0x7f1324045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:03.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.370+0000 7f1340f23800 1 -- 172.21.15.165:0/392903322 shutdown_connections 2024-09-22T08:11:03.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.370+0000 7f1340f23800 1 --2- 172.21.15.165:0/392903322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db7cb0 0x55c412dbd640 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.370+0000 7f1340f23800 1 -- 172.21.15.165:0/392903322 >> 172.21.15.165:0/392903322 conn(0x55c412db1db0 msgr2=0x55c412db4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.370+0000 7f1340f23800 1 -- 172.21.15.165:0/392903322 shutdown_connections 2024-09-22T08:11:03.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.370+0000 7f1340f23800 1 -- 172.21.15.165:0/392903322 wait complete. 2024-09-22T08:11:03.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.383+0000 7f1340f23800 1 Processor -- start 2024-09-22T08:11:03.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.384+0000 7f1340f23800 1 -- start start 2024-09-22T08:11:03.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.384+0000 7f1340f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412ea5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.384+0000 7f1340f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c412c4edd0 con 0x55c412db69e0 2024-09-22T08:11:03.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.384+0000 7f133cc0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412ea5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.384+0000 7f133cc0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412ea5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50678/0 (socket says 172.21.15.165:50678) 2024-09-22T08:11:03.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.384+0000 7f133cc0c640 1 -- 172.21.15.165:0/3506485132 learned_addr learned my addr 172.21.15.165:0/3506485132 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.384+0000 7f133cc0c640 1 -- 172.21.15.165:0/3506485132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c412ea6570 con 0x55c412db69e0 2024-09-22T08:11:03.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.384+0000 7f133cc0c640 1 --2- 172.21.15.165:0/3506485132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412ea5f80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f132c001e40 tx=0x7f132c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47830572b7d4474 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.385+0000 7f122ae0d640 1 -- 172.21.15.165:0/3506485132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c012020 con 0x55c412db69e0 2024-09-22T08:11:03.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.385+0000 7f122ae0d640 1 -- 172.21.15.165:0/3506485132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c00e5a0 con 0x55c412db69e0 2024-09-22T08:11:03.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.385+0000 7f122ae0d640 1 -- 172.21.15.165:0/3506485132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c00e8a0 con 0x55c412db69e0 2024-09-22T08:11:03.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.385+0000 7f1340f23800 1 -- 172.21.15.165:0/3506485132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 msgr2=0x55c412ea5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.385+0000 7f1340f23800 1 --2- 172.21.15.165:0/3506485132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412ea5f80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f132c001e40 tx=0x7f132c001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:03.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.385+0000 7f1340f23800 1 -- 172.21.15.165:0/3506485132 shutdown_connections 2024-09-22T08:11:03.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.385+0000 7f1340f23800 1 --2- 172.21.15.165:0/3506485132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412ea5f80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.385+0000 7f1340f23800 1 -- 172.21.15.165:0/3506485132 >> 172.21.15.165:0/3506485132 conn(0x55c412db1db0 msgr2=0x55c412ea1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.385+0000 7f1340f23800 1 -- 172.21.15.165:0/3506485132 shutdown_connections 2024-09-22T08:11:03.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.385+0000 7f1340f23800 1 -- 172.21.15.165:0/3506485132 wait complete. 2024-09-22T08:11:03.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.386+0000 7f1340f23800 1 Processor -- start 2024-09-22T08:11:03.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.386+0000 7f1340f23800 1 -- start start 2024-09-22T08:11:03.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.386+0000 7f1340f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412d2c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.386+0000 7f1340f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c412dbdb80 con 0x55c412db69e0 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.386+0000 7f133cc0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412d2c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.386+0000 7f133cc0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412d2c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50694/0 (socket says 172.21.15.165:50694) 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.386+0000 7f133cc0c640 1 -- 172.21.15.165:0/1342810946 learned_addr learned my addr 172.21.15.165:0/1342810946 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.387+0000 7f133cc0c640 1 -- 172.21.15.165:0/1342810946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c412d2c7c0 con 0x55c412db69e0 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.387+0000 7f133cc0c640 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412d2c260 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f132c0012b0 tx=0x7f132c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.387+0000 7f122960a640 1 -- 172.21.15.165:0/1342810946 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c012030 con 0x55c412db69e0 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.387+0000 7f122960a640 1 -- 172.21.15.165:0/1342810946 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c01a750 con 0x55c412db69e0 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.387+0000 7f122960a640 1 -- 172.21.15.165:0/1342810946 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c01aa70 con 0x55c412db69e0 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.387+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c412d2ab70 con 0x55c412db69e0 2024-09-22T08:11:03.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.387+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c412d2b130 con 0x55c412db69e0 2024-09-22T08:11:03.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.388+0000 7f122960a640 1 -- 172.21.15.165:0/1342810946 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f132c015020 con 0x55c412db69e0 2024-09-22T08:11:03.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.388+0000 7f122960a640 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f122403cfb0 0x7f122403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.388+0000 7f122960a640 1 -- 172.21.15.165:0/1342810946 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f132c020030 con 0x55c412db69e0 2024-09-22T08:11:03.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.388+0000 7f133440b640 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f122403cfb0 0x7f122403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.388+0000 7f1340f23800 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412db7cb0 0x55c412eb6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.388+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412eb74e0 con 0x55c412db7cb0 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.388+0000 7f133d40d640 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412db7cb0 0x55c412eb6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.389+0000 7f133440b640 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f122403cfb0 0x7f122403f470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1324057000 tx=0x7f1324052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.389+0000 7f133d40d640 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412db7cb0 0x55c412eb6fa0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.389+0000 7f133d40d640 1 -- 172.21.15.165:0/1342810946 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f133800a4d0 con 0x55c412db7cb0 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.389+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412d2b630 con 0x55c412db7cb0 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.389+0000 7f133d40d640 1 -- 172.21.15.165:0/1342810946 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f133800a4d0 con 0x55c412db7cb0 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.389+0000 7f1340f23800 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eb9810 0x55c412ebbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.389+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412ebc2d0 con 0x55c412eb9810 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.390+0000 7f133cc0c640 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eb9810 0x55c412ebbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.390+0000 7f133cc0c640 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eb9810 0x55c412ebbc00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.390+0000 7f133cc0c640 1 -- 172.21.15.165:0/1342810946 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412eb9810 2024-09-22T08:11:03.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.390+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412eb86b0 con 0x55c412db7cb0 2024-09-22T08:11:03.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.390+0000 7f133d40d640 1 -- 172.21.15.165:0/1342810946 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f133800a4d0 con 0x55c412db7cb0 2024-09-22T08:11:03.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.390+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412eb8b50 con 0x55c412db7cb0 2024-09-22T08:11:03.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.391+0000 7f133d40d640 1 -- 172.21.15.165:0/1342810946 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f133800a4d0 con 0x55c412db7cb0 2024-09-22T08:11:03.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.391+0000 7f1340f23800 1 Processor -- start 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.391+0000 7f1340f23800 1 -- start start 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.391+0000 7f1340f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ecac50 0x55c412ecb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.391+0000 7f1340f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c412cadd50 con 0x55c412ecac50 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.391+0000 7f133d40d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ecac50 0x55c412ecb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.391+0000 7f133d40d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ecac50 0x55c412ecb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50702/0 (socket says 172.21.15.165:50702) 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.391+0000 7f133d40d640 1 -- 172.21.15.165:0/2073858110 learned_addr learned my addr 172.21.15.165:0/2073858110 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.392+0000 7f133d40d640 1 -- 172.21.15.165:0/2073858110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c412ecb6b0 con 0x55c412ecac50 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.392+0000 7f133d40d640 1 --2- 172.21.15.165:0/2073858110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ecac50 0x55c412ecb070 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55c412eb78c0 tx=0x7f1338018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.392+0000 7f12227fc640 1 -- 172.21.15.165:0/2073858110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1338014450 con 0x55c412ecac50 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.392+0000 7f1340f23800 1 -- 172.21.15.165:0/2073858110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c412ecbee0 con 0x55c412ecac50 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.392+0000 7f12227fc640 1 -- 172.21.15.165:0/2073858110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13380145f0 con 0x55c412ecac50 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.392+0000 7f1340f23800 1 -- 172.21.15.165:0/2073858110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c412ecc480 con 0x55c412ecac50 2024-09-22T08:11:03.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.392+0000 7f12227fc640 1 -- 172.21.15.165:0/2073858110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1338028060 con 0x55c412ecac50 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.393+0000 7f12227fc640 1 -- 172.21.15.165:0/2073858110 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1338011040 con 0x55c412ecac50 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.393+0000 7f12227fc640 1 --2- 172.21.15.165:0/2073858110 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f121403cfb0 0x7f121403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.393+0000 7f12227fc640 1 -- 172.21.15.165:0/2073858110 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f133801e070 con 0x55c412ecac50 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.393+0000 7f133cc0c640 1 --2- 172.21.15.165:0/2073858110 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f121403cfb0 0x7f121403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.394+0000 7f1340f23800 1 Processor -- start 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.394+0000 7f1340f23800 1 -- start start 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.394+0000 7f133cc0c640 1 --2- 172.21.15.165:0/2073858110 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f121403cfb0 0x7f121403f470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55c412eb7960 tx=0x7f132c02df10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.394+0000 7f1340f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412ed8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.394+0000 7f1340f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c412ea69a0 con 0x55c412ed8780 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.394+0000 7f133d40d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412ed8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.394+0000 7f133d40d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412ed8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50708/0 (socket says 172.21.15.165:50708) 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.394+0000 7f133d40d640 1 -- 172.21.15.165:0/1749894564 learned_addr learned my addr 172.21.15.165:0/1749894564 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.394+0000 7f133d40d640 1 -- 172.21.15.165:0/1749894564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c412ed9170 con 0x55c412ed8780 2024-09-22T08:11:03.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.394+0000 7f133d40d640 1 --2- 172.21.15.165:0/1749894564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412ed8b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1338054890 tx=0x7f133802ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12572ee36a324cba server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1213fff640 1 -- 172.21.15.165:0/1749894564 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f133804b070 con 0x55c412ed8780 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1213fff640 1 -- 172.21.15.165:0/1749894564 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13380549a0 con 0x55c412ed8780 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1213fff640 1 -- 172.21.15.165:0/1749894564 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1338016910 con 0x55c412ed8780 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1340f23800 1 -- 172.21.15.165:0/1749894564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 msgr2=0x55c412ed8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1340f23800 1 --2- 172.21.15.165:0/1749894564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412ed8b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1338054890 tx=0x7f133802ced0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1340f23800 1 -- 172.21.15.165:0/1749894564 shutdown_connections 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1340f23800 1 --2- 172.21.15.165:0/1749894564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412ed8b80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1340f23800 1 -- 172.21.15.165:0/1749894564 >> 172.21.15.165:0/1749894564 conn(0x55c412ed3ad0 msgr2=0x55c412ed1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1340f23800 1 -- 172.21.15.165:0/1749894564 shutdown_connections 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1340f23800 1 -- 172.21.15.165:0/1749894564 wait complete. 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1340f23800 1 Processor -- start 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1340f23800 1 -- start start 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.395+0000 7f1340f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412edece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f1340f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c412ed7710 con 0x55c412ed8780 2024-09-22T08:11:03.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f133d40d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412edece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f133d40d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412edece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50718/0 (socket says 172.21.15.165:50718) 2024-09-22T08:11:03.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 learned_addr learned my addr 172.21.15.165:0/558523307 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c412edf240 con 0x55c412ed8780 2024-09-22T08:11:03.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f133d40d640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412edece0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f133800b010 tx=0x7f13380547f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f12127fc640 1 -- 172.21.15.165:0/558523307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f133804b030 con 0x55c412ed8780 2024-09-22T08:11:03.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f12127fc640 1 -- 172.21.15.165:0/558523307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1338045a30 con 0x55c412ed8780 2024-09-22T08:11:03.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c412edf4d0 con 0x55c412ed8780 2024-09-22T08:11:03.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f12127fc640 1 -- 172.21.15.165:0/558523307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1338045d10 con 0x55c412ed8780 2024-09-22T08:11:03.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.396+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c412edfe50 con 0x55c412ed8780 2024-09-22T08:11:03.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.397+0000 7f12127fc640 1 -- 172.21.15.165:0/558523307 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f13380148d0 con 0x55c412ed8780 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.397+0000 7f12127fc640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f120803cfb0 0x7f120803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.397+0000 7f12127fc640 1 -- 172.21.15.165:0/558523307 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f133804c070 con 0x55c412ed8780 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.397+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.397+0000 7f133cc0c640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f120803cfb0 0x7f120803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f1340f23800 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412eea7e0 0x55c412eecc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412eed3c0 con 0x55c412eea7e0 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f133440b640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412eea7e0 0x55c412eecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f133cc0c640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f120803cfb0 0x7f120803f470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f132c052a10 tx=0x7f132c048000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f133440b640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412eea7e0 0x55c412eecc70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f1340f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f1340f23800 20 realm 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412eed7f0 con 0x55c412eea7e0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.398+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412eee0c0 con 0x55c412eea7e0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412eee460 con 0x55c412eea7e0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eef1c0 0x55c412ef15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef1af0 con 0x55c412eef1c0 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f133d40d640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eef1c0 0x55c412ef15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.399+0000 7f133d40d640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eef1c0 0x55c412ef15b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.400+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.400+0000 7f1340f23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.400+0000 7f1340f23800 20 searching for the correct realm 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.400+0000 7f1340f23800 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55c412ef3b30 0x55c412ef5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.400+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412ef3b30 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.400+0000 7f133cc0c640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55c412ef3b30 0x55c412ef5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.400+0000 7f133cc0c640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55c412ef3b30 0x55c412ef5ff0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.400+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.400+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eef1c0 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.401+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.401+0000 7f133d40d640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1338014070 0x7f13380363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.401+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x7f1338014070 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.401+0000 7f133440b640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1338014070 0x7f13380363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.401+0000 7f133440b640 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1338014070 0x7f13380363e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.401+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.401+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eea7e0 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.402+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.402+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eea7e0 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.402+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.402+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x7f1338014070 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.402+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.402+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x7f1338014070 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.402+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.402+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eef1c0 2024-09-22T08:11:03.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.403+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.403+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412ef3b30 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.403+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.403+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eea7e0 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.403+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.403+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x7f1338014070 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.403+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.403+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eea7e0 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.403+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.403+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eef1c0 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.404+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.404+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412ef3b30 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.404+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.404+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412ef3b30 2024-09-22T08:11:03.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.404+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.404+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x7f1338014070 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.404+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.404+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412ef3b30 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.405+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.405+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412ef3b30 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.405+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.405+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eea7e0 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.405+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.405+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eea7e0 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.405+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.405+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x7f1338014070 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.406+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.406+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412ef3b30 2024-09-22T08:11:03.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.406+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.406+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eef1c0 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.406+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.406+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eea7e0 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.406+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.406+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x7f1338014070 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.406+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.407+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412ef3b30 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.407+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.407+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x7f1338014070 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.407+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.407+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eef1c0 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.407+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.407+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412ef3b30 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.407+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.407+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x7f1338014070 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eea7e0 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef66c0 con 0x55c412eef1c0 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef2530 con 0x55c412eea7e0 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.408+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef2140 con 0x55c412eea7e0 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef2ea0 con 0x55c412eea7e0 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 20 zone default found 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 4 Realm: () 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:03.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 20 zonegroup default 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef29b0 con 0x7f1338014070 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.409+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef8a10 con 0x55c412ef3b30 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.410+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.410+0000 7f1340f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.410+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.410+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef8f80 con 0x55c412ef3b30 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.410+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.410+0000 7f1340f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.410+0000 7f1340f23800 20 started sync module instance, tier type = 2024-09-22T08:11:03.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.410+0000 7f1340f23800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:03.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.410+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef7e70 con 0x55c412eef1c0 2024-09-22T08:11:03.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.411+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.411+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94300619635136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef93c0 con 0x55c412eef1c0 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.411+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef9dc0 con 0x55c412eea7e0 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.412+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94300619635136] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.412+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.412+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94300619637568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef9d80 con 0x55c412eea7e0 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.412+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efa820 con 0x55c412ef3b30 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.414+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94300619637568] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.414+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.414+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94300619643088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef9cf0 con 0x55c412ef3b30 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.414+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efb6e0 con 0x55c412eef1c0 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.415+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.415+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94300619650064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efbe80 con 0x55c412eef1c0 2024-09-22T08:11:03.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.415+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efc9a0 con 0x55c412eea7e0 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.415+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94300619643088] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.416+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.416+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94300619654256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efbe80 con 0x55c412eea7e0 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.416+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efd3f0 con 0x7f1338014070 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.416+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94300619650064] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.417+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94300619654256] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.417+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.417+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94300619648016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efcf00 con 0x7f1338014070 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.417+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efdc90 con 0x7f1338014070 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.418+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.418+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94300619658736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efdec0 con 0x7f1338014070 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.418+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efe880 con 0x7f1338014070 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.418+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94300619648016] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.419+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94300619658736] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.419+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.419+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94300619659792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efde30 con 0x7f1338014070 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.419+0000 7f1340f23800 20 add_watcher() i=0 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.419+0000 7f1340f23800 20 add_watcher() i=1 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.419+0000 7f1340f23800 20 add_watcher() i=2 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.419+0000 7f1340f23800 20 add_watcher() i=3 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.419+0000 7f1340f23800 20 add_watcher() i=4 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.419+0000 7f1340f23800 20 add_watcher() i=5 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.419+0000 7f1340f23800 20 add_watcher() i=6 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.420+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94300619659792] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.420+0000 7f1340f23800 20 add_watcher() i=7 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.420+0000 7f1340f23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.420+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412f018b0 con 0x55c412eea7e0 2024-09-22T08:11:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.421+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.421+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94300619662288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efed40 con 0x55c412eea7e0 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94300619662288] v32'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f11f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f1340f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f1340f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f1340f23800 5 note: GC not initialized 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f11f27e4640 20 reqs_thread_entry: start 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f1340f23800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f1340f23800 20 Filter name: none 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f11eb7fe640 20 reqs_thread_entry: start 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f1340f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.422+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c412f346b0 con 0x55c412eea7e0 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.423+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.423+0000 7f1340f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.431 INFO:teuthology.orchestra.run.smithi165.stderr:could not fetch user info: no user info saved 2024-09-22T08:11:03.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.423+0000 7f11f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.423+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94300619662288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412f34670 con 0x55c412eea7e0 2024-09-22T08:11:03.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.424+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94300619662288] v32'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.424+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94300619635136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412f34670 con 0x55c412eef1c0 2024-09-22T08:11:03.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.425+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94300619635136] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.426+0000 7f1340f23800 20 remove_watcher() i=0 2024-09-22T08:11:03.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.426+0000 7f1340f23800 2 removed watcher, disabling cache 2024-09-22T08:11:03.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.426+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94300619637568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412f34670 con 0x55c412eea7e0 2024-09-22T08:11:03.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.427+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94300619637568] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.427+0000 7f1340f23800 20 remove_watcher() i=1 2024-09-22T08:11:03.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.427+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94300619643088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412f34670 con 0x55c412ef3b30 2024-09-22T08:11:03.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.428+0000 7f133cc0c640 1 -- 172.21.15.165:0/558523307 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94300619643088] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c018ce0 con 0x55c412ef3b30 2024-09-22T08:11:03.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.428+0000 7f1340f23800 20 remove_watcher() i=2 2024-09-22T08:11:03.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.428+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94300619650064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef79c0 con 0x55c412eef1c0 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.429+0000 7f133d40d640 1 -- 172.21.15.165:0/558523307 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94300619650064] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f133803d020 con 0x55c412eef1c0 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.429+0000 7f1340f23800 20 remove_watcher() i=3 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.429+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94300619654256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef98d0 con 0x55c412eea7e0 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.430+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94300619654256] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x55c412eea7e0 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.430+0000 7f1340f23800 20 remove_watcher() i=4 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.430+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94300619648016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412efb410 con 0x7f1338014070 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.431+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94300619648016] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.431+0000 7f1340f23800 20 remove_watcher() i=5 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.431+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94300619658736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef79c0 con 0x7f1338014070 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.432+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94300619658736] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.432+0000 7f1340f23800 20 remove_watcher() i=6 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.432+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94300619659792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c412ef98d0 con 0x7f1338014070 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.432+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94300619659792] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324051070 con 0x7f1338014070 2024-09-22T08:11:03.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.432+0000 7f1340f23800 20 remove_watcher() i=7 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1338014070 msgr2=0x7f13380363e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1338014070 0x7f13380363e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412eea7e0 msgr2=0x55c412eecc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412eea7e0 0x55c412eecc70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eef1c0 msgr2=0x55c412ef15b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eef1c0 0x55c412ef15b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55c412ef3b30 msgr2=0x55c412ef5ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55c412ef3b30 0x55c412ef5ff0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f120803cfb0 msgr2=0x7f120803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f120803cfb0 0x7f120803f470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f132c052a10 tx=0x7f132c048000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 msgr2=0x55c412edece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 --2- 172.21.15.165:0/558523307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ed8780 0x55c412edece0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f133800b010 tx=0x7f13380547f0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 reap_dead start 2024-09-22T08:11:03.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f133440b640 1 -- 172.21.15.165:0/558523307 reap_dead start 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 shutdown_connections 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 >> 172.21.15.165:0/558523307 conn(0x55c412ed3ad0 msgr2=0x55c412ed1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 shutdown_connections 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/558523307 wait complete. 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/2073858110 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f121403cfb0 msgr2=0x7f121403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 --2- 172.21.15.165:0/2073858110 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f121403cfb0 0x7f121403f470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55c412eb7960 tx=0x7f132c02df10 comp rx=0 tx=0).stop 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/2073858110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ecac50 msgr2=0x55c412ecb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 --2- 172.21.15.165:0/2073858110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ecac50 0x55c412ecb070 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55c412eb78c0 tx=0x7f1338018830 comp rx=0 tx=0).stop 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/2073858110 shutdown_connections 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 --2- 172.21.15.165:0/2073858110 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f121403cfb0 0x7f121403f470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 --2- 172.21.15.165:0/2073858110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412ecac50 0x55c412ecb070 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/2073858110 >> 172.21.15.165:0/2073858110 conn(0x55c412ebf000 msgr2=0x55c412ebf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/2073858110 shutdown_connections 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.433+0000 7f1340f23800 1 -- 172.21.15.165:0/2073858110 wait complete. 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412db7cb0 msgr2=0x55c412eb6fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412db7cb0 0x55c412eb6fa0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eb9810 msgr2=0x55c412ebbc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eb9810 0x55c412ebbc00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f122403cfb0 msgr2=0x7f122403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f122403cfb0 0x7f122403f470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1324057000 tx=0x7f1324052000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 msgr2=0x55c412d2c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412d2c260 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f132c0012b0 tx=0x7f132c000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 shutdown_connections 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c412eb9810 0x55c412ebbc00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c412db7cb0 0x55c412eb6fa0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f122403cfb0 0x7f122403f470 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 --2- 172.21.15.165:0/1342810946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c412db69e0 0x55c412d2c260 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 >> 172.21.15.165:0/1342810946 conn(0x55c412db1db0 msgr2=0x55c412ea7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 shutdown_connections 2024-09-22T08:11:03.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.434+0000 7f1340f23800 1 -- 172.21.15.165:0/1342810946 wait complete. 2024-09-22T08:11:03.443 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T08:11:03.443 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-22T08:11:03.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-22T08:11:03.444 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-22T08:11:03.498 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:03.498 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:03.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.498+0000 7fe95a487800 1 Processor -- start 2024-09-22T08:11:03.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.498+0000 7fe95a487800 1 -- start start 2024-09-22T08:11:03.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.498+0000 7fe95a487800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f80c74dc50 0x55f80c750040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.498+0000 7fe95a487800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f80c5d4a20 con 0x55f80c74a140 2024-09-22T08:11:03.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.498+0000 7fe95a487800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f80c5d47d0 con 0x55f80c74dc50 2024-09-22T08:11:03.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.499+0000 7fe94f770640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f80c74dc50 0x55f80c750040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.499+0000 7fe94f770640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f80c74dc50 0x55f80c750040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50730/0 (socket says 172.21.15.165:50730) 2024-09-22T08:11:03.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.499+0000 7fe957f71640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f80c74a140 0x55f80c74c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33464/0 (socket says 172.21.15.165:33464) 2024-09-22T08:11:03.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.499+0000 7fe94f770640 1 -- 172.21.15.165:0/646183521 learned_addr learned my addr 172.21.15.165:0/646183521 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.499+0000 7fe94f770640 1 -- 172.21.15.165:0/646183521 >> v1:172.21.15.53:6789/0 conn(0x55f80c74a140 legacy=0x55f80c74c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.499+0000 7fe94f770640 1 -- 172.21.15.165:0/646183521 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80c7515c0 con 0x55f80c74dc50 2024-09-22T08:11:03.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.501+0000 7fe94f770640 1 --2- 172.21.15.165:0/646183521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74dc50 0x55f80c750040 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe94000a520 tx=0x7fe940045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448c2ae00a7651a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.501+0000 7fe957770640 1 -- 172.21.15.165:0/646183521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe940055070 con 0x55f80c74dc50 2024-09-22T08:11:03.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.501+0000 7fe957770640 1 -- 172.21.15.165:0/646183521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9400515b0 con 0x55f80c74dc50 2024-09-22T08:11:03.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.501+0000 7fe957770640 1 -- 172.21.15.165:0/646183521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9400518d0 con 0x55f80c74dc50 2024-09-22T08:11:03.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.501+0000 7fe95a487800 1 -- 172.21.15.165:0/646183521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74dc50 msgr2=0x55f80c750040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.501+0000 7fe95a487800 1 --2- 172.21.15.165:0/646183521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74dc50 0x55f80c750040 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe94000a520 tx=0x7fe940045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.502+0000 7fe95a487800 1 -- 172.21.15.165:0/646183521 shutdown_connections 2024-09-22T08:11:03.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.502+0000 7fe95a487800 1 --2- 172.21.15.165:0/646183521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74dc50 0x55f80c750040 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.502+0000 7fe95a487800 1 -- 172.21.15.165:0/646183521 >> 172.21.15.165:0/646183521 conn(0x55f80c743c00 msgr2=0x55f80c746060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.502+0000 7fe95a487800 1 -- 172.21.15.165:0/646183521 shutdown_connections 2024-09-22T08:11:03.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.502+0000 7fe95a487800 1 -- 172.21.15.165:0/646183521 wait complete. 2024-09-22T08:11:03.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.515+0000 7fe95a487800 1 Processor -- start 2024-09-22T08:11:03.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.515+0000 7fe95a487800 1 -- start start 2024-09-22T08:11:03.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.515+0000 7fe95a487800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c7498d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.515+0000 7fe95a487800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f80c5e1dd0 con 0x55f80c74a140 2024-09-22T08:11:03.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.516+0000 7fe957f71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c7498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.516+0000 7fe957f71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c7498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50742/0 (socket says 172.21.15.165:50742) 2024-09-22T08:11:03.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.516+0000 7fe957f71640 1 -- 172.21.15.165:0/2776886990 learned_addr learned my addr 172.21.15.165:0/2776886990 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.516+0000 7fe957f71640 1 -- 172.21.15.165:0/2776886990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80c749ec0 con 0x55f80c74a140 2024-09-22T08:11:03.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.516+0000 7fe957f71640 1 --2- 172.21.15.165:0/2776886990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c7498d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe94800b260 tx=0x7fe94800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb5527bf5a0a120 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.516+0000 7fe845e0b640 1 -- 172.21.15.165:0/2776886990 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe94800be60 con 0x55f80c74a140 2024-09-22T08:11:03.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.516+0000 7fe845e0b640 1 -- 172.21.15.165:0/2776886990 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe948006070 con 0x55f80c74a140 2024-09-22T08:11:03.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.516+0000 7fe845e0b640 1 -- 172.21.15.165:0/2776886990 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe94800e710 con 0x55f80c74a140 2024-09-22T08:11:03.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.517+0000 7fe95a487800 1 -- 172.21.15.165:0/2776886990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 msgr2=0x55f80c7498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.517+0000 7fe95a487800 1 --2- 172.21.15.165:0/2776886990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c7498d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe94800b260 tx=0x7fe94800b660 comp rx=0 tx=0).stop 2024-09-22T08:11:03.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.517+0000 7fe95a487800 1 -- 172.21.15.165:0/2776886990 shutdown_connections 2024-09-22T08:11:03.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.517+0000 7fe95a487800 1 --2- 172.21.15.165:0/2776886990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c7498d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.517+0000 7fe95a487800 1 -- 172.21.15.165:0/2776886990 >> 172.21.15.165:0/2776886990 conn(0x55f80c743c00 msgr2=0x55f80c834ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.517+0000 7fe95a487800 1 -- 172.21.15.165:0/2776886990 shutdown_connections 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.517+0000 7fe95a487800 1 -- 172.21.15.165:0/2776886990 wait complete. 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.517+0000 7fe95a487800 1 Processor -- start 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe95a487800 1 -- start start 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe95a487800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c842e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe95a487800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f80c750880 con 0x55f80c74a140 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe957f71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c842e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe957f71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c842e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50748/0 (socket says 172.21.15.165:50748) 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe957f71640 1 -- 172.21.15.165:0/953624866 learned_addr learned my addr 172.21.15.165:0/953624866 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe957f71640 1 -- 172.21.15.165:0/953624866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80c8433b0 con 0x55f80c74a140 2024-09-22T08:11:03.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe957f71640 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c842e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f80c749400 tx=0x7fe948000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe83ffff640 1 -- 172.21.15.165:0/953624866 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe94800ee10 con 0x55f80c74a140 2024-09-22T08:11:03.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe83ffff640 1 -- 172.21.15.165:0/953624866 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94800fa30 con 0x55f80c74a140 2024-09-22T08:11:03.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f80c843640 con 0x55f80c74a140 2024-09-22T08:11:03.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.518+0000 7fe83ffff640 1 -- 172.21.15.165:0/953624866 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe94800fd30 con 0x55f80c74a140 2024-09-22T08:11:03.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.519+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f80c844040 con 0x55f80c74a140 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.519+0000 7fe83ffff640 1 -- 172.21.15.165:0/953624866 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe948017070 con 0x55f80c74a140 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.520+0000 7fe83ffff640 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 0x7fe84003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.520+0000 7fe83ffff640 1 -- 172.21.15.165:0/953624866 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe948015020 con 0x55f80c74a140 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.520+0000 7fe94f770640 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 0x7fe84003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.520+0000 7fe95a487800 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c74dc50 0x55f80c84a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.520+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c84a9e0 con 0x55f80c74dc50 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.520+0000 7fe958772640 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c74dc50 0x55f80c84a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.520+0000 7fe94f770640 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 0x7fe84003f4c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe940057000 tx=0x7fe940052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.520+0000 7fe958772640 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c74dc50 0x55f80c84a4a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.520+0000 7fe958772640 1 -- 172.21.15.165:0/953624866 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95000a4d0 con 0x55f80c74dc50 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.521+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c84ad80 con 0x55f80c74dc50 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.521+0000 7fe958772640 1 -- 172.21.15.165:0/953624866 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe95000a4d0 con 0x55f80c74dc50 2024-09-22T08:11:03.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.521+0000 7fe95a487800 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c84c880 0x55f80c84ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.521+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c84f490 con 0x55f80c84c880 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.521+0000 7fe957f71640 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c84c880 0x55f80c84ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.521+0000 7fe957f71640 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c84c880 0x55f80c84ed00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.521+0000 7fe957f71640 1 -- 172.21.15.165:0/953624866 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c84c880 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.521+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c84b5d0 con 0x55f80c74dc50 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.522+0000 7fe958772640 1 -- 172.21.15.165:0/953624866 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe95000a4d0 con 0x55f80c74dc50 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.522+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c84ba20 con 0x55f80c74dc50 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.522+0000 7fe958772640 1 -- 172.21.15.165:0/953624866 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe95000a4d0 con 0x55f80c74dc50 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.522+0000 7fe95a487800 1 Processor -- start 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.522+0000 7fe95a487800 1 -- start start 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.523+0000 7fe95a487800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c85de10 0x55f80c85e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.523+0000 7fe95a487800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f80c640d50 con 0x55f80c85de10 2024-09-22T08:11:03.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.523+0000 7fe958772640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c85de10 0x55f80c85e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.523+0000 7fe958772640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c85de10 0x55f80c85e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50756/0 (socket says 172.21.15.165:50756) 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.523+0000 7fe958772640 1 -- 172.21.15.165:0/3373851798 learned_addr learned my addr 172.21.15.165:0/3373851798 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.523+0000 7fe958772640 1 -- 172.21.15.165:0/3373851798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80c85e870 con 0x55f80c85de10 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.523+0000 7fe958772640 1 --2- 172.21.15.165:0/3373851798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c85de10 0x55f80c85e230 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe95000a2a0 tx=0x7fe950018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.524+0000 7fe83d7fa640 1 -- 172.21.15.165:0/3373851798 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950014450 con 0x55f80c85de10 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.524+0000 7fe95a487800 1 -- 172.21.15.165:0/3373851798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f80c85f0a0 con 0x55f80c85de10 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.524+0000 7fe83d7fa640 1 -- 172.21.15.165:0/3373851798 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9500145f0 con 0x55f80c85de10 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.524+0000 7fe83d7fa640 1 -- 172.21.15.165:0/3373851798 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950014910 con 0x55f80c85de10 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.524+0000 7fe95a487800 1 -- 172.21.15.165:0/3373851798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f80c85f640 con 0x55f80c85de10 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.525+0000 7fe83d7fa640 1 -- 172.21.15.165:0/3373851798 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe950011040 con 0x55f80c85de10 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.525+0000 7fe83d7fa640 1 --2- 172.21.15.165:0/3373851798 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 0x7fe83003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.525+0000 7fe83d7fa640 1 -- 172.21.15.165:0/3373851798 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe95001e070 con 0x55f80c85de10 2024-09-22T08:11:03.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.525+0000 7fe957f71640 1 --2- 172.21.15.165:0/3373851798 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 0x7fe83003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.525+0000 7fe95a487800 1 Processor -- start 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.525+0000 7fe95a487800 1 -- start start 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.525+0000 7fe957f71640 1 --2- 172.21.15.165:0/3373851798 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 0x7fe83003f470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55f80c844f40 tx=0x7fe94801c790 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.525+0000 7fe95a487800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c86ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.525+0000 7fe95a487800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f80c748320 con 0x55f80c86a8b0 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.526+0000 7fe958772640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c86ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.526+0000 7fe958772640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c86ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50758/0 (socket says 172.21.15.165:50758) 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.526+0000 7fe958772640 1 -- 172.21.15.165:0/1142466307 learned_addr learned my addr 172.21.15.165:0/1142466307 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.526+0000 7fe958772640 1 -- 172.21.15.165:0/1142466307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80c86b280 con 0x55f80c86a8b0 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.526+0000 7fe958772640 1 --2- 172.21.15.165:0/1142466307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c86ac90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe9500547d0 tx=0x7fe950001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c77a91a76290b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.526+0000 7fe836ffd640 1 -- 172.21.15.165:0/1142466307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95004b070 con 0x55f80c86a8b0 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.526+0000 7fe836ffd640 1 -- 172.21.15.165:0/1142466307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950051070 con 0x55f80c86a8b0 2024-09-22T08:11:03.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.526+0000 7fe836ffd640 1 -- 172.21.15.165:0/1142466307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950053320 con 0x55f80c86a8b0 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 -- 172.21.15.165:0/1142466307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 msgr2=0x55f80c86ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 --2- 172.21.15.165:0/1142466307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c86ac90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe9500547d0 tx=0x7fe950001440 comp rx=0 tx=0).stop 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 -- 172.21.15.165:0/1142466307 shutdown_connections 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 --2- 172.21.15.165:0/1142466307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c86ac90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 -- 172.21.15.165:0/1142466307 >> 172.21.15.165:0/1142466307 conn(0x55f80c866cb0 msgr2=0x55f80c864ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 -- 172.21.15.165:0/1142466307 shutdown_connections 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 -- 172.21.15.165:0/1142466307 wait complete. 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 Processor -- start 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 -- start start 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c871e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe95a487800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f80c86b8c0 con 0x55f80c86a8b0 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe958772640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c871e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe958772640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c871e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50772/0 (socket says 172.21.15.165:50772) 2024-09-22T08:11:03.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 learned_addr learned my addr 172.21.15.165:0/2571089508 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.527+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80c8723a0 con 0x55f80c86a8b0 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.528+0000 7fe958772640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c871e40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe950049040 tx=0x7fe950022f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.528+0000 7fe8357fa640 1 -- 172.21.15.165:0/2571089508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95004b040 con 0x55f80c86a8b0 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.528+0000 7fe8357fa640 1 -- 172.21.15.165:0/2571089508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950011330 con 0x55f80c86a8b0 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.528+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f80c872630 con 0x55f80c86a8b0 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.528+0000 7fe8357fa640 1 -- 172.21.15.165:0/2571089508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950054be0 con 0x55f80c86a8b0 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.528+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f80c8731c0 con 0x55f80c86a8b0 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.529+0000 7fe8357fa640 1 -- 172.21.15.165:0/2571089508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe9500459a0 con 0x55f80c86a8b0 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.529+0000 7fe8357fa640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe82003cfb0 0x7fe82003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.529+0000 7fe8357fa640 1 -- 172.21.15.165:0/2571089508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe95004de00 con 0x55f80c86a8b0 2024-09-22T08:11:03.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.529+0000 7fe957f71640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe82003cfb0 0x7fe82003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.529+0000 7fe957f71640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe82003cfb0 0x7fe82003f470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe9480534d0 tx=0x7fe948048000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.529+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe95a487800 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c87d920 0x55f80c87fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c880530 con 0x55f80c87d920 2024-09-22T08:11:03.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe94f770640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c87d920 0x55f80c87fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe94f770640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c87d920 0x55f80c87fde0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe95a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe95a487800 20 realm 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c880960 con 0x55f80c87d920 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe95a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe95a487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.530+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c881230 con 0x55f80c87d920 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe95a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8815d0 con 0x55f80c87d920 2024-09-22T08:11:03.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe95a487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe95a487800 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c882330 0x55f80c884720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c884d30 con 0x55f80c882330 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe958772640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c882330 0x55f80c884720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.531+0000 7fe958772640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c882330 0x55f80c884720 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.532+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.532+0000 7fe95a487800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.532+0000 7fe95a487800 20 searching for the correct realm 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.532+0000 7fe95a487800 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f80c886d00 0x55f80c8891c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.532+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c886d00 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.532+0000 7fe957f71640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f80c886d00 0x55f80c8891c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.532+0000 7fe957f71640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f80c886d00 0x55f80c8891c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.532+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.532+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c882330 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.532+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.533+0000 7fe958772640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe950037070 0x7fe95002d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.533+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x7fe950037070 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.533+0000 7fe94f770640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe950037070 0x7fe95002d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.533+0000 7fe94f770640 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe950037070 0x7fe95002d9b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.533+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x7fe950037070 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.534+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c87d920 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.534+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.534+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c87d920 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.534+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.534+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x7fe950037070 2024-09-22T08:11:03.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.534+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x7fe950037070 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.534+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x7fe950037070 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.534+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x7fe950037070 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.535+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c882330 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.535+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.535+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c886d00 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.535+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.535+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c87d920 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.535+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.535+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x7fe950037070 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.535+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x7fe950037070 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.535+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c87d920 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.536+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.536+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c882330 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.536+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.536+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c886d00 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.536+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.536+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c886d00 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.536+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.536+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x7fe950037070 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.537+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x7fe950037070 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.537+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c886d00 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.537+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.537+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c886d00 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.537+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.537+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c87d920 2024-09-22T08:11:03.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.537+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.537+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c87d920 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.537+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.537+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x7fe950037070 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.538+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x7fe950037070 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.538+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c886d00 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.538+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.538+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c882330 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.538+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.538+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c87d920 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.538+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.538+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x7fe950037070 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.539+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x7fe950037070 2024-09-22T08:11:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.539+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c886d00 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.539+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.539+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x7fe950037070 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.539+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x7fe950037070 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.539+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c882330 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.539+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.539+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c886d00 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x7fe950037070 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe940057030 con 0x7fe950037070 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c87d920 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889840 con 0x55f80c882330 2024-09-22T08:11:03.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe95a487800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe95a487800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe95a487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe95a487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe95a487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe95a487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.540+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c885720 con 0x55f80c87d920 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c885fc0 con 0x55f80c87d920 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe940057030 con 0x55f80c87d920 2024-09-22T08:11:03.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c889cc0 con 0x55f80c87d920 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 20 zone default found 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 4 Realm: () 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 20 zonegroup default 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.541+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88a0c0 con 0x7fe950037070 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe95a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88bf20 con 0x55f80c886d00 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe95a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88c400 con 0x55f80c886d00 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe95a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe95a487800 20 started sync module instance, tier type = 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe95a487800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.542+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88b390 con 0x55f80c882330 2024-09-22T08:11:03.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.543+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.543+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94523850536880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88aff0 con 0x55f80c882330 2024-09-22T08:11:03.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.543+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88d330 con 0x55f80c87d920 2024-09-22T08:11:03.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.544+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.544+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94523850542720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88d750 con 0x55f80c87d920 2024-09-22T08:11:03.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.544+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88e250 con 0x55f80c886d00 2024-09-22T08:11:03.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.544+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94523850536880] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.545+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94523850542720] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.545+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.545+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94523850541152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88d750 con 0x55f80c886d00 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.545+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88eaf0 con 0x55f80c882330 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.546+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.546+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94523850549312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88f390 con 0x55f80c882330 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.546+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88fe60 con 0x55f80c87d920 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.546+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94523850541152] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.547+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.547+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94523850553680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88fe20 con 0x55f80c87d920 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.548+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8908b0 con 0x7fe950037070 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.548+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94523850549312] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.549+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94523850553680] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.549+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.549+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94523850543776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8903c0 con 0x7fe950037070 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.549+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c891150 con 0x7fe950037070 2024-09-22T08:11:03.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.550+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.550+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94523850558096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c891360 con 0x7fe950037070 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.550+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c891d20 con 0x7fe950037070 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.550+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94523850543776] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.551+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94523850558096] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.551+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.551+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94523850559152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8912d0 con 0x7fe950037070 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.551+0000 7fe95a487800 20 add_watcher() i=0 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.551+0000 7fe95a487800 20 add_watcher() i=1 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.551+0000 7fe95a487800 20 add_watcher() i=2 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.551+0000 7fe95a487800 20 add_watcher() i=3 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.551+0000 7fe95a487800 20 add_watcher() i=4 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.551+0000 7fe95a487800 20 add_watcher() i=5 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.551+0000 7fe95a487800 20 add_watcher() i=6 2024-09-22T08:11:03.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.552+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94523850559152] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.552+0000 7fe95a487800 20 add_watcher() i=7 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.552+0000 7fe95a487800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.552+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c894d50 con 0x55f80c87d920 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.553+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.553+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94523850561648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8921e0 con 0x55f80c87d920 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94523850561648] v32'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe80dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe95a487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe95a487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe95a487800 5 note: GC not initialized 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe80cfe1640 20 reqs_thread_entry: start 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe95a487800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe95a487800 20 Filter name: none 2024-09-22T08:11:03.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe7867fc640 20 reqs_thread_entry: start 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe95a487800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.554+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8c8070 con 0x55f80c87d920 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8c65d0 con 0x55f80c87d920 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8c65d0 con 0x7fe950037070 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.555+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8c6f50 con 0x55f80c87d920 2024-09-22T08:11:03.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.556+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.556+0000 7fe95a487800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.556+0000 7fe95a487800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.556+0000 7fe95a487800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.556+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94523850779200 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8cbac0 con 0x55f80c87d920 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.557+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify (1) cookie 94523850553680 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55f80c8c72f0 con 0x55f80c87d920 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.557+0000 7fe836ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94523850553680 notifier 4290 bl.length()=567 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.557+0000 7fe836ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.557+0000 7fe836ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.557+0000 7fe836ffd640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe81c003ea0 con 0x55f80c87d920 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.557+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 notify.4 [notify cookie 94523850779200 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.557+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.557+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== watch-notify(notify_complete (2) cookie 94523850779200 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f80c8c7b90 con 0x55f80c87d920 2024-09-22T08:11:03.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.557+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8c69d0 con 0x55f80c87d920 2024-09-22T08:11:03.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe95a487800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-22T08:11:03.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe95a487800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-22T08:11:03.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe95a487800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-22T08:11:03.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94523850794496 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8cba30 con 0x55f80c882330 2024-09-22T08:11:03.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== watch-notify(notify (1) cookie 94523850549312 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55f80c8731c0 con 0x55f80c882330 2024-09-22T08:11:03.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe8367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94523850549312 notifier 4290 bl.length()=169 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe8367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe8367fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe8367fc640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe78c003400 con 0x55f80c882330 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(69 notify.3 [notify cookie 94523850794496 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== watch-notify(notify_complete (2) cookie 94523850794496 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f80c872630 con 0x55f80c882330 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.559+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8c9aa0 con 0x7fe950037070 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe95a487800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe95a487800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe95a487800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94523850794496 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8cba30 con 0x55f80c882330 2024-09-22T08:11:03.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== watch-notify(notify (1) cookie 94523850549312 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f80c872630 con 0x55f80c882330 2024-09-22T08:11:03.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe836ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94523850549312 notifier 4290 bl.length()=177 2024-09-22T08:11:03.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe836ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-22T08:11:03.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe836ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-22T08:11:03.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe836ffd640 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe81c003ea0 con 0x55f80c882330 2024-09-22T08:11:03.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(72 notify.3 [notify cookie 94523850794496 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== watch-notify(notify_complete (2) cookie 94523850794496 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f80c8723a0 con 0x55f80c882330 2024-09-22T08:11:03.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.561+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.572 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.562+0000 7fe80dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.562+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94523850561648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8c5d40 con 0x55f80c87d920 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.563+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94523850561648] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.563+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94523850536880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8c5d40 con 0x55f80c882330 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.566+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94523850536880] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.566+0000 7fe95a487800 20 remove_watcher() i=0 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.566+0000 7fe95a487800 2 removed watcher, disabling cache 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.566+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94523850542720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8c5d40 con 0x55f80c87d920 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.568+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94523850542720] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.568+0000 7fe95a487800 20 remove_watcher() i=1 2024-09-22T08:11:03.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.568+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94523850541152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c8c5d40 con 0x55f80c886d00 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.569+0000 7fe957f71640 1 -- 172.21.15.165:0/2571089508 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94523850541152] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe94802e070 con 0x55f80c886d00 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.569+0000 7fe95a487800 20 remove_watcher() i=2 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.569+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94523850549312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88b7b0 con 0x55f80c882330 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.570+0000 7fe958772640 1 -- 172.21.15.165:0/2571089508 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94523850549312] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95002a070 con 0x55f80c882330 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.570+0000 7fe95a487800 20 remove_watcher() i=3 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.570+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94523850553680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88ce80 con 0x55f80c87d920 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.571+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94523850553680] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x55f80c87d920 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.571+0000 7fe95a487800 20 remove_watcher() i=4 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.571+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94523850543776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88c860 con 0x7fe950037070 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.572+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94523850543776] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.572+0000 7fe95a487800 20 remove_watcher() i=5 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.573+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94523850558096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88b7b0 con 0x7fe950037070 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.573+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94523850558096] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.573+0000 7fe95a487800 20 remove_watcher() i=6 2024-09-22T08:11:03.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.574+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94523850559152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f80c88c860 con 0x7fe950037070 2024-09-22T08:11:03.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.574+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94523850559152] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9400881c0 con 0x7fe950037070 2024-09-22T08:11:03.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.574+0000 7fe95a487800 20 remove_watcher() i=7 2024-09-22T08:11:03.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe950037070 msgr2=0x7fe95002d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe950037070 0x7fe95002d9b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c87d920 msgr2=0x55f80c87fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c87d920 0x55f80c87fde0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c882330 msgr2=0x55f80c884720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c882330 0x55f80c884720 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f80c886d00 msgr2=0x55f80c8891c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f80c886d00 0x55f80c8891c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe82003cfb0 msgr2=0x7fe82003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe82003cfb0 0x7fe82003f470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe9480534d0 tx=0x7fe948048000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 msgr2=0x55f80c871e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 --2- 172.21.15.165:0/2571089508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c86a8b0 0x55f80c871e40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe950049040 tx=0x7fe950022f30 comp rx=0 tx=0).stop 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 reap_dead start 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe94f770640 1 -- 172.21.15.165:0/2571089508 reap_dead start 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 shutdown_connections 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 >> 172.21.15.165:0/2571089508 conn(0x55f80c866cb0 msgr2=0x55f80c864ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 shutdown_connections 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/2571089508 wait complete. 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/3373851798 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 msgr2=0x7fe83003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 --2- 172.21.15.165:0/3373851798 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 0x7fe83003f470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55f80c844f40 tx=0x7fe94801c790 comp rx=0 tx=0).stop 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/3373851798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c85de10 msgr2=0x55f80c85e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 --2- 172.21.15.165:0/3373851798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c85de10 0x55f80c85e230 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe95000a2a0 tx=0x7fe950018830 comp rx=0 tx=0).stop 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/3373851798 shutdown_connections 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 --2- 172.21.15.165:0/3373851798 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 0x7fe83003f470 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 --2- 172.21.15.165:0/3373851798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c85de10 0x55f80c85e230 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/3373851798 >> 172.21.15.165:0/3373851798 conn(0x55f80c8521c0 msgr2=0x55f80c8525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/3373851798 shutdown_connections 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.575+0000 7fe95a487800 1 -- 172.21.15.165:0/3373851798 wait complete. 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c74dc50 msgr2=0x55f80c84a4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c74dc50 0x55f80c84a4a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c84c880 msgr2=0x55f80c84ed00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c84c880 0x55f80c84ed00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 msgr2=0x7fe84003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 0x7fe84003f4c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe940057000 tx=0x7fe940052000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 msgr2=0x55f80c842e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c842e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f80c749400 tx=0x7fe948000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 shutdown_connections 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f80c84c880 0x55f80c84ed00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f80c74dc50 0x55f80c84a4a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 0x7fe84003f4c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 --2- 172.21.15.165:0/953624866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f80c74a140 0x55f80c842e50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 >> 172.21.15.165:0/953624866 conn(0x55f80c743c00 msgr2=0x55f80c834610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 shutdown_connections 2024-09-22T08:11:03.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.576+0000 7fe95a487800 1 -- 172.21.15.165:0/953624866 wait complete. 2024-09-22T08:11:03.585 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:03.585 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-22T08:11:03.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-22T08:11:03.586 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-22T08:11:03.634 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:03.634 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:03.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.634+0000 7f7146f2a800 1 Processor -- start 2024-09-22T08:11:03.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.634+0000 7f7146f2a800 1 -- start start 2024-09-22T08:11:03.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.634+0000 7f7146f2a800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562605a30c20 0x562605a330e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.634+0000 7f7146f2a800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626058b5a20 con 0x56260599e550 2024-09-22T08:11:03.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.634+0000 7f7146f2a800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5626058b57d0 con 0x562605a30c20 2024-09-22T08:11:03.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.635+0000 7f714244e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562605a30c20 0x562605a330e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.635+0000 7f7142c4f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56260599e550 0x562605a2f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33472/0 (socket says 172.21.15.165:33472) 2024-09-22T08:11:03.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.635+0000 7f7142c4f640 1 -- 172.21.15.165:0/2801158968 learned_addr learned my addr 172.21.15.165:0/2801158968 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:03.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.635+0000 7f714244e640 1 -- 172.21.15.165:0/2801158968 >> v1:172.21.15.53:6789/0 conn(0x56260599e550 legacy=0x562605a2f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.635+0000 7f714244e640 1 -- 172.21.15.165:0/2801158968 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562605a347f0 con 0x562605a30c20 2024-09-22T08:11:03.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.637+0000 7f714244e640 1 --2- 172.21.15.165:0/2801158968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 0x562605a330e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f713800a470 tx=0x7f7138045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608b26581cd9c8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.637+0000 7f7141c4d640 1 -- 172.21.15.165:0/2801158968 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7138053570 con 0x562605a30c20 2024-09-22T08:11:03.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.637+0000 7f7141c4d640 1 -- 172.21.15.165:0/2801158968 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7138058070 con 0x562605a30c20 2024-09-22T08:11:03.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.637+0000 7f7141c4d640 1 -- 172.21.15.165:0/2801158968 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7138053880 con 0x562605a30c20 2024-09-22T08:11:03.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.637+0000 7f7146f2a800 1 -- 172.21.15.165:0/2801158968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 msgr2=0x562605a330e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.637+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2801158968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 0x562605a330e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f713800a470 tx=0x7f7138045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:03.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.638+0000 7f7146f2a800 1 -- 172.21.15.165:0/2801158968 shutdown_connections 2024-09-22T08:11:03.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.638+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2801158968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 0x562605a330e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.638+0000 7f7146f2a800 1 -- 172.21.15.165:0/2801158968 >> 172.21.15.165:0/2801158968 conn(0x562605a24c00 msgr2=0x562605a27040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.638+0000 7f7146f2a800 1 -- 172.21.15.165:0/2801158968 shutdown_connections 2024-09-22T08:11:03.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.638+0000 7f7146f2a800 1 -- 172.21.15.165:0/2801158968 wait complete. 2024-09-22T08:11:03.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.651+0000 7f7146f2a800 1 Processor -- start 2024-09-22T08:11:03.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.652+0000 7f7146f2a800 1 -- start start 2024-09-22T08:11:03.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.652+0000 7f7146f2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260599e550 0x562605b1c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.652+0000 7f7146f2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626058c2dd0 con 0x56260599e550 2024-09-22T08:11:03.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.652+0000 7f7142c4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260599e550 0x562605b1c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.652+0000 7f7142c4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260599e550 0x562605b1c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50778/0 (socket says 172.21.15.165:50778) 2024-09-22T08:11:03.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.652+0000 7f7142c4f640 1 -- 172.21.15.165:0/2023304045 learned_addr learned my addr 172.21.15.165:0/2023304045 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.652+0000 7f7142c4f640 1 -- 172.21.15.165:0/2023304045 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562605b1c7e0 con 0x56260599e550 2024-09-22T08:11:03.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.653+0000 7f7142c4f640 1 --2- 172.21.15.165:0/2023304045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260599e550 0x562605b1c1f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7134001e40 tx=0x7f7134001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e40a9ceb597180e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.653+0000 7f7030e09640 1 -- 172.21.15.165:0/2023304045 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7134012020 con 0x56260599e550 2024-09-22T08:11:03.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.653+0000 7f7030e09640 1 -- 172.21.15.165:0/2023304045 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713400e5a0 con 0x56260599e550 2024-09-22T08:11:03.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.653+0000 7f7030e09640 1 -- 172.21.15.165:0/2023304045 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713400e8a0 con 0x56260599e550 2024-09-22T08:11:03.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.653+0000 7f7146f2a800 1 -- 172.21.15.165:0/2023304045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260599e550 msgr2=0x562605b1c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.653+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2023304045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260599e550 0x562605b1c1f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7134001e40 tx=0x7f7134001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:03.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.653+0000 7f7146f2a800 1 -- 172.21.15.165:0/2023304045 shutdown_connections 2024-09-22T08:11:03.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.653+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2023304045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56260599e550 0x562605b1c1f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.653+0000 7f7146f2a800 1 -- 172.21.15.165:0/2023304045 >> 172.21.15.165:0/2023304045 conn(0x562605a24c00 msgr2=0x562605b17b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.654+0000 7f7146f2a800 1 -- 172.21.15.165:0/2023304045 shutdown_connections 2024-09-22T08:11:03.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.654+0000 7f7146f2a800 1 -- 172.21.15.165:0/2023304045 wait complete. 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.654+0000 7f7146f2a800 1 Processor -- start 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.654+0000 7f7146f2a800 1 -- start start 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.654+0000 7f7146f2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 0x562605b23f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.654+0000 7f7146f2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562605a33a90 con 0x562605a30c20 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.654+0000 7f7142c4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 0x562605b23f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.654+0000 7f7142c4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 0x562605b23f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50780/0 (socket says 172.21.15.165:50780) 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.654+0000 7f7142c4f640 1 -- 172.21.15.165:0/4140572204 learned_addr learned my addr 172.21.15.165:0/4140572204 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.655+0000 7f7142c4f640 1 -- 172.21.15.165:0/4140572204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562605b244f0 con 0x562605a30c20 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.655+0000 7f7142c4f640 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 0x562605b23f90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f713400c010 tx=0x7f7134000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.655+0000 7f702f606640 1 -- 172.21.15.165:0/4140572204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7134012030 con 0x562605a30c20 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.655+0000 7f702f606640 1 -- 172.21.15.165:0/4140572204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71340014a0 con 0x562605a30c20 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.655+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562605b24780 con 0x562605a30c20 2024-09-22T08:11:03.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.655+0000 7f702f606640 1 -- 172.21.15.165:0/4140572204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713401a700 con 0x562605a30c20 2024-09-22T08:11:03.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.655+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562605b25180 con 0x562605a30c20 2024-09-22T08:11:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.656+0000 7f702f606640 1 -- 172.21.15.165:0/4140572204 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7134015020 con 0x562605a30c20 2024-09-22T08:11:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.656+0000 7f702f606640 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f702803d000 0x7f702803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.656+0000 7f702f606640 1 -- 172.21.15.165:0/4140572204 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7134020030 con 0x562605a30c20 2024-09-22T08:11:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.656+0000 7f714244e640 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f702803d000 0x7f702803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.656+0000 7f7146f2a800 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b25c80 0x562605b2b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.656+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b2bb20 con 0x562605b25c80 2024-09-22T08:11:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.657+0000 7f7143450640 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b25c80 0x562605b2b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.657+0000 7f714244e640 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f702803d000 0x7f702803f4c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7138057000 tx=0x7f7138052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.657+0000 7f7143450640 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b25c80 0x562605b2b5e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.657+0000 7f7143450640 1 -- 172.21.15.165:0/4140572204 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f713c00a4d0 con 0x562605b25c80 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.657+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b25630 con 0x562605b25c80 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.657+0000 7f7143450640 1 -- 172.21.15.165:0/4140572204 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f713c00a4d0 con 0x562605b25c80 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.657+0000 7f7146f2a800 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b2de50 0x562605b30240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.657+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b30910 con 0x562605b2de50 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.658+0000 7f7142c4f640 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b2de50 0x562605b30240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.658+0000 7f7142c4f640 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b2de50 0x562605b30240 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.658+0000 7f7142c4f640 1 -- 172.21.15.165:0/4140572204 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f71340187b0 con 0x562605b2de50 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.658+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b2ccf0 con 0x562605b25c80 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.658+0000 7f7143450640 1 -- 172.21.15.165:0/4140572204 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f713c00a4d0 con 0x562605b25c80 2024-09-22T08:11:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.658+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b2d170 con 0x562605b25c80 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.659+0000 7f7143450640 1 -- 172.21.15.165:0/4140572204 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f713c00a4d0 con 0x562605b25c80 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.659+0000 7f7146f2a800 1 Processor -- start 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.659+0000 7f7146f2a800 1 -- start start 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.659+0000 7f7146f2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b3f280 0x562605b3f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.659+0000 7f7146f2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562605921d50 con 0x562605b3f280 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.659+0000 7f7143450640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b3f280 0x562605b3f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.660+0000 7f7143450640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b3f280 0x562605b3f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50794/0 (socket says 172.21.15.165:50794) 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.660+0000 7f7143450640 1 -- 172.21.15.165:0/18045059 learned_addr learned my addr 172.21.15.165:0/18045059 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.660+0000 7f7143450640 1 -- 172.21.15.165:0/18045059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562605b3fce0 con 0x562605b3f280 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.660+0000 7f7143450640 1 --2- 172.21.15.165:0/18045059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b3f280 0x562605b3f6a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x562605b2bf00 tx=0x7f713c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.660+0000 7f702ce01640 1 -- 172.21.15.165:0/18045059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c014450 con 0x562605b3f280 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.660+0000 7f702ce01640 1 -- 172.21.15.165:0/18045059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c0145f0 con 0x562605b3f280 2024-09-22T08:11:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.660+0000 7f702ce01640 1 -- 172.21.15.165:0/18045059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c014910 con 0x562605b3f280 2024-09-22T08:11:03.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.660+0000 7f7146f2a800 1 -- 172.21.15.165:0/18045059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562605b40510 con 0x562605b3f280 2024-09-22T08:11:03.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.660+0000 7f7146f2a800 1 -- 172.21.15.165:0/18045059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562605b40ab0 con 0x562605b3f280 2024-09-22T08:11:03.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.661+0000 7f702ce01640 1 -- 172.21.15.165:0/18045059 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f713c011040 con 0x562605b3f280 2024-09-22T08:11:03.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.661+0000 7f702ce01640 1 --2- 172.21.15.165:0/18045059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f701c03d000 0x7f701c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.661+0000 7f702ce01640 1 -- 172.21.15.165:0/18045059 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f713c01e070 con 0x562605b3f280 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.661+0000 7f7142c4f640 1 --2- 172.21.15.165:0/18045059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f701c03d000 0x7f701c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.662+0000 7f7146f2a800 1 Processor -- start 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.662+0000 7f7142c4f640 1 --2- 172.21.15.165:0/18045059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f701c03d000 0x7f701c03f4c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x562605b2bfa0 tx=0x7f7134018f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.662+0000 7f7146f2a800 1 -- start start 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.662+0000 7f7146f2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b4c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.662+0000 7f7146f2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562605b1cc10 con 0x562605b4bcc0 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.662+0000 7f7143450640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b4c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.662+0000 7f7143450640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b4c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50808/0 (socket says 172.21.15.165:50808) 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.662+0000 7f7143450640 1 -- 172.21.15.165:0/2284214293 learned_addr learned my addr 172.21.15.165:0/2284214293 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.662+0000 7f7143450640 1 -- 172.21.15.165:0/2284214293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562605b4c6b0 con 0x562605b4bcc0 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.662+0000 7f7143450640 1 --2- 172.21.15.165:0/2284214293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b4c0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f713c054760 tx=0x7f713c016c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace04478bbe1fe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f70267fc640 1 -- 172.21.15.165:0/2284214293 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c04b070 con 0x562605b4bcc0 2024-09-22T08:11:03.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f70267fc640 1 -- 172.21.15.165:0/2284214293 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c051070 con 0x562605b4bcc0 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f70267fc640 1 -- 172.21.15.165:0/2284214293 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c011da0 con 0x562605b4bcc0 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f7146f2a800 1 -- 172.21.15.165:0/2284214293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 msgr2=0x562605b4c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2284214293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b4c0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f713c054760 tx=0x7f713c016c80 comp rx=0 tx=0).stop 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f7146f2a800 1 -- 172.21.15.165:0/2284214293 shutdown_connections 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2284214293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b4c0c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f7146f2a800 1 -- 172.21.15.165:0/2284214293 >> 172.21.15.165:0/2284214293 conn(0x562605b480c0 msgr2=0x562605b46300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f7146f2a800 1 -- 172.21.15.165:0/2284214293 shutdown_connections 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f7146f2a800 1 -- 172.21.15.165:0/2284214293 wait complete. 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f7146f2a800 1 Processor -- start 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.663+0000 7f7146f2a800 1 -- start start 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7146f2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b53290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7146f2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562605b4ccd0 con 0x562605b4bcc0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7143450640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b53290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7143450640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b53290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50818/0 (socket says 172.21.15.165:50818) 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 learned_addr learned my addr 172.21.15.165:0/2676388522 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562605b537f0 con 0x562605b4bcc0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7143450640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b53290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f713c049040 tx=0x7f713c0546f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7024ff9640 1 -- 172.21.15.165:0/2676388522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c04b040 con 0x562605b4bcc0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7024ff9640 1 -- 172.21.15.165:0/2676388522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c0168f0 con 0x562605b4bcc0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562605b53a80 con 0x562605b4bcc0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7024ff9640 1 -- 172.21.15.165:0/2676388522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f713c011460 con 0x562605b4bcc0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.664+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562605b54400 con 0x562605b4bcc0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.665+0000 7f7024ff9640 1 -- 172.21.15.165:0/2676388522 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f713c056070 con 0x562605b4bcc0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.665+0000 7f7024ff9640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f700c03cfb0 0x7f700c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.665+0000 7f7024ff9640 1 -- 172.21.15.165:0/2676388522 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f713c00e040 con 0x562605b4bcc0 2024-09-22T08:11:03.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.665+0000 7f7142c4f640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f700c03cfb0 0x7f700c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.666+0000 7f7142c4f640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f700c03cfb0 0x7f700c03f470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f713401af90 tx=0x7f713404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.666+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.666+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b5ed70 0x562605b61230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.666+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b61980 con 0x562605b5ed70 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.666+0000 7f714244e640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b5ed70 0x562605b61230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.666+0000 7f714244e640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b5ed70 0x562605b61230 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 20 realm 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b61db0 con 0x562605b5ed70 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b62680 con 0x562605b5ed70 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b62a20 con 0x562605b5ed70 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b63780 0x562605b65b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.667+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b66180 con 0x562605b63780 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.668+0000 7f7143450640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b63780 0x562605b65b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.668+0000 7f7143450640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b63780 0x562605b65b70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.668+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.668+0000 7f7146f2a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.668+0000 7f7146f2a800 20 searching for the correct realm 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.668+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562605b68130 0x562605b6a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.668+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b68130 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.668+0000 7f7142c4f640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562605b68130 0x562605b6a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.668+0000 7f7142c4f640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562605b68130 0x562605b6a5f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.669+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.669+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b63780 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.669+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.669+0000 7f7143450640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f713c037020 0x7f713c04d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.669+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x7f713c037020 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.669+0000 7f714244e640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f713c037020 0x7f713c04d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.669+0000 7f714244e640 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f713c037020 0x7f713c04d260 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.670+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.670+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b5ed70 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.670+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.670+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b5ed70 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.670+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.670+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x7f713c037020 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.670+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.670+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x7f713c037020 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.671+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.671+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b63780 2024-09-22T08:11:03.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.671+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.671+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b68130 2024-09-22T08:11:03.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.671+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.671+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b5ed70 2024-09-22T08:11:03.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.671+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.671+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x7f713c037020 2024-09-22T08:11:03.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.672+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.672+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b5ed70 2024-09-22T08:11:03.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.672+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.672+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b63780 2024-09-22T08:11:03.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.672+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.672+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b68130 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.672+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.672+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b68130 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.672+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.672+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x7f713c037020 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.673+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.673+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b68130 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.673+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.673+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b68130 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.673+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.673+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b5ed70 2024-09-22T08:11:03.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.673+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.673+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b5ed70 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.674+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.674+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x7f713c037020 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.674+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.674+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b68130 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.674+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.674+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b63780 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.674+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.674+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b5ed70 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.675+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.675+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x7f713c037020 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.675+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.675+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b68130 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.676+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.676+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x7f713c037020 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.676+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.676+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b63780 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.676+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.676+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b68130 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.676+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.676+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x7f713c037020 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b5ed70 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562605b6ac70 con 0x562605b63780 2024-09-22T08:11:03.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b66b70 con 0x562605b5ed70 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.677+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b67410 con 0x562605b5ed70 2024-09-22T08:11:03.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b6b0f0 con 0x562605b5ed70 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 20 zone default found 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 4 Realm: () 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 20 zonegroup default 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b6b4f0 con 0x7f713c037020 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b6d320 con 0x562605b68130 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.678+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.679+0000 7f7146f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.679+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.679+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b6d800 con 0x562605b68130 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.679+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.679+0000 7f7146f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.679+0000 7f7146f2a800 20 started sync module instance, tier type = 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.679+0000 7f7146f2a800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:03.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.679+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b6c7c0 con 0x562605b63780 2024-09-22T08:11:03.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.680+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.680+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94721304611760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b6e110 con 0x562605b63780 2024-09-22T08:11:03.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.680+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b6e960 con 0x562605b5ed70 2024-09-22T08:11:03.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.683+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.683+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94721304617232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b6eb20 con 0x562605b5ed70 2024-09-22T08:11:03.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.683+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b6f620 con 0x562605b68130 2024-09-22T08:11:03.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.683+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94721304611760] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.685+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94721304617232] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.685+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.685+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94721304621328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b6e570 con 0x562605b68130 2024-09-22T08:11:03.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.685+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b70060 con 0x562605b63780 2024-09-22T08:11:03.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.688+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94721304621328] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.688+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.688+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94721304624048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b70480 con 0x562605b63780 2024-09-22T08:11:03.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.688+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b70d50 con 0x562605b5ed70 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.691+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.691+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94721304626304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b708e0 con 0x562605b5ed70 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.691+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b71d00 con 0x7f713c037020 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.691+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94721304624048] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.692+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94721304626304] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.694+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.694+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94721304625104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b71810 con 0x7f713c037020 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.694+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b725a0 con 0x7f713c037020 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.695+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.695+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94721304633584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b71810 con 0x7f713c037020 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.695+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b73110 con 0x7f713c037020 2024-09-22T08:11:03.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.696+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94721304625104] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.696+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94721304633584] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.696+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.696+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94721304634640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b710f0 con 0x7f713c037020 2024-09-22T08:11:03.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.697+0000 7f7146f2a800 20 add_watcher() i=0 2024-09-22T08:11:03.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.697+0000 7f7146f2a800 20 add_watcher() i=1 2024-09-22T08:11:03.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.697+0000 7f7146f2a800 20 add_watcher() i=2 2024-09-22T08:11:03.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.697+0000 7f7146f2a800 20 add_watcher() i=3 2024-09-22T08:11:03.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.697+0000 7f7146f2a800 20 add_watcher() i=4 2024-09-22T08:11:03.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.697+0000 7f7146f2a800 20 add_watcher() i=5 2024-09-22T08:11:03.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.697+0000 7f7146f2a800 20 add_watcher() i=6 2024-09-22T08:11:03.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.700+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94721304634640] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.700+0000 7f7146f2a800 20 add_watcher() i=7 2024-09-22T08:11:03.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.700+0000 7f7146f2a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:03.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.700+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605b76100 con 0x562605b5ed70 2024-09-22T08:11:03.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.701+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.701+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94721304636384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b735f0 con 0x562605b5ed70 2024-09-22T08:11:03.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.702+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94721304636384] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.702+0000 7f6ff97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.702+0000 7f7146f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:03.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.702+0000 7f7146f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:03.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.702+0000 7f7146f2a800 5 note: GC not initialized 2024-09-22T08:11:03.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.702+0000 7f6f73fff640 20 reqs_thread_entry: start 2024-09-22T08:11:03.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.703+0000 7f7146f2a800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.703+0000 7f7146f2a800 20 Filter name: none 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.703+0000 7f6f71ffb640 20 reqs_thread_entry: start 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.703+0000 7f7146f2a800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.703+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.703+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605ba93e0 con 0x7f713c037020 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.703+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605ba7940 con 0x562605b5ed70 2024-09-22T08:11:03.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 20 rados_obj.operate() r=0 bl.length=7 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562605ba7d30 con 0x562605b5ed70 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.704+0000 7f7146f2a800 20 get_user_info_from_index found 0 xattrs 2024-09-22T08:11:03.707 INFO:teuthology.orchestra.run.smithi165.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-22T08:11:03.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.705+0000 7f6ff97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.705+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94721304636384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b5b930 con 0x562605b5ed70 2024-09-22T08:11:03.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.706+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94721304636384] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.706+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94721304611760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b72be0 con 0x562605b63780 2024-09-22T08:11:03.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.707+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94721304611760] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.707+0000 7f7146f2a800 20 remove_watcher() i=0 2024-09-22T08:11:03.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.707+0000 7f7146f2a800 2 removed watcher, disabling cache 2024-09-22T08:11:03.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.707+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94721304617232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b72be0 con 0x562605b5ed70 2024-09-22T08:11:03.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.708+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94721304617232] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.708+0000 7f7146f2a800 20 remove_watcher() i=1 2024-09-22T08:11:03.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.708+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94721304621328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b6e110 con 0x562605b68130 2024-09-22T08:11:03.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.709+0000 7f7142c4f640 1 -- 172.21.15.165:0/2676388522 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94721304621328] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71340187b0 con 0x562605b68130 2024-09-22T08:11:03.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.709+0000 7f7146f2a800 20 remove_watcher() i=2 2024-09-22T08:11:03.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.709+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94721304624048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b72be0 con 0x562605b63780 2024-09-22T08:11:03.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.710+0000 7f7143450640 1 -- 172.21.15.165:0/2676388522 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94721304624048] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f713c03e070 con 0x562605b63780 2024-09-22T08:11:03.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.710+0000 7f7146f2a800 20 remove_watcher() i=3 2024-09-22T08:11:03.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.711+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94721304626304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b6f110 con 0x562605b5ed70 2024-09-22T08:11:03.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.712+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94721304626304] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x562605b5ed70 2024-09-22T08:11:03.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.712+0000 7f7146f2a800 20 remove_watcher() i=4 2024-09-22T08:11:03.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.712+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94721304625104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b6fbb0 con 0x7f713c037020 2024-09-22T08:11:03.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.713+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94721304625104] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.713+0000 7f7146f2a800 20 remove_watcher() i=5 2024-09-22T08:11:03.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.713+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94721304633584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b72be0 con 0x7f713c037020 2024-09-22T08:11:03.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.714+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94721304633584] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.714+0000 7f7146f2a800 20 remove_watcher() i=6 2024-09-22T08:11:03.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.714+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94721304634640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562605b72be0 con 0x7f713c037020 2024-09-22T08:11:03.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94721304634640] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7138051070 con 0x7f713c037020 2024-09-22T08:11:03.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 20 remove_watcher() i=7 2024-09-22T08:11:03.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f713c037020 msgr2=0x7f713c04d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f713c037020 0x7f713c04d260 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b5ed70 msgr2=0x562605b61230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b5ed70 0x562605b61230 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b63780 msgr2=0x562605b65b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b63780 0x562605b65b70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562605b68130 msgr2=0x562605b6a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562605b68130 0x562605b6a5f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f700c03cfb0 msgr2=0x7f700c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f700c03cfb0 0x7f700c03f470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f713401af90 tx=0x7f713404e000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 msgr2=0x562605b53290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f714244e640 1 -- 172.21.15.165:0/2676388522 reap_dead start 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b53290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f713c049040 tx=0x7f713c0546f0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 shutdown_connections 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 --2- 172.21.15.165:0/2676388522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b4bcc0 0x562605b53290 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 >> 172.21.15.165:0/2676388522 conn(0x562605b480c0 msgr2=0x562605b462d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 shutdown_connections 2024-09-22T08:11:03.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.715+0000 7f7146f2a800 1 -- 172.21.15.165:0/2676388522 wait complete. 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/18045059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f701c03d000 msgr2=0x7f701c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/18045059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f701c03d000 0x7f701c03f4c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x562605b2bfa0 tx=0x7f7134018f00 comp rx=0 tx=0).stop 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/18045059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b3f280 msgr2=0x562605b3f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/18045059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b3f280 0x562605b3f6a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x562605b2bf00 tx=0x7f713c018830 comp rx=0 tx=0).stop 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/18045059 shutdown_connections 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/18045059 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f701c03d000 0x7f701c03f4c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/18045059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605b3f280 0x562605b3f6a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/18045059 >> 172.21.15.165:0/18045059 conn(0x562605b33630 msgr2=0x562605b33a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/18045059 shutdown_connections 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/18045059 wait complete. 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b25c80 msgr2=0x562605b2b5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b25c80 0x562605b2b5e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b2de50 msgr2=0x562605b30240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b2de50 0x562605b30240 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f702803d000 msgr2=0x7f702803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f702803d000 0x7f702803f4c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7138057000 tx=0x7f7138052000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 msgr2=0x562605b23f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 0x562605b23f90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f713400c010 tx=0x7f7134000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 shutdown_connections 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562605b2de50 0x562605b30240 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562605b25c80 0x562605b2b5e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f702803d000 0x7f702803f4c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 --2- 172.21.15.165:0/4140572204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562605a30c20 0x562605b23f90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 >> 172.21.15.165:0/4140572204 conn(0x562605a24c00 msgr2=0x562605b1d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 shutdown_connections 2024-09-22T08:11:03.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.716+0000 7f7146f2a800 1 -- 172.21.15.165:0/4140572204 wait complete. 2024-09-22T08:11:03.725 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-22T08:11:03.726 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:11:03.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:11:03.726 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:11:03.770 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:03.770 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:03.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.770+0000 7f1d1f330800 1 Processor -- start 2024-09-22T08:11:03.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.770+0000 7f1d1f330800 1 -- start start 2024-09-22T08:11:03.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.770+0000 7f1d1f330800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56134c9e5c00 0x56134c9e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.770+0000 7f1d1f330800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56134c86ca20 con 0x56134c9e20f0 2024-09-22T08:11:03.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.770+0000 7f1d1f330800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56134c86c7d0 con 0x56134c9e5c00 2024-09-22T08:11:03.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.770+0000 7f1d1a8af640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56134c9e5c00 0x56134c9e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.771+0000 7f1d1b0b0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56134c9e20f0 0x56134c9e44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33474/0 (socket says 172.21.15.165:33474) 2024-09-22T08:11:03.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.771+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/3045534386 learned_addr learned my addr 172.21.15.165:0/3045534386 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:03.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.771+0000 7f1d1a8af640 1 -- 172.21.15.165:0/3045534386 >> v1:172.21.15.53:6789/0 conn(0x56134c9e20f0 legacy=0x56134c9e44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.771+0000 7f1d1a8af640 1 -- 172.21.15.165:0/3045534386 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134c9e9570 con 0x56134c9e5c00 2024-09-22T08:11:03.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.771+0000 7f1d1a0ae640 1 -- 172.21.15.165:0/3045534386 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079704837 0 0) 0x56134c86ca20 con 0x56134c9e20f0 2024-09-22T08:11:03.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1a8af640 1 --2- 172.21.15.165:0/3045534386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e5c00 0x56134c9e7ff0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000a470 tx=0x7f1d10045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957199c2d487a034 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1a0ae640 1 -- 172.21.15.165:0/3045534386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d10053570 con 0x56134c9e5c00 2024-09-22T08:11:03.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1a0ae640 1 -- 172.21.15.165:0/3045534386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d10058070 con 0x56134c9e5c00 2024-09-22T08:11:03.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1a0ae640 1 -- 172.21.15.165:0/3045534386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d10053880 con 0x56134c9e5c00 2024-09-22T08:11:03.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1f330800 1 -- 172.21.15.165:0/3045534386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e5c00 msgr2=0x56134c9e7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1f330800 1 --2- 172.21.15.165:0/3045534386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e5c00 0x56134c9e7ff0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000a470 tx=0x7f1d10045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:03.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1f330800 1 -- 172.21.15.165:0/3045534386 shutdown_connections 2024-09-22T08:11:03.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1f330800 1 --2- 172.21.15.165:0/3045534386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e5c00 0x56134c9e7ff0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1f330800 1 -- 172.21.15.165:0/3045534386 >> 172.21.15.165:0/3045534386 conn(0x56134c9dbbb0 msgr2=0x56134c9de010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1f330800 1 -- 172.21.15.165:0/3045534386 shutdown_connections 2024-09-22T08:11:03.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.773+0000 7f1d1f330800 1 -- 172.21.15.165:0/3045534386 wait complete. 2024-09-22T08:11:03.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.787+0000 7f1d1f330800 1 Processor -- start 2024-09-22T08:11:03.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.787+0000 7f1d1f330800 1 -- start start 2024-09-22T08:11:03.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.787+0000 7f1d1f330800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134cad0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.787+0000 7f1d1f330800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56134c879dd0 con 0x56134c9e20f0 2024-09-22T08:11:03.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.788+0000 7f1d1b0b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134cad0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.788+0000 7f1d1b0b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134cad0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50834/0 (socket says 172.21.15.165:50834) 2024-09-22T08:11:03.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.788+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/3651464026 learned_addr learned my addr 172.21.15.165:0/3651464026 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.788+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/3651464026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134cad1480 con 0x56134c9e20f0 2024-09-22T08:11:03.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.788+0000 7f1d1b0b0640 1 --2- 172.21.15.165:0/3651464026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134cad0e90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c001ea0 tx=0x7f1d0c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d955c563b6ebd91 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.788+0000 7f1c0960a640 1 -- 172.21.15.165:0/3651464026 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c008070 con 0x56134c9e20f0 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.788+0000 7f1c0960a640 1 -- 172.21.15.165:0/3651464026 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0c00d500 con 0x56134c9e20f0 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.788+0000 7f1c0960a640 1 -- 172.21.15.165:0/3651464026 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c00d880 con 0x56134c9e20f0 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 -- 172.21.15.165:0/3651464026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 msgr2=0x56134cad0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 --2- 172.21.15.165:0/3651464026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134cad0e90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c001ea0 tx=0x7f1d0c00b6a0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 -- 172.21.15.165:0/3651464026 shutdown_connections 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 --2- 172.21.15.165:0/3651464026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134cad0e90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 -- 172.21.15.165:0/3651464026 >> 172.21.15.165:0/3651464026 conn(0x56134c9dbbb0 msgr2=0x56134cacc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 -- 172.21.15.165:0/3651464026 shutdown_connections 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 -- 172.21.15.165:0/3651464026 wait complete. 2024-09-22T08:11:03.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 Processor -- start 2024-09-22T08:11:03.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 -- start start 2024-09-22T08:11:03.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134c9e1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.789+0000 7f1d1f330800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56134c9e8830 con 0x56134c9e20f0 2024-09-22T08:11:03.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.790+0000 7f1d1b0b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134c9e1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.790+0000 7f1d1b0b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134c9e1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50850/0 (socket says 172.21.15.165:50850) 2024-09-22T08:11:03.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.790+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1202732435 learned_addr learned my addr 172.21.15.165:0/1202732435 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.790+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1202732435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134c9e1d70 con 0x56134c9e20f0 2024-09-22T08:11:03.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.790+0000 7f1d1b0b0640 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134c9e1810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0012f0 tx=0x7f1d0c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.790+0000 7f1c07e07640 1 -- 172.21.15.165:0/1202732435 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c00f9d0 con 0x56134c9e20f0 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.790+0000 7f1c07e07640 1 -- 172.21.15.165:0/1202732435 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0c00fb70 con 0x56134c9e20f0 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.790+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56134c9e0120 con 0x56134c9e20f0 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.790+0000 7f1c07e07640 1 -- 172.21.15.165:0/1202732435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c00fe50 con 0x56134c9e20f0 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.791+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134c9e06e0 con 0x56134c9e20f0 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.791+0000 7f1c07e07640 1 -- 172.21.15.165:0/1202732435 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1d0c017040 con 0x56134c9e20f0 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.792+0000 7f1c07e07640 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1c0003d1a0 0x7f1c0003f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.792+0000 7f1c07e07640 1 -- 172.21.15.165:0/1202732435 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1d0c015020 con 0x56134c9e20f0 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.792+0000 7f1d1a8af640 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1c0003d1a0 0x7f1c0003f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.792+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134c9e5c00 0x56134cae1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.792+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cae23e0 con 0x56134c9e5c00 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.792+0000 7f1d1b8b1640 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134c9e5c00 0x56134cae1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.792+0000 7f1d1a8af640 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1c0003d1a0 0x7f1c0003f660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d10057000 tx=0x7f1d10052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.792+0000 7f1d1b8b1640 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134c9e5c00 0x56134cae1ea0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.792+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1202732435 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d1400a4d0 con 0x56134c9e5c00 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.793+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134c9e0be0 con 0x56134c9e5c00 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.793+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1202732435 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d1400a4d0 con 0x56134c9e5c00 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.793+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cae4730 0x56134cae6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.793+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cae71f0 con 0x56134cae4730 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.793+0000 7f1d1b0b0640 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cae4730 0x56134cae6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.793+0000 7f1d1b0b0640 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cae4730 0x56134cae6b20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.794+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1202732435 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cae4730 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.794+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cae35d0 con 0x56134c9e5c00 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.794+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1202732435 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d1400a4d0 con 0x56134c9e5c00 2024-09-22T08:11:03.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.794+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cae3a70 con 0x56134c9e5c00 2024-09-22T08:11:03.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.794+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1202732435 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d1400a4d0 con 0x56134c9e5c00 2024-09-22T08:11:03.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.794+0000 7f1d1f330800 1 Processor -- start 2024-09-22T08:11:03.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.795+0000 7f1d1f330800 1 -- start start 2024-09-22T08:11:03.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.795+0000 7f1d1f330800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134caf5bb0 0x56134caf5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.795+0000 7f1d1f330800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56134c8d8d50 con 0x56134caf5bb0 2024-09-22T08:11:03.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.795+0000 7f1d1b8b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134caf5bb0 0x56134caf5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.795+0000 7f1d1b8b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134caf5bb0 0x56134caf5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50858/0 (socket says 172.21.15.165:50858) 2024-09-22T08:11:03.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.795+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1087783451 learned_addr learned my addr 172.21.15.165:0/1087783451 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.795+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1087783451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134caf6610 con 0x56134caf5bb0 2024-09-22T08:11:03.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.795+0000 7f1d1b8b1640 1 --2- 172.21.15.165:0/1087783451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134caf5bb0 0x56134caf5fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56134cae27e0 tx=0x7f1d14018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.796+0000 7f1c05602640 1 -- 172.21.15.165:0/1087783451 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d14014450 con 0x56134caf5bb0 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.796+0000 7f1c05602640 1 -- 172.21.15.165:0/1087783451 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d140145f0 con 0x56134caf5bb0 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.796+0000 7f1d1f330800 1 -- 172.21.15.165:0/1087783451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56134caf6e40 con 0x56134caf5bb0 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.796+0000 7f1c05602640 1 -- 172.21.15.165:0/1087783451 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d14014910 con 0x56134caf5bb0 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.796+0000 7f1d1f330800 1 -- 172.21.15.165:0/1087783451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134caf73e0 con 0x56134caf5bb0 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.796+0000 7f1c05602640 1 -- 172.21.15.165:0/1087783451 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1d14011040 con 0x56134caf5bb0 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1c05602640 1 --2- 172.21.15.165:0/1087783451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1bf403d000 0x7f1bf403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1c05602640 1 -- 172.21.15.165:0/1087783451 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1d1401e070 con 0x56134caf5bb0 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1d1b0b0640 1 --2- 172.21.15.165:0/1087783451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1bf403d000 0x7f1bf403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1d1f330800 1 Processor -- start 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1d1f330800 1 -- start start 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1d1b0b0640 1 --2- 172.21.15.165:0/1087783451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1bf403d000 0x7f1bf403f4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x56134cae2880 tx=0x7f1d0c0011b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1d1f330800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb029a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1d1f330800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56134cad18b0 con 0x56134cb025a0 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1d1b8b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1d1b8b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb029a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50874/0 (socket says 172.21.15.165:50874) 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.797+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/318710096 learned_addr learned my addr 172.21.15.165:0/318710096 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.798+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/318710096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134cb02f90 con 0x56134cb025a0 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.798+0000 7f1d1b8b1640 1 --2- 172.21.15.165:0/318710096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb029a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d14016620 tx=0x7f1d14011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c392486c636b729 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.798+0000 7f1bfeffd640 1 -- 172.21.15.165:0/318710096 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d14051020 con 0x56134cb025a0 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.798+0000 7f1bfeffd640 1 -- 172.21.15.165:0/318710096 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d14022de0 con 0x56134cb025a0 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.798+0000 7f1bfeffd640 1 -- 172.21.15.165:0/318710096 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d14028070 con 0x56134cb025a0 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.798+0000 7f1d1f330800 1 -- 172.21.15.165:0/318710096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 msgr2=0x56134cb029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.798+0000 7f1d1f330800 1 --2- 172.21.15.165:0/318710096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb029a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d14016620 tx=0x7f1d14011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.798+0000 7f1d1f330800 1 -- 172.21.15.165:0/318710096 shutdown_connections 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.798+0000 7f1d1f330800 1 --2- 172.21.15.165:0/318710096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb029a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.798+0000 7f1d1f330800 1 -- 172.21.15.165:0/318710096 >> 172.21.15.165:0/318710096 conn(0x56134cafe9a0 msgr2=0x56134cafcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.799+0000 7f1d1f330800 1 -- 172.21.15.165:0/318710096 shutdown_connections 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.799+0000 7f1d1f330800 1 -- 172.21.15.165:0/318710096 wait complete. 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.799+0000 7f1d1f330800 1 Processor -- start 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.799+0000 7f1d1f330800 1 -- start start 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.799+0000 7f1d1f330800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb09b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.799+0000 7f1d1f330800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56134cb035b0 con 0x56134cb025a0 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.799+0000 7f1d1b8b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb09b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.799+0000 7f1d1b8b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb09b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50882/0 (socket says 172.21.15.165:50882) 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.799+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 learned_addr learned my addr 172.21.15.165:0/1042931274 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.799+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134cb0a0c0 con 0x56134cb025a0 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.800+0000 7f1d1b8b1640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb09b60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d14022f90 tx=0x7f1d140546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.800+0000 7f1bfd7fa640 1 -- 172.21.15.165:0/1042931274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d14031020 con 0x56134cb025a0 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.800+0000 7f1bfd7fa640 1 -- 172.21.15.165:0/1042931274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d14011330 con 0x56134cb025a0 2024-09-22T08:11:03.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.800+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56134cb0a350 con 0x56134cb025a0 2024-09-22T08:11:03.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.800+0000 7f1bfd7fa640 1 -- 172.21.15.165:0/1042931274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d140458e0 con 0x56134cb025a0 2024-09-22T08:11:03.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.800+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134cb0acd0 con 0x56134cb025a0 2024-09-22T08:11:03.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.801+0000 7f1bfd7fa640 1 -- 172.21.15.165:0/1042931274 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1d14034020 con 0x56134cb025a0 2024-09-22T08:11:03.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.801+0000 7f1bfd7fa640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1be403cfb0 0x7f1be403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.801+0000 7f1bfd7fa640 1 -- 172.21.15.165:0/1042931274 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1d1400e040 con 0x56134cb025a0 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.801+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.801+0000 7f1d1b0b0640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1be403cfb0 0x7f1be403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.801+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134cb15660 0x56134cb17af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.801+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb18240 con 0x56134cb15660 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.801+0000 7f1d1a8af640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134cb15660 0x56134cb17af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.801+0000 7f1d1b0b0640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1be403cfb0 0x7f1be403f470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0189e0 tx=0x7f1d0c027000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.801+0000 7f1d1a8af640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134cb15660 0x56134cb17af0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 20 realm 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb18670 con 0x56134cb15660 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb18f40 con 0x56134cb15660 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb192e0 con 0x56134cb15660 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cb1a040 0x56134cb1c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.802+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb1c970 con 0x56134cb1a040 2024-09-22T08:11:03.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.803+0000 7f1d1b8b1640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cb1a040 0x56134cb1c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.803+0000 7f1d1b8b1640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cb1a040 0x56134cb1c430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.803+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.803+0000 7f1d1f330800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.803+0000 7f1d1f330800 20 searching for the correct realm 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.803+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56134cb1e9b0 0x56134cb20e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.803+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1e9b0 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.803+0000 7f1d1b0b0640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56134cb1e9b0 0x56134cb20e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.803+0000 7f1d1b0b0640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56134cb1e9b0 0x56134cb20e70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.804+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.804+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1a040 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.804+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.804+0000 7f1d1b8b1640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1d14036020 0x7f1d1402ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.804+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x7f1d14036020 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.804+0000 7f1d1a8af640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1d14036020 0x7f1d1402ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.805+0000 7f1d1a8af640 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1d14036020 0x7f1d1402ca10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.805+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.805+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb15660 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.805+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.805+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb15660 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.805+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.805+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x7f1d14036020 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.806+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.806+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x7f1d14036020 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.806+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.806+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1a040 2024-09-22T08:11:03.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.806+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.806+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1e9b0 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.806+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.806+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb15660 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.807+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.807+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x7f1d14036020 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.807+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.807+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb15660 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.807+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.807+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1a040 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.807+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.807+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1e9b0 2024-09-22T08:11:03.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.808+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.808+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1e9b0 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.808+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.808+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x7f1d14036020 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.808+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.808+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1e9b0 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.808+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.808+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1e9b0 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.809+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.809+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb15660 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.809+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.809+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb15660 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.809+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.809+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x7f1d14036020 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.809+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.809+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1e9b0 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.810+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.810+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1a040 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.810+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.810+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb15660 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.810+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.810+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x7f1d14036020 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.810+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.810+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1e9b0 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.811+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.811+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x7f1d14036020 2024-09-22T08:11:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.811+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.811+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1a040 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.811+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.811+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1e9b0 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.811+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.811+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x7f1d14036020 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb15660 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56134cb21540 con 0x56134cb1a040 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1f330800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1f330800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:03.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1f330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1f330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1f330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1f330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb1d3b0 con 0x56134cb15660 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.812+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb1cfc0 con 0x56134cb15660 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb1dd20 con 0x56134cb15660 2024-09-22T08:11:03.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 20 zone default found 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 4 Realm: () 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 20 zonegroup default 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb1d830 con 0x7f1d14036020 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.813+0000 7f1d1f330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb23890 con 0x56134cb1e9b0 2024-09-22T08:11:03.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1f330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb23e20 con 0x56134cb1e9b0 2024-09-22T08:11:03.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1f330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1f330800 20 started sync module instance, tier type = 2024-09-22T08:11:03.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1f330800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:03.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.814+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb22cf0 con 0x56134cb1a040 2024-09-22T08:11:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.815+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.815+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94640891111488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb24280 con 0x56134cb1a040 2024-09-22T08:11:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.815+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb24c40 con 0x56134cb15660 2024-09-22T08:11:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.816+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94640891111488] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.816+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.816+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94640891113760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb24c40 con 0x56134cb15660 2024-09-22T08:11:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.816+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb25660 con 0x56134cb1e9b0 2024-09-22T08:11:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.817+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94640891113760] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.818+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.818+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94640891119504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb24bb0 con 0x56134cb1e9b0 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.818+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb26520 con 0x56134cb1a040 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.819+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94640891119504] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.819+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.819+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94640891125872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb26940 con 0x56134cb1a040 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.819+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb27340 con 0x56134cb15660 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.820+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.820+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94640891129424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb272d0 con 0x56134cb15660 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.820+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb282f0 con 0x7f1d14036020 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.821+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94640891125872] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.821+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94640891129424] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.821+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.821+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94640891126928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb274b0 con 0x7f1d14036020 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.821+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb28b90 con 0x7f1d14036020 2024-09-22T08:11:03.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.822+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94640891126928] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.823+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.823+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94640891133392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb274b0 con 0x7f1d14036020 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.823+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb291b0 con 0x7f1d14036020 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.824+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94640891133392] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.824+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.824+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94640891135632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb291b0 con 0x7f1d14036020 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.824+0000 7f1d1f330800 20 add_watcher() i=0 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.824+0000 7f1d1f330800 20 add_watcher() i=1 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.824+0000 7f1d1f330800 20 add_watcher() i=2 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.824+0000 7f1d1f330800 20 add_watcher() i=3 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.824+0000 7f1d1f330800 20 add_watcher() i=4 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.824+0000 7f1d1f330800 20 add_watcher() i=5 2024-09-22T08:11:03.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.824+0000 7f1d1f330800 20 add_watcher() i=6 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.825+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94640891135632] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.825+0000 7f1d1f330800 20 add_watcher() i=7 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.825+0000 7f1d1f330800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.825+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb2c6b0 con 0x56134cb15660 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.825+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.825+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94640891138208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb29a30 con 0x56134cb15660 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.827+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94640891138208] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.827+0000 7f1bd27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.827+0000 7f1d1f330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.827+0000 7f1d1f330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.828+0000 7f1d1f330800 5 note: GC not initialized 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.828+0000 7f1bd17e2640 20 reqs_thread_entry: start 2024-09-22T08:11:03.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.828+0000 7f1d1f330800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:03.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.828+0000 7f1d1f330800 20 Filter name: none 2024-09-22T08:11:03.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.828+0000 7f1bca7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:03.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.828+0000 7f1d1f330800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.828+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56134cb5f5d0 con 0x56134cb15660 2024-09-22T08:11:03.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.828+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.828+0000 7f1d1f330800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:03.835 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.829+0000 7f1bd27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.829+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94640891138208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb2b130 con 0x56134cb15660 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.830+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94640891138208] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.830+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94640891111488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb5d370 con 0x56134cb1a040 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.833+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94640891111488] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.833+0000 7f1d1f330800 20 remove_watcher() i=0 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.833+0000 7f1d1f330800 2 removed watcher, disabling cache 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.833+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94640891113760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb5d370 con 0x56134cb15660 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.834+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94640891113760] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.834+0000 7f1d1f330800 20 remove_watcher() i=1 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.834+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94640891119504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb5d370 con 0x56134cb1e9b0 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.836+0000 7f1d1b0b0640 1 -- 172.21.15.165:0/1042931274 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94640891119504] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c02d070 con 0x56134cb1e9b0 2024-09-22T08:11:03.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.836+0000 7f1d1f330800 20 remove_watcher() i=2 2024-09-22T08:11:03.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.836+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94640891125872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb22840 con 0x56134cb1a040 2024-09-22T08:11:03.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.837+0000 7f1d1b8b1640 1 -- 172.21.15.165:0/1042931274 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94640891125872] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d1402a070 con 0x56134cb1a040 2024-09-22T08:11:03.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.837+0000 7f1d1f330800 20 remove_watcher() i=3 2024-09-22T08:11:03.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.837+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94640891129424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb24790 con 0x56134cb15660 2024-09-22T08:11:03.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.838+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94640891129424] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x56134cb15660 2024-09-22T08:11:03.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.838+0000 7f1d1f330800 20 remove_watcher() i=4 2024-09-22T08:11:03.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.838+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94640891126928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb26070 con 0x7f1d14036020 2024-09-22T08:11:03.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.839+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94640891126928] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.839+0000 7f1d1f330800 20 remove_watcher() i=5 2024-09-22T08:11:03.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.839+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94640891133392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb22840 con 0x7f1d14036020 2024-09-22T08:11:03.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.840+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94640891133392] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.840+0000 7f1d1f330800 20 remove_watcher() i=6 2024-09-22T08:11:03.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.840+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94640891135632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56134cb26e50 con 0x7f1d14036020 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94640891135632] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10051070 con 0x7f1d14036020 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 20 remove_watcher() i=7 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1d14036020 msgr2=0x7f1d1402ca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1d14036020 0x7f1d1402ca10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134cb15660 msgr2=0x56134cb17af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134cb15660 0x56134cb17af0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cb1a040 msgr2=0x56134cb1c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cb1a040 0x56134cb1c430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56134cb1e9b0 msgr2=0x56134cb20e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56134cb1e9b0 0x56134cb20e70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1be403cfb0 msgr2=0x7f1be403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1be403cfb0 0x7f1be403f470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0189e0 tx=0x7f1d0c027000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 msgr2=0x56134cb09b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1a8af640 1 -- 172.21.15.165:0/1042931274 reap_dead start 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb09b60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d14022f90 tx=0x7f1d140546a0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 shutdown_connections 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1042931274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134cb025a0 0x56134cb09b60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 >> 172.21.15.165:0/1042931274 conn(0x56134cafe9a0 msgr2=0x56134cafcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 shutdown_connections 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.841+0000 7f1d1f330800 1 -- 172.21.15.165:0/1042931274 wait complete. 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1087783451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1bf403d000 msgr2=0x7f1bf403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1087783451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1bf403d000 0x7f1bf403f4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x56134cae2880 tx=0x7f1d0c0011b0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1087783451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134caf5bb0 msgr2=0x56134caf5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1087783451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134caf5bb0 0x56134caf5fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56134cae27e0 tx=0x7f1d14018830 comp rx=0 tx=0).stop 2024-09-22T08:11:03.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1087783451 shutdown_connections 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1087783451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1bf403d000 0x7f1bf403f4c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1087783451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134caf5bb0 0x56134caf5fd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1087783451 >> 172.21.15.165:0/1087783451 conn(0x56134cae9f60 msgr2=0x56134caea340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1087783451 shutdown_connections 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1087783451 wait complete. 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134c9e5c00 msgr2=0x56134cae1ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134c9e5c00 0x56134cae1ea0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cae4730 msgr2=0x56134cae6b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cae4730 0x56134cae6b20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1c0003d1a0 msgr2=0x7f1c0003f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1c0003d1a0 0x7f1c0003f660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d10057000 tx=0x7f1d10052000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 msgr2=0x56134c9e1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134c9e1810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0012f0 tx=0x7f1d0c000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 shutdown_connections 2024-09-22T08:11:03.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56134cae4730 0x56134cae6b20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56134c9e5c00 0x56134cae1ea0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1c0003d1a0 0x7f1c0003f660 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 --2- 172.21.15.165:0/1202732435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56134c9e20f0 0x56134c9e1810 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 >> 172.21.15.165:0/1202732435 conn(0x56134c9dbbb0 msgr2=0x56134cad2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 shutdown_connections 2024-09-22T08:11:03.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.842+0000 7f1d1f330800 1 -- 172.21.15.165:0/1202732435 wait complete. 2024-09-22T08:11:03.851 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:03.852 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-22T08:11:03.852 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-22T08:11:03.852 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-22T08:11:03.896 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:03.896 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:03.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.896+0000 7f76ad2bb800 1 Processor -- start 2024-09-22T08:11:03.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.896+0000 7f76ad2bb800 1 -- start start 2024-09-22T08:11:03.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.896+0000 7f76ad2bb800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562762027d10 0x5627620b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.896+0000 7f76ad2bb800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562761f3fa20 con 0x5627620b9a10 2024-09-22T08:11:03.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.896+0000 7f76ad2bb800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562761f3f7d0 con 0x562762027d10 2024-09-22T08:11:03.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.896+0000 7f76aada5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562762027d10 0x5627620b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.896+0000 7f76aada5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562762027d10 0x5627620b94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50890/0 (socket says 172.21.15.165:50890) 2024-09-22T08:11:03.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.896+0000 7f76aada5640 1 -- 172.21.15.165:0/3109862153 learned_addr learned my addr 172.21.15.165:0/3109862153 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.896+0000 7f76aa5a4640 1 --1- 172.21.15.165:0/3109862153 >> v1:172.21.15.53:6789/0 conn(0x5627620b9a10 0x5627620bbed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33486/0 (socket says 172.21.15.165:33486) 2024-09-22T08:11:03.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.897+0000 7f76aada5640 1 -- 172.21.15.165:0/3109862153 >> v1:172.21.15.53:6789/0 conn(0x5627620b9a10 legacy=0x5627620bbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.897+0000 7f76aada5640 1 -- 172.21.15.165:0/3109862153 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627620be7c0 con 0x562762027d10 2024-09-22T08:11:03.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.897+0000 7f76a9da3640 1 -- 172.21.15.165:0/3109862153 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554080541 0 0) 0x562761f3fa20 con 0x5627620b9a10 2024-09-22T08:11:03.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.898+0000 7f76aada5640 1 --2- 172.21.15.165:0/3109862153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627620b94a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f769c005fd0 tx=0x7f769c045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6084cf465c76677b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.899+0000 7f76a9da3640 1 -- 172.21.15.165:0/3109862153 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769c04e600 con 0x562762027d10 2024-09-22T08:11:03.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.899+0000 7f76a9da3640 1 -- 172.21.15.165:0/3109862153 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769c04e7a0 con 0x562762027d10 2024-09-22T08:11:03.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.899+0000 7f76a9da3640 1 -- 172.21.15.165:0/3109862153 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769c04eaa0 con 0x562762027d10 2024-09-22T08:11:03.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.899+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3109862153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 msgr2=0x5627620b94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.899+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3109862153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627620b94a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f769c005fd0 tx=0x7f769c045cf0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.899+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3109862153 shutdown_connections 2024-09-22T08:11:03.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.899+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3109862153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627620b94a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.899+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3109862153 >> 172.21.15.165:0/3109862153 conn(0x5627620aebb0 msgr2=0x5627620b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.899+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3109862153 shutdown_connections 2024-09-22T08:11:03.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.899+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3109862153 wait complete. 2024-09-22T08:11:03.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.913+0000 7f76ad2bb800 1 Processor -- start 2024-09-22T08:11:03.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.913+0000 7f76ad2bb800 1 -- start start 2024-09-22T08:11:03.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.913+0000 7f76ad2bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621a6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.913+0000 7f76ad2bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562761f4cdd0 con 0x562762027d10 2024-09-22T08:11:03.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.913+0000 7f76aada5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.913+0000 7f76aada5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621a6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50902/0 (socket says 172.21.15.165:50902) 2024-09-22T08:11:03.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.913+0000 7f76aada5640 1 -- 172.21.15.165:0/1788614984 learned_addr learned my addr 172.21.15.165:0/1788614984 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.913+0000 7f76aada5640 1 -- 172.21.15.165:0/1788614984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627621a6660 con 0x562762027d10 2024-09-22T08:11:03.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.914+0000 7f76aada5640 1 --2- 172.21.15.165:0/1788614984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621a6070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f769c005fd0 tx=0x7f769c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1ae62bc19074df server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.914+0000 7f7598e09640 1 -- 172.21.15.165:0/1788614984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769c04ea80 con 0x562762027d10 2024-09-22T08:11:03.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.914+0000 7f7598e09640 1 -- 172.21.15.165:0/1788614984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769c05c040 con 0x562762027d10 2024-09-22T08:11:03.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.914+0000 7f7598e09640 1 -- 172.21.15.165:0/1788614984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769c04ed50 con 0x562762027d10 2024-09-22T08:11:03.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.914+0000 7f76ad2bb800 1 -- 172.21.15.165:0/1788614984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 msgr2=0x5627621a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.914+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/1788614984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621a6070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f769c005fd0 tx=0x7f769c050000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.914+0000 7f76ad2bb800 1 -- 172.21.15.165:0/1788614984 shutdown_connections 2024-09-22T08:11:03.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.914+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/1788614984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621a6070 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.914+0000 7f76ad2bb800 1 -- 172.21.15.165:0/1788614984 >> 172.21.15.165:0/1788614984 conn(0x5627620aebb0 msgr2=0x5627621a19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.914+0000 7f76ad2bb800 1 -- 172.21.15.165:0/1788614984 shutdown_connections 2024-09-22T08:11:03.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.915+0000 7f76ad2bb800 1 -- 172.21.15.165:0/1788614984 wait complete. 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.915+0000 7f76ad2bb800 1 Processor -- start 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.915+0000 7f76ad2bb800 1 -- start start 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.915+0000 7f76ad2bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.915+0000 7f76ad2bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627620bda60 con 0x562762027d10 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.915+0000 7f76aada5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.915+0000 7f76aada5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50904/0 (socket says 172.21.15.165:50904) 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.915+0000 7f76aada5640 1 -- 172.21.15.165:0/4201606859 learned_addr learned my addr 172.21.15.165:0/4201606859 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.916+0000 7f76aada5640 1 -- 172.21.15.165:0/4201606859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627621adf90 con 0x562762027d10 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.916+0000 7f76aada5640 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621ada30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f769c00a190 tx=0x7f769c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.916+0000 7f7597606640 1 -- 172.21.15.165:0/4201606859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769c071070 con 0x562762027d10 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.916+0000 7f7597606640 1 -- 172.21.15.165:0/4201606859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769c06d440 con 0x562762027d10 2024-09-22T08:11:03.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.916+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627621ae220 con 0x562762027d10 2024-09-22T08:11:03.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.916+0000 7f7597606640 1 -- 172.21.15.165:0/4201606859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769c06d740 con 0x562762027d10 2024-09-22T08:11:03.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.916+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627621aec20 con 0x562762027d10 2024-09-22T08:11:03.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.917+0000 7f7597606640 1 -- 172.21.15.165:0/4201606859 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f769c074070 con 0x562762027d10 2024-09-22T08:11:03.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.917+0000 7f7597606640 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f759003d000 0x7f759003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.917+0000 7f7597606640 1 -- 172.21.15.165:0/4201606859 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f769c066020 con 0x562762027d10 2024-09-22T08:11:03.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.917+0000 7f76aa5a4640 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f759003d000 0x7f759003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.917+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627620b9a10 0x5627621b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.917+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621b55c0 con 0x5627620b9a10 2024-09-22T08:11:03.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.917+0000 7f76ab5a6640 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627620b9a10 0x5627621b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.917+0000 7f76aa5a4640 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f759003d000 0x7f759003f4c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7694000c00 tx=0x7f76940013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.918+0000 7f76ab5a6640 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627620b9a10 0x5627621b5080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.918+0000 7f76ab5a6640 1 -- 172.21.15.165:0/4201606859 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76a40083e0 con 0x5627620b9a10 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.918+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621b5960 con 0x5627620b9a10 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.918+0000 7f76ab5a6640 1 -- 172.21.15.165:0/4201606859 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f76a40083e0 con 0x5627620b9a10 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.918+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621b73e0 0x5627621b9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.918+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621b9fe0 con 0x5627621b73e0 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.918+0000 7f76aada5640 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621b73e0 0x5627621b9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.918+0000 7f76aada5640 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621b73e0 0x5627621b9850 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.919+0000 7f76aada5640 1 -- 172.21.15.165:0/4201606859 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f769c07d070 con 0x5627621b73e0 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.919+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621b61b0 con 0x5627620b9a10 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.919+0000 7f76ab5a6640 1 -- 172.21.15.165:0/4201606859 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f76a40083e0 con 0x5627620b9a10 2024-09-22T08:11:03.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.919+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621b6590 con 0x5627620b9a10 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.919+0000 7f76ab5a6640 1 -- 172.21.15.165:0/4201606859 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f76a40083e0 con 0x5627620b9a10 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.920+0000 7f76ad2bb800 1 Processor -- start 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.920+0000 7f76ad2bb800 1 -- start start 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.920+0000 7f76ad2bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621c89c0 0x5627621c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.920+0000 7f76ad2bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562761fabd50 con 0x5627621c89c0 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.920+0000 7f76ab5a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621c89c0 0x5627621c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.920+0000 7f76ab5a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621c89c0 0x5627621c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50916/0 (socket says 172.21.15.165:50916) 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.920+0000 7f76ab5a6640 1 -- 172.21.15.165:0/2453112005 learned_addr learned my addr 172.21.15.165:0/2453112005 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.920+0000 7f76ab5a6640 1 -- 172.21.15.165:0/2453112005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627621c9420 con 0x5627621c89c0 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.920+0000 7f76ab5a6640 1 --2- 172.21.15.165:0/2453112005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621c89c0 0x5627621c8de0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5627621af8f0 tx=0x7f76a400af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.921+0000 7f7594e01640 1 -- 172.21.15.165:0/2453112005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a4007d60 con 0x5627621c89c0 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.921+0000 7f7594e01640 1 -- 172.21.15.165:0/2453112005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a401e020 con 0x5627621c89c0 2024-09-22T08:11:03.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.921+0000 7f7594e01640 1 -- 172.21.15.165:0/2453112005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a4019590 con 0x5627621c89c0 2024-09-22T08:11:03.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.921+0000 7f76ad2bb800 1 -- 172.21.15.165:0/2453112005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627621c9c50 con 0x5627621c89c0 2024-09-22T08:11:03.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.921+0000 7f76ad2bb800 1 -- 172.21.15.165:0/2453112005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627621ca1f0 con 0x5627621c89c0 2024-09-22T08:11:03.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.921+0000 7f7594e01640 1 -- 172.21.15.165:0/2453112005 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f76a4016040 con 0x5627621c89c0 2024-09-22T08:11:03.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f7594e01640 1 --2- 172.21.15.165:0/2453112005 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f758403d000 0x7f758403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f7594e01640 1 -- 172.21.15.165:0/2453112005 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f76a401f030 con 0x5627621c89c0 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f76aada5640 1 --2- 172.21.15.165:0/2453112005 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f758403d000 0x7f758403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f76ad2bb800 1 Processor -- start 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f76ad2bb800 1 -- start start 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f76aada5640 1 --2- 172.21.15.165:0/2453112005 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f758403d000 0x7f758403f4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5627621afa90 tx=0x7f769c0971c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f76ad2bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621d5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f76ad2bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627621a69d0 con 0x5627621d5480 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f76ab5a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621d5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f76ab5a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621d5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50918/0 (socket says 172.21.15.165:50918) 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.922+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3402578595 learned_addr learned my addr 172.21.15.165:0/3402578595 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3402578595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627621d5e70 con 0x5627621d5480 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f76ab5a6640 1 --2- 172.21.15.165:0/3402578595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621d5880 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f76a4054590 tx=0x7f76a4016f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51a0ffa0fb94967 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f758e7fc640 1 -- 172.21.15.165:0/3402578595 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a401d070 con 0x5627621d5480 2024-09-22T08:11:03.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f758e7fc640 1 -- 172.21.15.165:0/3402578595 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a404dbc0 con 0x5627621d5480 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f758e7fc640 1 -- 172.21.15.165:0/3402578595 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a4045130 con 0x5627621d5480 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3402578595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 msgr2=0x5627621d5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3402578595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621d5880 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f76a4054590 tx=0x7f76a4016f80 comp rx=0 tx=0).stop 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3402578595 shutdown_connections 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3402578595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621d5880 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3402578595 >> 172.21.15.165:0/3402578595 conn(0x5627621d1880 msgr2=0x5627621cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3402578595 shutdown_connections 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.923+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3402578595 wait complete. 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.924+0000 7f76ad2bb800 1 Processor -- start 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.924+0000 7f76ad2bb800 1 -- start start 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.924+0000 7f76ad2bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621dca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.924+0000 7f76ad2bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627621d6490 con 0x5627621d5480 2024-09-22T08:11:03.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.924+0000 7f76ab5a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621dca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.924+0000 7f76ab5a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621dca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50924/0 (socket says 172.21.15.165:50924) 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.924+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 learned_addr learned my addr 172.21.15.165:0/3302031997 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.924+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627621dcfe0 con 0x5627621d5480 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.925+0000 7f76ab5a6640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621dca80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f76a4016fc0 tx=0x7f76a4054520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.925+0000 7f758cff9640 1 -- 172.21.15.165:0/3302031997 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a4044070 con 0x5627621d5480 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.925+0000 7f758cff9640 1 -- 172.21.15.165:0/3302031997 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a4031070 con 0x5627621d5480 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.925+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627621dd270 con 0x5627621d5480 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.925+0000 7f758cff9640 1 -- 172.21.15.165:0/3302031997 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a4014340 con 0x5627621d5480 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.925+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627621ddbf0 con 0x5627621d5480 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.925+0000 7f758cff9640 1 -- 172.21.15.165:0/3302031997 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f76a40144e0 con 0x5627621d5480 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.926+0000 7f758cff9640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f757403cfb0 0x7f757403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.926+0000 7f758cff9640 1 -- 172.21.15.165:0/3302031997 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f76a4004280 con 0x5627621d5480 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.926+0000 7f76aada5640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f757403cfb0 0x7f757403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.926+0000 7f76aada5640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f757403cfb0 0x7f757403f470 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5627621ba3e0 tx=0x7f769c08e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.926+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.926+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627621e8370 0x5627621ea830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.926+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621eaf80 con 0x5627621e8370 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76aa5a4640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627621e8370 0x5627621ea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76aa5a4640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627621e8370 0x5627621ea830 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f769400f5f0 con 0x5627621e8370 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76ad2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76ad2bb800 20 realm 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621e76c0 con 0x5627621e8370 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f769400f5f0 con 0x5627621e8370 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76ad2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76ad2bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:03.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621eba70 con 0x5627621e8370 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f769400f5f0 con 0x5627621e8370 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.927+0000 7f76ad2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621ec340 con 0x5627621e8370 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f769400f5f0 con 0x5627621e8370 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ad2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621ecd60 0x5627621ef150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621ef8c0 con 0x5627621ecd60 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ab5a6640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621ecd60 0x5627621ef150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ab5a6640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621ecd60 0x5627621ef150 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f76a40083e0 con 0x5627621ecd60 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ad2bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ad2bb800 20 searching for the correct realm 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5627621f1870 0x5627621f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.928+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621f1870 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.929+0000 7f76aada5640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5627621f1870 0x5627621f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.929+0000 7f76aada5640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5627621f1870 0x5627621f3d30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.929+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.929+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621ecd60 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.929+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f76a40083e0 con 0x5627621ecd60 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.929+0000 7f76ab5a6640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f76a4019040 0x7f76a4015600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.929+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x7f76a4019040 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.930+0000 7f76aa5a4640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f76a4019040 0x7f76a4015600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:03.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.930+0000 7f76aa5a4640 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f76a4019040 0x7f76a4015600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.930+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769400f5f0 con 0x7f76a4019040 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.930+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621e8370 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.930+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769400f5f0 con 0x5627621e8370 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.930+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621e8370 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.931+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f769402b040 con 0x5627621e8370 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.931+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x7f76a4019040 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.931+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769402b040 con 0x7f76a4019040 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.931+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x7f76a4019040 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.931+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769402b040 con 0x7f76a4019040 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.931+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621ecd60 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.931+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76a40083e0 con 0x5627621ecd60 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.931+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621f1870 2024-09-22T08:11:03.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.932+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.932+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621e8370 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.932+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769402b040 con 0x5627621e8370 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.932+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x7f76a4019040 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.932+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769402b040 con 0x7f76a4019040 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.932+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621e8370 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.932+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769402b040 con 0x5627621e8370 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.932+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621ecd60 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.933+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f76a40083e0 con 0x5627621ecd60 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.933+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621f1870 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.933+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.933+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621f1870 2024-09-22T08:11:03.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.933+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.933+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x7f76a4019040 2024-09-22T08:11:03.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.933+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769402b040 con 0x7f76a4019040 2024-09-22T08:11:03.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.933+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621f1870 2024-09-22T08:11:03.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.934+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.934+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621f1870 2024-09-22T08:11:03.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.934+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.934+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621e8370 2024-09-22T08:11:03.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.934+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769402b040 con 0x5627621e8370 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.934+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621e8370 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.934+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f769402b040 con 0x5627621e8370 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.934+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x7f76a4019040 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.935+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769402b040 con 0x7f76a4019040 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.935+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621f1870 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.935+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.935+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621ecd60 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.935+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76a40083e0 con 0x5627621ecd60 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.935+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621e8370 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.935+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769402b040 con 0x5627621e8370 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.935+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x7f76a4019040 2024-09-22T08:11:03.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.935+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.935+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621f1870 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.936+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.936+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x7f76a4019040 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.936+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.936+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621ecd60 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.936+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76a4068040 con 0x5627621ecd60 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.936+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621f1870 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.936+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.936+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x7f76a4019040 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621e8370 2024-09-22T08:11:03.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4400 con 0x5627621ecd60 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76a4068040 con 0x5627621ecd60 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621f02e0 con 0x5627621e8370 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.937+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621f0b80 con 0x5627621e8370 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621f4880 con 0x5627621e8370 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 20 zone default found 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 4 Realm: () 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 20 zonegroup default 2024-09-22T08:11:03.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621f48a0 con 0x7f76a4019040 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621f66d0 con 0x5627621f1870 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.938+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.939+0000 7f76ad2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.939+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.939+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621f6bb0 con 0x5627621f1870 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.939+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.939+0000 7f76ad2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.939+0000 7f76ad2bb800 20 started sync module instance, tier type = 2024-09-22T08:11:03.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.939+0000 7f76ad2bb800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.939+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f5b70 con 0x5627621ecd60 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.940+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a4068040 con 0x5627621ecd60 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.940+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94727149936752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f5b70 con 0x5627621ecd60 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.940+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f7670 con 0x5627621e8370 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.942+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.942+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94727149941120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f7640 con 0x5627621e8370 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.942+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f8640 con 0x5627621f1870 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.943+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94727149936752] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a4068040 con 0x5627621ecd60 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.945+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94727149941120] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.945+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.945+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94727149943392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f56c0 con 0x5627621f1870 2024-09-22T08:11:03.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.945+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f8f10 con 0x5627621ecd60 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.948+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94727149943392] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.948+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a4068040 con 0x5627621ecd60 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.948+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94727149947488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f8e80 con 0x5627621ecd60 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.948+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f9dd0 con 0x5627621e8370 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.949+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.949+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94727149951264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f9d40 con 0x5627621e8370 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.949+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621fadc0 con 0x7f76a4019040 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.949+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94727149947488] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a4068040 con 0x5627621ecd60 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.950+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.950+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94727149955216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621fad80 con 0x7f76a4019040 2024-09-22T08:11:03.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.950+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621fb7f0 con 0x7f76a4019040 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.950+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94727149951264] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.951+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94727149955216] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.951+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.951+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94727149949696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621fa1c0 con 0x7f76a4019040 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.952+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621fbca0 con 0x7f76a4019040 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.952+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.952+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94727149949696] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.953+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94727149959152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621fbc10 con 0x7f76a4019040 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.953+0000 7f76ad2bb800 20 add_watcher() i=0 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.953+0000 7f76ad2bb800 20 add_watcher() i=1 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.953+0000 7f76ad2bb800 20 add_watcher() i=2 2024-09-22T08:11:03.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.953+0000 7f76ad2bb800 20 add_watcher() i=3 2024-09-22T08:11:03.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.953+0000 7f76ad2bb800 20 add_watcher() i=4 2024-09-22T08:11:03.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.953+0000 7f76ad2bb800 20 add_watcher() i=5 2024-09-22T08:11:03.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.953+0000 7f76ad2bb800 20 add_watcher() i=6 2024-09-22T08:11:03.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.955+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94727149959152] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.955+0000 7f76ad2bb800 20 add_watcher() i=7 2024-09-22T08:11:03.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.955+0000 7f76ad2bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:03.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.955+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627621ff170 con 0x5627621e8370 2024-09-22T08:11:03.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.956+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.956+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94727149957920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621fc490 con 0x5627621e8370 2024-09-22T08:11:03.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.958+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94727149957920] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.958+0000 7f75617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.958+0000 7f76ad2bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:03.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.958+0000 7f76ad2bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:03.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.958+0000 7f76ad2bb800 5 note: GC not initialized 2024-09-22T08:11:03.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f74dbfff640 20 reqs_thread_entry: start 2024-09-22T08:11:03.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76ad2bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:03.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76ad2bb800 20 Filter name: none 2024-09-22T08:11:03.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f74d9ffb640 20 reqs_thread_entry: start 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76ad2bb800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76ad2bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627622324b0 con 0x5627621e8370 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76ad2bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76ad2bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76ad2bb800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76ad2bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.959+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562762234f40 con 0x5627621ecd60 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.960+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f76a4068040 con 0x5627621ecd60 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.960+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627622386c0 con 0x5627621e8370 2024-09-22T08:11:03.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f76ad2bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f76ad2bb800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f76ad2bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94727150207104 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562762233f30 con 0x5627621e8370 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 94727149951264 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f7694018040 con 0x5627621e8370 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f758e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94727149951264 notifier 4311 bl.length()=567 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f758e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f758e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f758e7fc640 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7570003ea0 con 0x5627621e8370 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(65 notify.4 [notify cookie 94727150207104 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.961+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.962+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 94727150207104 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f769402fbe0 con 0x5627621e8370 2024-09-22T08:11:03.966 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:03.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.962+0000 7f75617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:03.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.962+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94727149957920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627622301f0 con 0x5627621e8370 2024-09-22T08:11:03.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.963+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94727149957920] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.963+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94727149936752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627622301f0 con 0x5627621ecd60 2024-09-22T08:11:03.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.964+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94727149936752] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a4068040 con 0x5627621ecd60 2024-09-22T08:11:03.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.964+0000 7f76ad2bb800 20 remove_watcher() i=0 2024-09-22T08:11:03.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.964+0000 7f76ad2bb800 2 removed watcher, disabling cache 2024-09-22T08:11:03.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.964+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94727149941120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627622301f0 con 0x5627621e8370 2024-09-22T08:11:03.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.966+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94727149941120] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.966+0000 7f76ad2bb800 20 remove_watcher() i=1 2024-09-22T08:11:03.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.966+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94727149943392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627622301f0 con 0x5627621f1870 2024-09-22T08:11:03.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.967+0000 7f76aada5640 1 -- 172.21.15.165:0/3302031997 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94727149943392] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769c09f040 con 0x5627621f1870 2024-09-22T08:11:03.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.967+0000 7f76ad2bb800 20 remove_watcher() i=2 2024-09-22T08:11:03.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.967+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94727149947488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f6070 con 0x5627621ecd60 2024-09-22T08:11:03.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.968+0000 7f76ab5a6640 1 -- 172.21.15.165:0/3302031997 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94727149947488] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a4068040 con 0x5627621ecd60 2024-09-22T08:11:03.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.968+0000 7f76ad2bb800 20 remove_watcher() i=3 2024-09-22T08:11:03.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.968+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94727149951264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f7180 con 0x5627621e8370 2024-09-22T08:11:03.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.969+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94727149951264] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x5627621e8370 2024-09-22T08:11:03.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.969+0000 7f76ad2bb800 20 remove_watcher() i=4 2024-09-22T08:11:03.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.969+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94727149955216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f8a60 con 0x7f76a4019040 2024-09-22T08:11:03.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.970+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94727149955216] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.970+0000 7f76ad2bb800 20 remove_watcher() i=5 2024-09-22T08:11:03.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.970+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94727149949696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f6070 con 0x7f76a4019040 2024-09-22T08:11:03.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.971+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94727149949696] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.971+0000 7f76ad2bb800 20 remove_watcher() i=6 2024-09-22T08:11:03.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.971+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94727149959152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627621f9920 con 0x7f76a4019040 2024-09-22T08:11:03.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.972+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94727149959152] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769403b040 con 0x7f76a4019040 2024-09-22T08:11:03.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.972+0000 7f76ad2bb800 20 remove_watcher() i=7 2024-09-22T08:11:03.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f76a4019040 msgr2=0x7f76a4015600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f76a4019040 0x7f76a4015600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627621e8370 msgr2=0x5627621ea830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627621e8370 0x5627621ea830 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621ecd60 msgr2=0x5627621ef150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621ecd60 0x5627621ef150 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5627621f1870 msgr2=0x5627621f3d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5627621f1870 0x5627621f3d30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f757403cfb0 msgr2=0x7f757403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f757403cfb0 0x7f757403f470 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5627621ba3e0 tx=0x7f769c08e000 comp rx=0 tx=0).stop 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 msgr2=0x5627621dca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/3302031997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621d5480 0x5627621dca80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f76a4016fc0 tx=0x7f76a4054520 comp rx=0 tx=0).stop 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76aa5a4640 1 -- 172.21.15.165:0/3302031997 reap_dead start 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 shutdown_connections 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 >> 172.21.15.165:0/3302031997 conn(0x5627621d1880 msgr2=0x5627621cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 shutdown_connections 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/3302031997 wait complete. 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/2453112005 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f758403d000 msgr2=0x7f758403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/2453112005 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f758403d000 0x7f758403f4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5627621afa90 tx=0x7f769c0971c0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/2453112005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621c89c0 msgr2=0x5627621c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/2453112005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621c89c0 0x5627621c8de0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5627621af8f0 tx=0x7f76a400af20 comp rx=0 tx=0).stop 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/2453112005 shutdown_connections 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/2453112005 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f758403d000 0x7f758403f4c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/2453112005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627621c89c0 0x5627621c8de0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/2453112005 >> 172.21.15.165:0/2453112005 conn(0x5627621bcd70 msgr2=0x5627621bd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/2453112005 shutdown_connections 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.973+0000 7f76ad2bb800 1 -- 172.21.15.165:0/2453112005 wait complete. 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627620b9a10 msgr2=0x5627621b5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627620b9a10 0x5627621b5080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621b73e0 msgr2=0x5627621b9850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621b73e0 0x5627621b9850 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f759003d000 msgr2=0x7f759003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f759003d000 0x7f759003f4c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7694000c00 tx=0x7f76940013b0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 msgr2=0x5627621ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621ada30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f769c00a190 tx=0x7f769c003330 comp rx=0 tx=0).stop 2024-09-22T08:11:03.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 shutdown_connections 2024-09-22T08:11:03.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5627621b73e0 0x5627621b9850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627620b9a10 0x5627621b5080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f759003d000 0x7f759003f4c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 --2- 172.21.15.165:0/4201606859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562762027d10 0x5627621ada30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:03.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 >> 172.21.15.165:0/4201606859 conn(0x5627620aebb0 msgr2=0x5627621a01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:03.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 shutdown_connections 2024-09-22T08:11:03.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:03.974+0000 7f76ad2bb800 1 -- 172.21.15.165:0/4201606859 wait complete. 2024-09-22T08:11:03.983 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:03.983 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:11:03.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:11:03.984 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:11:04.028 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:04.028 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:04.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.028+0000 7f978f52a800 1 Processor -- start 2024-09-22T08:11:04.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.028+0000 7f978f52a800 1 -- start start 2024-09-22T08:11:04.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.028+0000 7f978f52a800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560e08454cb0 0x560e0845a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.028+0000 7f978f52a800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e082dea20 con 0x560e084539e0 2024-09-22T08:11:04.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.028+0000 7f978f52a800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560e082de7d0 con 0x560e08454cb0 2024-09-22T08:11:04.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.028+0000 7f978aaac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560e08454cb0 0x560e0845a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.028+0000 7f978b2ad640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560e084539e0 0x560e084545a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33492/0 (socket says 172.21.15.165:33492) 2024-09-22T08:11:04.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.028+0000 7f978aaac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560e08454cb0 0x560e0845a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50928/0 (socket says 172.21.15.165:50928) 2024-09-22T08:11:04.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.028+0000 7f978b2ad640 1 -- 172.21.15.165:0/1860404889 learned_addr learned my addr 172.21.15.165:0/1860404889 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:04.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.029+0000 7f978aaac640 1 -- 172.21.15.165:0/1860404889 >> v1:172.21.15.53:6789/0 conn(0x560e084539e0 legacy=0x560e084545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.029+0000 7f978aaac640 1 -- 172.21.15.165:0/1860404889 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e084540e0 con 0x560e08454cb0 2024-09-22T08:11:04.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.030+0000 7f978aaac640 1 --2- 172.21.15.165:0/1860404889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08454cb0 0x560e0845a640 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f977400a470 tx=0x7f9774045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bffdd248620ff04 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.031+0000 7f978a2ab640 1 -- 172.21.15.165:0/1860404889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9774053570 con 0x560e08454cb0 2024-09-22T08:11:04.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.031+0000 7f978a2ab640 1 -- 172.21.15.165:0/1860404889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9774058070 con 0x560e08454cb0 2024-09-22T08:11:04.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.031+0000 7f978a2ab640 1 -- 172.21.15.165:0/1860404889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9774053880 con 0x560e08454cb0 2024-09-22T08:11:04.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.031+0000 7f978f52a800 1 -- 172.21.15.165:0/1860404889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08454cb0 msgr2=0x560e0845a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.031+0000 7f978f52a800 1 --2- 172.21.15.165:0/1860404889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08454cb0 0x560e0845a640 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f977400a470 tx=0x7f9774045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:04.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.031+0000 7f978f52a800 1 -- 172.21.15.165:0/1860404889 shutdown_connections 2024-09-22T08:11:04.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.031+0000 7f978f52a800 1 --2- 172.21.15.165:0/1860404889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08454cb0 0x560e0845a640 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.031+0000 7f978f52a800 1 -- 172.21.15.165:0/1860404889 >> 172.21.15.165:0/1860404889 conn(0x560e0844edb0 msgr2=0x560e08451210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.031+0000 7f978f52a800 1 -- 172.21.15.165:0/1860404889 shutdown_connections 2024-09-22T08:11:04.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.031+0000 7f978f52a800 1 -- 172.21.15.165:0/1860404889 wait complete. 2024-09-22T08:11:04.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.045+0000 7f978f52a800 1 Processor -- start 2024-09-22T08:11:04.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.045+0000 7f978f52a800 1 -- start start 2024-09-22T08:11:04.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.045+0000 7f978f52a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e08542f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.045+0000 7f978f52a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e082ebdd0 con 0x560e084539e0 2024-09-22T08:11:04.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.045+0000 7f978b2ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e08542f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.045+0000 7f978b2ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e08542f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50944/0 (socket says 172.21.15.165:50944) 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.045+0000 7f978b2ad640 1 -- 172.21.15.165:0/2120823754 learned_addr learned my addr 172.21.15.165:0/2120823754 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.046+0000 7f978b2ad640 1 -- 172.21.15.165:0/2120823754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e08543570 con 0x560e084539e0 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.046+0000 7f978b2ad640 1 --2- 172.21.15.165:0/2120823754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e08542f80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9784001e40 tx=0x7f9784001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9567bff7490589 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.046+0000 7f967960a640 1 -- 172.21.15.165:0/2120823754 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9784012020 con 0x560e084539e0 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.046+0000 7f967960a640 1 -- 172.21.15.165:0/2120823754 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978400e5a0 con 0x560e084539e0 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.046+0000 7f967960a640 1 -- 172.21.15.165:0/2120823754 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f978400e8a0 con 0x560e084539e0 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 -- 172.21.15.165:0/2120823754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 msgr2=0x560e08542f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 --2- 172.21.15.165:0/2120823754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e08542f80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9784001e40 tx=0x7f9784001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 -- 172.21.15.165:0/2120823754 shutdown_connections 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 --2- 172.21.15.165:0/2120823754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e08542f80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 -- 172.21.15.165:0/2120823754 >> 172.21.15.165:0/2120823754 conn(0x560e0844edb0 msgr2=0x560e0853e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 -- 172.21.15.165:0/2120823754 shutdown_connections 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 -- 172.21.15.165:0/2120823754 wait complete. 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 Processor -- start 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 -- start start 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e0854aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.047+0000 7f978f52a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e0845ab80 con 0x560e084539e0 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.048+0000 7f978b2ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e0854aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.048+0000 7f978b2ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e0854aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50958/0 (socket says 172.21.15.165:50958) 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.048+0000 7f978b2ad640 1 -- 172.21.15.165:0/1561897748 learned_addr learned my addr 172.21.15.165:0/1561897748 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.048+0000 7f978b2ad640 1 -- 172.21.15.165:0/1561897748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e0854b030 con 0x560e084539e0 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.048+0000 7f978b2ad640 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e0854aad0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f978400c010 tx=0x7f9784000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.048+0000 7f9677e07640 1 -- 172.21.15.165:0/1561897748 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9784012030 con 0x560e084539e0 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.048+0000 7f9677e07640 1 -- 172.21.15.165:0/1561897748 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97840014a0 con 0x560e084539e0 2024-09-22T08:11:04.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.048+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e0854b2c0 con 0x560e084539e0 2024-09-22T08:11:04.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.048+0000 7f9677e07640 1 -- 172.21.15.165:0/1561897748 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f978401a7a0 con 0x560e084539e0 2024-09-22T08:11:04.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.048+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e0854bcc0 con 0x560e084539e0 2024-09-22T08:11:04.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.049+0000 7f9677e07640 1 -- 172.21.15.165:0/1561897748 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9784015020 con 0x560e084539e0 2024-09-22T08:11:04.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.049+0000 7f9677e07640 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f967003d000 0x7f967003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.049+0000 7f9677e07640 1 -- 172.21.15.165:0/1561897748 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9784020030 con 0x560e084539e0 2024-09-22T08:11:04.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.049+0000 7f978aaac640 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f967003d000 0x7f967003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.050+0000 7f978f52a800 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e08454cb0 0x560e08552120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.050+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0854c850 con 0x560e08454cb0 2024-09-22T08:11:04.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.050+0000 7f978baae640 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e08454cb0 0x560e08552120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.050+0000 7f978aaac640 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f967003d000 0x7f967003f4c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9774057000 tx=0x7f9774052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.050+0000 7f978baae640 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e08454cb0 0x560e08552120 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.050+0000 7f978baae640 1 -- 172.21.15.165:0/1561897748 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f977c00a4d0 con 0x560e08454cb0 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.050+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0854c150 con 0x560e08454cb0 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.051+0000 7f978baae640 1 -- 172.21.15.165:0/1561897748 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f977c00a4d0 con 0x560e08454cb0 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.051+0000 7f978f52a800 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e08554590 0x560e08556980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.051+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e08557050 con 0x560e08554590 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.051+0000 7f978b2ad640 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e08554590 0x560e08556980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.051+0000 7f978b2ad640 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e08554590 0x560e08556980 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.051+0000 7f978b2ad640 1 -- 172.21.15.165:0/1561897748 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f97840187b0 con 0x560e08554590 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.051+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e08553430 con 0x560e08454cb0 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.052+0000 7f978baae640 1 -- 172.21.15.165:0/1561897748 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f977c00a4d0 con 0x560e08454cb0 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.052+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e085538d0 con 0x560e08454cb0 2024-09-22T08:11:04.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.052+0000 7f978baae640 1 -- 172.21.15.165:0/1561897748 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f977c00a4d0 con 0x560e08454cb0 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.052+0000 7f978f52a800 1 Processor -- start 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.052+0000 7f978f52a800 1 -- start start 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.052+0000 7f978f52a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e083c9300 0x560e083c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.052+0000 7f978f52a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e0834ad50 con 0x560e083c9300 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.052+0000 7f978baae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e083c9300 0x560e083c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.053+0000 7f978baae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e083c9300 0x560e083c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50968/0 (socket says 172.21.15.165:50968) 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.053+0000 7f978baae640 1 -- 172.21.15.165:0/1854367446 learned_addr learned my addr 172.21.15.165:0/1854367446 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.053+0000 7f978baae640 1 -- 172.21.15.165:0/1854367446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e083c9820 con 0x560e083c9300 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.053+0000 7f978baae640 1 --2- 172.21.15.165:0/1854367446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e083c9300 0x560e083c7b70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x560e08552660 tx=0x7f977c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.053+0000 7f9675602640 1 -- 172.21.15.165:0/1854367446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f977c014450 con 0x560e083c9300 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.053+0000 7f9675602640 1 -- 172.21.15.165:0/1854367446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f977c0145f0 con 0x560e083c9300 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.053+0000 7f978f52a800 1 -- 172.21.15.165:0/1854367446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e083c80b0 con 0x560e083c9300 2024-09-22T08:11:04.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.053+0000 7f9675602640 1 -- 172.21.15.165:0/1854367446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f977c014910 con 0x560e083c9300 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.053+0000 7f978f52a800 1 -- 172.21.15.165:0/1854367446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e083c8650 con 0x560e083c9300 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.054+0000 7f9675602640 1 -- 172.21.15.165:0/1854367446 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f977c011040 con 0x560e083c9300 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.054+0000 7f9675602640 1 --2- 172.21.15.165:0/1854367446 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f966403d000 0x7f966403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.054+0000 7f9675602640 1 -- 172.21.15.165:0/1854367446 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f977c01e070 con 0x560e083c9300 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.054+0000 7f978b2ad640 1 --2- 172.21.15.165:0/1854367446 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f966403d000 0x7f966403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.055+0000 7f978f52a800 1 Processor -- start 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.055+0000 7f978b2ad640 1 --2- 172.21.15.165:0/1854367446 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f966403d000 0x7f966403f4c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x560e08552700 tx=0x7f9784052990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.055+0000 7f978f52a800 1 -- start start 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.055+0000 7f978f52a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e08574a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.055+0000 7f978f52a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e085439a0 con 0x560e08574630 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.055+0000 7f978baae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e08574a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.055+0000 7f978baae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e08574a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50976/0 (socket says 172.21.15.165:50976) 2024-09-22T08:11:04.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.055+0000 7f978baae640 1 -- 172.21.15.165:0/2081295944 learned_addr learned my addr 172.21.15.165:0/2081295944 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.055+0000 7f978baae640 1 -- 172.21.15.165:0/2081295944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e08575020 con 0x560e08574630 2024-09-22T08:11:04.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.055+0000 7f978baae640 1 --2- 172.21.15.165:0/2081295944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e08574a30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f977c016620 tx=0x7f977c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fa0db0454a0029 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f966effd640 1 -- 172.21.15.165:0/2081295944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f977c051020 con 0x560e08574630 2024-09-22T08:11:04.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f966effd640 1 -- 172.21.15.165:0/2081295944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f977c022de0 con 0x560e08574630 2024-09-22T08:11:04.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f966effd640 1 -- 172.21.15.165:0/2081295944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f977c028070 con 0x560e08574630 2024-09-22T08:11:04.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 -- 172.21.15.165:0/2081295944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 msgr2=0x560e08574a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 --2- 172.21.15.165:0/2081295944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e08574a30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f977c016620 tx=0x7f977c011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 -- 172.21.15.165:0/2081295944 shutdown_connections 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 --2- 172.21.15.165:0/2081295944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e08574a30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 -- 172.21.15.165:0/2081295944 >> 172.21.15.165:0/2081295944 conn(0x560e08570a30 msgr2=0x560e0856ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 -- 172.21.15.165:0/2081295944 shutdown_connections 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 -- 172.21.15.165:0/2081295944 wait complete. 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 Processor -- start 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 -- start start 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e0857bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.056+0000 7f978f52a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e08575640 con 0x560e08574630 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.057+0000 7f978baae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e0857bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.057+0000 7f978baae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e0857bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50978/0 (socket says 172.21.15.165:50978) 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.057+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 learned_addr learned my addr 172.21.15.165:0/3899194440 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.057+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e0857c1c0 con 0x560e08574630 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.057+0000 7f978baae640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e0857bc60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f977c022f90 tx=0x7f977c0546f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.057+0000 7f966d7fa640 1 -- 172.21.15.165:0/3899194440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f977c031020 con 0x560e08574630 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.057+0000 7f966d7fa640 1 -- 172.21.15.165:0/3899194440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f977c011330 con 0x560e08574630 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.057+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e0857c450 con 0x560e08574630 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.057+0000 7f966d7fa640 1 -- 172.21.15.165:0/3899194440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f977c045930 con 0x560e08574630 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.057+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e0857cdd0 con 0x560e08574630 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.058+0000 7f966d7fa640 1 -- 172.21.15.165:0/3899194440 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f977c034020 con 0x560e08574630 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.058+0000 7f966d7fa640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f965403cfb0 0x7f965403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.058+0000 7f966d7fa640 1 -- 172.21.15.165:0/3899194440 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f977c00e040 con 0x560e08574630 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.058+0000 7f978b2ad640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f965403cfb0 0x7f965403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978f52a800 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e085876f0 0x560e08589bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0858a300 con 0x560e085876f0 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978b2ad640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f965403cfb0 0x7f965403f470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f978401af70 tx=0x7f978404e070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978aaac640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e085876f0 0x560e08589bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978aaac640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e085876f0 0x560e08589bb0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978f52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978f52a800 20 realm 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0858a730 con 0x560e085876f0 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.059+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:04.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0858b000 con 0x560e085876f0 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0858b3a0 con 0x560e085876f0 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e0858c100 0x560e0858e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0858ea30 con 0x560e0858c100 2024-09-22T08:11:04.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978baae640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e0858c100 0x560e0858e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.060+0000 7f978baae640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e0858c100 0x560e0858e4f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.061+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.061+0000 7f978f52a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.061+0000 7f978f52a800 20 searching for the correct realm 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.061+0000 7f978f52a800 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560e08590a70 0x560e08592f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.061+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e08590a70 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.061+0000 7f978b2ad640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560e08590a70 0x560e08592f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.061+0000 7f978b2ad640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560e08590a70 0x560e08592f30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.061+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.061+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e0858c100 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.062+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.062+0000 7f978baae640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f977c041040 0x7f977c036400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.062+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x7f977c041040 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.062+0000 7f978aaac640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f977c041040 0x7f977c036400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.062+0000 7f978aaac640 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f977c041040 0x7f977c036400 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.062+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.063+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e085876f0 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.063+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.063+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e085876f0 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.063+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.063+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x7f977c041040 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.063+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.063+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x7f977c041040 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.064+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.064+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e0858c100 2024-09-22T08:11:04.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.064+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.064+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e08590a70 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.064+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.064+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e085876f0 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.064+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.064+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x7f977c041040 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.064+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.064+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e085876f0 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.065+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.065+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e0858c100 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.065+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.065+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e08590a70 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.065+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.065+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e08590a70 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.065+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.065+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x7f977c041040 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.066+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.066+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e08590a70 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.066+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.066+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e08590a70 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.066+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.066+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e085876f0 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.066+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.066+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e085876f0 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.067+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.067+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x7f977c041040 2024-09-22T08:11:04.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.067+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.067+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e08590a70 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.067+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.067+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e0858c100 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.067+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.067+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e085876f0 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.068+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.068+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x7f977c041040 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.068+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.068+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e08590a70 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.068+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.068+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x7f977c041040 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.068+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.068+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e0858c100 2024-09-22T08:11:04.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.069+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.069+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e08590a70 2024-09-22T08:11:04.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.069+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.069+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x7f977c041040 2024-09-22T08:11:04.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.069+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.069+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e085876f0 2024-09-22T08:11:04.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.069+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.069+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e08593600 con 0x560e0858c100 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0858f4a0 con 0x560e085876f0 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0858f0b0 con 0x560e085876f0 2024-09-22T08:11:04.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0858fe10 con 0x560e085876f0 2024-09-22T08:11:04.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:04.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 zone default found 2024-09-22T08:11:04.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 4 Realm: () 2024-09-22T08:11:04.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 zonegroup default 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.070+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0858f920 con 0x7f977c041040 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978f52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e08595970 con 0x560e08590a70 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978f52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e08595dd0 con 0x560e08590a70 2024-09-22T08:11:04.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978f52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978f52a800 20 started sync module instance, tier type = 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978f52a800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.071+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08594e10 con 0x560e0858c100 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.072+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.072+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94618269602304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e085966e0 con 0x560e0858c100 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.072+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08596f30 con 0x560e085876f0 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.073+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94618269602304] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.074+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.074+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94618269606720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08596cf0 con 0x560e085876f0 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.074+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e085977e0 con 0x560e08590a70 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.075+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.075+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94618269610672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08598080 con 0x560e08590a70 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.075+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08598b80 con 0x560e0858c100 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.075+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94618269606720] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.076+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94618269610672] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.076+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.076+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94618269613008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08596760 con 0x560e0858c100 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.076+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08599590 con 0x560e085876f0 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.077+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.077+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94618269618400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e085999b0 con 0x560e085876f0 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.077+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e0859a3d0 con 0x7f977c041040 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.078+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94618269613008] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.079+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94618269618400] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.079+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.079+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94618269621952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08599500 con 0x7f977c041040 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.079+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e0859ac70 con 0x7f977c041040 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.080+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94618269621952] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.080+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.080+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94618269615728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08599500 con 0x7f977c041040 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.080+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e0859b220 con 0x7f977c041040 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.081+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.081+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94618269625712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e0859b680 con 0x7f977c041040 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.081+0000 7f978f52a800 20 add_watcher() i=0 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.081+0000 7f978f52a800 20 add_watcher() i=1 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.081+0000 7f978f52a800 20 add_watcher() i=2 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.081+0000 7f978f52a800 20 add_watcher() i=3 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.081+0000 7f978f52a800 20 add_watcher() i=4 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.081+0000 7f978f52a800 20 add_watcher() i=5 2024-09-22T08:11:04.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.081+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94618269615728] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.081+0000 7f978f52a800 20 add_watcher() i=6 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.082+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94618269625712] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.082+0000 7f978f52a800 20 add_watcher() i=7 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.082+0000 7f978f52a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.082+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e0859a7c0 con 0x560e085876f0 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.082+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.082+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94618269626768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e0859c040 con 0x560e085876f0 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.083+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94618269626768] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.083+0000 7f9641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.083+0000 7f978f52a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.083+0000 7f978f52a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.083+0000 7f978f52a800 5 note: GC not initialized 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.084+0000 7f9640fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.084+0000 7f978f52a800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:04.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.084+0000 7f978f52a800 20 Filter name: none 2024-09-22T08:11:04.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.084+0000 7f95ba7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:04.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.084+0000 7f978f52a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.084+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e085d16b0 con 0x560e085876f0 2024-09-22T08:11:04.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.084+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.084+0000 7f978f52a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:04.094 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:04.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.085+0000 7f9641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.085+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94618269626768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e085cff30 con 0x560e085876f0 2024-09-22T08:11:04.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.086+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94618269626768] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.086+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94618269602304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e0859b190 con 0x560e0858c100 2024-09-22T08:11:04.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.087+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94618269602304] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.087+0000 7f978f52a800 20 remove_watcher() i=0 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.087+0000 7f978f52a800 2 removed watcher, disabling cache 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.087+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94618269606720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08595200 con 0x560e085876f0 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.089+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94618269606720] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.089+0000 7f978f52a800 20 remove_watcher() i=1 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.089+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94618269610672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08595200 con 0x560e08590a70 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.089+0000 7f978b2ad640 1 -- 172.21.15.165:0/3899194440 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94618269610672] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97840187b0 con 0x560e08590a70 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.089+0000 7f978f52a800 20 remove_watcher() i=2 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.089+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94618269613008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08596340 con 0x560e0858c100 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.090+0000 7f978baae640 1 -- 172.21.15.165:0/3899194440 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94618269613008] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f977c02a070 con 0x560e0858c100 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.090+0000 7f978f52a800 20 remove_watcher() i=3 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.090+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94618269618400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08596340 con 0x560e085876f0 2024-09-22T08:11:04.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.091+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94618269618400] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x560e085876f0 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.091+0000 7f978f52a800 20 remove_watcher() i=4 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.091+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94618269621952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e085990e0 con 0x7f977c041040 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.092+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94618269621952] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.092+0000 7f978f52a800 20 remove_watcher() i=5 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.092+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94618269615728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08596340 con 0x7f977c041040 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.094+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94618269615728] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.094+0000 7f978f52a800 20 remove_watcher() i=6 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.094+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94618269625712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e08598670 con 0x7f977c041040 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.094+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94618269625712] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9774051070 con 0x7f977c041040 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.094+0000 7f978f52a800 20 remove_watcher() i=7 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f977c041040 msgr2=0x7f977c036400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f977c041040 0x7f977c036400 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e085876f0 msgr2=0x560e08589bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e085876f0 0x560e08589bb0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e0858c100 msgr2=0x560e0858e4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e0858c100 0x560e0858e4f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560e08590a70 msgr2=0x560e08592f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560e08590a70 0x560e08592f30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f965403cfb0 msgr2=0x7f965403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f965403cfb0 0x7f965403f470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f978401af70 tx=0x7f978404e070 comp rx=0 tx=0).stop 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978aaac640 1 -- 172.21.15.165:0/3899194440 reap_dead start 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 msgr2=0x560e0857bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e0857bc60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f977c022f90 tx=0x7f977c0546f0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 shutdown_connections 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/3899194440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e08574630 0x560e0857bc60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 >> 172.21.15.165:0/3899194440 conn(0x560e08570a30 msgr2=0x560e0856ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 shutdown_connections 2024-09-22T08:11:04.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/3899194440 wait complete. 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/1854367446 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f966403d000 msgr2=0x7f966403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/1854367446 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f966403d000 0x7f966403f4c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x560e08552700 tx=0x7f9784052990 comp rx=0 tx=0).stop 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/1854367446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e083c9300 msgr2=0x560e083c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/1854367446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e083c9300 0x560e083c7b70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x560e08552660 tx=0x7f977c018830 comp rx=0 tx=0).stop 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/1854367446 shutdown_connections 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/1854367446 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f966403d000 0x7f966403f4c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 --2- 172.21.15.165:0/1854367446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e083c9300 0x560e083c7b70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/1854367446 >> 172.21.15.165:0/1854367446 conn(0x560e08559d80 msgr2=0x560e0855a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/1854367446 shutdown_connections 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.095+0000 7f978f52a800 1 -- 172.21.15.165:0/1854367446 wait complete. 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e08454cb0 msgr2=0x560e08552120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e08454cb0 0x560e08552120 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e08554590 msgr2=0x560e08556980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e08554590 0x560e08556980 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f967003d000 msgr2=0x7f967003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f967003d000 0x7f967003f4c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9774057000 tx=0x7f9774052000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 msgr2=0x560e0854aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e0854aad0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f978400c010 tx=0x7f9784000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 shutdown_connections 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560e08554590 0x560e08556980 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560e08454cb0 0x560e08552120 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f967003d000 0x7f967003f4c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 --2- 172.21.15.165:0/1561897748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e084539e0 0x560e0854aad0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 >> 172.21.15.165:0/1561897748 conn(0x560e0844edb0 msgr2=0x560e08544470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 shutdown_connections 2024-09-22T08:11:04.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.096+0000 7f978f52a800 1 -- 172.21.15.165:0/1561897748 wait complete. 2024-09-22T08:11:04.105 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:04.105 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-22T08:11:04.105 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-22T08:11:04.106 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-22T08:11:04.149 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:04.149 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:04.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.149+0000 7f6703122800 1 Processor -- start 2024-09-22T08:11:04.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.149+0000 7f6703122800 1 -- start start 2024-09-22T08:11:04.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.150+0000 7f6703122800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558917000cb0 0x558917006640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.150+0000 7f6703122800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558916e8aa20 con 0x558916fff9e0 2024-09-22T08:11:04.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.150+0000 7f6703122800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558916e8a7d0 con 0x558917000cb0 2024-09-22T08:11:04.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.150+0000 7f66fe5d1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558917000cb0 0x558917006640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.150+0000 7f66fedd2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558916fff9e0 0x5589170005a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33506/0 (socket says 172.21.15.165:33506) 2024-09-22T08:11:04.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.150+0000 7f66fe5d1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558917000cb0 0x558917006640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:50992/0 (socket says 172.21.15.165:50992) 2024-09-22T08:11:04.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.150+0000 7f66fedd2640 1 -- 172.21.15.165:0/2211858912 learned_addr learned my addr 172.21.15.165:0/2211858912 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:04.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.150+0000 7f66fe5d1640 1 -- 172.21.15.165:0/2211858912 >> v1:172.21.15.53:6789/0 conn(0x558916fff9e0 legacy=0x5589170005a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.150+0000 7f66fe5d1640 1 -- 172.21.15.165:0/2211858912 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589170000e0 con 0x558917000cb0 2024-09-22T08:11:04.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.152+0000 7f66fe5d1640 1 --2- 172.21.15.165:0/2211858912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917000cb0 0x558917006640 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f66f400a470 tx=0x7f66f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445de5114f5d36a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.152+0000 7f66fddd0640 1 -- 172.21.15.165:0/2211858912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f4053570 con 0x558917000cb0 2024-09-22T08:11:04.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.152+0000 7f66fddd0640 1 -- 172.21.15.165:0/2211858912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f4058070 con 0x558917000cb0 2024-09-22T08:11:04.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.152+0000 7f66fddd0640 1 -- 172.21.15.165:0/2211858912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f4053880 con 0x558917000cb0 2024-09-22T08:11:04.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.153+0000 7f6703122800 1 -- 172.21.15.165:0/2211858912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917000cb0 msgr2=0x558917006640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.153+0000 7f6703122800 1 --2- 172.21.15.165:0/2211858912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917000cb0 0x558917006640 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f66f400a470 tx=0x7f66f4045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:04.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.153+0000 7f6703122800 1 -- 172.21.15.165:0/2211858912 shutdown_connections 2024-09-22T08:11:04.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.153+0000 7f6703122800 1 --2- 172.21.15.165:0/2211858912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917000cb0 0x558917006640 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.153+0000 7f6703122800 1 -- 172.21.15.165:0/2211858912 >> 172.21.15.165:0/2211858912 conn(0x558916ffadb0 msgr2=0x558916ffd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.153+0000 7f6703122800 1 -- 172.21.15.165:0/2211858912 shutdown_connections 2024-09-22T08:11:04.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.153+0000 7f6703122800 1 -- 172.21.15.165:0/2211858912 wait complete. 2024-09-22T08:11:04.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.167+0000 7f6703122800 1 Processor -- start 2024-09-22T08:11:04.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.167+0000 7f6703122800 1 -- start start 2024-09-22T08:11:04.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.167+0000 7f6703122800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x558916f752b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.167+0000 7f6703122800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558916e97dd0 con 0x558916fff9e0 2024-09-22T08:11:04.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.168+0000 7f66fedd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x558916f752b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.168+0000 7f66fedd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x558916f752b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51002/0 (socket says 172.21.15.165:51002) 2024-09-22T08:11:04.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.168+0000 7f66fedd2640 1 -- 172.21.15.165:0/1111614452 learned_addr learned my addr 172.21.15.165:0/1111614452 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.168+0000 7f66fedd2640 1 -- 172.21.15.165:0/1111614452 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558916f758a0 con 0x558916fff9e0 2024-09-22T08:11:04.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.168+0000 7f66fedd2640 1 --2- 172.21.15.165:0/1111614452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x558916f752b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f66f0001e40 tx=0x7f66f0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6405a49fcd0af1d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.168+0000 7f65ece09640 1 -- 172.21.15.165:0/1111614452 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0012020 con 0x558916fff9e0 2024-09-22T08:11:04.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.168+0000 7f65ece09640 1 -- 172.21.15.165:0/1111614452 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f000e5a0 con 0x558916fff9e0 2024-09-22T08:11:04.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.168+0000 7f65ece09640 1 -- 172.21.15.165:0/1111614452 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f000e8a0 con 0x558916fff9e0 2024-09-22T08:11:04.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 -- 172.21.15.165:0/1111614452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 msgr2=0x558916f752b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 --2- 172.21.15.165:0/1111614452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x558916f752b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f66f0001e40 tx=0x7f66f0001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:04.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 -- 172.21.15.165:0/1111614452 shutdown_connections 2024-09-22T08:11:04.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 --2- 172.21.15.165:0/1111614452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x558916f752b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 -- 172.21.15.165:0/1111614452 >> 172.21.15.165:0/1111614452 conn(0x558916ffadb0 msgr2=0x5589170ea900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 -- 172.21.15.165:0/1111614452 shutdown_connections 2024-09-22T08:11:04.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 -- 172.21.15.165:0/1111614452 wait complete. 2024-09-22T08:11:04.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 Processor -- start 2024-09-22T08:11:04.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 -- start start 2024-09-22T08:11:04.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x5589170f8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.169+0000 7f6703122800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558917006b80 con 0x558916fff9e0 2024-09-22T08:11:04.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.170+0000 7f66fedd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x5589170f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.170+0000 7f66fedd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x5589170f8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51004/0 (socket says 172.21.15.165:51004) 2024-09-22T08:11:04.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.170+0000 7f66fedd2640 1 -- 172.21.15.165:0/772379862 learned_addr learned my addr 172.21.15.165:0/772379862 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.170+0000 7f66fedd2640 1 -- 172.21.15.165:0/772379862 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589170f91c0 con 0x558916fff9e0 2024-09-22T08:11:04.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.170+0000 7f66fedd2640 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x5589170f8c60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c010 tx=0x7f66f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.170+0000 7f65eb606640 1 -- 172.21.15.165:0/772379862 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0012030 con 0x558916fff9e0 2024-09-22T08:11:04.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.170+0000 7f65eb606640 1 -- 172.21.15.165:0/772379862 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f00014a0 con 0x558916fff9e0 2024-09-22T08:11:04.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.170+0000 7f65eb606640 1 -- 172.21.15.165:0/772379862 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f001a7a0 con 0x558916fff9e0 2024-09-22T08:11:04.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.171+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589170f94b0 con 0x558916fff9e0 2024-09-22T08:11:04.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.171+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589170fa060 con 0x558916fff9e0 2024-09-22T08:11:04.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.171+0000 7f65eb606640 1 -- 172.21.15.165:0/772379862 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f66f0015020 con 0x558916fff9e0 2024-09-22T08:11:04.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.172+0000 7f65eb606640 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65e403d000 0x7f65e403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.172+0000 7f65eb606640 1 -- 172.21.15.165:0/772379862 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f66f0020030 con 0x558916fff9e0 2024-09-22T08:11:04.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.172+0000 7f66fe5d1640 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65e403d000 0x7f65e403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.172+0000 7f6703122800 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917000cb0 0x5589171002b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.172+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589171007f0 con 0x558917000cb0 2024-09-22T08:11:04.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.172+0000 7f66ff5d3640 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917000cb0 0x5589171002b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.172+0000 7f66fe5d1640 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65e403d000 0x7f65e403f4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f66f4057000 tx=0x7f66f4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.172+0000 7f66ff5d3640 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917000cb0 0x5589171002b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.173+0000 7f66ff5d3640 1 -- 172.21.15.165:0/772379862 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66f800a4d0 con 0x558917000cb0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.173+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558917100b90 con 0x558917000cb0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.173+0000 7f66ff5d3640 1 -- 172.21.15.165:0/772379862 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66f800a4d0 con 0x558917000cb0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.173+0000 7f6703122800 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917102650 0x558917104af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.173+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558917105280 con 0x558917102650 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.173+0000 7f66fedd2640 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917102650 0x558917104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.173+0000 7f66fedd2640 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917102650 0x558917104af0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.174+0000 7f66fedd2640 1 -- 172.21.15.165:0/772379862 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66f00187b0 con 0x558917102650 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.174+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589171013e0 con 0x558917000cb0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.174+0000 7f66ff5d3640 1 -- 172.21.15.165:0/772379862 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66f800a4d0 con 0x558917000cb0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.174+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589171017c0 con 0x558917000cb0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.174+0000 7f66ff5d3640 1 -- 172.21.15.165:0/772379862 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f66f800a4d0 con 0x558917000cb0 2024-09-22T08:11:04.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.175+0000 7f6703122800 1 Processor -- start 2024-09-22T08:11:04.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.175+0000 7f6703122800 1 -- start start 2024-09-22T08:11:04.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.175+0000 7f6703122800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917113c30 0x558917114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.175+0000 7f6703122800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558916ef6d50 con 0x558917113c30 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.175+0000 7f66ff5d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917113c30 0x558917114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.175+0000 7f66ff5d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917113c30 0x558917114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51008/0 (socket says 172.21.15.165:51008) 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.175+0000 7f66ff5d3640 1 -- 172.21.15.165:0/2039751627 learned_addr learned my addr 172.21.15.165:0/2039751627 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.175+0000 7f66ff5d3640 1 -- 172.21.15.165:0/2039751627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558917114690 con 0x558917113c30 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.175+0000 7f66ff5d3640 1 --2- 172.21.15.165:0/2039751627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917113c30 0x558917114050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5589170f9af0 tx=0x7f66f8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.176+0000 7f65e8e01640 1 -- 172.21.15.165:0/2039751627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f8014450 con 0x558917113c30 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.176+0000 7f65e8e01640 1 -- 172.21.15.165:0/2039751627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f8014610 con 0x558917113c30 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.176+0000 7f65e8e01640 1 -- 172.21.15.165:0/2039751627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f8014930 con 0x558917113c30 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.176+0000 7f6703122800 1 -- 172.21.15.165:0/2039751627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558917114ec0 con 0x558917113c30 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.176+0000 7f6703122800 1 -- 172.21.15.165:0/2039751627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558917115460 con 0x558917113c30 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.176+0000 7f65e8e01640 1 -- 172.21.15.165:0/2039751627 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f66f8011040 con 0x558917113c30 2024-09-22T08:11:04.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f65e8e01640 1 --2- 172.21.15.165:0/2039751627 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65d803cfb0 0x7f65d803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f65e8e01640 1 -- 172.21.15.165:0/2039751627 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f66f801e070 con 0x558917113c30 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f66fedd2640 1 --2- 172.21.15.165:0/2039751627 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65d803cfb0 0x7f65d803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f6703122800 1 Processor -- start 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f6703122800 1 -- start start 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f66fedd2640 1 --2- 172.21.15.165:0/2039751627 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65d803cfb0 0x7f65d803f470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5589170fad30 tx=0x7f66f0052920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f6703122800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917120ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f6703122800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558916f73cf0 con 0x5589171206f0 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f66ff5d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917120ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f66ff5d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917120ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51010/0 (socket says 172.21.15.165:51010) 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.177+0000 7f66ff5d3640 1 -- 172.21.15.165:0/3878285879 learned_addr learned my addr 172.21.15.165:0/3878285879 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f66ff5d3640 1 -- 172.21.15.165:0/3878285879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589171210c0 con 0x5589171206f0 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f66ff5d3640 1 --2- 172.21.15.165:0/3878285879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917120ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66f8016fd0 tx=0x7f66f8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adf4fc86a6510b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f65e27fc640 1 -- 172.21.15.165:0/3878285879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f8011da0 con 0x5589171206f0 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f65e27fc640 1 -- 172.21.15.165:0/3878285879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f80532d0 con 0x5589171206f0 2024-09-22T08:11:04.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f65e27fc640 1 -- 172.21.15.165:0/3878285879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f80168f0 con 0x5589171206f0 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f6703122800 1 -- 172.21.15.165:0/3878285879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 msgr2=0x558917120ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f6703122800 1 --2- 172.21.15.165:0/3878285879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917120ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66f8016fd0 tx=0x7f66f8011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f6703122800 1 -- 172.21.15.165:0/3878285879 shutdown_connections 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f6703122800 1 --2- 172.21.15.165:0/3878285879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917120ad0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f6703122800 1 -- 172.21.15.165:0/3878285879 >> 172.21.15.165:0/3878285879 conn(0x55891711caf0 msgr2=0x55891711ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f6703122800 1 -- 172.21.15.165:0/3878285879 shutdown_connections 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.178+0000 7f6703122800 1 -- 172.21.15.165:0/3878285879 wait complete. 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.179+0000 7f6703122800 1 Processor -- start 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.179+0000 7f6703122800 1 -- start start 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.179+0000 7f6703122800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917127cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.179+0000 7f6703122800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558917121700 con 0x5589171206f0 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.179+0000 7f66ff5d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917127cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.179+0000 7f66ff5d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917127cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51014/0 (socket says 172.21.15.165:51014) 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.179+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 learned_addr learned my addr 172.21.15.165:0/260704677 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.180+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558917128210 con 0x5589171206f0 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.180+0000 7f66ff5d3640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917127cb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f66f80016e0 tx=0x7f66f8054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.180+0000 7f65e0ff9640 1 -- 172.21.15.165:0/260704677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f80168f0 con 0x5589171206f0 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.180+0000 7f65e0ff9640 1 -- 172.21.15.165:0/260704677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f8032070 con 0x5589171206f0 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.180+0000 7f65e0ff9640 1 -- 172.21.15.165:0/260704677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f80561c0 con 0x5589171206f0 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.180+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589171284a0 con 0x5589171206f0 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.180+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558917128e20 con 0x5589171206f0 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.181+0000 7f65e0ff9640 1 -- 172.21.15.165:0/260704677 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f66f8014ad0 con 0x5589171206f0 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.181+0000 7f65e0ff9640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65c803cfb0 0x7f65c803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.181+0000 7f65e0ff9640 1 -- 172.21.15.165:0/260704677 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f66f800e040 con 0x5589171206f0 2024-09-22T08:11:04.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.181+0000 7f66fedd2640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65c803cfb0 0x7f65c803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.181+0000 7f66fedd2640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65c803cfb0 0x7f65c803f470 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f66f0001250 tx=0x7f66f0048000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.182+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.182+0000 7f6703122800 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917133780 0x558917135c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.182+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558917136390 con 0x558917133780 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.182+0000 7f66fe5d1640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917133780 0x558917135c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.182+0000 7f66fe5d1640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917133780 0x558917135c40 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.182+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.182+0000 7f6703122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.182+0000 7f6703122800 20 realm 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.182+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.182+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589171367c0 con 0x558917133780 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558917137090 con 0x558917133780 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558917137430 con 0x558917133780 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917138190 0x55891713a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55891713ab90 con 0x558917138190 2024-09-22T08:11:04.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f66ff5d3640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917138190 0x55891713a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.183+0000 7f66ff5d3640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917138190 0x55891713a580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.184+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.184+0000 7f6703122800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.184+0000 7f6703122800 20 searching for the correct realm 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.184+0000 7f6703122800 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55891713cb40 0x55891713f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.184+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x55891713cb40 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.184+0000 7f66fedd2640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55891713cb40 0x55891713f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.184+0000 7f66fedd2640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55891713cb40 0x55891713f000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.184+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.184+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917138190 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.185+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.185+0000 7f66ff5d3640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f66f8014070 0x7f66f8045960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.185+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x7f66f8014070 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.185+0000 7f66fe5d1640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f66f8014070 0x7f66f8045960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.185+0000 7f66fe5d1640 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f66f8014070 0x7f66f8045960 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.185+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.185+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917133780 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.186+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.186+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917133780 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.186+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.186+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x7f66f8014070 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.186+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.186+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x7f66f8014070 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.186+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.186+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917138190 2024-09-22T08:11:04.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.187+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.187+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x55891713cb40 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.187+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.187+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917133780 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.187+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.187+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x7f66f8014070 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.187+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.187+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917133780 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.188+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.188+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917138190 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.188+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.188+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x55891713cb40 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.188+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.188+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x55891713cb40 2024-09-22T08:11:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.188+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.188+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x7f66f8014070 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.189+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.189+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x55891713cb40 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.189+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.189+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x55891713cb40 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.189+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.189+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917133780 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.189+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.189+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917133780 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.189+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.189+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x7f66f8014070 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.190+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.190+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x55891713cb40 2024-09-22T08:11:04.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.190+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.190+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917138190 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.190+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.190+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917133780 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.190+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.191+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x7f66f8014070 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.191+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.191+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x55891713cb40 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.191+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.191+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x7f66f8014070 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.191+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.191+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917138190 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.192+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.192+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x55891713cb40 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.192+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.192+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x7f66f8014070 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.192+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.192+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917133780 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.192+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.192+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55891713f680 con 0x558917138190 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:04.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55891713b580 con 0x558917133780 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55891713be20 con 0x558917133780 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55891713fb00 con 0x558917133780 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 zone default found 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 4 Realm: () 2024-09-22T08:11:04.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 zonegroup default 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.193+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55891713ff00 con 0x7f66f8014070 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f6703122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558917141d30 con 0x55891713cb40 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f6703122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558917142210 con 0x55891713cb40 2024-09-22T08:11:04.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f6703122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f6703122800 20 started sync module instance, tier type = 2024-09-22T08:11:04.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f6703122800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:04.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.194+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589171411d0 con 0x558917138190 2024-09-22T08:11:04.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.195+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.195+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94047286072768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917142b20 con 0x558917138190 2024-09-22T08:11:04.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.195+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917143370 con 0x558917133780 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.196+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94047286072768] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.197+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.197+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94047286077040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917142fe0 con 0x558917133780 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.197+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917143b00 con 0x55891713cb40 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.199+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94047286077040] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.199+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.199+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94047286080976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917143ef0 con 0x55891713cb40 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.199+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917144930 con 0x558917138190 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.202+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94047286080976] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.202+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.202+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94047286084608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917144d20 con 0x558917138190 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.202+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917145780 con 0x558917133780 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.203+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.203+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94047286088288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917145780 con 0x558917133780 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.203+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917146700 con 0x7f66f8014070 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.205+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.205+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94047286092272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589171466c0 con 0x7f66f8014070 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.205+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917147650 con 0x7f66f8014070 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.205+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94047286084608] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.206+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94047286092272] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.206+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.206+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94047286078096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589171471a0 con 0x7f66f8014070 2024-09-22T08:11:04.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.206+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917147b60 con 0x7f66f8014070 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.207+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94047286078096] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.208+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94047286088288] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.208+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.208+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94047286090608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589171476b0 con 0x7f66f8014070 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.208+0000 7f6703122800 20 add_watcher() i=0 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.208+0000 7f6703122800 20 add_watcher() i=1 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.208+0000 7f6703122800 20 add_watcher() i=2 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.208+0000 7f6703122800 20 add_watcher() i=3 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.208+0000 7f6703122800 20 add_watcher() i=4 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.208+0000 7f6703122800 20 add_watcher() i=5 2024-09-22T08:11:04.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.208+0000 7f6703122800 20 add_watcher() i=6 2024-09-22T08:11:04.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.209+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94047286090608] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.209+0000 7f6703122800 20 add_watcher() i=7 2024-09-22T08:11:04.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.209+0000 7f6703122800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.209+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55891714ab90 con 0x558917133780 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.209+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.209+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94047286097584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917148050 con 0x558917133780 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94047286097584] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f65b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f6703122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f6703122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f6703122800 5 note: GC not initialized 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f652ffff640 20 reqs_thread_entry: start 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f6703122800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f6703122800 20 Filter name: none 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f652dffb640 20 reqs_thread_entry: start 2024-09-22T08:11:04.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f6703122800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:04.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f6703122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.211+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55891717de10 con 0x558917133780 2024-09-22T08:11:04.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.212+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.212+0000 7f6703122800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:04.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.212+0000 7f6703122800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:04.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.212+0000 7f6703122800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.212+0000 7f6703122800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:04.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.212+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589171808a0 con 0x558917138190 2024-09-22T08:11:04.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.212+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.212+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917184000 con 0x558917133780 2024-09-22T08:11:04.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.213+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.213+0000 7f6703122800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:04.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.213+0000 7f6703122800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.213+0000 7f6703122800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.213+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94047286344192 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55891717f890 con 0x558917133780 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.214+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 94047286088288 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f66f4082040 con 0x558917133780 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.214+0000 7f65e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94047286088288 notifier 4325 bl.length()=567 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.214+0000 7f65e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.214+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(65 notify.4 [notify cookie 94047286344192 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.214+0000 7f65e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.214+0000 7f65e27fc640 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f65c4003ea0 con 0x558917133780 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.214+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.214+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 94047286344192 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5589170000e0 con 0x558917133780 2024-09-22T08:11:04.217 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:04.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.215+0000 7f65b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.215+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94047286097584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55891717bb50 con 0x558917133780 2024-09-22T08:11:04.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.216+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94047286097584] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.216+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94047286072768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55891717bb50 con 0x558917138190 2024-09-22T08:11:04.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.217+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94047286072768] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.217+0000 7f6703122800 20 remove_watcher() i=0 2024-09-22T08:11:04.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.217+0000 7f6703122800 2 removed watcher, disabling cache 2024-09-22T08:11:04.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.217+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94047286077040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55891717bb50 con 0x558917133780 2024-09-22T08:11:04.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.219+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94047286077040] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.219+0000 7f6703122800 20 remove_watcher() i=1 2024-09-22T08:11:04.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.219+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94047286080976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55891717bb50 con 0x55891713cb40 2024-09-22T08:11:04.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.220+0000 7f66fedd2640 1 -- 172.21.15.165:0/260704677 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94047286080976] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f00187b0 con 0x55891713cb40 2024-09-22T08:11:04.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.220+0000 7f6703122800 20 remove_watcher() i=2 2024-09-22T08:11:04.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.220+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94047286084608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589171415c0 con 0x558917138190 2024-09-22T08:11:04.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.221+0000 7f66ff5d3640 1 -- 172.21.15.165:0/260704677 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94047286084608] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f802a070 con 0x558917138190 2024-09-22T08:11:04.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.221+0000 7f6703122800 20 remove_watcher() i=3 2024-09-22T08:11:04.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.221+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94047286088288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917142670 con 0x558917133780 2024-09-22T08:11:04.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.224+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94047286088288] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x558917133780 2024-09-22T08:11:04.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.224+0000 7f6703122800 20 remove_watcher() i=4 2024-09-22T08:11:04.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.224+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94047286092272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589171415c0 con 0x7f66f8014070 2024-09-22T08:11:04.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.225+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94047286092272] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.225+0000 7f6703122800 20 remove_watcher() i=5 2024-09-22T08:11:04.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.225+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94047286078096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558917142670 con 0x7f66f8014070 2024-09-22T08:11:04.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.226+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94047286078096] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.226+0000 7f6703122800 20 remove_watcher() i=6 2024-09-22T08:11:04.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.226+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94047286090608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589171415c0 con 0x7f66f8014070 2024-09-22T08:11:04.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.227+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94047286090608] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f4051070 con 0x7f66f8014070 2024-09-22T08:11:04.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.227+0000 7f6703122800 20 remove_watcher() i=7 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f66f8014070 msgr2=0x7f66f8045960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f66f8014070 0x7f66f8045960 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917133780 msgr2=0x558917135c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917133780 0x558917135c40 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917138190 msgr2=0x55891713a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917138190 0x55891713a580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55891713cb40 msgr2=0x55891713f000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55891713cb40 0x55891713f000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65c803cfb0 msgr2=0x7f65c803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65c803cfb0 0x7f65c803f470 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f66f0001250 tx=0x7f66f0048000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 msgr2=0x558917127cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 --2- 172.21.15.165:0/260704677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5589171206f0 0x558917127cb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f66f80016e0 tx=0x7f66f8054720 comp rx=0 tx=0).stop 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 reap_dead start 2024-09-22T08:11:04.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f66fe5d1640 1 -- 172.21.15.165:0/260704677 reap_dead start 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 shutdown_connections 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 >> 172.21.15.165:0/260704677 conn(0x55891711caf0 msgr2=0x55891711ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 shutdown_connections 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/260704677 wait complete. 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/2039751627 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65d803cfb0 msgr2=0x7f65d803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 --2- 172.21.15.165:0/2039751627 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65d803cfb0 0x7f65d803f470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5589170fad30 tx=0x7f66f0052920 comp rx=0 tx=0).stop 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/2039751627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917113c30 msgr2=0x558917114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 --2- 172.21.15.165:0/2039751627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917113c30 0x558917114050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5589170f9af0 tx=0x7f66f8018830 comp rx=0 tx=0).stop 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/2039751627 shutdown_connections 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 --2- 172.21.15.165:0/2039751627 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65d803cfb0 0x7f65d803f470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 --2- 172.21.15.165:0/2039751627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558917113c30 0x558917114050 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/2039751627 >> 172.21.15.165:0/2039751627 conn(0x558917107fe0 msgr2=0x5589171083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/2039751627 shutdown_connections 2024-09-22T08:11:04.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.228+0000 7f6703122800 1 -- 172.21.15.165:0/2039751627 wait complete. 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917000cb0 msgr2=0x5589171002b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917000cb0 0x5589171002b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917102650 msgr2=0x558917104af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917102650 0x558917104af0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65e403d000 msgr2=0x7f65e403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65e403d000 0x7f65e403f4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f66f4057000 tx=0x7f66f4052000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 msgr2=0x5589170f8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x5589170f8c60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c010 tx=0x7f66f0000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 shutdown_connections 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558917102650 0x558917104af0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558917000cb0 0x5589171002b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65e403d000 0x7f65e403f4c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 --2- 172.21.15.165:0/772379862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558916fff9e0 0x5589170f8c60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 >> 172.21.15.165:0/772379862 conn(0x558916ffadb0 msgr2=0x5589170ea450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 shutdown_connections 2024-09-22T08:11:04.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.229+0000 7f6703122800 1 -- 172.21.15.165:0/772379862 wait complete. 2024-09-22T08:11:04.238 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:04.238 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:11:04.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:11:04.239 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:11:04.283 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:04.283 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:04.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.283+0000 7f6a70132800 1 Processor -- start 2024-09-22T08:11:04.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.283+0000 7f6a70132800 1 -- start start 2024-09-22T08:11:04.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.283+0000 7f6a70132800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b4183afbf0 0x55b4183b5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.283+0000 7f6a70132800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b41823aa20 con 0x55b4183ae7e0 2024-09-22T08:11:04.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.283+0000 7f6a70132800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b41823a7d0 con 0x55b4183afbf0 2024-09-22T08:11:04.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.283+0000 7f6a63fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b4183afbf0 0x55b4183b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.283+0000 7f6a6bdbc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b4183ae7e0 0x55b4183af4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33516/0 (socket says 172.21.15.165:33516) 2024-09-22T08:11:04.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.283+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/1568223715 learned_addr learned my addr 172.21.15.165:0/1568223715 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:04.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.284+0000 7f6a63fff640 1 -- 172.21.15.165:0/1568223715 >> v1:172.21.15.53:6789/0 conn(0x55b4183ae7e0 legacy=0x55b4183af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.284+0000 7f6a63fff640 1 -- 172.21.15.165:0/1568223715 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4183aeee0 con 0x55b4183afbf0 2024-09-22T08:11:04.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.285+0000 7f6a63fff640 1 --2- 172.21.15.165:0/1568223715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183afbf0 0x55b4183b5580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400a470 tx=0x7f6a54045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8866a92f76428db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.285+0000 7f6a6b5bb640 1 -- 172.21.15.165:0/1568223715 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a54053570 con 0x55b4183afbf0 2024-09-22T08:11:04.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.285+0000 7f6a6b5bb640 1 -- 172.21.15.165:0/1568223715 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a54058070 con 0x55b4183afbf0 2024-09-22T08:11:04.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.285+0000 7f6a6b5bb640 1 -- 172.21.15.165:0/1568223715 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a54053880 con 0x55b4183afbf0 2024-09-22T08:11:04.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.286+0000 7f6a70132800 1 -- 172.21.15.165:0/1568223715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183afbf0 msgr2=0x55b4183b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.286+0000 7f6a70132800 1 --2- 172.21.15.165:0/1568223715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183afbf0 0x55b4183b5580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400a470 tx=0x7f6a54045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:04.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.286+0000 7f6a70132800 1 -- 172.21.15.165:0/1568223715 shutdown_connections 2024-09-22T08:11:04.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.286+0000 7f6a70132800 1 --2- 172.21.15.165:0/1568223715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183afbf0 0x55b4183b5580 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.286+0000 7f6a70132800 1 -- 172.21.15.165:0/1568223715 >> 172.21.15.165:0/1568223715 conn(0x55b4183a9bb0 msgr2=0x55b4183ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.286+0000 7f6a70132800 1 -- 172.21.15.165:0/1568223715 shutdown_connections 2024-09-22T08:11:04.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.286+0000 7f6a70132800 1 -- 172.21.15.165:0/1568223715 wait complete. 2024-09-22T08:11:04.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.300+0000 7f6a70132800 1 Processor -- start 2024-09-22T08:11:04.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.300+0000 7f6a70132800 1 -- start start 2024-09-22T08:11:04.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.300+0000 7f6a70132800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4183229b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.300+0000 7f6a70132800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b418247dd0 con 0x55b4183ae7e0 2024-09-22T08:11:04.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.300+0000 7f6a6bdbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4183229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.300+0000 7f6a6bdbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4183229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51042/0 (socket says 172.21.15.165:51042) 2024-09-22T08:11:04.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.300+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/4059632600 learned_addr learned my addr 172.21.15.165:0/4059632600 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.300+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/4059632600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4184a1bc0 con 0x55b4183ae7e0 2024-09-22T08:11:04.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6a6bdbc640 1 --2- 172.21.15.165:0/4059632600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4183229b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c001e40 tx=0x7f6a5c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb26de1b7cf2df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6959e0b640 1 -- 172.21.15.165:0/4059632600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c012020 con 0x55b4183ae7e0 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6959e0b640 1 -- 172.21.15.165:0/4059632600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c00e5a0 con 0x55b4183ae7e0 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6959e0b640 1 -- 172.21.15.165:0/4059632600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c00e8a0 con 0x55b4183ae7e0 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6a70132800 1 -- 172.21.15.165:0/4059632600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 msgr2=0x55b4183229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6a70132800 1 --2- 172.21.15.165:0/4059632600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4183229b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c001e40 tx=0x7f6a5c001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6a70132800 1 -- 172.21.15.165:0/4059632600 shutdown_connections 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6a70132800 1 --2- 172.21.15.165:0/4059632600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4183229b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6a70132800 1 -- 172.21.15.165:0/4059632600 >> 172.21.15.165:0/4059632600 conn(0x55b4183a9bb0 msgr2=0x55b418499880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6a70132800 1 -- 172.21.15.165:0/4059632600 shutdown_connections 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.301+0000 7f6a70132800 1 -- 172.21.15.165:0/4059632600 wait complete. 2024-09-22T08:11:04.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.302+0000 7f6a70132800 1 Processor -- start 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.302+0000 7f6a70132800 1 -- start start 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.302+0000 7f6a70132800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4184a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.302+0000 7f6a70132800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b4183b5ac0 con 0x55b4183ae7e0 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.302+0000 7f6a6bdbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4184a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.302+0000 7f6a6bdbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4184a6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51046/0 (socket says 172.21.15.165:51046) 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.302+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3064938472 learned_addr learned my addr 172.21.15.165:0/3064938472 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.302+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3064938472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4184a70b0 con 0x55b4183ae7e0 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.303+0000 7f6a6bdbc640 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4184a6b50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00c010 tx=0x7f6a5c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.303+0000 7f6953fff640 1 -- 172.21.15.165:0/3064938472 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c012030 con 0x55b4183ae7e0 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.303+0000 7f6953fff640 1 -- 172.21.15.165:0/3064938472 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c0014a0 con 0x55b4183ae7e0 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.303+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4184a7340 con 0x55b4183ae7e0 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.303+0000 7f6953fff640 1 -- 172.21.15.165:0/3064938472 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c01a7a0 con 0x55b4183ae7e0 2024-09-22T08:11:04.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.303+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4184a7d40 con 0x55b4183ae7e0 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.304+0000 7f6953fff640 1 -- 172.21.15.165:0/3064938472 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6a5c015020 con 0x55b4183ae7e0 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.304+0000 7f6953fff640 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f695403d000 0x7f695403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.304+0000 7f6953fff640 1 -- 172.21.15.165:0/3064938472 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6a5c020030 con 0x55b4183ae7e0 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.304+0000 7f6a63fff640 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f695403d000 0x7f695403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.304+0000 7f6a70132800 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4183afbf0 0x55b4184ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.304+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184a88d0 con 0x55b4183afbf0 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.304+0000 7f6a6c5bd640 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4183afbf0 0x55b4184ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.304+0000 7f6a63fff640 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f695403d000 0x7f695403f4c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a54057000 tx=0x7f6a54052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.305+0000 7f6a6c5bd640 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4183afbf0 0x55b4184ae1a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.305+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3064938472 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x55b4183afbf0 2024-09-22T08:11:04.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.305+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184a81d0 con 0x55b4183afbf0 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.305+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3064938472 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a6400a4d0 con 0x55b4183afbf0 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.305+0000 7f6a70132800 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184b0610 0x55b4184b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.305+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184b30d0 con 0x55b4184b0610 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.305+0000 7f6a6bdbc640 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184b0610 0x55b4184b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.305+0000 7f6a6bdbc640 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184b0610 0x55b4184b2a00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.306+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3064938472 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184b0610 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.306+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184af4b0 con 0x55b4183afbf0 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.306+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3064938472 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a6400a4d0 con 0x55b4183afbf0 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.306+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184af950 con 0x55b4183afbf0 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.306+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3064938472 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a6400a4d0 con 0x55b4183afbf0 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.307+0000 7f6a70132800 1 Processor -- start 2024-09-22T08:11:04.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.307+0000 7f6a70132800 1 -- start start 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.307+0000 7f6a70132800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184c1a50 0x55b4184c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.307+0000 7f6a70132800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b4182a6d50 con 0x55b4184c1a50 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.307+0000 7f6a6c5bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184c1a50 0x55b4184c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.307+0000 7f6a6c5bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184c1a50 0x55b4184c1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51060/0 (socket says 172.21.15.165:51060) 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.307+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3943519794 learned_addr learned my addr 172.21.15.165:0/3943519794 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.307+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3943519794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4184c24b0 con 0x55b4184c1a50 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.308+0000 7f6a6c5bd640 1 --2- 172.21.15.165:0/3943519794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184c1a50 0x55b4184c1e70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55b4184ae6e0 tx=0x7f6a64018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.308+0000 7f69517fa640 1 -- 172.21.15.165:0/3943519794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64014450 con 0x55b4184c1a50 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.308+0000 7f69517fa640 1 -- 172.21.15.165:0/3943519794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a640145f0 con 0x55b4184c1a50 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.308+0000 7f6a70132800 1 -- 172.21.15.165:0/3943519794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4184c2ce0 con 0x55b4184c1a50 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.308+0000 7f69517fa640 1 -- 172.21.15.165:0/3943519794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64014910 con 0x55b4184c1a50 2024-09-22T08:11:04.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.308+0000 7f6a70132800 1 -- 172.21.15.165:0/3943519794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4184c3280 con 0x55b4184c1a50 2024-09-22T08:11:04.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f69517fa640 1 -- 172.21.15.165:0/3943519794 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6a64011040 con 0x55b4184c1a50 2024-09-22T08:11:04.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f69517fa640 1 --2- 172.21.15.165:0/3943519794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f694403cfb0 0x7f694403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f69517fa640 1 -- 172.21.15.165:0/3943519794 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6a6401e070 con 0x55b4184c1a50 2024-09-22T08:11:04.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f6a6bdbc640 1 --2- 172.21.15.165:0/3943519794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f694403cfb0 0x7f694403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f6a70132800 1 Processor -- start 2024-09-22T08:11:04.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f6a70132800 1 -- start start 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f6a6bdbc640 1 --2- 172.21.15.165:0/3943519794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f694403cfb0 0x7f694403f470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55b4184ae780 tx=0x7f6a5c052990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f6a70132800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f6a70132800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b4184a1ea0 con 0x55b4184ce510 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f6a6c5bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f6a6c5bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51070/0 (socket says 172.21.15.165:51070) 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.309+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/560590079 learned_addr learned my addr 172.21.15.165:0/560590079 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.310+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/560590079 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4184ceee0 con 0x55b4184ce510 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.310+0000 7f6a6c5bd640 1 --2- 172.21.15.165:0/560590079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184ce8f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6a64016fd0 tx=0x7f6a64011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4f099baac563e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.310+0000 7f694affd640 1 -- 172.21.15.165:0/560590079 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6404b070 con 0x55b4184ce510 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.310+0000 7f694affd640 1 -- 172.21.15.165:0/560590079 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a64051070 con 0x55b4184ce510 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.310+0000 7f694affd640 1 -- 172.21.15.165:0/560590079 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64022db0 con 0x55b4184ce510 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.310+0000 7f6a70132800 1 -- 172.21.15.165:0/560590079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 msgr2=0x55b4184ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.310+0000 7f6a70132800 1 --2- 172.21.15.165:0/560590079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184ce8f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6a64016fd0 tx=0x7f6a64011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.310+0000 7f6a70132800 1 -- 172.21.15.165:0/560590079 shutdown_connections 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.310+0000 7f6a70132800 1 --2- 172.21.15.165:0/560590079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184ce8f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.310+0000 7f6a70132800 1 -- 172.21.15.165:0/560590079 >> 172.21.15.165:0/560590079 conn(0x55b4184ca910 msgr2=0x55b4184c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.311+0000 7f6a70132800 1 -- 172.21.15.165:0/560590079 shutdown_connections 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.311+0000 7f6a70132800 1 -- 172.21.15.165:0/560590079 wait complete. 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.311+0000 7f6a70132800 1 Processor -- start 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.311+0000 7f6a70132800 1 -- start start 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.311+0000 7f6a70132800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184d5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.311+0000 7f6a70132800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b4184cf520 con 0x55b4184ce510 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.311+0000 7f6a6c5bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.311+0000 7f6a6c5bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184d5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51076/0 (socket says 172.21.15.165:51076) 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.311+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 learned_addr learned my addr 172.21.15.165:0/3663780855 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.311+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4184d6020 con 0x55b4184ce510 2024-09-22T08:11:04.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.312+0000 7f6a6c5bd640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184d5ac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6a64053630 tx=0x7f6a64054740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.312+0000 7f69497fa640 1 -- 172.21.15.165:0/3663780855 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6404b030 con 0x55b4184ce510 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.312+0000 7f69497fa640 1 -- 172.21.15.165:0/3663780855 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a64011330 con 0x55b4184ce510 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.312+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4184d62b0 con 0x55b4184ce510 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.312+0000 7f69497fa640 1 -- 172.21.15.165:0/3663780855 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64054bc0 con 0x55b4184ce510 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.312+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4184d6e40 con 0x55b4184ce510 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.312+0000 7f69497fa640 1 -- 172.21.15.165:0/3663780855 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6a64045980 con 0x55b4184ce510 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.313+0000 7f69497fa640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f693403cfb0 0x7f693403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.313+0000 7f69497fa640 1 -- 172.21.15.165:0/3663780855 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6a6404c070 con 0x55b4184ce510 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.313+0000 7f6a6bdbc640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f693403cfb0 0x7f693403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.313+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.313+0000 7f6a70132800 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4184e1570 0x55b4184e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.313+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184e4180 con 0x55b4184e1570 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.313+0000 7f6a63fff640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4184e1570 0x55b4184e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.313+0000 7f6a6bdbc640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f693403cfb0 0x7f693403f470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55b4184b34b0 tx=0x7f6a5c04e070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.313+0000 7f6a63fff640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4184e1570 0x55b4184e3a30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 20 realm 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184e45b0 con 0x55b4184e1570 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184e4e80 con 0x55b4184e1570 2024-09-22T08:11:04.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184e5220 con 0x55b4184e1570 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184e5f80 0x55b4184e8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.314+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184e88b0 con 0x55b4184e5f80 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.315+0000 7f6a6c5bd640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184e5f80 0x55b4184e8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.315+0000 7f6a6c5bd640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184e5f80 0x55b4184e8370 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.315+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a6403c020 con 0x55b4184e5f80 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.315+0000 7f6a70132800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:04.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.315+0000 7f6a70132800 20 searching for the correct realm 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.315+0000 7f6a70132800 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b4184ea8f0 0x55b4184ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.315+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184ea8f0 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.315+0000 7f6a6bdbc640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b4184ea8f0 0x55b4184ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.316+0000 7f6a6bdbc640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b4184ea8f0 0x55b4184ecdb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.316+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.316+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e5f80 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.316+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a6403c020 con 0x55b4184e5f80 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.316+0000 7f6a6c5bd640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6a64014070 0x7f6a64023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.316+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x7f6a64014070 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.316+0000 7f6a63fff640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6a64014070 0x7f6a64023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.317+0000 7f6a63fff640 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6a64014070 0x7f6a64023420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.317+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.317+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e1570 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.317+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.317+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e1570 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.317+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.317+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x7f6a64014070 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.318+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.318+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x7f6a64014070 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.318+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.318+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e5f80 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.318+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.318+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184ea8f0 2024-09-22T08:11:04.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.318+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.318+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e1570 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.319+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.319+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x7f6a64014070 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.319+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.319+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e1570 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.319+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.319+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e5f80 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.319+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.320+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184ea8f0 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.320+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.320+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184ea8f0 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.320+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.320+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x7f6a64014070 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.320+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.320+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184ea8f0 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.321+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.321+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184ea8f0 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.321+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.321+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e1570 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.321+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.321+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e1570 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.321+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.321+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x7f6a64014070 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.322+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.322+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184ea8f0 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.322+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.322+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e5f80 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.322+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.322+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e1570 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.322+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.322+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x7f6a64014070 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.323+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.323+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184ea8f0 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.323+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.323+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x7f6a64014070 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.323+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.323+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e5f80 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.323+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.323+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184ea8f0 2024-09-22T08:11:04.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.323+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x7f6a64014070 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e1570 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ed480 con 0x55b4184e5f80 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a70132800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a70132800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a70132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a70132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a70132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a70132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.324+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184e9350 con 0x55b4184e1570 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184e8f60 con 0x55b4184e1570 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184e9cc0 con 0x55b4184e1570 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 20 zone default found 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 4 Realm: () 2024-09-22T08:11:04.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 20 zonegroup default 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184e9820 con 0x7f6a64014070 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.325+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ef8f0 con 0x55b4184ea8f0 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.326+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.326+0000 7f6a70132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.326+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.326+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184efce0 con 0x55b4184ea8f0 2024-09-22T08:11:04.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.326+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.326+0000 7f6a70132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.326+0000 7f6a70132800 20 started sync module instance, tier type = 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.326+0000 7f6a70132800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.326+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184eec90 con 0x55b4184e5f80 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.327+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.327+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94231990300848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184ee8f0 con 0x55b4184e5f80 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.327+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f0bf0 con 0x55b4184e1570 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.328+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94231990300848] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.329+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.329+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94231990305056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f0bf0 con 0x55b4184e1570 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.329+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f1690 con 0x55b4184ea8f0 2024-09-22T08:11:04.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.331+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.331+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94231990309248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f1f60 con 0x55b4184ea8f0 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.331+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f2a10 con 0x55b4184e5f80 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.331+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94231990305056] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.332+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94231990309248] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.332+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.332+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94231990311600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f2520 con 0x55b4184e5f80 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.332+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f3450 con 0x55b4184e1570 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.333+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.333+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94231990316960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f3870 con 0x55b4184e1570 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.333+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f42c0 con 0x7f6a64014070 2024-09-22T08:11:04.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.333+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94231990311600] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.334+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94231990316960] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.334+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.334+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94231990320560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f33c0 con 0x7f6a64014070 2024-09-22T08:11:04.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.334+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f48a0 con 0x7f6a64014070 2024-09-22T08:11:04.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.335+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.335+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94231990322160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f4cc0 con 0x7f6a64014070 2024-09-22T08:11:04.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.335+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f56e0 con 0x7f6a64014070 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.335+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94231990320560] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.336+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.336+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94231990325712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f56a0 con 0x7f6a64014070 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.336+0000 7f6a70132800 20 add_watcher() i=0 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.336+0000 7f6a70132800 20 add_watcher() i=1 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.336+0000 7f6a70132800 20 add_watcher() i=2 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.336+0000 7f6a70132800 20 add_watcher() i=3 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.336+0000 7f6a70132800 20 add_watcher() i=4 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.336+0000 7f6a70132800 20 add_watcher() i=5 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.336+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94231990322160] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.336+0000 7f6a70132800 20 add_watcher() i=6 2024-09-22T08:11:04.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.337+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94231990325712] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.337+0000 7f6a70132800 20 add_watcher() i=7 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.337+0000 7f6a70132800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.337+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f48b0 con 0x55b4184e1570 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.338+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.338+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94231990306624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f5f50 con 0x55b4184e1570 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94231990306624] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f6921fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f6a70132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f6a70132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f6a70132800 5 note: GC not initialized 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f6920fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f6a70132800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f6a70132800 20 Filter name: none 2024-09-22T08:11:04.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f689a7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:04.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f6a70132800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.339+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b41852b580 con 0x55b4184e1570 2024-09-22T08:11:04.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.340+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.340+0000 7f6a70132800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:04.348 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:04.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.340+0000 7f6921fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.341+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94231990306624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f7e30 con 0x55b4184e1570 2024-09-22T08:11:04.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.341+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94231990306624] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.341+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94231990300848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f0740 con 0x55b4184e5f80 2024-09-22T08:11:04.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.342+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94231990300848] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.342+0000 7f6a70132800 20 remove_watcher() i=0 2024-09-22T08:11:04.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.342+0000 7f6a70132800 2 removed watcher, disabling cache 2024-09-22T08:11:04.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.342+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94231990305056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f0740 con 0x55b4184e1570 2024-09-22T08:11:04.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.344+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94231990305056] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.344+0000 7f6a70132800 20 remove_watcher() i=1 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.344+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94231990309248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f0120 con 0x55b4184ea8f0 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.345+0000 7f6a6bdbc640 1 -- 172.21.15.165:0/3663780855 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94231990309248] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c0187b0 con 0x55b4184ea8f0 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.345+0000 7f6a70132800 20 remove_watcher() i=2 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.345+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94231990311600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f0740 con 0x55b4184e5f80 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.346+0000 7f6a6c5bd640 1 -- 172.21.15.165:0/3663780855 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94231990311600] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a64060040 con 0x55b4184e5f80 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.346+0000 7f6a70132800 20 remove_watcher() i=3 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.346+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94231990316960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f1ab0 con 0x55b4184e1570 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.347+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94231990316960] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x55b4184e1570 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.347+0000 7f6a70132800 20 remove_watcher() i=4 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.347+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94231990320560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f0740 con 0x7f6a64014070 2024-09-22T08:11:04.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.348+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94231990320560] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.348+0000 7f6a70132800 20 remove_watcher() i=5 2024-09-22T08:11:04.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.348+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94231990322160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f2fa0 con 0x7f6a64014070 2024-09-22T08:11:04.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.349+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94231990322160] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.349+0000 7f6a70132800 20 remove_watcher() i=6 2024-09-22T08:11:04.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.349+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94231990325712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4184f1ab0 con 0x7f6a64014070 2024-09-22T08:11:04.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94231990325712] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a54051070 con 0x7f6a64014070 2024-09-22T08:11:04.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 20 remove_watcher() i=7 2024-09-22T08:11:04.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6a64014070 msgr2=0x7f6a64023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6a64014070 0x7f6a64023420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4184e1570 msgr2=0x55b4184e3a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4184e1570 0x55b4184e3a30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184e5f80 msgr2=0x55b4184e8370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184e5f80 0x55b4184e8370 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b4184ea8f0 msgr2=0x55b4184ecdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b4184ea8f0 0x55b4184ecdb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f693403cfb0 msgr2=0x7f693403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f693403cfb0 0x7f693403f470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55b4184b34b0 tx=0x7f6a5c04e070 comp rx=0 tx=0).stop 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 msgr2=0x55b4184d5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 --2- 172.21.15.165:0/3663780855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184ce510 0x55b4184d5ac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6a64053630 tx=0x7f6a64054740 comp rx=0 tx=0).stop 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 reap_dead start 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a63fff640 1 -- 172.21.15.165:0/3663780855 reap_dead start 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 shutdown_connections 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 >> 172.21.15.165:0/3663780855 conn(0x55b4184ca910 msgr2=0x55b4184c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 shutdown_connections 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.350+0000 7f6a70132800 1 -- 172.21.15.165:0/3663780855 wait complete. 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3943519794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f694403cfb0 msgr2=0x7f694403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3943519794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f694403cfb0 0x7f694403f470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55b4184ae780 tx=0x7f6a5c052990 comp rx=0 tx=0).stop 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3943519794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184c1a50 msgr2=0x55b4184c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3943519794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184c1a50 0x55b4184c1e70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55b4184ae6e0 tx=0x7f6a64018830 comp rx=0 tx=0).stop 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3943519794 shutdown_connections 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3943519794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f694403cfb0 0x7f694403f470 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3943519794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4184c1a50 0x55b4184c1e70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3943519794 >> 172.21.15.165:0/3943519794 conn(0x55b4184b5e00 msgr2=0x55b4184b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3943519794 shutdown_connections 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3943519794 wait complete. 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4183afbf0 msgr2=0x55b4184ae1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4183afbf0 0x55b4184ae1a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184b0610 msgr2=0x55b4184b2a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184b0610 0x55b4184b2a00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f695403d000 msgr2=0x7f695403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f695403d000 0x7f695403f4c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a54057000 tx=0x7f6a54052000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 msgr2=0x55b4184a6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4184a6b50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00c010 tx=0x7f6a5c000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 shutdown_connections 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4184b0610 0x55b4184b2a00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4183afbf0 0x55b4184ae1a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f695403d000 0x7f695403f4c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 --2- 172.21.15.165:0/3064938472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4183ae7e0 0x55b4184a6b50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 >> 172.21.15.165:0/3064938472 conn(0x55b4183a9bb0 msgr2=0x55b418498070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 shutdown_connections 2024-09-22T08:11:04.361 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.351+0000 7f6a70132800 1 -- 172.21.15.165:0/3064938472 wait complete. 2024-09-22T08:11:04.362 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:04.362 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-22T08:11:04.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-22T08:11:04.362 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-22T08:11:04.411 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:04.411 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:04.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.411+0000 7f341bf2f800 1 Processor -- start 2024-09-22T08:11:04.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.411+0000 7f341bf2f800 1 -- start start 2024-09-22T08:11:04.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.411+0000 7f341bf2f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5641ecde3800 0x5641ecde4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.411+0000 7f341bf2f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641ecc6fa20 con 0x5641ecde4a40 2024-09-22T08:11:04.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.411+0000 7f341bf2f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5641ecc6f7d0 con 0x5641ecde3800 2024-09-22T08:11:04.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.411+0000 7f3417c76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5641ecde3800 0x5641ecde4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.411+0000 7f3417c76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5641ecde3800 0x5641ecde4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51092/0 (socket says 172.21.15.165:51092) 2024-09-22T08:11:04.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.411+0000 7f3417c76640 1 -- 172.21.15.165:0/2077067025 learned_addr learned my addr 172.21.15.165:0/2077067025 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.412+0000 7f3417c76640 1 -- 172.21.15.165:0/2077067025 >> v1:172.21.15.53:6789/0 conn(0x5641ecde4a40 legacy=0x5641ecde9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.412+0000 7f3417475640 1 -- 172.21.15.165:0/2077067025 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633567987 0 0) 0x5641ecc6fa20 con 0x5641ecde4a40 2024-09-22T08:11:04.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.412+0000 7f3417c76640 1 -- 172.21.15.165:0/2077067025 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ecde3f00 con 0x5641ecde3800 2024-09-22T08:11:04.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.413+0000 7f3417c76640 1 --2- 172.21.15.165:0/2077067025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecde4500 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f340800a520 tx=0x7f3408045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc182446398e649a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.413+0000 7f3417475640 1 -- 172.21.15.165:0/2077067025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3408055070 con 0x5641ecde3800 2024-09-22T08:11:04.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.414+0000 7f3417475640 1 -- 172.21.15.165:0/2077067025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34080515b0 con 0x5641ecde3800 2024-09-22T08:11:04.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.414+0000 7f3417475640 1 -- 172.21.15.165:0/2077067025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34080518d0 con 0x5641ecde3800 2024-09-22T08:11:04.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.414+0000 7f341bf2f800 1 -- 172.21.15.165:0/2077067025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 msgr2=0x5641ecde4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.414+0000 7f341bf2f800 1 --2- 172.21.15.165:0/2077067025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecde4500 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f340800a520 tx=0x7f3408045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.414+0000 7f341bf2f800 1 -- 172.21.15.165:0/2077067025 shutdown_connections 2024-09-22T08:11:04.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.414+0000 7f341bf2f800 1 --2- 172.21.15.165:0/2077067025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecde4500 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.414+0000 7f341bf2f800 1 -- 172.21.15.165:0/2077067025 >> 172.21.15.165:0/2077067025 conn(0x5641ecddebd0 msgr2=0x5641ecde1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.414+0000 7f341bf2f800 1 -- 172.21.15.165:0/2077067025 shutdown_connections 2024-09-22T08:11:04.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.414+0000 7f341bf2f800 1 -- 172.21.15.165:0/2077067025 wait complete. 2024-09-22T08:11:04.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.428+0000 7f341bf2f800 1 Processor -- start 2024-09-22T08:11:04.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.428+0000 7f341bf2f800 1 -- start start 2024-09-22T08:11:04.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.428+0000 7f341bf2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecd579d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.428+0000 7f341bf2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5641ecc7cdd0 con 0x5641ecde3800 2024-09-22T08:11:04.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.428+0000 7f3417c76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecd579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.428+0000 7f3417c76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecd579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51094/0 (socket says 172.21.15.165:51094) 2024-09-22T08:11:04.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.428+0000 7f3417c76640 1 -- 172.21.15.165:0/2972686095 learned_addr learned my addr 172.21.15.165:0/2972686095 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.429+0000 7f3417c76640 1 -- 172.21.15.165:0/2972686095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641eced6ab0 con 0x5641ecde3800 2024-09-22T08:11:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.429+0000 7f3417c76640 1 --2- 172.21.15.165:0/2972686095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecd579d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3408045be0 tx=0x7f3408051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bfdb4eb8b24aea server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.429+0000 7f3305e0b640 1 -- 172.21.15.165:0/2972686095 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3408051ac0 con 0x5641ecde3800 2024-09-22T08:11:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.429+0000 7f3305e0b640 1 -- 172.21.15.165:0/2972686095 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3408051c60 con 0x5641ecde3800 2024-09-22T08:11:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.429+0000 7f3305e0b640 1 -- 172.21.15.165:0/2972686095 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3408066460 con 0x5641ecde3800 2024-09-22T08:11:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 -- 172.21.15.165:0/2972686095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 msgr2=0x5641ecd579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 --2- 172.21.15.165:0/2972686095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecd579d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3408045be0 tx=0x7f3408051000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 -- 172.21.15.165:0/2972686095 shutdown_connections 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 --2- 172.21.15.165:0/2972686095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecd579d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 -- 172.21.15.165:0/2972686095 >> 172.21.15.165:0/2972686095 conn(0x5641ecddebd0 msgr2=0x5641ecece770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 -- 172.21.15.165:0/2972686095 shutdown_connections 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 -- 172.21.15.165:0/2972686095 wait complete. 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 Processor -- start 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 -- start start 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecedb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.430+0000 7f341bf2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5641ecde52b0 con 0x5641ecde3800 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.431+0000 7f3417c76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecedb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.431+0000 7f3417c76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecedb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51100/0 (socket says 172.21.15.165:51100) 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.431+0000 7f3417c76640 1 -- 172.21.15.165:0/3381747441 learned_addr learned my addr 172.21.15.165:0/3381747441 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.431+0000 7f3417c76640 1 -- 172.21.15.165:0/3381747441 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ecedbee0 con 0x5641ecde3800 2024-09-22T08:11:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.431+0000 7f3417c76640 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecedb980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3408045be0 tx=0x7f3408003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.431+0000 7f32fffff640 1 -- 172.21.15.165:0/3381747441 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f340805a600 con 0x5641ecde3800 2024-09-22T08:11:04.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.431+0000 7f32fffff640 1 -- 172.21.15.165:0/3381747441 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340805a7a0 con 0x5641ecde3800 2024-09-22T08:11:04.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.431+0000 7f32fffff640 1 -- 172.21.15.165:0/3381747441 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f340805aa80 con 0x5641ecde3800 2024-09-22T08:11:04.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.431+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641ecedc170 con 0x5641ecde3800 2024-09-22T08:11:04.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.431+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641ecedcb70 con 0x5641ecde3800 2024-09-22T08:11:04.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.432+0000 7f32fffff640 1 -- 172.21.15.165:0/3381747441 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3408058070 con 0x5641ecde3800 2024-09-22T08:11:04.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.432+0000 7f32fffff640 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f330003d000 0x7f330003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.432+0000 7f32fffff640 1 -- 172.21.15.165:0/3381747441 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3408062070 con 0x5641ecde3800 2024-09-22T08:11:04.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.432+0000 7f340ffff640 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f330003d000 0x7f330003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.432+0000 7f341bf2f800 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecde4a40 0x5641ecee2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.432+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecee3510 con 0x5641ecde4a40 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.433+0000 7f3418477640 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecde4a40 0x5641ecee2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.433+0000 7f340ffff640 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f330003d000 0x7f330003f4c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3400000f60 tx=0x7f34000013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.433+0000 7f3418477640 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecde4a40 0x5641ecee2fd0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.433+0000 7f3418477640 1 -- 172.21.15.165:0/3381747441 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f341000a4d0 con 0x5641ecde4a40 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.433+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecee38b0 con 0x5641ecde4a40 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.434+0000 7f3418477640 1 -- 172.21.15.165:0/3381747441 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f341000a4d0 con 0x5641ecde4a40 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.434+0000 7f341bf2f800 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecee53b0 0x5641ecee7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.434+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecee7fc0 con 0x5641ecee53b0 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.434+0000 7f3417c76640 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecee53b0 0x5641ecee7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.434+0000 7f3417c76640 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecee53b0 0x5641ecee7830 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.434+0000 7f3417c76640 1 -- 172.21.15.165:0/3381747441 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3408057030 con 0x5641ecee53b0 2024-09-22T08:11:04.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.434+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecee4100 con 0x5641ecde4a40 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.434+0000 7f3418477640 1 -- 172.21.15.165:0/3381747441 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f341000a4d0 con 0x5641ecde4a40 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.434+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecee4550 con 0x5641ecde4a40 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.435+0000 7f3418477640 1 -- 172.21.15.165:0/3381747441 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f341000a4d0 con 0x5641ecde4a40 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.435+0000 7f341bf2f800 1 Processor -- start 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.435+0000 7f341bf2f800 1 -- start start 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.435+0000 7f341bf2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641eced4220 0x5641eced2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.435+0000 7f341bf2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5641eccdbd50 con 0x5641eced4220 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.435+0000 7f3418477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641eced4220 0x5641eced2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.435+0000 7f3418477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641eced4220 0x5641eced2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51116/0 (socket says 172.21.15.165:51116) 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.435+0000 7f3418477640 1 -- 172.21.15.165:0/2404770731 learned_addr learned my addr 172.21.15.165:0/2404770731 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.436+0000 7f3418477640 1 -- 172.21.15.165:0/2404770731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641eced4740 con 0x5641eced4220 2024-09-22T08:11:04.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.436+0000 7f3418477640 1 --2- 172.21.15.165:0/2404770731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641eced4220 0x5641eced2a90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f341000a2a0 tx=0x7f3410018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.436+0000 7f32fd7fa640 1 -- 172.21.15.165:0/2404770731 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3410014450 con 0x5641eced4220 2024-09-22T08:11:04.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.436+0000 7f32fd7fa640 1 -- 172.21.15.165:0/2404770731 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34100145f0 con 0x5641eced4220 2024-09-22T08:11:04.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.436+0000 7f341bf2f800 1 -- 172.21.15.165:0/2404770731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641eced2fd0 con 0x5641eced4220 2024-09-22T08:11:04.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.436+0000 7f32fd7fa640 1 -- 172.21.15.165:0/2404770731 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3410014910 con 0x5641eced4220 2024-09-22T08:11:04.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.436+0000 7f341bf2f800 1 -- 172.21.15.165:0/2404770731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641eced3570 con 0x5641eced4220 2024-09-22T08:11:04.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.437+0000 7f32fd7fa640 1 -- 172.21.15.165:0/2404770731 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3410011040 con 0x5641eced4220 2024-09-22T08:11:04.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.437+0000 7f32fd7fa640 1 --2- 172.21.15.165:0/2404770731 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32f003d000 0x7f32f003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.437+0000 7f32fd7fa640 1 -- 172.21.15.165:0/2404770731 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f341001e070 con 0x5641eced4220 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.437+0000 7f3417c76640 1 --2- 172.21.15.165:0/2404770731 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32f003d000 0x7f32f003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.437+0000 7f341bf2f800 1 Processor -- start 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.437+0000 7f341bf2f800 1 -- start start 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.437+0000 7f3417c76640 1 --2- 172.21.15.165:0/2404770731 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32f003d000 0x7f32f003f4c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5641ecedda70 tx=0x7f3408065a60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.438+0000 7f341bf2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf05990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.438+0000 7f341bf2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5641eced6cb0 con 0x5641ecf055b0 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.438+0000 7f3418477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf05990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.438+0000 7f3418477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf05990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51118/0 (socket says 172.21.15.165:51118) 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.438+0000 7f3418477640 1 -- 172.21.15.165:0/1054908256 learned_addr learned my addr 172.21.15.165:0/1054908256 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.438+0000 7f3418477640 1 -- 172.21.15.165:0/1054908256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ecf05f80 con 0x5641ecf055b0 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.438+0000 7f3418477640 1 --2- 172.21.15.165:0/1054908256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf05990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3410016fd0 tx=0x7f3410011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7176a57484c22e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.438+0000 7f32f6ffd640 1 -- 172.21.15.165:0/1054908256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3410051020 con 0x5641ecf055b0 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.438+0000 7f32f6ffd640 1 -- 172.21.15.165:0/1054908256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3410016440 con 0x5641ecf055b0 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.438+0000 7f32f6ffd640 1 -- 172.21.15.165:0/1054908256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3410028070 con 0x5641ecf055b0 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 -- 172.21.15.165:0/1054908256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 msgr2=0x5641ecf05990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 --2- 172.21.15.165:0/1054908256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf05990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3410016fd0 tx=0x7f3410011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 -- 172.21.15.165:0/1054908256 shutdown_connections 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 --2- 172.21.15.165:0/1054908256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf05990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 -- 172.21.15.165:0/1054908256 >> 172.21.15.165:0/1054908256 conn(0x5641ecf019b0 msgr2=0x5641eceffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 -- 172.21.15.165:0/1054908256 shutdown_connections 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 -- 172.21.15.165:0/1054908256 wait complete. 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 Processor -- start 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 -- start start 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf0cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f341bf2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5641ecf065c0 con 0x5641ecf055b0 2024-09-22T08:11:04.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.439+0000 7f3418477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf0cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.440+0000 7f3418477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf0cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51128/0 (socket says 172.21.15.165:51128) 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.440+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 learned_addr learned my addr 172.21.15.165:0/273693920 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.440+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ecf0d0e0 con 0x5641ecf055b0 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.440+0000 7f3418477640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf0cb80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3410053660 tx=0x7f3410054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.440+0000 7f32f57fa640 1 -- 172.21.15.165:0/273693920 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3410011330 con 0x5641ecf055b0 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.440+0000 7f32f57fa640 1 -- 172.21.15.165:0/273693920 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3410032070 con 0x5641ecf055b0 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.440+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641ecf0d370 con 0x5641ecf055b0 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.440+0000 7f32f57fa640 1 -- 172.21.15.165:0/273693920 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3410045960 con 0x5641ecf055b0 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.440+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641ecf0dcf0 con 0x5641ecf055b0 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.441+0000 7f32f57fa640 1 -- 172.21.15.165:0/273693920 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3410045b90 con 0x5641ecf055b0 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.441+0000 7f32f57fa640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32e003cfb0 0x7f32e003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.441+0000 7f32f57fa640 1 -- 172.21.15.165:0/273693920 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f341000e040 con 0x5641ecf055b0 2024-09-22T08:11:04.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.441+0000 7f3417c76640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32e003cfb0 0x7f32e003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.441+0000 7f3417c76640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32e003cfb0 0x7f32e003f470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3408066040 tx=0x7f3408088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.442+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.442+0000 7f341bf2f800 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecf18660 0x5641ecf1ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.442+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf1b270 con 0x5641ecf18660 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.442+0000 7f340ffff640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecf18660 0x5641ecf1ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.442+0000 7f340ffff640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecf18660 0x5641ecf1ab20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.442+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34000104c0 con 0x5641ecf18660 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.442+0000 7f341bf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.442+0000 7f341bf2f800 20 realm 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.442+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.442+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf179b0 con 0x5641ecf18660 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34000104c0 con 0x5641ecf18660 2024-09-22T08:11:04.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf1bd60 con 0x5641ecf18660 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34000104c0 con 0x5641ecf18660 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf1c630 con 0x5641ecf18660 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34000104c0 con 0x5641ecf18660 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecf1d050 0x5641ecf1f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf1fb80 con 0x5641ecf1d050 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.443+0000 7f3418477640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecf1d050 0x5641ecf1f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.444+0000 7f3418477640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecf1d050 0x5641ecf1f440 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.444+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.444+0000 7f341bf2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.444+0000 7f341bf2f800 20 searching for the correct realm 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.444+0000 7f341bf2f800 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5641ecf21b30 0x5641ecf23ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.444+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf21b30 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.444+0000 7f3417c76640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5641ecf21b30 0x5641ecf23ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.444+0000 7f3417c76640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5641ecf21b30 0x5641ecf23ff0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.445+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.445+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf1d050 2024-09-22T08:11:04.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.445+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.445+0000 7f3418477640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3410014070 0x7f3410037460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.445+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x7f3410014070 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.445+0000 7f340ffff640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3410014070 0x7f3410037460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.446+0000 7f340ffff640 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3410014070 0x7f3410037460 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.446+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34000104c0 con 0x7f3410014070 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.446+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf18660 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.446+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34000104c0 con 0x5641ecf18660 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.446+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf18660 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.446+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f340002a040 con 0x5641ecf18660 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.446+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x7f3410014070 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.447+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340002a040 con 0x7f3410014070 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.447+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x7f3410014070 2024-09-22T08:11:04.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.447+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340002a040 con 0x7f3410014070 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.447+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf1d050 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.447+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.447+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf21b30 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.447+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.447+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf18660 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.448+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340002a040 con 0x5641ecf18660 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.448+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x7f3410014070 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.448+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340002a040 con 0x7f3410014070 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.448+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf18660 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.448+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340002a040 con 0x5641ecf18660 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.448+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf1d050 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.448+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.448+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf21b30 2024-09-22T08:11:04.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.449+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.449+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf21b30 2024-09-22T08:11:04.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.449+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.449+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x7f3410014070 2024-09-22T08:11:04.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.449+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340002a040 con 0x7f3410014070 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.449+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf21b30 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.449+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.449+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf21b30 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.449+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.449+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf18660 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.450+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340002a040 con 0x5641ecf18660 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.450+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf18660 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.450+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f340002a040 con 0x5641ecf18660 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.450+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x7f3410014070 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.450+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340002a040 con 0x7f3410014070 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.450+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf21b30 2024-09-22T08:11:04.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.450+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.450+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf1d050 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.451+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.451+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf18660 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.451+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340002a040 con 0x5641ecf18660 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.451+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x7f3410014070 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.451+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.452+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf21b30 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.452+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.452+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x7f3410014070 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.452+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.452+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf1d050 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.452+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.452+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf21b30 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.452+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.452+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x7f3410014070 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf18660 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24670 con 0x5641ecf1d050 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f341bf2f800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f341bf2f800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f341bf2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f341bf2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:04.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f341bf2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f341bf2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.453+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf20540 con 0x5641ecf18660 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf20de0 con 0x5641ecf18660 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24af0 con 0x5641ecf18660 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:04.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 20 zone default found 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 4 Realm: () 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 20 zonegroup default 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.454+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf24b50 con 0x7f3410014070 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f341bf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf26980 con 0x5641ecf21b30 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f341bf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf26e00 con 0x5641ecf21b30 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f341bf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f341bf2f800 20 started sync module instance, tier type = 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f341bf2f800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.455+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf25e20 con 0x5641ecf1d050 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.456+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.456+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94841148171072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf25e20 con 0x5641ecf1d050 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.456+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf278e0 con 0x5641ecf18660 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.457+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.457+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94841148171072] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.457+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94841148175312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf278a0 con 0x5641ecf18660 2024-09-22T08:11:04.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.457+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf283d0 con 0x5641ecf21b30 2024-09-22T08:11:04.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.458+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94841148175312] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.458+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.459+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94841148168560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf28770 con 0x5641ecf21b30 2024-09-22T08:11:04.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.459+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf29170 con 0x5641ecf1d050 2024-09-22T08:11:04.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.459+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94841148168560] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.460+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.460+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94841148177616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf29560 con 0x5641ecf1d050 2024-09-22T08:11:04.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.460+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf29fe0 con 0x5641ecf18660 2024-09-22T08:11:04.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.462+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94841148177616] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.465+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.465+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94841148185296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf29560 con 0x5641ecf18660 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.465+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf2aa50 con 0x7f3410014070 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.468+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94841148185296] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.468+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.468+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94841148187968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf2aa10 con 0x7f3410014070 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.468+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf2b460 con 0x7f3410014070 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.470+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94841148187968] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.471+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.471+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94841148181632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf2b460 con 0x7f3410014070 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.471+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf2be20 con 0x7f3410014070 2024-09-22T08:11:04.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.472+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.472+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94841148193136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf2c240 con 0x7f3410014070 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.472+0000 7f341bf2f800 20 add_watcher() i=0 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.472+0000 7f341bf2f800 20 add_watcher() i=1 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.472+0000 7f341bf2f800 20 add_watcher() i=2 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.472+0000 7f341bf2f800 20 add_watcher() i=3 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.472+0000 7f341bf2f800 20 add_watcher() i=4 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.472+0000 7f341bf2f800 20 add_watcher() i=5 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.472+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94841148181632] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.472+0000 7f341bf2f800 20 add_watcher() i=6 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.473+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94841148193136] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.473+0000 7f341bf2f800 20 add_watcher() i=7 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.473+0000 7f341bf2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:04.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.473+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf2b0a0 con 0x5641ecf18660 2024-09-22T08:11:04.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.473+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.473+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94841148194192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf2cc00 con 0x5641ecf18660 2024-09-22T08:11:04.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.474+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94841148194192] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.474+0000 7f32cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.474+0000 7f341bf2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:04.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.474+0000 7f341bf2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.474+0000 7f341bf2f800 5 note: GC not initialized 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.474+0000 7f32ccfe1640 20 reqs_thread_entry: start 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.474+0000 7f341bf2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.474+0000 7f341bf2f800 20 Filter name: none 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.474+0000 7f32467fc640 20 reqs_thread_entry: start 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf627b0 con 0x5641ecf18660 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:04.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf63220 con 0x7f3410014070 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.475+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf68b90 con 0x5641ecf18660 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.476+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.476+0000 7f341bf2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.476+0000 7f341bf2f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.476+0000 7f341bf2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.476+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94841148442000 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf64270 con 0x5641ecf18660 2024-09-22T08:11:04.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.477+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 94841148185296 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f340002e900 con 0x5641ecf18660 2024-09-22T08:11:04.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.477+0000 7f32f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94841148185296 notifier 4339 bl.length()=678 2024-09-22T08:11:04.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.477+0000 7f32f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:04.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.477+0000 7f32f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.477+0000 7f32f6ffd640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f32dc003ea0 con 0x5641ecf18660 2024-09-22T08:11:04.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.477+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(65 notify.4 [notify cookie 94841148442000 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.477+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.477+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 94841148442000 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f340002ead0 con 0x5641ecf18660 2024-09-22T08:11:04.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.477+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf68590 con 0x7f3410014070 2024-09-22T08:11:04.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.478+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.478+0000 7f341bf2f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:11:04.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.478+0000 7f341bf2f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:11:04.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.478+0000 7f341bf2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:11:04.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.478+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94841148442000 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf63dc0 con 0x5641ecf21b30 2024-09-22T08:11:04.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.479+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== watch-notify(notify (1) cookie 94841148168560 notify 137438953472 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f34080a1040 con 0x5641ecf21b30 2024-09-22T08:11:04.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.479+0000 7f32f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94841148168560 notifier 4339 bl.length()=177 2024-09-22T08:11:04.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.479+0000 7f32f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:11:04.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.479+0000 7f32f67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:11:04.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.479+0000 7f32f67fc640 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f324c003400 con 0x5641ecf21b30 2024-09-22T08:11:04.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.479+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(68 notify.2 [notify cookie 94841148442000 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.479+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.479+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== watch-notify(notify_complete (2) cookie 94841148442000 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641ecedcb70 con 0x5641ecf21b30 2024-09-22T08:11:04.483 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-22T08:11:04.476614Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:04.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.480+0000 7f32cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.480+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94841148194192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf646c0 con 0x5641ecf18660 2024-09-22T08:11:04.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.481+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94841148194192] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.481+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94841148171072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf60420 con 0x5641ecf1d050 2024-09-22T08:11:04.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.482+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94841148171072] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.482+0000 7f341bf2f800 20 remove_watcher() i=0 2024-09-22T08:11:04.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.482+0000 7f341bf2f800 2 removed watcher, disabling cache 2024-09-22T08:11:04.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.482+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94841148175312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf60420 con 0x5641ecf18660 2024-09-22T08:11:04.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.483+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94841148175312] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.483+0000 7f341bf2f800 20 remove_watcher() i=1 2024-09-22T08:11:04.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.483+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94841148168560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf60420 con 0x5641ecf21b30 2024-09-22T08:11:04.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.484+0000 7f3417c76640 1 -- 172.21.15.165:0/273693920 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94841148168560] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3408057030 con 0x5641ecf21b30 2024-09-22T08:11:04.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.484+0000 7f341bf2f800 20 remove_watcher() i=2 2024-09-22T08:11:04.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.484+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94841148177616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf60420 con 0x5641ecf1d050 2024-09-22T08:11:04.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.485+0000 7f3418477640 1 -- 172.21.15.165:0/273693920 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94841148177616] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f341002a070 con 0x5641ecf1d050 2024-09-22T08:11:04.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.485+0000 7f341bf2f800 20 remove_watcher() i=3 2024-09-22T08:11:04.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.485+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94841148185296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf60420 con 0x5641ecf18660 2024-09-22T08:11:04.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.486+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94841148185296] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x5641ecf18660 2024-09-22T08:11:04.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.486+0000 7f341bf2f800 20 remove_watcher() i=4 2024-09-22T08:11:04.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.486+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94841148187968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf60420 con 0x7f3410014070 2024-09-22T08:11:04.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.487+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94841148187968] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.487+0000 7f341bf2f800 20 remove_watcher() i=5 2024-09-22T08:11:04.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.487+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94841148181632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf60420 con 0x7f3410014070 2024-09-22T08:11:04.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.488+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94841148181632] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.488+0000 7f341bf2f800 20 remove_watcher() i=6 2024-09-22T08:11:04.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.488+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94841148193136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641ecf60420 con 0x7f3410014070 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94841148193136] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f340003a040 con 0x7f3410014070 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 20 remove_watcher() i=7 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3410014070 msgr2=0x7f3410037460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3410014070 0x7f3410037460 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecf18660 msgr2=0x5641ecf1ab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecf18660 0x5641ecf1ab20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecf1d050 msgr2=0x5641ecf1f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecf1d050 0x5641ecf1f440 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5641ecf21b30 msgr2=0x5641ecf23ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5641ecf21b30 0x5641ecf23ff0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32e003cfb0 msgr2=0x7f32e003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32e003cfb0 0x7f32e003f470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3408066040 tx=0x7f3408088000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 msgr2=0x5641ecf0cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 --2- 172.21.15.165:0/273693920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecf055b0 0x5641ecf0cb80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3410053660 tx=0x7f3410054720 comp rx=0 tx=0).stop 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 reap_dead start 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f340ffff640 1 -- 172.21.15.165:0/273693920 reap_dead start 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 shutdown_connections 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 >> 172.21.15.165:0/273693920 conn(0x5641ecf019b0 msgr2=0x5641eceffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 shutdown_connections 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.489+0000 7f341bf2f800 1 -- 172.21.15.165:0/273693920 wait complete. 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/2404770731 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32f003d000 msgr2=0x7f32f003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/2404770731 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32f003d000 0x7f32f003f4c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5641ecedda70 tx=0x7f3408065a60 comp rx=0 tx=0).stop 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/2404770731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641eced4220 msgr2=0x5641eced2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/2404770731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641eced4220 0x5641eced2a90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f341000a2a0 tx=0x7f3410018830 comp rx=0 tx=0).stop 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/2404770731 shutdown_connections 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/2404770731 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f32f003d000 0x7f32f003f4c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/2404770731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641eced4220 0x5641eced2a90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/2404770731 >> 172.21.15.165:0/2404770731 conn(0x5641eceeacf0 msgr2=0x5641eceeb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/2404770731 shutdown_connections 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/2404770731 wait complete. 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecde4a40 msgr2=0x5641ecee2fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecde4a40 0x5641ecee2fd0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecee53b0 msgr2=0x5641ecee7830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecee53b0 0x5641ecee7830 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f330003d000 msgr2=0x7f330003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f330003d000 0x7f330003f4c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3400000f60 tx=0x7f34000013f0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 msgr2=0x5641ecedb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecedb980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3408045be0 tx=0x7f3408003020 comp rx=0 tx=0).stop 2024-09-22T08:11:04.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 shutdown_connections 2024-09-22T08:11:04.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5641ecee53b0 0x5641ecee7830 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5641ecde4a40 0x5641ecee2fd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f330003d000 0x7f330003f4c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 --2- 172.21.15.165:0/3381747441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5641ecde3800 0x5641ecedb980 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 >> 172.21.15.165:0/3381747441 conn(0x5641ecddebd0 msgr2=0x5641ececcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 shutdown_connections 2024-09-22T08:11:04.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.490+0000 7f341bf2f800 1 -- 172.21.15.165:0/3381747441 wait complete. 2024-09-22T08:11:04.500 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-22T08:11:04.476614Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:04.500 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:11:04.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:11:04.500 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:11:04.545 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:04.545 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:04.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.545+0000 7f6e7a32a800 1 Processor -- start 2024-09-22T08:11:04.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.545+0000 7f6e7a32a800 1 -- start start 2024-09-22T08:11:04.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.545+0000 7f6e7a32a800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563570fd3b70 0x563570fd5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.545+0000 7f6e7a32a800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563570e5aa20 con 0x563570fd0060 2024-09-22T08:11:04.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.545+0000 7f6e7a32a800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563570e5a7d0 con 0x563570fd3b70 2024-09-22T08:11:04.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.546+0000 7f6e75760640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563570fd3b70 0x563570fd5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.546+0000 7f6e75f61640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563570fd0060 0x563570fd2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33532/0 (socket says 172.21.15.165:33532) 2024-09-22T08:11:04.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.546+0000 7f6e75f61640 1 -- 172.21.15.165:0/2958414388 learned_addr learned my addr 172.21.15.165:0/2958414388 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:04.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.546+0000 7f6e75760640 1 -- 172.21.15.165:0/2958414388 >> v1:172.21.15.53:6789/0 conn(0x563570fd0060 legacy=0x563570fd2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.546+0000 7f6e74f5f640 1 -- 172.21.15.165:0/2958414388 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2716244531 0 0) 0x563570e5aa20 con 0x563570fd0060 2024-09-22T08:11:04.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.546+0000 7f6e75760640 1 -- 172.21.15.165:0/2958414388 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563570fd7540 con 0x563570fd3b70 2024-09-22T08:11:04.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e75760640 1 --2- 172.21.15.165:0/2958414388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd3b70 0x563570fd5f60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000a470 tx=0x7f6e60045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc34208a33bb67d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e74f5f640 1 -- 172.21.15.165:0/2958414388 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e60053570 con 0x563570fd3b70 2024-09-22T08:11:04.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e74f5f640 1 -- 172.21.15.165:0/2958414388 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e60058070 con 0x563570fd3b70 2024-09-22T08:11:04.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e74f5f640 1 -- 172.21.15.165:0/2958414388 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e60053880 con 0x563570fd3b70 2024-09-22T08:11:04.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2958414388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd3b70 msgr2=0x563570fd5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2958414388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd3b70 0x563570fd5f60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000a470 tx=0x7f6e60045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:04.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2958414388 shutdown_connections 2024-09-22T08:11:04.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2958414388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd3b70 0x563570fd5f60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2958414388 >> 172.21.15.165:0/2958414388 conn(0x563570fc9ba0 msgr2=0x563570fcc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2958414388 shutdown_connections 2024-09-22T08:11:04.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.548+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2958414388 wait complete. 2024-09-22T08:11:04.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.562+0000 7f6e7a32a800 1 Processor -- start 2024-09-22T08:11:04.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.562+0000 7f6e7a32a800 1 -- start start 2024-09-22T08:11:04.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.562+0000 7f6e7a32a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x5635710beea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.562+0000 7f6e7a32a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563570e67dd0 con 0x563570fd0060 2024-09-22T08:11:04.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.563+0000 7f6e75f61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x5635710beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.563+0000 7f6e75f61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x5635710beea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51146/0 (socket says 172.21.15.165:51146) 2024-09-22T08:11:04.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.563+0000 7f6e75f61640 1 -- 172.21.15.165:0/3884241195 learned_addr learned my addr 172.21.15.165:0/3884241195 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.563+0000 7f6e75f61640 1 -- 172.21.15.165:0/3884241195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635710bf490 con 0x563570fd0060 2024-09-22T08:11:04.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.563+0000 7f6e75f61640 1 --2- 172.21.15.165:0/3884241195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x5635710beea0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e68006fa0 tx=0x7f6e68001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506ebdedeb3509e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.563+0000 7f6d63e07640 1 -- 172.21.15.165:0/3884241195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e68003450 con 0x563570fd0060 2024-09-22T08:11:04.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.563+0000 7f6d63e07640 1 -- 172.21.15.165:0/3884241195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e68003610 con 0x563570fd0060 2024-09-22T08:11:04.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.563+0000 7f6d63e07640 1 -- 172.21.15.165:0/3884241195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e68003970 con 0x563570fd0060 2024-09-22T08:11:04.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.564+0000 7f6e7a32a800 1 -- 172.21.15.165:0/3884241195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 msgr2=0x5635710beea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.564+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/3884241195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x5635710beea0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e68006fa0 tx=0x7f6e68001b00 comp rx=0 tx=0).stop 2024-09-22T08:11:04.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.564+0000 7f6e7a32a800 1 -- 172.21.15.165:0/3884241195 shutdown_connections 2024-09-22T08:11:04.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.564+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/3884241195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x5635710beea0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.564+0000 7f6e7a32a800 1 -- 172.21.15.165:0/3884241195 >> 172.21.15.165:0/3884241195 conn(0x563570fc9ba0 msgr2=0x5635710ba820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.564+0000 7f6e7a32a800 1 -- 172.21.15.165:0/3884241195 shutdown_connections 2024-09-22T08:11:04.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.564+0000 7f6e7a32a800 1 -- 172.21.15.165:0/3884241195 wait complete. 2024-09-22T08:11:04.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.564+0000 7f6e7a32a800 1 Processor -- start 2024-09-22T08:11:04.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.564+0000 7f6e7a32a800 1 -- start start 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6e7a32a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x563570fcf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6e7a32a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563570fd6830 con 0x563570fd0060 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6e75f61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x563570fcf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6e75f61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x563570fcf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51162/0 (socket says 172.21.15.165:51162) 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6e75f61640 1 -- 172.21.15.165:0/2881834227 learned_addr learned my addr 172.21.15.165:0/2881834227 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6e75f61640 1 -- 172.21.15.165:0/2881834227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563570fcfce0 con 0x563570fd0060 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6e75f61640 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x563570fcf780 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6e68001330 tx=0x7f6e68001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6d62604640 1 -- 172.21.15.165:0/2881834227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e68014a10 con 0x563570fd0060 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6d62604640 1 -- 172.21.15.165:0/2881834227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e68014bb0 con 0x563570fd0060 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6d62604640 1 -- 172.21.15.165:0/2881834227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e6801e3f0 con 0x563570fd0060 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563570fce090 con 0x563570fd0060 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.565+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563570fce650 con 0x563570fd0060 2024-09-22T08:11:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.566+0000 7f6d62604640 1 -- 172.21.15.165:0/2881834227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6e68010070 con 0x563570fd0060 2024-09-22T08:11:04.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.566+0000 7f6d62604640 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5c03d050 0x7f6d5c03f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.567+0000 7f6d62604640 1 -- 172.21.15.165:0/2881834227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6e68018070 con 0x563570fd0060 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.567+0000 7f6e75760640 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5c03d050 0x7f6d5c03f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.567+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563570fd3b70 0x5635710cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.567+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635710d03f0 con 0x563570fd3b70 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.567+0000 7f6e76762640 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563570fd3b70 0x5635710cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.567+0000 7f6e75760640 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5c03d050 0x7f6d5c03f510 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e60057000 tx=0x7f6e60052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.567+0000 7f6e76762640 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563570fd3b70 0x5635710cfeb0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.567+0000 7f6e76762640 1 -- 172.21.15.165:0/2881834227 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e700083e0 con 0x563570fd3b70 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.567+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563570fceb50 con 0x563570fd3b70 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.568+0000 7f6e76762640 1 -- 172.21.15.165:0/2881834227 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e700083e0 con 0x563570fd3b70 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.568+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635710d2740 0x5635710d4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.568+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635710d5200 con 0x5635710d2740 2024-09-22T08:11:04.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.568+0000 7f6e75f61640 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635710d2740 0x5635710d4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.568+0000 7f6e75f61640 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635710d2740 0x5635710d4b30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.568+0000 7f6e75f61640 1 -- 172.21.15.165:0/2881834227 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e6801b070 con 0x5635710d2740 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.568+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635710d15e0 con 0x563570fd3b70 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.569+0000 7f6e76762640 1 -- 172.21.15.165:0/2881834227 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e700083e0 con 0x563570fd3b70 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.569+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635710d1a80 con 0x563570fd3b70 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.569+0000 7f6e76762640 1 -- 172.21.15.165:0/2881834227 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e700083e0 con 0x563570fd3b70 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.569+0000 7f6e7a32a800 1 Processor -- start 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.569+0000 7f6e7a32a800 1 -- start start 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6e7a32a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710e3b80 0x5635710e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6e7a32a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563570ec6d50 con 0x5635710e3b80 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6e76762640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710e3b80 0x5635710e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6e76762640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710e3b80 0x5635710e3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51174/0 (socket says 172.21.15.165:51174) 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6e76762640 1 -- 172.21.15.165:0/56983507 learned_addr learned my addr 172.21.15.165:0/56983507 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6e76762640 1 -- 172.21.15.165:0/56983507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635710e45e0 con 0x5635710e3b80 2024-09-22T08:11:04.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6e76762640 1 --2- 172.21.15.165:0/56983507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710e3b80 0x5635710e3fa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x563570fcf320 tx=0x7f6e7000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6d5b7fe640 1 -- 172.21.15.165:0/56983507 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e70007dc0 con 0x5635710e3b80 2024-09-22T08:11:04.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6d5b7fe640 1 -- 172.21.15.165:0/56983507 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7001e020 con 0x5635710e3b80 2024-09-22T08:11:04.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6e7a32a800 1 -- 172.21.15.165:0/56983507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635710e4e10 con 0x5635710e3b80 2024-09-22T08:11:04.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6d5b7fe640 1 -- 172.21.15.165:0/56983507 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e70019570 con 0x5635710e3b80 2024-09-22T08:11:04.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.570+0000 7f6e7a32a800 1 -- 172.21.15.165:0/56983507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635710e53b0 con 0x5635710e3b80 2024-09-22T08:11:04.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.571+0000 7f6d5b7fe640 1 -- 172.21.15.165:0/56983507 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6e70016040 con 0x5635710e3b80 2024-09-22T08:11:04.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.571+0000 7f6d5b7fe640 1 --2- 172.21.15.165:0/56983507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5003d000 0x7f6d5003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.571+0000 7f6d5b7fe640 1 -- 172.21.15.165:0/56983507 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6e7001f030 con 0x5635710e3b80 2024-09-22T08:11:04.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.571+0000 7f6e75f61640 1 --2- 172.21.15.165:0/56983507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5003d000 0x7f6d5003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.572+0000 7f6e7a32a800 1 Processor -- start 2024-09-22T08:11:04.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.572+0000 7f6e75f61640 1 --2- 172.21.15.165:0/56983507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5003d000 0x7f6d5003f4c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5635710d0890 tx=0x7f6e68052a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.572+0000 7f6e7a32a800 1 -- start start 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.572+0000 7f6e7a32a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.572+0000 7f6e7a32a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635710bf8c0 con 0x5635710f0550 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.572+0000 7f6e76762640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.572+0000 7f6e76762640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51186/0 (socket says 172.21.15.165:51186) 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.572+0000 7f6e76762640 1 -- 172.21.15.165:0/3029954716 learned_addr learned my addr 172.21.15.165:0/3029954716 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.572+0000 7f6e76762640 1 -- 172.21.15.165:0/3029954716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635710f0f40 con 0x5635710f0550 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.572+0000 7f6e76762640 1 --2- 172.21.15.165:0/3029954716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f0950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6e70018fd0 tx=0x7f6e70054be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7282ddd211585268 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6d597fa640 1 -- 172.21.15.165:0/3029954716 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e70044030 con 0x5635710f0550 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6d597fa640 1 -- 172.21.15.165:0/3029954716 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e70051020 con 0x5635710f0550 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6d597fa640 1 -- 172.21.15.165:0/3029954716 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e7001d040 con 0x5635710f0550 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6e7a32a800 1 -- 172.21.15.165:0/3029954716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 msgr2=0x5635710f0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/3029954716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f0950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6e70018fd0 tx=0x7f6e70054be0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6e7a32a800 1 -- 172.21.15.165:0/3029954716 shutdown_connections 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/3029954716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f0950 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6e7a32a800 1 -- 172.21.15.165:0/3029954716 >> 172.21.15.165:0/3029954716 conn(0x5635710ec950 msgr2=0x5635710eab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6e7a32a800 1 -- 172.21.15.165:0/3029954716 shutdown_connections 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6e7a32a800 1 -- 172.21.15.165:0/3029954716 wait complete. 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6e7a32a800 1 Processor -- start 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.573+0000 7f6e7a32a800 1 -- start start 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6e7a32a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6e7a32a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635710f1560 con 0x5635710f0550 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6e76762640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6e76762640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51198/0 (socket says 172.21.15.165:51198) 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 learned_addr learned my addr 172.21.15.165:0/2379158175 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635710f80e0 con 0x5635710f0550 2024-09-22T08:11:04.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6e76762640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f7b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e70023fd0 tx=0x7f6e700548a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6d477fe640 1 -- 172.21.15.165:0/2379158175 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e70033070 con 0x5635710f0550 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6d477fe640 1 -- 172.21.15.165:0/2379158175 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e70045040 con 0x5635710f0550 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635710f8370 con 0x5635710f0550 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6d477fe640 1 -- 172.21.15.165:0/2379158175 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e7001d030 con 0x5635710f0550 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.574+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635710f8f00 con 0x5635710f0550 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.575+0000 7f6d477fe640 1 -- 172.21.15.165:0/2379158175 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6e70056070 con 0x5635710f0550 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.575+0000 7f6d477fe640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d4003cfb0 0x7f6d4003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.575+0000 7f6d477fe640 1 -- 172.21.15.165:0/2379158175 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6e7004d050 con 0x5635710f0550 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.575+0000 7f6e75f61640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d4003cfb0 0x7f6d4003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.576+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.576+0000 7f6e75f61640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d4003cfb0 0x7f6d4003f470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e68002020 tx=0x7f6e68036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.576+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563571103530 0x5635711059f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.576+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563571106140 con 0x563571103530 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.576+0000 7f6e75760640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563571103530 0x5635711059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.576+0000 7f6e75760640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563571103530 0x5635711059f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 20 realm 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563571106570 con 0x563571103530 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563571106e40 con 0x563571103530 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635711071e0 con 0x563571103530 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563571107f40 0x56357110a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56357110a870 con 0x563571107f40 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.577+0000 7f6e76762640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563571107f40 0x56357110a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.578+0000 7f6e76762640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563571107f40 0x56357110a330 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.578+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.578+0000 7f6e7a32a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.578+0000 7f6e7a32a800 20 searching for the correct realm 2024-09-22T08:11:04.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.578+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56357110c8b0 0x56357110ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.578+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x56357110c8b0 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.578+0000 7f6e75f61640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56357110c8b0 0x56357110ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.578+0000 7f6e75f61640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56357110c8b0 0x56357110ed70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.579+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.579+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571107f40 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.579+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.579+0000 7f6e76762640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6e70019040 0x7f6e7002c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.579+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x7f6e70019040 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.579+0000 7f6e75760640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6e70019040 0x7f6e7002c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.579+0000 7f6e75760640 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6e70019040 0x7f6e7002c9d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.580+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.580+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571103530 2024-09-22T08:11:04.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.580+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.580+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571103530 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.580+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.580+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x7f6e70019040 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.580+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.580+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x7f6e70019040 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.581+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.581+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571107f40 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.581+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.581+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x56357110c8b0 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.581+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.581+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571103530 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.581+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.581+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x7f6e70019040 2024-09-22T08:11:04.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.582+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.582+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571103530 2024-09-22T08:11:04.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.582+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.582+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571107f40 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.582+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.582+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x56357110c8b0 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.582+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.582+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x56357110c8b0 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.582+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.582+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x7f6e70019040 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.583+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.583+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x56357110c8b0 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.583+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.583+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x56357110c8b0 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.583+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.583+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571103530 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.583+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.583+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571103530 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.584+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.584+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x7f6e70019040 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.584+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.584+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x56357110c8b0 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.584+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.584+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571107f40 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.584+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.584+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571103530 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.585+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.585+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x7f6e70019040 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.585+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.585+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x56357110c8b0 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.586+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.586+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x7f6e70019040 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.586+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.586+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571107f40 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.586+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.586+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x56357110c8b0 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.586+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.586+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x7f6e70019040 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571103530 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56357110f440 con 0x563571107f40 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56357110b2e0 con 0x563571103530 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.587+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56357110aef0 con 0x563571103530 2024-09-22T08:11:04.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56357110bc50 con 0x563571103530 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 20 zone default found 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 4 Realm: () 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 20 zonegroup default 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56357110b760 con 0x7f6e70019040 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635711117b0 con 0x56357110c8b0 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.588+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563571111c90 con 0x56357110c8b0 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.589+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.589+0000 7f6e7a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.589+0000 7f6e7a32a800 20 started sync module instance, tier type = 2024-09-22T08:11:04.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.589+0000 7f6e7a32a800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.589+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571110c50 con 0x563571107f40 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.590+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.590+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94787530199408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571110c50 con 0x563571107f40 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.590+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635711127e0 con 0x563571103530 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.591+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94787530199408] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.591+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.591+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94787530203824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571110c50 con 0x563571103530 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.591+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571113230 con 0x56357110c8b0 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.592+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.592+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94787530206528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571113b00 con 0x56357110c8b0 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.592+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571114610 con 0x563571107f40 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.592+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94787530203824] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.593+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94787530206528] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.593+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.593+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94787530208848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635711107a0 con 0x563571107f40 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.593+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571115020 con 0x563571103530 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.594+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.594+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94787530214256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571115440 con 0x563571103530 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.594+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571115eb0 con 0x7f6e70019040 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.595+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94787530208848] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.595+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.595+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94787530217856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571115e70 con 0x7f6e70019040 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.595+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635711168c0 con 0x7f6e70019040 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.596+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94787530214256] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.596+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94787530217856] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.596+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.596+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94787530211520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571116410 con 0x7f6e70019040 2024-09-22T08:11:04.606 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.596+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571117160 con 0x7f6e70019040 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.597+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94787530211520] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.597+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.597+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94787530215312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571116410 con 0x7f6e70019040 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.597+0000 7f6e7a32a800 20 add_watcher() i=0 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.597+0000 7f6e7a32a800 20 add_watcher() i=1 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.597+0000 7f6e7a32a800 20 add_watcher() i=2 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.597+0000 7f6e7a32a800 20 add_watcher() i=3 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.597+0000 7f6e7a32a800 20 add_watcher() i=4 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.597+0000 7f6e7a32a800 20 add_watcher() i=5 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.597+0000 7f6e7a32a800 20 add_watcher() i=6 2024-09-22T08:11:04.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.598+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94787530215312] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.598+0000 7f6e7a32a800 20 add_watcher() i=7 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.598+0000 7f6e7a32a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.598+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56357111a240 con 0x563571103530 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.599+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.599+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94787530222768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571117580 con 0x563571103530 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.599+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94787530222768] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.600+0000 7f6d2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.600+0000 7f6e7a32a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.600+0000 7f6e7a32a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.600+0000 7f6e7a32a800 5 note: GC not initialized 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.600+0000 7f6d2afe5640 20 reqs_thread_entry: start 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.600+0000 7f6e7a32a800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:04.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.600+0000 7f6e7a32a800 20 Filter name: none 2024-09-22T08:11:04.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.600+0000 7f6d28fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:04.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.600+0000 7f6e7a32a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.600+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56357114d100 con 0x563571103530 2024-09-22T08:11:04.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.601+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.601+0000 7f6e7a32a800 20 rados_obj.operate() r=0 bl.length=502 2024-09-22T08:11:04.610 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-22T08:11:04.476614Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:04.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.601+0000 7f6d2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.602+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94787530222768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56357114ba70 con 0x563571103530 2024-09-22T08:11:04.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.602+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94787530222768] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.602+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94787530199408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56357114ba70 con 0x563571107f40 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.603+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94787530199408] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.603+0000 7f6e7a32a800 20 remove_watcher() i=0 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.603+0000 7f6e7a32a800 2 removed watcher, disabling cache 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.603+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94787530203824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571111170 con 0x563571103530 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.604+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94787530203824] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.604+0000 7f6e7a32a800 20 remove_watcher() i=1 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.604+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94787530206528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571111170 con 0x56357110c8b0 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.605+0000 7f6e75f61640 1 -- 172.21.15.165:0/2379158175 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94787530206528] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e6801b070 con 0x56357110c8b0 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.605+0000 7f6e7a32a800 20 remove_watcher() i=2 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.605+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94787530208848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571111170 con 0x563571107f40 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.606+0000 7f6e76762640 1 -- 172.21.15.165:0/2379158175 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94787530208848] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e7002a070 con 0x563571107f40 2024-09-22T08:11:04.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.606+0000 7f6e7a32a800 20 remove_watcher() i=3 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.606+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94787530214256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571111170 con 0x563571103530 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.608+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94787530214256] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x563571103530 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.608+0000 7f6e7a32a800 20 remove_watcher() i=4 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.608+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94787530217856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571111170 con 0x7f6e70019040 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.609+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94787530217856] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.609+0000 7f6e7a32a800 20 remove_watcher() i=5 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.609+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94787530211520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571115980 con 0x7f6e70019040 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.610+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94787530211520] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.610+0000 7f6e7a32a800 20 remove_watcher() i=6 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.610+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94787530215312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563571111170 con 0x7f6e70019040 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.610+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94787530215312] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e60051070 con 0x7f6e70019040 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.610+0000 7f6e7a32a800 20 remove_watcher() i=7 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6e70019040 msgr2=0x7f6e7002c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6e70019040 0x7f6e7002c9d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563571103530 msgr2=0x5635711059f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563571103530 0x5635711059f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563571107f40 msgr2=0x56357110a330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563571107f40 0x56357110a330 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56357110c8b0 msgr2=0x56357110ed70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56357110c8b0 0x56357110ed70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d4003cfb0 msgr2=0x7f6d4003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d4003cfb0 0x7f6d4003f470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e68002020 tx=0x7f6e68036000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 msgr2=0x5635710f7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e75760640 1 -- 172.21.15.165:0/2379158175 reap_dead start 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f7b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e70023fd0 tx=0x7f6e700548a0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 shutdown_connections 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2379158175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710f0550 0x5635710f7b80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 >> 172.21.15.165:0/2379158175 conn(0x5635710ec950 msgr2=0x5635710eab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 shutdown_connections 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2379158175 wait complete. 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/56983507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5003d000 msgr2=0x7f6d5003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/56983507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5003d000 0x7f6d5003f4c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5635710d0890 tx=0x7f6e68052a80 comp rx=0 tx=0).stop 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/56983507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710e3b80 msgr2=0x5635710e3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/56983507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710e3b80 0x5635710e3fa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x563570fcf320 tx=0x7f6e7000af40 comp rx=0 tx=0).stop 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/56983507 shutdown_connections 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/56983507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5003d000 0x7f6d5003f4c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/56983507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635710e3b80 0x5635710e3fa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/56983507 >> 172.21.15.165:0/56983507 conn(0x5635710d7f30 msgr2=0x5635710d8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/56983507 shutdown_connections 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.611+0000 7f6e7a32a800 1 -- 172.21.15.165:0/56983507 wait complete. 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563570fd3b70 msgr2=0x5635710cfeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563570fd3b70 0x5635710cfeb0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635710d2740 msgr2=0x5635710d4b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635710d2740 0x5635710d4b30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5c03d050 msgr2=0x7f6d5c03f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5c03d050 0x7f6d5c03f510 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e60057000 tx=0x7f6e60052000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 msgr2=0x563570fcf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x563570fcf780 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6e68001330 tx=0x7f6e68001250 comp rx=0 tx=0).stop 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 shutdown_connections 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635710d2740 0x5635710d4b30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563570fd3b70 0x5635710cfeb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6d5c03d050 0x7f6d5c03f510 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 --2- 172.21.15.165:0/2881834227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563570fd0060 0x563570fcf780 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 >> 172.21.15.165:0/2881834227 conn(0x563570fc9ba0 msgr2=0x5635710c0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 shutdown_connections 2024-09-22T08:11:04.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.612+0000 7f6e7a32a800 1 -- 172.21.15.165:0/2881834227 wait complete. 2024-09-22T08:11:04.621 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-22T08:11:04.476614Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:04.621 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-22T08:11:04.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-22T08:11:04.622 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-22T08:11:04.668 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:04.669 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.668+0000 7f4f25130800 1 Processor -- start 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.668+0000 7f4f25130800 1 -- start start 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.668+0000 7f4f25130800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b3c0bedbf0 0x55b3c0bf00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.668+0000 7f4f25130800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b3c0a72a20 con 0x55b3c0b5b510 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.669+0000 7f4f25130800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b3c0a727d0 con 0x55b3c0bedbf0 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.669+0000 7f4f205bb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b3c0bedbf0 0x55b3c0bf00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.669+0000 7f4f20dbc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b3c0b5b510 0x55b3c0bec4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33544/0 (socket says 172.21.15.165:33544) 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.669+0000 7f4f205bb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b3c0bedbf0 0x55b3c0bf00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51206/0 (socket says 172.21.15.165:51206) 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.669+0000 7f4f20dbc640 1 -- 172.21.15.165:0/895308627 learned_addr learned my addr 172.21.15.165:0/895308627 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.669+0000 7f4f205bb640 1 -- 172.21.15.165:0/895308627 >> v1:172.21.15.53:6789/0 conn(0x55b3c0b5b510 legacy=0x55b3c0bec4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.669+0000 7f4f205bb640 1 -- 172.21.15.165:0/895308627 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0bf1790 con 0x55b3c0bedbf0 2024-09-22T08:11:04.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.671+0000 7f4f205bb640 1 --2- 172.21.15.165:0/895308627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0bedbf0 0x55b3c0bf00b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400a470 tx=0x7f4f14045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c1793d40f83db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.671+0000 7f4f1fdba640 1 -- 172.21.15.165:0/895308627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f14053570 con 0x55b3c0bedbf0 2024-09-22T08:11:04.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.671+0000 7f4f1fdba640 1 -- 172.21.15.165:0/895308627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f14058070 con 0x55b3c0bedbf0 2024-09-22T08:11:04.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.671+0000 7f4f1fdba640 1 -- 172.21.15.165:0/895308627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f14053880 con 0x55b3c0bedbf0 2024-09-22T08:11:04.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.671+0000 7f4f25130800 1 -- 172.21.15.165:0/895308627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0bedbf0 msgr2=0x55b3c0bf00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.671+0000 7f4f25130800 1 --2- 172.21.15.165:0/895308627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0bedbf0 0x55b3c0bf00b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400a470 tx=0x7f4f14045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:04.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.671+0000 7f4f25130800 1 -- 172.21.15.165:0/895308627 shutdown_connections 2024-09-22T08:11:04.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.671+0000 7f4f25130800 1 --2- 172.21.15.165:0/895308627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0bedbf0 0x55b3c0bf00b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.671+0000 7f4f25130800 1 -- 172.21.15.165:0/895308627 >> 172.21.15.165:0/895308627 conn(0x55b3c0be1be0 msgr2=0x55b3c0be4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.672+0000 7f4f25130800 1 -- 172.21.15.165:0/895308627 shutdown_connections 2024-09-22T08:11:04.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.672+0000 7f4f25130800 1 -- 172.21.15.165:0/895308627 wait complete. 2024-09-22T08:11:04.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.685+0000 7f4f25130800 1 Processor -- start 2024-09-22T08:11:04.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.685+0000 7f4f25130800 1 -- start start 2024-09-22T08:11:04.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.685+0000 7f4f25130800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0cd9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.685+0000 7f4f25130800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3c0a7fdd0 con 0x55b3c0b5b510 2024-09-22T08:11:04.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.686+0000 7f4f20dbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0cd9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.686+0000 7f4f20dbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0cd9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51214/0 (socket says 172.21.15.165:51214) 2024-09-22T08:11:04.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.686+0000 7f4f20dbc640 1 -- 172.21.15.165:0/2794975444 learned_addr learned my addr 172.21.15.165:0/2794975444 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.686+0000 7f4f20dbc640 1 -- 172.21.15.165:0/2794975444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0cd9840 con 0x55b3c0b5b510 2024-09-22T08:11:04.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.686+0000 7f4f20dbc640 1 --2- 172.21.15.165:0/2794975444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0cd9250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4f10001800 tx=0x7f4f10001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0933252dd6a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.686+0000 7f4e0ee0d640 1 -- 172.21.15.165:0/2794975444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f10004520 con 0x55b3c0b5b510 2024-09-22T08:11:04.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.686+0000 7f4e0ee0d640 1 -- 172.21.15.165:0/2794975444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f100046c0 con 0x55b3c0b5b510 2024-09-22T08:11:04.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.686+0000 7f4e0ee0d640 1 -- 172.21.15.165:0/2794975444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f100049e0 con 0x55b3c0b5b510 2024-09-22T08:11:04.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.687+0000 7f4f25130800 1 -- 172.21.15.165:0/2794975444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 msgr2=0x55b3c0cd9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.687+0000 7f4f25130800 1 --2- 172.21.15.165:0/2794975444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0cd9250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4f10001800 tx=0x7f4f10001cc0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.687+0000 7f4f25130800 1 -- 172.21.15.165:0/2794975444 shutdown_connections 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.687+0000 7f4f25130800 1 --2- 172.21.15.165:0/2794975444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0cd9250 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.687+0000 7f4f25130800 1 -- 172.21.15.165:0/2794975444 >> 172.21.15.165:0/2794975444 conn(0x55b3c0be1be0 msgr2=0x55b3c0cd4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.687+0000 7f4f25130800 1 -- 172.21.15.165:0/2794975444 shutdown_connections 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.687+0000 7f4f25130800 1 -- 172.21.15.165:0/2794975444 wait complete. 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.687+0000 7f4f25130800 1 Processor -- start 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.687+0000 7f4f25130800 1 -- start start 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4f25130800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0ce0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4f25130800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3c0bf0a30 con 0x55b3c0b5b510 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4f20dbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0ce0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4f20dbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0ce0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51220/0 (socket says 172.21.15.165:51220) 2024-09-22T08:11:04.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4f20dbc640 1 -- 172.21.15.165:0/1768586334 learned_addr learned my addr 172.21.15.165:0/1768586334 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4f20dbc640 1 -- 172.21.15.165:0/1768586334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0ce1300 con 0x55b3c0b5b510 2024-09-22T08:11:04.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4f20dbc640 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0ce0da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4f10000f80 tx=0x7f4f10001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4e0d60a640 1 -- 172.21.15.165:0/1768586334 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f10022020 con 0x55b3c0b5b510 2024-09-22T08:11:04.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4e0d60a640 1 -- 172.21.15.165:0/1768586334 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f10014890 con 0x55b3c0b5b510 2024-09-22T08:11:04.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3c0ce1590 con 0x55b3c0b5b510 2024-09-22T08:11:04.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.688+0000 7f4e0d60a640 1 -- 172.21.15.165:0/1768586334 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f10014bb0 con 0x55b3c0b5b510 2024-09-22T08:11:04.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.689+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c0ce1f90 con 0x55b3c0b5b510 2024-09-22T08:11:04.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.689+0000 7f4e0d60a640 1 -- 172.21.15.165:0/1768586334 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4f10025020 con 0x55b3c0b5b510 2024-09-22T08:11:04.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.690+0000 7f4e0d60a640 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e0803cfb0 0x7f4e0803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.690+0000 7f4e0d60a640 1 -- 172.21.15.165:0/1768586334 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4f10018030 con 0x55b3c0b5b510 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.690+0000 7f4f205bb640 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e0803cfb0 0x7f4e0803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.690+0000 7f4f25130800 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0bedbf0 0x55b3c0ce83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.690+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0ce8930 con 0x55b3c0bedbf0 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.690+0000 7f4f215bd640 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0bedbf0 0x55b3c0ce83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.690+0000 7f4f205bb640 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e0803cfb0 0x7f4e0803f470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4f14057000 tx=0x7f4f14052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.690+0000 7f4f215bd640 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0bedbf0 0x55b3c0ce83f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.690+0000 7f4f215bd640 1 -- 172.21.15.165:0/1768586334 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0bedbf0 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.690+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0ce8cd0 con 0x55b3c0bedbf0 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.691+0000 7f4f215bd640 1 -- 172.21.15.165:0/1768586334 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0bedbf0 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.691+0000 7f4f25130800 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0cea7d0 0x55b3c0cecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.691+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0ced3e0 con 0x55b3c0cea7d0 2024-09-22T08:11:04.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.691+0000 7f4f20dbc640 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0cea7d0 0x55b3c0cecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.691+0000 7f4f20dbc640 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0cea7d0 0x55b3c0cecc50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.691+0000 7f4f20dbc640 1 -- 172.21.15.165:0/1768586334 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0cea7d0 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.692+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0ce9520 con 0x55b3c0bedbf0 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.692+0000 7f4f215bd640 1 -- 172.21.15.165:0/1768586334 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0bedbf0 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.692+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0ce9970 con 0x55b3c0bedbf0 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.692+0000 7f4f215bd640 1 -- 172.21.15.165:0/1768586334 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0bedbf0 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.692+0000 7f4f25130800 1 Processor -- start 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.692+0000 7f4f25130800 1 -- start start 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.693+0000 7f4f25130800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0cfbdc0 0x55b3c0cfc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.693+0000 7f4f25130800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3c0aded50 con 0x55b3c0cfbdc0 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.693+0000 7f4f215bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0cfbdc0 0x55b3c0cfc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.693+0000 7f4f215bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0cfbdc0 0x55b3c0cfc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51230/0 (socket says 172.21.15.165:51230) 2024-09-22T08:11:04.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.693+0000 7f4f215bd640 1 -- 172.21.15.165:0/3001586895 learned_addr learned my addr 172.21.15.165:0/3001586895 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.693+0000 7f4f215bd640 1 -- 172.21.15.165:0/3001586895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0cfc820 con 0x55b3c0cfbdc0 2024-09-22T08:11:04.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.693+0000 7f4f215bd640 1 --2- 172.21.15.165:0/3001586895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0cfbdc0 0x55b3c0cfc1e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55b3c0ce2cd0 tx=0x7f4f1800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.694+0000 7f4e067fc640 1 -- 172.21.15.165:0/3001586895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f18007dc0 con 0x55b3c0cfbdc0 2024-09-22T08:11:04.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.694+0000 7f4e067fc640 1 -- 172.21.15.165:0/3001586895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1801e020 con 0x55b3c0cfbdc0 2024-09-22T08:11:04.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.694+0000 7f4f25130800 1 -- 172.21.15.165:0/3001586895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3c0cfd050 con 0x55b3c0cfbdc0 2024-09-22T08:11:04.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.694+0000 7f4e067fc640 1 -- 172.21.15.165:0/3001586895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f18019570 con 0x55b3c0cfbdc0 2024-09-22T08:11:04.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.694+0000 7f4f25130800 1 -- 172.21.15.165:0/3001586895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c0cfd5f0 con 0x55b3c0cfbdc0 2024-09-22T08:11:04.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.694+0000 7f4e067fc640 1 -- 172.21.15.165:0/3001586895 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4f18016040 con 0x55b3c0cfbdc0 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4e067fc640 1 --2- 172.21.15.165:0/3001586895 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4df803d000 0x7f4df803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4e067fc640 1 -- 172.21.15.165:0/3001586895 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4f1801f030 con 0x55b3c0cfbdc0 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4f20dbc640 1 --2- 172.21.15.165:0/3001586895 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4df803d000 0x7f4df803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4f25130800 1 Processor -- start 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4f25130800 1 -- start start 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4f20dbc640 1 --2- 172.21.15.165:0/3001586895 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4df803d000 0x7f4df803f4c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55b3c0ce2e90 tx=0x7f4f10011f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4f25130800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d08ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4f25130800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3c0cd9c70 con 0x55b3c0d088c0 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4f215bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d08ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4f215bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d08ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51238/0 (socket says 172.21.15.165:51238) 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.695+0000 7f4f215bd640 1 -- 172.21.15.165:0/2918929438 learned_addr learned my addr 172.21.15.165:0/2918929438 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4f215bd640 1 -- 172.21.15.165:0/2918929438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0d09290 con 0x55b3c0d088c0 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4f215bd640 1 --2- 172.21.15.165:0/2918929438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d08ca0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4f18007fd0 tx=0x7f4f18014340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab131080350f9ff server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4df7fff640 1 -- 172.21.15.165:0/2918929438 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f1801d070 con 0x55b3c0d088c0 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4df7fff640 1 -- 172.21.15.165:0/2918929438 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f18056070 con 0x55b3c0d088c0 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4df7fff640 1 -- 172.21.15.165:0/2918929438 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f18017bf0 con 0x55b3c0d088c0 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4f25130800 1 -- 172.21.15.165:0/2918929438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 msgr2=0x55b3c0d08ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4f25130800 1 --2- 172.21.15.165:0/2918929438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d08ca0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4f18007fd0 tx=0x7f4f18014340 comp rx=0 tx=0).stop 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4f25130800 1 -- 172.21.15.165:0/2918929438 shutdown_connections 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4f25130800 1 --2- 172.21.15.165:0/2918929438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d08ca0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4f25130800 1 -- 172.21.15.165:0/2918929438 >> 172.21.15.165:0/2918929438 conn(0x55b3c0d04cc0 msgr2=0x55b3c0d02f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4f25130800 1 -- 172.21.15.165:0/2918929438 shutdown_connections 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.696+0000 7f4f25130800 1 -- 172.21.15.165:0/2918929438 wait complete. 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.697+0000 7f4f25130800 1 Processor -- start 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.697+0000 7f4f25130800 1 -- start start 2024-09-22T08:11:04.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.697+0000 7f4f25130800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d0fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.697+0000 7f4f25130800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3c0d098d0 con 0x55b3c0d088c0 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.697+0000 7f4f215bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d0fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.697+0000 7f4f215bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d0fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51254/0 (socket says 172.21.15.165:51254) 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.697+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 learned_addr learned my addr 172.21.15.165:0/4098481225 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.697+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0d103c0 con 0x55b3c0d088c0 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.698+0000 7f4f215bd640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d0fe60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4f18056220 tx=0x7f4f18054570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.698+0000 7f4df67fc640 1 -- 172.21.15.165:0/4098481225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f18044070 con 0x55b3c0d088c0 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.698+0000 7f4df67fc640 1 -- 172.21.15.165:0/4098481225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f18031070 con 0x55b3c0d088c0 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.698+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3c0d10650 con 0x55b3c0d088c0 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.698+0000 7f4df67fc640 1 -- 172.21.15.165:0/4098481225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f180455a0 con 0x55b3c0d088c0 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.698+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c0d10fd0 con 0x55b3c0d088c0 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.698+0000 7f4df67fc640 1 -- 172.21.15.165:0/4098481225 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4f180173b0 con 0x55b3c0d088c0 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.699+0000 7f4df67fc640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4dec03cfb0 0x7f4dec03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.699+0000 7f4df67fc640 1 -- 172.21.15.165:0/4098481225 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4f1802dc90 con 0x55b3c0d088c0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.699+0000 7f4f20dbc640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4dec03cfb0 0x7f4dec03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.699+0000 7f4f20dbc640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4dec03cfb0 0x7f4dec03f470 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f10052db0 tx=0x7f4f10033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.699+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.699+0000 7f4f25130800 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0d1b7c0 0x55b3c0d1dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.699+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d1e3d0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.699+0000 7f4f205bb640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0d1b7c0 0x55b3c0d1dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f205bb640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0d1b7c0 0x55b3c0d1dc80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 20 realm 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d1e800 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d1f0d0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.700+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d1f470 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f25130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f25130800 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0d201d0 0x55b3c0d225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d22bd0 con 0x55b3c0d201d0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f215bd640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0d201d0 0x55b3c0d225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f215bd640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0d201d0 0x55b3c0d225c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f25130800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f25130800 20 searching for the correct realm 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f25130800 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3c0d24b80 0x55b3c0d27040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d24b80 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.701+0000 7f4f20dbc640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3c0d24b80 0x55b3c0d27040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.702+0000 7f4f20dbc640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3c0d24b80 0x55b3c0d27040 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.702+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.702+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d201d0 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.702+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.702+0000 7f4f215bd640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4f18019040 0x7f4f180559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.702+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x7f4f18019040 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.703+0000 7f4f205bb640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4f18019040 0x7f4f180559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.703+0000 7f4f205bb640 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4f18019040 0x7f4f180559c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.703+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.703+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.704+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.704+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.704+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.704+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x7f4f18019040 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.704+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.704+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x7f4f18019040 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.704+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.704+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d201d0 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.705+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.705+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d24b80 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.705+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.705+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.705+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.705+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x7f4f18019040 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.705+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.705+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.706+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.706+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d201d0 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.706+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.706+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d24b80 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.706+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.706+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d24b80 2024-09-22T08:11:04.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.706+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.706+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x7f4f18019040 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.707+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.707+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d24b80 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.707+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.707+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d24b80 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.707+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.707+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.707+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.707+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.707+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.707+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x7f4f18019040 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.708+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.708+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d24b80 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.708+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.708+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d201d0 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.708+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.708+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.708+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.708+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x7f4f18019040 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.709+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.709+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d24b80 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.709+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.709+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x7f4f18019040 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.709+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.709+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d201d0 2024-09-22T08:11:04.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.709+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.709+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d24b80 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.710+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.710+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x7f4f18019040 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.710+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.710+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.710+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.710+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d276c0 con 0x55b3c0d201d0 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:04.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d235c0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d23e60 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d27b40 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:04.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 zone default found 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 4 Realm: () 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 zonegroup default 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.711+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d27f40 con 0x7f4f18019040 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f25130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d29da0 con 0x55b3c0d24b80 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f25130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2a280 con 0x55b3c0d24b80 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f25130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f25130800 20 started sync module instance, tier type = 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f25130800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.712+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d29210 con 0x55b3c0d201d0 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.713+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.713+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94230522533696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d29210 con 0x55b3c0d201d0 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.713+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2ad40 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.714+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94230522533696] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.714+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.714+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94230522538064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d29210 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.714+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2b7d0 con 0x55b3c0d24b80 2024-09-22T08:11:04.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.715+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94230522538064] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.716+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.716+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94230522531168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d29180 con 0x55b3c0d24b80 2024-09-22T08:11:04.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.716+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2c690 con 0x55b3c0d201d0 2024-09-22T08:11:04.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.718+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94230522531168] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.718+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.718+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94230522544608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2cab0 con 0x55b3c0d201d0 2024-09-22T08:11:04.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.718+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2d470 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.721+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94230522544608] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.723+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.723+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94230522546144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2d470 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.723+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2de70 con 0x7f4f18019040 2024-09-22T08:11:04.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.726+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94230522546144] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.726+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.726+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94230522550656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2d470 con 0x7f4f18019040 2024-09-22T08:11:04.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.727+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2e880 con 0x7f4f18019040 2024-09-22T08:11:04.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.729+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.729+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94230522550656] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.729+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94230522553296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2e7f0 con 0x7f4f18019040 2024-09-22T08:11:04.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.729+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2f210 con 0x7f4f18019040 2024-09-22T08:11:04.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.730+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.730+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94230522555648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2f1d0 con 0x7f4f18019040 2024-09-22T08:11:04.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.730+0000 7f4f25130800 20 add_watcher() i=0 2024-09-22T08:11:04.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.730+0000 7f4f25130800 20 add_watcher() i=1 2024-09-22T08:11:04.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.730+0000 7f4f25130800 20 add_watcher() i=2 2024-09-22T08:11:04.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.730+0000 7f4f25130800 20 add_watcher() i=3 2024-09-22T08:11:04.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.730+0000 7f4f25130800 20 add_watcher() i=4 2024-09-22T08:11:04.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.730+0000 7f4f25130800 20 add_watcher() i=5 2024-09-22T08:11:04.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.730+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94230522553296] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.730+0000 7f4f25130800 20 add_watcher() i=6 2024-09-22T08:11:04.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.731+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94230522555648] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.731+0000 7f4f25130800 20 add_watcher() i=7 2024-09-22T08:11:04.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.731+0000 7f4f25130800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:04.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.731+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2d010 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.732+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.732+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94230522557872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d2d010 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94230522557872] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4dd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4f25130800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4f25130800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4f25130800 5 note: GC not initialized 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4dd67e4640 20 reqs_thread_entry: start 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4f25130800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4f25130800 20 Filter name: none 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4dcffff640 20 reqs_thread_entry: start 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4f25130800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4f25130800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.733+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d65ae0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.734+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.734+0000 7f4f25130800 20 rados_obj.operate() r=0 bl.length=502 2024-09-22T08:11:04.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.734+0000 7f4f25130800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:04.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.734+0000 7f4f25130800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.734+0000 7f4f25130800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:04.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.734+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d6c160 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4f25130800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:04.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4f25130800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4f25130800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:04.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94230522805152 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d67820 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 94230522546144 notify 137438953476 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f4f14082040 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4df7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94230522546144 notifier 4353 bl.length()=567 2024-09-22T08:11:04.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4df7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:04.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(64 notify.4 [notify cookie 94230522805152 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4df7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.735+0000 7f4df7fff640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4de4003ea0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.736+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.736+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 94230522805152 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b3c0bf1790 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.736+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d6bba0 con 0x7f4f18019040 2024-09-22T08:11:04.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.737+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.737+0000 7f4f25130800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:11:04.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.737+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94230522805152 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d67370 con 0x55b3c0d24b80 2024-09-22T08:11:04.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.737+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== watch-notify(notify (1) cookie 94230522531168 notify 137438953473 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b3c0ce1f90 con 0x55b3c0d24b80 2024-09-22T08:11:04.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.737+0000 7f4df7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94230522531168 notifier 4353 bl.length()=170 2024-09-22T08:11:04.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.737+0000 7f4df7fff640 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4de4003ea0 con 0x55b3c0d24b80 2024-09-22T08:11:04.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.737+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 notify.2 [notify cookie 94230522805152 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.737+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.738+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== watch-notify(notify_complete (2) cookie 94230522805152 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b3c0ce1590 con 0x55b3c0d24b80 2024-09-22T08:11:04.740 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:04.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.738+0000 7f4dd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.738+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94230522557872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d637b0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.739+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94230522557872] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.739+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94230522533696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d637b0 con 0x55b3c0d201d0 2024-09-22T08:11:04.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.742+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94230522533696] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.742+0000 7f4f25130800 20 remove_watcher() i=0 2024-09-22T08:11:04.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.742+0000 7f4f25130800 2 removed watcher, disabling cache 2024-09-22T08:11:04.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.742+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94230522538064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d637b0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.743+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94230522538064] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.743+0000 7f4f25130800 20 remove_watcher() i=1 2024-09-22T08:11:04.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.743+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94230522531168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d637b0 con 0x55b3c0d24b80 2024-09-22T08:11:04.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.745+0000 7f4f20dbc640 1 -- 172.21.15.165:0/4098481225 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94230522531168] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1001b070 con 0x55b3c0d24b80 2024-09-22T08:11:04.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.745+0000 7f4f25130800 20 remove_watcher() i=2 2024-09-22T08:11:04.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.745+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94230522544608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d637b0 con 0x55b3c0d201d0 2024-09-22T08:11:04.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.746+0000 7f4f215bd640 1 -- 172.21.15.165:0/4098481225 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94230522544608] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f180083e0 con 0x55b3c0d201d0 2024-09-22T08:11:04.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.746+0000 7f4f25130800 20 remove_watcher() i=3 2024-09-22T08:11:04.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.746+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94230522546144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d637b0 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.748+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94230522546144] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x55b3c0d1b7c0 2024-09-22T08:11:04.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.748+0000 7f4f25130800 20 remove_watcher() i=4 2024-09-22T08:11:04.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.748+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94230522550656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d637b0 con 0x7f4f18019040 2024-09-22T08:11:04.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.749+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94230522550656] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.749+0000 7f4f25130800 20 remove_watcher() i=5 2024-09-22T08:11:04.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.749+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94230522553296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d637b0 con 0x7f4f18019040 2024-09-22T08:11:04.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.751+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94230522553296] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.751+0000 7f4f25130800 20 remove_watcher() i=6 2024-09-22T08:11:04.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.751+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94230522555648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d637b0 con 0x7f4f18019040 2024-09-22T08:11:04.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.751+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94230522555648] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f14051070 con 0x7f4f18019040 2024-09-22T08:11:04.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.751+0000 7f4f25130800 20 remove_watcher() i=7 2024-09-22T08:11:04.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4f18019040 msgr2=0x7f4f180559c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4f18019040 0x7f4f180559c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0d1b7c0 msgr2=0x55b3c0d1dc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0d1b7c0 0x55b3c0d1dc80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0d201d0 msgr2=0x55b3c0d225c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0d201d0 0x55b3c0d225c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3c0d24b80 msgr2=0x55b3c0d27040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3c0d24b80 0x55b3c0d27040 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4dec03cfb0 msgr2=0x7f4dec03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4dec03cfb0 0x7f4dec03f470 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f10052db0 tx=0x7f4f10033000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 msgr2=0x55b3c0d0fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 --2- 172.21.15.165:0/4098481225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0d088c0 0x55b3c0d0fe60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4f18056220 tx=0x7f4f18054570 comp rx=0 tx=0).stop 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f205bb640 1 -- 172.21.15.165:0/4098481225 reap_dead start 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 shutdown_connections 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 >> 172.21.15.165:0/4098481225 conn(0x55b3c0d04cc0 msgr2=0x55b3c0d02ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 shutdown_connections 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/4098481225 wait complete. 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/3001586895 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4df803d000 msgr2=0x7f4df803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 --2- 172.21.15.165:0/3001586895 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4df803d000 0x7f4df803f4c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55b3c0ce2e90 tx=0x7f4f10011f40 comp rx=0 tx=0).stop 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/3001586895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0cfbdc0 msgr2=0x55b3c0cfc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 --2- 172.21.15.165:0/3001586895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0cfbdc0 0x55b3c0cfc1e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55b3c0ce2cd0 tx=0x7f4f1800af40 comp rx=0 tx=0).stop 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/3001586895 shutdown_connections 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 --2- 172.21.15.165:0/3001586895 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4df803d000 0x7f4df803f4c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 --2- 172.21.15.165:0/3001586895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0cfbdc0 0x55b3c0cfc1e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/3001586895 >> 172.21.15.165:0/3001586895 conn(0x55b3c0cf0170 msgr2=0x55b3c0cf0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/3001586895 shutdown_connections 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.752+0000 7f4f25130800 1 -- 172.21.15.165:0/3001586895 wait complete. 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0bedbf0 msgr2=0x55b3c0ce83f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0bedbf0 0x55b3c0ce83f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0cea7d0 msgr2=0x55b3c0cecc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0cea7d0 0x55b3c0cecc50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e0803cfb0 msgr2=0x7f4e0803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e0803cfb0 0x7f4e0803f470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4f14057000 tx=0x7f4f14052000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 msgr2=0x55b3c0ce0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0ce0da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4f10000f80 tx=0x7f4f10001250 comp rx=0 tx=0).stop 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 shutdown_connections 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3c0cea7d0 0x55b3c0cecc50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3c0bedbf0 0x55b3c0ce83f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e0803cfb0 0x7f4e0803f470 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 --2- 172.21.15.165:0/1768586334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3c0b5b510 0x55b3c0ce0da0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 >> 172.21.15.165:0/1768586334 conn(0x55b3c0be1be0 msgr2=0x55b3c0cda740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 shutdown_connections 2024-09-22T08:11:04.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.753+0000 7f4f25130800 1 -- 172.21.15.165:0/1768586334 wait complete. 2024-09-22T08:11:04.762 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:04.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-22T08:11:04.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-22T08:11:04.763 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-22T08:11:04.811 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:04.811 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:04.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.811+0000 7f4192f2e800 1 Processor -- start 2024-09-22T08:11:04.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.811+0000 7f4192f2e800 1 -- start start 2024-09-22T08:11:04.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.811+0000 7f4192f2e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555b4a6d1000 0x555b4a6d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.811+0000 7f4192f2e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b4a55ba20 con 0x555b4a6d3930 2024-09-22T08:11:04.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.811+0000 7f4192f2e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555b4a55b7d0 con 0x555b4a6d1000 2024-09-22T08:11:04.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.812+0000 7f418ecdd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555b4a6d1000 0x555b4a6d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.812+0000 7f418ecdd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555b4a6d1000 0x555b4a6d33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51256/0 (socket says 172.21.15.165:51256) 2024-09-22T08:11:04.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.812+0000 7f418ecdd640 1 -- 172.21.15.165:0/444362203 learned_addr learned my addr 172.21.15.165:0/444362203 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.812+0000 7f418e4dc640 1 --1- 172.21.15.165:0/444362203 >> v1:172.21.15.53:6789/0 conn(0x555b4a6d3930 0x555b4a6d5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33556/0 (socket says 172.21.15.165:33556) 2024-09-22T08:11:04.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.812+0000 7f418ecdd640 1 -- 172.21.15.165:0/444362203 >> v1:172.21.15.53:6789/0 conn(0x555b4a6d3930 legacy=0x555b4a6d5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.812+0000 7f418ecdd640 1 -- 172.21.15.165:0/444362203 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a6d8590 con 0x555b4a6d1000 2024-09-22T08:11:04.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.814+0000 7f418ecdd640 1 --2- 172.21.15.165:0/444362203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a6d33f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f418000a520 tx=0x7f4180045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27026c0983fcc28f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.814+0000 7f418dcdb640 1 -- 172.21.15.165:0/444362203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4180055070 con 0x555b4a6d1000 2024-09-22T08:11:04.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.814+0000 7f418dcdb640 1 -- 172.21.15.165:0/444362203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41800515b0 con 0x555b4a6d1000 2024-09-22T08:11:04.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.814+0000 7f418dcdb640 1 -- 172.21.15.165:0/444362203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41800518d0 con 0x555b4a6d1000 2024-09-22T08:11:04.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.814+0000 7f4192f2e800 1 -- 172.21.15.165:0/444362203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 msgr2=0x555b4a6d33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.814+0000 7f4192f2e800 1 --2- 172.21.15.165:0/444362203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a6d33f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f418000a520 tx=0x7f4180045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.815+0000 7f4192f2e800 1 -- 172.21.15.165:0/444362203 shutdown_connections 2024-09-22T08:11:04.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.815+0000 7f4192f2e800 1 --2- 172.21.15.165:0/444362203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a6d33f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.815+0000 7f4192f2e800 1 -- 172.21.15.165:0/444362203 >> 172.21.15.165:0/444362203 conn(0x555b4a6cabe0 msgr2=0x555b4a6cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.815+0000 7f4192f2e800 1 -- 172.21.15.165:0/444362203 shutdown_connections 2024-09-22T08:11:04.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.815+0000 7f4192f2e800 1 -- 172.21.15.165:0/444362203 wait complete. 2024-09-22T08:11:04.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.828+0000 7f4192f2e800 1 Processor -- start 2024-09-22T08:11:04.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.829+0000 7f4192f2e800 1 -- start start 2024-09-22T08:11:04.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.829+0000 7f4192f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.829+0000 7f4192f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b4a568dd0 con 0x555b4a6d1000 2024-09-22T08:11:04.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.829+0000 7f418ecdd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.829+0000 7f418ecdd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7bfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51268/0 (socket says 172.21.15.165:51268) 2024-09-22T08:11:04.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.829+0000 7f418ecdd640 1 -- 172.21.15.165:0/2127373001 learned_addr learned my addr 172.21.15.165:0/2127373001 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.829+0000 7f418ecdd640 1 -- 172.21.15.165:0/2127373001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a7c05e0 con 0x555b4a6d1000 2024-09-22T08:11:04.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.830+0000 7f418ecdd640 1 --2- 172.21.15.165:0/2127373001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7bfff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41800460d0 tx=0x7f4180051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40aef79e3b4ab69e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.830+0000 7f407ce09640 1 -- 172.21.15.165:0/2127373001 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41800519d0 con 0x555b4a6d1000 2024-09-22T08:11:04.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.830+0000 7f407ce09640 1 -- 172.21.15.165:0/2127373001 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4180051b70 con 0x555b4a6d1000 2024-09-22T08:11:04.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.830+0000 7f407ce09640 1 -- 172.21.15.165:0/2127373001 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4180051e50 con 0x555b4a6d1000 2024-09-22T08:11:04.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.830+0000 7f4192f2e800 1 -- 172.21.15.165:0/2127373001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 msgr2=0x555b4a7bfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.830+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2127373001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7bfff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41800460d0 tx=0x7f4180051000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f4192f2e800 1 -- 172.21.15.165:0/2127373001 shutdown_connections 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2127373001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7bfff0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f4192f2e800 1 -- 172.21.15.165:0/2127373001 >> 172.21.15.165:0/2127373001 conn(0x555b4a6cabe0 msgr2=0x555b4a7bb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f4192f2e800 1 -- 172.21.15.165:0/2127373001 shutdown_connections 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f4192f2e800 1 -- 172.21.15.165:0/2127373001 wait complete. 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f4192f2e800 1 Processor -- start 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f4192f2e800 1 -- start start 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f4192f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f4192f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b4a6d7830 con 0x555b4a6d1000 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f418ecdd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f418ecdd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7c7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51282/0 (socket says 172.21.15.165:51282) 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.831+0000 7f418ecdd640 1 -- 172.21.15.165:0/2874211666 learned_addr learned my addr 172.21.15.165:0/2874211666 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.832+0000 7f418ecdd640 1 -- 172.21.15.165:0/2874211666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a7c7f60 con 0x555b4a6d1000 2024-09-22T08:11:04.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.832+0000 7f418ecdd640 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7c7a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f41800460d0 tx=0x7f4180002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.832+0000 7f407b606640 1 -- 172.21.15.165:0/2874211666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4180073020 con 0x555b4a6d1000 2024-09-22T08:11:04.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.832+0000 7f407b606640 1 -- 172.21.15.165:0/2874211666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418006f580 con 0x555b4a6d1000 2024-09-22T08:11:04.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.832+0000 7f407b606640 1 -- 172.21.15.165:0/2874211666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418006f8a0 con 0x555b4a6d1000 2024-09-22T08:11:04.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.832+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4a7c81f0 con 0x555b4a6d1000 2024-09-22T08:11:04.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.832+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4a7c8e00 con 0x555b4a6d1000 2024-09-22T08:11:04.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.833+0000 7f407b606640 1 -- 172.21.15.165:0/2874211666 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4180076020 con 0x555b4a6d1000 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.833+0000 7f407b606640 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f407403cfb0 0x7f407403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.833+0000 7f407b606640 1 -- 172.21.15.165:0/2874211666 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f418006b040 con 0x555b4a6d1000 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.833+0000 7f418e4dc640 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f407403cfb0 0x7f407403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.833+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a6d3930 0x555b4a7cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.833+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a7cf590 con 0x555b4a6d3930 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.834+0000 7f418f4de640 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a6d3930 0x555b4a7cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.834+0000 7f418e4dc640 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f407403cfb0 0x7f407403f470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4184001e30 tx=0x7f4184001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.834+0000 7f418f4de640 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a6d3930 0x555b4a7cf050 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.834+0000 7f418f4de640 1 -- 172.21.15.165:0/2874211666 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f418800a4d0 con 0x555b4a6d3930 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.834+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a7cf930 con 0x555b4a6d3930 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.834+0000 7f418f4de640 1 -- 172.21.15.165:0/2874211666 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f418800a4d0 con 0x555b4a6d3930 2024-09-22T08:11:04.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.834+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a7d1430 0x555b4a7d38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.834+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a7d4060 con 0x555b4a7d1430 2024-09-22T08:11:04.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.835+0000 7f418ecdd640 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a7d1430 0x555b4a7d38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.835+0000 7f418ecdd640 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a7d1430 0x555b4a7d38d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.835+0000 7f418ecdd640 1 -- 172.21.15.165:0/2874211666 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4180057030 con 0x555b4a7d1430 2024-09-22T08:11:04.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.835+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a7d0180 con 0x555b4a6d3930 2024-09-22T08:11:04.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.835+0000 7f418f4de640 1 -- 172.21.15.165:0/2874211666 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f418800a4d0 con 0x555b4a6d3930 2024-09-22T08:11:04.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.835+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a7d05a0 con 0x555b4a6d3930 2024-09-22T08:11:04.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.836+0000 7f418f4de640 1 -- 172.21.15.165:0/2874211666 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f418800a4d0 con 0x555b4a6d3930 2024-09-22T08:11:04.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.836+0000 7f4192f2e800 1 Processor -- start 2024-09-22T08:11:04.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.836+0000 7f4192f2e800 1 -- start start 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.836+0000 7f4192f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7e2a40 0x555b4a7e2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.836+0000 7f4192f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b4a5c7d50 con 0x555b4a7e2a40 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.837+0000 7f418f4de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7e2a40 0x555b4a7e2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.837+0000 7f418f4de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7e2a40 0x555b4a7e2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51292/0 (socket says 172.21.15.165:51292) 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.837+0000 7f418f4de640 1 -- 172.21.15.165:0/4031662970 learned_addr learned my addr 172.21.15.165:0/4031662970 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.837+0000 7f418f4de640 1 -- 172.21.15.165:0/4031662970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a7e34a0 con 0x555b4a7e2a40 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.837+0000 7f418f4de640 1 --2- 172.21.15.165:0/4031662970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7e2a40 0x555b4a7e2e60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x555b4a7c9890 tx=0x7f4188018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.837+0000 7f4078e01640 1 -- 172.21.15.165:0/4031662970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188014450 con 0x555b4a7e2a40 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.837+0000 7f4078e01640 1 -- 172.21.15.165:0/4031662970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41880145f0 con 0x555b4a7e2a40 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.837+0000 7f4192f2e800 1 -- 172.21.15.165:0/4031662970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4a7e3cd0 con 0x555b4a7e2a40 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.837+0000 7f4078e01640 1 -- 172.21.15.165:0/4031662970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188014910 con 0x555b4a7e2a40 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.837+0000 7f4192f2e800 1 -- 172.21.15.165:0/4031662970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4a7e4270 con 0x555b4a7e2a40 2024-09-22T08:11:04.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.838+0000 7f4078e01640 1 -- 172.21.15.165:0/4031662970 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4188011040 con 0x555b4a7e2a40 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.838+0000 7f4078e01640 1 --2- 172.21.15.165:0/4031662970 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f406803cfb0 0x7f406803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.838+0000 7f4078e01640 1 -- 172.21.15.165:0/4031662970 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f418801e070 con 0x555b4a7e2a40 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.838+0000 7f418ecdd640 1 --2- 172.21.15.165:0/4031662970 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f406803cfb0 0x7f406803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f4192f2e800 1 Processor -- start 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f4192f2e800 1 -- start start 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f418ecdd640 1 --2- 172.21.15.165:0/4031662970 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f406803cfb0 0x7f406803f470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4180096a10 tx=0x7f41800968e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f4192f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f4192f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b4a7c0950 con 0x555b4a7ef4e0 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f418f4de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f418f4de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7ef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51302/0 (socket says 172.21.15.165:51302) 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f418f4de640 1 -- 172.21.15.165:0/203054782 learned_addr learned my addr 172.21.15.165:0/203054782 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f418f4de640 1 -- 172.21.15.165:0/203054782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a7efed0 con 0x555b4a7ef4e0 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f418f4de640 1 --2- 172.21.15.165:0/203054782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7ef8e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4188016fd0 tx=0x7f4188011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418c95afe33d5d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.839+0000 7f40727fc640 1 -- 172.21.15.165:0/203054782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188051020 con 0x555b4a7ef4e0 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f40727fc640 1 -- 172.21.15.165:0/203054782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4188022de0 con 0x555b4a7ef4e0 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f40727fc640 1 -- 172.21.15.165:0/203054782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188028070 con 0x555b4a7ef4e0 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f4192f2e800 1 -- 172.21.15.165:0/203054782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 msgr2=0x555b4a7ef8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f4192f2e800 1 --2- 172.21.15.165:0/203054782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7ef8e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4188016fd0 tx=0x7f4188011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f4192f2e800 1 -- 172.21.15.165:0/203054782 shutdown_connections 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f4192f2e800 1 --2- 172.21.15.165:0/203054782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7ef8e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f4192f2e800 1 -- 172.21.15.165:0/203054782 >> 172.21.15.165:0/203054782 conn(0x555b4a7eb8e0 msgr2=0x555b4a7e9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f4192f2e800 1 -- 172.21.15.165:0/203054782 shutdown_connections 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f4192f2e800 1 -- 172.21.15.165:0/203054782 wait complete. 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f4192f2e800 1 Processor -- start 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.840+0000 7f4192f2e800 1 -- start start 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f4192f2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f4192f2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b4a7f04f0 con 0x555b4a7ef4e0 2024-09-22T08:11:04.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f418f4de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f418f4de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7f6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51312/0 (socket says 172.21.15.165:51312) 2024-09-22T08:11:04.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 learned_addr learned my addr 172.21.15.165:0/2525235331 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a7f7030 con 0x555b4a7ef4e0 2024-09-22T08:11:04.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f418f4de640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7f6ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4188016fd0 tx=0x7f4188054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f4070ff9640 1 -- 172.21.15.165:0/2525235331 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188031020 con 0x555b4a7ef4e0 2024-09-22T08:11:04.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f4070ff9640 1 -- 172.21.15.165:0/2525235331 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4188011480 con 0x555b4a7ef4e0 2024-09-22T08:11:04.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4a7f72c0 con 0x555b4a7ef4e0 2024-09-22T08:11:04.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f4070ff9640 1 -- 172.21.15.165:0/2525235331 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4188045ad0 con 0x555b4a7ef4e0 2024-09-22T08:11:04.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.841+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4a7f7c40 con 0x555b4a7ef4e0 2024-09-22T08:11:04.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.842+0000 7f4070ff9640 1 -- 172.21.15.165:0/2525235331 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4188034020 con 0x555b4a7ef4e0 2024-09-22T08:11:04.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.842+0000 7f4070ff9640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803d000 0x7f405803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.842+0000 7f4070ff9640 1 -- 172.21.15.165:0/2525235331 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f418800e040 con 0x555b4a7ef4e0 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.842+0000 7f418ecdd640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803d000 0x7f405803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.843+0000 7f418ecdd640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803d000 0x7f405803f4c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f418005a7d0 tx=0x7f4180085000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.843+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.843+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a8025e0 0x555b4a804aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.843+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8051f0 con 0x555b4a8025e0 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.843+0000 7f418e4dc640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a8025e0 0x555b4a804aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.843+0000 7f418e4dc640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a8025e0 0x555b4a804aa0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f418400f610 con 0x555b4a8025e0 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 20 realm 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a801930 con 0x555b4a8025e0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f418400f610 con 0x555b4a8025e0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a805ce0 con 0x555b4a8025e0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f418400f610 con 0x555b4a8025e0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8065b0 con 0x555b4a8025e0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f418400f610 con 0x555b4a8025e0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a806fd0 0x555b4a8093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.844+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a809b00 con 0x555b4a806fd0 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.845+0000 7f418f4de640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a806fd0 0x555b4a8093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.845+0000 7f418f4de640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a806fd0 0x555b4a8093c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.845+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.845+0000 7f4192f2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.845+0000 7f4192f2e800 20 searching for the correct realm 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.845+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555b4a80bab0 0x555b4a80df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.845+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a80bab0 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.845+0000 7f418ecdd640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555b4a80bab0 0x555b4a80df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.846+0000 7f418ecdd640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555b4a80bab0 0x555b4a80df40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.846+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.846+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a806fd0 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.846+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.846+0000 7f418f4de640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4188036020 0x7f41880155a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.846+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x7f4188036020 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.846+0000 7f418e4dc640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4188036020 0x7f41880155a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.847+0000 7f418e4dc640 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4188036020 0x7f41880155a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.847+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400f610 con 0x7f4188036020 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.847+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a8025e0 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.847+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400f610 con 0x555b4a8025e0 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.847+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a8025e0 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.847+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f418402b040 con 0x555b4a8025e0 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.847+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x7f4188036020 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.848+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418402b040 con 0x7f4188036020 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.848+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x7f4188036020 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.848+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418402b040 con 0x7f4188036020 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.848+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a806fd0 2024-09-22T08:11:04.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.848+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.848+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a80bab0 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.848+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.848+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a8025e0 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.849+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418402b040 con 0x555b4a8025e0 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.849+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x7f4188036020 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.849+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418402b040 con 0x7f4188036020 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.849+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a8025e0 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.849+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418402b040 con 0x555b4a8025e0 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.849+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a806fd0 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.849+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.849+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a80bab0 2024-09-22T08:11:04.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.850+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.850+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a80bab0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.850+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.850+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x7f4188036020 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.850+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418402b040 con 0x7f4188036020 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.850+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a80bab0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.850+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.850+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a80bab0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.850+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.850+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a8025e0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.851+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418402b040 con 0x555b4a8025e0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.851+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a8025e0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.851+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f418402b040 con 0x555b4a8025e0 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.851+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x7f4188036020 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.851+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418402b040 con 0x7f4188036020 2024-09-22T08:11:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.851+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a80bab0 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.851+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.851+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a806fd0 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.852+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.852+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a8025e0 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.852+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418402b040 con 0x555b4a8025e0 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.852+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x7f4188036020 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.852+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.852+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a80bab0 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.852+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.852+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x7f4188036020 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.853+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.853+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a806fd0 2024-09-22T08:11:04.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.853+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.853+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a80bab0 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.853+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.853+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x7f4188036020 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.853+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.853+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a8025e0 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80e5c0 con 0x555b4a806fd0 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:04.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80a4c0 con 0x555b4a8025e0 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80ad60 con 0x555b4a8025e0 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.854+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80a100 con 0x555b4a8025e0 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 20 zone default found 2024-09-22T08:11:04.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 4 Realm: () 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 20 zonegroup default 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80ea40 con 0x7f4188036020 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a810870 con 0x555b4a80bab0 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.855+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a810cc0 con 0x555b4a80bab0 2024-09-22T08:11:04.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.856+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.856+0000 7f4192f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.856+0000 7f4192f2e800 20 started sync module instance, tier type = 2024-09-22T08:11:04.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.856+0000 7f4192f2e800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:04.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.856+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a80fd10 con 0x555b4a806fd0 2024-09-22T08:11:04.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.857+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.857+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93850580353280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8115d0 con 0x555b4a806fd0 2024-09-22T08:11:04.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.857+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a811e20 con 0x555b4a8025e0 2024-09-22T08:11:04.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.858+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93850580353280] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.858+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.858+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93850580357408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a811ad0 con 0x555b4a8025e0 2024-09-22T08:11:04.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.858+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8125c0 con 0x555b4a80bab0 2024-09-22T08:11:04.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.859+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93850580357408] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.859+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.859+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93850580361360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8129b0 con 0x555b4a80bab0 2024-09-22T08:11:04.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.859+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8133f0 con 0x555b4a806fd0 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.861+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93850580361360] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.862+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.862+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93850580364992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8137e0 con 0x555b4a806fd0 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.862+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a814220 con 0x555b4a8025e0 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.864+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.864+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93850580368624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8141e0 con 0x555b4a8025e0 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.864+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8151e0 con 0x7f4188036020 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.867+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93850580364992] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.867+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.867+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93850580372752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8151e0 con 0x7f4188036020 2024-09-22T08:11:04.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.867+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a815bf0 con 0x7f4188036020 2024-09-22T08:11:04.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.870+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93850580368624] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.870+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.870+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93850580372752] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.870+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93850580370880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a815740 con 0x7f4188036020 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.870+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a816100 con 0x7f4188036020 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.871+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93850580370880] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.871+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.871+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93850580358464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a816100 con 0x7f4188036020 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.871+0000 7f4192f2e800 20 add_watcher() i=0 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.871+0000 7f4192f2e800 20 add_watcher() i=1 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.871+0000 7f4192f2e800 20 add_watcher() i=2 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.871+0000 7f4192f2e800 20 add_watcher() i=3 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.871+0000 7f4192f2e800 20 add_watcher() i=4 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.871+0000 7f4192f2e800 20 add_watcher() i=5 2024-09-22T08:11:04.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.871+0000 7f4192f2e800 20 add_watcher() i=6 2024-09-22T08:11:04.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.872+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93850580358464] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.872+0000 7f4192f2e800 20 add_watcher() i=7 2024-09-22T08:11:04.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.872+0000 7f4192f2e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:04.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.872+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a819570 con 0x555b4a8025e0 2024-09-22T08:11:04.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.873+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.873+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93850580389712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a816270 con 0x555b4a8025e0 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93850580389712] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f40457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f4192f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f4192f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f4192f2e800 5 note: GC not initialized 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f3fbffff640 20 reqs_thread_entry: start 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f4192f2e800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f4192f2e800 20 Filter name: none 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f3fbdffb640 20 reqs_thread_entry: start 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f4192f2e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.874+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a84c900 con 0x555b4a8025e0 2024-09-22T08:11:04.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:04.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a84d370 con 0x555b4a8025e0 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.875+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a852d00 con 0x555b4a8025e0 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.876+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.876+0000 7f4192f2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:04.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.876+0000 7f4192f2e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.876+0000 7f4192f2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.876+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93850580625152 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a84e380 con 0x555b4a8025e0 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.876+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify (1) cookie 93850580368624 notify 137438953477 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f4184018040 con 0x555b4a8025e0 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.877+0000 7f40727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 93850580368624 notifier 4360 bl.length()=732 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.877+0000 7f40727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.877+0000 7f40727fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.877+0000 7f40727fc640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4054003ea0 con 0x555b4a8025e0 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.877+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(65 notify.4 [notify cookie 93850580625152 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.877+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.877+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== watch-notify(notify_complete (2) cookie 93850580625152 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4184009050 con 0x555b4a8025e0 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.877+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a852700 con 0x555b4a8025e0 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f4192f2e800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-22T08:11:04.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f4192f2e800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f4192f2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93850580625152 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b4a84ded0 con 0x555b4a806fd0 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== watch-notify(notify (1) cookie 93850580353280 notify 137438953474 ret 0) ==== 208+0+0 (crc 0 0 0) 0x555b4a7f7c40 con 0x555b4a806fd0 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f4071ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 93850580353280 notifier 4360 bl.length()=166 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f4071ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f4071ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f4071ffb640 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3fc4003400 con 0x555b4a806fd0 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.878+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(68 notify.0 [notify cookie 93850580625152 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.879+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== watch-notify(notify_complete (2) cookie 93850580625152 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b4a7f72c0 con 0x555b4a806fd0 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.879+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.882 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"mRBMb9AGs4Qn0JAxhvHFRcPOqqIg2wCW3QwMq1mA","active":true,"create_date":"2024-09-22T08:11:04.876443Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.880+0000 7f40457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.880+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93850580389712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a84a620 con 0x555b4a8025e0 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.880+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93850580389712] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.880+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93850580353280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a84a620 con 0x555b4a806fd0 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.881+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93850580353280] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.881+0000 7f4192f2e800 20 remove_watcher() i=0 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.881+0000 7f4192f2e800 2 removed watcher, disabling cache 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.881+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93850580357408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a84a620 con 0x555b4a8025e0 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.883+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93850580357408] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.883+0000 7f4192f2e800 20 remove_watcher() i=1 2024-09-22T08:11:04.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.883+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93850580361360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a84a620 con 0x555b4a80bab0 2024-09-22T08:11:04.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.883+0000 7f418ecdd640 1 -- 172.21.15.165:0/2525235331 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93850580361360] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4180057030 con 0x555b4a80bab0 2024-09-22T08:11:04.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.883+0000 7f4192f2e800 20 remove_watcher() i=2 2024-09-22T08:11:04.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.883+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93850580364992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a812090 con 0x555b4a806fd0 2024-09-22T08:11:04.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.884+0000 7f418f4de640 1 -- 172.21.15.165:0/2525235331 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93850580364992] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418802a070 con 0x555b4a806fd0 2024-09-22T08:11:04.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.884+0000 7f4192f2e800 20 remove_watcher() i=3 2024-09-22T08:11:04.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.884+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93850580368624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a812090 con 0x555b4a8025e0 2024-09-22T08:11:04.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.885+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93850580368624] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x555b4a8025e0 2024-09-22T08:11:04.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.885+0000 7f4192f2e800 20 remove_watcher() i=4 2024-09-22T08:11:04.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.885+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93850580372752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a812090 con 0x7f4188036020 2024-09-22T08:11:04.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.886+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93850580372752] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.886+0000 7f4192f2e800 20 remove_watcher() i=5 2024-09-22T08:11:04.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.886+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93850580370880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a812090 con 0x7f4188036020 2024-09-22T08:11:04.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.887+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93850580370880] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.887+0000 7f4192f2e800 20 remove_watcher() i=6 2024-09-22T08:11:04.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.887+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93850580358464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b4a8145c0 con 0x7f4188036020 2024-09-22T08:11:04.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.888+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93850580358464] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418403b040 con 0x7f4188036020 2024-09-22T08:11:04.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.888+0000 7f4192f2e800 20 remove_watcher() i=7 2024-09-22T08:11:04.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.888+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4188036020 msgr2=0x7f41880155a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.888+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4188036020 0x7f41880155a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.888+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a8025e0 msgr2=0x555b4a804aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.888+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a8025e0 0x555b4a804aa0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.888+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a806fd0 msgr2=0x555b4a8093c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.888+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a806fd0 0x555b4a8093c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.888+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555b4a80bab0 msgr2=0x555b4a80df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.888+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555b4a80bab0 0x555b4a80df40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803d000 msgr2=0x7f405803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f405803d000 0x7f405803f4c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f418005a7d0 tx=0x7f4180085000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 msgr2=0x555b4a7f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2525235331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7ef4e0 0x555b4a7f6ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4188016fd0 tx=0x7f4188054720 comp rx=0 tx=0).stop 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 reap_dead start 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f418e4dc640 1 -- 172.21.15.165:0/2525235331 reap_dead start 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 shutdown_connections 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 >> 172.21.15.165:0/2525235331 conn(0x555b4a7eb8e0 msgr2=0x555b4a7e9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 shutdown_connections 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2525235331 wait complete. 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/4031662970 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f406803cfb0 msgr2=0x7f406803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 --2- 172.21.15.165:0/4031662970 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f406803cfb0 0x7f406803f470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4180096a10 tx=0x7f41800968e0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/4031662970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7e2a40 msgr2=0x555b4a7e2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 --2- 172.21.15.165:0/4031662970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7e2a40 0x555b4a7e2e60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x555b4a7c9890 tx=0x7f4188018830 comp rx=0 tx=0).stop 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/4031662970 shutdown_connections 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 --2- 172.21.15.165:0/4031662970 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f406803cfb0 0x7f406803f470 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 --2- 172.21.15.165:0/4031662970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a7e2a40 0x555b4a7e2e60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/4031662970 >> 172.21.15.165:0/4031662970 conn(0x555b4a7d6df0 msgr2=0x555b4a7d71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/4031662970 shutdown_connections 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/4031662970 wait complete. 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a6d3930 msgr2=0x555b4a7cf050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a6d3930 0x555b4a7cf050 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a7d1430 msgr2=0x555b4a7d38d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a7d1430 0x555b4a7d38d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f407403cfb0 msgr2=0x7f407403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f407403cfb0 0x7f407403f470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4184001e30 tx=0x7f4184001390 comp rx=0 tx=0).stop 2024-09-22T08:11:04.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 msgr2=0x555b4a7c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7c7a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f41800460d0 tx=0x7f4180002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.889+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 shutdown_connections 2024-09-22T08:11:04.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.890+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555b4a7d1430 0x555b4a7d38d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.890+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555b4a6d3930 0x555b4a7cf050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.890+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f407403cfb0 0x7f407403f470 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.890+0000 7f4192f2e800 1 --2- 172.21.15.165:0/2874211666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b4a6d1000 0x555b4a7c7a00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.890+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 >> 172.21.15.165:0/2874211666 conn(0x555b4a6cabe0 msgr2=0x555b4a7c1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.890+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 shutdown_connections 2024-09-22T08:11:04.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.890+0000 7f4192f2e800 1 -- 172.21.15.165:0/2874211666 wait complete. 2024-09-22T08:11:04.899 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'mRBMb9AGs4Qn0JAxhvHFRcPOqqIg2wCW3QwMq1mA', 'active': True, 'create_date': '2024-09-22T08:11:04.876443Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:04.899 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-22T08:11:04.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-22T08:11:04.900 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-22T08:11:04.948 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:04.948 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:04.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.948+0000 7fc83142f800 1 Processor -- start 2024-09-22T08:11:04.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.948+0000 7fc83142f800 1 -- start start 2024-09-22T08:11:04.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.948+0000 7fc83142f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d95106590 0x557d95104b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.948+0000 7fc83142f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d9501ba20 con 0x557d951050b0 2024-09-22T08:11:04.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.948+0000 7fc83142f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x557d9501b7d0 con 0x557d95106590 2024-09-22T08:11:04.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.948+0000 7fc82ef19640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d95106590 0x557d95104b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.948+0000 7fc82ef19640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d95106590 0x557d95104b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51316/0 (socket says 172.21.15.165:51316) 2024-09-22T08:11:04.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.948+0000 7fc82e718640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x557d951050b0 0x557d95198510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33572/0 (socket says 172.21.15.165:33572) 2024-09-22T08:11:04.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.948+0000 7fc82ef19640 1 -- 172.21.15.165:0/2228081161 learned_addr learned my addr 172.21.15.165:0/2228081161 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.949+0000 7fc82ef19640 1 -- 172.21.15.165:0/2228081161 >> v1:172.21.15.53:6789/0 conn(0x557d951050b0 legacy=0x557d95198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.949+0000 7fc82ef19640 1 -- 172.21.15.165:0/2228081161 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d951056a0 con 0x557d95106590 2024-09-22T08:11:04.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc82ef19640 1 --2- 172.21.15.165:0/2228081161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d95106590 0x557d95104b70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc82000a520 tx=0x7fc820045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d52463d93f290b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc82df17640 1 -- 172.21.15.165:0/2228081161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820055070 con 0x557d95106590 2024-09-22T08:11:04.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc82df17640 1 -- 172.21.15.165:0/2228081161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8200515b0 con 0x557d95106590 2024-09-22T08:11:04.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc82df17640 1 -- 172.21.15.165:0/2228081161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8200518d0 con 0x557d95106590 2024-09-22T08:11:04.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc83142f800 1 -- 172.21.15.165:0/2228081161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d95106590 msgr2=0x557d95104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc83142f800 1 --2- 172.21.15.165:0/2228081161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d95106590 0x557d95104b70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc82000a520 tx=0x7fc820045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc83142f800 1 -- 172.21.15.165:0/2228081161 shutdown_connections 2024-09-22T08:11:04.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc83142f800 1 --2- 172.21.15.165:0/2228081161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d95106590 0x557d95104b70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc83142f800 1 -- 172.21.15.165:0/2228081161 >> 172.21.15.165:0/2228081161 conn(0x557d9518bdd0 msgr2=0x557d9518e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc83142f800 1 -- 172.21.15.165:0/2228081161 shutdown_connections 2024-09-22T08:11:04.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.951+0000 7fc83142f800 1 -- 172.21.15.165:0/2228081161 wait complete. 2024-09-22T08:11:04.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.965+0000 7fc83142f800 1 Processor -- start 2024-09-22T08:11:04.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.965+0000 7fc83142f800 1 -- start start 2024-09-22T08:11:04.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.965+0000 7fc83142f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95282210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.965+0000 7fc83142f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d95028dd0 con 0x557d951050b0 2024-09-22T08:11:04.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.966+0000 7fc82ef19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95282210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.966+0000 7fc82ef19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95282210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51332/0 (socket says 172.21.15.165:51332) 2024-09-22T08:11:04.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.966+0000 7fc82ef19640 1 -- 172.21.15.165:0/980908 learned_addr learned my addr 172.21.15.165:0/980908 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.966+0000 7fc82ef19640 1 -- 172.21.15.165:0/980908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d95282800 con 0x557d951050b0 2024-09-22T08:11:04.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.966+0000 7fc82ef19640 1 --2- 172.21.15.165:0/980908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95282210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc820025da0 tx=0x7fc820051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76e93f79bb13563 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.966+0000 7fc71ce09640 1 -- 172.21.15.165:0/980908 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820051ac0 con 0x557d951050b0 2024-09-22T08:11:04.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.966+0000 7fc71ce09640 1 -- 172.21.15.165:0/980908 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc820051c60 con 0x557d951050b0 2024-09-22T08:11:04.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.966+0000 7fc71ce09640 1 -- 172.21.15.165:0/980908 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82005a450 con 0x557d951050b0 2024-09-22T08:11:04.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 -- 172.21.15.165:0/980908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 msgr2=0x557d95282210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 --2- 172.21.15.165:0/980908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95282210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc820025da0 tx=0x7fc820051000 comp rx=0 tx=0).stop 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 -- 172.21.15.165:0/980908 shutdown_connections 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 --2- 172.21.15.165:0/980908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95282210 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 -- 172.21.15.165:0/980908 >> 172.21.15.165:0/980908 conn(0x557d9518bdd0 msgr2=0x557d9527dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 -- 172.21.15.165:0/980908 shutdown_connections 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 -- 172.21.15.165:0/980908 wait complete. 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 Processor -- start 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 -- start start 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95289b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.967+0000 7fc83142f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d95199e40 con 0x557d951050b0 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.968+0000 7fc82ef19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95289b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.968+0000 7fc82ef19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95289b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51344/0 (socket says 172.21.15.165:51344) 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.968+0000 7fc82ef19640 1 -- 172.21.15.165:0/3804807927 learned_addr learned my addr 172.21.15.165:0/3804807927 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.968+0000 7fc82ef19640 1 -- 172.21.15.165:0/3804807927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9528a080 con 0x557d951050b0 2024-09-22T08:11:04.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.968+0000 7fc82ef19640 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95289b20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc820025da0 tx=0x7fc820002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.968+0000 7fc71b606640 1 -- 172.21.15.165:0/3804807927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc820073070 con 0x557d951050b0 2024-09-22T08:11:04.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.968+0000 7fc71b606640 1 -- 172.21.15.165:0/3804807927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82005a640 con 0x557d951050b0 2024-09-22T08:11:04.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.968+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d9528a310 con 0x557d951050b0 2024-09-22T08:11:04.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.968+0000 7fc71b606640 1 -- 172.21.15.165:0/3804807927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82005a920 con 0x557d951050b0 2024-09-22T08:11:04.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.968+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d9528af20 con 0x557d951050b0 2024-09-22T08:11:04.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.969+0000 7fc71b606640 1 -- 172.21.15.165:0/3804807927 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc820076070 con 0x557d951050b0 2024-09-22T08:11:04.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.969+0000 7fc71b606640 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc71403cfb0 0x7fc71403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.969+0000 7fc71b606640 1 -- 172.21.15.165:0/3804807927 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc820062070 con 0x557d951050b0 2024-09-22T08:11:04.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.970+0000 7fc82e718640 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc71403cfb0 0x7fc71403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.970+0000 7fc83142f800 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d95106590 0x557d95291170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.970+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952916b0 con 0x557d95106590 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.970+0000 7fc82f71a640 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d95106590 0x557d95291170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.970+0000 7fc82e718640 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc71403cfb0 0x7fc71403f470 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc824001e80 tx=0x7fc8240013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.970+0000 7fc82f71a640 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d95106590 0x557d95291170 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.970+0000 7fc82f71a640 1 -- 172.21.15.165:0/3804807927 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc82800a4d0 con 0x557d95106590 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.970+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d95291a50 con 0x557d95106590 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.971+0000 7fc82f71a640 1 -- 172.21.15.165:0/3804807927 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc82800a4d0 con 0x557d95106590 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.971+0000 7fc83142f800 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952937c0 0x557d95295bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.971+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d95296200 con 0x557d952937c0 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.971+0000 7fc82ef19640 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952937c0 0x557d95295bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.971+0000 7fc82ef19640 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952937c0 0x557d95295bb0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.971+0000 7fc82ef19640 1 -- 172.21.15.165:0/3804807927 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc82007f070 con 0x557d952937c0 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.971+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d95292660 con 0x557d95106590 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.972+0000 7fc82f71a640 1 -- 172.21.15.165:0/3804807927 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc82800a4d0 con 0x557d95106590 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.972+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d95292b00 con 0x557d95106590 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.972+0000 7fc82f71a640 1 -- 172.21.15.165:0/3804807927 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc82800a4d0 con 0x557d95106590 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.972+0000 7fc83142f800 1 Processor -- start 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.972+0000 7fc83142f800 1 -- start start 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc83142f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952a4bb0 0x557d952a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc83142f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d95087d50 con 0x557d952a4bb0 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc82f71a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952a4bb0 0x557d952a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc82f71a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952a4bb0 0x557d952a4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51354/0 (socket says 172.21.15.165:51354) 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc82f71a640 1 -- 172.21.15.165:0/3229359276 learned_addr learned my addr 172.21.15.165:0/3229359276 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc82f71a640 1 -- 172.21.15.165:0/3229359276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d952a5610 con 0x557d952a4bb0 2024-09-22T08:11:04.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc82f71a640 1 --2- 172.21.15.165:0/3229359276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952a4bb0 0x557d952a4fd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x557d9528a9b0 tx=0x7fc828018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc718e01640 1 -- 172.21.15.165:0/3229359276 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828014450 con 0x557d952a4bb0 2024-09-22T08:11:04.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc718e01640 1 -- 172.21.15.165:0/3229359276 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc828014610 con 0x557d952a4bb0 2024-09-22T08:11:04.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc83142f800 1 -- 172.21.15.165:0/3229359276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d952a5e40 con 0x557d952a4bb0 2024-09-22T08:11:04.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc718e01640 1 -- 172.21.15.165:0/3229359276 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828014930 con 0x557d952a4bb0 2024-09-22T08:11:04.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.973+0000 7fc83142f800 1 -- 172.21.15.165:0/3229359276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d952a63e0 con 0x557d952a4bb0 2024-09-22T08:11:04.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.974+0000 7fc718e01640 1 -- 172.21.15.165:0/3229359276 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc828011040 con 0x557d952a4bb0 2024-09-22T08:11:04.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.974+0000 7fc718e01640 1 --2- 172.21.15.165:0/3229359276 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc70803d000 0x7fc70803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.974+0000 7fc718e01640 1 -- 172.21.15.165:0/3229359276 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc82801e070 con 0x557d952a4bb0 2024-09-22T08:11:04.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.974+0000 7fc82ef19640 1 --2- 172.21.15.165:0/3229359276 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc70803d000 0x7fc70803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.975+0000 7fc83142f800 1 Processor -- start 2024-09-22T08:11:04.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.975+0000 7fc83142f800 1 -- start start 2024-09-22T08:11:04.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.975+0000 7fc82ef19640 1 --2- 172.21.15.165:0/3229359276 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc70803d000 0x7fc70803f4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x557d9528b1a0 tx=0x7fc820076590 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.975+0000 7fc83142f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.975+0000 7fc83142f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d95282b70 con 0x557d952b1630 2024-09-22T08:11:04.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.975+0000 7fc82f71a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.975+0000 7fc82f71a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51366/0 (socket says 172.21.15.165:51366) 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.975+0000 7fc82f71a640 1 -- 172.21.15.165:0/436106575 learned_addr learned my addr 172.21.15.165:0/436106575 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.975+0000 7fc82f71a640 1 -- 172.21.15.165:0/436106575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d952b2000 con 0x557d952b1630 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc82f71a640 1 --2- 172.21.15.165:0/436106575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b1a10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc828016fd0 tx=0x7fc82802b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f3c1d394a6a066 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc7127fc640 1 -- 172.21.15.165:0/436106575 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828022de0 con 0x557d952b1630 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc7127fc640 1 -- 172.21.15.165:0/436106575 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc828011da0 con 0x557d952b1630 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc7127fc640 1 -- 172.21.15.165:0/436106575 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8280167c0 con 0x557d952b1630 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc83142f800 1 -- 172.21.15.165:0/436106575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 msgr2=0x557d952b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc83142f800 1 --2- 172.21.15.165:0/436106575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b1a10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc828016fd0 tx=0x7fc82802b4c0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc83142f800 1 -- 172.21.15.165:0/436106575 shutdown_connections 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc83142f800 1 --2- 172.21.15.165:0/436106575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b1a10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:04.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc83142f800 1 -- 172.21.15.165:0/436106575 >> 172.21.15.165:0/436106575 conn(0x557d952ada30 msgr2=0x557d952abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc83142f800 1 -- 172.21.15.165:0/436106575 shutdown_connections 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.976+0000 7fc83142f800 1 -- 172.21.15.165:0/436106575 wait complete. 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.977+0000 7fc83142f800 1 Processor -- start 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.977+0000 7fc83142f800 1 -- start start 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.977+0000 7fc83142f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.977+0000 7fc83142f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d952b2640 con 0x557d952b1630 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.977+0000 7fc82f71a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.977+0000 7fc82f71a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51376/0 (socket says 172.21.15.165:51376) 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.977+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 learned_addr learned my addr 172.21.15.165:0/1830430473 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.977+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d952b9180 con 0x557d952b1630 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.977+0000 7fc82f71a640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b8c20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc828016fd0 tx=0x7fc828054670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.977+0000 7fc710ff9640 1 -- 172.21.15.165:0/1830430473 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828011460 con 0x557d952b1630 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.978+0000 7fc710ff9640 1 -- 172.21.15.165:0/1830430473 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc828032020 con 0x557d952b1630 2024-09-22T08:11:04.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.978+0000 7fc710ff9640 1 -- 172.21.15.165:0/1830430473 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828016910 con 0x557d952b1630 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.978+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d952b9410 con 0x557d952b1630 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.978+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d952b9fa0 con 0x557d952b1630 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.978+0000 7fc710ff9640 1 -- 172.21.15.165:0/1830430473 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc82804dd10 con 0x557d952b1630 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.979+0000 7fc710ff9640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc6f803cfb0 0x7fc6f803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.979+0000 7fc710ff9640 1 -- 172.21.15.165:0/1830430473 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc828033030 con 0x557d952b1630 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.979+0000 7fc82ef19640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc6f803cfb0 0x7fc6f803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.979+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.979+0000 7fc83142f800 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d952c4770 0x557d952c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.979+0000 7fc82ef19640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc6f803cfb0 0x7fc6f803f470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc820051f60 tx=0x7fc82008f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.979+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952c7380 con 0x557d952c4770 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.979+0000 7fc82e718640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d952c4770 0x557d952c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.979+0000 7fc82e718640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d952c4770 0x557d952c6c30 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc82400f630 con 0x557d952c4770 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 20 realm 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952c3ac0 con 0x557d952c4770 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc82400f630 con 0x557d952c4770 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952c7e70 con 0x557d952c4770 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc82400f630 con 0x557d952c4770 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:04.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952c8740 con 0x557d952c4770 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc82400f630 con 0x557d952c4770 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952c9160 0x557d952cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952cbc90 con 0x557d952c9160 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.980+0000 7fc82f71a640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952c9160 0x557d952cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.981+0000 7fc82f71a640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952c9160 0x557d952cb550 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.981+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.981+0000 7fc83142f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.981+0000 7fc83142f800 20 searching for the correct realm 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.981+0000 7fc83142f800 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557d952cdc40 0x557d952d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.981+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952cdc40 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.981+0000 7fc82ef19640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557d952cdc40 0x557d952d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.981+0000 7fc82ef19640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557d952cdc40 0x557d952d0100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.982+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.982+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c9160 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.982+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.982+0000 7fc82f71a640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fc828014070 0x7fc828001930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.982+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x7fc828014070 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.982+0000 7fc82e718640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fc828014070 0x7fc828001930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.983+0000 7fc82e718640 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fc828014070 0x7fc828001930 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.983+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f630 con 0x7fc828014070 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.983+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c4770 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.983+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f630 con 0x557d952c4770 2024-09-22T08:11:04.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.983+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c4770 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.983+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc82402b040 con 0x557d952c4770 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.984+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x7fc828014070 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.984+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82402b040 con 0x7fc828014070 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.984+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x7fc828014070 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.984+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82402b040 con 0x7fc828014070 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.984+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c9160 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.984+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.984+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952cdc40 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.984+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.984+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c4770 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.985+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82402b040 con 0x557d952c4770 2024-09-22T08:11:05.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.985+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x7fc828014070 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.985+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82402b040 con 0x7fc828014070 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.985+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c4770 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.985+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82402b040 con 0x557d952c4770 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.985+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c9160 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.985+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.985+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952cdc40 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.986+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.986+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952cdc40 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.986+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.986+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x7fc828014070 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.986+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82402b040 con 0x7fc828014070 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.986+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952cdc40 2024-09-22T08:11:05.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.986+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.986+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952cdc40 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.987+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.987+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c4770 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.987+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82402b040 con 0x557d952c4770 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.987+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c4770 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.987+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc82402b040 con 0x557d952c4770 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.987+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x7fc828014070 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.987+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82402b040 con 0x7fc828014070 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.987+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952cdc40 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.988+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.988+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c9160 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.988+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.988+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c4770 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.988+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82402b040 con 0x557d952c4770 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.988+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x7fc828014070 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.988+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.988+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952cdc40 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.989+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.989+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x7fc828014070 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.989+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.989+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c9160 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.989+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.989+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952cdc40 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.989+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.989+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x7fc828014070 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c4770 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0780 con 0x557d952c9160 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952cc680 con 0x557d952c4770 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.990+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952ccf20 con 0x557d952c4770 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0c00 con 0x557d952c4770 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 20 zone default found 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 4 Realm: () 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 20 zonegroup default 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952d0c00 con 0x7fc828014070 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.991+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc83142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952d2a30 con 0x557d952cdc40 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc83142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952d2f10 con 0x557d952cdc40 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc83142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc83142f800 20 started sync module instance, tier type = 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc83142f800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.992+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d1ed0 con 0x557d952c9160 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.993+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.993+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93997862036160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d1b30 con 0x557d952c9160 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.993+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d3e40 con 0x557d952c4770 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.994+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93997862036160] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.994+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.994+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93997862040432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d3e40 con 0x557d952c4770 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.994+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d4840 con 0x557d952cdc40 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.995+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.995+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93997862044496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d50e0 con 0x557d952cdc40 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.995+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d5b90 con 0x557d952c9160 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.995+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93997862040432] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.996+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93997862044496] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.996+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.996+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93997862046768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d5670 con 0x557d952c9160 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.996+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d6470 con 0x557d952c4770 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.997+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.997+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93997862046768] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.997+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93997862042000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d6430 con 0x557d952c4770 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.998+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d6f20 con 0x7fc828014070 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.998+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93997862042000] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.998+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.998+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93997862054384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d6430 con 0x7fc828014070 2024-09-22T08:11:05.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.998+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d7930 con 0x7fc828014070 2024-09-22T08:11:05.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.999+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93997862054384] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.999+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.999+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93997862057568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d6430 con 0x7fc828014070 2024-09-22T08:11:05.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:04.999+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d8340 con 0x7fc828014070 2024-09-22T08:11:05.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.000+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.000+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93997862059664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d8760 con 0x7fc828014070 2024-09-22T08:11:05.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.000+0000 7fc83142f800 20 add_watcher() i=0 2024-09-22T08:11:05.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.000+0000 7fc83142f800 20 add_watcher() i=1 2024-09-22T08:11:05.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.000+0000 7fc83142f800 20 add_watcher() i=2 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.000+0000 7fc83142f800 20 add_watcher() i=3 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.000+0000 7fc83142f800 20 add_watcher() i=4 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.000+0000 7fc83142f800 20 add_watcher() i=5 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.001+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93997862057568] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.001+0000 7fc83142f800 20 add_watcher() i=6 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.001+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93997862059664] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.001+0000 7fc83142f800 20 add_watcher() i=7 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.001+0000 7fc83142f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.001+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d952dbca0 con 0x557d952c4770 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.002+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.002+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93997862060720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d9120 con 0x557d952c4770 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.003+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93997862060720] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.003+0000 7fc6e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.003+0000 7fc83142f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.003+0000 7fc83142f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.003+0000 7fc83142f800 5 note: GC not initialized 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.003+0000 7fc65ffff640 20 reqs_thread_entry: start 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.003+0000 7fc83142f800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.003+0000 7fc83142f800 20 Filter name: none 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.003+0000 7fc65dffb640 20 reqs_thread_entry: start 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.004+0000 7fc83142f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.004+0000 7fc83142f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.004+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9530ec60 con 0x557d952c4770 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.004+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.004+0000 7fc83142f800 20 rados_obj.operate() r=0 bl.length=556 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.004+0000 7fc83142f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:05.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.004+0000 7fc83142f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.004+0000 7fc83142f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.004+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d953153f0 con 0x557d952c4770 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.005+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.005+0000 7fc83142f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.005+0000 7fc83142f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.005+0000 7fc83142f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.005+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93997862309360 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d95310ad0 con 0x557d952c4770 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.005+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 93997862042000 notify 137438953478 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fc824018040 con 0x557d952c4770 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.006+0000 7fc7127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 93997862042000 notifier 4367 bl.length()=732 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.006+0000 7fc7127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.006+0000 7fc7127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.006+0000 7fc7127fc640 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc6f4003ea0 con 0x557d952c4770 2024-09-22T08:11:05.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.006+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(64 notify.4 [notify cookie 93997862309360 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.006+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.006+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 93997862309360 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc824009050 con 0x557d952c4770 2024-09-22T08:11:05.016 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.007+0000 7fc6e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.007+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93997862060720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d95310620 con 0x557d952c4770 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.008+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93997862060720] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.008+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93997862036160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9530c920 con 0x557d952c9160 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.009+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93997862036160] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.009+0000 7fc83142f800 20 remove_watcher() i=0 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.009+0000 7fc83142f800 2 removed watcher, disabling cache 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.009+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93997862040432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9530c920 con 0x557d952c4770 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.010+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93997862040432] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.010+0000 7fc83142f800 20 remove_watcher() i=1 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.010+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93997862044496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9530c920 con 0x557d952cdc40 2024-09-22T08:11:05.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.011+0000 7fc82ef19640 1 -- 172.21.15.165:0/1830430473 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93997862044496] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82007f070 con 0x557d952cdc40 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.011+0000 7fc83142f800 20 remove_watcher() i=2 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.011+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93997862046768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d95310ad0 con 0x557d952c9160 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.012+0000 7fc82f71a640 1 -- 172.21.15.165:0/1830430473 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93997862046768] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802a070 con 0x557d952c9160 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.012+0000 7fc83142f800 20 remove_watcher() i=3 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.012+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93997862042000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d82b0 con 0x557d952c4770 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.013+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93997862042000] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x557d952c4770 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.013+0000 7fc83142f800 20 remove_watcher() i=4 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.013+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93997862054384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d82b0 con 0x7fc828014070 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.014+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93997862054384] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.014+0000 7fc83142f800 20 remove_watcher() i=5 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.014+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93997862057568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d69f0 con 0x7fc828014070 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.015+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93997862057568] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.015+0000 7fc83142f800 20 remove_watcher() i=6 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.015+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93997862059664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d952d82b0 con 0x7fc828014070 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.015+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93997862059664] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82403b040 con 0x7fc828014070 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.015+0000 7fc83142f800 20 remove_watcher() i=7 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fc828014070 msgr2=0x7fc828001930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fc828014070 0x7fc828001930 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d952c4770 msgr2=0x557d952c6c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d952c4770 0x557d952c6c30 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952c9160 msgr2=0x557d952cb550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952c9160 0x557d952cb550 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557d952cdc40 msgr2=0x557d952d0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557d952cdc40 0x557d952d0100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc6f803cfb0 msgr2=0x7fc6f803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc6f803cfb0 0x7fc6f803f470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc820051f60 tx=0x7fc82008f000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 msgr2=0x557d952b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b8c20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc828016fd0 tx=0x7fc828054670 comp rx=0 tx=0).stop 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc82e718640 1 -- 172.21.15.165:0/1830430473 reap_dead start 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 shutdown_connections 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/1830430473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952b1630 0x557d952b8c20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 >> 172.21.15.165:0/1830430473 conn(0x557d952ada30 msgr2=0x557d952abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 shutdown_connections 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/1830430473 wait complete. 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/3229359276 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc70803d000 msgr2=0x7fc70803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/3229359276 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc70803d000 0x7fc70803f4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x557d9528b1a0 tx=0x7fc820076590 comp rx=0 tx=0).stop 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/3229359276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952a4bb0 msgr2=0x557d952a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/3229359276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952a4bb0 0x557d952a4fd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x557d9528a9b0 tx=0x7fc828018830 comp rx=0 tx=0).stop 2024-09-22T08:11:05.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/3229359276 shutdown_connections 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/3229359276 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc70803d000 0x7fc70803f4c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 --2- 172.21.15.165:0/3229359276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d952a4bb0 0x557d952a4fd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/3229359276 >> 172.21.15.165:0/3229359276 conn(0x557d95298f60 msgr2=0x557d95299340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/3229359276 shutdown_connections 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.016+0000 7fc83142f800 1 -- 172.21.15.165:0/3229359276 wait complete. 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d95106590 msgr2=0x557d95291170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d95106590 0x557d95291170 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952937c0 msgr2=0x557d95295bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952937c0 0x557d95295bb0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc71403cfb0 msgr2=0x7fc71403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc71403cfb0 0x7fc71403f470 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc824001e80 tx=0x7fc8240013e0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 msgr2=0x557d95289b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95289b20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc820025da0 tx=0x7fc820002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 shutdown_connections 2024-09-22T08:11:05.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557d952937c0 0x557d95295bb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557d95106590 0x557d95291170 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc71403cfb0 0x7fc71403f470 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 --2- 172.21.15.165:0/3804807927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d951050b0 0x557d95289b20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 >> 172.21.15.165:0/3804807927 conn(0x557d9518bdd0 msgr2=0x557d9527c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 shutdown_connections 2024-09-22T08:11:05.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.017+0000 7fc83142f800 1 -- 172.21.15.165:0/3804807927 wait complete. 2024-09-22T08:11:05.027 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:05.027 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:11:05.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:11:05.027 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:11:05.072 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:05.072 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:05.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.072+0000 7fa641326800 1 Processor -- start 2024-09-22T08:11:05.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.072+0000 7fa641326800 1 -- start start 2024-09-22T08:11:05.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.072+0000 7fa641326800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555eb372bd40 0x555eb372e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.072+0000 7fa641326800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555eb35b0a20 con 0x555eb3723cc0 2024-09-22T08:11:05.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.072+0000 7fa641326800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555eb35b07d0 con 0x555eb372bd40 2024-09-22T08:11:05.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.072+0000 7fa634708640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555eb372bd40 0x555eb372e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.072+0000 7fa63cf09640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x555eb3723cc0 0x555eb37260d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33574/0 (socket says 172.21.15.165:33574) 2024-09-22T08:11:05.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.072+0000 7fa63cf09640 1 -- 172.21.15.165:0/2603052 learned_addr learned my addr 172.21.15.165:0/2603052 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:05.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.072+0000 7fa634708640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555eb372bd40 0x555eb372e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51386/0 (socket says 172.21.15.165:51386) 2024-09-22T08:11:05.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.073+0000 7fa634708640 1 -- 172.21.15.165:0/2603052 >> v1:172.21.15.53:6789/0 conn(0x555eb3723cc0 legacy=0x555eb37260d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.073+0000 7fa634708640 1 -- 172.21.15.165:0/2603052 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb372f770 con 0x555eb372bd40 2024-09-22T08:11:05.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.074+0000 7fa634708640 1 --2- 172.21.15.165:0/2603052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb372bd40 0x555eb372e130 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa62400a470 tx=0x7fa624045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c7053e0b3a1044 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.075+0000 7fa637fff640 1 -- 172.21.15.165:0/2603052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa624053570 con 0x555eb372bd40 2024-09-22T08:11:05.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.075+0000 7fa637fff640 1 -- 172.21.15.165:0/2603052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa624058070 con 0x555eb372bd40 2024-09-22T08:11:05.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.075+0000 7fa637fff640 1 -- 172.21.15.165:0/2603052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa624053880 con 0x555eb372bd40 2024-09-22T08:11:05.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.075+0000 7fa641326800 1 -- 172.21.15.165:0/2603052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb372bd40 msgr2=0x555eb372e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.075+0000 7fa641326800 1 --2- 172.21.15.165:0/2603052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb372bd40 0x555eb372e130 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa62400a470 tx=0x7fa624045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:05.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.075+0000 7fa641326800 1 -- 172.21.15.165:0/2603052 shutdown_connections 2024-09-22T08:11:05.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.075+0000 7fa641326800 1 --2- 172.21.15.165:0/2603052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb372bd40 0x555eb372e130 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.075+0000 7fa641326800 1 -- 172.21.15.165:0/2603052 >> 172.21.15.165:0/2603052 conn(0x555eb371f310 msgr2=0x555eb3721790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.075+0000 7fa641326800 1 -- 172.21.15.165:0/2603052 shutdown_connections 2024-09-22T08:11:05.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.075+0000 7fa641326800 1 -- 172.21.15.165:0/2603052 wait complete. 2024-09-22T08:11:05.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.089+0000 7fa641326800 1 Processor -- start 2024-09-22T08:11:05.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.089+0000 7fa641326800 1 -- start start 2024-09-22T08:11:05.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.089+0000 7fa641326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb3817230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.089+0000 7fa641326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555eb35bddd0 con 0x555eb3723cc0 2024-09-22T08:11:05.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.089+0000 7fa63cf09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb3817230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.090+0000 7fa63cf09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb3817230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51396/0 (socket says 172.21.15.165:51396) 2024-09-22T08:11:05.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.090+0000 7fa63cf09640 1 -- 172.21.15.165:0/2934914193 learned_addr learned my addr 172.21.15.165:0/2934914193 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.090+0000 7fa63cf09640 1 -- 172.21.15.165:0/2934914193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb3817820 con 0x555eb3723cc0 2024-09-22T08:11:05.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.090+0000 7fa63cf09640 1 --2- 172.21.15.165:0/2934914193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb3817230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa62c001e40 tx=0x7fa62c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecce447e80b04d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.090+0000 7fa52ae0d640 1 -- 172.21.15.165:0/2934914193 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa62c012020 con 0x555eb3723cc0 2024-09-22T08:11:05.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.090+0000 7fa52ae0d640 1 -- 172.21.15.165:0/2934914193 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa62c00e5a0 con 0x555eb3723cc0 2024-09-22T08:11:05.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.090+0000 7fa52ae0d640 1 -- 172.21.15.165:0/2934914193 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa62c00e8a0 con 0x555eb3723cc0 2024-09-22T08:11:05.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.091+0000 7fa641326800 1 -- 172.21.15.165:0/2934914193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 msgr2=0x555eb3817230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.091+0000 7fa641326800 1 --2- 172.21.15.165:0/2934914193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb3817230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa62c001e40 tx=0x7fa62c001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:05.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.091+0000 7fa641326800 1 -- 172.21.15.165:0/2934914193 shutdown_connections 2024-09-22T08:11:05.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.091+0000 7fa641326800 1 --2- 172.21.15.165:0/2934914193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb3817230 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.091+0000 7fa641326800 1 -- 172.21.15.165:0/2934914193 >> 172.21.15.165:0/2934914193 conn(0x555eb371f310 msgr2=0x555eb3812bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.091+0000 7fa641326800 1 -- 172.21.15.165:0/2934914193 shutdown_connections 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.091+0000 7fa641326800 1 -- 172.21.15.165:0/2934914193 wait complete. 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.091+0000 7fa641326800 1 Processor -- start 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.091+0000 7fa641326800 1 -- start start 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.092+0000 7fa641326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb381ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.092+0000 7fa641326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555eb372ea30 con 0x555eb3723cc0 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.092+0000 7fa63cf09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb381ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.092+0000 7fa63cf09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb381ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51404/0 (socket says 172.21.15.165:51404) 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.092+0000 7fa63cf09640 1 -- 172.21.15.165:0/2324567517 learned_addr learned my addr 172.21.15.165:0/2324567517 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.092+0000 7fa63cf09640 1 -- 172.21.15.165:0/2324567517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb381f2f0 con 0x555eb3723cc0 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.092+0000 7fa63cf09640 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb381ed90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00c010 tx=0x7fa62c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.093+0000 7fa52960a640 1 -- 172.21.15.165:0/2324567517 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa62c012030 con 0x555eb3723cc0 2024-09-22T08:11:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.093+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555eb381f580 con 0x555eb3723cc0 2024-09-22T08:11:05.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.093+0000 7fa52960a640 1 -- 172.21.15.165:0/2324567517 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa62c0014a0 con 0x555eb3723cc0 2024-09-22T08:11:05.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.093+0000 7fa52960a640 1 -- 172.21.15.165:0/2324567517 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa62c01a7a0 con 0x555eb3723cc0 2024-09-22T08:11:05.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.093+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eb381ff80 con 0x555eb3723cc0 2024-09-22T08:11:05.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.094+0000 7fa52960a640 1 -- 172.21.15.165:0/2324567517 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa62c015020 con 0x555eb3723cc0 2024-09-22T08:11:05.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.094+0000 7fa52960a640 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa52403cfb0 0x7fa52403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.094+0000 7fa52960a640 1 -- 172.21.15.165:0/2324567517 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa62c020030 con 0x555eb3723cc0 2024-09-22T08:11:05.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.094+0000 7fa634708640 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa52403cfb0 0x7fa52403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.094+0000 7fa641326800 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb372bd40 0x555eb38263e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.094+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb3820b60 con 0x555eb372bd40 2024-09-22T08:11:05.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.094+0000 7fa63d70a640 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb372bd40 0x555eb38263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.094+0000 7fa634708640 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa52403cfb0 0x7fa52403f470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa624057000 tx=0x7fa624052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.095+0000 7fa63d70a640 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb372bd40 0x555eb38263e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.095+0000 7fa63d70a640 1 -- 172.21.15.165:0/2324567517 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa63800a4d0 con 0x555eb372bd40 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.095+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb3820430 con 0x555eb372bd40 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.095+0000 7fa63d70a640 1 -- 172.21.15.165:0/2324567517 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa63800a4d0 con 0x555eb372bd40 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.095+0000 7fa641326800 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb38288b0 0x555eb382aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.095+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb382b370 con 0x555eb38288b0 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.095+0000 7fa63cf09640 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb38288b0 0x555eb382aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.095+0000 7fa63cf09640 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb38288b0 0x555eb382aca0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.096+0000 7fa63cf09640 1 -- 172.21.15.165:0/2324567517 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb38288b0 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.096+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb3827750 con 0x555eb372bd40 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.096+0000 7fa63d70a640 1 -- 172.21.15.165:0/2324567517 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa63800a4d0 con 0x555eb372bd40 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.096+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb3827bf0 con 0x555eb372bd40 2024-09-22T08:11:05.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.096+0000 7fa63d70a640 1 -- 172.21.15.165:0/2324567517 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa63800a4d0 con 0x555eb372bd40 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.097+0000 7fa641326800 1 Processor -- start 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.097+0000 7fa641326800 1 -- start start 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.097+0000 7fa641326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3839cf0 0x555eb383a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.097+0000 7fa641326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555eb361cd50 con 0x555eb3839cf0 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.097+0000 7fa63d70a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3839cf0 0x555eb383a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.097+0000 7fa63d70a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3839cf0 0x555eb383a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51414/0 (socket says 172.21.15.165:51414) 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.097+0000 7fa63d70a640 1 -- 172.21.15.165:0/2915544337 learned_addr learned my addr 172.21.15.165:0/2915544337 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.098+0000 7fa63d70a640 1 -- 172.21.15.165:0/2915544337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb383a750 con 0x555eb3839cf0 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.098+0000 7fa63d70a640 1 --2- 172.21.15.165:0/2915544337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3839cf0 0x555eb383a110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x555eb3826960 tx=0x7fa638018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.098+0000 7fa5227fc640 1 -- 172.21.15.165:0/2915544337 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6380180d0 con 0x555eb3839cf0 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.098+0000 7fa5227fc640 1 -- 172.21.15.165:0/2915544337 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa638018270 con 0x555eb3839cf0 2024-09-22T08:11:05.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.098+0000 7fa5227fc640 1 -- 172.21.15.165:0/2915544337 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638014450 con 0x555eb3839cf0 2024-09-22T08:11:05.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.098+0000 7fa641326800 1 -- 172.21.15.165:0/2915544337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555eb383af80 con 0x555eb3839cf0 2024-09-22T08:11:05.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.098+0000 7fa641326800 1 -- 172.21.15.165:0/2915544337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eb383b520 con 0x555eb3839cf0 2024-09-22T08:11:05.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.099+0000 7fa5227fc640 1 -- 172.21.15.165:0/2915544337 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa638011040 con 0x555eb3839cf0 2024-09-22T08:11:05.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.099+0000 7fa5227fc640 1 --2- 172.21.15.165:0/2915544337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa51403d000 0x7fa51403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.099+0000 7fa5227fc640 1 -- 172.21.15.165:0/2915544337 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa63801e070 con 0x555eb3839cf0 2024-09-22T08:11:05.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.099+0000 7fa63cf09640 1 --2- 172.21.15.165:0/2915544337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa51403d000 0x7fa51403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.099+0000 7fa641326800 1 Processor -- start 2024-09-22T08:11:05.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.099+0000 7fa641326800 1 -- start start 2024-09-22T08:11:05.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.099+0000 7fa63cf09640 1 --2- 172.21.15.165:0/2915544337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa51403d000 0x7fa51403f4c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x555eb3826a00 tx=0x7fa62c018b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.099+0000 7fa641326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb3846b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.099+0000 7fa641326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555eb3817c50 con 0x555eb3846770 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.100+0000 7fa63d70a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb3846b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.100+0000 7fa63d70a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb3846b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51428/0 (socket says 172.21.15.165:51428) 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.100+0000 7fa63d70a640 1 -- 172.21.15.165:0/3337866104 learned_addr learned my addr 172.21.15.165:0/3337866104 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.100+0000 7fa63d70a640 1 -- 172.21.15.165:0/3337866104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb3847160 con 0x555eb3846770 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.100+0000 7fa63d70a640 1 --2- 172.21.15.165:0/3337866104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb3846b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa638054320 tx=0x7fa638016440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05c275e02cb2cda server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.100+0000 7fa513fff640 1 -- 172.21.15.165:0/3337866104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63802bb90 con 0x555eb3846770 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.100+0000 7fa513fff640 1 -- 172.21.15.165:0/3337866104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63804b070 con 0x555eb3846770 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.100+0000 7fa513fff640 1 -- 172.21.15.165:0/3337866104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63802be60 con 0x555eb3846770 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 -- 172.21.15.165:0/3337866104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 msgr2=0x555eb3846b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 --2- 172.21.15.165:0/3337866104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb3846b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa638054320 tx=0x7fa638016440 comp rx=0 tx=0).stop 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 -- 172.21.15.165:0/3337866104 shutdown_connections 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 --2- 172.21.15.165:0/3337866104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb3846b70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 -- 172.21.15.165:0/3337866104 >> 172.21.15.165:0/3337866104 conn(0x555eb3842b70 msgr2=0x555eb3840db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 -- 172.21.15.165:0/3337866104 shutdown_connections 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 -- 172.21.15.165:0/3337866104 wait complete. 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 Processor -- start 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 -- start start 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb384ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa641326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555eb3847780 con 0x555eb3846770 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa63d70a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb384ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa63d70a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb384ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51440/0 (socket says 172.21.15.165:51440) 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.101+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 learned_addr learned my addr 172.21.15.165:0/3581064350 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.102+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb384e330 con 0x555eb3846770 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.102+0000 7fa63d70a640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb384ddd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa6380117d0 tx=0x7fa6380542b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.102+0000 7fa5127fc640 1 -- 172.21.15.165:0/3581064350 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638014800 con 0x555eb3846770 2024-09-22T08:11:05.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.102+0000 7fa5127fc640 1 -- 172.21.15.165:0/3581064350 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6380149a0 con 0x555eb3846770 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.102+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555eb384e5c0 con 0x555eb3846770 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.102+0000 7fa5127fc640 1 -- 172.21.15.165:0/3581064350 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638022910 con 0x555eb3846770 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.102+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eb384f150 con 0x555eb3846770 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.103+0000 7fa5127fc640 1 -- 172.21.15.165:0/3581064350 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa638022ab0 con 0x555eb3846770 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.103+0000 7fa5127fc640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa50803d000 0x7fa50803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.103+0000 7fa5127fc640 1 -- 172.21.15.165:0/3581064350 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa638034070 con 0x555eb3846770 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.103+0000 7fa63cf09640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa50803d000 0x7fa50803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.103+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.103+0000 7fa641326800 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb3859830 0x555eb385bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb385c440 con 0x555eb3859830 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa634708640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb3859830 0x555eb385bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa63cf09640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa50803d000 0x7fa50803f4c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa62c03f010 tx=0x7fa62c049000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa634708640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb3859830 0x555eb385bcf0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa641326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa641326800 20 realm 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb385c870 con 0x555eb3859830 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa641326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa641326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.104+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb385d140 con 0x555eb3859830 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa641326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb385d4e0 con 0x555eb3859830 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa641326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa641326800 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb385e240 0x555eb3860630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb3860b70 con 0x555eb385e240 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa63d70a640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb385e240 0x555eb3860630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa63d70a640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb385e240 0x555eb3860630 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa641326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa641326800 20 searching for the correct realm 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.105+0000 7fa641326800 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555eb3862bb0 0x555eb3865070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.106+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3862bb0 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.106+0000 7fa63cf09640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555eb3862bb0 0x555eb3865070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.106+0000 7fa63cf09640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555eb3862bb0 0x555eb3865070 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.106+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.106+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb385e240 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.106+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.106+0000 7fa63d70a640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fa638014070 0x7fa63801b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.106+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x7fa638014070 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.107+0000 7fa634708640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fa638014070 0x7fa63801b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.107+0000 7fa634708640 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fa638014070 0x7fa63801b9f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.107+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.107+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3859830 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.108+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.108+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3859830 2024-09-22T08:11:05.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.108+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.108+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x7fa638014070 2024-09-22T08:11:05.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.108+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.108+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x7fa638014070 2024-09-22T08:11:05.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.108+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.108+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb385e240 2024-09-22T08:11:05.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.109+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.109+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3862bb0 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.109+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.109+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3859830 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.109+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.109+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x7fa638014070 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.109+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.109+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3859830 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.110+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.110+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb385e240 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.110+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.110+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3862bb0 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.110+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.110+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3862bb0 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.110+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.110+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x7fa638014070 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.111+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.111+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3862bb0 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.111+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.111+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3862bb0 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.111+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.111+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3859830 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.111+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.111+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3859830 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.111+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.111+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x7fa638014070 2024-09-22T08:11:05.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.112+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.112+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3862bb0 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.112+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.112+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb385e240 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.112+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.112+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3859830 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.112+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.112+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x7fa638014070 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.113+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.113+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3862bb0 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.113+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.113+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x7fa638014070 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.113+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.113+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb385e240 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.113+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.113+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3862bb0 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.114+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.114+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x7fa638014070 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.114+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.114+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb3859830 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555eb3865740 con 0x555eb385e240 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:05.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb38615e0 con 0x555eb3859830 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb38611f0 con 0x555eb3859830 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.115+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb3861f50 con 0x555eb3859830 2024-09-22T08:11:05.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 20 zone default found 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 4 Realm: () 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 20 zonegroup default 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb3861a60 con 0x7fa638014070 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb3867ab0 con 0x555eb3862bb0 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb3867f90 con 0x555eb3862bb0 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.116+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.117+0000 7fa641326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.117+0000 7fa641326800 20 started sync module instance, tier type = 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.117+0000 7fa641326800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.117+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb3866f50 con 0x555eb385e240 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.118+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.118+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93865227219776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb38688a0 con 0x555eb385e240 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.118+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb38690f0 con 0x555eb3859830 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.119+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.119+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93865227225520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb38693c0 con 0x555eb3859830 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.119+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93865227219776] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.119+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb38683f0 con 0x555eb3862bb0 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.120+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.120+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93865227229616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386a350 con 0x555eb3862bb0 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.120+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386ad10 con 0x555eb385e240 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.121+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93865227229616] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.121+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93865227225520] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.122+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.122+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93865227230880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386ad10 con 0x555eb385e240 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.122+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386b5f0 con 0x555eb3859830 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.123+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.123+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93865227235584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386b560 con 0x555eb3859830 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.123+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386c5c0 con 0x7fa638014070 2024-09-22T08:11:05.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.123+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93865227230880] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.124+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93865227235584] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.124+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.124+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93865227239600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386c580 con 0x7fa638014070 2024-09-22T08:11:05.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.124+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386ce90 con 0x7fa638014070 2024-09-22T08:11:05.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.125+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93865227239600] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.125+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.125+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93865227233376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386c580 con 0x7fa638014070 2024-09-22T08:11:05.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.125+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386d4b0 con 0x7fa638014070 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.126+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.126+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93865227233376] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.126+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93865227243520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386d8d0 con 0x7fa638014070 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.126+0000 7fa641326800 20 add_watcher() i=0 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.126+0000 7fa641326800 20 add_watcher() i=1 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.126+0000 7fa641326800 20 add_watcher() i=2 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.126+0000 7fa641326800 20 add_watcher() i=3 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.126+0000 7fa641326800 20 add_watcher() i=4 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.126+0000 7fa641326800 20 add_watcher() i=5 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.126+0000 7fa641326800 20 add_watcher() i=6 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.127+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93865227243520] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.127+0000 7fa641326800 20 add_watcher() i=7 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.127+0000 7fa641326800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:05.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.127+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb3870cd0 con 0x555eb3859830 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.127+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.127+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93865227244576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386e150 con 0x555eb3859830 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.128+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93865227244576] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.128+0000 7fa4f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.128+0000 7fa641326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.129+0000 7fa641326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.129+0000 7fa641326800 5 note: GC not initialized 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.129+0000 7fa4f1fe3640 20 reqs_thread_entry: start 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.129+0000 7fa641326800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.129+0000 7fa641326800 20 Filter name: none 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.129+0000 7fa4637fe640 20 reqs_thread_entry: start 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.129+0000 7fa641326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.129+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555eb38a37d0 con 0x555eb3859830 2024-09-22T08:11:05.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.130+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.130+0000 7fa641326800 20 rados_obj.operate() r=0 bl.length=556 2024-09-22T08:11:05.138 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:05.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.130+0000 7fa4f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.130+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93865227244576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb38a2120 con 0x555eb3859830 2024-09-22T08:11:05.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.131+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93865227244576] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.131+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93865227219776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386d420 con 0x555eb385e240 2024-09-22T08:11:05.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.132+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93865227219776] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.132+0000 7fa641326800 20 remove_watcher() i=0 2024-09-22T08:11:05.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.132+0000 7fa641326800 2 removed watcher, disabling cache 2024-09-22T08:11:05.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.132+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93865227225520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb3867340 con 0x555eb3859830 2024-09-22T08:11:05.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.134+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93865227225520] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.134+0000 7fa641326800 20 remove_watcher() i=1 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.134+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93865227229616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb3867340 con 0x555eb3862bb0 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.135+0000 7fa63cf09640 1 -- 172.21.15.165:0/3581064350 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93865227229616] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62c01ab20 con 0x555eb3862bb0 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.135+0000 7fa641326800 20 remove_watcher() i=2 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.135+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93865227230880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb38699b0 con 0x555eb385e240 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.136+0000 7fa63d70a640 1 -- 172.21.15.165:0/3581064350 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93865227230880] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63803e020 con 0x555eb385e240 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.136+0000 7fa641326800 20 remove_watcher() i=3 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.136+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93865227235584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb38699b0 con 0x555eb3859830 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.137+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93865227235584] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x555eb3859830 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.137+0000 7fa641326800 20 remove_watcher() i=4 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.137+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93865227239600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386b100 con 0x7fa638014070 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.138+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93865227239600] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.138+0000 7fa641326800 20 remove_watcher() i=5 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.138+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93865227233376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb38699b0 con 0x7fa638014070 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.139+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93865227233376] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.139+0000 7fa641326800 20 remove_watcher() i=6 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.139+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93865227243520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555eb386b100 con 0x7fa638014070 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.139+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93865227243520] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624051070 con 0x7fa638014070 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 20 remove_watcher() i=7 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fa638014070 msgr2=0x7fa63801b9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fa638014070 0x7fa63801b9f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb3859830 msgr2=0x555eb385bcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb3859830 0x555eb385bcf0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb385e240 msgr2=0x555eb3860630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb385e240 0x555eb3860630 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555eb3862bb0 msgr2=0x555eb3865070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555eb3862bb0 0x555eb3865070 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa50803d000 msgr2=0x7fa50803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa50803d000 0x7fa50803f4c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa62c03f010 tx=0x7fa62c049000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 msgr2=0x555eb384ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb384ddd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa6380117d0 tx=0x7fa6380542b0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa634708640 1 -- 172.21.15.165:0/3581064350 reap_dead start 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 shutdown_connections 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/3581064350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3846770 0x555eb384ddd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 >> 172.21.15.165:0/3581064350 conn(0x555eb3842b70 msgr2=0x555eb3840d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 shutdown_connections 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/3581064350 wait complete. 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/2915544337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa51403d000 msgr2=0x7fa51403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/2915544337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa51403d000 0x7fa51403f4c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x555eb3826a00 tx=0x7fa62c018b60 comp rx=0 tx=0).stop 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/2915544337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3839cf0 msgr2=0x555eb383a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/2915544337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3839cf0 0x555eb383a110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x555eb3826960 tx=0x7fa638018830 comp rx=0 tx=0).stop 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/2915544337 shutdown_connections 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/2915544337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa51403d000 0x7fa51403f4c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 --2- 172.21.15.165:0/2915544337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3839cf0 0x555eb383a110 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/2915544337 >> 172.21.15.165:0/2915544337 conn(0x555eb382e0a0 msgr2=0x555eb382e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/2915544337 shutdown_connections 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.140+0000 7fa641326800 1 -- 172.21.15.165:0/2915544337 wait complete. 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb372bd40 msgr2=0x555eb38263e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb372bd40 0x555eb38263e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb38288b0 msgr2=0x555eb382aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb38288b0 0x555eb382aca0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa52403cfb0 msgr2=0x7fa52403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa52403cfb0 0x7fa52403f470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa624057000 tx=0x7fa624052000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 msgr2=0x555eb381ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb381ed90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00c010 tx=0x7fa62c000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 shutdown_connections 2024-09-22T08:11:05.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555eb38288b0 0x555eb382aca0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555eb372bd40 0x555eb38263e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fa52403cfb0 0x7fa52403f470 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 --2- 172.21.15.165:0/2324567517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555eb3723cc0 0x555eb381ed90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 >> 172.21.15.165:0/2324567517 conn(0x555eb371f310 msgr2=0x555eb3818720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 shutdown_connections 2024-09-22T08:11:05.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.141+0000 7fa641326800 1 -- 172.21.15.165:0/2324567517 wait complete. 2024-09-22T08:11:05.150 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:05.150 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:11:05.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:11:05.151 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:11:05.195 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:05.196 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:05.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.195+0000 7fee91724800 1 Processor -- start 2024-09-22T08:11:05.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.195+0000 7fee91724800 1 -- start start 2024-09-22T08:11:05.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.196+0000 7fee91724800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b3a6869bb0 0x55b3a686bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.196+0000 7fee91724800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b3a66f0a20 con 0x55b3a68660a0 2024-09-22T08:11:05.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.196+0000 7fee91724800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b3a66f07d0 con 0x55b3a6869bb0 2024-09-22T08:11:05.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.196+0000 7fee8cc67640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b3a6869bb0 0x55b3a686bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.196+0000 7fee8cc67640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b3a6869bb0 0x55b3a686bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51444/0 (socket says 172.21.15.165:51444) 2024-09-22T08:11:05.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.196+0000 7fee8cc67640 1 -- 172.21.15.165:0/3632581895 learned_addr learned my addr 172.21.15.165:0/3632581895 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.196+0000 7fee8d468640 1 --1- 172.21.15.165:0/3632581895 >> v1:172.21.15.53:6789/0 conn(0x55b3a68660a0 0x55b3a6868490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33584/0 (socket says 172.21.15.165:33584) 2024-09-22T08:11:05.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.196+0000 7fee8cc67640 1 -- 172.21.15.165:0/3632581895 >> v1:172.21.15.53:6789/0 conn(0x55b3a68660a0 legacy=0x55b3a6868490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.196+0000 7fee8cc67640 1 -- 172.21.15.165:0/3632581895 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a686d580 con 0x55b3a6869bb0 2024-09-22T08:11:05.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.198+0000 7fee8cc67640 1 --2- 172.21.15.165:0/3632581895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6869bb0 0x55b3a686bfa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fee8400a520 tx=0x7fee84045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce5d3a6b5c0723a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.198+0000 7fee7ffff640 1 -- 172.21.15.165:0/3632581895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee84055070 con 0x55b3a6869bb0 2024-09-22T08:11:05.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.198+0000 7fee7ffff640 1 -- 172.21.15.165:0/3632581895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee840515b0 con 0x55b3a6869bb0 2024-09-22T08:11:05.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.198+0000 7fee7ffff640 1 -- 172.21.15.165:0/3632581895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee840518d0 con 0x55b3a6869bb0 2024-09-22T08:11:05.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.199+0000 7fee91724800 1 -- 172.21.15.165:0/3632581895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6869bb0 msgr2=0x55b3a686bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.199+0000 7fee91724800 1 --2- 172.21.15.165:0/3632581895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6869bb0 0x55b3a686bfa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fee8400a520 tx=0x7fee84045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.199+0000 7fee91724800 1 -- 172.21.15.165:0/3632581895 shutdown_connections 2024-09-22T08:11:05.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.199+0000 7fee91724800 1 --2- 172.21.15.165:0/3632581895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6869bb0 0x55b3a686bfa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.199+0000 7fee91724800 1 -- 172.21.15.165:0/3632581895 >> 172.21.15.165:0/3632581895 conn(0x55b3a685fbe0 msgr2=0x55b3a6862020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.199+0000 7fee91724800 1 -- 172.21.15.165:0/3632581895 shutdown_connections 2024-09-22T08:11:05.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.199+0000 7fee91724800 1 -- 172.21.15.165:0/3632581895 wait complete. 2024-09-22T08:11:05.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.213+0000 7fee91724800 1 Processor -- start 2024-09-22T08:11:05.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.213+0000 7fee91724800 1 -- start start 2024-09-22T08:11:05.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.213+0000 7fee91724800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a6865810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.213+0000 7fee91724800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3a66fddd0 con 0x55b3a68660a0 2024-09-22T08:11:05.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.213+0000 7fee8d468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a6865810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.213+0000 7fee8d468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a6865810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51454/0 (socket says 172.21.15.165:51454) 2024-09-22T08:11:05.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.213+0000 7fee8d468640 1 -- 172.21.15.165:0/26141217 learned_addr learned my addr 172.21.15.165:0/26141217 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.214+0000 7fee8d468640 1 -- 172.21.15.165:0/26141217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a6865e00 con 0x55b3a68660a0 2024-09-22T08:11:05.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.214+0000 7fee8d468640 1 --2- 172.21.15.165:0/26141217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a6865810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fee8000b260 tx=0x7fee8000b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba4bc8a8a1b269b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.214+0000 7fed7b606640 1 -- 172.21.15.165:0/26141217 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee8000be60 con 0x55b3a68660a0 2024-09-22T08:11:05.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.214+0000 7fed7b606640 1 -- 172.21.15.165:0/26141217 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee80006070 con 0x55b3a68660a0 2024-09-22T08:11:05.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.214+0000 7fed7b606640 1 -- 172.21.15.165:0/26141217 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee8000e710 con 0x55b3a68660a0 2024-09-22T08:11:05.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 -- 172.21.15.165:0/26141217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 msgr2=0x55b3a6865810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 --2- 172.21.15.165:0/26141217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a6865810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fee8000b260 tx=0x7fee8000b660 comp rx=0 tx=0).stop 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 -- 172.21.15.165:0/26141217 shutdown_connections 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 --2- 172.21.15.165:0/26141217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a6865810 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 -- 172.21.15.165:0/26141217 >> 172.21.15.165:0/26141217 conn(0x55b3a685fbe0 msgr2=0x55b3a6950960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 -- 172.21.15.165:0/26141217 shutdown_connections 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 -- 172.21.15.165:0/26141217 wait complete. 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 Processor -- start 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 -- start start 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a695ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee91724800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3a686c870 con 0x55b3a68660a0 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee8d468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a695ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee8d468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a695ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51462/0 (socket says 172.21.15.165:51462) 2024-09-22T08:11:05.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.215+0000 7fee8d468640 1 -- 172.21.15.165:0/2539710030 learned_addr learned my addr 172.21.15.165:0/2539710030 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.216+0000 7fee8d468640 1 -- 172.21.15.165:0/2539710030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a695f1d0 con 0x55b3a68660a0 2024-09-22T08:11:05.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.216+0000 7fee8d468640 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a695ec70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55b3a6865340 tx=0x7fee80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.216+0000 7fed79e03640 1 -- 172.21.15.165:0/2539710030 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee8000f810 con 0x55b3a68660a0 2024-09-22T08:11:05.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.216+0000 7fed79e03640 1 -- 172.21.15.165:0/2539710030 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee8000f9b0 con 0x55b3a68660a0 2024-09-22T08:11:05.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.216+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3a695f4c0 con 0x55b3a68660a0 2024-09-22T08:11:05.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.216+0000 7fed79e03640 1 -- 172.21.15.165:0/2539710030 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee8000fcd0 con 0x55b3a68660a0 2024-09-22T08:11:05.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.216+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a6960070 con 0x55b3a68660a0 2024-09-22T08:11:05.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.217+0000 7fed79e03640 1 -- 172.21.15.165:0/2539710030 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fee80017070 con 0x55b3a68660a0 2024-09-22T08:11:05.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.217+0000 7fed79e03640 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7403cfb0 0x7fed7403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.217+0000 7fed79e03640 1 -- 172.21.15.165:0/2539710030 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fee80015020 con 0x55b3a68660a0 2024-09-22T08:11:05.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.217+0000 7fee8cc67640 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7403cfb0 0x7fed7403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.217+0000 7fee91724800 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a6869bb0 0x55b3a69662c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.217+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a6966800 con 0x55b3a6869bb0 2024-09-22T08:11:05.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.218+0000 7fee8dc69640 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a6869bb0 0x55b3a69662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.218+0000 7fee8cc67640 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7403cfb0 0x7fed7403f470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee84057000 tx=0x7fee84052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.218+0000 7fee8dc69640 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a6869bb0 0x55b3a69662c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.218+0000 7fee8dc69640 1 -- 172.21.15.165:0/2539710030 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee8800a4d0 con 0x55b3a6869bb0 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.218+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a6966ba0 con 0x55b3a6869bb0 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.218+0000 7fee8dc69640 1 -- 172.21.15.165:0/2539710030 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee8800a4d0 con 0x55b3a6869bb0 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.218+0000 7fee91724800 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a6968910 0x55b3a696ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.218+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a696b350 con 0x55b3a6968910 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.219+0000 7fee8d468640 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a6968910 0x55b3a696ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.219+0000 7fee8d468640 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a6968910 0x55b3a696ad00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.219+0000 7fee8d468640 1 -- 172.21.15.165:0/2539710030 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a6968910 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.219+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69677b0 con 0x55b3a6869bb0 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.219+0000 7fee8dc69640 1 -- 172.21.15.165:0/2539710030 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee8800a4d0 con 0x55b3a6869bb0 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.219+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a6967c90 con 0x55b3a6869bb0 2024-09-22T08:11:05.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.220+0000 7fee8dc69640 1 -- 172.21.15.165:0/2539710030 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fee8800a4d0 con 0x55b3a6869bb0 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.220+0000 7fee91724800 1 Processor -- start 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.220+0000 7fee91724800 1 -- start start 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.220+0000 7fee91724800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6979d10 0x55b3a697a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.220+0000 7fee91724800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3a675cd50 con 0x55b3a6979d10 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.220+0000 7fee8dc69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6979d10 0x55b3a697a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.220+0000 7fee8dc69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6979d10 0x55b3a697a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51474/0 (socket says 172.21.15.165:51474) 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.220+0000 7fee8dc69640 1 -- 172.21.15.165:0/2504025365 learned_addr learned my addr 172.21.15.165:0/2504025365 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.221+0000 7fee8dc69640 1 -- 172.21.15.165:0/2504025365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a697a770 con 0x55b3a6979d10 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.221+0000 7fee8dc69640 1 --2- 172.21.15.165:0/2504025365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6979d10 0x55b3a697a130 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55b3a6960b90 tx=0x7fee88018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.221+0000 7fed72ffd640 1 -- 172.21.15.165:0/2504025365 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee88014450 con 0x55b3a6979d10 2024-09-22T08:11:05.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.221+0000 7fed72ffd640 1 -- 172.21.15.165:0/2504025365 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee880145f0 con 0x55b3a6979d10 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.221+0000 7fee91724800 1 -- 172.21.15.165:0/2504025365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3a697afa0 con 0x55b3a6979d10 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.221+0000 7fed72ffd640 1 -- 172.21.15.165:0/2504025365 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee88014910 con 0x55b3a6979d10 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.221+0000 7fee91724800 1 -- 172.21.15.165:0/2504025365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a697b540 con 0x55b3a6979d10 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.222+0000 7fed72ffd640 1 -- 172.21.15.165:0/2504025365 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fee88011040 con 0x55b3a6979d10 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.222+0000 7fed72ffd640 1 --2- 172.21.15.165:0/2504025365 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed6403d000 0x7fed6403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.222+0000 7fed72ffd640 1 -- 172.21.15.165:0/2504025365 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fee8801e070 con 0x55b3a6979d10 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.222+0000 7fee8d468640 1 --2- 172.21.15.165:0/2504025365 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed6403d000 0x7fed6403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.222+0000 7fee91724800 1 Processor -- start 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.222+0000 7fee91724800 1 -- start start 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fee8d468640 1 --2- 172.21.15.165:0/2504025365 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed6403d000 0x7fed6403f4c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55b3a69602f0 tx=0x7fee80019e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fee91724800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a6986b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fee91724800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3a6864250 con 0x55b3a6986750 2024-09-22T08:11:05.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fee8dc69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a6986b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fee8dc69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a6986b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51488/0 (socket says 172.21.15.165:51488) 2024-09-22T08:11:05.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fee8dc69640 1 -- 172.21.15.165:0/2992952552 learned_addr learned my addr 172.21.15.165:0/2992952552 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fee8dc69640 1 -- 172.21.15.165:0/2992952552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a6987140 con 0x55b3a6986750 2024-09-22T08:11:05.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fee8dc69640 1 --2- 172.21.15.165:0/2992952552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a6986b50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fee88016620 tx=0x7fee88011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8230d3d91e8798d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fed70ff9640 1 -- 172.21.15.165:0/2992952552 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee88051020 con 0x55b3a6986750 2024-09-22T08:11:05.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fed70ff9640 1 -- 172.21.15.165:0/2992952552 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee88022de0 con 0x55b3a6986750 2024-09-22T08:11:05.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.223+0000 7fed70ff9640 1 -- 172.21.15.165:0/2992952552 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee88028070 con 0x55b3a6986750 2024-09-22T08:11:05.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 -- 172.21.15.165:0/2992952552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 msgr2=0x55b3a6986b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 --2- 172.21.15.165:0/2992952552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a6986b50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fee88016620 tx=0x7fee88011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:05.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 -- 172.21.15.165:0/2992952552 shutdown_connections 2024-09-22T08:11:05.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 --2- 172.21.15.165:0/2992952552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a6986b50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 -- 172.21.15.165:0/2992952552 >> 172.21.15.165:0/2992952552 conn(0x55b3a6982b50 msgr2=0x55b3a6980d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 -- 172.21.15.165:0/2992952552 shutdown_connections 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 -- 172.21.15.165:0/2992952552 wait complete. 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 Processor -- start 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 -- start start 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a698dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee91724800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3a6987760 con 0x55b3a6986750 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee8dc69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a698dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee8dc69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a698dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51504/0 (socket says 172.21.15.165:51504) 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.224+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 learned_addr learned my addr 172.21.15.165:0/121866256 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.225+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a698e230 con 0x55b3a6986750 2024-09-22T08:11:05.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.225+0000 7fee8dc69640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a698dcd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee880562e0 tx=0x7fee880546f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.225+0000 7fed62ffd640 1 -- 172.21.15.165:0/121866256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee88031020 con 0x55b3a6986750 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.225+0000 7fed62ffd640 1 -- 172.21.15.165:0/121866256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee8802b350 con 0x55b3a6986750 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.225+0000 7fed62ffd640 1 -- 172.21.15.165:0/121866256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee880549d0 con 0x55b3a6986750 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.225+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3a698e4c0 con 0x55b3a6986750 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.225+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a698ee40 con 0x55b3a6986750 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.226+0000 7fed62ffd640 1 -- 172.21.15.165:0/121866256 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fee88034020 con 0x55b3a6986750 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.226+0000 7fed62ffd640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed5803d000 0x7fed5803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.226+0000 7fed62ffd640 1 -- 172.21.15.165:0/121866256 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fee8800e040 con 0x55b3a6986750 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.226+0000 7fee8d468640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed5803d000 0x7fed5803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.226+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.226+0000 7fee91724800 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a69997f0 0x55b3a699bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.226+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a699c400 con 0x55b3a69997f0 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee8cc67640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a69997f0 0x55b3a699bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee8d468640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed5803d000 0x7fed5803f4c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fee80019f90 tx=0x7fee80028000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee8cc67640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a69997f0 0x55b3a699bcb0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee91724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee91724800 20 realm 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a699c830 con 0x55b3a69997f0 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee91724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee91724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:05.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.227+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a699d100 con 0x55b3a69997f0 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee91724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a699d4a0 con 0x55b3a69997f0 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee91724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee91724800 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a699e200 0x55b3a69a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a0b30 con 0x55b3a699e200 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee8dc69640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a699e200 0x55b3a69a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.228+0000 7fee8dc69640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a699e200 0x55b3a69a05f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee91724800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee91724800 20 searching for the correct realm 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee91724800 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3a69a2b70 0x55b3a69a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69a2b70 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee8d468640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3a69a2b70 0x55b3a69a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee8d468640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3a69a2b70 0x55b3a69a5030 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a699e200 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee8dc69640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fee88041040 0x7fee8802c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.229+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x7fee88041040 2024-09-22T08:11:05.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.230+0000 7fee8cc67640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fee88041040 0x7fee8802c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.230+0000 7fee8cc67640 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fee88041040 0x7fee8802c840 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.230+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x7fee88041040 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.230+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69997f0 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.231+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.231+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69997f0 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.231+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.231+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x7fee88041040 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.231+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x7fee88041040 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.231+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x7fee88041040 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.231+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x7fee88041040 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.231+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a699e200 2024-09-22T08:11:05.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.232+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.232+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69a2b70 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.232+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.232+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69997f0 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.232+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.232+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x7fee88041040 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.232+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x7fee88041040 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.232+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69997f0 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.233+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.233+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a699e200 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.233+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.233+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69a2b70 2024-09-22T08:11:05.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.233+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.233+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69a2b70 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.233+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.233+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x7fee88041040 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.233+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x7fee88041040 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.234+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69a2b70 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.234+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.234+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69a2b70 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.234+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.234+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69997f0 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.234+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.234+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69997f0 2024-09-22T08:11:05.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.234+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.234+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x7fee88041040 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.235+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x7fee88041040 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.235+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69a2b70 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.235+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.235+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a699e200 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.235+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.235+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69997f0 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.236+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.236+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x7fee88041040 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.236+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x7fee88041040 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.236+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69a2b70 2024-09-22T08:11:05.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.236+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.236+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x7fee88041040 2024-09-22T08:11:05.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.236+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x7fee88041040 2024-09-22T08:11:05.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.236+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a699e200 2024-09-22T08:11:05.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.237+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.237+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69a2b70 2024-09-22T08:11:05.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.237+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.237+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x7fee88041040 2024-09-22T08:11:05.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.237+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee84057030 con 0x7fee88041040 2024-09-22T08:11:05.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.237+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a69997f0 2024-09-22T08:11:05.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.237+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.237+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a5700 con 0x55b3a699e200 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a15a0 con 0x55b3a69997f0 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a11b0 con 0x55b3a69997f0 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee84057030 con 0x55b3a69997f0 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a1f10 con 0x55b3a69997f0 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.238+0000 7fee91724800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 20 zone default found 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 4 Realm: () 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:05.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 20 zonegroup default 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a1a70 con 0x7fee88041040 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x7fee88041040 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a7ad0 con 0x55b3a69a2b70 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a7f60 con 0x55b3a69a2b70 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 20 started sync module instance, tier type = 2024-09-22T08:11:05.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:05.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.239+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a6f40 con 0x55b3a699e200 2024-09-22T08:11:05.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.240+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.240+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94230082646832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a8870 con 0x55b3a699e200 2024-09-22T08:11:05.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.240+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a90c0 con 0x55b3a69997f0 2024-09-22T08:11:05.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.241+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94230082646832] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.242+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.242+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94230082651072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a8db0 con 0x55b3a69997f0 2024-09-22T08:11:05.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.242+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a98d0 con 0x55b3a69a2b70 2024-09-22T08:11:05.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.243+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.243+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94230082655136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69aa170 con 0x55b3a69a2b70 2024-09-22T08:11:05.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.243+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69aac60 con 0x55b3a699e200 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.243+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94230082651072] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.244+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.244+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94230082660144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69ab050 con 0x55b3a699e200 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.244+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69aba90 con 0x55b3a69997f0 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.244+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94230082655136] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.245+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.245+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94230082663776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69ab050 con 0x55b3a69997f0 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.245+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69ac4e0 con 0x7fee88041040 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.245+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94230082660144] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.246+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94230082663776] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.246+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x7fee88041040 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.246+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94230082657472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69abff0 con 0x7fee88041040 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.246+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69acd80 con 0x7fee88041040 2024-09-22T08:11:05.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.247+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94230082657472] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x7fee88041040 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.247+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x7fee88041040 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.247+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94230082652192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69abff0 con 0x7fee88041040 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.247+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69ad3a0 con 0x7fee88041040 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.248+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94230082652192] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x7fee88041040 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.248+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x7fee88041040 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.248+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94230082668448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69ad3a0 con 0x7fee88041040 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.248+0000 7fee91724800 20 add_watcher() i=0 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.248+0000 7fee91724800 20 add_watcher() i=1 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.248+0000 7fee91724800 20 add_watcher() i=2 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.248+0000 7fee91724800 20 add_watcher() i=3 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.248+0000 7fee91724800 20 add_watcher() i=4 2024-09-22T08:11:05.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.248+0000 7fee91724800 20 add_watcher() i=5 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.248+0000 7fee91724800 20 add_watcher() i=6 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.249+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94230082668448] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x7fee88041040 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.249+0000 7fee91724800 20 add_watcher() i=7 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.249+0000 7fee91724800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.249+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69b0810 con 0x55b3a69997f0 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.249+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.249+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94230082683376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69ad510 con 0x55b3a69997f0 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.250+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94230082683376] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.250+0000 7fed43fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fee91724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fee91724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fee91724800 5 note: GC not initialized 2024-09-22T08:11:05.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fed42fe5640 20 reqs_thread_entry: start 2024-09-22T08:11:05.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fee91724800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:05.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fee91724800 20 Filter name: none 2024-09-22T08:11:05.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fed40fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:05.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fee91724800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69e3760 con 0x55b3a69997f0 2024-09-22T08:11:05.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.251+0000 7fee91724800 20 rados_obj.operate() r=0 bl.length=556 2024-09-22T08:11:05.263 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:05.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.252+0000 7fed43fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.252+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94230082683376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69e20f0 con 0x55b3a69997f0 2024-09-22T08:11:05.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.253+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94230082683376] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.253+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94230082646832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69b01f0 con 0x55b3a699e200 2024-09-22T08:11:05.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.254+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94230082646832] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.254+0000 7fee91724800 20 remove_watcher() i=0 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.254+0000 7fee91724800 2 removed watcher, disabling cache 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.254+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94230082651072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69b01f0 con 0x55b3a69997f0 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.255+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94230082651072] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.255+0000 7fee91724800 20 remove_watcher() i=1 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.255+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94230082655136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a83c0 con 0x55b3a69a2b70 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.256+0000 7fee8d468640 1 -- 172.21.15.165:0/121866256 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94230082655136] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8002e070 con 0x55b3a69a2b70 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.256+0000 7fee91724800 20 remove_watcher() i=2 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.256+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94230082660144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69b01f0 con 0x55b3a699e200 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.257+0000 7fee8dc69640 1 -- 172.21.15.165:0/121866256 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94230082660144] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8802a070 con 0x55b3a699e200 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.257+0000 7fee91724800 20 remove_watcher() i=3 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.257+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94230082663776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a93a0 con 0x55b3a69997f0 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.258+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94230082663776] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x55b3a69997f0 2024-09-22T08:11:05.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.258+0000 7fee91724800 20 remove_watcher() i=4 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.258+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94230082657472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69aa730 con 0x7fee88041040 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.259+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94230082657472] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x7fee88041040 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.259+0000 7fee91724800 20 remove_watcher() i=5 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.259+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94230082652192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69b01f0 con 0x7fee88041040 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.260+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94230082652192] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x7fee88041040 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.260+0000 7fee91724800 20 remove_watcher() i=6 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.260+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94230082668448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3a69a93a0 con 0x7fee88041040 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94230082668448] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee840881c0 con 0x7fee88041040 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 20 remove_watcher() i=7 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fee88041040 msgr2=0x7fee8802c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fee88041040 0x7fee8802c840 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a69997f0 msgr2=0x55b3a699bcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a69997f0 0x55b3a699bcb0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a699e200 msgr2=0x55b3a69a05f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a699e200 0x55b3a69a05f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3a69a2b70 msgr2=0x55b3a69a5030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3a69a2b70 0x55b3a69a5030 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed5803d000 msgr2=0x7fed5803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed5803d000 0x7fed5803f4c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fee80019f90 tx=0x7fee80028000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 msgr2=0x55b3a698dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee8cc67640 1 -- 172.21.15.165:0/121866256 reap_dead start 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a698dcd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee880562e0 tx=0x7fee880546f0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 shutdown_connections 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 --2- 172.21.15.165:0/121866256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6986750 0x55b3a698dcd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.261+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 >> 172.21.15.165:0/121866256 conn(0x55b3a6982b50 msgr2=0x55b3a6980d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 shutdown_connections 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/121866256 wait complete. 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2504025365 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed6403d000 msgr2=0x7fed6403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2504025365 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed6403d000 0x7fed6403f4c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55b3a69602f0 tx=0x7fee80019e20 comp rx=0 tx=0).stop 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2504025365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6979d10 msgr2=0x55b3a697a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2504025365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6979d10 0x55b3a697a130 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55b3a6960b90 tx=0x7fee88018830 comp rx=0 tx=0).stop 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2504025365 shutdown_connections 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2504025365 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed6403d000 0x7fed6403f4c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2504025365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a6979d10 0x55b3a697a130 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2504025365 >> 172.21.15.165:0/2504025365 conn(0x55b3a696e0c0 msgr2=0x55b3a696e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2504025365 shutdown_connections 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2504025365 wait complete. 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a6869bb0 msgr2=0x55b3a69662c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a6869bb0 0x55b3a69662c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a6968910 msgr2=0x55b3a696ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a6968910 0x55b3a696ad00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7403cfb0 msgr2=0x7fed7403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7403cfb0 0x7fed7403f470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee84057000 tx=0x7fee84052000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 msgr2=0x55b3a695ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a695ec70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55b3a6865340 tx=0x7fee80000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 shutdown_connections 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3a6968910 0x55b3a696ad00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3a6869bb0 0x55b3a69662c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7403cfb0 0x7fed7403f470 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 --2- 172.21.15.165:0/2539710030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3a68660a0 0x55b3a695ec70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 >> 172.21.15.165:0/2539710030 conn(0x55b3a685fbe0 msgr2=0x55b3a69504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 shutdown_connections 2024-09-22T08:11:05.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.262+0000 7fee91724800 1 -- 172.21.15.165:0/2539710030 wait complete. 2024-09-22T08:11:05.274 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:05.274 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-22T08:11:05.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-22T08:11:05.275 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-22T08:11:05.323 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:05.323 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.323+0000 7f4a02220800 1 Processor -- start 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.323+0000 7f4a02220800 1 -- start start 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.323+0000 7f4a02220800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5634da677800 0x5634da678500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.323+0000 7f4a02220800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634da503a20 con 0x5634da678a40 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.323+0000 7f4a02220800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5634da5037d0 con 0x5634da677800 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.324+0000 7f49ffd0a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5634da677800 0x5634da678500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.324+0000 7f49ffd0a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5634da677800 0x5634da678500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51506/0 (socket says 172.21.15.165:51506) 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.324+0000 7f49ff509640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5634da678a40 0x5634da67d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33596/0 (socket says 172.21.15.165:33596) 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.324+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1753473724 learned_addr learned my addr 172.21.15.165:0/1753473724 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.324+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1753473724 >> v1:172.21.15.53:6789/0 conn(0x5634da678a40 legacy=0x5634da67d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.324+0000 7f49fed08640 1 -- 172.21.15.165:0/1753473724 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579523054 0 0) 0x5634da503a20 con 0x5634da678a40 2024-09-22T08:11:05.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.324+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1753473724 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634da677f00 con 0x5634da677800 2024-09-22T08:11:05.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.326+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/1753473724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da678500 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f49f000a520 tx=0x7f49f0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b76de154401908a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.326+0000 7f49fed08640 1 -- 172.21.15.165:0/1753473724 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f0055070 con 0x5634da677800 2024-09-22T08:11:05.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.326+0000 7f49fed08640 1 -- 172.21.15.165:0/1753473724 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f00515b0 con 0x5634da677800 2024-09-22T08:11:05.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.326+0000 7f49fed08640 1 -- 172.21.15.165:0/1753473724 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f00518d0 con 0x5634da677800 2024-09-22T08:11:05.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.327+0000 7f4a02220800 1 -- 172.21.15.165:0/1753473724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 msgr2=0x5634da678500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.327+0000 7f4a02220800 1 --2- 172.21.15.165:0/1753473724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da678500 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f49f000a520 tx=0x7f49f0045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.327+0000 7f4a02220800 1 -- 172.21.15.165:0/1753473724 shutdown_connections 2024-09-22T08:11:05.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.327+0000 7f4a02220800 1 --2- 172.21.15.165:0/1753473724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da678500 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.327+0000 7f4a02220800 1 -- 172.21.15.165:0/1753473724 >> 172.21.15.165:0/1753473724 conn(0x5634da672bd0 msgr2=0x5634da675030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.327+0000 7f4a02220800 1 -- 172.21.15.165:0/1753473724 shutdown_connections 2024-09-22T08:11:05.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.327+0000 7f4a02220800 1 -- 172.21.15.165:0/1753473724 wait complete. 2024-09-22T08:11:05.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.341+0000 7f4a02220800 1 Processor -- start 2024-09-22T08:11:05.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.341+0000 7f4a02220800 1 -- start start 2024-09-22T08:11:05.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.341+0000 7f4a02220800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da5eb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.341+0000 7f4a02220800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5634da510dd0 con 0x5634da677800 2024-09-22T08:11:05.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.341+0000 7f49ffd0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da5eb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.341+0000 7f49ffd0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da5eb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51510/0 (socket says 172.21.15.165:51510) 2024-09-22T08:11:05.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.341+0000 7f49ffd0a640 1 -- 172.21.15.165:0/4019845060 learned_addr learned my addr 172.21.15.165:0/4019845060 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.342+0000 7f49ffd0a640 1 -- 172.21.15.165:0/4019845060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634da5ebe70 con 0x5634da677800 2024-09-22T08:11:05.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.342+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/4019845060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da5eb930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f49f0045be0 tx=0x7f49f0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5083b6462c59db6b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.342+0000 7f48ede0b640 1 -- 172.21.15.165:0/4019845060 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f0051ac0 con 0x5634da677800 2024-09-22T08:11:05.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.342+0000 7f48ede0b640 1 -- 172.21.15.165:0/4019845060 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f0051c60 con 0x5634da677800 2024-09-22T08:11:05.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.342+0000 7f48ede0b640 1 -- 172.21.15.165:0/4019845060 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f0066460 con 0x5634da677800 2024-09-22T08:11:05.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 -- 172.21.15.165:0/4019845060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 msgr2=0x5634da5eb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 --2- 172.21.15.165:0/4019845060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da5eb930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f49f0045be0 tx=0x7f49f0051000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 -- 172.21.15.165:0/4019845060 shutdown_connections 2024-09-22T08:11:05.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 --2- 172.21.15.165:0/4019845060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da5eb930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 -- 172.21.15.165:0/4019845060 >> 172.21.15.165:0/4019845060 conn(0x5634da672bd0 msgr2=0x5634da762740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 -- 172.21.15.165:0/4019845060 shutdown_connections 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 -- 172.21.15.165:0/4019845060 wait complete. 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 Processor -- start 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 -- start start 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da771bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.343+0000 7f4a02220800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5634da6792b0 con 0x5634da677800 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.344+0000 7f49ffd0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da771bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.344+0000 7f49ffd0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da771bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51522/0 (socket says 172.21.15.165:51522) 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.344+0000 7f49ffd0a640 1 -- 172.21.15.165:0/958154430 learned_addr learned my addr 172.21.15.165:0/958154430 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.344+0000 7f49ffd0a640 1 -- 172.21.15.165:0/958154430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634da772110 con 0x5634da677800 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.344+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da771bb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f49f0045be0 tx=0x7f49f0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.344+0000 7f48e7fff640 1 -- 172.21.15.165:0/958154430 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f005a600 con 0x5634da677800 2024-09-22T08:11:05.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.344+0000 7f48e7fff640 1 -- 172.21.15.165:0/958154430 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f005a7a0 con 0x5634da677800 2024-09-22T08:11:05.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.344+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634da7723a0 con 0x5634da677800 2024-09-22T08:11:05.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.344+0000 7f48e7fff640 1 -- 172.21.15.165:0/958154430 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f005aa80 con 0x5634da677800 2024-09-22T08:11:05.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.344+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634da772da0 con 0x5634da677800 2024-09-22T08:11:05.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.345+0000 7f48e7fff640 1 -- 172.21.15.165:0/958154430 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f49f0058070 con 0x5634da677800 2024-09-22T08:11:05.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.345+0000 7f48e7fff640 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48e803d000 0x7f48e803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.346+0000 7f48e7fff640 1 -- 172.21.15.165:0/958154430 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f49f0062070 con 0x5634da677800 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.346+0000 7f49ff509640 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48e803d000 0x7f48e803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.346+0000 7f4a02220800 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da678a40 0x5634da779200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.346+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da779740 con 0x5634da678a40 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.346+0000 7f4a0050b640 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da678a40 0x5634da779200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.346+0000 7f49ff509640 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48e803d000 0x7f48e803f4c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f49f4000c00 tx=0x7f49f40013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.346+0000 7f4a0050b640 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da678a40 0x5634da779200 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.346+0000 7f4a0050b640 1 -- 172.21.15.165:0/958154430 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49f800a4d0 con 0x5634da678a40 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.346+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da779ae0 con 0x5634da678a40 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.347+0000 7f4a0050b640 1 -- 172.21.15.165:0/958154430 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49f800a4d0 con 0x5634da678a40 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.347+0000 7f4a02220800 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da77b5a0 0x5634da77da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.347+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da77e1d0 con 0x5634da77b5a0 2024-09-22T08:11:05.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.347+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da77b5a0 0x5634da77da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.347+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da77b5a0 0x5634da77da40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.347+0000 7f49ffd0a640 1 -- 172.21.15.165:0/958154430 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f49f0057030 con 0x5634da77b5a0 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.348+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da77a330 con 0x5634da678a40 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.348+0000 7f4a0050b640 1 -- 172.21.15.165:0/958154430 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49f800a4d0 con 0x5634da678a40 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.348+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da77a710 con 0x5634da678a40 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.348+0000 7f4a0050b640 1 -- 172.21.15.165:0/958154430 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f49f800a4d0 con 0x5634da678a40 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.348+0000 7f4a02220800 1 Processor -- start 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.348+0000 7f4a02220800 1 -- start start 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f4a02220800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da78cb10 0x5634da78cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f4a02220800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5634da56fd50 con 0x5634da78cb10 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f4a0050b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da78cb10 0x5634da78cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f4a0050b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da78cb10 0x5634da78cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51532/0 (socket says 172.21.15.165:51532) 2024-09-22T08:11:05.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f4a0050b640 1 -- 172.21.15.165:0/4230283431 learned_addr learned my addr 172.21.15.165:0/4230283431 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f4a0050b640 1 -- 172.21.15.165:0/4230283431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634da78d570 con 0x5634da78cb10 2024-09-22T08:11:05.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f4a0050b640 1 --2- 172.21.15.165:0/4230283431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da78cb10 0x5634da78cf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5634da772bb0 tx=0x7f49f8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f48e57fa640 1 -- 172.21.15.165:0/4230283431 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f8014450 con 0x5634da78cb10 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f48e57fa640 1 -- 172.21.15.165:0/4230283431 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f8014610 con 0x5634da78cb10 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f4a02220800 1 -- 172.21.15.165:0/4230283431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634da78dda0 con 0x5634da78cb10 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.349+0000 7f48e57fa640 1 -- 172.21.15.165:0/4230283431 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f8014930 con 0x5634da78cb10 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.350+0000 7f4a02220800 1 -- 172.21.15.165:0/4230283431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634da78e340 con 0x5634da78cb10 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.350+0000 7f48e57fa640 1 -- 172.21.15.165:0/4230283431 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f49f8011040 con 0x5634da78cb10 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f48e57fa640 1 --2- 172.21.15.165:0/4230283431 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48d803d000 0x7f48d803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f48e57fa640 1 -- 172.21.15.165:0/4230283431 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f49f801e070 con 0x5634da78cb10 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/4230283431 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48d803d000 0x7f48d803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f4a02220800 1 Processor -- start 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f4a02220800 1 -- start start 2024-09-22T08:11:05.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/4230283431 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48d803d000 0x7f48d803f4c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5634da773c80 tx=0x7f49f0065a60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f4a02220800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da799970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f4a02220800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5634da76ceb0 con 0x5634da799590 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f4a0050b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da799970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f4a0050b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da799970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51548/0 (socket says 172.21.15.165:51548) 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.351+0000 7f4a0050b640 1 -- 172.21.15.165:0/1123103413 learned_addr learned my addr 172.21.15.165:0/1123103413 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f4a0050b640 1 -- 172.21.15.165:0/1123103413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634da799f60 con 0x5634da799590 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f4a0050b640 1 --2- 172.21.15.165:0/1123103413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da799970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49f8018430 tx=0x7f49f8014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0f00cf7dc32a36 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f48deffd640 1 -- 172.21.15.165:0/1123103413 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f804b070 con 0x5634da799590 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f48deffd640 1 -- 172.21.15.165:0/1123103413 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f8051070 con 0x5634da799590 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f48deffd640 1 -- 172.21.15.165:0/1123103413 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f8011da0 con 0x5634da799590 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f4a02220800 1 -- 172.21.15.165:0/1123103413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 msgr2=0x5634da799970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f4a02220800 1 --2- 172.21.15.165:0/1123103413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da799970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49f8018430 tx=0x7f49f8014ea0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f4a02220800 1 -- 172.21.15.165:0/1123103413 shutdown_connections 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f4a02220800 1 --2- 172.21.15.165:0/1123103413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da799970 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f4a02220800 1 -- 172.21.15.165:0/1123103413 >> 172.21.15.165:0/1123103413 conn(0x5634da795990 msgr2=0x5634da793bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f4a02220800 1 -- 172.21.15.165:0/1123103413 shutdown_connections 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.352+0000 7f4a02220800 1 -- 172.21.15.165:0/1123103413 wait complete. 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.353+0000 7f4a02220800 1 Processor -- start 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.353+0000 7f4a02220800 1 -- start start 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.353+0000 7f4a02220800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da7a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.353+0000 7f4a02220800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5634da79a5a0 con 0x5634da799590 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.353+0000 7f4a0050b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da7a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.353+0000 7f4a0050b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da7a0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51552/0 (socket says 172.21.15.165:51552) 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.353+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 learned_addr learned my addr 172.21.15.165:0/1021311267 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.353+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634da7a1110 con 0x5634da799590 2024-09-22T08:11:05.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.353+0000 7f4a0050b640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da7a0bb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f49f802bfd0 tx=0x7f49f80546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.354+0000 7f48dd7fa640 1 -- 172.21.15.165:0/1021311267 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f804b040 con 0x5634da799590 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.354+0000 7f48dd7fa640 1 -- 172.21.15.165:0/1021311267 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f80167c0 con 0x5634da799590 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.354+0000 7f48dd7fa640 1 -- 172.21.15.165:0/1021311267 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49f8011330 con 0x5634da799590 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.354+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634da7a13a0 con 0x5634da799590 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.354+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634da7a1d20 con 0x5634da799590 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.355+0000 7f48dd7fa640 1 -- 172.21.15.165:0/1021311267 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f49f8054850 con 0x5634da799590 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.355+0000 7f48dd7fa640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48c803d000 0x7f48c803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.355+0000 7f48dd7fa640 1 -- 172.21.15.165:0/1021311267 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f49f800e040 con 0x5634da799590 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.355+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48c803d000 0x7f48c803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.355+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.355+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48c803d000 0x7f48c803f4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f49f0065910 tx=0x7f49f0088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.355+0000 7f4a02220800 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da7ac680 0x5634da7aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.355+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7af290 con 0x5634da7ac680 2024-09-22T08:11:05.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.355+0000 7f49ff509640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da7ac680 0x5634da7aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.361 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f49ff509640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da7ac680 0x5634da7aeb40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49f400f5f0 con 0x5634da7ac680 2024-09-22T08:11:05.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 20 realm 2024-09-22T08:11:05.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7ab9d0 con 0x5634da7ac680 2024-09-22T08:11:05.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49f400f5f0 con 0x5634da7ac680 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7afd80 con 0x5634da7ac680 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49f400f5f0 con 0x5634da7ac680 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.356+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b0650 con 0x5634da7ac680 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49f400f5f0 con 0x5634da7ac680 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a02220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a02220800 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da7b1070 0x5634da7b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b3bd0 con 0x5634da7b1070 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a0050b640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da7b1070 0x5634da7b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a0050b640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da7b1070 0x5634da7b3460 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a02220800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a02220800 20 searching for the correct realm 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a02220800 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5634da7b5b80 0x5634da7b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.357+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b5b80 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.358+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5634da7b5b80 0x5634da7b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.358+0000 7f49ffd0a640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5634da7b5b80 0x5634da7b8040 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.358+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.358+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b1070 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.358+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.358+0000 7f4a0050b640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f49f8014070 0x7f49f80451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.358+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x7f49f8014070 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.359+0000 7f49ff509640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f49f8014070 0x7f49f80451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.359+0000 7f49ff509640 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f49f8014070 0x7f49f80451b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.359+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f400f5f0 con 0x7f49f8014070 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.359+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7ac680 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.359+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f400f5f0 con 0x5634da7ac680 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.359+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7ac680 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.360+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f49f402b040 con 0x5634da7ac680 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.360+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x7f49f8014070 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.360+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f402b040 con 0x7f49f8014070 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.360+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x7f49f8014070 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.360+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f402b040 con 0x7f49f8014070 2024-09-22T08:11:05.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.360+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b1070 2024-09-22T08:11:05.377 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.360+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.377 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.360+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b5b80 2024-09-22T08:11:05.377 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.361+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.361+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7ac680 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.361+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f402b040 con 0x5634da7ac680 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.361+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x7f49f8014070 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.361+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f402b040 con 0x7f49f8014070 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.361+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7ac680 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.361+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f402b040 con 0x5634da7ac680 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.361+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b1070 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.362+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.362+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b5b80 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.362+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.362+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b5b80 2024-09-22T08:11:05.378 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.362+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.362+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x7f49f8014070 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.362+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f402b040 con 0x7f49f8014070 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.362+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b5b80 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.363+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.363+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b5b80 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.363+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.363+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7ac680 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.363+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f402b040 con 0x5634da7ac680 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.363+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7ac680 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.363+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f49f402b040 con 0x5634da7ac680 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.363+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x7f49f8014070 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.364+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f402b040 con 0x7f49f8014070 2024-09-22T08:11:05.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.364+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b5b80 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.364+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.364+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b1070 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.364+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.364+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7ac680 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.364+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f402b040 con 0x5634da7ac680 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.364+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x7f49f8014070 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.365+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.365+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b5b80 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.365+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.365+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x7f49f8014070 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.365+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.365+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b1070 2024-09-22T08:11:05.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.365+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.365+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b5b80 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.365+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.365+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x7f49f8014070 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7ac680 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8710 con 0x5634da7b1070 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:05.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b4590 con 0x5634da7ac680 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.366+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b4e30 con 0x5634da7ac680 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8b90 con 0x5634da7ac680 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:05.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 20 zone default found 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 4 Realm: () 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 20 zonegroup default 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b8b90 con 0x7f49f8014070 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.367+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7baa30 con 0x5634da7b5b80 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.368+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.368+0000 7f4a02220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.368+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.368+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7badd0 con 0x5634da7b5b80 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.368+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.368+0000 7f4a02220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.368+0000 7f4a02220800 20 started sync module instance, tier type = 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.368+0000 7f4a02220800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.368+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7b9ec0 con 0x5634da7b1070 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.369+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.369+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94785003823792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bb6c0 con 0x5634da7b1070 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.369+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bbf10 con 0x5634da7ac680 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.370+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94785003823792] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.370+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.370+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94785003827728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bbb80 con 0x5634da7ac680 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.370+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bc6a0 con 0x5634da7b5b80 2024-09-22T08:11:05.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.371+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.371+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94785003831664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bcf40 con 0x5634da7b5b80 2024-09-22T08:11:05.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.371+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bda10 con 0x5634da7b1070 2024-09-22T08:11:05.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.371+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94785003827728] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.372+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94785003831664] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.372+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.372+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94785003834000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bb630 con 0x5634da7b1070 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.372+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7be420 con 0x5634da7ac680 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.374+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.374+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94785003834000] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.374+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94785003839344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7be390 con 0x5634da7ac680 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.374+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bed50 con 0x7f49f8014070 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.375+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.375+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94785003839344] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.375+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94785003841696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7becc0 con 0x7f49f8014070 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.375+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bd520 con 0x7f49f8014070 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.376+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94785003841696] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.376+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.376+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94785003836704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bf810 con 0x7f49f8014070 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.376+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7c01d0 con 0x7f49f8014070 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.377+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94785003836704] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.377+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.377+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94785003843824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7c01d0 con 0x7f49f8014070 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.377+0000 7f4a02220800 20 add_watcher() i=0 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.377+0000 7f4a02220800 20 add_watcher() i=1 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.377+0000 7f4a02220800 20 add_watcher() i=2 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.377+0000 7f4a02220800 20 add_watcher() i=3 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.377+0000 7f4a02220800 20 add_watcher() i=4 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.377+0000 7f4a02220800 20 add_watcher() i=5 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.377+0000 7f4a02220800 20 add_watcher() i=6 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.378+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94785003843824] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.378+0000 7f4a02220800 20 add_watcher() i=7 2024-09-22T08:11:05.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.378+0000 7f4a02220800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.378+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7c36d0 con 0x5634da7ac680 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.378+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.378+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94785003847872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7c0990 con 0x5634da7ac680 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.379+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94785003847872] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.379+0000 7f48b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.379+0000 7f4a02220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.379+0000 7f4a02220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.379+0000 7f4a02220800 5 note: GC not initialized 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.379+0000 7f48b57e2640 20 reqs_thread_entry: start 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 20 Filter name: none 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f48ae7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7f6a60 con 0x5634da7ac680 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 20 rados_obj.operate() r=0 bl.length=556 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7f77b0 con 0x5634da7b1070 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.380+0000 7f4a02220800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.381+0000 7f4a02220800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.381+0000 7f4a02220800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-22T08:11:05.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.381+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7fd490 con 0x5634da7ac680 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f4a02220800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f4a02220800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f4a02220800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94785004097232 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7fa0a0 con 0x5634da7ac680 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 94785003839344 notify 137438953479 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f49f4018040 con 0x5634da7ac680 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f48deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94785003839344 notifier 4388 bl.length()=849 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f48deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f48deffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(65 notify.4 [notify cookie 94785004097232 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f48deffd640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f48c4003ea0 con 0x5634da7ac680 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 94785004097232 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f49f402fcd0 con 0x5634da7ac680 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.382+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7fced0 con 0x5634da7b1070 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f4a02220800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f4a02220800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f4a02220800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94785004097232 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634da7f7bd0 con 0x5634da7b1070 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== watch-notify(notify (1) cookie 94785003823792 notify 137438953475 ret 0) ==== 208+0+0 (crc 0 0 0) 0x5634da7a1d20 con 0x5634da7b1070 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f48de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94785003823792 notifier 4388 bl.length()=166 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f48de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f48de7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(68 notify.0 [notify cookie 94785004097232 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f48de7fc640 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4828003400 con 0x5634da7b1070 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.384+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== watch-notify(notify_complete (2) cookie 94785004097232 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5634da7a13a0 con 0x5634da7b1070 2024-09-22T08:11:05.397 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-22T08:11:05.381799Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:05.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.385+0000 7f48b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.385+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94785003847872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7f4760 con 0x5634da7ac680 2024-09-22T08:11:05.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.386+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94785003847872] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.386+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94785003823792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7f4760 con 0x5634da7b1070 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.387+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94785003823792] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.387+0000 7f4a02220800 20 remove_watcher() i=0 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.387+0000 7f4a02220800 2 removed watcher, disabling cache 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.387+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94785003827728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7f4760 con 0x5634da7ac680 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.388+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94785003827728] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.388+0000 7f4a02220800 20 remove_watcher() i=1 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.388+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94785003831664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7f4760 con 0x5634da7b5b80 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.389+0000 7f49ffd0a640 1 -- 172.21.15.165:0/1021311267 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94785003831664] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f0057030 con 0x5634da7b5b80 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.389+0000 7f4a02220800 20 remove_watcher() i=2 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.389+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94785003834000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bb210 con 0x5634da7b1070 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.390+0000 7f4a0050b640 1 -- 172.21.15.165:0/1021311267 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94785003834000] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f802a070 con 0x5634da7b1070 2024-09-22T08:11:05.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.390+0000 7f4a02220800 20 remove_watcher() i=3 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.390+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94785003839344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bc170 con 0x5634da7ac680 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.391+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94785003839344] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x5634da7ac680 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.391+0000 7f4a02220800 20 remove_watcher() i=4 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.391+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94785003841696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bca90 con 0x7f49f8014070 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.392+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94785003841696] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.392+0000 7f4a02220800 20 remove_watcher() i=5 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.392+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94785003836704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bb210 con 0x7f49f8014070 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.393+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94785003836704] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.393+0000 7f4a02220800 20 remove_watcher() i=6 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.393+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94785003843824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634da7bdf70 con 0x7f49f8014070 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94785003843824] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49f403b040 con 0x7f49f8014070 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 20 remove_watcher() i=7 2024-09-22T08:11:05.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f49f8014070 msgr2=0x7f49f80451b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f49f8014070 0x7f49f80451b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da7ac680 msgr2=0x5634da7aeb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da7ac680 0x5634da7aeb40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da7b1070 msgr2=0x5634da7b3460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da7b1070 0x5634da7b3460 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5634da7b5b80 msgr2=0x5634da7b8040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5634da7b5b80 0x5634da7b8040 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48c803d000 msgr2=0x7f48c803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48c803d000 0x7f48c803f4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f49f0065910 tx=0x7f49f0088000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 msgr2=0x5634da7a0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f49ff509640 1 -- 172.21.15.165:0/1021311267 reap_dead start 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da7a0bb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f49f802bfd0 tx=0x7f49f80546a0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 shutdown_connections 2024-09-22T08:11:05.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 --2- 172.21.15.165:0/1021311267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da799590 0x5634da7a0bb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 >> 172.21.15.165:0/1021311267 conn(0x5634da795990 msgr2=0x5634da793ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 shutdown_connections 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.394+0000 7f4a02220800 1 -- 172.21.15.165:0/1021311267 wait complete. 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/4230283431 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48d803d000 msgr2=0x7f48d803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/4230283431 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48d803d000 0x7f48d803f4c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5634da773c80 tx=0x7f49f0065a60 comp rx=0 tx=0).stop 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/4230283431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da78cb10 msgr2=0x5634da78cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/4230283431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da78cb10 0x5634da78cf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5634da772bb0 tx=0x7f49f8018830 comp rx=0 tx=0).stop 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/4230283431 shutdown_connections 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/4230283431 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48d803d000 0x7f48d803f4c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/4230283431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da78cb10 0x5634da78cf30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/4230283431 >> 172.21.15.165:0/4230283431 conn(0x5634da780ec0 msgr2=0x5634da7812a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/4230283431 shutdown_connections 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/4230283431 wait complete. 2024-09-22T08:11:05.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da678a40 msgr2=0x5634da779200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da678a40 0x5634da779200 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da77b5a0 msgr2=0x5634da77da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da77b5a0 0x5634da77da40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48e803d000 msgr2=0x7f48e803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48e803d000 0x7f48e803f4c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f49f4000c00 tx=0x7f49f40013b0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 msgr2=0x5634da771bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da771bb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f49f0045be0 tx=0x7f49f0003020 comp rx=0 tx=0).stop 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 shutdown_connections 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5634da77b5a0 0x5634da77da40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5634da678a40 0x5634da779200 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f48e803d000 0x7f48e803f4c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 --2- 172.21.15.165:0/958154430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5634da677800 0x5634da771bb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 >> 172.21.15.165:0/958154430 conn(0x5634da672bd0 msgr2=0x5634da760f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 shutdown_connections 2024-09-22T08:11:05.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.395+0000 7f4a02220800 1 -- 172.21.15.165:0/958154430 wait complete. 2024-09-22T08:11:05.407 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-22T08:11:05.381799Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:05.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:11:05.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:11:05.408 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:11:05.452 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:05.452 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:05.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b8b0c800 1 Processor -- start 2024-09-22T08:11:05.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b8b0c800 1 -- start start 2024-09-22T08:11:05.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b8b0c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b4442a2bf0 0x55b4442a8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b8b0c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b44412da20 con 0x55b4442a17e0 2024-09-22T08:11:05.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b8b0c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b44412d7d0 con 0x55b4442a2bf0 2024-09-22T08:11:05.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b5df5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b4442a2bf0 0x55b4442a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b65f6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b4442a17e0 0x55b4442a24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33602/0 (socket says 172.21.15.165:33602) 2024-09-22T08:11:05.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b65f6640 1 -- 172.21.15.165:0/3982027657 learned_addr learned my addr 172.21.15.165:0/3982027657 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:05.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b5df5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b4442a2bf0 0x55b4442a8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51560/0 (socket says 172.21.15.165:51560) 2024-09-22T08:11:05.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b5df5640 1 -- 172.21.15.165:0/3982027657 >> v1:172.21.15.53:6789/0 conn(0x55b4442a17e0 legacy=0x55b4442a24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.453+0000 7f30b5df5640 1 -- 172.21.15.165:0/3982027657 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4442a1ee0 con 0x55b4442a2bf0 2024-09-22T08:11:05.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.455+0000 7f30b5df5640 1 --2- 172.21.15.165:0/3982027657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a2bf0 0x55b4442a8580 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00a470 tx=0x7f30ac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e8408104255172 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.455+0000 7f30b55f4640 1 -- 172.21.15.165:0/3982027657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30ac053570 con 0x55b4442a2bf0 2024-09-22T08:11:05.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.455+0000 7f30b55f4640 1 -- 172.21.15.165:0/3982027657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ac058070 con 0x55b4442a2bf0 2024-09-22T08:11:05.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.455+0000 7f30b55f4640 1 -- 172.21.15.165:0/3982027657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30ac053880 con 0x55b4442a2bf0 2024-09-22T08:11:05.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.456+0000 7f30b8b0c800 1 -- 172.21.15.165:0/3982027657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a2bf0 msgr2=0x55b4442a8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.456+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/3982027657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a2bf0 0x55b4442a8580 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00a470 tx=0x7f30ac045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:05.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.456+0000 7f30b8b0c800 1 -- 172.21.15.165:0/3982027657 shutdown_connections 2024-09-22T08:11:05.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.456+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/3982027657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a2bf0 0x55b4442a8580 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.456+0000 7f30b8b0c800 1 -- 172.21.15.165:0/3982027657 >> 172.21.15.165:0/3982027657 conn(0x55b44429cbb0 msgr2=0x55b44429f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.456+0000 7f30b8b0c800 1 -- 172.21.15.165:0/3982027657 shutdown_connections 2024-09-22T08:11:05.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.456+0000 7f30b8b0c800 1 -- 172.21.15.165:0/3982027657 wait complete. 2024-09-22T08:11:05.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.470+0000 7f30b8b0c800 1 Processor -- start 2024-09-22T08:11:05.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.470+0000 7f30b8b0c800 1 -- start start 2024-09-22T08:11:05.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.470+0000 7f30b8b0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444215970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.470+0000 7f30b8b0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b44413add0 con 0x55b4442a17e0 2024-09-22T08:11:05.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.470+0000 7f30b65f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444215970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.470+0000 7f30b65f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444215970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51572/0 (socket says 172.21.15.165:51572) 2024-09-22T08:11:05.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.470+0000 7f30b65f6640 1 -- 172.21.15.165:0/1276608476 learned_addr learned my addr 172.21.15.165:0/1276608476 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.471+0000 7f30b65f6640 1 -- 172.21.15.165:0/1276608476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b444394c00 con 0x55b4442a17e0 2024-09-22T08:11:05.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.471+0000 7f30b65f6640 1 --2- 172.21.15.165:0/1276608476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444215970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f30a8001e40 tx=0x7f30a8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe39c1b70b087d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.471+0000 7f2fa4608640 1 -- 172.21.15.165:0/1276608476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a8012020 con 0x55b4442a17e0 2024-09-22T08:11:05.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.471+0000 7f2fa4608640 1 -- 172.21.15.165:0/1276608476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a800e5a0 con 0x55b4442a17e0 2024-09-22T08:11:05.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.471+0000 7f2fa4608640 1 -- 172.21.15.165:0/1276608476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a800e8a0 con 0x55b4442a17e0 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 -- 172.21.15.165:0/1276608476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 msgr2=0x55b444215970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/1276608476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444215970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f30a8001e40 tx=0x7f30a8001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 -- 172.21.15.165:0/1276608476 shutdown_connections 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/1276608476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444215970 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 -- 172.21.15.165:0/1276608476 >> 172.21.15.165:0/1276608476 conn(0x55b44429cbb0 msgr2=0x55b44438c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 -- 172.21.15.165:0/1276608476 shutdown_connections 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 -- 172.21.15.165:0/1276608476 wait complete. 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 Processor -- start 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 -- start start 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444399b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.472+0000 7f30b8b0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b4442a8ac0 con 0x55b4442a17e0 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.473+0000 7f30b65f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444399b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.473+0000 7f30b65f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444399b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51588/0 (socket says 172.21.15.165:51588) 2024-09-22T08:11:05.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.473+0000 7f30b65f6640 1 -- 172.21.15.165:0/148788462 learned_addr learned my addr 172.21.15.165:0/148788462 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.473+0000 7f30b65f6640 1 -- 172.21.15.165:0/148788462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b44439a080 con 0x55b4442a17e0 2024-09-22T08:11:05.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.473+0000 7f30b65f6640 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444399b20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f30a80012b0 tx=0x7f30a8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.473+0000 7f2fa2e05640 1 -- 172.21.15.165:0/148788462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a8012030 con 0x55b4442a17e0 2024-09-22T08:11:05.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.473+0000 7f2fa2e05640 1 -- 172.21.15.165:0/148788462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a801a750 con 0x55b4442a17e0 2024-09-22T08:11:05.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.473+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b44439a310 con 0x55b4442a17e0 2024-09-22T08:11:05.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.473+0000 7f2fa2e05640 1 -- 172.21.15.165:0/148788462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a801aa70 con 0x55b4442a17e0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.473+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b44439ad10 con 0x55b4442a17e0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.474+0000 7f2fa2e05640 1 -- 172.21.15.165:0/148788462 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f30a8015020 con 0x55b4442a17e0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.474+0000 7f2fa2e05640 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03cfb0 0x7f2f9c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.474+0000 7f2fa2e05640 1 -- 172.21.15.165:0/148788462 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f30a8020030 con 0x55b4442a17e0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.474+0000 7f30b5df5640 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03cfb0 0x7f2f9c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.474+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4442a2bf0 0x55b4443a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.474+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443a16b0 con 0x55b4442a2bf0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.475+0000 7f30b6df7640 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4442a2bf0 0x55b4443a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.475+0000 7f30b5df5640 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03cfb0 0x7f2f9c03f470 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30ac057000 tx=0x7f30ac052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.475+0000 7f30b6df7640 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4442a2bf0 0x55b4443a1170 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.475+0000 7f30b6df7640 1 -- 172.21.15.165:0/148788462 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30b000a4d0 con 0x55b4442a2bf0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.475+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443a1a50 con 0x55b4442a2bf0 2024-09-22T08:11:05.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.475+0000 7f30b6df7640 1 -- 172.21.15.165:0/148788462 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f30b000a4d0 con 0x55b4442a2bf0 2024-09-22T08:11:05.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.475+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443a3510 0x55b4443a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.475+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443a6140 con 0x55b4443a3510 2024-09-22T08:11:05.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.476+0000 7f30b65f6640 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443a3510 0x55b4443a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.476+0000 7f30b65f6640 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443a3510 0x55b4443a59b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.476+0000 7f30b65f6640 1 -- 172.21.15.165:0/148788462 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443a3510 2024-09-22T08:11:05.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.476+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443a22a0 con 0x55b4442a2bf0 2024-09-22T08:11:05.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.476+0000 7f30b6df7640 1 -- 172.21.15.165:0/148788462 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f30b000a4d0 con 0x55b4442a2bf0 2024-09-22T08:11:05.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.476+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443a2680 con 0x55b4442a2bf0 2024-09-22T08:11:05.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.477+0000 7f30b6df7640 1 -- 172.21.15.165:0/148788462 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f30b000a4d0 con 0x55b4442a2bf0 2024-09-22T08:11:05.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.477+0000 7f30b8b0c800 1 Processor -- start 2024-09-22T08:11:05.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.477+0000 7f30b8b0c800 1 -- start start 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.477+0000 7f30b8b0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4443b4af0 0x55b4443b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.477+0000 7f30b8b0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b444199d50 con 0x55b4443b4af0 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.477+0000 7f30b6df7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4443b4af0 0x55b4443b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.477+0000 7f30b6df7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4443b4af0 0x55b4443b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51598/0 (socket says 172.21.15.165:51598) 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.477+0000 7f30b6df7640 1 -- 172.21.15.165:0/4150165563 learned_addr learned my addr 172.21.15.165:0/4150165563 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.478+0000 7f30b6df7640 1 -- 172.21.15.165:0/4150165563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4443b5550 con 0x55b4443b4af0 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.478+0000 7f30b6df7640 1 --2- 172.21.15.165:0/4150165563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4443b4af0 0x55b4443b4f10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55b44439a9b0 tx=0x7f30b0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.478+0000 7f2f9bfff640 1 -- 172.21.15.165:0/4150165563 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b0014450 con 0x55b4443b4af0 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.478+0000 7f2f9bfff640 1 -- 172.21.15.165:0/4150165563 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b0014610 con 0x55b4443b4af0 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.478+0000 7f2f9bfff640 1 -- 172.21.15.165:0/4150165563 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b0014930 con 0x55b4443b4af0 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.478+0000 7f30b8b0c800 1 -- 172.21.15.165:0/4150165563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4443b5d80 con 0x55b4443b4af0 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.478+0000 7f30b8b0c800 1 -- 172.21.15.165:0/4150165563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4443b6320 con 0x55b4443b4af0 2024-09-22T08:11:05.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.479+0000 7f2f9bfff640 1 -- 172.21.15.165:0/4150165563 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f30b0011040 con 0x55b4443b4af0 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.479+0000 7f2f9bfff640 1 --2- 172.21.15.165:0/4150165563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9003cfb0 0x7f2f9003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.479+0000 7f2f9bfff640 1 -- 172.21.15.165:0/4150165563 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f30b001e070 con 0x55b4443b4af0 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.479+0000 7f30b65f6640 1 --2- 172.21.15.165:0/4150165563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9003cfb0 0x7f2f9003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.479+0000 7f30b8b0c800 1 Processor -- start 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f30b8b0c800 1 -- start start 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f30b65f6640 1 --2- 172.21.15.165:0/4150165563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9003cfb0 0x7f2f9003f470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55b44439bbf0 tx=0x7f30a802df10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f30b8b0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b444390ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f30b8b0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b444394e80 con 0x55b444390bf0 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f30b6df7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b444390ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f30b6df7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b444390ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51612/0 (socket says 172.21.15.165:51612) 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f30b6df7640 1 -- 172.21.15.165:0/652107716 learned_addr learned my addr 172.21.15.165:0/652107716 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f30b6df7640 1 -- 172.21.15.165:0/652107716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4443915e0 con 0x55b444390bf0 2024-09-22T08:11:05.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f30b6df7640 1 --2- 172.21.15.165:0/652107716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b444390ff0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f30b002b400 tx=0x7f30b0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53f38055df41b42 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f2f99ffb640 1 -- 172.21.15.165:0/652107716 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b0011da0 con 0x55b444390bf0 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f2f99ffb640 1 -- 172.21.15.165:0/652107716 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b0053280 con 0x55b444390bf0 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.480+0000 7f2f99ffb640 1 -- 172.21.15.165:0/652107716 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b00167c0 con 0x55b444390bf0 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 -- 172.21.15.165:0/652107716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 msgr2=0x55b444390ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/652107716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b444390ff0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f30b002b400 tx=0x7f30b0011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 -- 172.21.15.165:0/652107716 shutdown_connections 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/652107716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b444390ff0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 -- 172.21.15.165:0/652107716 >> 172.21.15.165:0/652107716 conn(0x55b4443bd990 msgr2=0x55b4443bbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 -- 172.21.15.165:0/652107716 shutdown_connections 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 -- 172.21.15.165:0/652107716 wait complete. 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 Processor -- start 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 -- start start 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b4443cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.481+0000 7f30b8b0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b444391c50 con 0x55b444390bf0 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.482+0000 7f30b6df7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b4443cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.482+0000 7f30b6df7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b4443cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51618/0 (socket says 172.21.15.165:51618) 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.482+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 learned_addr learned my addr 172.21.15.165:0/2192166450 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.482+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4443cb330 con 0x55b444390bf0 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.482+0000 7f30b6df7640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b4443cadd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f30b0044040 tx=0x7f30b00546f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.482+0000 7f2f87fff640 1 -- 172.21.15.165:0/2192166450 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b0056070 con 0x55b444390bf0 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.482+0000 7f2f87fff640 1 -- 172.21.15.165:0/2192166450 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b0056210 con 0x55b444390bf0 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.482+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4443cb5c0 con 0x55b444390bf0 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.482+0000 7f2f87fff640 1 -- 172.21.15.165:0/2192166450 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b0014c00 con 0x55b444390bf0 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.482+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4443cbf40 con 0x55b444390bf0 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.483+0000 7f2f87fff640 1 -- 172.21.15.165:0/2192166450 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f30b0034030 con 0x55b444390bf0 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.483+0000 7f2f87fff640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f8003d000 0x7f2f8003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.483+0000 7f2f87fff640 1 -- 172.21.15.165:0/2192166450 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f30b0032070 con 0x55b444390bf0 2024-09-22T08:11:05.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.483+0000 7f30b65f6640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f8003d000 0x7f2f8003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.483+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.483+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4443d67c0 0x55b4443d8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.483+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443d93d0 con 0x55b4443d67c0 2024-09-22T08:11:05.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b5df5640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4443d67c0 0x55b4443d8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b65f6640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f8003d000 0x7f2f8003f4c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f30a8044c60 tx=0x7f30a8048000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b5df5640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4443d67c0 0x55b4443d8c80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b8b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b8b0c800 20 realm 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443d9800 con 0x55b4443d67c0 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b8b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b8b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443da0d0 con 0x55b4443d67c0 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.484+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b8b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443da470 con 0x55b4443d67c0 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b8b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443db1d0 0x55b4443dd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443ddb00 con 0x55b4443db1d0 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b6df7640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443db1d0 0x55b4443dd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b6df7640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443db1d0 0x55b4443dd5c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b8b0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b8b0c800 20 searching for the correct realm 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.485+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b4443dfb40 0x55b4443e2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.486+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443dfb40 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.486+0000 7f30b65f6640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b4443dfb40 0x55b4443e2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.486+0000 7f30b65f6640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b4443dfb40 0x55b4443e2000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.486+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.486+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443db1d0 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.486+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.486+0000 7f30b6df7640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f30b0014070 0x7f30b0023880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.486+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x7f30b0014070 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.487+0000 7f30b5df5640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f30b0014070 0x7f30b0023880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.487+0000 7f30b5df5640 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f30b0014070 0x7f30b0023880 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.487+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.487+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443d67c0 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.488+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.488+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443d67c0 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.488+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.488+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x7f30b0014070 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.488+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.488+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x7f30b0014070 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.488+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.488+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443db1d0 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.489+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.489+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443dfb40 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.489+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.489+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443d67c0 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.489+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.489+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x7f30b0014070 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.489+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.489+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443d67c0 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.489+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.489+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443db1d0 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.490+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.490+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443dfb40 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.490+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.490+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443dfb40 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.490+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.490+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x7f30b0014070 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.490+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.490+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443dfb40 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.491+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.491+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443dfb40 2024-09-22T08:11:05.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.491+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.491+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443d67c0 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.491+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.491+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443d67c0 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.491+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.491+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x7f30b0014070 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.491+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.491+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443dfb40 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.492+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.492+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443db1d0 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.492+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.492+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443d67c0 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.492+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.492+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x7f30b0014070 2024-09-22T08:11:05.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.492+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.492+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443dfb40 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.493+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.493+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x7f30b0014070 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.493+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.493+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443db1d0 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.493+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.493+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443dfb40 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.493+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.493+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x7f30b0014070 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443d67c0 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e26d0 con 0x55b4443db1d0 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b8b0c800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b8b0c800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b8b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b8b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b8b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.494+0000 7f30b8b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443de540 con 0x55b4443d67c0 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443de150 con 0x55b4443d67c0 2024-09-22T08:11:05.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443deeb0 con 0x55b4443d67c0 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 20 zone default found 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 4 Realm: () 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 20 zonegroup default 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.495+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443de9c0 con 0x7f30b0014070 2024-09-22T08:11:05.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b8b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e4a40 con 0x55b4443dfb40 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b8b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e4f00 con 0x55b4443dfb40 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b8b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b8b0c800 20 started sync module instance, tier type = 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b8b0c800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.496+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e3ee0 con 0x55b4443db1d0 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.497+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.497+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232727405264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e57f0 con 0x55b4443db1d0 2024-09-22T08:11:05.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.497+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e6040 con 0x55b4443d67c0 2024-09-22T08:11:05.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.498+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94232727405264] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.498+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.498+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94232727409744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e5d80 con 0x55b4443d67c0 2024-09-22T08:11:05.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.498+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e6890 con 0x55b4443dfb40 2024-09-22T08:11:05.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.499+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94232727409744] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.499+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.499+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94232727413568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e6c80 con 0x55b4443dfb40 2024-09-22T08:11:05.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.499+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e76c0 con 0x55b4443db1d0 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.500+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94232727413568] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.500+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.500+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94232727417232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e7ab0 con 0x55b4443db1d0 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.500+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e84f0 con 0x55b4443d67c0 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.502+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.502+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94232727420864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e84b0 con 0x55b4443d67c0 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.502+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e94b0 con 0x7f30b0014070 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.502+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94232727417232] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.502+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94232727420864] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.503+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.503+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94232727424992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e8690 con 0x7f30b0014070 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.503+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e9d50 con 0x7f30b0014070 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.503+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94232727424992] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.504+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.504+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94232727410800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e9b80 con 0x7f30b0014070 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.504+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443ea3d0 con 0x7f30b0014070 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.505+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94232727410800] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.505+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.505+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94232727427248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443ea1c0 con 0x7f30b0014070 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.505+0000 7f30b8b0c800 20 add_watcher() i=0 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.505+0000 7f30b8b0c800 20 add_watcher() i=1 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.505+0000 7f30b8b0c800 20 add_watcher() i=2 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.505+0000 7f30b8b0c800 20 add_watcher() i=3 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.505+0000 7f30b8b0c800 20 add_watcher() i=4 2024-09-22T08:11:05.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.505+0000 7f30b8b0c800 20 add_watcher() i=5 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.505+0000 7f30b8b0c800 20 add_watcher() i=6 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.506+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94232727427248] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.506+0000 7f30b8b0c800 20 add_watcher() i=7 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.506+0000 7f30b8b0c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.506+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4443ed820 con 0x55b4443d67c0 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.506+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.506+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94232727428304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443eab80 con 0x55b4443d67c0 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.507+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94232727428304] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.507+0000 7f2f6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.507+0000 7f30b8b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.507+0000 7f30b8b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.507+0000 7f30b8b0c800 5 note: GC not initialized 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.507+0000 7f2f677fe640 20 reqs_thread_entry: start 2024-09-22T08:11:05.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.507+0000 7f30b8b0c800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:05.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.508+0000 7f30b8b0c800 20 Filter name: none 2024-09-22T08:11:05.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.508+0000 7f2f657fa640 20 reqs_thread_entry: start 2024-09-22T08:11:05.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.508+0000 7f30b8b0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.508+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b444420770 con 0x55b4443d67c0 2024-09-22T08:11:05.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.508+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.508+0000 7f30b8b0c800 20 rados_obj.operate() r=0 bl.length=673 2024-09-22T08:11:05.518 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-22T08:11:05.381799Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:05.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.509+0000 7f2f6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.509+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94232727428304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443ec620 con 0x55b4443d67c0 2024-09-22T08:11:05.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.510+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94232727428304] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.510+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94232727405264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e9cd0 con 0x55b4443db1d0 2024-09-22T08:11:05.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.511+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94232727405264] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.511+0000 7f30b8b0c800 20 remove_watcher() i=0 2024-09-22T08:11:05.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.511+0000 7f30b8b0c800 2 removed watcher, disabling cache 2024-09-22T08:11:05.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.511+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94232727409744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e42d0 con 0x55b4443d67c0 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.512+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94232727409744] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.512+0000 7f30b8b0c800 20 remove_watcher() i=1 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.512+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94232727413568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e42d0 con 0x55b4443dfb40 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.513+0000 7f30b65f6640 1 -- 172.21.15.165:0/2192166450 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94232727413568] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30a8054490 con 0x55b4443dfb40 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.513+0000 7f30b8b0c800 20 remove_watcher() i=2 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.513+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94232727417232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e5450 con 0x55b4443db1d0 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.514+0000 7f30b6df7640 1 -- 172.21.15.165:0/2192166450 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94232727417232] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b002a070 con 0x55b4443db1d0 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.514+0000 7f30b8b0c800 20 remove_watcher() i=3 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.514+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94232727420864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e5450 con 0x55b4443d67c0 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.515+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94232727420864] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x55b4443d67c0 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.515+0000 7f30b8b0c800 20 remove_watcher() i=4 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.515+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94232727424992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e5450 con 0x7f30b0014070 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.516+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94232727424992] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.516+0000 7f30b8b0c800 20 remove_watcher() i=5 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.516+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94232727410800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e5450 con 0x7f30b0014070 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.517+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94232727410800] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.517+0000 7f30b8b0c800 20 remove_watcher() i=6 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.517+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94232727427248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4443e6340 con 0x7f30b0014070 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94232727427248] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30ac051070 con 0x7f30b0014070 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 20 remove_watcher() i=7 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f30b0014070 msgr2=0x7f30b0023880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f30b0014070 0x7f30b0023880 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4443d67c0 msgr2=0x55b4443d8c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4443d67c0 0x55b4443d8c80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443db1d0 msgr2=0x55b4443dd5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443db1d0 0x55b4443dd5c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b4443dfb40 msgr2=0x55b4443e2000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b4443dfb40 0x55b4443e2000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f8003d000 msgr2=0x7f2f8003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f8003d000 0x7f2f8003f4c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f30a8044c60 tx=0x7f30a8048000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 msgr2=0x55b4443cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/2192166450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b444390bf0 0x55b4443cadd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f30b0044040 tx=0x7f30b00546f0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 reap_dead start 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b5df5640 1 -- 172.21.15.165:0/2192166450 reap_dead start 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 shutdown_connections 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 >> 172.21.15.165:0/2192166450 conn(0x55b4443bd990 msgr2=0x55b4443bbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 shutdown_connections 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/2192166450 wait complete. 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/4150165563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9003cfb0 msgr2=0x7f2f9003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/4150165563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9003cfb0 0x7f2f9003f470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55b44439bbf0 tx=0x7f30a802df10 comp rx=0 tx=0).stop 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/4150165563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4443b4af0 msgr2=0x55b4443b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/4150165563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4443b4af0 0x55b4443b4f10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55b44439a9b0 tx=0x7f30b0018830 comp rx=0 tx=0).stop 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/4150165563 shutdown_connections 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/4150165563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9003cfb0 0x7f2f9003f470 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/4150165563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4443b4af0 0x55b4443b4f10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/4150165563 >> 172.21.15.165:0/4150165563 conn(0x55b4443a8ea0 msgr2=0x55b4443a9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/4150165563 shutdown_connections 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.518+0000 7f30b8b0c800 1 -- 172.21.15.165:0/4150165563 wait complete. 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4442a2bf0 msgr2=0x55b4443a1170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4442a2bf0 0x55b4443a1170 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443a3510 msgr2=0x55b4443a59b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443a3510 0x55b4443a59b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03cfb0 msgr2=0x7f2f9c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03cfb0 0x7f2f9c03f470 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30ac057000 tx=0x7f30ac052000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 msgr2=0x55b444399b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444399b20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f30a80012b0 tx=0x7f30a8000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 shutdown_connections 2024-09-22T08:11:05.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b4443a3510 0x55b4443a59b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b4442a2bf0 0x55b4443a1170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2f9c03cfb0 0x7f2f9c03f470 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 --2- 172.21.15.165:0/148788462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4442a17e0 0x55b444399b20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 >> 172.21.15.165:0/148788462 conn(0x55b44429cbb0 msgr2=0x55b44438b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 shutdown_connections 2024-09-22T08:11:05.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.519+0000 7f30b8b0c800 1 -- 172.21.15.165:0/148788462 wait complete. 2024-09-22T08:11:05.529 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-22T08:11:05.381799Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:05.529 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-22T08:11:05.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-22T08:11:05.529 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-22T08:11:05.576 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:05.576 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:05.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.576+0000 7f70c5b42800 1 Processor -- start 2024-09-22T08:11:05.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.576+0000 7f70c5b42800 1 -- start start 2024-09-22T08:11:05.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.576+0000 7f70c5b42800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5635bc068c00 0x5635bc06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.576+0000 7f70c5b42800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5635bbeefa20 con 0x5635bc0650f0 2024-09-22T08:11:05.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.576+0000 7f70c5b42800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5635bbeef7d0 con 0x5635bc068c00 2024-09-22T08:11:05.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.576+0000 7f70bbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5635bc068c00 0x5635bc06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.576+0000 7f70bbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5635bc068c00 0x5635bc06aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51632/0 (socket says 172.21.15.165:51632) 2024-09-22T08:11:05.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.576+0000 7f70c18ed640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5635bc0650f0 0x5635bc0674e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33606/0 (socket says 172.21.15.165:33606) 2024-09-22T08:11:05.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.576+0000 7f70bbfff640 1 -- 172.21.15.165:0/3860852815 learned_addr learned my addr 172.21.15.165:0/3860852815 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.577+0000 7f70bbfff640 1 -- 172.21.15.165:0/3860852815 >> v1:172.21.15.53:6789/0 conn(0x5635bc0650f0 legacy=0x5635bc0674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.577+0000 7f70c10ec640 1 -- 172.21.15.165:0/3860852815 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4058561182 0 0) 0x5635bbeefa20 con 0x5635bc0650f0 2024-09-22T08:11:05.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.577+0000 7f70bbfff640 1 -- 172.21.15.165:0/3860852815 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bc06c570 con 0x5635bc068c00 2024-09-22T08:11:05.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.578+0000 7f70bbfff640 1 --2- 172.21.15.165:0/3860852815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc068c00 0x5635bc06aff0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00a520 tx=0x7f70ac045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a68ccb6833fd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.578+0000 7f70c10ec640 1 -- 172.21.15.165:0/3860852815 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70ac055070 con 0x5635bc068c00 2024-09-22T08:11:05.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.579+0000 7f70c10ec640 1 -- 172.21.15.165:0/3860852815 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ac0515b0 con 0x5635bc068c00 2024-09-22T08:11:05.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.579+0000 7f70c10ec640 1 -- 172.21.15.165:0/3860852815 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70ac0518d0 con 0x5635bc068c00 2024-09-22T08:11:05.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.579+0000 7f70c5b42800 1 -- 172.21.15.165:0/3860852815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc068c00 msgr2=0x5635bc06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.579+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3860852815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc068c00 0x5635bc06aff0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00a520 tx=0x7f70ac045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.579+0000 7f70c5b42800 1 -- 172.21.15.165:0/3860852815 shutdown_connections 2024-09-22T08:11:05.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.579+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3860852815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc068c00 0x5635bc06aff0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.579+0000 7f70c5b42800 1 -- 172.21.15.165:0/3860852815 >> 172.21.15.165:0/3860852815 conn(0x5635bc05ebb0 msgr2=0x5635bc061010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.579+0000 7f70c5b42800 1 -- 172.21.15.165:0/3860852815 shutdown_connections 2024-09-22T08:11:05.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.579+0000 7f70c5b42800 1 -- 172.21.15.165:0/3860852815 wait complete. 2024-09-22T08:11:05.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.593+0000 7f70c5b42800 1 Processor -- start 2024-09-22T08:11:05.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.593+0000 7f70c5b42800 1 -- start start 2024-09-22T08:11:05.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.593+0000 7f70c5b42800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc153e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.593+0000 7f70c5b42800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635bbefcdd0 con 0x5635bc0650f0 2024-09-22T08:11:05.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.593+0000 7f70c18ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.593+0000 7f70c18ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51638/0 (socket says 172.21.15.165:51638) 2024-09-22T08:11:05.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.593+0000 7f70c18ed640 1 -- 172.21.15.165:0/3537338299 learned_addr learned my addr 172.21.15.165:0/3537338299 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.594+0000 7f70c18ed640 1 -- 172.21.15.165:0/3537338299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bc154410 con 0x5635bc0650f0 2024-09-22T08:11:05.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.594+0000 7f70c18ed640 1 --2- 172.21.15.165:0/3537338299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc153e20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f70b4001ea0 tx=0x7f70b400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a4c8f8de7be90b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.594+0000 7f6fafe07640 1 -- 172.21.15.165:0/3537338299 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70b4008070 con 0x5635bc0650f0 2024-09-22T08:11:05.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.594+0000 7f6fafe07640 1 -- 172.21.15.165:0/3537338299 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b400d500 con 0x5635bc0650f0 2024-09-22T08:11:05.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.594+0000 7f6fafe07640 1 -- 172.21.15.165:0/3537338299 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70b400d880 con 0x5635bc0650f0 2024-09-22T08:11:05.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 -- 172.21.15.165:0/3537338299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 msgr2=0x5635bc153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3537338299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc153e20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f70b4001ea0 tx=0x7f70b400b6a0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 -- 172.21.15.165:0/3537338299 shutdown_connections 2024-09-22T08:11:05.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3537338299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc153e20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 -- 172.21.15.165:0/3537338299 >> 172.21.15.165:0/3537338299 conn(0x5635bc05ebb0 msgr2=0x5635bc14f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 -- 172.21.15.165:0/3537338299 shutdown_connections 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 -- 172.21.15.165:0/3537338299 wait complete. 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 Processor -- start 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 -- start start 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc15b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c5b42800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635bc06b830 con 0x5635bc0650f0 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c18ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c18ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc15b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51654/0 (socket says 172.21.15.165:51654) 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.595+0000 7f70c18ed640 1 -- 172.21.15.165:0/1802787894 learned_addr learned my addr 172.21.15.165:0/1802787894 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.596+0000 7f70c18ed640 1 -- 172.21.15.165:0/1802787894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bc15bed0 con 0x5635bc0650f0 2024-09-22T08:11:05.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.596+0000 7f70c18ed640 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc15b970 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70b4000f60 tx=0x7f70b4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.596+0000 7f6fae604640 1 -- 172.21.15.165:0/1802787894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70b400f8d0 con 0x5635bc0650f0 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.596+0000 7f6fae604640 1 -- 172.21.15.165:0/1802787894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b400fa70 con 0x5635bc0650f0 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.596+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635bc15c160 con 0x5635bc0650f0 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.596+0000 7f6fae604640 1 -- 172.21.15.165:0/1802787894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70b400fd50 con 0x5635bc0650f0 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.596+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635bc15cb60 con 0x5635bc0650f0 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.597+0000 7f6fae604640 1 -- 172.21.15.165:0/1802787894 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f70b4017040 con 0x5635bc0650f0 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.597+0000 7f6fae604640 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6fa803cfb0 0x7f6fa803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.597+0000 7f6fae604640 1 -- 172.21.15.165:0/1802787894 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f70b4015020 con 0x5635bc0650f0 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.597+0000 7f70bbfff640 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6fa803cfb0 0x7f6fa803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.597+0000 7f70c5b42800 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc068c00 0x5635bc162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.597+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc163500 con 0x5635bc068c00 2024-09-22T08:11:05.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.597+0000 7f70c20ee640 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc068c00 0x5635bc162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.598+0000 7f70bbfff640 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6fa803cfb0 0x7f6fa803f470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70ac057000 tx=0x7f70ac052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.598+0000 7f70c20ee640 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc068c00 0x5635bc162fc0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.598+0000 7f70c20ee640 1 -- 172.21.15.165:0/1802787894 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70bc00a4d0 con 0x5635bc068c00 2024-09-22T08:11:05.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.598+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1638a0 con 0x5635bc068c00 2024-09-22T08:11:05.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.598+0000 7f70c20ee640 1 -- 172.21.15.165:0/1802787894 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70bc00a4d0 con 0x5635bc068c00 2024-09-22T08:11:05.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.598+0000 7f70c5b42800 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc165360 0x5635bc1677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.598+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc167f60 con 0x5635bc165360 2024-09-22T08:11:05.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.598+0000 7f70c18ed640 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc165360 0x5635bc1677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.599+0000 7f70c18ed640 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc165360 0x5635bc1677d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.599+0000 7f70c18ed640 1 -- 172.21.15.165:0/1802787894 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc165360 2024-09-22T08:11:05.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.599+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1640f0 con 0x5635bc068c00 2024-09-22T08:11:05.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.599+0000 7f70c20ee640 1 -- 172.21.15.165:0/1802787894 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70bc00a4d0 con 0x5635bc068c00 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.599+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1644d0 con 0x5635bc068c00 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.600+0000 7f70c20ee640 1 -- 172.21.15.165:0/1802787894 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f70bc00a4d0 con 0x5635bc068c00 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.600+0000 7f70c5b42800 1 Processor -- start 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.600+0000 7f70c5b42800 1 -- start start 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.600+0000 7f70c5b42800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc176910 0x5635bc176d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.600+0000 7f70c5b42800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635bbf5bd50 con 0x5635bc176910 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.600+0000 7f70c20ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc176910 0x5635bc176d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.600+0000 7f70c20ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc176910 0x5635bc176d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51658/0 (socket says 172.21.15.165:51658) 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.600+0000 7f70c20ee640 1 -- 172.21.15.165:0/2541583119 learned_addr learned my addr 172.21.15.165:0/2541583119 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.601+0000 7f70c20ee640 1 -- 172.21.15.165:0/2541583119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bc177370 con 0x5635bc176910 2024-09-22T08:11:05.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.601+0000 7f70c20ee640 1 --2- 172.21.15.165:0/2541583119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc176910 0x5635bc176d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5635bc15c970 tx=0x7f70bc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.601+0000 7f6fa77fe640 1 -- 172.21.15.165:0/2541583119 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70bc014450 con 0x5635bc176910 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.601+0000 7f6fa77fe640 1 -- 172.21.15.165:0/2541583119 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc014610 con 0x5635bc176910 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.601+0000 7f6fa77fe640 1 -- 172.21.15.165:0/2541583119 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70bc014930 con 0x5635bc176910 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.601+0000 7f70c5b42800 1 -- 172.21.15.165:0/2541583119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635bc177ba0 con 0x5635bc176910 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.601+0000 7f70c5b42800 1 -- 172.21.15.165:0/2541583119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635bc178140 con 0x5635bc176910 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.602+0000 7f6fa77fe640 1 -- 172.21.15.165:0/2541583119 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f70bc011040 con 0x5635bc176910 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.602+0000 7f6fa77fe640 1 --2- 172.21.15.165:0/2541583119 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f9c03cfb0 0x7f6f9c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.602+0000 7f6fa77fe640 1 -- 172.21.15.165:0/2541583119 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f70bc01e070 con 0x5635bc176910 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.602+0000 7f70c18ed640 1 --2- 172.21.15.165:0/2541583119 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f9c03cfb0 0x7f6f9c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.602+0000 7f70c5b42800 1 Processor -- start 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f70c5b42800 1 -- start start 2024-09-22T08:11:05.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f70c18ed640 1 --2- 172.21.15.165:0/2541583119 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f9c03cfb0 0x7f6f9c03f470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5635bc15da10 tx=0x7f70b401b440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f70c5b42800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc0634f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f70c5b42800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635bc154840 con 0x5635bc0630f0 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f70c20ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc0634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f70c20ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc0634f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51660/0 (socket says 172.21.15.165:51660) 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f70c20ee640 1 -- 172.21.15.165:0/4260222182 learned_addr learned my addr 172.21.15.165:0/4260222182 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f70c20ee640 1 -- 172.21.15.165:0/4260222182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bc063ae0 con 0x5635bc0630f0 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f70c20ee640 1 --2- 172.21.15.165:0/4260222182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc0634f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f70bc016fd0 tx=0x7f70bc011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f0ca2b5d127c5b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f6fa57fa640 1 -- 172.21.15.165:0/4260222182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70bc011da0 con 0x5635bc0630f0 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f6fa57fa640 1 -- 172.21.15.165:0/4260222182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc0532d0 con 0x5635bc0630f0 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.603+0000 7f6fa57fa640 1 -- 172.21.15.165:0/4260222182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70bc0168f0 con 0x5635bc0630f0 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 -- 172.21.15.165:0/4260222182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 msgr2=0x5635bc0634f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 --2- 172.21.15.165:0/4260222182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc0634f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f70bc016fd0 tx=0x7f70bc011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 -- 172.21.15.165:0/4260222182 shutdown_connections 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 --2- 172.21.15.165:0/4260222182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc0634f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 -- 172.21.15.165:0/4260222182 >> 172.21.15.165:0/4260222182 conn(0x5635bc17f7b0 msgr2=0x5635bc17d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 -- 172.21.15.165:0/4260222182 shutdown_connections 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 -- 172.21.15.165:0/4260222182 wait complete. 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 Processor -- start 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 -- start start 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc18cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.604+0000 7f70c5b42800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635bc064150 con 0x5635bc0630f0 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.605+0000 7f70c20ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc18cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.605+0000 7f70c20ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc18cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51664/0 (socket says 172.21.15.165:51664) 2024-09-22T08:11:05.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.605+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 learned_addr learned my addr 172.21.15.165:0/3023001799 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.605+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bc18d150 con 0x5635bc0630f0 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.605+0000 7f70c20ee640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc18cbf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0546f0 tx=0x7f70bc054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.605+0000 7f6f937fe640 1 -- 172.21.15.165:0/3023001799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70bc011470 con 0x5635bc0630f0 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.605+0000 7f6f937fe640 1 -- 172.21.15.165:0/3023001799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc014ad0 con 0x5635bc0630f0 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.605+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635bc18d3e0 con 0x5635bc0630f0 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.605+0000 7f6f937fe640 1 -- 172.21.15.165:0/3023001799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70bc056070 con 0x5635bc0630f0 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.605+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635bc18dd60 con 0x5635bc0630f0 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.606+0000 7f6f937fe640 1 -- 172.21.15.165:0/3023001799 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f70bc034020 con 0x5635bc0630f0 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.606+0000 7f6f937fe640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f8c03d000 0x7f6f8c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.606+0000 7f6f937fe640 1 -- 172.21.15.165:0/3023001799 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f70bc032020 con 0x5635bc0630f0 2024-09-22T08:11:05.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.606+0000 7f70c18ed640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f8c03d000 0x7f6f8c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.607+0000 7f70c18ed640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f8c03d000 0x7f6f8c03f4c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70b400eab0 tx=0x7f70b4027000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.607+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.607+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc198680 0x5635bc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.607+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc19b290 con 0x5635bc198680 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.607+0000 7f70bbfff640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc198680 0x5635bc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.607+0000 7f70bbfff640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc198680 0x5635bc19ab40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 20 realm 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc19b6c0 con 0x5635bc198680 2024-09-22T08:11:05.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc19bf90 con 0x5635bc198680 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc19c330 con 0x5635bc198680 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc19d090 0x5635bc19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.608+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc19fa90 con 0x5635bc19d090 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.609+0000 7f70c20ee640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc19d090 0x5635bc19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.609+0000 7f70c20ee640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc19d090 0x5635bc19f480 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.609+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f70bc02a070 con 0x5635bc19d090 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.609+0000 7f70c5b42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.609+0000 7f70c5b42800 20 searching for the correct realm 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.609+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5635bc1a1a70 0x5635bc1a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.609+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc1a1a70 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.609+0000 7f70c18ed640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5635bc1a1a70 0x5635bc1a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.610+0000 7f70c18ed640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5635bc1a1a70 0x5635bc1a3f30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.610+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.610+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc19d090 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.610+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f70bc02a070 con 0x5635bc19d090 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.610+0000 7f70c20ee640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f70bc014070 0x7f70bc04d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.610+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x7f70bc014070 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.610+0000 7f70bbfff640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f70bc014070 0x7f70bc04d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.611+0000 7f70bbfff640 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f70bc014070 0x7f70bc04d480 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.611+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x7f70bc014070 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.611+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc198680 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.611+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.611+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc198680 2024-09-22T08:11:05.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.611+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.611+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x7f70bc014070 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.612+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x7f70bc014070 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.612+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x7f70bc014070 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.612+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x7f70bc014070 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.612+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc19d090 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.612+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.612+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc1a1a70 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.612+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.612+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc198680 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.613+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.613+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x7f70bc014070 2024-09-22T08:11:05.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.613+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x7f70bc014070 2024-09-22T08:11:05.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.613+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc198680 2024-09-22T08:11:05.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.613+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.613+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc19d090 2024-09-22T08:11:05.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.613+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.613+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc1a1a70 2024-09-22T08:11:05.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.614+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.614+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc1a1a70 2024-09-22T08:11:05.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.614+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.614+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x7f70bc014070 2024-09-22T08:11:05.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.614+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x7f70bc014070 2024-09-22T08:11:05.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.614+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc1a1a70 2024-09-22T08:11:05.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.614+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.614+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc1a1a70 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.614+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.614+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc198680 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.615+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.615+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc198680 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.615+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.615+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x7f70bc014070 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.615+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x7f70bc014070 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.615+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc1a1a70 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.615+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.615+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc19d090 2024-09-22T08:11:05.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.616+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.616+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc198680 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.616+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.616+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x7f70bc014070 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.616+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x7f70bc014070 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.616+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc1a1a70 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.616+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.616+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x7f70bc014070 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.617+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x7f70bc014070 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.617+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc19d090 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.617+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.617+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc1a1a70 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.617+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.617+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x7f70bc014070 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.617+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70ac057030 con 0x7f70bc014070 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.617+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc198680 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a45b0 con 0x5635bc19d090 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:05.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a0350 con 0x5635bc198680 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a0740 con 0x5635bc198680 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70ac057030 con 0x5635bc198680 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.618+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a4a30 con 0x5635bc198680 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 zone default found 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 4 Realm: () 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 zonegroup default 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc19ff60 con 0x7f70bc014070 2024-09-22T08:11:05.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x7f70bc014070 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a6cc0 con 0x5635bc1a1a70 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a71a0 con 0x5635bc1a1a70 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 started sync module instance, tier type = 2024-09-22T08:11:05.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:05.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.619+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a6160 con 0x5635bc19d090 2024-09-22T08:11:05.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.620+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.620+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94788789102176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a6160 con 0x5635bc19d090 2024-09-22T08:11:05.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.620+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a7c60 con 0x5635bc198680 2024-09-22T08:11:05.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.621+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94788789102176] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.622+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.622+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94788789106544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a6160 con 0x5635bc198680 2024-09-22T08:11:05.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.622+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a8710 con 0x5635bc1a1a70 2024-09-22T08:11:05.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.623+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.623+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94788789109232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a8fb0 con 0x5635bc1a1a70 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.623+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a9a70 con 0x5635bc19d090 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.623+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94788789106544] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.624+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94788789109232] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.624+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.624+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94788789111552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a5cb0 con 0x5635bc19d090 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.624+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1aa380 con 0x5635bc198680 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.625+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.625+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94788789116560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1aa2f0 con 0x5635bc198680 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.625+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1ab2e0 con 0x7f70bc014070 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.625+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94788789111552] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.626+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94788789116560] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.626+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x7f70bc014070 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.626+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94788789114272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1ab2e0 con 0x7f70bc014070 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.626+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1aa850 con 0x7f70bc014070 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.627+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94788789114272] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x7f70bc014070 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.627+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x7f70bc014070 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.627+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94788789120448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1ab970 con 0x7f70bc014070 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.627+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1ac1c0 con 0x7f70bc014070 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.628+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x7f70bc014070 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.628+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94788789123920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1ac560 con 0x7f70bc014070 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.628+0000 7f70c5b42800 20 add_watcher() i=0 2024-09-22T08:11:05.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.628+0000 7f70c5b42800 20 add_watcher() i=1 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.628+0000 7f70c5b42800 20 add_watcher() i=2 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.628+0000 7f70c5b42800 20 add_watcher() i=3 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.628+0000 7f70c5b42800 20 add_watcher() i=4 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.628+0000 7f70c5b42800 20 add_watcher() i=5 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.628+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94788789120448] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x7f70bc014070 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.628+0000 7f70c5b42800 20 add_watcher() i=6 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.629+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94788789123920] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x7f70bc014070 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.629+0000 7f70c5b42800 20 add_watcher() i=7 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.629+0000 7f70c5b42800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.629+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1ab570 con 0x5635bc198680 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.629+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.629+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94788789125104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1ab570 con 0x5635bc198680 2024-09-22T08:11:05.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.630+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94788789125104] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.630+0000 7f6f737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.631+0000 7f70c5b42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.631+0000 7f70c5b42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.631+0000 7f70c5b42800 5 note: GC not initialized 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.631+0000 7f6f727fc640 20 reqs_thread_entry: start 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.631+0000 7f70c5b42800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.631+0000 7f70c5b42800 20 Filter name: none 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.631+0000 7f6ee3fff640 20 reqs_thread_entry: start 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.631+0000 7f70c5b42800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.631+0000 7f70c5b42800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.631+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1e2ac0 con 0x5635bc198680 2024-09-22T08:11:05.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.632+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.632+0000 7f70c5b42800 20 rados_obj.operate() r=0 bl.length=673 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.632+0000 7f70c5b42800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.632+0000 7f70c5b42800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.632+0000 7f70c5b42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.632+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1e95f0 con 0x5635bc198680 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f70c5b42800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f70c5b42800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f70c5b42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94788789375088 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1e4cd0 con 0x5635bc198680 2024-09-22T08:11:05.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 94788789116560 notify 137438953480 ret 0) ==== 800+0+0 (crc 0 0 0) 0x5635bc06c570 con 0x5635bc198680 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f6fa57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94788789116560 notifier 4402 bl.length()=758 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f6fa57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f6fa57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f6fa57fa640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6f84003ea0 con 0x5635bc198680 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(64 notify.4 [notify cookie 94788789375088 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.633+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 94788789375088 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f70ac05bce0 con 0x5635bc198680 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.634+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1e9070 con 0x5635bc198680 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.634+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.634+0000 7f70c5b42800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-22T08:11:05.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.634+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94788789375088 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1e4820 con 0x5635bc19d090 2024-09-22T08:11:05.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.635+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== watch-notify(notify (1) cookie 94788789102176 notify 137438953476 ret 0) ==== 201+0+0 (crc 0 0 0) 0x5635bc18dd60 con 0x5635bc19d090 2024-09-22T08:11:05.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.635+0000 7f6fa4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94788789102176 notifier 4402 bl.length()=159 2024-09-22T08:11:05.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.635+0000 7f6fa4ff9640 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6eec0032c0 con 0x5635bc19d090 2024-09-22T08:11:05.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.635+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [notify cookie 94788789375088 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.635+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.635+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== watch-notify(notify_complete (2) cookie 94788789375088 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5635bc18d3e0 con 0x5635bc19d090 2024-09-22T08:11:05.652 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-22T08:11:05.381799Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:05.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.636+0000 7f6f737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.636+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94788789125104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1e0800 con 0x5635bc198680 2024-09-22T08:11:05.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.637+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94788789125104] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.637+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94788789102176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1e0800 con 0x5635bc19d090 2024-09-22T08:11:05.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.638+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94788789102176] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.638+0000 7f70c5b42800 20 remove_watcher() i=0 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.638+0000 7f70c5b42800 2 removed watcher, disabling cache 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.638+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94788789106544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1e0800 con 0x5635bc198680 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.639+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94788789106544] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.639+0000 7f70c5b42800 20 remove_watcher() i=1 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.639+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94788789109232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1e0800 con 0x5635bc1a1a70 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.640+0000 7f70c18ed640 1 -- 172.21.15.165:0/3023001799 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94788789109232] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70b402d070 con 0x5635bc1a1a70 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.640+0000 7f70c5b42800 20 remove_watcher() i=2 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.640+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94788789111552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a7770 con 0x5635bc19d090 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.641+0000 7f70c20ee640 1 -- 172.21.15.165:0/3023001799 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94788789111552] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70bc05f040 con 0x5635bc19d090 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.641+0000 7f70c5b42800 20 remove_watcher() i=3 2024-09-22T08:11:05.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.641+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94788789116560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a81f0 con 0x5635bc198680 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.642+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94788789116560] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x5635bc198680 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.642+0000 7f70c5b42800 20 remove_watcher() i=4 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.642+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94788789114272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a8b00 con 0x7f70bc014070 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.643+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94788789114272] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x7f70bc014070 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.643+0000 7f70c5b42800 20 remove_watcher() i=5 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.643+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94788789120448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a7770 con 0x7f70bc014070 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.644+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94788789120448] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x7f70bc014070 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.644+0000 7f70c5b42800 20 remove_watcher() i=6 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.644+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94788789123920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635bc1a81f0 con 0x7f70bc014070 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94788789123920] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70ac0891c0 con 0x7f70bc014070 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 20 remove_watcher() i=7 2024-09-22T08:11:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f70bc014070 msgr2=0x7f70bc04d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f70bc014070 0x7f70bc04d480 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc198680 msgr2=0x5635bc19ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc198680 0x5635bc19ab40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc19d090 msgr2=0x5635bc19f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc19d090 0x5635bc19f480 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5635bc1a1a70 msgr2=0x5635bc1a3f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5635bc1a1a70 0x5635bc1a3f30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f8c03d000 msgr2=0x7f6f8c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f8c03d000 0x7f6f8c03f4c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70b400eab0 tx=0x7f70b4027000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 msgr2=0x5635bc18cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70bbfff640 1 -- 172.21.15.165:0/3023001799 reap_dead start 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc18cbf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0546f0 tx=0x7f70bc054720 comp rx=0 tx=0).stop 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 shutdown_connections 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/3023001799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0630f0 0x5635bc18cbf0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 >> 172.21.15.165:0/3023001799 conn(0x5635bc17f7b0 msgr2=0x5635bc17d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 shutdown_connections 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/3023001799 wait complete. 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/2541583119 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f9c03cfb0 msgr2=0x7f6f9c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/2541583119 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f9c03cfb0 0x7f6f9c03f470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5635bc15da10 tx=0x7f70b401b440 comp rx=0 tx=0).stop 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/2541583119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc176910 msgr2=0x5635bc176d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/2541583119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc176910 0x5635bc176d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5635bc15c970 tx=0x7f70bc018830 comp rx=0 tx=0).stop 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/2541583119 shutdown_connections 2024-09-22T08:11:05.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/2541583119 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6f9c03cfb0 0x7f6f9c03f470 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 --2- 172.21.15.165:0/2541583119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc176910 0x5635bc176d30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.645+0000 7f70c5b42800 1 -- 172.21.15.165:0/2541583119 >> 172.21.15.165:0/2541583119 conn(0x5635bc16acc0 msgr2=0x5635bc16b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 -- 172.21.15.165:0/2541583119 shutdown_connections 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 -- 172.21.15.165:0/2541583119 wait complete. 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc068c00 msgr2=0x5635bc162fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc068c00 0x5635bc162fc0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc165360 msgr2=0x5635bc1677d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc165360 0x5635bc1677d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6fa803cfb0 msgr2=0x7f6fa803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6fa803cfb0 0x7f6fa803f470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70ac057000 tx=0x7f70ac052000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 msgr2=0x5635bc15b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc15b970 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70b4000f60 tx=0x7f70b4000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 shutdown_connections 2024-09-22T08:11:05.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5635bc165360 0x5635bc1677d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5635bc068c00 0x5635bc162fc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6fa803cfb0 0x7f6fa803f470 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 --2- 172.21.15.165:0/1802787894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635bc0650f0 0x5635bc15b970 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 >> 172.21.15.165:0/1802787894 conn(0x5635bc05ebb0 msgr2=0x5635bc155310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 shutdown_connections 2024-09-22T08:11:05.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.646+0000 7f70c5b42800 1 -- 172.21.15.165:0/1802787894 wait complete. 2024-09-22T08:11:05.664 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-22T08:11:05.381799Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:05.665 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-22T08:11:05.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-22T08:11:05.665 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-22T08:11:05.709 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:05.709 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:05.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.709+0000 7f235562f800 1 Processor -- start 2024-09-22T08:11:05.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.709+0000 7f235562f800 1 -- start start 2024-09-22T08:11:05.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.709+0000 7f235562f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d700305ff0 0x55d7003083e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.709+0000 7f235562f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d700190a20 con 0x55d700308920 2024-09-22T08:11:05.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.709+0000 7f235562f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d7001907d0 con 0x55d700305ff0 2024-09-22T08:11:05.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.710+0000 7f2353120640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d700305ff0 0x55d7003083e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.710+0000 7f235291f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d700308920 0x55d70030ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33608/0 (socket says 172.21.15.165:33608) 2024-09-22T08:11:05.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.710+0000 7f235291f640 1 -- 172.21.15.165:0/2729002408 learned_addr learned my addr 172.21.15.165:0/2729002408 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:05.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.710+0000 7f2353120640 1 -- 172.21.15.165:0/2729002408 >> v1:172.21.15.53:6789/0 conn(0x55d700308920 legacy=0x55d70030ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.710+0000 7f2353120640 1 -- 172.21.15.165:0/2729002408 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70030d580 con 0x55d700305ff0 2024-09-22T08:11:05.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f2353120640 1 --2- 172.21.15.165:0/2729002408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003083e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f234400a470 tx=0x7f2344045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b63ffc756d0a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f235211e640 1 -- 172.21.15.165:0/2729002408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2344053570 con 0x55d700305ff0 2024-09-22T08:11:05.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f235211e640 1 -- 172.21.15.165:0/2729002408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2344058070 con 0x55d700305ff0 2024-09-22T08:11:05.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f235211e640 1 -- 172.21.15.165:0/2729002408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2344053880 con 0x55d700305ff0 2024-09-22T08:11:05.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f235562f800 1 -- 172.21.15.165:0/2729002408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 msgr2=0x55d7003083e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f235562f800 1 --2- 172.21.15.165:0/2729002408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003083e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f234400a470 tx=0x7f2344045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:05.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f235562f800 1 -- 172.21.15.165:0/2729002408 shutdown_connections 2024-09-22T08:11:05.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f235562f800 1 --2- 172.21.15.165:0/2729002408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003083e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f235562f800 1 -- 172.21.15.165:0/2729002408 >> 172.21.15.165:0/2729002408 conn(0x55d7002ffbb0 msgr2=0x55d700302010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f235562f800 1 -- 172.21.15.165:0/2729002408 shutdown_connections 2024-09-22T08:11:05.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.712+0000 7f235562f800 1 -- 172.21.15.165:0/2729002408 wait complete. 2024-09-22T08:11:05.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.726+0000 7f235562f800 1 Processor -- start 2024-09-22T08:11:05.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.726+0000 7f235562f800 1 -- start start 2024-09-22T08:11:05.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.727+0000 7f235562f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003f5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.727+0000 7f235562f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d70019ddd0 con 0x55d700305ff0 2024-09-22T08:11:05.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.727+0000 7f2353120640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.727+0000 7f2353120640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003f5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51688/0 (socket says 172.21.15.165:51688) 2024-09-22T08:11:05.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.727+0000 7f2353120640 1 -- 172.21.15.165:0/979688442 learned_addr learned my addr 172.21.15.165:0/979688442 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.727+0000 7f2353120640 1 -- 172.21.15.165:0/979688442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7003f5630 con 0x55d700305ff0 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.727+0000 7f2353120640 1 --2- 172.21.15.165:0/979688442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003f5040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2344025c20 tx=0x7f2344051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e5be32bcc039f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.728+0000 7f224160a640 1 -- 172.21.15.165:0/979688442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2344053a20 con 0x55d700305ff0 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.728+0000 7f224160a640 1 -- 172.21.15.165:0/979688442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2344063070 con 0x55d700305ff0 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.728+0000 7f224160a640 1 -- 172.21.15.165:0/979688442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2344053cf0 con 0x55d700305ff0 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.728+0000 7f235562f800 1 -- 172.21.15.165:0/979688442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 msgr2=0x55d7003f5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.728+0000 7f235562f800 1 --2- 172.21.15.165:0/979688442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003f5040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2344025c20 tx=0x7f2344051000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.728+0000 7f235562f800 1 -- 172.21.15.165:0/979688442 shutdown_connections 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.728+0000 7f235562f800 1 --2- 172.21.15.165:0/979688442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003f5040 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.728+0000 7f235562f800 1 -- 172.21.15.165:0/979688442 >> 172.21.15.165:0/979688442 conn(0x55d7002ffbb0 msgr2=0x55d7003f09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.728+0000 7f235562f800 1 -- 172.21.15.165:0/979688442 shutdown_connections 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.728+0000 7f235562f800 1 -- 172.21.15.165:0/979688442 wait complete. 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.729+0000 7f235562f800 1 Processor -- start 2024-09-22T08:11:05.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.729+0000 7f235562f800 1 -- start start 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.729+0000 7f235562f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.729+0000 7f235562f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d70030c820 con 0x55d700305ff0 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.729+0000 7f2353120640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.729+0000 7f2353120640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003fcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51694/0 (socket says 172.21.15.165:51694) 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.729+0000 7f2353120640 1 -- 172.21.15.165:0/3181261143 learned_addr learned my addr 172.21.15.165:0/3181261143 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.729+0000 7f2353120640 1 -- 172.21.15.165:0/3181261143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7003fd050 con 0x55d700305ff0 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.729+0000 7f2353120640 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003fcaf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2344025c20 tx=0x7f2344002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.730+0000 7f223fe07640 1 -- 172.21.15.165:0/3181261143 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2344068660 con 0x55d700305ff0 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.730+0000 7f223fe07640 1 -- 172.21.15.165:0/3181261143 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2344068800 con 0x55d700305ff0 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.730+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7003fd2e0 con 0x55d700305ff0 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.730+0000 7f223fe07640 1 -- 172.21.15.165:0/3181261143 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2344068ae0 con 0x55d700305ff0 2024-09-22T08:11:05.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.730+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7003fdef0 con 0x55d700305ff0 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.731+0000 7f223fe07640 1 -- 172.21.15.165:0/3181261143 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2344068c80 con 0x55d700305ff0 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.731+0000 7f223fe07640 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f223803cfb0 0x7f223803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.731+0000 7f223fe07640 1 -- 172.21.15.165:0/3181261143 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2344098da0 con 0x55d700305ff0 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.731+0000 7f235291f640 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f223803cfb0 0x7f223803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.731+0000 7f235562f800 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700308920 0x55d700404140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.731+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700404680 con 0x55d700308920 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.731+0000 7f2353921640 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700308920 0x55d700404140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.731+0000 7f235291f640 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f223803cfb0 0x7f223803f470 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2348001d70 tx=0x7f23480012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.731+0000 7f2353921640 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700308920 0x55d700404140 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.732+0000 7f2353921640 1 -- 172.21.15.165:0/3181261143 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f234c00a4d0 con 0x55d700308920 2024-09-22T08:11:05.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.732+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700404a20 con 0x55d700308920 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.732+0000 7f2353921640 1 -- 172.21.15.165:0/3181261143 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f234c00a4d0 con 0x55d700308920 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.732+0000 7f235562f800 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d7004064e0 0x55d700408980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.732+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700409110 con 0x55d7004064e0 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.732+0000 7f2353120640 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d7004064e0 0x55d700408980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.732+0000 7f2353120640 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d7004064e0 0x55d700408980 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.733+0000 7f2353120640 1 -- 172.21.15.165:0/3181261143 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2344051070 con 0x55d7004064e0 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.733+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700405270 con 0x55d700308920 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.733+0000 7f2353921640 1 -- 172.21.15.165:0/3181261143 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f234c00a4d0 con 0x55d700308920 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.733+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700405650 con 0x55d700308920 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.733+0000 7f2353921640 1 -- 172.21.15.165:0/3181261143 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f234c00a4d0 con 0x55d700308920 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.734+0000 7f235562f800 1 Processor -- start 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.734+0000 7f235562f800 1 -- start start 2024-09-22T08:11:05.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.734+0000 7f235562f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305790 0x55d700304000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.734+0000 7f235562f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7001fcd50 con 0x55d700305790 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.734+0000 7f2353921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305790 0x55d700304000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.734+0000 7f2353921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305790 0x55d700304000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51704/0 (socket says 172.21.15.165:51704) 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.734+0000 7f2353921640 1 -- 172.21.15.165:0/2930413594 learned_addr learned my addr 172.21.15.165:0/2930413594 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.735+0000 7f2353921640 1 -- 172.21.15.165:0/2930413594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d700305cb0 con 0x55d700305790 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.735+0000 7f2353921640 1 --2- 172.21.15.165:0/2930413594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305790 0x55d700304000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55d7003fdaf0 tx=0x7f234c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.735+0000 7f223d602640 1 -- 172.21.15.165:0/2930413594 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f234c014450 con 0x55d700305790 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.735+0000 7f223d602640 1 -- 172.21.15.165:0/2930413594 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f234c014610 con 0x55d700305790 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.735+0000 7f235562f800 1 -- 172.21.15.165:0/2930413594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d700304540 con 0x55d700305790 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.735+0000 7f223d602640 1 -- 172.21.15.165:0/2930413594 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f234c014930 con 0x55d700305790 2024-09-22T08:11:05.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.735+0000 7f235562f800 1 -- 172.21.15.165:0/2930413594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d700304a90 con 0x55d700305790 2024-09-22T08:11:05.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.736+0000 7f223d602640 1 -- 172.21.15.165:0/2930413594 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f234c011040 con 0x55d700305790 2024-09-22T08:11:05.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.736+0000 7f223d602640 1 --2- 172.21.15.165:0/2930413594 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f222c03d000 0x7f222c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.736+0000 7f223d602640 1 -- 172.21.15.165:0/2930413594 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f234c01e070 con 0x55d700305790 2024-09-22T08:11:05.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.736+0000 7f2353120640 1 --2- 172.21.15.165:0/2930413594 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f222c03d000 0x7f222c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.736+0000 7f235562f800 1 Processor -- start 2024-09-22T08:11:05.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.736+0000 7f2353120640 1 --2- 172.21.15.165:0/2930413594 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f222c03d000 0x7f222c03f4c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55d7003febc0 tx=0x7f234405da60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.736+0000 7f235562f800 1 -- start start 2024-09-22T08:11:05.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.736+0000 7f235562f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d700426b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.736+0000 7f235562f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7003f5a00 con 0x55d700426700 2024-09-22T08:11:05.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.737+0000 7f2353921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d700426b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.737+0000 7f2353921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d700426b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51718/0 (socket says 172.21.15.165:51718) 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.737+0000 7f2353921640 1 -- 172.21.15.165:0/2798218586 learned_addr learned my addr 172.21.15.165:0/2798218586 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.737+0000 7f2353921640 1 -- 172.21.15.165:0/2798218586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7004270f0 con 0x55d700426700 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.737+0000 7f2353921640 1 --2- 172.21.15.165:0/2798218586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d700426b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f234c018430 tx=0x7f234c014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd9cf716c1dbc9d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.737+0000 7f2236ffd640 1 -- 172.21.15.165:0/2798218586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f234c04b070 con 0x55d700426700 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.737+0000 7f2236ffd640 1 -- 172.21.15.165:0/2798218586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f234c051070 con 0x55d700426700 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.737+0000 7f2236ffd640 1 -- 172.21.15.165:0/2798218586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f234c011da0 con 0x55d700426700 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 -- 172.21.15.165:0/2798218586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 msgr2=0x55d700426b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 --2- 172.21.15.165:0/2798218586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d700426b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f234c018430 tx=0x7f234c014ea0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 -- 172.21.15.165:0/2798218586 shutdown_connections 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 --2- 172.21.15.165:0/2798218586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d700426b00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 -- 172.21.15.165:0/2798218586 >> 172.21.15.165:0/2798218586 conn(0x55d700422b00 msgr2=0x55d700420d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 -- 172.21.15.165:0/2798218586 shutdown_connections 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 -- 172.21.15.165:0/2798218586 wait complete. 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 Processor -- start 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 -- start start 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d70042dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f235562f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d700427710 con 0x55d700426700 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f2353921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d70042dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f2353921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d70042dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51728/0 (socket says 172.21.15.165:51728) 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.738+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 learned_addr learned my addr 172.21.15.165:0/19833718 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.739+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70042e270 con 0x55d700426700 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.739+0000 7f2353921640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d70042dd10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f234c02bfd0 tx=0x7f234c0546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.739+0000 7f22357fa640 1 -- 172.21.15.165:0/19833718 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f234c04b040 con 0x55d700426700 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.739+0000 7f22357fa640 1 -- 172.21.15.165:0/19833718 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f234c053320 con 0x55d700426700 2024-09-22T08:11:05.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.739+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d70042e500 con 0x55d700426700 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.739+0000 7f22357fa640 1 -- 172.21.15.165:0/19833718 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f234c0168f0 con 0x55d700426700 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.739+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d70042ee80 con 0x55d700426700 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.740+0000 7f22357fa640 1 -- 172.21.15.165:0/19833718 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f234c011330 con 0x55d700426700 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.740+0000 7f22357fa640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f221c03cfb0 0x7f221c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.740+0000 7f22357fa640 1 -- 172.21.15.165:0/19833718 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f234c00e040 con 0x55d700426700 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.740+0000 7f2353120640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f221c03cfb0 0x7f221c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.740+0000 7f2353120640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f221c03cfb0 0x7f221c03f470 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2344068fd0 tx=0x7f2344088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.740+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235562f800 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700439790 0x55d70043bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d70043c3a0 con 0x55d700439790 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235291f640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700439790 0x55d70043bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235291f640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700439790 0x55d70043bc50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2348009050 con 0x55d700439790 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235562f800 20 realm 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700438ae0 con 0x55d700439790 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2348009050 con 0x55d700439790 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235562f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.741+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d70043ce90 con 0x55d700439790 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2348009050 con 0x55d700439790 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f235562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d70043d760 con 0x55d700439790 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2348009050 con 0x55d700439790 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f235562f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f235562f800 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d70043e180 0x55d700440570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700440cb0 con 0x55d70043e180 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f2353921640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d70043e180 0x55d700440570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.742+0000 7f2353921640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d70043e180 0x55d700440570 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.743+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.743+0000 7f235562f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.743+0000 7f235562f800 20 searching for the correct realm 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.743+0000 7f235562f800 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d700442c60 0x55d700445120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.743+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700442c60 2024-09-22T08:11:05.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.743+0000 7f2353120640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d700442c60 0x55d700445120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.743+0000 7f2353120640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d700442c60 0x55d700445120 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.743+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.743+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d70043e180 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.744+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.744+0000 7f2353921640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f234c037070 0x7f234c04d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.744+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x7f234c037070 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.744+0000 7f235291f640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f234c037070 0x7f234c04d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.744+0000 7f235291f640 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f234c037070 0x7f234c04d770 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.745+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348009050 con 0x7f234c037070 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.745+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700439790 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.745+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348009050 con 0x55d700439790 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.745+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700439790 2024-09-22T08:11:05.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.745+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.745+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x7f234c037070 2024-09-22T08:11:05.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.745+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.745+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x7f234c037070 2024-09-22T08:11:05.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.745+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.745+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d70043e180 2024-09-22T08:11:05.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.746+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.746+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700442c60 2024-09-22T08:11:05.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.746+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.746+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700439790 2024-09-22T08:11:05.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.746+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.746+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x7f234c037070 2024-09-22T08:11:05.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.746+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.746+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700439790 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.747+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.747+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d70043e180 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.747+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.747+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700442c60 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.747+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.747+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700442c60 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.747+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.747+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x7f234c037070 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.748+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.748+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700442c60 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.748+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.748+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700442c60 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.748+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.748+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700439790 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.748+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.748+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700439790 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.749+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.749+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x7f234c037070 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.749+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.749+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700442c60 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.749+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.749+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d70043e180 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.749+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.749+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700439790 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.749+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.750+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x7f234c037070 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.750+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.750+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700442c60 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.750+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.750+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x7f234c037070 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.750+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.750+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d70043e180 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.750+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.750+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700442c60 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.751+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.751+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x7f234c037070 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.751+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.751+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d700439790 2024-09-22T08:11:05.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.751+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.751+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7004457a0 con 0x55d70043e180 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700441670 con 0x55d700439790 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700441f10 con 0x55d700439790 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700445c20 con 0x55d700439790 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.752+0000 7f235562f800 20 zone default found 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 4 Realm: () 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:05.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 20 zonegroup default 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700446030 con 0x7f234c037070 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700447e60 con 0x55d700442c60 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700448340 con 0x55d700442c60 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 20 started sync module instance, tier type = 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.753+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700447300 con 0x55d70043e180 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.754+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.754+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94381910816496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700448c50 con 0x55d70043e180 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.754+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7004494a0 con 0x55d700439790 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.755+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94381910816496] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.756+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.756+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94381910820768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700449110 con 0x55d700439790 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.756+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700449c30 con 0x55d700442c60 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.757+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94381910820768] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.757+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.757+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94381910824704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044a020 con 0x55d700442c60 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.757+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044aa40 con 0x55d70043e180 2024-09-22T08:11:05.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.758+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.758+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94381910828336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044b2e0 con 0x55d70043e180 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.758+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044bdc0 con 0x55d700439790 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.758+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94381910824704] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.759+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.759+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94381910833360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044bdc0 con 0x55d700439790 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.759+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044c7d0 con 0x7f234c037070 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.759+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94381910828336] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.760+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94381910833360] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.760+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.760+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94381910821824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044c320 con 0x7f234c037070 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.760+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044d070 con 0x7f234c037070 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.761+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94381910821824] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.761+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.761+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94381910830640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044ce70 con 0x7f234c037070 2024-09-22T08:11:05.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.761+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044d6c0 con 0x7f234c037070 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.762+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94381910830640] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.762+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.762+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94381910838176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044d4f0 con 0x7f234c037070 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.762+0000 7f235562f800 20 add_watcher() i=0 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.762+0000 7f235562f800 20 add_watcher() i=1 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.762+0000 7f235562f800 20 add_watcher() i=2 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.762+0000 7f235562f800 20 add_watcher() i=3 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.762+0000 7f235562f800 20 add_watcher() i=4 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.762+0000 7f235562f800 20 add_watcher() i=5 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.762+0000 7f235562f800 20 add_watcher() i=6 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.763+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94381910838176] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.763+0000 7f235562f800 20 add_watcher() i=7 2024-09-22T08:11:05.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.763+0000 7f235562f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.763+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700450b20 con 0x55d700439790 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.763+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.764+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94381910839232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70044deb0 con 0x55d700439790 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.764+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94381910839232] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f2209fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f235562f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f235562f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f235562f800 5 note: GC not initialized 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f2208fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f235562f800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f235562f800 20 Filter name: none 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f21827fc640 20 reqs_thread_entry: start 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f235562f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:05.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f235562f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.765+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700483ea0 con 0x55d700439790 2024-09-22T08:11:05.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.766+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.766+0000 7f235562f800 20 rados_obj.operate() r=0 bl.length=582 2024-09-22T08:11:05.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.766+0000 7f235562f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:05.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.766+0000 7f235562f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.766+0000 7f235562f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:05.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.766+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d70048a4c0 con 0x55d700439790 2024-09-22T08:11:05.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f235562f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:05.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f235562f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f235562f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:05.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94381911088832 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d700485e30 con 0x55d700439790 2024-09-22T08:11:05.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 94381910833360 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55d700190a20 con 0x55d700439790 2024-09-22T08:11:05.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f2236ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94381910833360 notifier 4409 bl.length()=732 2024-09-22T08:11:05.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f2236ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:05.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f2236ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(64 notify.4 [notify cookie 94381911088832 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f2236ffd640 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2218003ea0 con 0x55d700439790 2024-09-22T08:11:05.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.767+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.768+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 94381911088832 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f234802f5c0 con 0x55d700439790 2024-09-22T08:11:05.779 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-22T08:11:05.381799Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:05.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.768+0000 7f2209fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.768+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94381910839232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700481c00 con 0x55d700439790 2024-09-22T08:11:05.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.769+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94381910839232] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.769+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94381910816496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700481c00 con 0x55d70043e180 2024-09-22T08:11:05.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.770+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94381910816496] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.770+0000 7f235562f800 20 remove_watcher() i=0 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.770+0000 7f235562f800 2 removed watcher, disabling cache 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.770+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94381910820768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700481c00 con 0x55d700439790 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.772+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94381910820768] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.772+0000 7f235562f800 20 remove_watcher() i=1 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.772+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94381910824704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700481c00 con 0x55d700442c60 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.773+0000 7f2353120640 1 -- 172.21.15.165:0/19833718 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94381910824704] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2344051070 con 0x55d700442c60 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.773+0000 7f235562f800 20 remove_watcher() i=2 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.773+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94381910828336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700481c00 con 0x55d70043e180 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.774+0000 7f2353921640 1 -- 172.21.15.165:0/19833718 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94381910828336] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f234c02a070 con 0x55d70043e180 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.774+0000 7f235562f800 20 remove_watcher() i=3 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.774+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94381910833360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700481c00 con 0x55d700439790 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.775+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94381910833360] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x55d700439790 2024-09-22T08:11:05.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.775+0000 7f235562f800 20 remove_watcher() i=4 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.775+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94381910821824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700481c00 con 0x7f234c037070 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.776+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94381910821824] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.776+0000 7f235562f800 20 remove_watcher() i=5 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.776+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94381910830640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700481c00 con 0x7f234c037070 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.776+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94381910830640] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.777+0000 7f235562f800 20 remove_watcher() i=6 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.777+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94381910838176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d700481c00 con 0x7f234c037070 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.777+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94381910838176] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2348029040 con 0x7f234c037070 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.777+0000 7f235562f800 20 remove_watcher() i=7 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f234c037070 msgr2=0x7f234c04d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f234c037070 0x7f234c04d770 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700439790 msgr2=0x55d70043bc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700439790 0x55d70043bc50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d70043e180 msgr2=0x55d700440570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d70043e180 0x55d700440570 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d700442c60 msgr2=0x55d700445120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d700442c60 0x55d700445120 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f221c03cfb0 msgr2=0x7f221c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f221c03cfb0 0x7f221c03f470 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2344068fd0 tx=0x7f2344088000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 msgr2=0x55d70042dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d70042dd10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f234c02bfd0 tx=0x7f234c0546a0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235291f640 1 -- 172.21.15.165:0/19833718 reap_dead start 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 shutdown_connections 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/19833718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700426700 0x55d70042dd10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 >> 172.21.15.165:0/19833718 conn(0x55d700422b00 msgr2=0x55d700420d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 shutdown_connections 2024-09-22T08:11:05.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/19833718 wait complete. 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/2930413594 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f222c03d000 msgr2=0x7f222c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/2930413594 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f222c03d000 0x7f222c03f4c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55d7003febc0 tx=0x7f234405da60 comp rx=0 tx=0).stop 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/2930413594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305790 msgr2=0x55d700304000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/2930413594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305790 0x55d700304000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55d7003fdaf0 tx=0x7f234c018830 comp rx=0 tx=0).stop 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/2930413594 shutdown_connections 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/2930413594 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f222c03d000 0x7f222c03f4c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 --2- 172.21.15.165:0/2930413594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305790 0x55d700304000 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/2930413594 >> 172.21.15.165:0/2930413594 conn(0x55d70040be70 msgr2=0x55d70040c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/2930413594 shutdown_connections 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.778+0000 7f235562f800 1 -- 172.21.15.165:0/2930413594 wait complete. 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700308920 msgr2=0x55d700404140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700308920 0x55d700404140 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d7004064e0 msgr2=0x55d700408980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d7004064e0 0x55d700408980 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f223803cfb0 msgr2=0x7f223803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f223803cfb0 0x7f223803f470 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2348001d70 tx=0x7f23480012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 msgr2=0x55d7003fcaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003fcaf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2344025c20 tx=0x7f2344002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 shutdown_connections 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d7004064e0 0x55d700408980 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d700308920 0x55d700404140 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f223803cfb0 0x7f223803f470 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 --2- 172.21.15.165:0/3181261143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d700305ff0 0x55d7003fcaf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 >> 172.21.15.165:0/3181261143 conn(0x55d7002ffbb0 msgr2=0x55d7003ef1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 shutdown_connections 2024-09-22T08:11:05.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.779+0000 7f235562f800 1 -- 172.21.15.165:0/3181261143 wait complete. 2024-09-22T08:11:05.789 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-22T08:11:05.381799Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:05.789 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-22T08:11:05.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-22T08:11:05.790 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-22T08:11:05.837 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:05.837 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:05.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.837+0000 7fcb57f23800 1 Processor -- start 2024-09-22T08:11:05.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.837+0000 7fcb57f23800 1 -- start start 2024-09-22T08:11:05.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.838+0000 7fcb57f23800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56075eb54bb0 0x56075eb56fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.838+0000 7fcb57f23800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56075e9dba20 con 0x56075eb510a0 2024-09-22T08:11:05.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.838+0000 7fcb57f23800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56075e9db7d0 con 0x56075eb54bb0 2024-09-22T08:11:05.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.838+0000 7fcb4b443640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56075eb54bb0 0x56075eb56fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.838+0000 7fcb53c44640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56075eb510a0 0x56075eb53490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33620/0 (socket says 172.21.15.165:33620) 2024-09-22T08:11:05.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.838+0000 7fcb53c44640 1 -- 172.21.15.165:0/3084320343 learned_addr learned my addr 172.21.15.165:0/3084320343 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:05.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.838+0000 7fcb4b443640 1 -- 172.21.15.165:0/3084320343 >> v1:172.21.15.53:6789/0 conn(0x56075eb510a0 legacy=0x56075eb53490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.838+0000 7fcb4b443640 1 -- 172.21.15.165:0/3084320343 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075eb58580 con 0x56075eb54bb0 2024-09-22T08:11:05.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.840+0000 7fcb4b443640 1 --2- 172.21.15.165:0/3084320343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb54bb0 0x56075eb56fa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00a470 tx=0x7fcb3c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36169e5fb595a288 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.840+0000 7fcb53443640 1 -- 172.21.15.165:0/3084320343 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c053570 con 0x56075eb54bb0 2024-09-22T08:11:05.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.840+0000 7fcb53443640 1 -- 172.21.15.165:0/3084320343 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c058070 con 0x56075eb54bb0 2024-09-22T08:11:05.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.840+0000 7fcb53443640 1 -- 172.21.15.165:0/3084320343 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c053880 con 0x56075eb54bb0 2024-09-22T08:11:05.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.841+0000 7fcb57f23800 1 -- 172.21.15.165:0/3084320343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb54bb0 msgr2=0x56075eb56fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.841+0000 7fcb57f23800 1 --2- 172.21.15.165:0/3084320343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb54bb0 0x56075eb56fa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00a470 tx=0x7fcb3c045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:05.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.841+0000 7fcb57f23800 1 -- 172.21.15.165:0/3084320343 shutdown_connections 2024-09-22T08:11:05.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.841+0000 7fcb57f23800 1 --2- 172.21.15.165:0/3084320343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb54bb0 0x56075eb56fa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.841+0000 7fcb57f23800 1 -- 172.21.15.165:0/3084320343 >> 172.21.15.165:0/3084320343 conn(0x56075eb4ac00 msgr2=0x56075eb4d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.841+0000 7fcb57f23800 1 -- 172.21.15.165:0/3084320343 shutdown_connections 2024-09-22T08:11:05.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.841+0000 7fcb57f23800 1 -- 172.21.15.165:0/3084320343 wait complete. 2024-09-22T08:11:05.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.855+0000 7fcb57f23800 1 Processor -- start 2024-09-22T08:11:05.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.855+0000 7fcb57f23800 1 -- start start 2024-09-22T08:11:05.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.855+0000 7fcb57f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec40020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.855+0000 7fcb57f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56075e9e8dd0 con 0x56075eb510a0 2024-09-22T08:11:05.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.855+0000 7fcb53c44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec40020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.855+0000 7fcb53c44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec40020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51738/0 (socket says 172.21.15.165:51738) 2024-09-22T08:11:05.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.855+0000 7fcb53c44640 1 -- 172.21.15.165:0/506748462 learned_addr learned my addr 172.21.15.165:0/506748462 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.856+0000 7fcb53c44640 1 -- 172.21.15.165:0/506748462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075ec40610 con 0x56075eb510a0 2024-09-22T08:11:05.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.856+0000 7fcb53c44640 1 --2- 172.21.15.165:0/506748462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec40020 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcb44001e40 tx=0x7fcb44001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5792f34d8323999 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.856+0000 7fca41e0b640 1 -- 172.21.15.165:0/506748462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb44012020 con 0x56075eb510a0 2024-09-22T08:11:05.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.856+0000 7fca41e0b640 1 -- 172.21.15.165:0/506748462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4400e5a0 con 0x56075eb510a0 2024-09-22T08:11:05.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.856+0000 7fca41e0b640 1 -- 172.21.15.165:0/506748462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4400e8a0 con 0x56075eb510a0 2024-09-22T08:11:05.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 -- 172.21.15.165:0/506748462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 msgr2=0x56075ec40020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 --2- 172.21.15.165:0/506748462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec40020 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcb44001e40 tx=0x7fcb44001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:05.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 -- 172.21.15.165:0/506748462 shutdown_connections 2024-09-22T08:11:05.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 --2- 172.21.15.165:0/506748462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec40020 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 -- 172.21.15.165:0/506748462 >> 172.21.15.165:0/506748462 conn(0x56075eb4ac00 msgr2=0x56075ec3b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 -- 172.21.15.165:0/506748462 shutdown_connections 2024-09-22T08:11:05.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 -- 172.21.15.165:0/506748462 wait complete. 2024-09-22T08:11:05.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 Processor -- start 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 -- start start 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec47b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb57f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56075eb57870 con 0x56075eb510a0 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb53c44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec47b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb53c44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec47b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51750/0 (socket says 172.21.15.165:51750) 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.857+0000 7fcb53c44640 1 -- 172.21.15.165:0/2460462716 learned_addr learned my addr 172.21.15.165:0/2460462716 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.858+0000 7fcb53c44640 1 -- 172.21.15.165:0/2460462716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075ec48090 con 0x56075eb510a0 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.858+0000 7fcb53c44640 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec47b30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcb440012b0 tx=0x7fcb44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.858+0000 7fca3bfff640 1 -- 172.21.15.165:0/2460462716 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb44012030 con 0x56075eb510a0 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.858+0000 7fca3bfff640 1 -- 172.21.15.165:0/2460462716 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4401a750 con 0x56075eb510a0 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.858+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56075ec48320 con 0x56075eb510a0 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.858+0000 7fca3bfff640 1 -- 172.21.15.165:0/2460462716 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4401aa70 con 0x56075eb510a0 2024-09-22T08:11:05.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.858+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56075ec48d20 con 0x56075eb510a0 2024-09-22T08:11:05.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.859+0000 7fca3bfff640 1 -- 172.21.15.165:0/2460462716 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcb44015020 con 0x56075eb510a0 2024-09-22T08:11:05.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.859+0000 7fca3bfff640 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca3c03d000 0x7fca3c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.859+0000 7fca3bfff640 1 -- 172.21.15.165:0/2460462716 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcb44020030 con 0x56075eb510a0 2024-09-22T08:11:05.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.859+0000 7fcb4b443640 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca3c03d000 0x7fca3c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.859+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075eb54bb0 0x56075ec4f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.859+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec4f6c0 con 0x56075eb54bb0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.860+0000 7fcb54445640 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075eb54bb0 0x56075ec4f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.860+0000 7fcb4b443640 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca3c03d000 0x7fca3c03f4c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c057000 tx=0x7fcb3c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.860+0000 7fcb54445640 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075eb54bb0 0x56075ec4f180 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.860+0000 7fcb54445640 1 -- 172.21.15.165:0/2460462716 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4c00a4d0 con 0x56075eb54bb0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.860+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec4fa60 con 0x56075eb54bb0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.860+0000 7fcb54445640 1 -- 172.21.15.165:0/2460462716 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb4c00a4d0 con 0x56075eb54bb0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.861+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec51520 0x56075ec539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.861+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec54130 con 0x56075ec51520 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.861+0000 7fcb53c44640 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec51520 0x56075ec539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.861+0000 7fcb53c44640 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec51520 0x56075ec539a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.861+0000 7fcb53c44640 1 -- 172.21.15.165:0/2460462716 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb44051040 con 0x56075ec51520 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.861+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec502b0 con 0x56075eb54bb0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.862+0000 7fcb54445640 1 -- 172.21.15.165:0/2460462716 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb4c00a4d0 con 0x56075eb54bb0 2024-09-22T08:11:05.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.862+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec50650 con 0x56075eb54bb0 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.862+0000 7fcb54445640 1 -- 172.21.15.165:0/2460462716 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb4c00a4d0 con 0x56075eb54bb0 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.862+0000 7fcb57f23800 1 Processor -- start 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.862+0000 7fcb57f23800 1 -- start start 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.862+0000 7fcb57f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb50820 0x56075eb4f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.862+0000 7fcb57f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56075ea47d50 con 0x56075eb50820 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.862+0000 7fcb54445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb50820 0x56075eb4f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.863+0000 7fcb54445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb50820 0x56075eb4f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51764/0 (socket says 172.21.15.165:51764) 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.863+0000 7fcb54445640 1 -- 172.21.15.165:0/1489434595 learned_addr learned my addr 172.21.15.165:0/1489434595 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.863+0000 7fcb54445640 1 -- 172.21.15.165:0/1489434595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075eb50d40 con 0x56075eb50820 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.863+0000 7fcb54445640 1 --2- 172.21.15.165:0/1489434595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb50820 0x56075eb4f090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x56075ec48b30 tx=0x7fcb4c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.863+0000 7fca397fa640 1 -- 172.21.15.165:0/1489434595 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c014450 con 0x56075eb50820 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.863+0000 7fca397fa640 1 -- 172.21.15.165:0/1489434595 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c014610 con 0x56075eb50820 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.863+0000 7fcb57f23800 1 -- 172.21.15.165:0/1489434595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56075eb4f5d0 con 0x56075eb50820 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.863+0000 7fca397fa640 1 -- 172.21.15.165:0/1489434595 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c014930 con 0x56075eb50820 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.863+0000 7fcb57f23800 1 -- 172.21.15.165:0/1489434595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56075eb4fb70 con 0x56075eb50820 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.864+0000 7fca397fa640 1 -- 172.21.15.165:0/1489434595 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcb4c011040 con 0x56075eb50820 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.864+0000 7fca397fa640 1 --2- 172.21.15.165:0/1489434595 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca2c03d000 0x7fca2c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.864+0000 7fca397fa640 1 -- 172.21.15.165:0/1489434595 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcb4c01e070 con 0x56075eb50820 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.864+0000 7fcb53c44640 1 --2- 172.21.15.165:0/1489434595 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca2c03d000 0x7fca2c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.864+0000 7fcb57f23800 1 Processor -- start 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.865+0000 7fcb53c44640 1 --2- 172.21.15.165:0/1489434595 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca2c03d000 0x7fca2c03f4c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcb44052bf0 tx=0x7fcb44052ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.865+0000 7fcb57f23800 1 -- start start 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.865+0000 7fcb57f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec71b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.865+0000 7fcb57f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56075ec40a40 con 0x56075ec71700 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.865+0000 7fcb54445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec71b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.865+0000 7fcb54445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec71b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51780/0 (socket says 172.21.15.165:51780) 2024-09-22T08:11:05.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.865+0000 7fcb54445640 1 -- 172.21.15.165:0/2621078185 learned_addr learned my addr 172.21.15.165:0/2621078185 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.865+0000 7fcb54445640 1 -- 172.21.15.165:0/2621078185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075ec720f0 con 0x56075ec71700 2024-09-22T08:11:05.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.865+0000 7fcb54445640 1 --2- 172.21.15.165:0/2621078185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec71b00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0546e0 tx=0x7fcb4c02b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992b7af0867d03ad server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.865+0000 7fca32ffd640 1 -- 172.21.15.165:0/2621078185 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c011da0 con 0x56075ec71700 2024-09-22T08:11:05.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fca32ffd640 1 -- 172.21.15.165:0/2621078185 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c053280 con 0x56075ec71700 2024-09-22T08:11:05.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fca32ffd640 1 -- 172.21.15.165:0/2621078185 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c0167c0 con 0x56075ec71700 2024-09-22T08:11:05.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 -- 172.21.15.165:0/2621078185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 msgr2=0x56075ec71b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2621078185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec71b00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0546e0 tx=0x7fcb4c02b4c0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 -- 172.21.15.165:0/2621078185 shutdown_connections 2024-09-22T08:11:05.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2621078185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec71b00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 -- 172.21.15.165:0/2621078185 >> 172.21.15.165:0/2621078185 conn(0x56075ec6db20 msgr2=0x56075ec6bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 -- 172.21.15.165:0/2621078185 shutdown_connections 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 -- 172.21.15.165:0/2621078185 wait complete. 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 Processor -- start 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 -- start start 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec78cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.866+0000 7fcb57f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56075ec72710 con 0x56075ec71700 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.867+0000 7fcb54445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec78cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.867+0000 7fcb54445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec78cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51796/0 (socket says 172.21.15.165:51796) 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.867+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 learned_addr learned my addr 172.21.15.165:0/2498896519 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.867+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075ec79250 con 0x56075ec71700 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.867+0000 7fcb54445640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec78cf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c044040 tx=0x7fcb4c054670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.867+0000 7fca317fa640 1 -- 172.21.15.165:0/2498896519 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c0168f0 con 0x56075ec71700 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.867+0000 7fca317fa640 1 -- 172.21.15.165:0/2498896519 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c014ad0 con 0x56075ec71700 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.867+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56075ec794e0 con 0x56075ec71700 2024-09-22T08:11:05.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.867+0000 7fca317fa640 1 -- 172.21.15.165:0/2498896519 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c045150 con 0x56075ec71700 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.867+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56075ec79e60 con 0x56075ec71700 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.868+0000 7fca317fa640 1 -- 172.21.15.165:0/2498896519 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcb4c034030 con 0x56075ec71700 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.868+0000 7fca317fa640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca1c03d000 0x7fca1c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.868+0000 7fca317fa640 1 -- 172.21.15.165:0/2498896519 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcb4c032070 con 0x56075ec71700 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.868+0000 7fcb53c44640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca1c03d000 0x7fca1c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.869+0000 7fcb53c44640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca1c03d000 0x7fca1c03f4c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcb4404d3f0 tx=0x7fcb44033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.869+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.869+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075ec847f0 0x56075ec86cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.869+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec87400 con 0x56075ec847f0 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.869+0000 7fcb4b443640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075ec847f0 0x56075ec86cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.869+0000 7fcb4b443640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075ec847f0 0x56075ec86cb0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.869+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 20 realm 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec87830 con 0x56075ec847f0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec88100 con 0x56075ec847f0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec884a0 con 0x56075ec847f0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec89200 0x56075ec8b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec8bc00 con 0x56075ec89200 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.870+0000 7fcb54445640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec89200 0x56075ec8b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.871+0000 7fcb54445640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec89200 0x56075ec8b5f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.871+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.871+0000 7fcb57f23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.871+0000 7fcb57f23800 20 searching for the correct realm 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.871+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56075ec8dbb0 0x56075ec90070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.871+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec8dbb0 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.871+0000 7fcb53c44640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56075ec8dbb0 0x56075ec90070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.871+0000 7fcb53c44640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56075ec8dbb0 0x56075ec90070 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.872+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.872+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec89200 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.872+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.872+0000 7fcb54445640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcb4c014070 0x7fcb4c04d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.872+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x7fcb4c014070 2024-09-22T08:11:05.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.872+0000 7fcb4b443640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcb4c014070 0x7fcb4c04d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.873+0000 7fcb4b443640 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcb4c014070 0x7fcb4c04d260 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.873+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.873+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec847f0 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.873+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.873+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec847f0 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.873+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.873+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x7fcb4c014070 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.874+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.874+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x7fcb4c014070 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.874+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.874+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec89200 2024-09-22T08:11:05.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.874+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.874+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec8dbb0 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.874+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.874+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec847f0 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.874+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.874+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x7fcb4c014070 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.875+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.875+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec847f0 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.875+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.875+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec89200 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.875+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.875+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec8dbb0 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.875+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.875+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec8dbb0 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.876+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.876+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x7fcb4c014070 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.876+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.876+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec8dbb0 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.876+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.876+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec8dbb0 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.876+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.876+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec847f0 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.877+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.877+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec847f0 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.877+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.877+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x7fcb4c014070 2024-09-22T08:11:05.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.877+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.877+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec8dbb0 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.877+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.877+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec89200 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.878+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.878+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec847f0 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.878+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.878+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x7fcb4c014070 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.878+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.878+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec8dbb0 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.878+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.878+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x7fcb4c014070 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.878+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.879+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec89200 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.879+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.879+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec8dbb0 2024-09-22T08:11:05.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.879+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.879+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x7fcb4c014070 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.879+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.879+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec847f0 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.879+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.879+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56075ec906f0 con 0x56075ec89200 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:05.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec8c5f0 con 0x56075ec847f0 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec8ce90 con 0x56075ec847f0 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec90b70 con 0x56075ec847f0 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 zone default found 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 4 Realm: () 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:05.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 zonegroup default 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.880+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec90f70 con 0x7fcb4c014070 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb57f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec92dd0 con 0x56075ec8dbb0 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb57f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec932b0 con 0x56075ec8dbb0 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb57f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:05.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb57f23800 20 started sync module instance, tier type = 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb57f23800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.881+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec92240 con 0x56075ec89200 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.882+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.882+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94589655000672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec91ea0 con 0x56075ec89200 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.882+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec941e0 con 0x56075ec847f0 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.883+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94589655000672] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.884+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.884+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94589655004944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec941e0 con 0x56075ec847f0 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.884+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec94be0 con 0x56075ec8dbb0 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.885+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94589655004944] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.885+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.885+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94589655006512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec94150 con 0x56075ec8dbb0 2024-09-22T08:11:05.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.885+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec95aa0 con 0x56075ec89200 2024-09-22T08:11:05.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.886+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94589655006512] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.886+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.886+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94589655012848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec95ec0 con 0x56075ec89200 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.886+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec96880 con 0x56075ec847f0 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.887+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.887+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94589655016400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec96ca0 con 0x56075ec847f0 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.887+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec97760 con 0x7fcb4c014070 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.887+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94589655012848] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.888+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94589655016400] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.888+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.888+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94589655020176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec967f0 con 0x7fcb4c014070 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.888+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec98030 con 0x7fcb4c014070 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.889+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94589655020176] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.889+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.889+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94589655013904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec967f0 con 0x7fcb4c014070 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.889+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec985d0 con 0x7fcb4c014070 2024-09-22T08:11:05.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.890+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.890+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94589655023808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec98a40 con 0x7fcb4c014070 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.890+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94589655013904] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.890+0000 7fcb57f23800 20 add_watcher() i=0 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.890+0000 7fcb57f23800 20 add_watcher() i=1 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.890+0000 7fcb57f23800 20 add_watcher() i=2 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.890+0000 7fcb57f23800 20 add_watcher() i=3 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.890+0000 7fcb57f23800 20 add_watcher() i=4 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.890+0000 7fcb57f23800 20 add_watcher() i=5 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.890+0000 7fcb57f23800 20 add_watcher() i=6 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.891+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94589655023808] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.891+0000 7fcb57f23800 20 add_watcher() i=7 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.891+0000 7fcb57f23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.891+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ec9bec0 con 0x56075ec847f0 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.891+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.891+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94589655025040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec99340 con 0x56075ec847f0 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.892+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94589655025040] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.892+0000 7fca09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.892+0000 7fcb57f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.892+0000 7fcb57f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.892+0000 7fcb57f23800 5 note: GC not initialized 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.892+0000 7fca08fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb57f23800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb57f23800 20 Filter name: none 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fc9827fc640 20 reqs_thread_entry: start 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb57f23800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb57f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ecceef0 con 0x56075ec847f0 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb57f23800 20 rados_obj.operate() r=0 bl.length=556 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb57f23800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb57f23800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb57f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.893+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ecd55a0 con 0x56075ec847f0 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fcb57f23800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fcb57f23800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fcb57f23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94589655273440 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ecd0ce0 con 0x56075ec847f0 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 94589655016400 notify 137438953482 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fcb3c082040 con 0x56075ec847f0 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fca32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94589655016400 notifier 4416 bl.length()=567 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fca32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fca32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:05.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fca32ffd640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fca18003ea0 con 0x56075ec847f0 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(64 notify.4 [notify cookie 94589655273440 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 94589655273440 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56075eb58580 con 0x56075ec847f0 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.895+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ecd4fe0 con 0x56075ec89200 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.896+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.896+0000 7fcb57f23800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.896+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94589655273440 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56075ecd0830 con 0x56075ec89200 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.897+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== watch-notify(notify (1) cookie 94589655000672 notify 137438953477 ret 0) ==== 201+0+0 (crc 0 0 0) 0x56075ec79e60 con 0x56075ec89200 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.897+0000 7fca327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94589655000672 notifier 4416 bl.length()=159 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.897+0000 7fca327fc640 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc9880032c0 con 0x56075ec89200 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.897+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(67 notify.0 [notify cookie 94589655273440 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.897+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.897+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== watch-notify(notify_complete (2) cookie 94589655273440 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56075ec794e0 con 0x56075ec89200 2024-09-22T08:11:05.904 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:05.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.898+0000 7fca09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:05.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.898+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94589655025040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ecccbf0 con 0x56075ec847f0 2024-09-22T08:11:05.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.899+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94589655025040] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.899+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94589655000672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ecccbf0 con 0x56075ec89200 2024-09-22T08:11:05.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.900+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94589655000672] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.900+0000 7fcb57f23800 20 remove_watcher() i=0 2024-09-22T08:11:05.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.900+0000 7fcb57f23800 2 removed watcher, disabling cache 2024-09-22T08:11:05.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.900+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94589655004944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ecccbf0 con 0x56075ec847f0 2024-09-22T08:11:05.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.901+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94589655004944] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.901+0000 7fcb57f23800 20 remove_watcher() i=1 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.901+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94589655006512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ecccbf0 con 0x56075ec8dbb0 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.902+0000 7fcb53c44640 1 -- 172.21.15.165:0/2498896519 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94589655006512] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb44046d70 con 0x56075ec8dbb0 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.902+0000 7fcb57f23800 20 remove_watcher() i=2 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.902+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94589655012848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ecd0ce0 con 0x56075ec89200 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.903+0000 7fcb54445640 1 -- 172.21.15.165:0/2498896519 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94589655012848] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c02a070 con 0x56075ec89200 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.903+0000 7fcb57f23800 20 remove_watcher() i=3 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.903+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94589655016400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec92660 con 0x56075ec847f0 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.904+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94589655016400] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x56075ec847f0 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.904+0000 7fcb57f23800 20 remove_watcher() i=4 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.904+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94589655020176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec93d30 con 0x7fcb4c014070 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.905+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94589655020176] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.905+0000 7fcb57f23800 20 remove_watcher() i=5 2024-09-22T08:11:05.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.905+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94589655013904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec955f0 con 0x7fcb4c014070 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.906+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94589655013904] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.906+0000 7fcb57f23800 20 remove_watcher() i=6 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.906+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94589655023808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56075ec963d0 con 0x7fcb4c014070 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.906+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94589655023808] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb4c014070 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 20 remove_watcher() i=7 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcb4c014070 msgr2=0x7fcb4c04d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcb4c014070 0x7fcb4c04d260 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075ec847f0 msgr2=0x56075ec86cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075ec847f0 0x56075ec86cb0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec89200 msgr2=0x56075ec8b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec89200 0x56075ec8b5f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56075ec8dbb0 msgr2=0x56075ec90070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56075ec8dbb0 0x56075ec90070 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca1c03d000 msgr2=0x7fca1c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca1c03d000 0x7fca1c03f4c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcb4404d3f0 tx=0x7fcb44033000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb4b443640 1 -- 172.21.15.165:0/2498896519 reap_dead start 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 msgr2=0x56075ec78cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec78cf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c044040 tx=0x7fcb4c054670 comp rx=0 tx=0).stop 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 shutdown_connections 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2498896519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075ec71700 0x56075ec78cf0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 >> 172.21.15.165:0/2498896519 conn(0x56075ec6db20 msgr2=0x56075ec6bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 shutdown_connections 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/2498896519 wait complete. 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/1489434595 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca2c03d000 msgr2=0x7fca2c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/1489434595 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca2c03d000 0x7fca2c03f4c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcb44052bf0 tx=0x7fcb44052ac0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/1489434595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb50820 msgr2=0x56075eb4f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/1489434595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb50820 0x56075eb4f090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x56075ec48b30 tx=0x7fcb4c018830 comp rx=0 tx=0).stop 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/1489434595 shutdown_connections 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/1489434595 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca2c03d000 0x7fca2c03f4c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 --2- 172.21.15.165:0/1489434595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb50820 0x56075eb4f090 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/1489434595 >> 172.21.15.165:0/1489434595 conn(0x56075ec56e70 msgr2=0x56075ec57250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/1489434595 shutdown_connections 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.907+0000 7fcb57f23800 1 -- 172.21.15.165:0/1489434595 wait complete. 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075eb54bb0 msgr2=0x56075ec4f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075eb54bb0 0x56075ec4f180 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec51520 msgr2=0x56075ec539a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec51520 0x56075ec539a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca3c03d000 msgr2=0x7fca3c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca3c03d000 0x7fca3c03f4c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c057000 tx=0x7fcb3c052000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 msgr2=0x56075ec47b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec47b30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcb440012b0 tx=0x7fcb44000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 shutdown_connections 2024-09-22T08:11:05.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56075ec51520 0x56075ec539a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56075eb54bb0 0x56075ec4f180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca3c03d000 0x7fca3c03f4c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 --2- 172.21.15.165:0/2460462716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56075eb510a0 0x56075ec47b30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 >> 172.21.15.165:0/2460462716 conn(0x56075eb4ac00 msgr2=0x56075ec41510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 shutdown_connections 2024-09-22T08:11:05.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.908+0000 7fcb57f23800 1 -- 172.21.15.165:0/2460462716 wait complete. 2024-09-22T08:11:05.917 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:05.918 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-22T08:11:05.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-22T08:11:05.918 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-22T08:11:05.962 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:05.962 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:05.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.962+0000 7f2d58325800 1 Processor -- start 2024-09-22T08:11:05.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.962+0000 7f2d58325800 1 -- start start 2024-09-22T08:11:05.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.962+0000 7f2d58325800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559ed9efa0f0 0x559ed9efc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.962+0000 7f2d58325800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559ed9d84a20 con 0x559ed9efca20 2024-09-22T08:11:05.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.962+0000 7f2d58325800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559ed9d847d0 con 0x559ed9efa0f0 2024-09-22T08:11:05.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.963+0000 7f2d53f33640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559ed9efa0f0 0x559ed9efc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.963+0000 7f2d53732640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559ed9efca20 0x559ed9efee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33634/0 (socket says 172.21.15.165:33634) 2024-09-22T08:11:05.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.963+0000 7f2d53732640 1 -- 172.21.15.165:0/1878014522 learned_addr learned my addr 172.21.15.165:0/1878014522 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:05.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.963+0000 7f2d53f33640 1 -- 172.21.15.165:0/1878014522 >> v1:172.21.15.53:6789/0 conn(0x559ed9efca20 legacy=0x559ed9efee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.963+0000 7f2d53f33640 1 -- 172.21.15.165:0/1878014522 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed9f01570 con 0x559ed9efa0f0 2024-09-22T08:11:05.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d53f33640 1 --2- 172.21.15.165:0/1878014522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9efc4e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400a470 tx=0x7f2d44045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7bb3d2b4c8b9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d52f31640 1 -- 172.21.15.165:0/1878014522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d44053570 con 0x559ed9efa0f0 2024-09-22T08:11:05.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d52f31640 1 -- 172.21.15.165:0/1878014522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d44058070 con 0x559ed9efa0f0 2024-09-22T08:11:05.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d52f31640 1 -- 172.21.15.165:0/1878014522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d44053880 con 0x559ed9efa0f0 2024-09-22T08:11:05.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d58325800 1 -- 172.21.15.165:0/1878014522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 msgr2=0x559ed9efc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d58325800 1 --2- 172.21.15.165:0/1878014522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9efc4e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400a470 tx=0x7f2d44045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:05.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d58325800 1 -- 172.21.15.165:0/1878014522 shutdown_connections 2024-09-22T08:11:05.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d58325800 1 --2- 172.21.15.165:0/1878014522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9efc4e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d58325800 1 -- 172.21.15.165:0/1878014522 >> 172.21.15.165:0/1878014522 conn(0x559ed9ef3bb0 msgr2=0x559ed9ef6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d58325800 1 -- 172.21.15.165:0/1878014522 shutdown_connections 2024-09-22T08:11:05.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.965+0000 7f2d58325800 1 -- 172.21.15.165:0/1878014522 wait complete. 2024-09-22T08:11:05.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.979+0000 7f2d58325800 1 Processor -- start 2024-09-22T08:11:05.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.979+0000 7f2d58325800 1 -- start start 2024-09-22T08:11:05.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.980+0000 7f2d58325800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9fe9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.980+0000 7f2d58325800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ed9d91dd0 con 0x559ed9efa0f0 2024-09-22T08:11:05.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.980+0000 7f2d53f33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9fe9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.980+0000 7f2d53f33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9fe9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51818/0 (socket says 172.21.15.165:51818) 2024-09-22T08:11:05.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.980+0000 7f2d53f33640 1 -- 172.21.15.165:0/3588665889 learned_addr learned my addr 172.21.15.165:0/3588665889 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.980+0000 7f2d53f33640 1 -- 172.21.15.165:0/3588665889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed9fe9630 con 0x559ed9efa0f0 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.980+0000 7f2d53f33640 1 --2- 172.21.15.165:0/3588665889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9fe9040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2d44025c20 tx=0x7f2d44051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339aec47b1b1dd0c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.980+0000 7f2c41e0b640 1 -- 172.21.15.165:0/3588665889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d44053570 con 0x559ed9efa0f0 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.980+0000 7f2c41e0b640 1 -- 172.21.15.165:0/3588665889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d44063070 con 0x559ed9efa0f0 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.980+0000 7f2c41e0b640 1 -- 172.21.15.165:0/3588665889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d44053840 con 0x559ed9efa0f0 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.981+0000 7f2d58325800 1 -- 172.21.15.165:0/3588665889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 msgr2=0x559ed9fe9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.981+0000 7f2d58325800 1 --2- 172.21.15.165:0/3588665889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9fe9040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2d44025c20 tx=0x7f2d44051000 comp rx=0 tx=0).stop 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.981+0000 7f2d58325800 1 -- 172.21.15.165:0/3588665889 shutdown_connections 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.981+0000 7f2d58325800 1 --2- 172.21.15.165:0/3588665889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9fe9040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.981+0000 7f2d58325800 1 -- 172.21.15.165:0/3588665889 >> 172.21.15.165:0/3588665889 conn(0x559ed9ef3bb0 msgr2=0x559ed9fe49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.981+0000 7f2d58325800 1 -- 172.21.15.165:0/3588665889 shutdown_connections 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.981+0000 7f2d58325800 1 -- 172.21.15.165:0/3588665889 wait complete. 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.981+0000 7f2d58325800 1 Processor -- start 2024-09-22T08:11:05.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.982+0000 7f2d58325800 1 -- start start 2024-09-22T08:11:05.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.982+0000 7f2d58325800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9ff0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.982+0000 7f2d58325800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ed9f00830 con 0x559ed9efa0f0 2024-09-22T08:11:05.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.982+0000 7f2d53f33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9ff0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.982+0000 7f2d53f33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9ff0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51826/0 (socket says 172.21.15.165:51826) 2024-09-22T08:11:05.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.982+0000 7f2d53f33640 1 -- 172.21.15.165:0/2664826386 learned_addr learned my addr 172.21.15.165:0/2664826386 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.982+0000 7f2d53f33640 1 -- 172.21.15.165:0/2664826386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed9ff0f90 con 0x559ed9efa0f0 2024-09-22T08:11:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.982+0000 7f2d53f33640 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9ff0a30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2d44053d60 tx=0x7f2d44002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.983+0000 7f2c3bfff640 1 -- 172.21.15.165:0/2664826386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d44068470 con 0x559ed9efa0f0 2024-09-22T08:11:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.983+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ed9ff1220 con 0x559ed9efa0f0 2024-09-22T08:11:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.983+0000 7f2c3bfff640 1 -- 172.21.15.165:0/2664826386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d44068610 con 0x559ed9efa0f0 2024-09-22T08:11:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.983+0000 7f2c3bfff640 1 -- 172.21.15.165:0/2664826386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d440688f0 con 0x559ed9efa0f0 2024-09-22T08:11:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.983+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed9ff1c20 con 0x559ed9efa0f0 2024-09-22T08:11:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.983+0000 7f2c3bfff640 1 -- 172.21.15.165:0/2664826386 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2d44068a90 con 0x559ed9efa0f0 2024-09-22T08:11:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.984+0000 7f2c3bfff640 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c3c03cfb0 0x7f2c3c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.984+0000 7f2c3bfff640 1 -- 172.21.15.165:0/2664826386 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2d44098a50 con 0x559ed9efa0f0 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.984+0000 7f2d53732640 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c3c03cfb0 0x7f2c3c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.984+0000 7f2d58325800 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559ed9efca20 0x559ed9ff8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.984+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ed9ff85c0 con 0x559ed9efca20 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.984+0000 7f2d54734640 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559ed9efca20 0x559ed9ff8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.984+0000 7f2d53732640 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c3c03cfb0 0x7f2c3c03f470 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2d48001d70 tx=0x7f2d480012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.984+0000 7f2d54734640 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559ed9efca20 0x559ed9ff8080 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.985+0000 7f2d54734640 1 -- 172.21.15.165:0/2664826386 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d4c00a4d0 con 0x559ed9efca20 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.985+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ed9ff8960 con 0x559ed9efca20 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.985+0000 7f2d54734640 1 -- 172.21.15.165:0/2664826386 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d4c00a4d0 con 0x559ed9efca20 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.985+0000 7f2d58325800 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559ed9ffa3e0 0x559ed9ffc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.985+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ed9ffcfe0 con 0x559ed9ffa3e0 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.985+0000 7f2d53f33640 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559ed9ffa3e0 0x559ed9ffc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.985+0000 7f2d53f33640 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559ed9ffa3e0 0x559ed9ffc850 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.986+0000 7f2d53f33640 1 -- 172.21.15.165:0/2664826386 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d44079020 con 0x559ed9ffa3e0 2024-09-22T08:11:05.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.986+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ed9ff91b0 con 0x559ed9efca20 2024-09-22T08:11:05.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.986+0000 7f2d54734640 1 -- 172.21.15.165:0/2664826386 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d4c00a4d0 con 0x559ed9efca20 2024-09-22T08:11:05.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.986+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ed9ff9550 con 0x559ed9efca20 2024-09-22T08:11:05.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.986+0000 7f2d54734640 1 -- 172.21.15.165:0/2664826386 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d4c00a4d0 con 0x559ed9efca20 2024-09-22T08:11:05.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.986+0000 7f2d58325800 1 Processor -- start 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.987+0000 7f2d58325800 1 -- start start 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.987+0000 7f2d58325800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda00b8f0 0x559eda00bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.987+0000 7f2d58325800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ed9df0d50 con 0x559eda00b8f0 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.987+0000 7f2d54734640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda00b8f0 0x559eda00bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.987+0000 7f2d54734640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda00b8f0 0x559eda00bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51842/0 (socket says 172.21.15.165:51842) 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.987+0000 7f2d54734640 1 -- 172.21.15.165:0/3073699281 learned_addr learned my addr 172.21.15.165:0/3073699281 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.987+0000 7f2d54734640 1 -- 172.21.15.165:0/3073699281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eda00c350 con 0x559eda00b8f0 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.987+0000 7f2d54734640 1 --2- 172.21.15.165:0/3073699281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda00b8f0 0x559eda00bd10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x559ed9ff18c0 tx=0x7f2d4c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.987+0000 7f2c397fa640 1 -- 172.21.15.165:0/3073699281 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d4c014450 con 0x559eda00b8f0 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.988+0000 7f2c397fa640 1 -- 172.21.15.165:0/3073699281 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4c014610 con 0x559eda00b8f0 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.988+0000 7f2d58325800 1 -- 172.21.15.165:0/3073699281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559eda00cb80 con 0x559eda00b8f0 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.988+0000 7f2c397fa640 1 -- 172.21.15.165:0/3073699281 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d4c014930 con 0x559eda00b8f0 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.988+0000 7f2d58325800 1 -- 172.21.15.165:0/3073699281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eda00d120 con 0x559eda00b8f0 2024-09-22T08:11:05.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.988+0000 7f2c397fa640 1 -- 172.21.15.165:0/3073699281 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2d4c011040 con 0x559eda00b8f0 2024-09-22T08:11:05.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2c397fa640 1 --2- 172.21.15.165:0/3073699281 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c2c03d000 0x7f2c2c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2c397fa640 1 -- 172.21.15.165:0/3073699281 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2d4c01e070 con 0x559eda00b8f0 2024-09-22T08:11:05.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2d53f33640 1 --2- 172.21.15.165:0/3073699281 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c2c03d000 0x7f2c2c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2d58325800 1 Processor -- start 2024-09-22T08:11:05.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2d58325800 1 -- start start 2024-09-22T08:11:05.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2d53f33640 1 --2- 172.21.15.165:0/3073699281 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c2c03d000 0x7f2c2c03f4c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x559ed9ff2a90 tx=0x7f2d44052bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:05.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2d58325800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda018750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:05.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2d58325800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ed9fe9a00 con 0x559eda018370 2024-09-22T08:11:05.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2d54734640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda018750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:05.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2d54734640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda018750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51846/0 (socket says 172.21.15.165:51846) 2024-09-22T08:11:05.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2d54734640 1 -- 172.21.15.165:0/2135873825 learned_addr learned my addr 172.21.15.165:0/2135873825 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:05.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.989+0000 7f2d54734640 1 -- 172.21.15.165:0/2135873825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eda018d40 con 0x559eda018370 2024-09-22T08:11:05.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2d54734640 1 --2- 172.21.15.165:0/2135873825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda018750 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c016fd0 tx=0x7f2d4c02b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8d6c033d2adbc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2c32ffd640 1 -- 172.21.15.165:0/2135873825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d4c022de0 con 0x559eda018370 2024-09-22T08:11:06.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2c32ffd640 1 -- 172.21.15.165:0/2135873825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4c011da0 con 0x559eda018370 2024-09-22T08:11:06.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2c32ffd640 1 -- 172.21.15.165:0/2135873825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d4c0167c0 con 0x559eda018370 2024-09-22T08:11:06.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2d58325800 1 -- 172.21.15.165:0/2135873825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 msgr2=0x559eda018750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2d58325800 1 --2- 172.21.15.165:0/2135873825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda018750 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c016fd0 tx=0x7f2d4c02b4c0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2d58325800 1 -- 172.21.15.165:0/2135873825 shutdown_connections 2024-09-22T08:11:06.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2d58325800 1 --2- 172.21.15.165:0/2135873825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda018750 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2d58325800 1 -- 172.21.15.165:0/2135873825 >> 172.21.15.165:0/2135873825 conn(0x559eda014770 msgr2=0x559eda0129b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2d58325800 1 -- 172.21.15.165:0/2135873825 shutdown_connections 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.990+0000 7f2d58325800 1 -- 172.21.15.165:0/2135873825 wait complete. 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.991+0000 7f2d58325800 1 Processor -- start 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.991+0000 7f2d58325800 1 -- start start 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.991+0000 7f2d58325800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda01f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.991+0000 7f2d58325800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559eda019380 con 0x559eda018370 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.991+0000 7f2d54734640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda01f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.991+0000 7f2d54734640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda01f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51848/0 (socket says 172.21.15.165:51848) 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.991+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 learned_addr learned my addr 172.21.15.165:0/849124649 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.991+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eda01fe80 con 0x559eda018370 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.991+0000 7f2d54734640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda01f920 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c016fd0 tx=0x7f2d4c054670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.992+0000 7f2c317fa640 1 -- 172.21.15.165:0/849124649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d4c011460 con 0x559eda018370 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.992+0000 7f2c317fa640 1 -- 172.21.15.165:0/849124649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4c032020 con 0x559eda018370 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.992+0000 7f2c317fa640 1 -- 172.21.15.165:0/849124649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d4c016910 con 0x559eda018370 2024-09-22T08:11:06.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.992+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559eda020110 con 0x559eda018370 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.992+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eda020ca0 con 0x559eda018370 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.993+0000 7f2c317fa640 1 -- 172.21.15.165:0/849124649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2d4c04dd10 con 0x559eda018370 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.993+0000 7f2c317fa640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1c03cfb0 0x7f2c1c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.993+0000 7f2c317fa640 1 -- 172.21.15.165:0/849124649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2d4c033030 con 0x559eda018370 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.993+0000 7f2d53f33640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1c03cfb0 0x7f2c1c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.993+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.993+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559eda02b440 0x559eda02d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.993+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda02e050 con 0x559eda02b440 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.993+0000 7f2d53732640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559eda02b440 0x559eda02d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.993+0000 7f2d53f33640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1c03cfb0 0x7f2c1c03f470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d44052fd0 tx=0x7f2d44089000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d53732640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559eda02b440 0x559eda02d900 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d48009050 con 0x559eda02b440 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 20 realm 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda02a790 con 0x559eda02b440 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d48009050 con 0x559eda02b440 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda02eb30 con 0x559eda02b440 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d48009050 con 0x559eda02b440 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.994+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda02f400 con 0x559eda02b440 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d48009050 con 0x559eda02b440 2024-09-22T08:11:06.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d58325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559eda02fd40 0x559eda032130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda032870 con 0x559eda02fd40 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d54734640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559eda02fd40 0x559eda032130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d54734640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559eda02fd40 0x559eda032130 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d58325800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d58325800 20 searching for the correct realm 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559eda034920 0x559eda036de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda034920 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.995+0000 7f2d53f33640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559eda034920 0x559eda036de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.996+0000 7f2d53f33640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559eda034920 0x559eda036de0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.996+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.996+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02fd40 2024-09-22T08:11:06.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.996+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.996+0000 7f2d54734640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d4c014070 0x7f2d4c001930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.996+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x7f2d4c014070 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.996+0000 7f2d53732640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d4c014070 0x7f2d4c001930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.997+0000 7f2d53732640 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d4c014070 0x7f2d4c001930 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.997+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48009050 con 0x7f2d4c014070 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.997+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02b440 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.997+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48009050 con 0x559eda02b440 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.997+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02b440 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.997+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.997+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x7f2d4c014070 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.998+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.998+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x7f2d4c014070 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.998+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.998+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02fd40 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.998+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.998+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda034920 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.998+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.998+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02b440 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.999+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.999+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x7f2d4c014070 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.999+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.999+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02b440 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.999+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.999+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02fd40 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.999+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:05.999+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda034920 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.000+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.000+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda034920 2024-09-22T08:11:06.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.000+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.000+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x7f2d4c014070 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.000+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.000+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda034920 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.001+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.001+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda034920 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.001+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.001+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02b440 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.001+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.001+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02b440 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.001+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.001+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x7f2d4c014070 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.001+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.001+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda034920 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.002+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.002+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02fd40 2024-09-22T08:11:06.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.002+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.002+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02b440 2024-09-22T08:11:06.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.002+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.002+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x7f2d4c014070 2024-09-22T08:11:06.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.002+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.002+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda034920 2024-09-22T08:11:06.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.003+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.003+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x7f2d4c014070 2024-09-22T08:11:06.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.003+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.003+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02fd40 2024-09-22T08:11:06.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.003+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.003+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda034920 2024-09-22T08:11:06.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.003+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.003+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x7f2d4c014070 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02b440 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eda0374b0 con 0x559eda02fd40 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:06.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda033320 con 0x559eda02b440 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda032f30 con 0x559eda02b440 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.004+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda033cd0 con 0x559eda02b440 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 20 zone default found 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 4 Realm: () 2024-09-22T08:11:06.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 20 zonegroup default 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda0337c0 con 0x7f2d4c014070 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda0398a0 con 0x559eda034920 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.005+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda039d50 con 0x559eda034920 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.006+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.006+0000 7f2d58325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.006+0000 7f2d58325800 20 started sync module instance, tier type = 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.006+0000 7f2d58325800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.006+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda038cf0 con 0x559eda02fd40 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.007+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.007+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94140750860512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03a660 con 0x559eda02fd40 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.007+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03aeb0 con 0x559eda02b440 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.008+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94140750860512] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.008+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.008+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94140750864816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03ab60 con 0x559eda02b440 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.008+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03b680 con 0x559eda034920 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.009+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94140750864816] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.009+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.009+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94140750868816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03ba70 con 0x559eda034920 2024-09-22T08:11:06.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.009+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03c470 con 0x559eda02fd40 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.010+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94140750868816] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.010+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.010+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94140750865872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03c430 con 0x559eda02fd40 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.010+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03cf00 con 0x559eda02b440 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.011+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94140750865872] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.012+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.012+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94140750875088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03c430 con 0x559eda02b440 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.012+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03d970 con 0x7f2d4c014070 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.013+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.013+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94140750877792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03d930 con 0x7f2d4c014070 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.013+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94140750875088] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.013+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03e7a0 con 0x7f2d4c014070 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.014+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94140750877792] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.014+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.014+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94140750880096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03d930 con 0x7f2d4c014070 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.014+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03edc0 con 0x7f2d4c014070 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.015+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94140750880096] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.015+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.015+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94140750881520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03edc0 con 0x7f2d4c014070 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.015+0000 7f2d58325800 20 add_watcher() i=0 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.015+0000 7f2d58325800 20 add_watcher() i=1 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.015+0000 7f2d58325800 20 add_watcher() i=2 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.015+0000 7f2d58325800 20 add_watcher() i=3 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.015+0000 7f2d58325800 20 add_watcher() i=4 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.015+0000 7f2d58325800 20 add_watcher() i=5 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.015+0000 7f2d58325800 20 add_watcher() i=6 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.016+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94140750881520] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.016+0000 7f2d58325800 20 add_watcher() i=7 2024-09-22T08:11:06.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.016+0000 7f2d58325800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:06.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.016+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda042300 con 0x559eda02b440 2024-09-22T08:11:06.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.016+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.016+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94140750884016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda03f640 con 0x559eda02b440 2024-09-22T08:11:06.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.017+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94140750884016] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.017+0000 7f2c09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.017+0000 7f2d58325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:06.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.017+0000 7f2d58325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:06.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.017+0000 7f2d58325800 5 note: GC not initialized 2024-09-22T08:11:06.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.017+0000 7f2c08fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:06.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.017+0000 7f2d58325800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:06.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.018+0000 7f2d58325800 20 Filter name: none 2024-09-22T08:11:06.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.018+0000 7f2b827fc640 20 reqs_thread_entry: start 2024-09-22T08:11:06.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.018+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.018+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda0752a0 con 0x559eda02b440 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.018+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.018+0000 7f2d58325800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.018+0000 7f2d58325800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.018+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda075cc0 con 0x559eda02b440 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.019+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.019+0000 7f2d58325800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.019+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eda076cd0 con 0x559eda02fd40 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.019+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.020+0000 7f2c09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.020+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94140750884016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda073060 con 0x559eda02b440 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.021+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94140750884016] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.021+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94140750860512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda073060 con 0x559eda02fd40 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.022+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94140750860512] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.022+0000 7f2d58325800 20 remove_watcher() i=0 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.022+0000 7f2d58325800 2 removed watcher, disabling cache 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.022+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94140750864816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda073060 con 0x559eda02b440 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.023+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94140750864816] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.023+0000 7f2d58325800 20 remove_watcher() i=1 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.023+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94140750868816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda073060 con 0x559eda034920 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.024+0000 7f2d53f33640 1 -- 172.21.15.165:0/849124649 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94140750868816] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d44098d70 con 0x559eda034920 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.024+0000 7f2d58325800 20 remove_watcher() i=2 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.024+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94140750865872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda073060 con 0x559eda02fd40 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.025+0000 7f2d54734640 1 -- 172.21.15.165:0/849124649 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94140750865872] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4c02a070 con 0x559eda02fd40 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.025+0000 7f2d58325800 20 remove_watcher() i=3 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.025+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94140750875088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda073060 con 0x559eda02b440 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.026+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94140750875088] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x559eda02b440 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.026+0000 7f2d58325800 20 remove_watcher() i=4 2024-09-22T08:11:06.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.026+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94140750877792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda073060 con 0x7f2d4c014070 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.027+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94140750877792] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.027+0000 7f2d58325800 20 remove_watcher() i=5 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.027+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94140750880096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda073060 con 0x7f2d4c014070 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.028+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94140750880096] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.028+0000 7f2d58325800 20 remove_watcher() i=6 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.028+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94140750881520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eda073060 con 0x7f2d4c014070 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94140750881520] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48029040 con 0x7f2d4c014070 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 20 remove_watcher() i=7 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d4c014070 msgr2=0x7f2d4c001930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d4c014070 0x7f2d4c001930 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559eda02b440 msgr2=0x559eda02d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559eda02b440 0x559eda02d900 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559eda02fd40 msgr2=0x559eda032130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559eda02fd40 0x559eda032130 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559eda034920 msgr2=0x559eda036de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559eda034920 0x559eda036de0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1c03cfb0 msgr2=0x7f2c1c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1c03cfb0 0x7f2c1c03f470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d44052fd0 tx=0x7f2d44089000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 msgr2=0x559eda01f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda01f920 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c016fd0 tx=0x7f2d4c054670 comp rx=0 tx=0).stop 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 shutdown_connections 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d53732640 1 -- 172.21.15.165:0/849124649 reap_dead start 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d4c014070 0x7f2d4c001930 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559eda034920 0x559eda036de0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559eda02fd40 0x559eda032130 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559eda02b440 0x559eda02d900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1c03cfb0 0x7f2c1c03f470 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/849124649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda018370 0x559eda01f920 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 >> 172.21.15.165:0/849124649 conn(0x559eda014770 msgr2=0x559eda012980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 shutdown_connections 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/849124649 wait complete. 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/3073699281 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c2c03d000 msgr2=0x7f2c2c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/3073699281 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c2c03d000 0x7f2c2c03f4c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x559ed9ff2a90 tx=0x7f2d44052bc0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/3073699281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda00b8f0 msgr2=0x559eda00bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/3073699281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda00b8f0 0x559eda00bd10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x559ed9ff18c0 tx=0x7f2d4c018830 comp rx=0 tx=0).stop 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/3073699281 shutdown_connections 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/3073699281 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c2c03d000 0x7f2c2c03f4c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 --2- 172.21.15.165:0/3073699281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559eda00b8f0 0x559eda00bd10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/3073699281 >> 172.21.15.165:0/3073699281 conn(0x559ed9fffca0 msgr2=0x559eda000080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/3073699281 shutdown_connections 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.029+0000 7f2d58325800 1 -- 172.21.15.165:0/3073699281 wait complete. 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559ed9efca20 msgr2=0x559ed9ff8080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559ed9efca20 0x559ed9ff8080 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559ed9ffa3e0 msgr2=0x559ed9ffc850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559ed9ffa3e0 0x559ed9ffc850 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c3c03cfb0 msgr2=0x7f2c3c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c3c03cfb0 0x7f2c3c03f470 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2d48001d70 tx=0x7f2d480012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 msgr2=0x559ed9ff0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9ff0a30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2d44053d60 tx=0x7f2d44002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 shutdown_connections 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559ed9ffa3e0 0x559ed9ffc850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559ed9efca20 0x559ed9ff8080 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c3c03cfb0 0x7f2c3c03f470 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 --2- 172.21.15.165:0/2664826386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed9efa0f0 0x559ed9ff0a30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 >> 172.21.15.165:0/2664826386 conn(0x559ed9ef3bb0 msgr2=0x559ed9fe31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 shutdown_connections 2024-09-22T08:11:06.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.030+0000 7f2d58325800 1 -- 172.21.15.165:0/2664826386 wait complete. 2024-09-22T08:11:06.039 INFO:teuthology.orchestra.run.smithi165.stdout:[] 2024-09-22T08:11:06.039 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:11:06.040 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-22T08:11:06.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-22T08:11:06.040 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-22T08:11:06.084 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:06.084 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:06.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.084+0000 7ff27cb46800 1 Processor -- start 2024-09-22T08:11:06.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.084+0000 7ff27cb46800 1 -- start start 2024-09-22T08:11:06.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.084+0000 7ff27cb46800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560eea9dfbd0 0x560eea9e2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.084+0000 7ff27cb46800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560eea864a20 con 0x560eea94d510 2024-09-22T08:11:06.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.084+0000 7ff27cb46800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560eea8647d0 con 0x560eea9dfbd0 2024-09-22T08:11:06.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.084+0000 7ff279e36640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560eea9dfbd0 0x560eea9e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.084+0000 7ff27a637640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560eea94d510 0x560eea9de4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33650/0 (socket says 172.21.15.165:33650) 2024-09-22T08:11:06.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.084+0000 7ff27a637640 1 -- 172.21.15.165:0/3139776042 learned_addr learned my addr 172.21.15.165:0/3139776042 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:06.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.085+0000 7ff279e36640 1 -- 172.21.15.165:0/3139776042 >> v1:172.21.15.53:6789/0 conn(0x560eea94d510 legacy=0x560eea9de4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.085+0000 7ff279e36640 1 -- 172.21.15.165:0/3139776042 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eea9e3770 con 0x560eea9dfbd0 2024-09-22T08:11:06.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.086+0000 7ff279e36640 1 --2- 172.21.15.165:0/3139776042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea9dfbd0 0x560eea9e2090 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff26400a470 tx=0x7ff264045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d6c037c072abca server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.086+0000 7ff279635640 1 -- 172.21.15.165:0/3139776042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff264053570 con 0x560eea9dfbd0 2024-09-22T08:11:06.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.087+0000 7ff279635640 1 -- 172.21.15.165:0/3139776042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff264058070 con 0x560eea9dfbd0 2024-09-22T08:11:06.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.087+0000 7ff279635640 1 -- 172.21.15.165:0/3139776042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff264053880 con 0x560eea9dfbd0 2024-09-22T08:11:06.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.087+0000 7ff27cb46800 1 -- 172.21.15.165:0/3139776042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea9dfbd0 msgr2=0x560eea9e2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.087+0000 7ff27cb46800 1 --2- 172.21.15.165:0/3139776042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea9dfbd0 0x560eea9e2090 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff26400a470 tx=0x7ff264045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:06.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.087+0000 7ff27cb46800 1 -- 172.21.15.165:0/3139776042 shutdown_connections 2024-09-22T08:11:06.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.087+0000 7ff27cb46800 1 --2- 172.21.15.165:0/3139776042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea9dfbd0 0x560eea9e2090 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.087+0000 7ff27cb46800 1 -- 172.21.15.165:0/3139776042 >> 172.21.15.165:0/3139776042 conn(0x560eea9d3ba0 msgr2=0x560eea9d6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.087+0000 7ff27cb46800 1 -- 172.21.15.165:0/3139776042 shutdown_connections 2024-09-22T08:11:06.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.087+0000 7ff27cb46800 1 -- 172.21.15.165:0/3139776042 wait complete. 2024-09-22T08:11:06.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.101+0000 7ff27cb46800 1 Processor -- start 2024-09-22T08:11:06.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.101+0000 7ff27cb46800 1 -- start start 2024-09-22T08:11:06.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.101+0000 7ff27cb46800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaacb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.101+0000 7ff27cb46800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560eea871dd0 con 0x560eea94d510 2024-09-22T08:11:06.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.101+0000 7ff27a637640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaacb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.101+0000 7ff27a637640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaacb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51858/0 (socket says 172.21.15.165:51858) 2024-09-22T08:11:06.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.101+0000 7ff27a637640 1 -- 172.21.15.165:0/2699777074 learned_addr learned my addr 172.21.15.165:0/2699777074 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.101+0000 7ff27a637640 1 -- 172.21.15.165:0/2699777074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eeaacb830 con 0x560eea94d510 2024-09-22T08:11:06.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.102+0000 7ff27a637640 1 --2- 172.21.15.165:0/2699777074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaacb240 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff26c001e40 tx=0x7ff26c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e5c03f73cc7107 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.102+0000 7ff168608640 1 -- 172.21.15.165:0/2699777074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff26c012020 con 0x560eea94d510 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.102+0000 7ff168608640 1 -- 172.21.15.165:0/2699777074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff26c00e5a0 con 0x560eea94d510 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.102+0000 7ff168608640 1 -- 172.21.15.165:0/2699777074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff26c00e8a0 con 0x560eea94d510 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 -- 172.21.15.165:0/2699777074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 msgr2=0x560eeaacb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2699777074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaacb240 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff26c001e40 tx=0x7ff26c001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 -- 172.21.15.165:0/2699777074 shutdown_connections 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2699777074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaacb240 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 -- 172.21.15.165:0/2699777074 >> 172.21.15.165:0/2699777074 conn(0x560eea9d3ba0 msgr2=0x560eeaac6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 -- 172.21.15.165:0/2699777074 shutdown_connections 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 -- 172.21.15.165:0/2699777074 wait complete. 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 Processor -- start 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 -- start start 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaad2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27cb46800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560eea9e2a10 con 0x560eea94d510 2024-09-22T08:11:06.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27a637640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaad2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27a637640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaad2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51872/0 (socket says 172.21.15.165:51872) 2024-09-22T08:11:06.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.103+0000 7ff27a637640 1 -- 172.21.15.165:0/2884765089 learned_addr learned my addr 172.21.15.165:0/2884765089 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.104+0000 7ff27a637640 1 -- 172.21.15.165:0/2884765089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eeaad32b0 con 0x560eea94d510 2024-09-22T08:11:06.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.104+0000 7ff27a637640 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaad2d50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0012b0 tx=0x7ff26c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.104+0000 7ff166e05640 1 -- 172.21.15.165:0/2884765089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff26c012030 con 0x560eea94d510 2024-09-22T08:11:06.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.104+0000 7ff166e05640 1 -- 172.21.15.165:0/2884765089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff26c01a750 con 0x560eea94d510 2024-09-22T08:11:06.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.104+0000 7ff166e05640 1 -- 172.21.15.165:0/2884765089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff26c01aa70 con 0x560eea94d510 2024-09-22T08:11:06.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.104+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560eeaad3540 con 0x560eea94d510 2024-09-22T08:11:06.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.104+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eeaad3f40 con 0x560eea94d510 2024-09-22T08:11:06.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.105+0000 7ff166e05640 1 -- 172.21.15.165:0/2884765089 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff26c015020 con 0x560eea94d510 2024-09-22T08:11:06.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.105+0000 7ff166e05640 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff16003cfb0 0x7ff16003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.105+0000 7ff166e05640 1 -- 172.21.15.165:0/2884765089 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff26c020030 con 0x560eea94d510 2024-09-22T08:11:06.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.105+0000 7ff279e36640 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff16003cfb0 0x7ff16003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.105+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eea9dfbd0 0x560eeaada3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.105+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeaada8e0 con 0x560eea9dfbd0 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.105+0000 7ff27ae38640 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eea9dfbd0 0x560eeaada3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.106+0000 7ff279e36640 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff16003cfb0 0x7ff16003f470 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff264057000 tx=0x7ff264052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.106+0000 7ff27ae38640 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eea9dfbd0 0x560eeaada3a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.106+0000 7ff27ae38640 1 -- 172.21.15.165:0/2884765089 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff27400a4d0 con 0x560eea9dfbd0 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.106+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeaadac80 con 0x560eea9dfbd0 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.106+0000 7ff27ae38640 1 -- 172.21.15.165:0/2884765089 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff27400a4d0 con 0x560eea9dfbd0 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.106+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeaadc740 0x560eeaadebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.106+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeaadf370 con 0x560eeaadc740 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.106+0000 7ff27a637640 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeaadc740 0x560eeaadebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.107+0000 7ff27a637640 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeaadc740 0x560eeaadebe0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.107+0000 7ff27a637640 1 -- 172.21.15.165:0/2884765089 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff26c054490 con 0x560eeaadc740 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.107+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeaadb4d0 con 0x560eea9dfbd0 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.107+0000 7ff27ae38640 1 -- 172.21.15.165:0/2884765089 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff27400a4d0 con 0x560eea9dfbd0 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.107+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeaadb8b0 con 0x560eea9dfbd0 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.108+0000 7ff27ae38640 1 -- 172.21.15.165:0/2884765089 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff27400a4d0 con 0x560eea9dfbd0 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.108+0000 7ff27cb46800 1 Processor -- start 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.108+0000 7ff27cb46800 1 -- start start 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.108+0000 7ff27cb46800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaaedd20 0x560eeaaee140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.108+0000 7ff27cb46800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560eea8d0d50 con 0x560eeaaedd20 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.108+0000 7ff27ae38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaaedd20 0x560eeaaee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.108+0000 7ff27ae38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaaedd20 0x560eeaaee140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51888/0 (socket says 172.21.15.165:51888) 2024-09-22T08:11:06.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.108+0000 7ff27ae38640 1 -- 172.21.15.165:0/4192648709 learned_addr learned my addr 172.21.15.165:0/4192648709 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.108+0000 7ff27ae38640 1 -- 172.21.15.165:0/4192648709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eeaaee780 con 0x560eeaaedd20 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.109+0000 7ff27ae38640 1 --2- 172.21.15.165:0/4192648709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaaedd20 0x560eeaaee140 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x560eeaad3be0 tx=0x7ff274018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.109+0000 7ff15ffff640 1 -- 172.21.15.165:0/4192648709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff274014450 con 0x560eeaaedd20 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.109+0000 7ff15ffff640 1 -- 172.21.15.165:0/4192648709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff274014610 con 0x560eeaaedd20 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.109+0000 7ff27cb46800 1 -- 172.21.15.165:0/4192648709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560eeaaeefb0 con 0x560eeaaedd20 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.109+0000 7ff15ffff640 1 -- 172.21.15.165:0/4192648709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff274014930 con 0x560eeaaedd20 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.109+0000 7ff27cb46800 1 -- 172.21.15.165:0/4192648709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eeaaef550 con 0x560eeaaedd20 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.110+0000 7ff15ffff640 1 -- 172.21.15.165:0/4192648709 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff274011040 con 0x560eeaaedd20 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.110+0000 7ff15ffff640 1 --2- 172.21.15.165:0/4192648709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff15403d000 0x7ff15403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.110+0000 7ff15ffff640 1 -- 172.21.15.165:0/4192648709 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff27401e070 con 0x560eeaaedd20 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.110+0000 7ff27a637640 1 --2- 172.21.15.165:0/4192648709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff15403d000 0x7ff15403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.110+0000 7ff27cb46800 1 Processor -- start 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.110+0000 7ff27a637640 1 --2- 172.21.15.165:0/4192648709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff15403d000 0x7ff15403f4c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x560eeaad4e20 tx=0x7ff26c02df10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.110+0000 7ff27cb46800 1 -- start start 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.111+0000 7ff27cb46800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeaafab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.111+0000 7ff27cb46800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560eeaacbc60 con 0x560eeaafa780 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.111+0000 7ff27ae38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeaafab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.111+0000 7ff27ae38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeaafab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51892/0 (socket says 172.21.15.165:51892) 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.111+0000 7ff27ae38640 1 -- 172.21.15.165:0/1223405402 learned_addr learned my addr 172.21.15.165:0/1223405402 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.111+0000 7ff27ae38640 1 -- 172.21.15.165:0/1223405402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eeaafb170 con 0x560eeaafa780 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.111+0000 7ff27ae38640 1 --2- 172.21.15.165:0/1223405402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeaafab80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff274018430 tx=0x7ff274014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95504df7411e94bf server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.111+0000 7ff15dffb640 1 -- 172.21.15.165:0/1223405402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27404b070 con 0x560eeaafa780 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.111+0000 7ff15dffb640 1 -- 172.21.15.165:0/1223405402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff274051070 con 0x560eeaafa780 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.111+0000 7ff15dffb640 1 -- 172.21.15.165:0/1223405402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff274011da0 con 0x560eeaafa780 2024-09-22T08:11:06.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 -- 172.21.15.165:0/1223405402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 msgr2=0x560eeaafab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 --2- 172.21.15.165:0/1223405402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeaafab80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff274018430 tx=0x7ff274014ea0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 -- 172.21.15.165:0/1223405402 shutdown_connections 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 --2- 172.21.15.165:0/1223405402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeaafab80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 -- 172.21.15.165:0/1223405402 >> 172.21.15.165:0/1223405402 conn(0x560eeaaf6b80 msgr2=0x560eeaaf4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 -- 172.21.15.165:0/1223405402 shutdown_connections 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 -- 172.21.15.165:0/1223405402 wait complete. 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 Processor -- start 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 -- start start 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeab01d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.112+0000 7ff27cb46800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560eeaafb790 con 0x560eeaafa780 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.113+0000 7ff27ae38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeab01d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.113+0000 7ff27ae38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeab01d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51904/0 (socket says 172.21.15.165:51904) 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.113+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 learned_addr learned my addr 172.21.15.165:0/280214329 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.113+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eeab022e0 con 0x560eeaafa780 2024-09-22T08:11:06.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.113+0000 7ff27ae38640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeab01d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff27402bfd0 tx=0x7ff2740546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.113+0000 7ff14bfff640 1 -- 172.21.15.165:0/280214329 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27404b040 con 0x560eeaafa780 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.113+0000 7ff14bfff640 1 -- 172.21.15.165:0/280214329 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2740167c0 con 0x560eeaafa780 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.113+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560eeab02570 con 0x560eeaafa780 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.113+0000 7ff14bfff640 1 -- 172.21.15.165:0/280214329 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff274011330 con 0x560eeaafa780 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.113+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eeab02ef0 con 0x560eeaafa780 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.114+0000 7ff14bfff640 1 -- 172.21.15.165:0/280214329 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff274054850 con 0x560eeaafa780 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.114+0000 7ff14bfff640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff14403d000 0x7ff14403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.114+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.114+0000 7ff14bfff640 1 -- 172.21.15.165:0/280214329 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff27400e040 con 0x560eeaafa780 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.114+0000 7ff27a637640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff14403d000 0x7ff14403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.114+0000 7ff27cb46800 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eeab0d830 0x560eeab0fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.114+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab103d0 con 0x560eeab0d830 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff279e36640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eeab0d830 0x560eeab0fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff27a637640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff14403d000 0x7ff14403f4c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff26c044c60 tx=0x7ff26c048000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff279e36640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eeab0d830 0x560eeab0fc80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff27cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff27cb46800 20 realm 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab10800 con 0x560eeab0d830 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff27cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff27cb46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.115+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab110d0 con 0x560eeab0d830 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab11470 con 0x560eeab0d830 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27cb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27cb46800 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeab121d0 0x560eeab145c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab14b00 con 0x560eeab121d0 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27ae38640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeab121d0 0x560eeab145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27ae38640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeab121d0 0x560eeab145c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27cb46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:06.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.116+0000 7ff27cb46800 20 searching for the correct realm 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.117+0000 7ff27cb46800 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560eeab16b40 0x560eeab19000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.117+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab16b40 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.117+0000 7ff27a637640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560eeab16b40 0x560eeab19000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.117+0000 7ff27a637640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560eeab16b40 0x560eeab19000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.117+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.117+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab121d0 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.117+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.117+0000 7ff27ae38640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff274014070 0x7ff27404d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.117+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x7ff274014070 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.118+0000 7ff279e36640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff274014070 0x7ff27404d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.118+0000 7ff279e36640 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff274014070 0x7ff27404d770 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.118+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.118+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab0d830 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.119+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.119+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab0d830 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.119+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.119+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x7ff274014070 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.119+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.119+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x7ff274014070 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.119+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.119+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab121d0 2024-09-22T08:11:06.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.120+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.120+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab16b40 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.120+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.120+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab0d830 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.120+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.120+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x7ff274014070 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.120+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.120+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab0d830 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.121+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.121+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab121d0 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.121+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.121+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab16b40 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.121+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.121+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab16b40 2024-09-22T08:11:06.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.121+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.121+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x7ff274014070 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.121+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.121+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab16b40 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.122+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.122+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab16b40 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.122+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.122+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab0d830 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.122+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.122+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab0d830 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.122+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.122+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x7ff274014070 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.122+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.122+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab16b40 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.123+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.123+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab121d0 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.123+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.123+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab0d830 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.123+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.123+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x7ff274014070 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.123+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.123+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab16b40 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.124+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.124+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x7ff274014070 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.124+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.124+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab121d0 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.124+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.124+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab16b40 2024-09-22T08:11:06.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.124+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.124+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x7ff274014070 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab0d830 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560eeab196d0 con 0x560eeab121d0 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:06.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab15570 con 0x560eeab0d830 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.125+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab15180 con 0x560eeab0d830 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab15ee0 con 0x560eeab0d830 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 20 zone default found 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 4 Realm: () 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:06.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 20 zonegroup default 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab15a40 con 0x7ff274014070 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.126+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1baa0 con 0x560eeab16b40 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.127+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.127+0000 7ff27cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.127+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.127+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1bf10 con 0x560eeab16b40 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.127+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.127+0000 7ff27cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.127+0000 7ff27cb46800 20 started sync module instance, tier type = 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.127+0000 7ff27cb46800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.127+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1af10 con 0x560eeab121d0 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.128+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.128+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94622067045120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1c800 con 0x560eeab121d0 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.128+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1d050 con 0x560eeab0d830 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.129+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94622067045120] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.129+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.129+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94622067049568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1cdd0 con 0x560eeab0d830 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.129+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1d8a0 con 0x560eeab16b40 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.130+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94622067049568] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.130+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.130+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94622067053456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1dcc0 con 0x560eeab16b40 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.130+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1e6c0 con 0x560eeab121d0 2024-09-22T08:11:06.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.131+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.131+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94622067053456] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.131+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94622067050624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1eae0 con 0x560eeab121d0 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.131+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1f5b0 con 0x560eeab0d830 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.132+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.132+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94622067060896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1f570 con 0x560eeab0d830 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.132+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab20550 con 0x7ff274014070 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.132+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94622067050624] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.133+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94622067060896] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.133+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.133+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94622067057104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab20070 con 0x7ff274014070 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.133+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab20e20 con 0x7ff274014070 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.134+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.134+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94622067067248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab20070 con 0x7ff274014070 2024-09-22T08:11:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.134+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab21960 con 0x7ff274014070 2024-09-22T08:11:06.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.134+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94622067057104] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.135+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.135+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94622067067248] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.135+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94622067070000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab21920 con 0x7ff274014070 2024-09-22T08:11:06.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.135+0000 7ff27cb46800 20 add_watcher() i=0 2024-09-22T08:11:06.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.135+0000 7ff27cb46800 20 add_watcher() i=1 2024-09-22T08:11:06.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.135+0000 7ff27cb46800 20 add_watcher() i=2 2024-09-22T08:11:06.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.135+0000 7ff27cb46800 20 add_watcher() i=3 2024-09-22T08:11:06.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.135+0000 7ff27cb46800 20 add_watcher() i=4 2024-09-22T08:11:06.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.135+0000 7ff27cb46800 20 add_watcher() i=5 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.135+0000 7ff27cb46800 20 add_watcher() i=6 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.136+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94622067070000] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.136+0000 7ff27cb46800 20 add_watcher() i=7 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.136+0000 7ff27cb46800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.136+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab24950 con 0x560eeab0d830 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.136+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.136+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94622067063104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab21e40 con 0x560eeab0d830 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.137+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94622067063104] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff130fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff27cb46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff27cb46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff27cb46800 5 note: GC not initialized 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff0ab7fe640 20 reqs_thread_entry: start 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff27cb46800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:06.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff27cb46800 20 Filter name: none 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff0a97fa640 20 reqs_thread_entry: start 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab57830 con 0x560eeab0d830 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.138+0000 7ff27cb46800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.139+0000 7ff27cb46800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.139+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab58250 con 0x560eeab0d830 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.139+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.139+0000 7ff27cb46800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.139+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560eeab59260 con 0x560eeab121d0 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.139+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.140+0000 7ff130fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.140+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94622067063104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab555f0 con 0x560eeab0d830 2024-09-22T08:11:06.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.141+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94622067063104] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.141+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94622067045120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab555f0 con 0x560eeab121d0 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.142+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94622067045120] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.142+0000 7ff27cb46800 20 remove_watcher() i=0 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.142+0000 7ff27cb46800 2 removed watcher, disabling cache 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.142+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94622067049568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab555f0 con 0x560eeab0d830 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.143+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94622067049568] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.143+0000 7ff27cb46800 20 remove_watcher() i=1 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.143+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94622067053456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab555f0 con 0x560eeab16b40 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.144+0000 7ff27a637640 1 -- 172.21.15.165:0/280214329 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94622067053456] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff26c054490 con 0x560eeab16b40 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.144+0000 7ff27cb46800 20 remove_watcher() i=2 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.144+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94622067050624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1b300 con 0x560eeab121d0 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.145+0000 7ff27ae38640 1 -- 172.21.15.165:0/280214329 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94622067050624] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27402a070 con 0x560eeab121d0 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.145+0000 7ff27cb46800 20 remove_watcher() i=3 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.145+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94622067060896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1c910 con 0x560eeab0d830 2024-09-22T08:11:06.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.146+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94622067060896] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x560eeab0d830 2024-09-22T08:11:06.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.146+0000 7ff27cb46800 20 remove_watcher() i=4 2024-09-22T08:11:06.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.146+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94622067057104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1c910 con 0x7ff274014070 2024-09-22T08:11:06.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.147+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94622067057104] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.147+0000 7ff27cb46800 20 remove_watcher() i=5 2024-09-22T08:11:06.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.147+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94622067067248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1c910 con 0x7ff274014070 2024-09-22T08:11:06.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.148+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94622067067248] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.148+0000 7ff27cb46800 20 remove_watcher() i=6 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.148+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94622067070000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560eeab1c910 con 0x7ff274014070 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94622067070000] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff264051070 con 0x7ff274014070 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 20 remove_watcher() i=7 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff274014070 msgr2=0x7ff27404d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff274014070 0x7ff27404d770 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eeab0d830 msgr2=0x560eeab0fc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eeab0d830 0x560eeab0fc80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeab121d0 msgr2=0x560eeab145c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeab121d0 0x560eeab145c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560eeab16b40 msgr2=0x560eeab19000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560eeab16b40 0x560eeab19000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff14403d000 msgr2=0x7ff14403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff14403d000 0x7ff14403f4c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff26c044c60 tx=0x7ff26c048000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 msgr2=0x560eeab01d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff279e36640 1 -- 172.21.15.165:0/280214329 reap_dead start 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeab01d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff27402bfd0 tx=0x7ff2740546a0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 shutdown_connections 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 --2- 172.21.15.165:0/280214329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaafa780 0x560eeab01d80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 >> 172.21.15.165:0/280214329 conn(0x560eeaaf6b80 msgr2=0x560eeaaf4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 shutdown_connections 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/280214329 wait complete. 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/4192648709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff15403d000 msgr2=0x7ff15403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 --2- 172.21.15.165:0/4192648709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff15403d000 0x7ff15403f4c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x560eeaad4e20 tx=0x7ff26c02df10 comp rx=0 tx=0).stop 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 -- 172.21.15.165:0/4192648709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaaedd20 msgr2=0x560eeaaee140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.149+0000 7ff27cb46800 1 --2- 172.21.15.165:0/4192648709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaaedd20 0x560eeaaee140 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x560eeaad3be0 tx=0x7ff274018830 comp rx=0 tx=0).stop 2024-09-22T08:11:06.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/4192648709 shutdown_connections 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 --2- 172.21.15.165:0/4192648709 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff15403d000 0x7ff15403f4c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 --2- 172.21.15.165:0/4192648709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eeaaedd20 0x560eeaaee140 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/4192648709 >> 172.21.15.165:0/4192648709 conn(0x560eeaae20d0 msgr2=0x560eeaae24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/4192648709 shutdown_connections 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/4192648709 wait complete. 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eea9dfbd0 msgr2=0x560eeaada3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eea9dfbd0 0x560eeaada3a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeaadc740 msgr2=0x560eeaadebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeaadc740 0x560eeaadebe0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff16003cfb0 msgr2=0x7ff16003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff16003cfb0 0x7ff16003f470 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff264057000 tx=0x7ff264052000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 msgr2=0x560eeaad2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaad2d50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0012b0 tx=0x7ff26c000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 shutdown_connections 2024-09-22T08:11:06.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560eeaadc740 0x560eeaadebe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560eea9dfbd0 0x560eeaada3a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff16003cfb0 0x7ff16003f470 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 --2- 172.21.15.165:0/2884765089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560eea94d510 0x560eeaad2d50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 >> 172.21.15.165:0/2884765089 conn(0x560eea9d3ba0 msgr2=0x560eeaacc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 shutdown_connections 2024-09-22T08:11:06.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.150+0000 7ff27cb46800 1 -- 172.21.15.165:0/2884765089 wait complete. 2024-09-22T08:11:06.159 INFO:teuthology.orchestra.run.smithi165.stdout:[] 2024-09-22T08:11:06.160 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:11:06.211 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:06.211 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-22T08:11:06.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-22T08:11:06.211 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-22T08:11:06.255 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:06.255 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:06.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.255+0000 7ff237663800 1 Processor -- start 2024-09-22T08:11:06.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.255+0000 7ff237663800 1 -- start start 2024-09-22T08:11:06.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.256+0000 7ff237663800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5578c38b4530 0x5578c39454b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.256+0000 7ff237663800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578c37cba20 con 0x5578c3945a20 2024-09-22T08:11:06.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.256+0000 7ff237663800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5578c37cb7d0 con 0x5578c38b4530 2024-09-22T08:11:06.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.256+0000 7ff235154640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5578c38b4530 0x5578c39454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.256+0000 7ff22c953640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5578c3945a20 0x5578c3947ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33666/0 (socket says 172.21.15.165:33666) 2024-09-22T08:11:06.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.256+0000 7ff22c953640 1 -- 172.21.15.165:0/4275620814 learned_addr learned my addr 172.21.15.165:0/4275620814 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:06.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.256+0000 7ff235154640 1 -- 172.21.15.165:0/4275620814 >> v1:172.21.15.53:6789/0 conn(0x5578c3945a20 legacy=0x5578c3947ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.256+0000 7ff235154640 1 -- 172.21.15.165:0/4275620814 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c394a7d0 con 0x5578c38b4530 2024-09-22T08:11:06.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.258+0000 7ff235154640 1 --2- 172.21.15.165:0/4275620814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c39454b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff22800a470 tx=0x7ff228045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e7b50d72a3fa50 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.258+0000 7ff234953640 1 -- 172.21.15.165:0/4275620814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff228053570 con 0x5578c38b4530 2024-09-22T08:11:06.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.258+0000 7ff234953640 1 -- 172.21.15.165:0/4275620814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff228058070 con 0x5578c38b4530 2024-09-22T08:11:06.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.258+0000 7ff234953640 1 -- 172.21.15.165:0/4275620814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff228053880 con 0x5578c38b4530 2024-09-22T08:11:06.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.259+0000 7ff237663800 1 -- 172.21.15.165:0/4275620814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 msgr2=0x5578c39454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.259+0000 7ff237663800 1 --2- 172.21.15.165:0/4275620814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c39454b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff22800a470 tx=0x7ff228045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:06.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.259+0000 7ff237663800 1 -- 172.21.15.165:0/4275620814 shutdown_connections 2024-09-22T08:11:06.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.259+0000 7ff237663800 1 --2- 172.21.15.165:0/4275620814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c39454b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.259+0000 7ff237663800 1 -- 172.21.15.165:0/4275620814 >> 172.21.15.165:0/4275620814 conn(0x5578c393abe0 msgr2=0x5578c393d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.259+0000 7ff237663800 1 -- 172.21.15.165:0/4275620814 shutdown_connections 2024-09-22T08:11:06.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.259+0000 7ff237663800 1 -- 172.21.15.165:0/4275620814 wait complete. 2024-09-22T08:11:06.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.273+0000 7ff237663800 1 Processor -- start 2024-09-22T08:11:06.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.273+0000 7ff237663800 1 -- start start 2024-09-22T08:11:06.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.273+0000 7ff237663800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a321e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.273+0000 7ff237663800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5578c37d8dd0 con 0x5578c38b4530 2024-09-22T08:11:06.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.273+0000 7ff235154640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.273+0000 7ff235154640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a321e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51922/0 (socket says 172.21.15.165:51922) 2024-09-22T08:11:06.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.273+0000 7ff235154640 1 -- 172.21.15.165:0/981449386 learned_addr learned my addr 172.21.15.165:0/981449386 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.274+0000 7ff235154640 1 -- 172.21.15.165:0/981449386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c3a327d0 con 0x5578c38b4530 2024-09-22T08:11:06.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.274+0000 7ff235154640 1 --2- 172.21.15.165:0/981449386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a321e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff228025c20 tx=0x7ff228051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b7359607629de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.274+0000 7ff123606640 1 -- 172.21.15.165:0/981449386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff228053570 con 0x5578c38b4530 2024-09-22T08:11:06.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.274+0000 7ff123606640 1 -- 172.21.15.165:0/981449386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff228063070 con 0x5578c38b4530 2024-09-22T08:11:06.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.274+0000 7ff123606640 1 -- 172.21.15.165:0/981449386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff228053840 con 0x5578c38b4530 2024-09-22T08:11:06.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 -- 172.21.15.165:0/981449386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 msgr2=0x5578c3a321e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 --2- 172.21.15.165:0/981449386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a321e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff228025c20 tx=0x7ff228051000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 -- 172.21.15.165:0/981449386 shutdown_connections 2024-09-22T08:11:06.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 --2- 172.21.15.165:0/981449386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a321e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 -- 172.21.15.165:0/981449386 >> 172.21.15.165:0/981449386 conn(0x5578c393abe0 msgr2=0x5578c3a2db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 -- 172.21.15.165:0/981449386 shutdown_connections 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 -- 172.21.15.165:0/981449386 wait complete. 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 Processor -- start 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 -- start start 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a39ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff237663800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5578c3949a70 con 0x5578c38b4530 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff235154640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a39ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff235154640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a39ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51926/0 (socket says 172.21.15.165:51926) 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.275+0000 7ff235154640 1 -- 172.21.15.165:0/4183669719 learned_addr learned my addr 172.21.15.165:0/4183669719 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.276+0000 7ff235154640 1 -- 172.21.15.165:0/4183669719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c3a3a200 con 0x5578c38b4530 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.276+0000 7ff235154640 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a39ca0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff228025c20 tx=0x7ff228002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.276+0000 7ff121e03640 1 -- 172.21.15.165:0/4183669719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff228074480 con 0x5578c38b4530 2024-09-22T08:11:06.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.276+0000 7ff121e03640 1 -- 172.21.15.165:0/4183669719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff228074620 con 0x5578c38b4530 2024-09-22T08:11:06.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.276+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578c3a3a490 con 0x5578c38b4530 2024-09-22T08:11:06.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.276+0000 7ff121e03640 1 -- 172.21.15.165:0/4183669719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff228074900 con 0x5578c38b4530 2024-09-22T08:11:06.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.276+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c3a3b0a0 con 0x5578c38b4530 2024-09-22T08:11:06.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.277+0000 7ff121e03640 1 -- 172.21.15.165:0/4183669719 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff228074aa0 con 0x5578c38b4530 2024-09-22T08:11:06.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.277+0000 7ff121e03640 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff11c03cfb0 0x7ff11c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.277+0000 7ff121e03640 1 -- 172.21.15.165:0/4183669719 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff228098b10 con 0x5578c38b4530 2024-09-22T08:11:06.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.277+0000 7ff22c953640 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff11c03cfb0 0x7ff11c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.277+0000 7ff237663800 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3945a20 0x5578c3a412f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.277+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a41830 con 0x5578c3945a20 2024-09-22T08:11:06.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.277+0000 7ff235955640 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3945a20 0x5578c3a412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.278+0000 7ff22c953640 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff11c03cfb0 0x7ff11c03f470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff220001d70 tx=0x7ff2200012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.278+0000 7ff235955640 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3945a20 0x5578c3a412f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.278+0000 7ff235955640 1 -- 172.21.15.165:0/4183669719 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff23000a4d0 con 0x5578c3945a20 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.278+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a41bd0 con 0x5578c3945a20 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.278+0000 7ff235955640 1 -- 172.21.15.165:0/4183669719 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff23000a4d0 con 0x5578c3945a20 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.278+0000 7ff237663800 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a436d0 0x5578c3a45b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.278+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a462e0 con 0x5578c3a436d0 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.278+0000 7ff235154640 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a436d0 0x5578c3a45b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.279+0000 7ff235154640 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a436d0 0x5578c3a45b50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.279+0000 7ff235154640 1 -- 172.21.15.165:0/4183669719 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a436d0 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.279+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a42420 con 0x5578c3945a20 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.279+0000 7ff235955640 1 -- 172.21.15.165:0/4183669719 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff23000a4d0 con 0x5578c3945a20 2024-09-22T08:11:06.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.279+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a42870 con 0x5578c3945a20 2024-09-22T08:11:06.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.280+0000 7ff235955640 1 -- 172.21.15.165:0/4183669719 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff23000a4d0 con 0x5578c3945a20 2024-09-22T08:11:06.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.280+0000 7ff237663800 1 Processor -- start 2024-09-22T08:11:06.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.280+0000 7ff237663800 1 -- start start 2024-09-22T08:11:06.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.280+0000 7ff237663800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a54b90 0x5578c3a54fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.280+0000 7ff237663800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5578c3837d50 con 0x5578c3a54b90 2024-09-22T08:11:06.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.280+0000 7ff235955640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a54b90 0x5578c3a54fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.280+0000 7ff235955640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a54b90 0x5578c3a54fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51940/0 (socket says 172.21.15.165:51940) 2024-09-22T08:11:06.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.281+0000 7ff235955640 1 -- 172.21.15.165:0/93135167 learned_addr learned my addr 172.21.15.165:0/93135167 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.281+0000 7ff235955640 1 -- 172.21.15.165:0/93135167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c3a555f0 con 0x5578c3a54b90 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.281+0000 7ff235955640 1 --2- 172.21.15.165:0/93135167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a54b90 0x5578c3a54fb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff23000a2a0 tx=0x7ff230018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.281+0000 7ff11affd640 1 -- 172.21.15.165:0/93135167 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff230014450 con 0x5578c3a54b90 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.281+0000 7ff11affd640 1 -- 172.21.15.165:0/93135167 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2300145f0 con 0x5578c3a54b90 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.281+0000 7ff11affd640 1 -- 172.21.15.165:0/93135167 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff230014910 con 0x5578c3a54b90 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.281+0000 7ff237663800 1 -- 172.21.15.165:0/93135167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578c3a55e20 con 0x5578c3a54b90 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.281+0000 7ff237663800 1 -- 172.21.15.165:0/93135167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c3a563c0 con 0x5578c3a54b90 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.282+0000 7ff11affd640 1 -- 172.21.15.165:0/93135167 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff230011040 con 0x5578c3a54b90 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.282+0000 7ff11affd640 1 --2- 172.21.15.165:0/93135167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10c03cfb0 0x7ff10c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.282+0000 7ff11affd640 1 -- 172.21.15.165:0/93135167 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff23001e070 con 0x5578c3a54b90 2024-09-22T08:11:06.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.282+0000 7ff235154640 1 --2- 172.21.15.165:0/93135167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10c03cfb0 0x7ff10c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.282+0000 7ff237663800 1 Processor -- start 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.283+0000 7ff237663800 1 -- start start 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.283+0000 7ff235154640 1 --2- 172.21.15.165:0/93135167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10c03cfb0 0x7ff10c03f470 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5578c3a3bd90 tx=0x7ff22805ce20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.283+0000 7ff237663800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a61a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.283+0000 7ff237663800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5578c3a32ba0 con 0x5578c3a61630 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.283+0000 7ff235955640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a61a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.283+0000 7ff235955640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a61a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51956/0 (socket says 172.21.15.165:51956) 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.283+0000 7ff235955640 1 -- 172.21.15.165:0/242918859 learned_addr learned my addr 172.21.15.165:0/242918859 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.283+0000 7ff235955640 1 -- 172.21.15.165:0/242918859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c3a62020 con 0x5578c3a61630 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff235955640 1 --2- 172.21.15.165:0/242918859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a61a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff230016fd0 tx=0x7ff230011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637b09e7b7a401b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff118ff9640 1 -- 172.21.15.165:0/242918859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff23004b070 con 0x5578c3a61630 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff118ff9640 1 -- 172.21.15.165:0/242918859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff230051070 con 0x5578c3a61630 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff118ff9640 1 -- 172.21.15.165:0/242918859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff230053320 con 0x5578c3a61630 2024-09-22T08:11:06.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff237663800 1 -- 172.21.15.165:0/242918859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 msgr2=0x5578c3a61a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff237663800 1 --2- 172.21.15.165:0/242918859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a61a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff230016fd0 tx=0x7ff230011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff237663800 1 -- 172.21.15.165:0/242918859 shutdown_connections 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff237663800 1 --2- 172.21.15.165:0/242918859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a61a30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff237663800 1 -- 172.21.15.165:0/242918859 >> 172.21.15.165:0/242918859 conn(0x5578c3a5da30 msgr2=0x5578c3a5bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff237663800 1 -- 172.21.15.165:0/242918859 shutdown_connections 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff237663800 1 -- 172.21.15.165:0/242918859 wait complete. 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.284+0000 7ff237663800 1 Processor -- start 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.285+0000 7ff237663800 1 -- start start 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.285+0000 7ff237663800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a68c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.285+0000 7ff237663800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5578c3a62640 con 0x5578c3a61630 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.285+0000 7ff235955640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a68c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.285+0000 7ff235955640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a68c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51964/0 (socket says 172.21.15.165:51964) 2024-09-22T08:11:06.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.285+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 learned_addr learned my addr 172.21.15.165:0/356249553 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.285+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c3a69170 con 0x5578c3a61630 2024-09-22T08:11:06.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.285+0000 7ff235955640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a68c10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff2300014d0 tx=0x7ff2300547b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.285+0000 7ff10affd640 1 -- 172.21.15.165:0/356249553 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff23004b040 con 0x5578c3a61630 2024-09-22T08:11:06.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.286+0000 7ff10affd640 1 -- 172.21.15.165:0/356249553 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff23004de50 con 0x5578c3a61630 2024-09-22T08:11:06.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.286+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578c3a69400 con 0x5578c3a61630 2024-09-22T08:11:06.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.286+0000 7ff10affd640 1 -- 172.21.15.165:0/356249553 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff230011460 con 0x5578c3a61630 2024-09-22T08:11:06.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.286+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c3a69d80 con 0x5578c3a61630 2024-09-22T08:11:06.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.286+0000 7ff10affd640 1 -- 172.21.15.165:0/356249553 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff2300459f0 con 0x5578c3a61630 2024-09-22T08:11:06.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.287+0000 7ff10affd640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10003cf60 0x7ff10003f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.287+0000 7ff10affd640 1 -- 172.21.15.165:0/356249553 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff23000e040 con 0x5578c3a61630 2024-09-22T08:11:06.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.287+0000 7ff235154640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10003cf60 0x7ff10003f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.287+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.287+0000 7ff237663800 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3a746d0 0x5578c3a76b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.287+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a772e0 con 0x5578c3a746d0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.287+0000 7ff235154640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10003cf60 0x7ff10003f420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff22805d8c0 tx=0x7ff228088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.287+0000 7ff22c953640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3a746d0 0x5578c3a76b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.287+0000 7ff22c953640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3a746d0 0x5578c3a76b90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff220009050 con 0x5578c3a746d0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 20 realm 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a73a20 con 0x5578c3a746d0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff220009050 con 0x5578c3a746d0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a77dc0 con 0x5578c3a746d0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff220009050 con 0x5578c3a746d0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a78690 con 0x5578c3a746d0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff220009050 con 0x5578c3a746d0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a78fd0 0x5578c3a7b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a7bb00 con 0x5578c3a78fd0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.288+0000 7ff235955640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a78fd0 0x5578c3a7b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.289+0000 7ff235955640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a78fd0 0x5578c3a7b3c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.289+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.289+0000 7ff237663800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.289+0000 7ff237663800 20 searching for the correct realm 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.289+0000 7ff237663800 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5578c3a7db80 0x5578c3a80040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.289+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a7db80 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.289+0000 7ff235154640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5578c3a7db80 0x5578c3a80040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.289+0000 7ff235154640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5578c3a7db80 0x5578c3a80040 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.290+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.290+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a78fd0 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.290+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.290+0000 7ff235955640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff230037070 0x7ff230015800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.290+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x7ff230037070 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.290+0000 7ff22c953640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff230037070 0x7ff230015800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.291+0000 7ff22c953640 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff230037070 0x7ff230015800 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.291+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220009050 con 0x7ff230037070 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.291+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a746d0 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.291+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220009050 con 0x5578c3a746d0 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.291+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a746d0 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.291+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.291+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x7ff230037070 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.291+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.292+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x7ff230037070 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.292+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.292+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a78fd0 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.292+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.292+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a7db80 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.292+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.292+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a746d0 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.292+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.292+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x7ff230037070 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.293+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.293+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a746d0 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.293+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.293+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a78fd0 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.293+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.293+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a7db80 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.293+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.293+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a7db80 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.294+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.294+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x7ff230037070 2024-09-22T08:11:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.294+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.294+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a7db80 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.294+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.294+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a7db80 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.294+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.294+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a746d0 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.294+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.294+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a746d0 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.295+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.295+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x7ff230037070 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.295+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.295+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a7db80 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.295+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.295+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a78fd0 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.295+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.295+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a746d0 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.296+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.296+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x7ff230037070 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.296+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.296+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a7db80 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.296+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.296+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x7ff230037070 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.296+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.296+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a78fd0 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.297+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.297+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a7db80 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.297+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.297+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x7ff230037070 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.297+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.297+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a746d0 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.297+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.297+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a80710 con 0x5578c3a78fd0 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a7c580 con 0x5578c3a746d0 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a7ca00 con 0x5578c3a746d0 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a7cee0 con 0x5578c3a746d0 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 zone default found 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 4 Realm: () 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 zonegroup default 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.298+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a7c180 con 0x7ff230037070 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff237663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a82ae0 con 0x5578c3a7db80 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff237663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a82f90 con 0x5578c3a7db80 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff237663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff237663800 20 started sync module instance, tier type = 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff237663800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:06.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.299+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a81f50 con 0x5578c3a78fd0 2024-09-22T08:11:06.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.300+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.300+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93977167012672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a838a0 con 0x5578c3a78fd0 2024-09-22T08:11:06.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.300+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a840f0 con 0x5578c3a746d0 2024-09-22T08:11:06.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.301+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93977167012672] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.301+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.301+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93977167016944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a83dc0 con 0x5578c3a746d0 2024-09-22T08:11:06.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.301+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a848e0 con 0x5578c3a7db80 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.302+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.303+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93977167020976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a85180 con 0x5578c3a7db80 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.303+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a85c50 con 0x5578c3a78fd0 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.303+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93977167016944] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.303+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93977167020976] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.303+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.304+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93977167025984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a84cd0 con 0x5578c3a78fd0 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.304+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a864f0 con 0x5578c3a746d0 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.304+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.304+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93977167028288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a86910 con 0x5578c3a746d0 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.304+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a87160 con 0x7ff230037070 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.305+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93977167025984] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.305+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.305+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93977167030544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a87550 con 0x7ff230037070 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.305+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a87da0 con 0x7ff230037070 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.305+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93977167028288] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.306+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93977167030544] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.307+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.307+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93977167029344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a86e40 con 0x7ff230037070 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.307+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a87f80 con 0x7ff230037070 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.308+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93977167029344] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.308+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.308+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93977167034992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a87f80 con 0x7ff230037070 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.308+0000 7ff237663800 20 add_watcher() i=0 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.308+0000 7ff237663800 20 add_watcher() i=1 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.308+0000 7ff237663800 20 add_watcher() i=2 2024-09-22T08:11:06.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.308+0000 7ff237663800 20 add_watcher() i=3 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.308+0000 7ff237663800 20 add_watcher() i=4 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.308+0000 7ff237663800 20 add_watcher() i=5 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.308+0000 7ff237663800 20 add_watcher() i=6 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.309+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93977167034992] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.309+0000 7ff237663800 20 add_watcher() i=7 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.309+0000 7ff237663800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.309+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a8b480 con 0x5578c3a746d0 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.309+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.309+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93977167033376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3a88800 con 0x5578c3a746d0 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.310+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93977167033376] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.310+0000 7ff0eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.310+0000 7ff237663800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:06.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.310+0000 7ff237663800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.310+0000 7ff237663800 5 note: GC not initialized 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.310+0000 7ff0ea7e4640 20 reqs_thread_entry: start 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.310+0000 7ff237663800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff237663800 20 Filter name: none 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff05bfff640 20 reqs_thread_entry: start 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abe470 con 0x5578c3a746d0 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff237663800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff237663800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abee90 con 0x5578c3a746d0 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff237663800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:06.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.311+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abfea0 con 0x5578c3a78fd0 2024-09-22T08:11:06.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.312+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.313+0000 7ff0eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.313+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93977167033376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abc210 con 0x5578c3a746d0 2024-09-22T08:11:06.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.314+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93977167033376] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.314+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93977167012672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abc210 con 0x5578c3a78fd0 2024-09-22T08:11:06.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.315+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93977167012672] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.315+0000 7ff237663800 20 remove_watcher() i=0 2024-09-22T08:11:06.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.315+0000 7ff237663800 2 removed watcher, disabling cache 2024-09-22T08:11:06.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.315+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93977167016944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abc210 con 0x5578c3a746d0 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.316+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93977167016944] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.316+0000 7ff237663800 20 remove_watcher() i=1 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.316+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93977167020976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abc210 con 0x5578c3a7db80 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.317+0000 7ff235154640 1 -- 172.21.15.165:0/356249553 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93977167020976] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff228051070 con 0x5578c3a7db80 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.317+0000 7ff237663800 20 remove_watcher() i=2 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.317+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93977167025984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abc210 con 0x5578c3a78fd0 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.318+0000 7ff235955640 1 -- 172.21.15.165:0/356249553 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93977167025984] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff23002a070 con 0x5578c3a78fd0 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.318+0000 7ff237663800 20 remove_watcher() i=3 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.318+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93977167028288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abc210 con 0x5578c3a746d0 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.319+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93977167028288] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x5578c3a746d0 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.319+0000 7ff237663800 20 remove_watcher() i=4 2024-09-22T08:11:06.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.319+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93977167030544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abc210 con 0x7ff230037070 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.320+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93977167030544] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.320+0000 7ff237663800 20 remove_watcher() i=5 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.320+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93977167029344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abc210 con 0x7ff230037070 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.321+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93977167029344] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.321+0000 7ff237663800 20 remove_watcher() i=6 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.321+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93977167034992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578c3abc210 con 0x7ff230037070 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93977167034992] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220029040 con 0x7ff230037070 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 20 remove_watcher() i=7 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff230037070 msgr2=0x7ff230015800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff230037070 0x7ff230015800 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3a746d0 msgr2=0x5578c3a76b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3a746d0 0x5578c3a76b90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a78fd0 msgr2=0x5578c3a7b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a78fd0 0x5578c3a7b3c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5578c3a7db80 msgr2=0x5578c3a80040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5578c3a7db80 0x5578c3a80040 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10003cf60 msgr2=0x7ff10003f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10003cf60 0x7ff10003f420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff22805d8c0 tx=0x7ff228088000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 msgr2=0x5578c3a68c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff22c953640 1 -- 172.21.15.165:0/356249553 reap_dead start 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a68c10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff2300014d0 tx=0x7ff2300547b0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 shutdown_connections 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/356249553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a61630 0x5578c3a68c10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 >> 172.21.15.165:0/356249553 conn(0x5578c3a5da30 msgr2=0x5578c3a5bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 shutdown_connections 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/356249553 wait complete. 2024-09-22T08:11:06.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/93135167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10c03cfb0 msgr2=0x7ff10c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/93135167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10c03cfb0 0x7ff10c03f470 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5578c3a3bd90 tx=0x7ff22805ce20 comp rx=0 tx=0).stop 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/93135167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a54b90 msgr2=0x5578c3a54fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/93135167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a54b90 0x5578c3a54fb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff23000a2a0 tx=0x7ff230018830 comp rx=0 tx=0).stop 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/93135167 shutdown_connections 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/93135167 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff10c03cfb0 0x7ff10c03f470 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 --2- 172.21.15.165:0/93135167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c3a54b90 0x5578c3a54fb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.322+0000 7ff237663800 1 -- 172.21.15.165:0/93135167 >> 172.21.15.165:0/93135167 conn(0x5578c3a48f40 msgr2=0x5578c3a49320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 -- 172.21.15.165:0/93135167 shutdown_connections 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 -- 172.21.15.165:0/93135167 wait complete. 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3945a20 msgr2=0x5578c3a412f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3945a20 0x5578c3a412f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a436d0 msgr2=0x5578c3a45b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a436d0 0x5578c3a45b50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff11c03cfb0 msgr2=0x7ff11c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff11c03cfb0 0x7ff11c03f470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff220001d70 tx=0x7ff2200012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 msgr2=0x5578c3a39ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a39ca0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff228025c20 tx=0x7ff228002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 shutdown_connections 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5578c3a436d0 0x5578c3a45b50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5578c3945a20 0x5578c3a412f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff11c03cfb0 0x7ff11c03f470 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 --2- 172.21.15.165:0/4183669719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5578c38b4530 0x5578c3a39ca0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 >> 172.21.15.165:0/4183669719 conn(0x5578c393abe0 msgr2=0x5578c3a2c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 shutdown_connections 2024-09-22T08:11:06.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.323+0000 7ff237663800 1 -- 172.21.15.165:0/4183669719 wait complete. 2024-09-22T08:11:06.333 INFO:teuthology.orchestra.run.smithi165.stdout:["myfoo"] 2024-09-22T08:11:06.333 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-22T08:11:06.387 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:06.387 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-22T08:11:06.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-22T08:11:06.388 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-22T08:11:06.430 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:06.430 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:06.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.430+0000 7f5b6a413800 1 Processor -- start 2024-09-22T08:11:06.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.430+0000 7f5b6a413800 1 -- start start 2024-09-22T08:11:06.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.430+0000 7f5b6a413800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5648559ddb70 0x5648559dff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.430+0000 7f5b6a413800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564855864a20 con 0x5648559da060 2024-09-22T08:11:06.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.430+0000 7f5b6a413800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5648558647d0 con 0x5648559ddb70 2024-09-22T08:11:06.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.430+0000 7f5b65391640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5648559ddb70 0x5648559dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.430+0000 7f5b65b92640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5648559da060 0x5648559dc450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33676/0 (socket says 172.21.15.165:33676) 2024-09-22T08:11:06.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.431+0000 7f5b65b92640 1 -- 172.21.15.165:0/559309265 learned_addr learned my addr 172.21.15.165:0/559309265 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:06.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.431+0000 7f5b65391640 1 -- 172.21.15.165:0/559309265 >> v1:172.21.15.53:6789/0 conn(0x5648559da060 legacy=0x5648559dc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.431+0000 7f5b64b90640 1 -- 172.21.15.165:0/559309265 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282775026 0 0) 0x564855864a20 con 0x5648559da060 2024-09-22T08:11:06.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.431+0000 7f5b65391640 1 -- 172.21.15.165:0/559309265 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648559e1540 con 0x5648559ddb70 2024-09-22T08:11:06.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b65391640 1 --2- 172.21.15.165:0/559309265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559ddb70 0x5648559dff60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00a470 tx=0x7f5b5c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775cd108ffcdca48 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b64b90640 1 -- 172.21.15.165:0/559309265 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5c053570 con 0x5648559ddb70 2024-09-22T08:11:06.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b64b90640 1 -- 172.21.15.165:0/559309265 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5c058070 con 0x5648559ddb70 2024-09-22T08:11:06.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b64b90640 1 -- 172.21.15.165:0/559309265 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5c053880 con 0x5648559ddb70 2024-09-22T08:11:06.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b6a413800 1 -- 172.21.15.165:0/559309265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559ddb70 msgr2=0x5648559dff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b6a413800 1 --2- 172.21.15.165:0/559309265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559ddb70 0x5648559dff60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00a470 tx=0x7f5b5c045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:06.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b6a413800 1 -- 172.21.15.165:0/559309265 shutdown_connections 2024-09-22T08:11:06.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b6a413800 1 --2- 172.21.15.165:0/559309265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559ddb70 0x5648559dff60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b6a413800 1 -- 172.21.15.165:0/559309265 >> 172.21.15.165:0/559309265 conn(0x5648559d3ba0 msgr2=0x5648559d6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b6a413800 1 -- 172.21.15.165:0/559309265 shutdown_connections 2024-09-22T08:11:06.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.433+0000 7f5b6a413800 1 -- 172.21.15.165:0/559309265 wait complete. 2024-09-22T08:11:06.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.447+0000 7f5b6a413800 1 Processor -- start 2024-09-22T08:11:06.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.447+0000 7f5b6a413800 1 -- start start 2024-09-22T08:11:06.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.447+0000 7f5b6a413800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ac8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.447+0000 7f5b6a413800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564855871dd0 con 0x5648559da060 2024-09-22T08:11:06.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.448+0000 7f5b65b92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ac8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.448+0000 7f5b65b92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ac8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51986/0 (socket says 172.21.15.165:51986) 2024-09-22T08:11:06.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.448+0000 7f5b65b92640 1 -- 172.21.15.165:0/3455227339 learned_addr learned my addr 172.21.15.165:0/3455227339 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.448+0000 7f5b65b92640 1 -- 172.21.15.165:0/3455227339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564855ac9470 con 0x5648559da060 2024-09-22T08:11:06.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.448+0000 7f5b65b92640 1 --2- 172.21.15.165:0/3455227339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ac8e80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b58001ea0 tx=0x7f5b5800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb6cc4c156492a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.449+0000 7f5a53e07640 1 -- 172.21.15.165:0/3455227339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b58008070 con 0x5648559da060 2024-09-22T08:11:06.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.449+0000 7f5a53e07640 1 -- 172.21.15.165:0/3455227339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5800d500 con 0x5648559da060 2024-09-22T08:11:06.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.449+0000 7f5a53e07640 1 -- 172.21.15.165:0/3455227339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5800d880 con 0x5648559da060 2024-09-22T08:11:06.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.449+0000 7f5b6a413800 1 -- 172.21.15.165:0/3455227339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 msgr2=0x564855ac8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.449+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3455227339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ac8e80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b58001ea0 tx=0x7f5b5800b6a0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.449+0000 7f5b6a413800 1 -- 172.21.15.165:0/3455227339 shutdown_connections 2024-09-22T08:11:06.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.449+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3455227339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ac8e80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.449+0000 7f5b6a413800 1 -- 172.21.15.165:0/3455227339 >> 172.21.15.165:0/3455227339 conn(0x5648559d3ba0 msgr2=0x564855ac4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.449+0000 7f5b6a413800 1 -- 172.21.15.165:0/3455227339 shutdown_connections 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.449+0000 7f5b6a413800 1 -- 172.21.15.165:0/3455227339 wait complete. 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.450+0000 7f5b6a413800 1 Processor -- start 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.450+0000 7f5b6a413800 1 -- start start 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.450+0000 7f5b6a413800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ad0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.450+0000 7f5b6a413800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5648559e0830 con 0x5648559da060 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.450+0000 7f5b65b92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ad0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.450+0000 7f5b65b92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ad0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51994/0 (socket says 172.21.15.165:51994) 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.450+0000 7f5b65b92640 1 -- 172.21.15.165:0/3074614609 learned_addr learned my addr 172.21.15.165:0/3074614609 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.450+0000 7f5b65b92640 1 -- 172.21.15.165:0/3074614609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564855ad0ed0 con 0x5648559da060 2024-09-22T08:11:06.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.451+0000 7f5b65b92640 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ad0970 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5b580012f0 tx=0x7f5b58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.451+0000 7f5a52604640 1 -- 172.21.15.165:0/3074614609 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5800f9d0 con 0x5648559da060 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.451+0000 7f5a52604640 1 -- 172.21.15.165:0/3074614609 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5800fb70 con 0x5648559da060 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.451+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564855ad1160 con 0x5648559da060 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.451+0000 7f5a52604640 1 -- 172.21.15.165:0/3074614609 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5800fe50 con 0x5648559da060 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.451+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564855ad1b60 con 0x5648559da060 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.452+0000 7f5a52604640 1 -- 172.21.15.165:0/3074614609 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5b58017040 con 0x5648559da060 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.452+0000 7f5a52604640 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4c03d1a0 0x7f5a4c03f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.452+0000 7f5a52604640 1 -- 172.21.15.165:0/3074614609 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5b58015020 con 0x5648559da060 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.452+0000 7f5b65391640 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4c03d1a0 0x7f5a4c03f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.452+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5648559ddb70 0x564855ad7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.452+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855ad8500 con 0x5648559ddb70 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.452+0000 7f5b66393640 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5648559ddb70 0x564855ad7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.453+0000 7f5b65391640 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4c03d1a0 0x7f5a4c03f660 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c057000 tx=0x7f5b5c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.453+0000 7f5b66393640 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5648559ddb70 0x564855ad7fc0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.453+0000 7f5b66393640 1 -- 172.21.15.165:0/3074614609 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b6000a4d0 con 0x5648559ddb70 2024-09-22T08:11:06.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.453+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855ad88a0 con 0x5648559ddb70 2024-09-22T08:11:06.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.453+0000 7f5b66393640 1 -- 172.21.15.165:0/3074614609 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b6000a4d0 con 0x5648559ddb70 2024-09-22T08:11:06.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.453+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855ada3a0 0x564855adc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.453+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855adcfb0 con 0x564855ada3a0 2024-09-22T08:11:06.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.453+0000 7f5b65b92640 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855ada3a0 0x564855adc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.454+0000 7f5b65b92640 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855ada3a0 0x564855adc820 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.454+0000 7f5b65b92640 1 -- 172.21.15.165:0/3074614609 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b58054040 con 0x564855ada3a0 2024-09-22T08:11:06.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.454+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855ad90f0 con 0x5648559ddb70 2024-09-22T08:11:06.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.454+0000 7f5b66393640 1 -- 172.21.15.165:0/3074614609 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b6000a4d0 con 0x5648559ddb70 2024-09-22T08:11:06.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.454+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855ad9540 con 0x5648559ddb70 2024-09-22T08:11:06.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.455+0000 7f5b66393640 1 -- 172.21.15.165:0/3074614609 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b6000a4d0 con 0x5648559ddb70 2024-09-22T08:11:06.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.455+0000 7f5b6a413800 1 Processor -- start 2024-09-22T08:11:06.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.455+0000 7f5b6a413800 1 -- start start 2024-09-22T08:11:06.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.455+0000 7f5b6a413800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855aeb930 0x564855aebd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.455+0000 7f5b6a413800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5648558d0d50 con 0x564855aeb930 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.455+0000 7f5b66393640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855aeb930 0x564855aebd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.455+0000 7f5b66393640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855aeb930 0x564855aebd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52002/0 (socket says 172.21.15.165:52002) 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.455+0000 7f5b66393640 1 -- 172.21.15.165:0/2511086898 learned_addr learned my addr 172.21.15.165:0/2511086898 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.456+0000 7f5b66393640 1 -- 172.21.15.165:0/2511086898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564855aec390 con 0x564855aeb930 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.456+0000 7f5b66393640 1 --2- 172.21.15.165:0/2511086898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855aeb930 0x564855aebd50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000a2a0 tx=0x7f5b60018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.456+0000 7f5a4b7fe640 1 -- 172.21.15.165:0/2511086898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b60014450 con 0x564855aeb930 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.456+0000 7f5a4b7fe640 1 -- 172.21.15.165:0/2511086898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b600145f0 con 0x564855aeb930 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.456+0000 7f5a4b7fe640 1 -- 172.21.15.165:0/2511086898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b60014910 con 0x564855aeb930 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.456+0000 7f5b6a413800 1 -- 172.21.15.165:0/2511086898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564855aecbc0 con 0x564855aeb930 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.456+0000 7f5b6a413800 1 -- 172.21.15.165:0/2511086898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564855aed160 con 0x564855aeb930 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.457+0000 7f5a4b7fe640 1 -- 172.21.15.165:0/2511086898 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5b60011040 con 0x564855aeb930 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.457+0000 7f5a4b7fe640 1 --2- 172.21.15.165:0/2511086898 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4003cfb0 0x7f5a4003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.457+0000 7f5a4b7fe640 1 -- 172.21.15.165:0/2511086898 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5b6001e070 con 0x564855aeb930 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.457+0000 7f5b65b92640 1 --2- 172.21.15.165:0/2511086898 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4003cfb0 0x7f5a4003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5b6a413800 1 Processor -- start 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5b65b92640 1 --2- 172.21.15.165:0/2511086898 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4003cfb0 0x7f5a4003f470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x564855ad2a60 tx=0x7f5b580011b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5b6a413800 1 -- start start 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5b6a413800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855af87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5b6a413800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564855ac98a0 con 0x564855af83d0 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5b66393640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855af87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5b66393640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855af87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52008/0 (socket says 172.21.15.165:52008) 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5b66393640 1 -- 172.21.15.165:0/1193469787 learned_addr learned my addr 172.21.15.165:0/1193469787 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5b66393640 1 -- 172.21.15.165:0/1193469787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564855af8dc0 con 0x564855af83d0 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5b66393640 1 --2- 172.21.15.165:0/1193469787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855af87d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5b60016fd0 tx=0x7f5b60011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b42202577913b6c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.458+0000 7f5a497fa640 1 -- 172.21.15.165:0/1193469787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b6004b070 con 0x564855af83d0 2024-09-22T08:11:06.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5a497fa640 1 -- 172.21.15.165:0/1193469787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b60051070 con 0x564855af83d0 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5a497fa640 1 -- 172.21.15.165:0/1193469787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b60053450 con 0x564855af83d0 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5b6a413800 1 -- 172.21.15.165:0/1193469787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 msgr2=0x564855af87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1193469787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855af87d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5b60016fd0 tx=0x7f5b60011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5b6a413800 1 -- 172.21.15.165:0/1193469787 shutdown_connections 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1193469787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855af87d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5b6a413800 1 -- 172.21.15.165:0/1193469787 >> 172.21.15.165:0/1193469787 conn(0x564855af47d0 msgr2=0x564855af2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5b6a413800 1 -- 172.21.15.165:0/1193469787 shutdown_connections 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5b6a413800 1 -- 172.21.15.165:0/1193469787 wait complete. 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5b6a413800 1 Processor -- start 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.459+0000 7f5b6a413800 1 -- start start 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5b6a413800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855aff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5b6a413800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564855af93e0 con 0x564855af83d0 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5b66393640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855aff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5b66393640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855aff9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52018/0 (socket says 172.21.15.165:52018) 2024-09-22T08:11:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 learned_addr learned my addr 172.21.15.165:0/1924443226 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564855afff20 con 0x564855af83d0 2024-09-22T08:11:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5b66393640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855aff9c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b600014d0 tx=0x7f5b600547b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5a377fe640 1 -- 172.21.15.165:0/1924443226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b6004b040 con 0x564855af83d0 2024-09-22T08:11:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5a377fe640 1 -- 172.21.15.165:0/1924443226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6004de50 con 0x564855af83d0 2024-09-22T08:11:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564855b001b0 con 0x564855af83d0 2024-09-22T08:11:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5a377fe640 1 -- 172.21.15.165:0/1924443226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b60011330 con 0x564855af83d0 2024-09-22T08:11:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.460+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564855b00b30 con 0x564855af83d0 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.461+0000 7f5a377fe640 1 -- 172.21.15.165:0/1924443226 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5b60056070 con 0x564855af83d0 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.461+0000 7f5a377fe640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a3003cfb0 0x7f5a3003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.461+0000 7f5a377fe640 1 -- 172.21.15.165:0/1924443226 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5b6000e040 con 0x564855af83d0 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.461+0000 7f5b65b92640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a3003cfb0 0x7f5a3003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.461+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.462+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x564855b0b4a0 0x564855b0d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.462+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b0e080 con 0x564855b0b4a0 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.462+0000 7f5b65391640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x564855b0b4a0 0x564855b0d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.462+0000 7f5b65b92640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a3003cfb0 0x7f5a3003f470 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5b58019fd0 tx=0x7f5b58041000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.462+0000 7f5b65391640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x564855b0b4a0 0x564855b0d930 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.462+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.462+0000 7f5b6a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.462+0000 7f5b6a413800 20 realm 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.462+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.462+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b0e4b0 con 0x564855b0b4a0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b0ed80 con 0x564855b0b4a0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b0f120 con 0x564855b0b4a0 2024-09-22T08:11:06.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855b0fe80 0x564855b12270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b127b0 con 0x564855b0fe80 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b66393640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855b0fe80 0x564855b12270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.463+0000 7f5b66393640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855b0fe80 0x564855b12270 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.464+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.464+0000 7f5b6a413800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.464+0000 7f5b6a413800 20 searching for the correct realm 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.464+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x564855b147f0 0x564855b16cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.464+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b147f0 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.464+0000 7f5b65b92640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x564855b147f0 0x564855b16cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.464+0000 7f5b65b92640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x564855b147f0 0x564855b16cb0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.464+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.464+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0fe80 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.465+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.465+0000 7f5b66393640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5b60014070 0x7f5b6002ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.465+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x7f5b60014070 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.465+0000 7f5b65391640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5b60014070 0x7f5b6002ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.465+0000 7f5b65391640 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5b60014070 0x7f5b6002ca40 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.465+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.465+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0b4a0 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.466+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.466+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0b4a0 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.466+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.466+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x7f5b60014070 2024-09-22T08:11:06.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.466+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.466+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x7f5b60014070 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.466+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.466+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0fe80 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.467+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.467+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b147f0 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.467+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.467+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0b4a0 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.467+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.467+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x7f5b60014070 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.467+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.467+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0b4a0 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.467+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.468+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0fe80 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.468+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.468+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b147f0 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.468+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.468+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b147f0 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.468+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.468+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x7f5b60014070 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.468+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.468+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b147f0 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.469+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.469+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b147f0 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.469+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.469+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0b4a0 2024-09-22T08:11:06.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.469+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.469+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0b4a0 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.469+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.469+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x7f5b60014070 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.469+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.469+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b147f0 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.470+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.470+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0fe80 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.470+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.470+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0b4a0 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.470+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.470+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x7f5b60014070 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.470+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.470+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b147f0 2024-09-22T08:11:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.471+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.471+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x7f5b60014070 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.471+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.471+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0fe80 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.471+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.471+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b147f0 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.471+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.471+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x7f5b60014070 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.471+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.471+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0b4a0 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b17380 con 0x564855b0fe80 2024-09-22T08:11:06.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b13220 con 0x564855b0b4a0 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b12e30 con 0x564855b0b4a0 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.472+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b13b90 con 0x564855b0b4a0 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 20 zone default found 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 4 Realm: () 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 20 zonegroup default 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b136f0 con 0x7f5b60014070 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b19720 con 0x564855b147f0 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b19c00 con 0x564855b147f0 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.473+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.474+0000 7f5b6a413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.474+0000 7f5b6a413800 20 started sync module instance, tier type = 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.474+0000 7f5b6a413800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.474+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0fe80 2024-09-22T08:11:06.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.475+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.475+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94868675334064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1a510 con 0x564855b0fe80 2024-09-22T08:11:06.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.475+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1ad60 con 0x564855b0b4a0 2024-09-22T08:11:06.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.476+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94868675334064] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.476+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.476+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94868675338336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1aa30 con 0x564855b0b4a0 2024-09-22T08:11:06.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.476+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1b4d0 con 0x564855b147f0 2024-09-22T08:11:06.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.477+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.477+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94868675342272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1bda0 con 0x564855b147f0 2024-09-22T08:11:06.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.477+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1c880 con 0x564855b0fe80 2024-09-22T08:11:06.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.477+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94868675338336] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.478+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94868675342272] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.478+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.478+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94868675344624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1a480 con 0x564855b0fe80 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.478+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1d290 con 0x564855b0b4a0 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.479+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.479+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94868675349984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1d6b0 con 0x564855b0b4a0 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.479+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1e160 con 0x7f5b60014070 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.479+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94868675344624] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.480+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.480+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94868675347344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1e160 con 0x7f5b60014070 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.480+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1ebb0 con 0x7f5b60014070 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.480+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94868675349984] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.481+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94868675347344] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.481+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.481+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94868675351040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1e6c0 con 0x7f5b60014070 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.481+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1f080 con 0x7f5b60014070 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.482+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94868675351040] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.482+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.482+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94868675353664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1f080 con 0x7f5b60014070 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.482+0000 7f5b6a413800 20 add_watcher() i=0 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.482+0000 7f5b6a413800 20 add_watcher() i=1 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.482+0000 7f5b6a413800 20 add_watcher() i=2 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.482+0000 7f5b6a413800 20 add_watcher() i=3 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.482+0000 7f5b6a413800 20 add_watcher() i=4 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.482+0000 7f5b6a413800 20 add_watcher() i=5 2024-09-22T08:11:06.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.482+0000 7f5b6a413800 20 add_watcher() i=6 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.483+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94868675353664] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.483+0000 7f5b6a413800 20 add_watcher() i=7 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.483+0000 7f5b6a413800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.483+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564855b22520 con 0x564855b0b4a0 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.483+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.483+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94868675370704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1f1f0 con 0x564855b0b4a0 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.484+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94868675370704] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.484+0000 7f5a177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.484+0000 7f5b6a413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.484+0000 7f5b6a413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.485+0000 7f5b6a413800 5 note: GC not initialized 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.485+0000 7f5a167fc640 20 reqs_thread_entry: start 2024-09-22T08:11:06.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.485+0000 7f5b6a413800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.485+0000 7f5b6a413800 20 Filter name: none 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.485+0000 7f5987fff640 20 reqs_thread_entry: start 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.485+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b54ff0 con 0x564855b147f0 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.485+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.485+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b54ff0 con 0x564855b147f0 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.485+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.486+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b54ff0 con 0x564855b0b4a0 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.486+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.486+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b13b90 con 0x564855b0b4a0 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.486+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.486+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b13b90 con 0x564855b0fe80 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.486+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.486+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b147f0 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.486+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.486+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0b4a0 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.487+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.487+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b147f0 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.487+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.487+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0fe80 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.487+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.487+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b147f0 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.487+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.487+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0b4a0 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.488+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.488+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x7f5b60014070 2024-09-22T08:11:06.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.488+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.488+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x7f5b60014070 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.488+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.488+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b147f0 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.488+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.488+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x7f5b60014070 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.489+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.489+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x7f5b60014070 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.489+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.489+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x7f5b60014070 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.489+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.489+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b147f0 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.489+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.489+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0fe80 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.490+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.490+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0b4a0 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.490+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.490+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0b4a0 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.490+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.490+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b147f0 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.490+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.490+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0fe80 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.490+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.490+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x7f5b60014070 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.491+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.491+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0b4a0 2024-09-22T08:11:06.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.491+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.491+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x7f5b60014070 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.491+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.491+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b147f0 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.491+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.491+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0fe80 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.492+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.492+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x7f5b60014070 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.492+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.492+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0b4a0 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.492+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.492+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b147f0 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.492+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.492+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564855b18bc0 con 0x564855b0fe80 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.493+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.493+0000 7f5b6a413800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.493+0000 7f5b6a413800 20 RGWRados::pool_iterate: got myfoo 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.493+0000 7f5a177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.493+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94868675370704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b13b90 con 0x564855b0b4a0 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.494+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94868675370704] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.494+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94868675334064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b53230 con 0x564855b0fe80 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.495+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94868675334064] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.495+0000 7f5b6a413800 20 remove_watcher() i=0 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.495+0000 7f5b6a413800 2 removed watcher, disabling cache 2024-09-22T08:11:06.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.495+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94868675338336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b53230 con 0x564855b0b4a0 2024-09-22T08:11:06.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.497+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94868675338336] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.497+0000 7f5b6a413800 20 remove_watcher() i=1 2024-09-22T08:11:06.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.497+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94868675342272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b53230 con 0x564855b147f0 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.498+0000 7f5b65b92640 1 -- 172.21.15.165:0/1924443226 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94868675342272] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b58039070 con 0x564855b147f0 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.498+0000 7f5b6a413800 20 remove_watcher() i=2 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.498+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94868675344624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1a060 con 0x564855b0fe80 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.499+0000 7f5b66393640 1 -- 172.21.15.165:0/1924443226 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94868675344624] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b6003c020 con 0x564855b0fe80 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.499+0000 7f5b6a413800 20 remove_watcher() i=3 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.499+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94868675349984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1b8f0 con 0x564855b0b4a0 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.500+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94868675349984] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x564855b0b4a0 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.500+0000 7f5b6a413800 20 remove_watcher() i=4 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.500+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94868675347344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1a060 con 0x7f5b60014070 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.501+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94868675347344] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.501+0000 7f5b6a413800 20 remove_watcher() i=5 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.501+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94868675351040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1cde0 con 0x7f5b60014070 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.502+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94868675351040] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.502+0000 7f5b6a413800 20 remove_watcher() i=6 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.502+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94868675353664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564855b1a060 con 0x7f5b60014070 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.502+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94868675353664] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c051070 con 0x7f5b60014070 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.502+0000 7f5b6a413800 20 remove_watcher() i=7 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5b60014070 msgr2=0x7f5b6002ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5b60014070 0x7f5b6002ca40 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x564855b0b4a0 msgr2=0x564855b0d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x564855b0b4a0 0x564855b0d930 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855b0fe80 msgr2=0x564855b12270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855b0fe80 0x564855b12270 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x564855b147f0 msgr2=0x564855b16cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x564855b147f0 0x564855b16cb0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a3003cfb0 msgr2=0x7f5a3003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a3003cfb0 0x7f5a3003f470 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5b58019fd0 tx=0x7f5b58041000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 msgr2=0x564855aff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b65391640 1 -- 172.21.15.165:0/1924443226 reap_dead start 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855aff9c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b600014d0 tx=0x7f5b600547b0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 shutdown_connections 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/1924443226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855af83d0 0x564855aff9c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 >> 172.21.15.165:0/1924443226 conn(0x564855af47d0 msgr2=0x564855af29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 shutdown_connections 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/1924443226 wait complete. 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/2511086898 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4003cfb0 msgr2=0x7f5a4003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/2511086898 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4003cfb0 0x7f5a4003f470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x564855ad2a60 tx=0x7f5b580011b0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/2511086898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855aeb930 msgr2=0x564855aebd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/2511086898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855aeb930 0x564855aebd50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000a2a0 tx=0x7f5b60018830 comp rx=0 tx=0).stop 2024-09-22T08:11:06.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/2511086898 shutdown_connections 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/2511086898 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4003cfb0 0x7f5a4003f470 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 --2- 172.21.15.165:0/2511086898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564855aeb930 0x564855aebd50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/2511086898 >> 172.21.15.165:0/2511086898 conn(0x564855adfce0 msgr2=0x564855ae00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/2511086898 shutdown_connections 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.503+0000 7f5b6a413800 1 -- 172.21.15.165:0/2511086898 wait complete. 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5648559ddb70 msgr2=0x564855ad7fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5648559ddb70 0x564855ad7fc0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855ada3a0 msgr2=0x564855adc820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855ada3a0 0x564855adc820 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4c03d1a0 msgr2=0x7f5a4c03f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4c03d1a0 0x7f5a4c03f660 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c057000 tx=0x7f5b5c052000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 msgr2=0x564855ad0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ad0970 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5b580012f0 tx=0x7f5b58000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 shutdown_connections 2024-09-22T08:11:06.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x564855ada3a0 0x564855adc820 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5648559ddb70 0x564855ad7fc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f5a4c03d1a0 0x7f5a4c03f660 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 --2- 172.21.15.165:0/3074614609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648559da060 0x564855ad0970 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 >> 172.21.15.165:0/3074614609 conn(0x5648559d3ba0 msgr2=0x564855aca370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 shutdown_connections 2024-09-22T08:11:06.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.504+0000 7f5b6a413800 1 -- 172.21.15.165:0/3074614609 wait complete. 2024-09-22T08:11:06.516 INFO:teuthology.orchestra.run.smithi165.stdout:["myfoo"] 2024-09-22T08:11:06.516 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-22T08:11:06.528 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:06.538 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:06.548 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:06.591 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-22T08:11:06.617 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:06.645 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:06.671 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:06.671 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:11:06.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:11:06.672 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-22T08:11:06.716 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:06.717 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:06.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.716+0000 7f9a89122800 1 Processor -- start 2024-09-22T08:11:06.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.716+0000 7f9a89122800 1 -- start start 2024-09-22T08:11:06.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.717+0000 7f9a89122800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bdc16d5bf0 0x55bdc16db580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.717+0000 7f9a89122800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bdc1560a20 con 0x55bdc16d47e0 2024-09-22T08:11:06.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.717+0000 7f9a89122800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55bdc15607d0 con 0x55bdc16d5bf0 2024-09-22T08:11:06.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.717+0000 7f9a7c5d1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bdc16d5bf0 0x55bdc16db580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.717+0000 7f9a84dd2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55bdc16d47e0 0x55bdc16d54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33678/0 (socket says 172.21.15.165:33678) 2024-09-22T08:11:06.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.717+0000 7f9a84dd2640 1 -- 172.21.15.165:0/2188750462 learned_addr learned my addr 172.21.15.165:0/2188750462 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:06.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.717+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/2188750462 >> v1:172.21.15.53:6789/0 conn(0x55bdc16d47e0 legacy=0x55bdc16d54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.717+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/2188750462 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc16d4ee0 con 0x55bdc16d5bf0 2024-09-22T08:11:06.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.719+0000 7f9a7c5d1640 1 --2- 172.21.15.165:0/2188750462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d5bf0 0x55bdc16db580 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00a470 tx=0x7f9a6c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8345cb802951a532 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.719+0000 7f9a7ffff640 1 -- 172.21.15.165:0/2188750462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a6c053570 con 0x55bdc16d5bf0 2024-09-22T08:11:06.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.719+0000 7f9a7ffff640 1 -- 172.21.15.165:0/2188750462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c058070 con 0x55bdc16d5bf0 2024-09-22T08:11:06.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.719+0000 7f9a7ffff640 1 -- 172.21.15.165:0/2188750462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a6c053880 con 0x55bdc16d5bf0 2024-09-22T08:11:06.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.720+0000 7f9a89122800 1 -- 172.21.15.165:0/2188750462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d5bf0 msgr2=0x55bdc16db580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.720+0000 7f9a89122800 1 --2- 172.21.15.165:0/2188750462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d5bf0 0x55bdc16db580 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00a470 tx=0x7f9a6c045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:06.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.720+0000 7f9a89122800 1 -- 172.21.15.165:0/2188750462 shutdown_connections 2024-09-22T08:11:06.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.720+0000 7f9a89122800 1 --2- 172.21.15.165:0/2188750462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d5bf0 0x55bdc16db580 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.720+0000 7f9a89122800 1 -- 172.21.15.165:0/2188750462 >> 172.21.15.165:0/2188750462 conn(0x55bdc16cfbb0 msgr2=0x55bdc16d2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.720+0000 7f9a89122800 1 -- 172.21.15.165:0/2188750462 shutdown_connections 2024-09-22T08:11:06.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.720+0000 7f9a89122800 1 -- 172.21.15.165:0/2188750462 wait complete. 2024-09-22T08:11:06.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.734+0000 7f9a89122800 1 Processor -- start 2024-09-22T08:11:06.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.734+0000 7f9a89122800 1 -- start start 2024-09-22T08:11:06.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.734+0000 7f9a89122800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.734+0000 7f9a89122800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bdc156ddd0 con 0x55bdc16d47e0 2024-09-22T08:11:06.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.734+0000 7f9a84dd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.734+0000 7f9a84dd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17c3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52042/0 (socket says 172.21.15.165:52042) 2024-09-22T08:11:06.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.734+0000 7f9a84dd2640 1 -- 172.21.15.165:0/1144237683 learned_addr learned my addr 172.21.15.165:0/1144237683 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.734+0000 7f9a84dd2640 1 -- 172.21.15.165:0/1144237683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc17c44f0 con 0x55bdc16d47e0 2024-09-22T08:11:06.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.735+0000 7f9a84dd2640 1 --2- 172.21.15.165:0/1144237683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17c3f00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9a74001e40 tx=0x7f9a74001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b80120b3c41da28 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.735+0000 7f9972e0d640 1 -- 172.21.15.165:0/1144237683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a7400b200 con 0x55bdc16d47e0 2024-09-22T08:11:06.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.735+0000 7f9972e0d640 1 -- 172.21.15.165:0/1144237683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a74009460 con 0x55bdc16d47e0 2024-09-22T08:11:06.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.735+0000 7f9972e0d640 1 -- 172.21.15.165:0/1144237683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a74009760 con 0x55bdc16d47e0 2024-09-22T08:11:06.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.735+0000 7f9a89122800 1 -- 172.21.15.165:0/1144237683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 msgr2=0x55bdc17c3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.735+0000 7f9a89122800 1 --2- 172.21.15.165:0/1144237683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17c3f00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9a74001e40 tx=0x7f9a74001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:06.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.735+0000 7f9a89122800 1 -- 172.21.15.165:0/1144237683 shutdown_connections 2024-09-22T08:11:06.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.735+0000 7f9a89122800 1 --2- 172.21.15.165:0/1144237683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17c3f00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.735+0000 7f9a89122800 1 -- 172.21.15.165:0/1144237683 >> 172.21.15.165:0/1144237683 conn(0x55bdc16cfbb0 msgr2=0x55bdc17bf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.735+0000 7f9a89122800 1 -- 172.21.15.165:0/1144237683 shutdown_connections 2024-09-22T08:11:06.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.736+0000 7f9a89122800 1 -- 172.21.15.165:0/1144237683 wait complete. 2024-09-22T08:11:06.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.736+0000 7f9a89122800 1 Processor -- start 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.736+0000 7f9a89122800 1 -- start start 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.736+0000 7f9a89122800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.736+0000 7f9a89122800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bdc16dbac0 con 0x55bdc16d47e0 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.736+0000 7f9a84dd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.736+0000 7f9a84dd2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52058/0 (socket says 172.21.15.165:52058) 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.736+0000 7f9a84dd2640 1 -- 172.21.15.165:0/3858670489 learned_addr learned my addr 172.21.15.165:0/3858670489 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.736+0000 7f9a84dd2640 1 -- 172.21.15.165:0/3858670489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc17cae70 con 0x55bdc16d47e0 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.737+0000 7f9a84dd2640 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17ca910 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9a74000c00 tx=0x7f9a74000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.737+0000 7f997160a640 1 -- 172.21.15.165:0/3858670489 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a74027070 con 0x55bdc16d47e0 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.737+0000 7f997160a640 1 -- 172.21.15.165:0/3858670489 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a74009c80 con 0x55bdc16d47e0 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.737+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdc17cb100 con 0x55bdc16d47e0 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.737+0000 7f997160a640 1 -- 172.21.15.165:0/3858670489 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a7401b040 con 0x55bdc16d47e0 2024-09-22T08:11:06.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.737+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdc17cbd10 con 0x55bdc16d47e0 2024-09-22T08:11:06.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.738+0000 7f997160a640 1 -- 172.21.15.165:0/3858670489 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9a74016430 con 0x55bdc16d47e0 2024-09-22T08:11:06.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.738+0000 7f997160a640 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f996c03d000 0x7f996c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.738+0000 7f997160a640 1 -- 172.21.15.165:0/3858670489 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9a74011070 con 0x55bdc16d47e0 2024-09-22T08:11:06.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.738+0000 7f9a7c5d1640 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f996c03d000 0x7f996c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.738+0000 7f9a89122800 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc16d5bf0 0x55bdc17d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.738+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc17d24a0 con 0x55bdc16d5bf0 2024-09-22T08:11:06.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.738+0000 7f9a855d3640 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc16d5bf0 0x55bdc17d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.738+0000 7f9a7c5d1640 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f996c03d000 0x7f996c03f4c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c057000 tx=0x7f9a6c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.738+0000 7f9a855d3640 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc16d5bf0 0x55bdc17d1f60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.739+0000 7f9a855d3640 1 -- 172.21.15.165:0/3858670489 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a8000a4d0 con 0x55bdc16d5bf0 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.739+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc17d2840 con 0x55bdc16d5bf0 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.739+0000 7f9a855d3640 1 -- 172.21.15.165:0/3858670489 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a8000a4d0 con 0x55bdc16d5bf0 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.739+0000 7f9a89122800 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc17d4300 0x55bdc17d67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.739+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc17d6f30 con 0x55bdc17d4300 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.739+0000 7f9a84dd2640 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc17d4300 0x55bdc17d67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.739+0000 7f9a84dd2640 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc17d4300 0x55bdc17d67a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.740+0000 7f9a84dd2640 1 -- 172.21.15.165:0/3858670489 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9a7401e040 con 0x55bdc17d4300 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.740+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc17d3090 con 0x55bdc16d5bf0 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.740+0000 7f9a855d3640 1 -- 172.21.15.165:0/3858670489 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a8000a4d0 con 0x55bdc16d5bf0 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.740+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc17d3430 con 0x55bdc16d5bf0 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.740+0000 7f9a855d3640 1 -- 172.21.15.165:0/3858670489 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9a8000a4d0 con 0x55bdc16d5bf0 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.741+0000 7f9a89122800 1 Processor -- start 2024-09-22T08:11:06.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.741+0000 7f9a89122800 1 -- start start 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.741+0000 7f9a89122800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17e58c0 0x55bdc17e5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.741+0000 7f9a89122800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bdc15ccd50 con 0x55bdc17e58c0 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.741+0000 7f9a855d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17e58c0 0x55bdc17e5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.741+0000 7f9a855d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17e58c0 0x55bdc17e5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52068/0 (socket says 172.21.15.165:52068) 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.741+0000 7f9a855d3640 1 -- 172.21.15.165:0/3760741203 learned_addr learned my addr 172.21.15.165:0/3760741203 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.741+0000 7f9a855d3640 1 -- 172.21.15.165:0/3760741203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc17e6320 con 0x55bdc17e58c0 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.741+0000 7f9a855d3640 1 --2- 172.21.15.165:0/3760741203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17e58c0 0x55bdc17e5ce0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55bdc17cb7a0 tx=0x7f9a80018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.742+0000 7f996a7fc640 1 -- 172.21.15.165:0/3760741203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a80014450 con 0x55bdc17e58c0 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.742+0000 7f996a7fc640 1 -- 172.21.15.165:0/3760741203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a80014610 con 0x55bdc17e58c0 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.742+0000 7f9a89122800 1 -- 172.21.15.165:0/3760741203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdc17e6b50 con 0x55bdc17e58c0 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.742+0000 7f996a7fc640 1 -- 172.21.15.165:0/3760741203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a80014930 con 0x55bdc17e58c0 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.742+0000 7f9a89122800 1 -- 172.21.15.165:0/3760741203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdc17e70f0 con 0x55bdc17e58c0 2024-09-22T08:11:06.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.742+0000 7f996a7fc640 1 -- 172.21.15.165:0/3760741203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9a80011040 con 0x55bdc17e58c0 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f996a7fc640 1 --2- 172.21.15.165:0/3760741203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f995c03d000 0x7f995c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f996a7fc640 1 -- 172.21.15.165:0/3760741203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9a8001e070 con 0x55bdc17e58c0 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f9a84dd2640 1 --2- 172.21.15.165:0/3760741203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f995c03d000 0x7f995c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f9a89122800 1 Processor -- start 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f9a89122800 1 -- start start 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f9a84dd2640 1 --2- 172.21.15.165:0/3760741203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f995c03d000 0x7f995c03f4c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9a74014ec0 tx=0x7f9a74016720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f9a89122800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f9a89122800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bdc17c4920 con 0x55bdc17f2300 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f9a855d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f9a855d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52084/0 (socket says 172.21.15.165:52084) 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.743+0000 7f9a855d3640 1 -- 172.21.15.165:0/2781564077 learned_addr learned my addr 172.21.15.165:0/2781564077 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f9a855d3640 1 -- 172.21.15.165:0/2781564077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc17f2cf0 con 0x55bdc17f2300 2024-09-22T08:11:06.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f9a855d3640 1 --2- 172.21.15.165:0/2781564077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f2700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9a800546e0 tx=0x7f9a8002b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3291e5e546d19c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f995bfff640 1 -- 172.21.15.165:0/2781564077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a80011da0 con 0x55bdc17f2300 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f995bfff640 1 -- 172.21.15.165:0/2781564077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a80053280 con 0x55bdc17f2300 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f995bfff640 1 -- 172.21.15.165:0/2781564077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a800167c0 con 0x55bdc17f2300 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f9a89122800 1 -- 172.21.15.165:0/2781564077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 msgr2=0x55bdc17f2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f9a89122800 1 --2- 172.21.15.165:0/2781564077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f2700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9a800546e0 tx=0x7f9a8002b4c0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f9a89122800 1 -- 172.21.15.165:0/2781564077 shutdown_connections 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f9a89122800 1 --2- 172.21.15.165:0/2781564077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f2700 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f9a89122800 1 -- 172.21.15.165:0/2781564077 >> 172.21.15.165:0/2781564077 conn(0x55bdc17ee720 msgr2=0x55bdc17ec960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f9a89122800 1 -- 172.21.15.165:0/2781564077 shutdown_connections 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.744+0000 7f9a89122800 1 -- 172.21.15.165:0/2781564077 wait complete. 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.745+0000 7f9a89122800 1 Processor -- start 2024-09-22T08:11:06.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.745+0000 7f9a89122800 1 -- start start 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.745+0000 7f9a89122800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.745+0000 7f9a89122800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bdc17f3310 con 0x55bdc17f2300 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.745+0000 7f9a855d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.745+0000 7f9a855d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52098/0 (socket says 172.21.15.165:52098) 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.745+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 learned_addr learned my addr 172.21.15.165:0/635776868 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.745+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdc17f9f00 con 0x55bdc17f2300 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.745+0000 7f9a855d3640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f99a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9a80044040 tx=0x7f9a80054670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.746+0000 7f995a7fc640 1 -- 172.21.15.165:0/635776868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a800167c0 con 0x55bdc17f2300 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.746+0000 7f995a7fc640 1 -- 172.21.15.165:0/635776868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a80014ad0 con 0x55bdc17f2300 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.746+0000 7f995a7fc640 1 -- 172.21.15.165:0/635776868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a80016960 con 0x55bdc17f2300 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.746+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdc17fa190 con 0x55bdc17f2300 2024-09-22T08:11:06.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.746+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdc17fab10 con 0x55bdc17f2300 2024-09-22T08:11:06.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.746+0000 7f995a7fc640 1 -- 172.21.15.165:0/635776868 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9a80034030 con 0x55bdc17f2300 2024-09-22T08:11:06.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.747+0000 7f995a7fc640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f99500413c0 0x7f9950043880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.747+0000 7f995a7fc640 1 -- 172.21.15.165:0/635776868 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9a80032070 con 0x55bdc17f2300 2024-09-22T08:11:06.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.747+0000 7f9a84dd2640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f99500413c0 0x7f9950043880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.747+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.747+0000 7f9a89122800 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc18053b0 0x55bdc1807870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.747+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1807fc0 con 0x55bdc18053b0 2024-09-22T08:11:06.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.747+0000 7f9a7c5d1640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc18053b0 0x55bdc1807870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.747+0000 7f9a84dd2640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f99500413c0 0x7f9950043880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9a74013fd0 tx=0x7f9a74041000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a7c5d1640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc18053b0 0x55bdc1807870 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 20 realm 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18083f0 con 0x55bdc18053b0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1808cc0 con 0x55bdc18053b0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1809060 con 0x55bdc18053b0 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.748+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a89122800 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc1809dc0 0x55bdc180c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc180c6f0 con 0x55bdc1809dc0 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a855d3640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc1809dc0 0x55bdc180c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a855d3640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc1809dc0 0x55bdc180c1b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a89122800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a89122800 20 searching for the correct realm 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a89122800 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55bdc180e730 0x55bdc1810bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc180e730 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a84dd2640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55bdc180e730 0x55bdc1810bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.749+0000 7f9a84dd2640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55bdc180e730 0x55bdc1810bf0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.750+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.750+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc1809dc0 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.750+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.750+0000 7f9a855d3640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9a80014070 0x7f9a8004d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.750+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x7f9a80014070 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.750+0000 7f9a7c5d1640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9a80014070 0x7f9a8004d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.751+0000 7f9a7c5d1640 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9a80014070 0x7f9a8004d6e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.751+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.751+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc18053b0 2024-09-22T08:11:06.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.751+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.751+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc18053b0 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.751+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.751+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x7f9a80014070 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.752+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.752+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x7f9a80014070 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.752+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.752+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc1809dc0 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.752+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.752+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc180e730 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.752+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.752+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc18053b0 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.753+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.753+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x7f9a80014070 2024-09-22T08:11:06.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.753+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.753+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc18053b0 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.753+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.753+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc1809dc0 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.753+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.753+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc180e730 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.753+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.753+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc180e730 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.754+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.754+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x7f9a80014070 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.754+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.754+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc180e730 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.754+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.754+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc180e730 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.754+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.754+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc18053b0 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.755+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.755+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc18053b0 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.755+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.755+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x7f9a80014070 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.755+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.755+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc180e730 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.755+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.755+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc1809dc0 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.756+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.756+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc18053b0 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.756+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.756+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x7f9a80014070 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.756+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.756+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc180e730 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.756+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.756+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x7f9a80014070 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.757+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.757+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc1809dc0 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.757+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.757+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc180e730 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.757+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.757+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x7f9a80014070 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.757+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.757+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc18053b0 2024-09-22T08:11:06.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18112c0 con 0x55bdc1809dc0 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc180d160 con 0x55bdc18053b0 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc180cd70 con 0x55bdc18053b0 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.758+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc180dad0 con 0x55bdc18053b0 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 20 zone default found 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 4 Realm: () 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 20 zonegroup default 2024-09-22T08:11:06.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc180d630 con 0x7f9a80014070 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1813690 con 0x55bdc180e730 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1813b20 con 0x55bdc180e730 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.759+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.760+0000 7f9a89122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.760+0000 7f9a89122800 20 started sync module instance, tier type = 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.760+0000 7f9a89122800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:06.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.760+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1812b00 con 0x55bdc1809dc0 2024-09-22T08:11:06.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.761+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.761+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94273483648752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1814430 con 0x55bdc1809dc0 2024-09-22T08:11:06.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.761+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1814c80 con 0x55bdc18053b0 2024-09-22T08:11:06.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.761+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94273483648752] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.762+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.762+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94273483653264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1814a60 con 0x55bdc18053b0 2024-09-22T08:11:06.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.762+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1815500 con 0x55bdc180e730 2024-09-22T08:11:06.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.763+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.763+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94273483657200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1815dd0 con 0x55bdc180e730 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.763+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18168b0 con 0x55bdc1809dc0 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.763+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94273483653264] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.764+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94273483657200] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.764+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.764+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94273483659552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18144b0 con 0x55bdc1809dc0 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.764+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18144b0 con 0x55bdc18053b0 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.765+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.765+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94273483664912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18176e0 con 0x55bdc18053b0 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.765+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94273483659552] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.765+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1818160 con 0x7f9a80014070 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.766+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94273483664912] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.766+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.766+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94273483668592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1817230 con 0x7f9a80014070 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.766+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1818780 con 0x7f9a80014070 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.767+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94273483668592] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.767+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.767+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94273483662272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1818780 con 0x7f9a80014070 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.767+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1819010 con 0x7f9a80014070 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.768+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94273483662272] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.768+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.768+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94273483670224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1818ba0 con 0x7f9a80014070 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.768+0000 7f9a89122800 20 add_watcher() i=0 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.768+0000 7f9a89122800 20 add_watcher() i=1 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.768+0000 7f9a89122800 20 add_watcher() i=2 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.768+0000 7f9a89122800 20 add_watcher() i=3 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.768+0000 7f9a89122800 20 add_watcher() i=4 2024-09-22T08:11:06.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.768+0000 7f9a89122800 20 add_watcher() i=5 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.768+0000 7f9a89122800 20 add_watcher() i=6 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.769+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94273483670224] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.769+0000 7f9a89122800 20 add_watcher() i=7 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.769+0000 7f9a89122800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.769+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc181c510 con 0x55bdc18053b0 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.770+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.770+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94273483672208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1819860 con 0x55bdc18053b0 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94273483672208] v32'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f993afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f9a89122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f9a89122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f9a89122800 5 note: GC not initialized 2024-09-22T08:11:06.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f9939fe3640 20 reqs_thread_entry: start 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f9a89122800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f9a89122800 20 Filter name: none 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f98ab7fe640 20 reqs_thread_entry: start 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.771+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc184f8f0 con 0x55bdc1809dc0 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.772+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.772+0000 7f9a89122800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.772+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.772+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1850230 con 0x7f9a80014070 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.772+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.772+0000 7f9a89122800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.772+0000 7f9a89122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.772+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.772+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18501e0 con 0x55bdc1809dc0 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1851900 con 0x7f9a80014070 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(65 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 4.0 4:018ba9d6:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1851330 con 0x55bdc180e730 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 4.1f 4:fb2ab228:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1856220 con 0x55bdc180e730 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 4.b 4:d327c397:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1851330 con 0x55bdc1809dc0 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 4.2e 4:777aca84:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc185af60 con 0x55bdc180e730 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 4.1 4:832f56df:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc185dce0 con 0x55bdc1809dc0 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 4.c 4:32d44c4f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1860680 con 0x55bdc18053b0 2024-09-22T08:11:06.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.773+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 4.2f 4:f6147bda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1862ef0 con 0x55bdc18053b0 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(68 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(70 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(69 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:73 4.1a 4:58540eb0:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1862ef0 con 0x55bdc1809dc0 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 4.1c 4:39fae181:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc185d8a0 con 0x7f9a80014070 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(71 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 4.12 4:4b80fb86:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18601b0 con 0x55bdc18053b0 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(72 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:76 4.25 4:a6efb879:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdc1855b70 con 0x55bdc180e730 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(73 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(74 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(75 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.774+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(76 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.775+0000 7f993afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.775+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94273483672208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18601b0 con 0x55bdc18053b0 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.776+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94273483672208] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.776+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94273483648752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18601b0 con 0x55bdc1809dc0 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.777+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94273483648752] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.777+0000 7f9a89122800 20 remove_watcher() i=0 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.777+0000 7f9a89122800 2 removed watcher, disabling cache 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.777+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94273483653264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18601b0 con 0x55bdc18053b0 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.778+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94273483653264] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.778+0000 7f9a89122800 20 remove_watcher() i=1 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.778+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94273483657200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18601b0 con 0x55bdc180e730 2024-09-22T08:11:06.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.779+0000 7f9a84dd2640 1 -- 172.21.15.165:0/635776868 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94273483657200] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a74009040 con 0x55bdc180e730 2024-09-22T08:11:06.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.779+0000 7f9a89122800 20 remove_watcher() i=2 2024-09-22T08:11:06.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.779+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94273483659552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18601b0 con 0x55bdc1809dc0 2024-09-22T08:11:06.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.780+0000 7f9a855d3640 1 -- 172.21.15.165:0/635776868 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94273483659552] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a8002a070 con 0x55bdc1809dc0 2024-09-22T08:11:06.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.780+0000 7f9a89122800 20 remove_watcher() i=3 2024-09-22T08:11:06.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.780+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94273483664912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18601b0 con 0x55bdc18053b0 2024-09-22T08:11:06.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.781+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94273483664912] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x55bdc18053b0 2024-09-22T08:11:06.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.781+0000 7f9a89122800 20 remove_watcher() i=4 2024-09-22T08:11:06.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.781+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94273483668592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18601b0 con 0x7f9a80014070 2024-09-22T08:11:06.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.782+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94273483668592] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.782+0000 7f9a89122800 20 remove_watcher() i=5 2024-09-22T08:11:06.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.782+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94273483662272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18601b0 con 0x7f9a80014070 2024-09-22T08:11:06.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.783+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94273483662272] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.783+0000 7f9a89122800 20 remove_watcher() i=6 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.783+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94273483670224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdc18601b0 con 0x7f9a80014070 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.784+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94273483670224] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6c051070 con 0x7f9a80014070 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.784+0000 7f9a89122800 20 remove_watcher() i=7 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.784+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9a80014070 msgr2=0x7f9a8004d6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.784+0000 7f9a89122800 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9a80014070 0x7f9a8004d6e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.784+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc18053b0 msgr2=0x55bdc1807870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.784+0000 7f9a89122800 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc18053b0 0x55bdc1807870 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.784+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc1809dc0 msgr2=0x55bdc180c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.784+0000 7f9a89122800 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc1809dc0 0x55bdc180c1b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.784+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55bdc180e730 msgr2=0x55bdc1810bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.784+0000 7f9a89122800 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55bdc180e730 0x55bdc1810bf0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f99500413c0 msgr2=0x7f9950043880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f99500413c0 0x7f9950043880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9a74013fd0 tx=0x7f9a74041000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 msgr2=0x55bdc17f99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 --2- 172.21.15.165:0/635776868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17f2300 0x55bdc17f99a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9a80044040 tx=0x7f9a80054670 comp rx=0 tx=0).stop 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 reap_dead start 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a7c5d1640 1 -- 172.21.15.165:0/635776868 reap_dead start 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 shutdown_connections 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 >> 172.21.15.165:0/635776868 conn(0x55bdc17ee720 msgr2=0x55bdc17ec930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 shutdown_connections 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/635776868 wait complete. 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/3760741203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f995c03d000 msgr2=0x7f995c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 --2- 172.21.15.165:0/3760741203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f995c03d000 0x7f995c03f4c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9a74014ec0 tx=0x7f9a74016720 comp rx=0 tx=0).stop 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/3760741203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17e58c0 msgr2=0x55bdc17e5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 --2- 172.21.15.165:0/3760741203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17e58c0 0x55bdc17e5ce0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55bdc17cb7a0 tx=0x7f9a80018830 comp rx=0 tx=0).stop 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/3760741203 shutdown_connections 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 --2- 172.21.15.165:0/3760741203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f995c03d000 0x7f995c03f4c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 --2- 172.21.15.165:0/3760741203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc17e58c0 0x55bdc17e5ce0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/3760741203 >> 172.21.15.165:0/3760741203 conn(0x55bdc17d9c70 msgr2=0x55bdc17da050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/3760741203 shutdown_connections 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/3760741203 wait complete. 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc16d5bf0 msgr2=0x55bdc17d1f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc16d5bf0 0x55bdc17d1f60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc17d4300 msgr2=0x55bdc17d67a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.785+0000 7f9a89122800 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc17d4300 0x55bdc17d67a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f996c03d000 msgr2=0x7f996c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f996c03d000 0x7f996c03f4c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c057000 tx=0x7f9a6c052000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 msgr2=0x55bdc17ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17ca910 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9a74000c00 tx=0x7f9a74000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 shutdown_connections 2024-09-22T08:11:06.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bdc17d4300 0x55bdc17d67a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bdc16d5bf0 0x55bdc17d1f60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f996c03d000 0x7f996c03f4c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 --2- 172.21.15.165:0/3858670489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bdc16d47e0 0x55bdc17ca910 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 >> 172.21.15.165:0/3858670489 conn(0x55bdc16cfbb0 msgr2=0x55bdc17c53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 shutdown_connections 2024-09-22T08:11:06.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.786+0000 7f9a89122800 1 -- 172.21.15.165:0/3858670489 wait complete. 2024-09-22T08:11:06.798 INFO:teuthology.orchestra.run.smithi165.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"083396ec-d900-46a5-a2e2-dd86e7b6cca3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","marker":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-22T08:11:06.206826Z","creation_time":"2024-09-22T08:11:06.203755Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-22T08:11:06.798 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '083396ec-d900-46a5-a2e2-dd86e7b6cca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'marker': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:11:06.206826Z', 'creation_time': '2024-09-22T08:11:06.203755Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-22T08:11:06.798 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-22T08:11:06.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-22T08:11:06.798 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-22T08:11:06.843 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:06.843 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:06.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.843+0000 7f6625546800 1 Processor -- start 2024-09-22T08:11:06.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.843+0000 7f6625546800 1 -- start start 2024-09-22T08:11:06.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.843+0000 7f6625546800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56017aaedc40 0x56017aaf0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.843+0000 7f6625546800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56017a979a20 con 0x56017aaf0700 2024-09-22T08:11:06.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.843+0000 7f6625546800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56017a9797d0 con 0x56017aaedc40 2024-09-22T08:11:06.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.843+0000 7f6623037640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56017aaedc40 0x56017aaf0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.843+0000 7f6622836640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56017aaf0700 0x56017aaf2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33694/0 (socket says 172.21.15.165:33694) 2024-09-22T08:11:06.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.843+0000 7f6622836640 1 -- 172.21.15.165:0/1291924583 learned_addr learned my addr 172.21.15.165:0/1291924583 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:06.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.844+0000 7f6623037640 1 -- 172.21.15.165:0/1291924583 >> v1:172.21.15.53:6789/0 conn(0x56017aaf0700 legacy=0x56017aaf2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.844+0000 7f6623037640 1 -- 172.21.15.165:0/1291924583 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017aaf5480 con 0x56017aaedc40 2024-09-22T08:11:06.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.846+0000 7f6623037640 1 --2- 172.21.15.165:0/1291924583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017aaf0050 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f661400a470 tx=0x7f6614045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b4257c554421e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.846+0000 7f6622035640 1 -- 172.21.15.165:0/1291924583 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6614053570 con 0x56017aaedc40 2024-09-22T08:11:06.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.846+0000 7f6622035640 1 -- 172.21.15.165:0/1291924583 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6614058070 con 0x56017aaedc40 2024-09-22T08:11:06.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.846+0000 7f6622035640 1 -- 172.21.15.165:0/1291924583 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6614053880 con 0x56017aaedc40 2024-09-22T08:11:06.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.846+0000 7f6625546800 1 -- 172.21.15.165:0/1291924583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 msgr2=0x56017aaf0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.846+0000 7f6625546800 1 --2- 172.21.15.165:0/1291924583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017aaf0050 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f661400a470 tx=0x7f6614045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:06.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.846+0000 7f6625546800 1 -- 172.21.15.165:0/1291924583 shutdown_connections 2024-09-22T08:11:06.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.846+0000 7f6625546800 1 --2- 172.21.15.165:0/1291924583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017aaf0050 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.847+0000 7f6625546800 1 -- 172.21.15.165:0/1291924583 >> 172.21.15.165:0/1291924583 conn(0x56017aae8310 msgr2=0x56017aaea790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.847+0000 7f6625546800 1 -- 172.21.15.165:0/1291924583 shutdown_connections 2024-09-22T08:11:06.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.847+0000 7f6625546800 1 -- 172.21.15.165:0/1291924583 wait complete. 2024-09-22T08:11:06.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.860+0000 7f6625546800 1 Processor -- start 2024-09-22T08:11:06.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.860+0000 7f6625546800 1 -- start start 2024-09-22T08:11:06.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.860+0000 7f6625546800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017aaed030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.860+0000 7f6625546800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56017a986dd0 con 0x56017aaedc40 2024-09-22T08:11:06.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.861+0000 7f6623037640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017aaed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.861+0000 7f6623037640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017aaed030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52112/0 (socket says 172.21.15.165:52112) 2024-09-22T08:11:06.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.861+0000 7f6623037640 1 -- 172.21.15.165:0/4271239851 learned_addr learned my addr 172.21.15.165:0/4271239851 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.861+0000 7f6623037640 1 -- 172.21.15.165:0/4271239851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017abe0bf0 con 0x56017aaedc40 2024-09-22T08:11:06.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.861+0000 7f6623037640 1 --2- 172.21.15.165:0/4271239851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017aaed030 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6614025c20 tx=0x7f6614051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8f64a495f5a2d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.861+0000 7f651160a640 1 -- 172.21.15.165:0/4271239851 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6614053a20 con 0x56017aaedc40 2024-09-22T08:11:06.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.861+0000 7f651160a640 1 -- 172.21.15.165:0/4271239851 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6614063070 con 0x56017aaedc40 2024-09-22T08:11:06.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.861+0000 7f651160a640 1 -- 172.21.15.165:0/4271239851 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6614053cf0 con 0x56017aaedc40 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.862+0000 7f6625546800 1 -- 172.21.15.165:0/4271239851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 msgr2=0x56017aaed030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.862+0000 7f6625546800 1 --2- 172.21.15.165:0/4271239851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017aaed030 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6614025c20 tx=0x7f6614051000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.862+0000 7f6625546800 1 -- 172.21.15.165:0/4271239851 shutdown_connections 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.862+0000 7f6625546800 1 --2- 172.21.15.165:0/4271239851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017aaed030 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.862+0000 7f6625546800 1 -- 172.21.15.165:0/4271239851 >> 172.21.15.165:0/4271239851 conn(0x56017aae8310 msgr2=0x56017abd88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.862+0000 7f6625546800 1 -- 172.21.15.165:0/4271239851 shutdown_connections 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.862+0000 7f6625546800 1 -- 172.21.15.165:0/4271239851 wait complete. 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.862+0000 7f6625546800 1 Processor -- start 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.863+0000 7f6625546800 1 -- start start 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.863+0000 7f6625546800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017abe5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.863+0000 7f6625546800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56017aaf4720 con 0x56017aaedc40 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.863+0000 7f6623037640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017abe5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.863+0000 7f6623037640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017abe5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52122/0 (socket says 172.21.15.165:52122) 2024-09-22T08:11:06.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.863+0000 7f6623037640 1 -- 172.21.15.165:0/3264829592 learned_addr learned my addr 172.21.15.165:0/3264829592 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.863+0000 7f6623037640 1 -- 172.21.15.165:0/3264829592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017abe6070 con 0x56017aaedc40 2024-09-22T08:11:06.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.863+0000 7f6623037640 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017abe5b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6614025c20 tx=0x7f6614002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.863+0000 7f650fe07640 1 -- 172.21.15.165:0/3264829592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6614068660 con 0x56017aaedc40 2024-09-22T08:11:06.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.864+0000 7f650fe07640 1 -- 172.21.15.165:0/3264829592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6614068800 con 0x56017aaedc40 2024-09-22T08:11:06.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.864+0000 7f650fe07640 1 -- 172.21.15.165:0/3264829592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6614068ae0 con 0x56017aaedc40 2024-09-22T08:11:06.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.864+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56017abe6300 con 0x56017aaedc40 2024-09-22T08:11:06.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.864+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56017abe6f10 con 0x56017aaedc40 2024-09-22T08:11:06.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.864+0000 7f650fe07640 1 -- 172.21.15.165:0/3264829592 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6614068c80 con 0x56017aaedc40 2024-09-22T08:11:06.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.865+0000 7f650fe07640 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f650803cfb0 0x7f650803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.865+0000 7f650fe07640 1 -- 172.21.15.165:0/3264829592 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6614098de0 con 0x56017aaedc40 2024-09-22T08:11:06.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.865+0000 7f6622836640 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f650803cfb0 0x7f650803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.865+0000 7f6625546800 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017aaf0700 0x56017abed160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.865+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017abed6a0 con 0x56017aaf0700 2024-09-22T08:11:06.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.865+0000 7f6623838640 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017aaf0700 0x56017abed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.865+0000 7f6622836640 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f650803cfb0 0x7f650803f470 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6618001d70 tx=0x7f66180012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.865+0000 7f6623838640 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017aaf0700 0x56017abed160 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.866+0000 7f6623838640 1 -- 172.21.15.165:0/3264829592 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f661c00a4d0 con 0x56017aaf0700 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.866+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017abeda40 con 0x56017aaf0700 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.866+0000 7f6623838640 1 -- 172.21.15.165:0/3264829592 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f661c00a4d0 con 0x56017aaf0700 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.866+0000 7f6625546800 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017abef500 0x56017abf19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.866+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017abf2130 con 0x56017abef500 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.866+0000 7f6623037640 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017abef500 0x56017abf19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.866+0000 7f6623037640 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017abef500 0x56017abf19a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.867+0000 7f6623037640 1 -- 172.21.15.165:0/3264829592 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6614051070 con 0x56017abef500 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.867+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017abee290 con 0x56017aaf0700 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.867+0000 7f6623838640 1 -- 172.21.15.165:0/3264829592 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f661c00a4d0 con 0x56017aaf0700 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.867+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017abee670 con 0x56017aaf0700 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.867+0000 7f6623838640 1 -- 172.21.15.165:0/3264829592 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f661c00a4d0 con 0x56017aaf0700 2024-09-22T08:11:06.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.867+0000 7f6625546800 1 Processor -- start 2024-09-22T08:11:06.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.868+0000 7f6625546800 1 -- start start 2024-09-22T08:11:06.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.868+0000 7f6625546800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac00ae0 0x56017ac00f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.868+0000 7f6625546800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56017a9e5d50 con 0x56017ac00ae0 2024-09-22T08:11:06.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.868+0000 7f6623838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac00ae0 0x56017ac00f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.868+0000 7f6623838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac00ae0 0x56017ac00f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52134/0 (socket says 172.21.15.165:52134) 2024-09-22T08:11:06.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.868+0000 7f6623838640 1 -- 172.21.15.165:0/3715568264 learned_addr learned my addr 172.21.15.165:0/3715568264 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.868+0000 7f6623838640 1 -- 172.21.15.165:0/3715568264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017ac01540 con 0x56017ac00ae0 2024-09-22T08:11:06.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.868+0000 7f6623838640 1 --2- 172.21.15.165:0/3715568264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac00ae0 0x56017ac00f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x56017abe6b10 tx=0x7f661c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.869+0000 7f650d602640 1 -- 172.21.15.165:0/3715568264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661c014450 con 0x56017ac00ae0 2024-09-22T08:11:06.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.869+0000 7f650d602640 1 -- 172.21.15.165:0/3715568264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661c014610 con 0x56017ac00ae0 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.869+0000 7f6625546800 1 -- 172.21.15.165:0/3715568264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56017ac01d70 con 0x56017ac00ae0 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.869+0000 7f650d602640 1 -- 172.21.15.165:0/3715568264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661c014930 con 0x56017ac00ae0 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.869+0000 7f6625546800 1 -- 172.21.15.165:0/3715568264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56017ac02310 con 0x56017ac00ae0 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.869+0000 7f650d602640 1 -- 172.21.15.165:0/3715568264 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f661c011040 con 0x56017ac00ae0 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f650d602640 1 --2- 172.21.15.165:0/3715568264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64fc03d000 0x7f64fc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f650d602640 1 -- 172.21.15.165:0/3715568264 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f661c01e070 con 0x56017ac00ae0 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f6623037640 1 --2- 172.21.15.165:0/3715568264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64fc03d000 0x7f64fc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f6625546800 1 Processor -- start 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f6623037640 1 --2- 172.21.15.165:0/3715568264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64fc03d000 0x7f64fc03f4c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x56017abe7be0 tx=0x7f661405da60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f6625546800 1 -- start start 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f6625546800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac0d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f6625546800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56017abe0e70 con 0x56017ac0d540 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f6623838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac0d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f6623838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac0d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52136/0 (socket says 172.21.15.165:52136) 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.870+0000 7f6623838640 1 -- 172.21.15.165:0/2502831096 learned_addr learned my addr 172.21.15.165:0/2502831096 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.871+0000 7f6623838640 1 -- 172.21.15.165:0/2502831096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017ac0df30 con 0x56017ac0d540 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.871+0000 7f6623838640 1 --2- 172.21.15.165:0/2502831096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac0d940 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f661c018430 tx=0x7f661c014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14f1a6a5b65376a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.871+0000 7f6506ffd640 1 -- 172.21.15.165:0/2502831096 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661c04b070 con 0x56017ac0d540 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.871+0000 7f6506ffd640 1 -- 172.21.15.165:0/2502831096 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661c051070 con 0x56017ac0d540 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.871+0000 7f6506ffd640 1 -- 172.21.15.165:0/2502831096 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661c011da0 con 0x56017ac0d540 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 -- 172.21.15.165:0/2502831096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 msgr2=0x56017ac0d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 --2- 172.21.15.165:0/2502831096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac0d940 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f661c018430 tx=0x7f661c014ea0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 -- 172.21.15.165:0/2502831096 shutdown_connections 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 --2- 172.21.15.165:0/2502831096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac0d940 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 -- 172.21.15.165:0/2502831096 >> 172.21.15.165:0/2502831096 conn(0x56017ac09940 msgr2=0x56017ac07b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 -- 172.21.15.165:0/2502831096 shutdown_connections 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 -- 172.21.15.165:0/2502831096 wait complete. 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 Processor -- start 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 -- start start 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac14b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6625546800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56017ac0e550 con 0x56017ac0d540 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6623838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac14b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6623838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac14b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52138/0 (socket says 172.21.15.165:52138) 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.872+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 learned_addr learned my addr 172.21.15.165:0/572197826 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.873+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017ac150a0 con 0x56017ac0d540 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.873+0000 7f6623838640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac14b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f661c02bfd0 tx=0x7f661c0546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.873+0000 7f65057fa640 1 -- 172.21.15.165:0/572197826 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661c04b040 con 0x56017ac0d540 2024-09-22T08:11:06.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.873+0000 7f65057fa640 1 -- 172.21.15.165:0/572197826 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661c053320 con 0x56017ac0d540 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.873+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56017ac15330 con 0x56017ac0d540 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.873+0000 7f65057fa640 1 -- 172.21.15.165:0/572197826 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661c0168f0 con 0x56017ac0d540 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.873+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56017ac15cb0 con 0x56017ac0d540 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.874+0000 7f65057fa640 1 -- 172.21.15.165:0/572197826 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f661c011330 con 0x56017ac0d540 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.874+0000 7f65057fa640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64ec03cf60 0x7f64ec03f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.874+0000 7f65057fa640 1 -- 172.21.15.165:0/572197826 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f661c00e040 con 0x56017ac0d540 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.874+0000 7f6623037640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64ec03cf60 0x7f64ec03f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.874+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.874+0000 7f6625546800 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017ac205b0 0x56017ac22a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.874+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac231c0 con 0x56017ac205b0 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.874+0000 7f6622836640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017ac205b0 0x56017ac22a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.874+0000 7f6623037640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64ec03cf60 0x7f64ec03f420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6614068fd0 tx=0x7f6614088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6622836640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017ac205b0 0x56017ac22a70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6618009050 con 0x56017ac205b0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 20 realm 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac1f950 con 0x56017ac205b0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6618009050 con 0x56017ac205b0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac23ca0 con 0x56017ac205b0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6618009050 con 0x56017ac205b0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.875+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac24570 con 0x56017ac205b0 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6618009050 con 0x56017ac205b0 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6625546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6625546800 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017ac24eb0 0x56017ac272a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac279e0 con 0x56017ac24eb0 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6623838640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017ac24eb0 0x56017ac272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6623838640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017ac24eb0 0x56017ac272a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6625546800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6625546800 20 searching for the correct realm 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6625546800 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56017ac29a60 0x56017ac2bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac29a60 2024-09-22T08:11:06.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.876+0000 7f6623037640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56017ac29a60 0x56017ac2bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.877+0000 7f6623037640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56017ac29a60 0x56017ac2bf20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.877+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.877+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac24eb0 2024-09-22T08:11:06.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.877+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.877+0000 7f6623838640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f661c037070 0x7f661c040850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.877+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x7f661c037070 2024-09-22T08:11:06.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.877+0000 7f6622836640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f661c037070 0x7f661c040850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.878+0000 7f6622836640 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f661c037070 0x7f661c040850 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.878+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618009050 con 0x7f661c037070 2024-09-22T08:11:06.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.878+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac205b0 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.878+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618009050 con 0x56017ac205b0 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.878+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac205b0 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.879+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.879+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x7f661c037070 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.879+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.879+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x7f661c037070 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.879+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.879+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac24eb0 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.879+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.879+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac29a60 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.879+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.880+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac205b0 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.880+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.880+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x7f661c037070 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.880+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.880+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac205b0 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.880+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.880+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac24eb0 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.881+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.881+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac29a60 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.881+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.881+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac29a60 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.881+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.881+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x7f661c037070 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.881+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.881+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac29a60 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.882+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.882+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac29a60 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.882+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.882+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac205b0 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.882+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.882+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac205b0 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.882+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.882+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x7f661c037070 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.883+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.883+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac29a60 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.883+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.883+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac24eb0 2024-09-22T08:11:06.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.883+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.883+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac205b0 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.883+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.883+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x7f661c037070 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.883+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.883+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac29a60 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.884+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.884+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x7f661c037070 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.884+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.884+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac24eb0 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.884+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.884+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac29a60 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.884+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.884+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x7f661c037070 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac205b0 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2c5f0 con 0x56017ac24eb0 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac28460 con 0x56017ac205b0 2024-09-22T08:11:06.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.885+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac28070 con 0x56017ac205b0 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac28e10 con 0x56017ac205b0 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 20 zone default found 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 4 Realm: () 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:06.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 20 zonegroup default 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac28930 con 0x7f661c037070 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2e990 con 0x56017ac29a60 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.886+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.887+0000 7f6625546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.887+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.887+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2ef50 con 0x56017ac29a60 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.887+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.887+0000 7f6625546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.887+0000 7f6625546800 20 started sync module instance, tier type = 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.887+0000 7f6625546800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.887+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2de00 con 0x56017ac24eb0 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.888+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.888+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94564354546000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2f3b0 con 0x56017ac24eb0 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.888+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2fd70 con 0x56017ac205b0 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.889+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94564354546000] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.889+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.889+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94564354548320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2fd70 con 0x56017ac205b0 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.889+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac30770 con 0x56017ac29a60 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.890+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.890+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94564354556544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac31010 con 0x56017ac29a60 2024-09-22T08:11:06.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.890+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94564354548320] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.890+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac2f8c0 con 0x56017ac24eb0 2024-09-22T08:11:06.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.891+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.891+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94564354561440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac31e70 con 0x56017ac24eb0 2024-09-22T08:11:06.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.891+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac328e0 con 0x56017ac205b0 2024-09-22T08:11:06.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.891+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94564354556544] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.892+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.892+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94564354565040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac328a0 con 0x56017ac205b0 2024-09-22T08:11:06.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.892+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac33330 con 0x7f661c037070 2024-09-22T08:11:06.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.892+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94564354561440] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.893+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94564354565040] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.893+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.893+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94564354558816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac32e40 con 0x7f661c037070 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.893+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac33bd0 con 0x7f661c037070 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.895+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94564354558816] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.895+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.895+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94564354562496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac33a60 con 0x7f661c037070 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.895+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac342b0 con 0x7f661c037070 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.896+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94564354562496] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.896+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.896+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94564354570128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac340a0 con 0x7f661c037070 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.896+0000 7f6625546800 20 add_watcher() i=0 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.896+0000 7f6625546800 20 add_watcher() i=1 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.896+0000 7f6625546800 20 add_watcher() i=2 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.896+0000 7f6625546800 20 add_watcher() i=3 2024-09-22T08:11:06.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.896+0000 7f6625546800 20 add_watcher() i=4 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.896+0000 7f6625546800 20 add_watcher() i=5 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.896+0000 7f6625546800 20 add_watcher() i=6 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.898+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94564354570128] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.898+0000 7f6625546800 20 add_watcher() i=7 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.898+0000 7f6625546800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.898+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac376b0 con 0x56017ac205b0 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.898+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.898+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94564354571184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac34a30 con 0x56017ac205b0 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.899+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94564354571184] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.899+0000 7f64d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.899+0000 7f6625546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.899+0000 7f6625546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.899+0000 7f6625546800 5 note: GC not initialized 2024-09-22T08:11:06.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.899+0000 7f64d8fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6625546800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6625546800 20 Filter name: none 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f64527fc640 20 reqs_thread_entry: start 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac6a6d0 con 0x56017ac205b0 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6625546800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac6b0f0 con 0x56017ac205b0 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6625546800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.900+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac6c100 con 0x56017ac24eb0 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.901+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.901+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.901+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac69730 con 0x56017ac24eb0 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.901+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.901+0000 7f6625546800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.901+0000 7f6625546800 20 rados->read ofs=0 len=0 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.901+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:66 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac6c100 con 0x7f661c037070 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(66 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 4.0 4:018ba9d6:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac6bab0 con 0x56017ac29a60 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 4.1f 4:fb2ab228:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac70a50 con 0x56017ac29a60 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 4.b 4:d327c397:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac6bab0 con 0x56017ac24eb0 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:70 4.2e 4:777aca84:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac757e0 con 0x56017ac29a60 2024-09-22T08:11:06.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 4.1 4:832f56df:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac757e0 con 0x56017ac24eb0 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 4.c 4:32d44c4f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac7aae0 con 0x56017ac205b0 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:73 4.2f 4:f6147bda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac7d950 con 0x56017ac205b0 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 4.1a 4:58540eb0:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac80730 con 0x56017ac24eb0 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 4.1c 4:39fae181:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac82fa0 con 0x7f661c037070 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 4.12 4:4b80fb86:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac85b20 con 0x56017ac205b0 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 4.25 4:a6efb879:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56017ac884a0 con 0x56017ac29a60 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(75 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(68 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(69 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(70 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.902+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.903+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(76 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.903+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(73 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.903+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(72 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.903+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.903+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(71 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.903+0000 7f64d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.903+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94564354571184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac68490 con 0x56017ac205b0 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.904+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94564354571184] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.904+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94564354546000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac68490 con 0x56017ac24eb0 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.905+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94564354546000] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.905+0000 7f6625546800 20 remove_watcher() i=0 2024-09-22T08:11:06.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.905+0000 7f6625546800 2 removed watcher, disabling cache 2024-09-22T08:11:06.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.905+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94564354548320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac68490 con 0x56017ac205b0 2024-09-22T08:11:06.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.907+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94564354548320] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.907+0000 7f6625546800 20 remove_watcher() i=1 2024-09-22T08:11:06.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.907+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94564354556544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac68490 con 0x56017ac29a60 2024-09-22T08:11:06.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.908+0000 7f6623037640 1 -- 172.21.15.165:0/572197826 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94564354556544] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6614051070 con 0x56017ac29a60 2024-09-22T08:11:06.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.908+0000 7f6625546800 20 remove_watcher() i=2 2024-09-22T08:11:06.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.908+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94564354561440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac68490 con 0x56017ac24eb0 2024-09-22T08:11:06.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.909+0000 7f6623838640 1 -- 172.21.15.165:0/572197826 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94564354561440] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661c02a070 con 0x56017ac24eb0 2024-09-22T08:11:06.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.909+0000 7f6625546800 20 remove_watcher() i=3 2024-09-22T08:11:06.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.909+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94564354565040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac68490 con 0x56017ac205b0 2024-09-22T08:11:06.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.910+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94564354565040] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x56017ac205b0 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.910+0000 7f6625546800 20 remove_watcher() i=4 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.910+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94564354558816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac68490 con 0x7f661c037070 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.911+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94564354558816] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.911+0000 7f6625546800 20 remove_watcher() i=5 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.911+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94564354562496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac68490 con 0x7f661c037070 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.912+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94564354562496] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.912+0000 7f6625546800 20 remove_watcher() i=6 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.912+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94564354570128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56017ac68490 con 0x7f661c037070 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94564354570128] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6618029040 con 0x7f661c037070 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 20 remove_watcher() i=7 2024-09-22T08:11:06.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f661c037070 msgr2=0x7f661c040850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f661c037070 0x7f661c040850 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017ac205b0 msgr2=0x56017ac22a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017ac205b0 0x56017ac22a70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017ac24eb0 msgr2=0x56017ac272a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017ac24eb0 0x56017ac272a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56017ac29a60 msgr2=0x56017ac2bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56017ac29a60 0x56017ac2bf20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64ec03cf60 msgr2=0x7f64ec03f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64ec03cf60 0x7f64ec03f420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6614068fd0 tx=0x7f6614088000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 msgr2=0x56017ac14b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6622836640 1 -- 172.21.15.165:0/572197826 reap_dead start 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac14b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f661c02bfd0 tx=0x7f661c0546a0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 shutdown_connections 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 --2- 172.21.15.165:0/572197826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac0d540 0x56017ac14b40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 >> 172.21.15.165:0/572197826 conn(0x56017ac09940 msgr2=0x56017ac07b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 shutdown_connections 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/572197826 wait complete. 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/3715568264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64fc03d000 msgr2=0x7f64fc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 --2- 172.21.15.165:0/3715568264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64fc03d000 0x7f64fc03f4c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x56017abe7be0 tx=0x7f661405da60 comp rx=0 tx=0).stop 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 -- 172.21.15.165:0/3715568264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac00ae0 msgr2=0x56017ac00f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.913+0000 7f6625546800 1 --2- 172.21.15.165:0/3715568264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac00ae0 0x56017ac00f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x56017abe6b10 tx=0x7f661c018830 comp rx=0 tx=0).stop 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3715568264 shutdown_connections 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 --2- 172.21.15.165:0/3715568264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f64fc03d000 0x7f64fc03f4c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 --2- 172.21.15.165:0/3715568264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017ac00ae0 0x56017ac00f00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3715568264 >> 172.21.15.165:0/3715568264 conn(0x56017abf4e90 msgr2=0x56017abf5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3715568264 shutdown_connections 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3715568264 wait complete. 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017aaf0700 msgr2=0x56017abed160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017aaf0700 0x56017abed160 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017abef500 msgr2=0x56017abf19a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017abef500 0x56017abf19a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f650803cfb0 msgr2=0x7f650803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f650803cfb0 0x7f650803f470 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6618001d70 tx=0x7f66180012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 msgr2=0x56017abe5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017abe5b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6614025c20 tx=0x7f6614002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 shutdown_connections 2024-09-22T08:11:06.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56017abef500 0x56017abf19a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56017aaf0700 0x56017abed160 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f650803cfb0 0x7f650803f470 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 --2- 172.21.15.165:0/3264829592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56017aaedc40 0x56017abe5b10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 >> 172.21.15.165:0/3264829592 conn(0x56017aae8310 msgr2=0x56017abd70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 shutdown_connections 2024-09-22T08:11:06.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.914+0000 7f6625546800 1 -- 172.21.15.165:0/3264829592 wait complete. 2024-09-22T08:11:06.925 INFO:teuthology.orchestra.run.smithi165.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"083396ec-d900-46a5-a2e2-dd86e7b6cca3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","marker":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-22T08:11:06.206826Z","creation_time":"2024-09-22T08:11:06.203755Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-22T08:11:06.925 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '083396ec-d900-46a5-a2e2-dd86e7b6cca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'marker': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:11:06.206826Z', 'creation_time': '2024-09-22T08:11:06.203755Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-22T08:11:06.931 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-22T08:11:06.932 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:11:06.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:11:06.932 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-22T08:11:06.976 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:06.976 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:06.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.976+0000 7f2c76b2a800 1 Processor -- start 2024-09-22T08:11:06.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.976+0000 7f2c76b2a800 1 -- start start 2024-09-22T08:11:06.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.976+0000 7f2c76b2a800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fa42a81d30 0x55fa42b11140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.976+0000 7f2c76b2a800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa42999a20 con 0x55fa42b117f0 2024-09-22T08:11:06.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.976+0000 7f2c76b2a800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55fa429997d0 con 0x55fa42a81d30 2024-09-22T08:11:06.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.976+0000 7f2c728da640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fa42a81d30 0x55fa42b11140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.976+0000 7f2c720d9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55fa42b117f0 0x55fa42b13cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33710/0 (socket says 172.21.15.165:33710) 2024-09-22T08:11:06.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.976+0000 7f2c728da640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fa42a81d30 0x55fa42b11140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52154/0 (socket says 172.21.15.165:52154) 2024-09-22T08:11:06.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.976+0000 7f2c720d9640 1 -- 172.21.15.165:0/3877323037 learned_addr learned my addr 172.21.15.165:0/3877323037 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:06.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.977+0000 7f2c728da640 1 -- 172.21.15.165:0/3877323037 >> v1:172.21.15.53:6789/0 conn(0x55fa42b117f0 legacy=0x55fa42b13cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.977+0000 7f2c728da640 1 -- 172.21.15.165:0/3877323037 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa42b16570 con 0x55fa42a81d30 2024-09-22T08:11:06.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.979+0000 7f2c728da640 1 --2- 172.21.15.165:0/3877323037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42b11140 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400a470 tx=0x7f2c64045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3aae4222226c16f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.979+0000 7f2c718d8640 1 -- 172.21.15.165:0/3877323037 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c64053570 con 0x55fa42a81d30 2024-09-22T08:11:06.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.979+0000 7f2c718d8640 1 -- 172.21.15.165:0/3877323037 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c64058070 con 0x55fa42a81d30 2024-09-22T08:11:06.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.979+0000 7f2c718d8640 1 -- 172.21.15.165:0/3877323037 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c64053880 con 0x55fa42a81d30 2024-09-22T08:11:06.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.980+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3877323037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 msgr2=0x55fa42b11140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.980+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3877323037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42b11140 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400a470 tx=0x7f2c64045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:06.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.980+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3877323037 shutdown_connections 2024-09-22T08:11:06.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.980+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3877323037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42b11140 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.980+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3877323037 >> 172.21.15.165:0/3877323037 conn(0x55fa42b08bb0 msgr2=0x55fa42b0b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.980+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3877323037 shutdown_connections 2024-09-22T08:11:06.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.980+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3877323037 wait complete. 2024-09-22T08:11:06.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.993+0000 7f2c76b2a800 1 Processor -- start 2024-09-22T08:11:06.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.993+0000 7f2c76b2a800 1 -- start start 2024-09-22T08:11:06.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.994+0000 7f2c76b2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42bfe040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.994+0000 7f2c76b2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa429a6dd0 con 0x55fa42a81d30 2024-09-22T08:11:06.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.994+0000 7f2c728da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42bfe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.994+0000 7f2c728da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42bfe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52170/0 (socket says 172.21.15.165:52170) 2024-09-22T08:11:06.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.994+0000 7f2c728da640 1 -- 172.21.15.165:0/724501898 learned_addr learned my addr 172.21.15.165:0/724501898 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.994+0000 7f2c728da640 1 -- 172.21.15.165:0/724501898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa42bfe630 con 0x55fa42a81d30 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.994+0000 7f2c728da640 1 --2- 172.21.15.165:0/724501898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42bfe040 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2c64025c20 tx=0x7f2c64051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0e2c27dab3fc51 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.994+0000 7f2b60e09640 1 -- 172.21.15.165:0/724501898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c64053a20 con 0x55fa42a81d30 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.995+0000 7f2b60e09640 1 -- 172.21.15.165:0/724501898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c64063070 con 0x55fa42a81d30 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.995+0000 7f2b60e09640 1 -- 172.21.15.165:0/724501898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c64053cf0 con 0x55fa42a81d30 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.995+0000 7f2c76b2a800 1 -- 172.21.15.165:0/724501898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 msgr2=0x55fa42bfe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.995+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/724501898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42bfe040 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2c64025c20 tx=0x7f2c64051000 comp rx=0 tx=0).stop 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.995+0000 7f2c76b2a800 1 -- 172.21.15.165:0/724501898 shutdown_connections 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.995+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/724501898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42bfe040 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.995+0000 7f2c76b2a800 1 -- 172.21.15.165:0/724501898 >> 172.21.15.165:0/724501898 conn(0x55fa42b08bb0 msgr2=0x55fa42bf99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.995+0000 7f2c76b2a800 1 -- 172.21.15.165:0/724501898 shutdown_connections 2024-09-22T08:11:06.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.995+0000 7f2c76b2a800 1 -- 172.21.15.165:0/724501898 wait complete. 2024-09-22T08:11:06.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.996+0000 7f2c76b2a800 1 Processor -- start 2024-09-22T08:11:06.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.996+0000 7f2c76b2a800 1 -- start start 2024-09-22T08:11:06.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.996+0000 7f2c76b2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42b0e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:06.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.996+0000 7f2c76b2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa42b15810 con 0x55fa42a81d30 2024-09-22T08:11:06.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.996+0000 7f2c728da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42b0e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:06.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.996+0000 7f2c728da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42b0e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52174/0 (socket says 172.21.15.165:52174) 2024-09-22T08:11:06.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.996+0000 7f2c728da640 1 -- 172.21.15.165:0/1674963905 learned_addr learned my addr 172.21.15.165:0/1674963905 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.996+0000 7f2c728da640 1 -- 172.21.15.165:0/1674963905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa42b0ed90 con 0x55fa42a81d30 2024-09-22T08:11:07.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.997+0000 7f2c728da640 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42b0e830 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2c64025c20 tx=0x7f2c64002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.997+0000 7f2b5f606640 1 -- 172.21.15.165:0/1674963905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c64068660 con 0x55fa42a81d30 2024-09-22T08:11:07.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.997+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa42b0d140 con 0x55fa42a81d30 2024-09-22T08:11:07.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.997+0000 7f2b5f606640 1 -- 172.21.15.165:0/1674963905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c64068800 con 0x55fa42a81d30 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.997+0000 7f2b5f606640 1 -- 172.21.15.165:0/1674963905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c64068ae0 con 0x55fa42a81d30 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.997+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa42b0d760 con 0x55fa42a81d30 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.998+0000 7f2b5f606640 1 -- 172.21.15.165:0/1674963905 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2c64068c80 con 0x55fa42a81d30 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.998+0000 7f2b5f606640 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b5803cfb0 0x7f2b5803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.998+0000 7f2b5f606640 1 -- 172.21.15.165:0/1674963905 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2c64098de0 con 0x55fa42a81d30 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.998+0000 7f2c720d9640 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b5803cfb0 0x7f2b5803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.998+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42b117f0 0x55fa42c0f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.998+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c0f550 con 0x55fa42b117f0 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.998+0000 7f2c730db640 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42b117f0 0x55fa42c0f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.999+0000 7f2c720d9640 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b5803cfb0 0x7f2b5803f470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c68001d70 tx=0x7f2c680012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.999+0000 7f2c730db640 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42b117f0 0x55fa42c0f010 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.999+0000 7f2c730db640 1 -- 172.21.15.165:0/1674963905 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c6c00a4d0 con 0x55fa42b117f0 2024-09-22T08:11:07.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.999+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c0fdf0 con 0x55fa42b117f0 2024-09-22T08:11:07.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.999+0000 7f2c730db640 1 -- 172.21.15.165:0/1674963905 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c6c00a4d0 con 0x55fa42b117f0 2024-09-22T08:11:07.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.999+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c11700 0x55fa42c13ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.999+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c14330 con 0x55fa42c11700 2024-09-22T08:11:07.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:06.999+0000 7f2c728da640 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c11700 0x55fa42c13ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.000+0000 7f2c728da640 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c11700 0x55fa42c13ba0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.000+0000 7f2c728da640 1 -- 172.21.15.165:0/1674963905 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c11700 2024-09-22T08:11:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.000+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c10640 con 0x55fa42b117f0 2024-09-22T08:11:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.000+0000 7f2c730db640 1 -- 172.21.15.165:0/1674963905 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c6c00a4d0 con 0x55fa42b117f0 2024-09-22T08:11:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.000+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c10a20 con 0x55fa42b117f0 2024-09-22T08:11:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.000+0000 7f2c730db640 1 -- 172.21.15.165:0/1674963905 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c6c00a4d0 con 0x55fa42b117f0 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.001+0000 7f2c76b2a800 1 Processor -- start 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.001+0000 7f2c76b2a800 1 -- start start 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.001+0000 7f2c76b2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c22ce0 0x55fa42c23100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.001+0000 7f2c76b2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa42a05d50 con 0x55fa42c22ce0 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.001+0000 7f2c730db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c22ce0 0x55fa42c23100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.001+0000 7f2c730db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c22ce0 0x55fa42c23100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52186/0 (socket says 172.21.15.165:52186) 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.001+0000 7f2c730db640 1 -- 172.21.15.165:0/1173648785 learned_addr learned my addr 172.21.15.165:0/1173648785 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.001+0000 7f2c730db640 1 -- 172.21.15.165:0/1173648785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa42c23740 con 0x55fa42c22ce0 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.002+0000 7f2c730db640 1 --2- 172.21.15.165:0/1173648785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c22ce0 0x55fa42c23100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55fa42b0e3d0 tx=0x7f2c6c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.002+0000 7f2b5ce01640 1 -- 172.21.15.165:0/1173648785 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c014450 con 0x55fa42c22ce0 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.002+0000 7f2b5ce01640 1 -- 172.21.15.165:0/1173648785 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6c014610 con 0x55fa42c22ce0 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.002+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1173648785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa42c23f70 con 0x55fa42c22ce0 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.002+0000 7f2b5ce01640 1 -- 172.21.15.165:0/1173648785 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c014930 con 0x55fa42c22ce0 2024-09-22T08:11:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.002+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1173648785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa42c24510 con 0x55fa42c22ce0 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.003+0000 7f2b5ce01640 1 -- 172.21.15.165:0/1173648785 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2c6c011040 con 0x55fa42c22ce0 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.003+0000 7f2b5ce01640 1 --2- 172.21.15.165:0/1173648785 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b4c03d000 0x7f2b4c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.003+0000 7f2b5ce01640 1 -- 172.21.15.165:0/1173648785 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2c6c01e070 con 0x55fa42c22ce0 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.003+0000 7f2c728da640 1 --2- 172.21.15.165:0/1173648785 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b4c03d000 0x7f2b4c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.003+0000 7f2c76b2a800 1 Processor -- start 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.003+0000 7f2c728da640 1 --2- 172.21.15.165:0/1173648785 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b4c03d000 0x7f2b4c03f4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55fa42b0dd90 tx=0x7f2c6405da60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.003+0000 7f2c76b2a800 1 -- start start 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.003+0000 7f2c76b2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c2fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.003+0000 7f2c76b2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa42bfea00 con 0x55fa42c2f740 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.004+0000 7f2c730db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c2fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.004+0000 7f2c730db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c2fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52194/0 (socket says 172.21.15.165:52194) 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.004+0000 7f2c730db640 1 -- 172.21.15.165:0/1241522497 learned_addr learned my addr 172.21.15.165:0/1241522497 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.004+0000 7f2c730db640 1 -- 172.21.15.165:0/1241522497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa42c30130 con 0x55fa42c2f740 2024-09-22T08:11:07.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.004+0000 7f2c730db640 1 --2- 172.21.15.165:0/1241522497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c2fb40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c018430 tx=0x7f2c6c001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efae690b884f579 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.004+0000 7f2b567fc640 1 -- 172.21.15.165:0/1241522497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c04b070 con 0x55fa42c2f740 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.004+0000 7f2b567fc640 1 -- 172.21.15.165:0/1241522497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6c051070 con 0x55fa42c2f740 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.004+0000 7f2b567fc640 1 -- 172.21.15.165:0/1241522497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c056070 con 0x55fa42c2f740 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1241522497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 msgr2=0x55fa42c2fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1241522497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c2fb40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c018430 tx=0x7f2c6c001440 comp rx=0 tx=0).stop 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1241522497 shutdown_connections 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1241522497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c2fb40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1241522497 >> 172.21.15.165:0/1241522497 conn(0x55fa42c2bb40 msgr2=0x55fa42c29d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1241522497 shutdown_connections 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1241522497 wait complete. 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 Processor -- start 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 -- start start 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c36cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c76b2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa42c30750 con 0x55fa42c2f740 2024-09-22T08:11:07.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c730db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c36cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c730db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c36cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52198/0 (socket says 172.21.15.165:52198) 2024-09-22T08:11:07.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.005+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 learned_addr learned my addr 172.21.15.165:0/3821646152 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.006+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa42c37220 con 0x55fa42c2f740 2024-09-22T08:11:07.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.006+0000 7f2c730db640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c36cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c02bfb0 tx=0x7f2c6c02b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.006+0000 7f2b54ff9640 1 -- 172.21.15.165:0/3821646152 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c04b040 con 0x55fa42c2f740 2024-09-22T08:11:07.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.006+0000 7f2b54ff9640 1 -- 172.21.15.165:0/3821646152 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6c0167c0 con 0x55fa42c2f740 2024-09-22T08:11:07.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.006+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa42c374b0 con 0x55fa42c2f740 2024-09-22T08:11:07.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.006+0000 7f2b54ff9640 1 -- 172.21.15.165:0/3821646152 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c011330 con 0x55fa42c2f740 2024-09-22T08:11:07.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.006+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa42c37e30 con 0x55fa42c2f740 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.007+0000 7f2b54ff9640 1 -- 172.21.15.165:0/3821646152 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2c6c054870 con 0x55fa42c2f740 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.007+0000 7f2b54ff9640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b3c03cfb0 0x7f2b3c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.007+0000 7f2b54ff9640 1 -- 172.21.15.165:0/3821646152 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2c6c00e040 con 0x55fa42c2f740 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.007+0000 7f2c728da640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b3c03cfb0 0x7f2b3c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.007+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.007+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42c42770 0x55fa42c44c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.007+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c45380 con 0x55fa42c42770 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c720d9640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42c42770 0x55fa42c44c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c728da640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b3c03cfb0 0x7f2b3c03f470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2c64068fd0 tx=0x7f2c64088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c720d9640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42c42770 0x55fa42c44c30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c68009050 con 0x55fa42c42770 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c76b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c76b2a800 20 realm 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c41ac0 con 0x55fa42c42770 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c68009050 con 0x55fa42c42770 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c76b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c76b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.008+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c45e60 con 0x55fa42c42770 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c68009050 con 0x55fa42c42770 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c46730 con 0x55fa42c42770 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c68009050 con 0x55fa42c42770 2024-09-22T08:11:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c47070 0x55fa42c49460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c49ba0 con 0x55fa42c47070 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c730db640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c47070 0x55fa42c49460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c730db640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c47070 0x55fa42c49460 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 20 searching for the correct realm 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fa42c4bc20 0x55fa42c4e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.009+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c4bc20 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.010+0000 7f2c728da640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fa42c4bc20 0x55fa42c4e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.010+0000 7f2c728da640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fa42c4bc20 0x55fa42c4e0e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.010+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.010+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c47070 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.010+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.010+0000 7f2c730db640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2c6c014070 0x7f2c6c04d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.010+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x7f2c6c014070 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.011+0000 7f2c720d9640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2c6c014070 0x7f2c6c04d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.011+0000 7f2c720d9640 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2c6c014070 0x7f2c6c04d760 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.011+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68009050 con 0x7f2c6c014070 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.011+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c42770 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.012+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68009050 con 0x55fa42c42770 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.012+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c42770 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.012+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.012+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x7f2c6c014070 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.012+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.012+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x7f2c6c014070 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.012+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.012+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c47070 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.013+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.013+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c4bc20 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.013+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.013+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c42770 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.013+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.013+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x7f2c6c014070 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.013+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.013+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c42770 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.014+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.014+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c47070 2024-09-22T08:11:07.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.014+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.014+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c4bc20 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.014+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.014+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c4bc20 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.014+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.014+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x7f2c6c014070 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.015+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.015+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c4bc20 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.015+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.015+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c4bc20 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.015+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.015+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c42770 2024-09-22T08:11:07.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.015+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.015+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c42770 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.015+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.015+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x7f2c6c014070 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.016+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.016+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c4bc20 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.016+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.016+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c47070 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.016+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.016+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c42770 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.016+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.016+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x7f2c6c014070 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.017+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.017+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c4bc20 2024-09-22T08:11:07.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.017+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.017+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x7f2c6c014070 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.017+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.017+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c47070 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.017+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.017+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c4bc20 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.017+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.017+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x7f2c6c014070 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c42770 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4e7b0 con 0x55fa42c47070 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c76b2a800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c76b2a800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c76b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c76b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c76b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c76b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.018+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4a620 con 0x55fa42c42770 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4a230 con 0x55fa42c42770 2024-09-22T08:11:07.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4afd0 con 0x55fa42c42770 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 20 zone default found 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 4 Realm: () 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 20 zonegroup default 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4aac0 con 0x7f2c6c014070 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.019+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c50b80 con 0x55fa42c4bc20 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.020+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.020+0000 7f2c76b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.020+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.020+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c51030 con 0x55fa42c4bc20 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.020+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.020+0000 7f2c76b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.020+0000 7f2c76b2a800 20 started sync module instance, tier type = 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.020+0000 7f2c76b2a800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.020+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c4fff0 con 0x55fa42c47070 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.021+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.021+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94533350392800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c51940 con 0x55fa42c47070 2024-09-22T08:11:07.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.021+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c52190 con 0x55fa42c42770 2024-09-22T08:11:07.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.022+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94533350392800] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.022+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.022+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94533350397072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c51e60 con 0x55fa42c42770 2024-09-22T08:11:07.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.022+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c52920 con 0x55fa42c4bc20 2024-09-22T08:11:07.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.023+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.023+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94533350401008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c531c0 con 0x55fa42c4bc20 2024-09-22T08:11:07.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.023+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c53ca0 con 0x55fa42c47070 2024-09-22T08:11:07.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.023+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94533350397072] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.024+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94533350401008] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.024+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.024+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94533350403344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c518b0 con 0x55fa42c47070 2024-09-22T08:11:07.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.024+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c546b0 con 0x55fa42c42770 2024-09-22T08:11:07.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.025+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94533350403344] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.026+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.026+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94533350406064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c546b0 con 0x55fa42c42770 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.026+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c55070 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.027+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.027+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94533350406064] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.027+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94533350411200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c55490 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.027+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c54240 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.027+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94533350411200] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.028+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.028+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94533350412256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c55400 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.028+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c563a0 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.029+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94533350412256] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.029+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.029+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94533350414848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c563a0 con 0x7f2c6c014070 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.029+0000 7f2c76b2a800 20 add_watcher() i=0 2024-09-22T08:11:07.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.029+0000 7f2c76b2a800 20 add_watcher() i=1 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.029+0000 7f2c76b2a800 20 add_watcher() i=2 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.029+0000 7f2c76b2a800 20 add_watcher() i=3 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.029+0000 7f2c76b2a800 20 add_watcher() i=4 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.029+0000 7f2c76b2a800 20 add_watcher() i=5 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.029+0000 7f2c76b2a800 20 add_watcher() i=6 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.030+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94533350414848] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.030+0000 7f2c76b2a800 20 add_watcher() i=7 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.030+0000 7f2c76b2a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.030+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c598a0 con 0x55fa42c42770 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.030+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.030+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94533350415904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c56c20 con 0x55fa42c42770 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.031+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94533350415904] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.031+0000 7f2b297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.031+0000 7f2c76b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.031+0000 7f2c76b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.031+0000 7f2c76b2a800 5 note: GC not initialized 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.031+0000 7f2aa3fff640 20 reqs_thread_entry: start 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.031+0000 7f2c76b2a800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.031+0000 7f2c76b2a800 20 Filter name: none 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2aa1ffb640 20 reqs_thread_entry: start 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8cd00 con 0x55fa42c47070 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c76b2a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8d670 con 0x7f2c6c014070 2024-09-22T08:11:07.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c76b2a800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c76b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.032+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8d6b0 con 0x55fa42c47070 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8ee20 con 0x7f2c6c014070 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(65 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 4.0 4:018ba9d6:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8e390 con 0x55fa42c4bc20 2024-09-22T08:11:07.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 4.1f 4:fb2ab228:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c93990 con 0x55fa42c4bc20 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 4.b 4:d327c397:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8e390 con 0x55fa42c47070 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 4.2e 4:777aca84:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c98760 con 0x55fa42c4bc20 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 4.1 4:832f56df:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c9b070 con 0x55fa42c47070 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 4.c 4:32d44c4f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c9db50 con 0x55fa42c42770 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 4.2f 4:f6147bda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c9db90 con 0x55fa42c42770 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:73 4.1a 4:58540eb0:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42ca2ac0 con 0x55fa42c47070 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.033+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 4.1c 4:39fae181:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42ca5960 con 0x7f2c6c014070 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 4.12 4:4b80fb86:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42ca8370 con 0x55fa42c42770 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:76 4.25 4:a6efb879:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8de60 con 0x55fa42c4bc20 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(69 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(68 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(70 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(71 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(72 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(74 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(75 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(76 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.034+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(73 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.035+0000 7f2b297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.035+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94533350415904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8a6c0 con 0x55fa42c42770 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.036+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94533350415904] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.036+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94533350392800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8a6c0 con 0x55fa42c47070 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.037+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94533350392800] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.037+0000 7f2c76b2a800 20 remove_watcher() i=0 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.037+0000 7f2c76b2a800 2 removed watcher, disabling cache 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.037+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94533350397072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8a6c0 con 0x55fa42c42770 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.038+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94533350397072] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.038+0000 7f2c76b2a800 20 remove_watcher() i=1 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.038+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94533350401008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8a6c0 con 0x55fa42c4bc20 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.039+0000 7f2c728da640 1 -- 172.21.15.165:0/3821646152 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94533350401008] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c64051070 con 0x55fa42c4bc20 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.039+0000 7f2c76b2a800 20 remove_watcher() i=2 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.039+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94533350403344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8a6c0 con 0x55fa42c47070 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.040+0000 7f2c730db640 1 -- 172.21.15.165:0/3821646152 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94533350403344] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c03c020 con 0x55fa42c47070 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.040+0000 7f2c76b2a800 20 remove_watcher() i=3 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.040+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94533350406064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8a6c0 con 0x55fa42c42770 2024-09-22T08:11:07.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.041+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94533350406064] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x55fa42c42770 2024-09-22T08:11:07.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.041+0000 7f2c76b2a800 20 remove_watcher() i=4 2024-09-22T08:11:07.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.041+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94533350411200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8a6c0 con 0x7f2c6c014070 2024-09-22T08:11:07.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.042+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94533350411200] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.042+0000 7f2c76b2a800 20 remove_watcher() i=5 2024-09-22T08:11:07.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.042+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94533350412256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8a6c0 con 0x7f2c6c014070 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.043+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94533350412256] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.043+0000 7f2c76b2a800 20 remove_watcher() i=6 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.043+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94533350414848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa42c8a6c0 con 0x7f2c6c014070 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94533350414848] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c68029040 con 0x7f2c6c014070 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 20 remove_watcher() i=7 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2c6c014070 msgr2=0x7f2c6c04d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2c6c014070 0x7f2c6c04d760 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42c42770 msgr2=0x55fa42c44c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42c42770 0x55fa42c44c30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c47070 msgr2=0x55fa42c49460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c47070 0x55fa42c49460 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fa42c4bc20 msgr2=0x55fa42c4e0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fa42c4bc20 0x55fa42c4e0e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b3c03cfb0 msgr2=0x7f2b3c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b3c03cfb0 0x7f2b3c03f470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2c64068fd0 tx=0x7f2c64088000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 msgr2=0x55fa42c36cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c720d9640 1 -- 172.21.15.165:0/3821646152 reap_dead start 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c36cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c02bfb0 tx=0x7f2c6c02b4c0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 shutdown_connections 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/3821646152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c2f740 0x55fa42c36cc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 >> 172.21.15.165:0/3821646152 conn(0x55fa42c2bb40 msgr2=0x55fa42c29d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 shutdown_connections 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.044+0000 7f2c76b2a800 1 -- 172.21.15.165:0/3821646152 wait complete. 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1173648785 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b4c03d000 msgr2=0x7f2b4c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1173648785 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b4c03d000 0x7f2b4c03f4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55fa42b0dd90 tx=0x7f2c6405da60 comp rx=0 tx=0).stop 2024-09-22T08:11:07.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1173648785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c22ce0 msgr2=0x55fa42c23100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1173648785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c22ce0 0x55fa42c23100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55fa42b0e3d0 tx=0x7f2c6c018830 comp rx=0 tx=0).stop 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1173648785 shutdown_connections 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1173648785 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b4c03d000 0x7f2b4c03f4c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1173648785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42c22ce0 0x55fa42c23100 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1173648785 >> 172.21.15.165:0/1173648785 conn(0x55fa42c17090 msgr2=0x55fa42c17470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1173648785 shutdown_connections 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1173648785 wait complete. 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42b117f0 msgr2=0x55fa42c0f010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42b117f0 0x55fa42c0f010 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c11700 msgr2=0x55fa42c13ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c11700 0x55fa42c13ba0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b5803cfb0 msgr2=0x7f2b5803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b5803cfb0 0x7f2b5803f470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c68001d70 tx=0x7f2c680012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 msgr2=0x55fa42b0e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42b0e830 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2c64025c20 tx=0x7f2c64002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 shutdown_connections 2024-09-22T08:11:07.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa42c11700 0x55fa42c13ba0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa42b117f0 0x55fa42c0f010 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2b5803cfb0 0x7f2b5803f470 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 --2- 172.21.15.165:0/1674963905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa42a81d30 0x55fa42b0e830 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 >> 172.21.15.165:0/1674963905 conn(0x55fa42b08bb0 msgr2=0x55fa42bf81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 shutdown_connections 2024-09-22T08:11:07.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.045+0000 7f2c76b2a800 1 -- 172.21.15.165:0/1674963905 wait complete. 2024-09-22T08:11:07.058 INFO:teuthology.orchestra.run.smithi165.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"083396ec-d900-46a5-a2e2-dd86e7b6cca3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","marker":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-22T08:11:06.206826Z","creation_time":"2024-09-22T08:11:06.203755Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-22T08:11:07.058 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '083396ec-d900-46a5-a2e2-dd86e7b6cca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'marker': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:11:06.206826Z', 'creation_time': '2024-09-22T08:11:06.203755Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-22T08:11:07.058 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-22T08:11:07.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-22T08:11:07.059 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-22T08:11:07.104 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:07.104 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:07.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.104+0000 7f213e20e800 1 Processor -- start 2024-09-22T08:11:07.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.104+0000 7f213e20e800 1 -- start start 2024-09-22T08:11:07.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.104+0000 7f213e20e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5618741d30f0 0x5618741d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.104+0000 7f213e20e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56187405da20 con 0x5618741d5a20 2024-09-22T08:11:07.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.104+0000 7f213e20e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56187405d7d0 con 0x5618741d30f0 2024-09-22T08:11:07.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.104+0000 7f21398cb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5618741d30f0 0x5618741d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.104+0000 7f2133fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5618741d5a20 0x5618741d7e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33716/0 (socket says 172.21.15.165:33716) 2024-09-22T08:11:07.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.104+0000 7f2133fff640 1 -- 172.21.15.165:0/3489777863 learned_addr learned my addr 172.21.15.165:0/3489777863 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:07.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.105+0000 7f21398cb640 1 -- 172.21.15.165:0/3489777863 >> v1:172.21.15.53:6789/0 conn(0x5618741d5a20 legacy=0x5618741d7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.105+0000 7f21398cb640 1 -- 172.21.15.165:0/3489777863 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618741da570 con 0x5618741d30f0 2024-09-22T08:11:07.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f21398cb640 1 --2- 172.21.15.165:0/3489777863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618741d54e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f212c00a470 tx=0x7f212c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bf94975a6bcc8a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f21390ca640 1 -- 172.21.15.165:0/3489777863 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f212c053570 con 0x5618741d30f0 2024-09-22T08:11:07.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f21390ca640 1 -- 172.21.15.165:0/3489777863 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212c058070 con 0x5618741d30f0 2024-09-22T08:11:07.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f21390ca640 1 -- 172.21.15.165:0/3489777863 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f212c053880 con 0x5618741d30f0 2024-09-22T08:11:07.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f213e20e800 1 -- 172.21.15.165:0/3489777863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 msgr2=0x5618741d54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f213e20e800 1 --2- 172.21.15.165:0/3489777863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618741d54e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f212c00a470 tx=0x7f212c045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:07.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f213e20e800 1 -- 172.21.15.165:0/3489777863 shutdown_connections 2024-09-22T08:11:07.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f213e20e800 1 --2- 172.21.15.165:0/3489777863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618741d54e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f213e20e800 1 -- 172.21.15.165:0/3489777863 >> 172.21.15.165:0/3489777863 conn(0x5618741ccbb0 msgr2=0x5618741cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f213e20e800 1 -- 172.21.15.165:0/3489777863 shutdown_connections 2024-09-22T08:11:07.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.107+0000 7f213e20e800 1 -- 172.21.15.165:0/3489777863 wait complete. 2024-09-22T08:11:07.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.121+0000 7f213e20e800 1 Processor -- start 2024-09-22T08:11:07.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.121+0000 7f213e20e800 1 -- start start 2024-09-22T08:11:07.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.121+0000 7f213e20e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618741d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.121+0000 7f213e20e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56187406add0 con 0x5618741d30f0 2024-09-22T08:11:07.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.122+0000 7f21398cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618741d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.122+0000 7f21398cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618741d2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52206/0 (socket says 172.21.15.165:52206) 2024-09-22T08:11:07.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.122+0000 7f21398cb640 1 -- 172.21.15.165:0/1157038936 learned_addr learned my addr 172.21.15.165:0/1157038936 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.122+0000 7f21398cb640 1 -- 172.21.15.165:0/1157038936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618741d2e50 con 0x5618741d30f0 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.122+0000 7f21398cb640 1 --2- 172.21.15.165:0/1157038936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618741d2860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f212c025c20 tx=0x7f212c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f5aa75233dc0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.122+0000 7f2027e07640 1 -- 172.21.15.165:0/1157038936 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f212c053570 con 0x5618741d30f0 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.122+0000 7f2027e07640 1 -- 172.21.15.165:0/1157038936 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212c063070 con 0x5618741d30f0 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.122+0000 7f2027e07640 1 -- 172.21.15.165:0/1157038936 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f212c053840 con 0x5618741d30f0 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.123+0000 7f213e20e800 1 -- 172.21.15.165:0/1157038936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 msgr2=0x5618741d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.123+0000 7f213e20e800 1 --2- 172.21.15.165:0/1157038936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618741d2860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f212c025c20 tx=0x7f212c051000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.123+0000 7f213e20e800 1 -- 172.21.15.165:0/1157038936 shutdown_connections 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.123+0000 7f213e20e800 1 --2- 172.21.15.165:0/1157038936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618741d2860 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.123+0000 7f213e20e800 1 -- 172.21.15.165:0/1157038936 >> 172.21.15.165:0/1157038936 conn(0x5618741ccbb0 msgr2=0x5618742bd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.123+0000 7f213e20e800 1 -- 172.21.15.165:0/1157038936 shutdown_connections 2024-09-22T08:11:07.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.123+0000 7f213e20e800 1 -- 172.21.15.165:0/1157038936 wait complete. 2024-09-22T08:11:07.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.124+0000 7f213e20e800 1 Processor -- start 2024-09-22T08:11:07.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.124+0000 7f213e20e800 1 -- start start 2024-09-22T08:11:07.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.124+0000 7f213e20e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618742cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.124+0000 7f213e20e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618741d9830 con 0x5618741d30f0 2024-09-22T08:11:07.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.124+0000 7f21398cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618742cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.124+0000 7f21398cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618742cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52208/0 (socket says 172.21.15.165:52208) 2024-09-22T08:11:07.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.124+0000 7f21398cb640 1 -- 172.21.15.165:0/1014525415 learned_addr learned my addr 172.21.15.165:0/1014525415 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.124+0000 7f21398cb640 1 -- 172.21.15.165:0/1014525415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618742cc240 con 0x5618741d30f0 2024-09-22T08:11:07.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.124+0000 7f21398cb640 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618742cbce0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f212c025c20 tx=0x7f212c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.125+0000 7f2026604640 1 -- 172.21.15.165:0/1014525415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f212c074480 con 0x5618741d30f0 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.125+0000 7f2026604640 1 -- 172.21.15.165:0/1014525415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212c074620 con 0x5618741d30f0 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.125+0000 7f2026604640 1 -- 172.21.15.165:0/1014525415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f212c074900 con 0x5618741d30f0 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.125+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618742cc4d0 con 0x5618741d30f0 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.125+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618742cd0e0 con 0x5618741d30f0 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.126+0000 7f2026604640 1 -- 172.21.15.165:0/1014525415 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f212c074aa0 con 0x5618741d30f0 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.126+0000 7f2026604640 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f202003d000 0x7f202003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.126+0000 7f2026604640 1 -- 172.21.15.165:0/1014525415 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f212c098b50 con 0x5618741d30f0 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.126+0000 7f2133fff640 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f202003d000 0x7f202003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.126+0000 7f213e20e800 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618741d5a20 0x5618742d3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.126+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618742d3870 con 0x5618741d5a20 2024-09-22T08:11:07.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.126+0000 7f213a0cc640 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618741d5a20 0x5618742d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.126+0000 7f2133fff640 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f202003d000 0x7f202003f4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2124001d70 tx=0x7f21240012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.126+0000 7f213a0cc640 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618741d5a20 0x5618742d3330 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.127+0000 7f213a0cc640 1 -- 172.21.15.165:0/1014525415 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f213400a4d0 con 0x5618741d5a20 2024-09-22T08:11:07.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.127+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618742d3c10 con 0x5618741d5a20 2024-09-22T08:11:07.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.127+0000 7f213a0cc640 1 -- 172.21.15.165:0/1014525415 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f213400a4d0 con 0x5618741d5a20 2024-09-22T08:11:07.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.127+0000 7f213e20e800 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618742d5690 0x5618742d7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.127+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618742d82c0 con 0x5618742d5690 2024-09-22T08:11:07.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.127+0000 7f21398cb640 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618742d5690 0x5618742d7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.127+0000 7f21398cb640 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618742d5690 0x5618742d7b30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.128+0000 7f21398cb640 1 -- 172.21.15.165:0/1014525415 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f212c051070 con 0x5618742d5690 2024-09-22T08:11:07.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.128+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618742d4460 con 0x5618741d5a20 2024-09-22T08:11:07.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.128+0000 7f213a0cc640 1 -- 172.21.15.165:0/1014525415 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f213400a4d0 con 0x5618741d5a20 2024-09-22T08:11:07.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.128+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618742d4800 con 0x5618741d5a20 2024-09-22T08:11:07.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.128+0000 7f213a0cc640 1 -- 172.21.15.165:0/1014525415 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f213400a4d0 con 0x5618741d5a20 2024-09-22T08:11:07.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.129+0000 7f213e20e800 1 Processor -- start 2024-09-22T08:11:07.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.129+0000 7f213e20e800 1 -- start start 2024-09-22T08:11:07.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.129+0000 7f213e20e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742e6c10 0x5618742e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.129+0000 7f213e20e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618740c9d50 con 0x5618742e6c10 2024-09-22T08:11:07.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.129+0000 7f213a0cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742e6c10 0x5618742e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.129+0000 7f213a0cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742e6c10 0x5618742e7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52216/0 (socket says 172.21.15.165:52216) 2024-09-22T08:11:07.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.129+0000 7f213a0cc640 1 -- 172.21.15.165:0/1689828127 learned_addr learned my addr 172.21.15.165:0/1689828127 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.129+0000 7f213a0cc640 1 -- 172.21.15.165:0/1689828127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618742e7670 con 0x5618742e6c10 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.130+0000 7f213a0cc640 1 --2- 172.21.15.165:0/1689828127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742e6c10 0x5618742e7030 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x5618742ccce0 tx=0x7f2134018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.130+0000 7f201f7fe640 1 -- 172.21.15.165:0/1689828127 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2134014450 con 0x5618742e6c10 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.130+0000 7f201f7fe640 1 -- 172.21.15.165:0/1689828127 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2134014610 con 0x5618742e6c10 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.130+0000 7f213e20e800 1 -- 172.21.15.165:0/1689828127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618742e7ea0 con 0x5618742e6c10 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.130+0000 7f201f7fe640 1 -- 172.21.15.165:0/1689828127 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2134014930 con 0x5618742e6c10 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.130+0000 7f213e20e800 1 -- 172.21.15.165:0/1689828127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618742e8440 con 0x5618742e6c10 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.131+0000 7f201f7fe640 1 -- 172.21.15.165:0/1689828127 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2134011040 con 0x5618742e6c10 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.131+0000 7f201f7fe640 1 --2- 172.21.15.165:0/1689828127 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f201403d000 0x7f201403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.131+0000 7f201f7fe640 1 -- 172.21.15.165:0/1689828127 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f213401e070 con 0x5618742e6c10 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.131+0000 7f21398cb640 1 --2- 172.21.15.165:0/1689828127 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f201403d000 0x7f201403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.131+0000 7f213e20e800 1 Processor -- start 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.131+0000 7f21398cb640 1 --2- 172.21.15.165:0/1689828127 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f201403d000 0x7f201403f4c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x5618742cdd70 tx=0x7f212c05f520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.131+0000 7f213e20e800 1 -- start start 2024-09-22T08:11:07.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.131+0000 7f213e20e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.131+0000 7f213e20e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618741d12a0 con 0x5618742f3620 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.132+0000 7f213a0cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.132+0000 7f213a0cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742f3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52230/0 (socket says 172.21.15.165:52230) 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.132+0000 7f213a0cc640 1 -- 172.21.15.165:0/1841758798 learned_addr learned my addr 172.21.15.165:0/1841758798 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.132+0000 7f213a0cc640 1 -- 172.21.15.165:0/1841758798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618742f4010 con 0x5618742f3620 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.132+0000 7f213a0cc640 1 --2- 172.21.15.165:0/1841758798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742f3a20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2134018430 tx=0x7f2134016ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49725708bdc2a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.132+0000 7f201d7fa640 1 -- 172.21.15.165:0/1841758798 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f213404b070 con 0x5618742f3620 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.132+0000 7f201d7fa640 1 -- 172.21.15.165:0/1841758798 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2134051070 con 0x5618742f3620 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.132+0000 7f201d7fa640 1 -- 172.21.15.165:0/1841758798 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2134016440 con 0x5618742f3620 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 -- 172.21.15.165:0/1841758798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 msgr2=0x5618742f3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 --2- 172.21.15.165:0/1841758798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742f3a20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2134018430 tx=0x7f2134016ca0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 -- 172.21.15.165:0/1841758798 shutdown_connections 2024-09-22T08:11:07.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 --2- 172.21.15.165:0/1841758798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742f3a20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 -- 172.21.15.165:0/1841758798 >> 172.21.15.165:0/1841758798 conn(0x5618742efa20 msgr2=0x5618742edc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 -- 172.21.15.165:0/1841758798 shutdown_connections 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 -- 172.21.15.165:0/1841758798 wait complete. 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 Processor -- start 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 -- start start 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742fac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213e20e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618742f4630 con 0x5618742f3620 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213a0cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742fac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213a0cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742fac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52236/0 (socket says 172.21.15.165:52236) 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.133+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 learned_addr learned my addr 172.21.15.165:0/3509519323 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.134+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618742fb1f0 con 0x5618742f3620 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.134+0000 7f213a0cc640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742fac90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2134022bf0 tx=0x7f2134054670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.134+0000 7f200b7fe640 1 -- 172.21.15.165:0/3509519323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f213404b040 con 0x5618742f3620 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.134+0000 7f200b7fe640 1 -- 172.21.15.165:0/3509519323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21340167c0 con 0x5618742f3620 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.134+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618742fb480 con 0x5618742f3620 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.134+0000 7f200b7fe640 1 -- 172.21.15.165:0/3509519323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2134011330 con 0x5618742f3620 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.134+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618742fbe00 con 0x5618742f3620 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.135+0000 7f200b7fe640 1 -- 172.21.15.165:0/3509519323 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f213404dd10 con 0x5618742f3620 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.135+0000 7f200b7fe640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f200403cfb0 0x7f200403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.135+0000 7f200b7fe640 1 -- 172.21.15.165:0/3509519323 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f213400e040 con 0x5618742f3620 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.135+0000 7f21398cb640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f200403cfb0 0x7f200403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.135+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.135+0000 7f213e20e800 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561874306720 0x561874308bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.135+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874309300 con 0x561874306720 2024-09-22T08:11:07.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.135+0000 7f2133fff640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561874306720 0x561874308bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f21398cb640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f200403cfb0 0x7f200403f470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5618742d86c0 tx=0x7f212c082000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f2133fff640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561874306720 0x561874308bb0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2124009050 con 0x561874306720 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 20 realm 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874305a90 con 0x561874306720 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2124009050 con 0x561874306720 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874309de0 con 0x561874306720 2024-09-22T08:11:07.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2124009050 con 0x561874306720 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.136+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187430a6b0 con 0x561874306720 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2124009050 con 0x561874306720 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213e20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213e20e800 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56187430aff0 0x56187430d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187430db20 con 0x56187430aff0 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213a0cc640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56187430aff0 0x56187430d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213a0cc640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56187430aff0 0x56187430d3e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213e20e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:07.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213e20e800 20 searching for the correct realm 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213e20e800 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56187430fba0 0x561874312060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.137+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430fba0 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.138+0000 7f21398cb640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56187430fba0 0x561874312060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.138+0000 7f21398cb640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56187430fba0 0x561874312060 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.138+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.138+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430aff0 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.138+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.138+0000 7f213a0cc640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2134014070 0x7f2134037600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.138+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x7f2134014070 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.139+0000 7f2133fff640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2134014070 0x7f2134037600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.139+0000 7f2133fff640 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2134014070 0x7f2134037600 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.139+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124009050 con 0x7f2134014070 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.139+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x561874306720 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.139+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124009050 con 0x561874306720 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.139+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x561874306720 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.140+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.140+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x7f2134014070 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.140+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.140+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x7f2134014070 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.140+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.140+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430aff0 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.140+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.140+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430fba0 2024-09-22T08:11:07.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.141+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.141+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x561874306720 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.141+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.141+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x7f2134014070 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.141+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.141+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x561874306720 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.141+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.141+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430aff0 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.142+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.142+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430fba0 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.142+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.142+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430fba0 2024-09-22T08:11:07.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.142+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.142+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x7f2134014070 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.142+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.142+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430fba0 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.142+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.142+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430fba0 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.143+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.143+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x561874306720 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.143+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.143+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x561874306720 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.143+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.143+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x7f2134014070 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.143+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.143+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430fba0 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.144+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.144+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430aff0 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.144+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.144+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x561874306720 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.144+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.144+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x7f2134014070 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.144+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.144+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430fba0 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.145+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.145+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x7f2134014070 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.145+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.145+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430aff0 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.145+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.145+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430fba0 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.145+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.145+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x7f2134014070 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x561874306720 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561874312730 con 0x56187430aff0 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:07.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:07.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:07.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:07.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:07.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:07.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187430e5a0 con 0x561874306720 2024-09-22T08:11:07.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.146+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187430e1e0 con 0x561874306720 2024-09-22T08:11:07.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187430ef40 con 0x561874306720 2024-09-22T08:11:07.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:07.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 20 zone default found 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 4 Realm: () 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 20 zonegroup default 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.147+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187430eac0 con 0x7f2134014070 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f213e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874314f80 con 0x56187430fba0 2024-09-22T08:11:07.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f213e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618743153a0 con 0x56187430fba0 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f213e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f213e20e800 20 started sync module instance, tier type = 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f213e20e800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.148+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874314410 con 0x56187430aff0 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.149+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.149+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94663028590944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874314410 con 0x56187430aff0 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.149+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874315ea0 con 0x561874306720 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.150+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94663028590944] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.150+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.150+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94663028595056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874314410 con 0x561874306720 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.150+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874316940 con 0x56187430fba0 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.151+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94663028595056] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.152+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.152+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94663028588384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874314380 con 0x56187430fba0 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.152+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618743176f0 con 0x56187430aff0 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.152+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94663028588384] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.153+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.153+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94663028600112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874317ae0 con 0x56187430aff0 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.153+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874318500 con 0x561874306720 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.153+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.153+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94663028604912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618743189b0 con 0x561874306720 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.154+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618743194c0 con 0x7f2134014070 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.154+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94663028600112] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.154+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.154+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94663028608880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874319480 con 0x7f2134014070 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.154+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874319ed0 con 0x7f2134014070 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.155+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94663028604912] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.155+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94663028608880] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.156+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.156+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94663028601168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874319a20 con 0x7f2134014070 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.156+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56187431a3e0 con 0x7f2134014070 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94663028601168] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94663028606144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56187431a3e0 con 0x7f2134014070 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 20 add_watcher() i=0 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 20 add_watcher() i=1 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 20 add_watcher() i=2 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 20 add_watcher() i=3 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 20 add_watcher() i=4 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 20 add_watcher() i=5 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 20 add_watcher() i=6 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94663028606144] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 20 add_watcher() i=7 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.157+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187431d880 con 0x561874306720 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.158+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.158+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94663028625968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56187431a550 con 0x561874306720 2024-09-22T08:11:07.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.159+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94663028625968] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.159+0000 7f1feb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.159+0000 7f213e20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.159+0000 7f213e20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.159+0000 7f213e20e800 5 note: GC not initialized 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.159+0000 7f1fea7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.159+0000 7f213e20e800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.159+0000 7f213e20e800 20 Filter name: none 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.160+0000 7f1f5bfff640 20 reqs_thread_entry: start 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.160+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.160+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874350870 con 0x561874306720 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.160+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.160+0000 7f213e20e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.160+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874351df0 con 0x56187430aff0 2024-09-22T08:11:07.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.160+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.160+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.160+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874351d80 con 0x7f2134014070 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(64 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:65 4.0 4:018ba9d6:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874353950 con 0x56187430fba0 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 4.1f 4:fb2ab228:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618743565c0 con 0x56187430fba0 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 4.b 4:d327c397:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618743565c0 con 0x56187430aff0 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 4.2e 4:777aca84:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187435b740 con 0x56187430fba0 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 4.1 4:832f56df:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187435b740 con 0x56187430aff0 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 4.c 4:32d44c4f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874360920 con 0x561874306720 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 4.2f 4:f6147bda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874363500 con 0x561874306720 2024-09-22T08:11:07.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 4.1a 4:58540eb0:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874365fc0 con 0x56187430aff0 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 4.1c 4:39fae181:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874363500 con 0x7f2134014070 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.161+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:74 4.12 4:4b80fb86:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187436ace0 con 0x561874306720 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:75 4.25 4:a6efb879:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56187436d630 con 0x56187430fba0 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(65 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(66 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(68 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(75 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(69 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(70 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(71 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(74 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.162+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874355f30 con 0x56187430aff0 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.163+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.163+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874355f30 con 0x56187430aff0 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.164+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.164+0000 7f213e20e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.164+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874355f30 con 0x561874306720 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.165+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.165+0000 7f213e20e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.165+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561874355f30 con 0x56187430aff0 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.165+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.166+0000 7f1feb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.166+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94663028625968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874355f30 con 0x561874306720 2024-09-22T08:11:07.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.167+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94663028625968] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.167+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94663028590944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56187431d230 con 0x56187430aff0 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.168+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94663028590944] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.168+0000 7f213e20e800 20 remove_watcher() i=0 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.168+0000 7f213e20e800 2 removed watcher, disabling cache 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.168+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94663028595056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874314960 con 0x561874306720 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.169+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94663028595056] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.169+0000 7f213e20e800 20 remove_watcher() i=1 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.169+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94663028588384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874315970 con 0x56187430fba0 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.170+0000 7f21398cb640 1 -- 172.21.15.165:0/3509519323 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94663028588384] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f212c051070 con 0x56187430fba0 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.170+0000 7f213e20e800 20 remove_watcher() i=2 2024-09-22T08:11:07.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.170+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94663028600112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874315970 con 0x56187430aff0 2024-09-22T08:11:07.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.171+0000 7f213a0cc640 1 -- 172.21.15.165:0/3509519323 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94663028600112] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f213402a070 con 0x56187430aff0 2024-09-22T08:11:07.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.171+0000 7f213e20e800 20 remove_watcher() i=3 2024-09-22T08:11:07.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.171+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94663028604912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874316d30 con 0x561874306720 2024-09-22T08:11:07.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.171+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94663028604912] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x561874306720 2024-09-22T08:11:07.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.171+0000 7f213e20e800 20 remove_watcher() i=4 2024-09-22T08:11:07.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.171+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94663028608880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874315970 con 0x7f2134014070 2024-09-22T08:11:07.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.172+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94663028608880] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.172+0000 7f213e20e800 20 remove_watcher() i=5 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.172+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94663028601168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874316d30 con 0x7f2134014070 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.173+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94663028601168] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.173+0000 7f213e20e800 20 remove_watcher() i=6 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.173+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94663028606144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561874315970 con 0x7f2134014070 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.174+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94663028606144] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2124029040 con 0x7f2134014070 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.174+0000 7f213e20e800 20 remove_watcher() i=7 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2134014070 msgr2=0x7f2134037600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2134014070 0x7f2134037600 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561874306720 msgr2=0x561874308bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561874306720 0x561874308bb0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56187430aff0 msgr2=0x56187430d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56187430aff0 0x56187430d3e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56187430fba0 msgr2=0x561874312060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56187430fba0 0x561874312060 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f200403cfb0 msgr2=0x7f200403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f200403cfb0 0x7f200403f470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5618742d86c0 tx=0x7f212c082000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 msgr2=0x5618742fac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 --2- 172.21.15.165:0/3509519323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742f3620 0x5618742fac90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2134022bf0 tx=0x7f2134054670 comp rx=0 tx=0).stop 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 reap_dead start 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f2133fff640 1 -- 172.21.15.165:0/3509519323 reap_dead start 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 shutdown_connections 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 >> 172.21.15.165:0/3509519323 conn(0x5618742efa20 msgr2=0x5618742edc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 shutdown_connections 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/3509519323 wait complete. 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/1689828127 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f201403d000 msgr2=0x7f201403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 --2- 172.21.15.165:0/1689828127 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f201403d000 0x7f201403f4c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x5618742cdd70 tx=0x7f212c05f520 comp rx=0 tx=0).stop 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/1689828127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742e6c10 msgr2=0x5618742e7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 --2- 172.21.15.165:0/1689828127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742e6c10 0x5618742e7030 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x5618742ccce0 tx=0x7f2134018830 comp rx=0 tx=0).stop 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/1689828127 shutdown_connections 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 --2- 172.21.15.165:0/1689828127 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f201403d000 0x7f201403f4c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 --2- 172.21.15.165:0/1689828127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618742e6c10 0x5618742e7030 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/1689828127 >> 172.21.15.165:0/1689828127 conn(0x5618742dafc0 msgr2=0x5618742db3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/1689828127 shutdown_connections 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.175+0000 7f213e20e800 1 -- 172.21.15.165:0/1689828127 wait complete. 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618741d5a20 msgr2=0x5618742d3330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618741d5a20 0x5618742d3330 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618742d5690 msgr2=0x5618742d7b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618742d5690 0x5618742d7b30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f202003d000 msgr2=0x7f202003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f202003d000 0x7f202003f4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2124001d70 tx=0x7f21240012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 msgr2=0x5618742cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618742cbce0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f212c025c20 tx=0x7f212c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 shutdown_connections 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618742d5690 0x5618742d7b30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618741d5a20 0x5618742d3330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f202003d000 0x7f202003f4c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 --2- 172.21.15.165:0/1014525415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618741d30f0 0x5618742cbce0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 >> 172.21.15.165:0/1014525415 conn(0x5618741ccbb0 msgr2=0x5618742bd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 shutdown_connections 2024-09-22T08:11:07.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.176+0000 7f213e20e800 1 -- 172.21.15.165:0/1014525415 wait complete. 2024-09-22T08:11:07.190 INFO:teuthology.orchestra.run.smithi165.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-22T08:11:07.164539Z","last_stats_update":"2024-09-22T08:11:07.163464Z"} 2024-09-22T08:11:07.190 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-22T08:11:07.164539Z', 'last_stats_update': '2024-09-22T08:11:07.163464Z'} 2024-09-22T08:11:07.197 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:07.197 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-22T08:11:07.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-22T08:11:07.197 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-22T08:11:07.244 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:07.244 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:07.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.244+0000 7f83f5f23800 1 Processor -- start 2024-09-22T08:11:07.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.244+0000 7f83f5f23800 1 -- start start 2024-09-22T08:11:07.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.244+0000 7f83f5f23800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x565427d21e40 0x565427d20330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.244+0000 7f83f5f23800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565427c37a20 con 0x565427d20960 2024-09-22T08:11:07.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.244+0000 7f83f5f23800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x565427c377d0 con 0x565427d21e40 2024-09-22T08:11:07.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.244+0000 7f83f1c44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x565427d21e40 0x565427d20330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.244+0000 7f83e9443640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x565427d20960 0x565427db4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33724/0 (socket says 172.21.15.165:33724) 2024-09-22T08:11:07.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.244+0000 7f83f1c44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x565427d21e40 0x565427d20330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52246/0 (socket says 172.21.15.165:52246) 2024-09-22T08:11:07.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.245+0000 7f83e9443640 1 -- 172.21.15.165:0/3859699442 learned_addr learned my addr 172.21.15.165:0/3859699442 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:07.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.245+0000 7f83f1c44640 1 -- 172.21.15.165:0/3859699442 >> v1:172.21.15.53:6789/0 conn(0x565427d20960 legacy=0x565427db4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.245+0000 7f83f1c44640 1 -- 172.21.15.165:0/3859699442 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565427d20f50 con 0x565427d21e40 2024-09-22T08:11:07.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f1c44640 1 --2- 172.21.15.165:0/3859699442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d21e40 0x565427d20330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f83e400a470 tx=0x7f83e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748d6b038ea5794f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f1443640 1 -- 172.21.15.165:0/3859699442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e4053570 con 0x565427d21e40 2024-09-22T08:11:07.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f1443640 1 -- 172.21.15.165:0/3859699442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e4058070 con 0x565427d21e40 2024-09-22T08:11:07.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f1443640 1 -- 172.21.15.165:0/3859699442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e4053880 con 0x565427d21e40 2024-09-22T08:11:07.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f5f23800 1 -- 172.21.15.165:0/3859699442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d21e40 msgr2=0x565427d20330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3859699442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d21e40 0x565427d20330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f83e400a470 tx=0x7f83e4045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:07.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f5f23800 1 -- 172.21.15.165:0/3859699442 shutdown_connections 2024-09-22T08:11:07.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3859699442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d21e40 0x565427d20330 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f5f23800 1 -- 172.21.15.165:0/3859699442 >> 172.21.15.165:0/3859699442 conn(0x565427da7cd0 msgr2=0x565427daa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f5f23800 1 -- 172.21.15.165:0/3859699442 shutdown_connections 2024-09-22T08:11:07.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.247+0000 7f83f5f23800 1 -- 172.21.15.165:0/3859699442 wait complete. 2024-09-22T08:11:07.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.261+0000 7f83f5f23800 1 Processor -- start 2024-09-22T08:11:07.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.261+0000 7f83f5f23800 1 -- start start 2024-09-22T08:11:07.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.261+0000 7f83f5f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427e9e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.261+0000 7f83f5f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x565427c44dd0 con 0x565427d20960 2024-09-22T08:11:07.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.261+0000 7f83f1c44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427e9e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.261+0000 7f83f1c44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427e9e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52254/0 (socket says 172.21.15.165:52254) 2024-09-22T08:11:07.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.261+0000 7f83f1c44640 1 -- 172.21.15.165:0/1770733669 learned_addr learned my addr 172.21.15.165:0/1770733669 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.262+0000 7f83f1c44640 1 -- 172.21.15.165:0/1770733669 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565427e9e7b0 con 0x565427d20960 2024-09-22T08:11:07.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.262+0000 7f83f1c44640 1 --2- 172.21.15.165:0/1770733669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427e9e1c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f83e4025c20 tx=0x7f83e4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f47e5ed95730b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.262+0000 7f82dfe07640 1 -- 172.21.15.165:0/1770733669 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e4053a20 con 0x565427d20960 2024-09-22T08:11:07.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.262+0000 7f82dfe07640 1 -- 172.21.15.165:0/1770733669 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e4063070 con 0x565427d20960 2024-09-22T08:11:07.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.262+0000 7f82dfe07640 1 -- 172.21.15.165:0/1770733669 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e4053cf0 con 0x565427d20960 2024-09-22T08:11:07.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 -- 172.21.15.165:0/1770733669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 msgr2=0x565427e9e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 --2- 172.21.15.165:0/1770733669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427e9e1c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f83e4025c20 tx=0x7f83e4051000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 -- 172.21.15.165:0/1770733669 shutdown_connections 2024-09-22T08:11:07.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 --2- 172.21.15.165:0/1770733669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427e9e1c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 -- 172.21.15.165:0/1770733669 >> 172.21.15.165:0/1770733669 conn(0x565427da7cd0 msgr2=0x565427e99b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 -- 172.21.15.165:0/1770733669 shutdown_connections 2024-09-22T08:11:07.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 -- 172.21.15.165:0/1770733669 wait complete. 2024-09-22T08:11:07.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 Processor -- start 2024-09-22T08:11:07.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 -- start start 2024-09-22T08:11:07.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427ea5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f5f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x565427db5d40 con 0x565427d20960 2024-09-22T08:11:07.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f1c44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427ea5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f1c44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427ea5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52268/0 (socket says 172.21.15.165:52268) 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.263+0000 7f83f1c44640 1 -- 172.21.15.165:0/2522605620 learned_addr learned my addr 172.21.15.165:0/2522605620 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.264+0000 7f83f1c44640 1 -- 172.21.15.165:0/2522605620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565427ea61d0 con 0x565427d20960 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.264+0000 7f83f1c44640 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427ea5c70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f83e4025c20 tx=0x7f83e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.264+0000 7f82de604640 1 -- 172.21.15.165:0/2522605620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e4068660 con 0x565427d20960 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.264+0000 7f82de604640 1 -- 172.21.15.165:0/2522605620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e4068800 con 0x565427d20960 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.264+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565427ea6460 con 0x565427d20960 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.264+0000 7f82de604640 1 -- 172.21.15.165:0/2522605620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e4068ae0 con 0x565427d20960 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.264+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565427ea7070 con 0x565427d20960 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.265+0000 7f82de604640 1 -- 172.21.15.165:0/2522605620 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f83e4068c80 con 0x565427d20960 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.265+0000 7f82de604640 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82d803cfb0 0x7f82d803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.265+0000 7f82de604640 1 -- 172.21.15.165:0/2522605620 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f83e4098da0 con 0x565427d20960 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.265+0000 7f83e9443640 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82d803cfb0 0x7f82d803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.265+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427d21e40 0x565427ead2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.265+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427ead800 con 0x565427d21e40 2024-09-22T08:11:07.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.265+0000 7f83f2445640 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427d21e40 0x565427ead2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.265+0000 7f83e9443640 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82d803cfb0 0x7f82d803f470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f83dc001d70 tx=0x7f83dc0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.266+0000 7f83f2445640 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427d21e40 0x565427ead2c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.266+0000 7f83f2445640 1 -- 172.21.15.165:0/2522605620 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83ec00a4d0 con 0x565427d21e40 2024-09-22T08:11:07.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.266+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427eadba0 con 0x565427d21e40 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.266+0000 7f83f2445640 1 -- 172.21.15.165:0/2522605620 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83ec00a4d0 con 0x565427d21e40 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.266+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427eaf660 0x565427eb1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.266+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427eb2290 con 0x565427eaf660 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.266+0000 7f83f1c44640 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427eaf660 0x565427eb1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.266+0000 7f83f1c44640 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427eaf660 0x565427eb1b00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.267+0000 7f83f1c44640 1 -- 172.21.15.165:0/2522605620 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83e4051070 con 0x565427eaf660 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.267+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427eae3f0 con 0x565427d21e40 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.267+0000 7f83f2445640 1 -- 172.21.15.165:0/2522605620 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83ec00a4d0 con 0x565427d21e40 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.267+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427eae7d0 con 0x565427d21e40 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.267+0000 7f83f2445640 1 -- 172.21.15.165:0/2522605620 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83ec00a4d0 con 0x565427d21e40 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.268+0000 7f83f5f23800 1 Processor -- start 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.268+0000 7f83f5f23800 1 -- start start 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.268+0000 7f83f5f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ec0c40 0x565427ec1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.268+0000 7f83f5f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x565427ca3d50 con 0x565427ec0c40 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.268+0000 7f83f2445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ec0c40 0x565427ec1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.268+0000 7f83f2445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ec0c40 0x565427ec1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52278/0 (socket says 172.21.15.165:52278) 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.268+0000 7f83f2445640 1 -- 172.21.15.165:0/2060388186 learned_addr learned my addr 172.21.15.165:0/2060388186 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.268+0000 7f83f2445640 1 -- 172.21.15.165:0/2060388186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565427ec16a0 con 0x565427ec0c40 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.269+0000 7f83f2445640 1 --2- 172.21.15.165:0/2060388186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ec0c40 0x565427ec1060 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x565427ea6c70 tx=0x7f83ec018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.269+0000 7f82d77fe640 1 -- 172.21.15.165:0/2060388186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec014450 con 0x565427ec0c40 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.269+0000 7f82d77fe640 1 -- 172.21.15.165:0/2060388186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec014610 con 0x565427ec0c40 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.269+0000 7f83f5f23800 1 -- 172.21.15.165:0/2060388186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565427ec1ed0 con 0x565427ec0c40 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.269+0000 7f82d77fe640 1 -- 172.21.15.165:0/2060388186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec014930 con 0x565427ec0c40 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.269+0000 7f83f5f23800 1 -- 172.21.15.165:0/2060388186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565427ec2470 con 0x565427ec0c40 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.270+0000 7f82d77fe640 1 -- 172.21.15.165:0/2060388186 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f83ec011040 con 0x565427ec0c40 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.270+0000 7f82d77fe640 1 --2- 172.21.15.165:0/2060388186 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82cc03d000 0x7f82cc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.270+0000 7f82d77fe640 1 -- 172.21.15.165:0/2060388186 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f83ec01e070 con 0x565427ec0c40 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.270+0000 7f83f1c44640 1 --2- 172.21.15.165:0/2060388186 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82cc03d000 0x7f82cc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.270+0000 7f83f5f23800 1 Processor -- start 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.270+0000 7f83f1c44640 1 --2- 172.21.15.165:0/2060388186 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82cc03d000 0x7f82cc03f4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x565427ea7d40 tx=0x7f83e405da60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.270+0000 7f83f5f23800 1 -- start start 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.270+0000 7f83f5f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ecdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.270+0000 7f83f5f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x565427e9eb80 con 0x565427ecd6a0 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.271+0000 7f83f2445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ecdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.271+0000 7f83f2445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ecdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52286/0 (socket says 172.21.15.165:52286) 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.271+0000 7f83f2445640 1 -- 172.21.15.165:0/1231188521 learned_addr learned my addr 172.21.15.165:0/1231188521 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.271+0000 7f83f2445640 1 -- 172.21.15.165:0/1231188521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565427ece090 con 0x565427ecd6a0 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.271+0000 7f83f2445640 1 --2- 172.21.15.165:0/1231188521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ecdaa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f83ec018430 tx=0x7f83ec014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a572268b3cc0a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.271+0000 7f82d57fa640 1 -- 172.21.15.165:0/1231188521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec04b070 con 0x565427ecd6a0 2024-09-22T08:11:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.271+0000 7f82d57fa640 1 -- 172.21.15.165:0/1231188521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec051070 con 0x565427ecd6a0 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.271+0000 7f82d57fa640 1 -- 172.21.15.165:0/1231188521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec011da0 con 0x565427ecd6a0 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 -- 172.21.15.165:0/1231188521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 msgr2=0x565427ecdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 --2- 172.21.15.165:0/1231188521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ecdaa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f83ec018430 tx=0x7f83ec014ea0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 -- 172.21.15.165:0/1231188521 shutdown_connections 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 --2- 172.21.15.165:0/1231188521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ecdaa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 -- 172.21.15.165:0/1231188521 >> 172.21.15.165:0/1231188521 conn(0x565427ec9aa0 msgr2=0x565427ec7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 -- 172.21.15.165:0/1231188521 shutdown_connections 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 -- 172.21.15.165:0/1231188521 wait complete. 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 Processor -- start 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 -- start start 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ed4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f5f23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x565427ece6b0 con 0x565427ecd6a0 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f2445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ed4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f2445640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ed4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52298/0 (socket says 172.21.15.165:52298) 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.272+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 learned_addr learned my addr 172.21.15.165:0/3300635584 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.273+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565427ed51e0 con 0x565427ecd6a0 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.273+0000 7f83f2445640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ed4c80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0535e0 tx=0x7f83ec0546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.273+0000 7f82c37fe640 1 -- 172.21.15.165:0/3300635584 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec04b040 con 0x565427ecd6a0 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.273+0000 7f82c37fe640 1 -- 172.21.15.165:0/3300635584 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec053320 con 0x565427ecd6a0 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.273+0000 7f82c37fe640 1 -- 172.21.15.165:0/3300635584 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec0168f0 con 0x565427ecd6a0 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.273+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565427ed5470 con 0x565427ecd6a0 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.273+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565427ed5df0 con 0x565427ecd6a0 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.274+0000 7f82c37fe640 1 -- 172.21.15.165:0/3300635584 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f83ec011330 con 0x565427ecd6a0 2024-09-22T08:11:07.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.274+0000 7f82c37fe640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82bc03cfb0 0x7f82bc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.274+0000 7f82c37fe640 1 -- 172.21.15.165:0/3300635584 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f83ec00e040 con 0x565427ecd6a0 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.274+0000 7f83f1c44640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82bc03cfb0 0x7f82bc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.274+0000 7f83f1c44640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82bc03cfb0 0x7f82bc03f470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83e4068fd0 tx=0x7f83e4088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.274+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.274+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427ee0770 0x565427ee2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.274+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427ee3380 con 0x565427ee0770 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.274+0000 7f83e9443640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427ee0770 0x565427ee2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83e9443640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427ee0770 0x565427ee2c30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83dc009050 con 0x565427ee0770 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 20 realm 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427edfac0 con 0x565427ee0770 2024-09-22T08:11:07.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83dc009050 con 0x565427ee0770 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427ee3e70 con 0x565427ee0770 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83dc009050 con 0x565427ee0770 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.275+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427ee4740 con 0x565427ee0770 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83dc009050 con 0x565427ee0770 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f5f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427ee5160 0x565427ee7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427ee7c90 con 0x565427ee5160 2024-09-22T08:11:07.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f2445640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427ee5160 0x565427ee7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f2445640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427ee5160 0x565427ee7550 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f5f23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f5f23800 20 searching for the correct realm 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x565427ee9c40 0x565427eec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee9c40 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.276+0000 7f83f1c44640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x565427ee9c40 0x565427eec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.277+0000 7f83f1c44640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x565427ee9c40 0x565427eec100 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.277+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.277+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee5160 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.277+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.277+0000 7f83f2445640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f83ec040c20 0x7f83ec02d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.277+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x7f83ec040c20 2024-09-22T08:11:07.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.278+0000 7f83e9443640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f83ec040c20 0x7f83ec02d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.278+0000 7f83e9443640 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f83ec040c20 0x7f83ec02d8e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.278+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc009050 con 0x7f83ec040c20 2024-09-22T08:11:07.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.278+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee0770 2024-09-22T08:11:07.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.278+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc009050 con 0x565427ee0770 2024-09-22T08:11:07.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.278+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee0770 2024-09-22T08:11:07.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.279+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.279+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x7f83ec040c20 2024-09-22T08:11:07.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.279+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.279+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x7f83ec040c20 2024-09-22T08:11:07.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.279+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.279+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee5160 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.279+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.279+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee9c40 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.280+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.280+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee0770 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.280+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.280+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x7f83ec040c20 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.280+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.280+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee0770 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.280+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.280+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee5160 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.280+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.280+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee9c40 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.281+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.281+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee9c40 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.281+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.281+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x7f83ec040c20 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.281+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.281+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee9c40 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.281+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.281+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee9c40 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.282+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.282+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee0770 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.282+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.282+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee0770 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.282+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.282+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x7f83ec040c20 2024-09-22T08:11:07.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.283+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.283+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee9c40 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.283+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.283+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee5160 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.283+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.283+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee0770 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.283+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.283+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x7f83ec040c20 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.284+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.284+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee9c40 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.284+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.284+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x7f83ec040c20 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.284+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.284+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee5160 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.284+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.284+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee9c40 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x7f83ec040c20 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee0770 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565427eec780 con 0x565427ee5160 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f5f23800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f5f23800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f5f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f5f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:07.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f5f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f5f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.285+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427ee8650 con 0x565427ee0770 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427ee8ef0 con 0x565427ee0770 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427eecc00 con 0x565427ee0770 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:07.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 20 zone default found 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 4 Realm: () 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 20 zonegroup default 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.286+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427eecfa0 con 0x7f83ec040c20 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f5f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427eeedd0 con 0x565427ee9c40 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f5f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427eef230 con 0x565427ee9c40 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f5f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f5f23800 20 started sync module instance, tier type = 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f5f23800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.287+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427eee270 con 0x565427ee5160 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.288+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.288+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94919447209568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427eeded0 con 0x565427ee5160 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.288+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef0160 con 0x565427ee0770 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.289+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.289+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94919447209568] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.289+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94919447213712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef0160 con 0x565427ee0770 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.289+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef0b80 con 0x565427ee9c40 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.290+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94919447213712] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.291+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.291+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94919447215280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef00d0 con 0x565427ee9c40 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.291+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef1a40 con 0x565427ee5160 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.292+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94919447215280] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.292+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.292+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94919447221648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef19b0 con 0x565427ee5160 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.292+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef2900 con 0x565427ee0770 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.293+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.293+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94919447225424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef2d20 con 0x565427ee0770 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.293+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef37c0 con 0x7f83ec040c20 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.293+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94919447221648] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.294+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94919447225424] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.296+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.296+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94919447229072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef2870 con 0x7f83ec040c20 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.296+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef4060 con 0x7f83ec040c20 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.297+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94919447229072] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.297+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.297+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94919447223856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef2870 con 0x7f83ec040c20 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.297+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef4630 con 0x7f83ec040c20 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.298+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94919447223856] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.298+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.298+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94919447231328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef4630 con 0x7f83ec040c20 2024-09-22T08:11:07.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.298+0000 7f83f5f23800 20 add_watcher() i=0 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.298+0000 7f83f5f23800 20 add_watcher() i=1 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.298+0000 7f83f5f23800 20 add_watcher() i=2 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.298+0000 7f83f5f23800 20 add_watcher() i=3 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.298+0000 7f83f5f23800 20 add_watcher() i=4 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.298+0000 7f83f5f23800 20 add_watcher() i=5 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.298+0000 7f83f5f23800 20 add_watcher() i=6 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.299+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94919447231328] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.299+0000 7f83f5f23800 20 add_watcher() i=7 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.299+0000 7f83f5f23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.299+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427ef7b00 con 0x565427ee0770 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.299+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.299+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94919447233824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427ef4eb0 con 0x565427ee0770 2024-09-22T08:11:07.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.300+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94919447233824] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.300+0000 7f82a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.300+0000 7f83f5f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.300+0000 7f83f5f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.300+0000 7f83f5f23800 5 note: GC not initialized 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f82a27fc640 20 reqs_thread_entry: start 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 20 Filter name: none 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f8213fff640 20 reqs_thread_entry: start 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427f2aeb0 con 0x565427ee0770 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:07.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.301+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427f2cfa0 con 0x565427ee5160 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.302+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.302+0000 7f83f5f23800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.302+0000 7f83f5f23800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.302+0000 7f83f5f23800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.302+0000 7f83f5f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 : miss 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.302+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.302+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427f2e810 con 0x7f83ec040c20 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.303+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(64 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.303+0000 7f83f5f23800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.303+0000 7f83f5f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.303+0000 7f83f5f23800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.303+0000 7f83f5f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.303+0000 7f83f5f23800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.303+0000 7f83f5f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.303+0000 7f83f5f23800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.303+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f31f50 con 0x565427ee5160 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.304+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.304+0000 7f83f5f23800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.304+0000 7f83f5f23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.304+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427f30f40 con 0x565427ee5160 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.304+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.304+0000 7f83f5f23800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.304+0000 7f83f5f23800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.304+0000 7f83f5f23800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.304+0000 7f83f5f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.304+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f35a00 con 0x565427ee5160 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.305+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.305+0000 7f83f5f23800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.305+0000 7f83f5f23800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.305+0000 7f83f5f23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.305+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94919447483456 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565427f32d20 con 0x7f83ec040c20 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.305+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== watch-notify(notify (1) cookie 94919447223856 notify 137438953474 ret 0) ==== 380+0+0 (crc 0 0 0) 0x565427f2ec00 con 0x7f83ec040c20 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.306+0000 7f82d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94919447223856 notifier 4479 bl.length()=338 2024-09-22T08:11:07.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.306+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(68 notify.6 [notify cookie 94919447483456 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.306+0000 7f82d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.306+0000 7f82d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.306+0000 7f82d57fa640 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f82b4003ea0 con 0x7f83ec040c20 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.306+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.306+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== watch-notify(notify_complete (2) cookie 94919447483456 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565427f2dd30 con 0x7f83ec040c20 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.307+0000 7f82a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.307+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94919447233824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f28c10 con 0x565427ee0770 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.308+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94919447233824] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.308+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94919447209568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f28c10 con 0x565427ee5160 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.309+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94919447209568] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.309+0000 7f83f5f23800 20 remove_watcher() i=0 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.309+0000 7f83f5f23800 2 removed watcher, disabling cache 2024-09-22T08:11:07.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.309+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94919447213712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f28c10 con 0x565427ee0770 2024-09-22T08:11:07.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.310+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94919447213712] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.310+0000 7f83f5f23800 20 remove_watcher() i=1 2024-09-22T08:11:07.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.310+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94919447215280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f28c10 con 0x565427ee9c40 2024-09-22T08:11:07.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.311+0000 7f83f1c44640 1 -- 172.21.15.165:0/3300635584 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94919447215280] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4051070 con 0x565427ee9c40 2024-09-22T08:11:07.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.311+0000 7f83f5f23800 20 remove_watcher() i=2 2024-09-22T08:11:07.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.311+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94919447221648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f28c10 con 0x565427ee5160 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.312+0000 7f83f2445640 1 -- 172.21.15.165:0/3300635584 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94919447221648] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec02a070 con 0x565427ee5160 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.312+0000 7f83f5f23800 20 remove_watcher() i=3 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.312+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94919447225424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f28c10 con 0x565427ee0770 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.313+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94919447225424] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x565427ee0770 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.313+0000 7f83f5f23800 20 remove_watcher() i=4 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.313+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94919447229072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f28c10 con 0x7f83ec040c20 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.314+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94919447229072] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.314+0000 7f83f5f23800 20 remove_watcher() i=5 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.314+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94919447223856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f28c10 con 0x7f83ec040c20 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.315+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94919447223856] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.315+0000 7f83f5f23800 20 remove_watcher() i=6 2024-09-22T08:11:07.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.315+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94919447231328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565427f28c10 con 0x7f83ec040c20 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94919447231328] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc029040 con 0x7f83ec040c20 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 20 remove_watcher() i=7 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f83ec040c20 msgr2=0x7f83ec02d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f83ec040c20 0x7f83ec02d8e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427ee0770 msgr2=0x565427ee2c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427ee0770 0x565427ee2c30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427ee5160 msgr2=0x565427ee7550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427ee5160 0x565427ee7550 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x565427ee9c40 msgr2=0x565427eec100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x565427ee9c40 0x565427eec100 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82bc03cfb0 msgr2=0x7f82bc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82bc03cfb0 0x7f82bc03f470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83e4068fd0 tx=0x7f83e4088000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83e9443640 1 -- 172.21.15.165:0/3300635584 reap_dead start 2024-09-22T08:11:07.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 msgr2=0x565427ed4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ed4c80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0535e0 tx=0x7f83ec0546a0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 shutdown_connections 2024-09-22T08:11:07.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 --2- 172.21.15.165:0/3300635584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ecd6a0 0x565427ed4c80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.316+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 >> 172.21.15.165:0/3300635584 conn(0x565427ec9aa0 msgr2=0x565427ec7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 shutdown_connections 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/3300635584 wait complete. 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2060388186 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82cc03d000 msgr2=0x7f82cc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2060388186 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82cc03d000 0x7f82cc03f4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x565427ea7d40 tx=0x7f83e405da60 comp rx=0 tx=0).stop 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2060388186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ec0c40 msgr2=0x565427ec1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2060388186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ec0c40 0x565427ec1060 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x565427ea6c70 tx=0x7f83ec018830 comp rx=0 tx=0).stop 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2060388186 shutdown_connections 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2060388186 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82cc03d000 0x7f82cc03f4c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2060388186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427ec0c40 0x565427ec1060 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2060388186 >> 172.21.15.165:0/2060388186 conn(0x565427eb4ff0 msgr2=0x565427eb53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2060388186 shutdown_connections 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2060388186 wait complete. 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427d21e40 msgr2=0x565427ead2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427d21e40 0x565427ead2c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427eaf660 msgr2=0x565427eb1b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427eaf660 0x565427eb1b00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82d803cfb0 msgr2=0x7f82d803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82d803cfb0 0x7f82d803f470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f83dc001d70 tx=0x7f83dc0012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 msgr2=0x565427ea5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427ea5c70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f83e4025c20 tx=0x7f83e4002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 shutdown_connections 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x565427eaf660 0x565427eb1b00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x565427d21e40 0x565427ead2c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f82d803cfb0 0x7f82d803f470 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 --2- 172.21.15.165:0/2522605620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x565427d20960 0x565427ea5c70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 >> 172.21.15.165:0/2522605620 conn(0x565427da7cd0 msgr2=0x565427e98330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 shutdown_connections 2024-09-22T08:11:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.317+0000 7f83f5f23800 1 -- 172.21.15.165:0/2522605620 wait complete. 2024-09-22T08:11:07.327 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-22T08:11:07.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-22T08:11:07.328 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-22T08:11:07.380 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:07.380 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:07.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbab1a98800 1 Processor -- start 2024-09-22T08:11:07.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbab1a98800 1 -- start start 2024-09-22T08:11:07.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbab1a98800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559f0c6b85b0 0x559f0c6b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbab1a98800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f0c5cda20 con 0x559f0c6b70d0 2024-09-22T08:11:07.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbab1a98800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559f0c5cd7d0 con 0x559f0c6b85b0 2024-09-22T08:11:07.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbaaf582640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559f0c6b85b0 0x559f0c6b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbaaf582640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559f0c6b85b0 0x559f0c6b6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52300/0 (socket says 172.21.15.165:52300) 2024-09-22T08:11:07.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbaa6d81640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559f0c6b70d0 0x559f0c74a530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33734/0 (socket says 172.21.15.165:33734) 2024-09-22T08:11:07.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbaaf582640 1 -- 172.21.15.165:0/3383568492 learned_addr learned my addr 172.21.15.165:0/3383568492 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbaaf582640 1 -- 172.21.15.165:0/3383568492 >> v1:172.21.15.53:6789/0 conn(0x559f0c6b70d0 legacy=0x559f0c74a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.380+0000 7fbaaf582640 1 -- 172.21.15.165:0/3383568492 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0c6b76c0 con 0x559f0c6b85b0 2024-09-22T08:11:07.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.382+0000 7fbaaf582640 1 --2- 172.21.15.165:0/3383568492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b85b0 0x559f0c6b6b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000a520 tx=0x7fbaa0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34dc7b7a1b26d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.382+0000 7fbaaed81640 1 -- 172.21.15.165:0/3383568492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa0055070 con 0x559f0c6b85b0 2024-09-22T08:11:07.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.382+0000 7fbaaed81640 1 -- 172.21.15.165:0/3383568492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa00515b0 con 0x559f0c6b85b0 2024-09-22T08:11:07.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.382+0000 7fbaaed81640 1 -- 172.21.15.165:0/3383568492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa00518d0 con 0x559f0c6b85b0 2024-09-22T08:11:07.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.383+0000 7fbab1a98800 1 -- 172.21.15.165:0/3383568492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b85b0 msgr2=0x559f0c6b6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.383+0000 7fbab1a98800 1 --2- 172.21.15.165:0/3383568492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b85b0 0x559f0c6b6b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000a520 tx=0x7fbaa0045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.383+0000 7fbab1a98800 1 -- 172.21.15.165:0/3383568492 shutdown_connections 2024-09-22T08:11:07.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.383+0000 7fbab1a98800 1 --2- 172.21.15.165:0/3383568492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b85b0 0x559f0c6b6b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.383+0000 7fbab1a98800 1 -- 172.21.15.165:0/3383568492 >> 172.21.15.165:0/3383568492 conn(0x559f0c73ddf0 msgr2=0x559f0c740250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.383+0000 7fbab1a98800 1 -- 172.21.15.165:0/3383568492 shutdown_connections 2024-09-22T08:11:07.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.383+0000 7fbab1a98800 1 -- 172.21.15.165:0/3383568492 wait complete. 2024-09-22T08:11:07.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.397+0000 7fbab1a98800 1 Processor -- start 2024-09-22T08:11:07.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.397+0000 7fbab1a98800 1 -- start start 2024-09-22T08:11:07.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.397+0000 7fbab1a98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c8342b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.397+0000 7fbab1a98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559f0c5dadd0 con 0x559f0c6b70d0 2024-09-22T08:11:07.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.397+0000 7fbaaf582640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c8342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.397+0000 7fbaaf582640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c8342b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52308/0 (socket says 172.21.15.165:52308) 2024-09-22T08:11:07.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.397+0000 7fbaaf582640 1 -- 172.21.15.165:0/1072364949 learned_addr learned my addr 172.21.15.165:0/1072364949 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.398+0000 7fbaaf582640 1 -- 172.21.15.165:0/1072364949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0c8348a0 con 0x559f0c6b70d0 2024-09-22T08:11:07.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.398+0000 7fbaaf582640 1 --2- 172.21.15.165:0/1072364949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c8342b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00460d0 tx=0x7fbaa0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608f08d89ae1035f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.398+0000 7fb99d60a640 1 -- 172.21.15.165:0/1072364949 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa00519d0 con 0x559f0c6b70d0 2024-09-22T08:11:07.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.398+0000 7fb99d60a640 1 -- 172.21.15.165:0/1072364949 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa0051b70 con 0x559f0c6b70d0 2024-09-22T08:11:07.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.398+0000 7fb99d60a640 1 -- 172.21.15.165:0/1072364949 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa0051e50 con 0x559f0c6b70d0 2024-09-22T08:11:07.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 -- 172.21.15.165:0/1072364949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 msgr2=0x559f0c8342b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 --2- 172.21.15.165:0/1072364949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c8342b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00460d0 tx=0x7fbaa0051000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 -- 172.21.15.165:0/1072364949 shutdown_connections 2024-09-22T08:11:07.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 --2- 172.21.15.165:0/1072364949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c8342b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 -- 172.21.15.165:0/1072364949 >> 172.21.15.165:0/1072364949 conn(0x559f0c73ddf0 msgr2=0x559f0c82fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 -- 172.21.15.165:0/1072364949 shutdown_connections 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 -- 172.21.15.165:0/1072364949 wait complete. 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 Processor -- start 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 -- start start 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c83bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbab1a98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559f0c74be60 con 0x559f0c6b70d0 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbaaf582640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c83bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbaaf582640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c83bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52318/0 (socket says 172.21.15.165:52318) 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.399+0000 7fbaaf582640 1 -- 172.21.15.165:0/2719086762 learned_addr learned my addr 172.21.15.165:0/2719086762 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.400+0000 7fbaaf582640 1 -- 172.21.15.165:0/2719086762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0c83c220 con 0x559f0c6b70d0 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.400+0000 7fbaaf582640 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c83bcc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00460d0 tx=0x7fbaa0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.400+0000 7fb99be07640 1 -- 172.21.15.165:0/2719086762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa0073020 con 0x559f0c6b70d0 2024-09-22T08:11:07.402 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.400+0000 7fb99be07640 1 -- 172.21.15.165:0/2719086762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa006f580 con 0x559f0c6b70d0 2024-09-22T08:11:07.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.400+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f0c83c4b0 con 0x559f0c6b70d0 2024-09-22T08:11:07.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.400+0000 7fb99be07640 1 -- 172.21.15.165:0/2719086762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa006f8a0 con 0x559f0c6b70d0 2024-09-22T08:11:07.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.400+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f0c83d0c0 con 0x559f0c6b70d0 2024-09-22T08:11:07.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.401+0000 7fb99be07640 1 -- 172.21.15.165:0/2719086762 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbaa0076020 con 0x559f0c6b70d0 2024-09-22T08:11:07.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.401+0000 7fb99be07640 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb99403d000 0x7fb99403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.401+0000 7fb99be07640 1 -- 172.21.15.165:0/2719086762 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbaa006b040 con 0x559f0c6b70d0 2024-09-22T08:11:07.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.401+0000 7fbaa6d81640 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb99403d000 0x7fb99403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.401+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c6b85b0 0x559f0c843310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.401+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c843850 con 0x559f0c6b85b0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.401+0000 7fbaafd83640 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c6b85b0 0x559f0c843310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.402+0000 7fbaa6d81640 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb99403d000 0x7fb99403f4c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fba98001e30 tx=0x7fba98001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.402+0000 7fbaafd83640 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c6b85b0 0x559f0c843310 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.402+0000 7fbaafd83640 1 -- 172.21.15.165:0/2719086762 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbaa800a4d0 con 0x559f0c6b85b0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.402+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c843bf0 con 0x559f0c6b85b0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.402+0000 7fbaafd83640 1 -- 172.21.15.165:0/2719086762 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbaa800a4d0 con 0x559f0c6b85b0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.402+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c8456f0 0x559f0c847b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.402+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c848320 con 0x559f0c8456f0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.403+0000 7fbaaf582640 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c8456f0 0x559f0c847b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.403+0000 7fbaaf582640 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c8456f0 0x559f0c847b90 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.403+0000 7fbaaf582640 1 -- 172.21.15.165:0/2719086762 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c8456f0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.403+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c844440 con 0x559f0c6b85b0 2024-09-22T08:11:07.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.403+0000 7fbaafd83640 1 -- 172.21.15.165:0/2719086762 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbaa800a4d0 con 0x559f0c6b85b0 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.403+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8448a0 con 0x559f0c6b85b0 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.404+0000 7fbaafd83640 1 -- 172.21.15.165:0/2719086762 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbaa800a4d0 con 0x559f0c6b85b0 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.404+0000 7fbab1a98800 1 Processor -- start 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.404+0000 7fbab1a98800 1 -- start start 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.404+0000 7fbab1a98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c856d90 0x559f0c8571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.404+0000 7fbab1a98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559f0c639d50 con 0x559f0c856d90 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.404+0000 7fbaafd83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c856d90 0x559f0c8571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.404+0000 7fbaafd83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c856d90 0x559f0c8571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52328/0 (socket says 172.21.15.165:52328) 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.404+0000 7fbaafd83640 1 -- 172.21.15.165:0/786084213 learned_addr learned my addr 172.21.15.165:0/786084213 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.405+0000 7fbaafd83640 1 -- 172.21.15.165:0/786084213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0c8577f0 con 0x559f0c856d90 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.405+0000 7fbaafd83640 1 --2- 172.21.15.165:0/786084213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c856d90 0x559f0c8571b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x559f0c83db50 tx=0x7fbaa8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.405+0000 7fb999602640 1 -- 172.21.15.165:0/786084213 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa8014450 con 0x559f0c856d90 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.405+0000 7fb999602640 1 -- 172.21.15.165:0/786084213 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa80145f0 con 0x559f0c856d90 2024-09-22T08:11:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.405+0000 7fbab1a98800 1 -- 172.21.15.165:0/786084213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f0c858020 con 0x559f0c856d90 2024-09-22T08:11:07.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.405+0000 7fb999602640 1 -- 172.21.15.165:0/786084213 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa8014910 con 0x559f0c856d90 2024-09-22T08:11:07.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.405+0000 7fbab1a98800 1 -- 172.21.15.165:0/786084213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f0c8585c0 con 0x559f0c856d90 2024-09-22T08:11:07.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.406+0000 7fb999602640 1 -- 172.21.15.165:0/786084213 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbaa8011040 con 0x559f0c856d90 2024-09-22T08:11:07.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.406+0000 7fb999602640 1 --2- 172.21.15.165:0/786084213 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb98803d000 0x7fb98803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.406+0000 7fb999602640 1 -- 172.21.15.165:0/786084213 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbaa801e070 con 0x559f0c856d90 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.406+0000 7fbaaf582640 1 --2- 172.21.15.165:0/786084213 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb98803d000 0x7fb98803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.406+0000 7fbab1a98800 1 Processor -- start 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fbaaf582640 1 --2- 172.21.15.165:0/786084213 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb98803d000 0x7fb98803f4c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x559f0c83ddc0 tx=0x7fbaa0077f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fbab1a98800 1 -- start start 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fbab1a98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c863bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fbab1a98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559f0c834c10 con 0x559f0c8637d0 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fbaafd83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c863bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fbaafd83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c863bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52344/0 (socket says 172.21.15.165:52344) 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fbaafd83640 1 -- 172.21.15.165:0/1127608202 learned_addr learned my addr 172.21.15.165:0/1127608202 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fbaafd83640 1 -- 172.21.15.165:0/1127608202 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0c8641c0 con 0x559f0c8637d0 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fbaafd83640 1 --2- 172.21.15.165:0/1127608202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c863bd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8054760 tx=0x7fbaa8016c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d69a06e0dbdc24 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fb992ffd640 1 -- 172.21.15.165:0/1127608202 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa804b070 con 0x559f0c8637d0 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fb992ffd640 1 -- 172.21.15.165:0/1127608202 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa8051070 con 0x559f0c8637d0 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.407+0000 7fb992ffd640 1 -- 172.21.15.165:0/1127608202 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa8011da0 con 0x559f0c8637d0 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 -- 172.21.15.165:0/1127608202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 msgr2=0x559f0c863bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 --2- 172.21.15.165:0/1127608202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c863bd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8054760 tx=0x7fbaa8016c80 comp rx=0 tx=0).stop 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 -- 172.21.15.165:0/1127608202 shutdown_connections 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 --2- 172.21.15.165:0/1127608202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c863bd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 -- 172.21.15.165:0/1127608202 >> 172.21.15.165:0/1127608202 conn(0x559f0c85fbd0 msgr2=0x559f0c85de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 -- 172.21.15.165:0/1127608202 shutdown_connections 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 -- 172.21.15.165:0/1127608202 wait complete. 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 Processor -- start 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 -- start start 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c86adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.408+0000 7fbab1a98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559f0c8647e0 con 0x559f0c8637d0 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.409+0000 7fbaafd83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c86adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.409+0000 7fbaafd83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c86adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52346/0 (socket says 172.21.15.165:52346) 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.409+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 learned_addr learned my addr 172.21.15.165:0/2632640769 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.409+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0c86b350 con 0x559f0c8637d0 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.409+0000 7fbaafd83640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c86adf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8049040 tx=0x7fbaa80546f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.409+0000 7fb9917fa640 1 -- 172.21.15.165:0/2632640769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa804b040 con 0x559f0c8637d0 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.409+0000 7fb9917fa640 1 -- 172.21.15.165:0/2632640769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa80168f0 con 0x559f0c8637d0 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.409+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f0c86b5e0 con 0x559f0c8637d0 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.409+0000 7fb9917fa640 1 -- 172.21.15.165:0/2632640769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa8011460 con 0x559f0c8637d0 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.409+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f0c86bf60 con 0x559f0c8637d0 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.410+0000 7fb9917fa640 1 -- 172.21.15.165:0/2632640769 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbaa8056070 con 0x559f0c8637d0 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.410+0000 7fb9917fa640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb97803cfb0 0x7fb97803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.411+0000 7fb9917fa640 1 -- 172.21.15.165:0/2632640769 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbaa800e040 con 0x559f0c8637d0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.411+0000 7fbaaf582640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb97803cfb0 0x7fb97803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.411+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.411+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c8768d0 0x559f0c878d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.411+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8794e0 con 0x559f0c8768d0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.411+0000 7fbaaf582640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb97803cfb0 0x7fb97803f470 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00507a0 tx=0x7fbaa0089000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.411+0000 7fbaa6d81640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c8768d0 0x559f0c878d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.411+0000 7fbaa6d81640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c8768d0 0x559f0c878d90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba9800f610 con 0x559f0c8768d0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 20 realm 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c875c20 con 0x559f0c8768d0 2024-09-22T08:11:07.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba9800f610 con 0x559f0c8768d0 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c879fd0 con 0x559f0c8768d0 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba9800f610 con 0x559f0c8768d0 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c87a8a0 con 0x559f0c8768d0 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba9800f610 con 0x559f0c8768d0 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c87b2c0 0x559f0c87d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c87ddf0 con 0x559f0c87b2c0 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.412+0000 7fbaafd83640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c87b2c0 0x559f0c87d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.413+0000 7fbaafd83640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c87b2c0 0x559f0c87d6b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.413+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.413+0000 7fbab1a98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.413+0000 7fbab1a98800 20 searching for the correct realm 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.413+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559f0c87fda0 0x559f0c882260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.413+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87fda0 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.413+0000 7fbaaf582640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559f0c87fda0 0x559f0c882260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.413+0000 7fbaaf582640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559f0c87fda0 0x559f0c882260 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.414+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.414+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87b2c0 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.414+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.414+0000 7fbaafd83640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbaa8037020 0x7fbaa804d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.414+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x7fbaa8037020 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.414+0000 7fbaa6d81640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbaa8037020 0x7fbaa804d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.415+0000 7fbaa6d81640 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbaa8037020 0x7fbaa804d260 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.415+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9800f610 con 0x7fbaa8037020 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.415+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c8768d0 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.415+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9800f610 con 0x559f0c8768d0 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.415+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c8768d0 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.415+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fba9802b040 con 0x559f0c8768d0 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.415+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x7fbaa8037020 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.416+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9802b040 con 0x7fbaa8037020 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.416+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x7fbaa8037020 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.416+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9802b040 con 0x7fbaa8037020 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.416+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87b2c0 2024-09-22T08:11:07.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.416+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.416+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87fda0 2024-09-22T08:11:07.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.416+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.416+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c8768d0 2024-09-22T08:11:07.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.416+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9802b040 con 0x559f0c8768d0 2024-09-22T08:11:07.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.416+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x7fbaa8037020 2024-09-22T08:11:07.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.417+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9802b040 con 0x7fbaa8037020 2024-09-22T08:11:07.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.417+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c8768d0 2024-09-22T08:11:07.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.417+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9802b040 con 0x559f0c8768d0 2024-09-22T08:11:07.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.417+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87b2c0 2024-09-22T08:11:07.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.417+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.417+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87fda0 2024-09-22T08:11:07.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.417+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.417+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87fda0 2024-09-22T08:11:07.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.418+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.418+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x7fbaa8037020 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.418+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9802b040 con 0x7fbaa8037020 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.418+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87fda0 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.418+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.418+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87fda0 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.418+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.418+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c8768d0 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.418+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9802b040 con 0x559f0c8768d0 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.419+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c8768d0 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.419+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fba9802b040 con 0x559f0c8768d0 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.419+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x7fbaa8037020 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.419+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9802b040 con 0x7fbaa8037020 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.419+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87fda0 2024-09-22T08:11:07.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.419+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.419+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87b2c0 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.420+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.420+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c8768d0 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.420+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9802b040 con 0x559f0c8768d0 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.420+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x7fbaa8037020 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.420+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.420+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87fda0 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.420+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.421+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x7fbaa8037020 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.421+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.421+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87b2c0 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.421+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.421+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87fda0 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.421+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.421+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x7fbaa8037020 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.421+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.421+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c8768d0 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8828e0 con 0x559f0c87b2c0 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:07.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c87e7e0 con 0x559f0c8768d0 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c87f080 con 0x559f0c8768d0 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.422+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c882d60 con 0x559f0c8768d0 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:07.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 20 zone default found 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 4 Realm: () 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 20 zonegroup default 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c882d80 con 0x7fbaa8037020 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c884be0 con 0x559f0c87fda0 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.423+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8850a0 con 0x559f0c87fda0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.424+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.424+0000 7fbab1a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.424+0000 7fbab1a98800 20 started sync module instance, tier type = 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.424+0000 7fbab1a98800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.424+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c884050 con 0x559f0c87b2c0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.425+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.425+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94141598418032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c883cb0 con 0x559f0c87b2c0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.425+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c885fd0 con 0x559f0c8768d0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.426+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94141598418032] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.426+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.426+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94141598422272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c885fd0 con 0x559f0c8768d0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.426+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8869d0 con 0x559f0c87fda0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.427+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94141598422272] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.427+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.427+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94141598423840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c885f40 con 0x559f0c87fda0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.427+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c887890 con 0x559f0c87b2c0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.428+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94141598423840] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.428+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.428+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94141598430176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c887800 con 0x559f0c87b2c0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.428+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c888750 con 0x559f0c8768d0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.429+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94141598430176] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.429+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.429+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94141598432384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c888750 con 0x559f0c8768d0 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.429+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c889160 con 0x7fbaa8037020 2024-09-22T08:11:07.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.430+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94141598432384] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.430+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.430+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94141598437008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c888750 con 0x7fbaa8037020 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.430+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c889b70 con 0x7fbaa8037020 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.431+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94141598437008] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.431+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.431+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94141598433952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c889d50 con 0x7fbaa8037020 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.431+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c88a5a0 con 0x7fbaa8037020 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.432+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94141598433952] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.432+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.432+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94141598440064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c88a390 con 0x7fbaa8037020 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.432+0000 7fbab1a98800 20 add_watcher() i=0 2024-09-22T08:11:07.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.432+0000 7fbab1a98800 20 add_watcher() i=1 2024-09-22T08:11:07.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.432+0000 7fbab1a98800 20 add_watcher() i=2 2024-09-22T08:11:07.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.432+0000 7fbab1a98800 20 add_watcher() i=3 2024-09-22T08:11:07.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.432+0000 7fbab1a98800 20 add_watcher() i=4 2024-09-22T08:11:07.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.432+0000 7fbab1a98800 20 add_watcher() i=5 2024-09-22T08:11:07.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.432+0000 7fbab1a98800 20 add_watcher() i=6 2024-09-22T08:11:07.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.433+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94141598440064] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.433+0000 7fbab1a98800 20 add_watcher() i=7 2024-09-22T08:11:07.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.433+0000 7fbab1a98800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:07.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.433+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c88da00 con 0x559f0c8768d0 2024-09-22T08:11:07.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.434+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.434+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94141598441120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c88ad80 con 0x559f0c8768d0 2024-09-22T08:11:07.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.435+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94141598441120] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.435+0000 7fb965fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.435+0000 7fbab1a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.435+0000 7fbab1a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.435+0000 7fbab1a98800 5 note: GC not initialized 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.435+0000 7fb964fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.435+0000 7fbab1a98800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 20 Filter name: none 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fb8de7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8c0ee0 con 0x7fbaa8037020 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8bf420 con 0x7fbaa8037020 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.436+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8bfcf0 con 0x7fbaa8037020 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.437+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fbab1a98800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fbab1a98800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fbab1a98800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94141598660672 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8c4980 con 0x7fbaa8037020 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== watch-notify(notify (1) cookie 94141598437008 notify 137438953475 ret 0) ==== 598+0+0 (crc 0 0 0) 0x559f0c8c0090 con 0x7fbaa8037020 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fb992ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94141598437008 notifier 4486 bl.length()=556 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fb992ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fb992ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(65 notify.5 [notify cookie 94141598660672 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fb992ffd640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb974003ea0 con 0x7fbaa8037020 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== watch-notify(notify_complete (2) cookie 94141598660672 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f0c8c0830 con 0x7fbaa8037020 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.438+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8bf7f0 con 0x7fbaa8037020 2024-09-22T08:11:07.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fbab1a98800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fbab1a98800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fbab1a98800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94141598660592 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8c4980 con 0x559f0c87fda0 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== watch-notify(notify (1) cookie 94141598423840 notify 137438953474 ret 0) ==== 219+0+0 (crc 0 0 0) 0x559f0c83d0c0 con 0x559f0c87fda0 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fb9927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94141598423840 notifier 4486 bl.length()=177 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fb9927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fb9927fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fb9927fc640 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb8e4003400 con 0x559f0c87fda0 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.439+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(68 notify.2 [notify cookie 94141598660592 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.440+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.440+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== watch-notify(notify_complete (2) cookie 94141598660592 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f0c83c4b0 con 0x559f0c87fda0 2024-09-22T08:11:07.452 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-22T08:11:07.437698Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:07.437688Z","tags":[],"group_ids":[]} 2024-09-22T08:11:07.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.441+0000 7fb965fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.441+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94141598441120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8beb90 con 0x559f0c8768d0 2024-09-22T08:11:07.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.441+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94141598441120] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.442+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94141598418032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8beb90 con 0x559f0c87b2c0 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.442+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94141598418032] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.442+0000 7fbab1a98800 20 remove_watcher() i=0 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.442+0000 7fbab1a98800 2 removed watcher, disabling cache 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.442+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94141598422272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8beb90 con 0x559f0c8768d0 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.444+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94141598422272] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.444+0000 7fbab1a98800 20 remove_watcher() i=1 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.444+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94141598423840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8beb90 con 0x559f0c87fda0 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.445+0000 7fbaaf582640 1 -- 172.21.15.165:0/2632640769 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94141598423840] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaa0057030 con 0x559f0c87fda0 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.445+0000 7fbab1a98800 20 remove_watcher() i=2 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.445+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94141598430176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8beb90 con 0x559f0c87b2c0 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.446+0000 7fbaafd83640 1 -- 172.21.15.165:0/2632640769 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94141598430176] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaa803e070 con 0x559f0c87b2c0 2024-09-22T08:11:07.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.446+0000 7fbab1a98800 20 remove_watcher() i=3 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.446+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94141598432384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8beb90 con 0x559f0c8768d0 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.447+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94141598432384] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x559f0c8768d0 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.447+0000 7fbab1a98800 20 remove_watcher() i=4 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.447+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94141598437008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8beb90 con 0x7fbaa8037020 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.448+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94141598437008] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.448+0000 7fbab1a98800 20 remove_watcher() i=5 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.448+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94141598433952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8beb90 con 0x7fbaa8037020 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.449+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94141598433952] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.449+0000 7fbab1a98800 20 remove_watcher() i=6 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.449+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94141598440064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559f0c8beb90 con 0x7fbaa8037020 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94141598440064] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9803b040 con 0x7fbaa8037020 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 20 remove_watcher() i=7 2024-09-22T08:11:07.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbaa8037020 msgr2=0x7fbaa804d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbaa8037020 0x7fbaa804d260 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c8768d0 msgr2=0x559f0c878d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c8768d0 0x559f0c878d90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c87b2c0 msgr2=0x559f0c87d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c87b2c0 0x559f0c87d6b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559f0c87fda0 msgr2=0x559f0c882260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559f0c87fda0 0x559f0c882260 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb97803cfb0 msgr2=0x7fb97803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb97803cfb0 0x7fb97803f470 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00507a0 tx=0x7fbaa0089000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 msgr2=0x559f0c86adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c86adf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8049040 tx=0x7fbaa80546f0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbaa6d81640 1 -- 172.21.15.165:0/2632640769 reap_dead start 2024-09-22T08:11:07.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 shutdown_connections 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2632640769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c8637d0 0x559f0c86adf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 >> 172.21.15.165:0/2632640769 conn(0x559f0c85fbd0 msgr2=0x559f0c85dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 shutdown_connections 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.450+0000 7fbab1a98800 1 -- 172.21.15.165:0/2632640769 wait complete. 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/786084213 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb98803d000 msgr2=0x7fb98803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/786084213 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb98803d000 0x7fb98803f4c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x559f0c83ddc0 tx=0x7fbaa0077f10 comp rx=0 tx=0).stop 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/786084213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c856d90 msgr2=0x559f0c8571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/786084213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c856d90 0x559f0c8571b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x559f0c83db50 tx=0x7fbaa8018830 comp rx=0 tx=0).stop 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/786084213 shutdown_connections 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/786084213 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb98803d000 0x7fb98803f4c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/786084213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c856d90 0x559f0c8571b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/786084213 >> 172.21.15.165:0/786084213 conn(0x559f0c84b140 msgr2=0x559f0c84b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/786084213 shutdown_connections 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/786084213 wait complete. 2024-09-22T08:11:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c6b85b0 msgr2=0x559f0c843310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c6b85b0 0x559f0c843310 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c8456f0 msgr2=0x559f0c847b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c8456f0 0x559f0c847b90 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb99403d000 msgr2=0x7fb99403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb99403d000 0x7fb99403f4c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fba98001e30 tx=0x7fba98001390 comp rx=0 tx=0).stop 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 msgr2=0x559f0c83bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c83bcc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00460d0 tx=0x7fbaa0002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 shutdown_connections 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559f0c8456f0 0x559f0c847b90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559f0c6b85b0 0x559f0c843310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb99403d000 0x7fb99403f4c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 --2- 172.21.15.165:0/2719086762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f0c6b70d0 0x559f0c83bcc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 >> 172.21.15.165:0/2719086762 conn(0x559f0c73ddf0 msgr2=0x559f0c8355e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 shutdown_connections 2024-09-22T08:11:07.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.451+0000 7fbab1a98800 1 -- 172.21.15.165:0/2719086762 wait complete. 2024-09-22T08:11:07.462 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-22T08:11:07.437698Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:07.437688Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:07.468 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-22T08:11:07.472 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:07.473 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-22T08:11:07.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-22T08:11:07.473 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-22T08:11:07.516 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:07.516 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:07.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.516+0000 7f122df0c800 1 Processor -- start 2024-09-22T08:11:07.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.516+0000 7f122df0c800 1 -- start start 2024-09-22T08:11:07.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.516+0000 7f122df0c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563c55b4bcb0 0x563c55b51640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.516+0000 7f122df0c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563c559d5a20 con 0x563c55b4a9e0 2024-09-22T08:11:07.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.516+0000 7f122df0c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563c559d57d0 con 0x563c55b4bcb0 2024-09-22T08:11:07.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.517+0000 7f122b1f5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563c55b4bcb0 0x563c55b51640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.517+0000 7f122b9f6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563c55b4a9e0 0x563c55b4b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33748/0 (socket says 172.21.15.165:33748) 2024-09-22T08:11:07.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.517+0000 7f122b9f6640 1 -- 172.21.15.165:0/2631688776 learned_addr learned my addr 172.21.15.165:0/2631688776 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:07.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.517+0000 7f122b1f5640 1 -- 172.21.15.165:0/2631688776 >> v1:172.21.15.53:6789/0 conn(0x563c55b4a9e0 legacy=0x563c55b4b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.517+0000 7f122a9f4640 1 -- 172.21.15.165:0/2631688776 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799241783 0 0) 0x563c559d5a20 con 0x563c55b4a9e0 2024-09-22T08:11:07.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.517+0000 7f122b1f5640 1 -- 172.21.15.165:0/2631688776 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c55b4b0e0 con 0x563c55b4bcb0 2024-09-22T08:11:07.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.519+0000 7f122b1f5640 1 --2- 172.21.15.165:0/2631688776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4bcb0 0x563c55b51640 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f122000a470 tx=0x7f1220045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fba9472a609c9a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.519+0000 7f122a9f4640 1 -- 172.21.15.165:0/2631688776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1220053570 con 0x563c55b4bcb0 2024-09-22T08:11:07.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.519+0000 7f122a9f4640 1 -- 172.21.15.165:0/2631688776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1220058070 con 0x563c55b4bcb0 2024-09-22T08:11:07.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.519+0000 7f122a9f4640 1 -- 172.21.15.165:0/2631688776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1220053880 con 0x563c55b4bcb0 2024-09-22T08:11:07.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.519+0000 7f122df0c800 1 -- 172.21.15.165:0/2631688776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4bcb0 msgr2=0x563c55b51640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.519+0000 7f122df0c800 1 --2- 172.21.15.165:0/2631688776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4bcb0 0x563c55b51640 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f122000a470 tx=0x7f1220045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:07.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.519+0000 7f122df0c800 1 -- 172.21.15.165:0/2631688776 shutdown_connections 2024-09-22T08:11:07.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.519+0000 7f122df0c800 1 --2- 172.21.15.165:0/2631688776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4bcb0 0x563c55b51640 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.519+0000 7f122df0c800 1 -- 172.21.15.165:0/2631688776 >> 172.21.15.165:0/2631688776 conn(0x563c55b45db0 msgr2=0x563c55b48210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.519+0000 7f122df0c800 1 -- 172.21.15.165:0/2631688776 shutdown_connections 2024-09-22T08:11:07.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.520+0000 7f122df0c800 1 -- 172.21.15.165:0/2631688776 wait complete. 2024-09-22T08:11:07.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.533+0000 7f122df0c800 1 Processor -- start 2024-09-22T08:11:07.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.534+0000 7f122df0c800 1 -- start start 2024-09-22T08:11:07.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.534+0000 7f122df0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55ac02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.534+0000 7f122df0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c559e2dd0 con 0x563c55b4a9e0 2024-09-22T08:11:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.534+0000 7f122b9f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55ac02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.534+0000 7f122b9f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55ac02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52356/0 (socket says 172.21.15.165:52356) 2024-09-22T08:11:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.534+0000 7f122b9f6640 1 -- 172.21.15.165:0/2552847742 learned_addr learned my addr 172.21.15.165:0/2552847742 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.534+0000 7f122b9f6640 1 -- 172.21.15.165:0/2552847742 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c55ac08c0 con 0x563c55b4a9e0 2024-09-22T08:11:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.535+0000 7f122b9f6640 1 --2- 172.21.15.165:0/2552847742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55ac02d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f121c006fa0 tx=0x7f121c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355409016ae9eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.535+0000 7f1119e0b640 1 -- 172.21.15.165:0/2552847742 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f121c003450 con 0x563c55b4a9e0 2024-09-22T08:11:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.535+0000 7f1119e0b640 1 -- 172.21.15.165:0/2552847742 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121c003610 con 0x563c55b4a9e0 2024-09-22T08:11:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.535+0000 7f1119e0b640 1 -- 172.21.15.165:0/2552847742 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f121c003970 con 0x563c55b4a9e0 2024-09-22T08:11:07.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.535+0000 7f122df0c800 1 -- 172.21.15.165:0/2552847742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 msgr2=0x563c55ac02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.535+0000 7f122df0c800 1 --2- 172.21.15.165:0/2552847742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55ac02d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f121c006fa0 tx=0x7f121c001b00 comp rx=0 tx=0).stop 2024-09-22T08:11:07.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122df0c800 1 -- 172.21.15.165:0/2552847742 shutdown_connections 2024-09-22T08:11:07.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122df0c800 1 --2- 172.21.15.165:0/2552847742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55ac02d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122df0c800 1 -- 172.21.15.165:0/2552847742 >> 172.21.15.165:0/2552847742 conn(0x563c55b45db0 msgr2=0x563c55c35770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122df0c800 1 -- 172.21.15.165:0/2552847742 shutdown_connections 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122df0c800 1 -- 172.21.15.165:0/2552847742 wait complete. 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122df0c800 1 Processor -- start 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122df0c800 1 -- start start 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122df0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55c43b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122df0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c55b51b80 con 0x563c55b4a9e0 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122b9f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55c43b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122b9f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55c43b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52364/0 (socket says 172.21.15.165:52364) 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.536+0000 7f122b9f6640 1 -- 172.21.15.165:0/113214991 learned_addr learned my addr 172.21.15.165:0/113214991 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.537+0000 7f122b9f6640 1 -- 172.21.15.165:0/113214991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c55c44070 con 0x563c55b4a9e0 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.537+0000 7f122b9f6640 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55c43b10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f121c001330 tx=0x7f121c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.537+0000 7f1113fff640 1 -- 172.21.15.165:0/113214991 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f121c014a10 con 0x563c55b4a9e0 2024-09-22T08:11:07.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.537+0000 7f1113fff640 1 -- 172.21.15.165:0/113214991 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121c014bb0 con 0x563c55b4a9e0 2024-09-22T08:11:07.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.537+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c55c44300 con 0x563c55b4a9e0 2024-09-22T08:11:07.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.537+0000 7f1113fff640 1 -- 172.21.15.165:0/113214991 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f121c01e3f0 con 0x563c55b4a9e0 2024-09-22T08:11:07.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.537+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c55c44d00 con 0x563c55b4a9e0 2024-09-22T08:11:07.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.538+0000 7f1113fff640 1 -- 172.21.15.165:0/113214991 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f121c010070 con 0x563c55b4a9e0 2024-09-22T08:11:07.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.538+0000 7f1113fff640 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f111403d000 0x7f111403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.538+0000 7f1113fff640 1 -- 172.21.15.165:0/113214991 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f121c018070 con 0x563c55b4a9e0 2024-09-22T08:11:07.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.538+0000 7f122b1f5640 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f111403d000 0x7f111403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.539+0000 7f122df0c800 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55b4bcb0 0x563c55c4b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.539+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c4b6a0 con 0x563c55b4bcb0 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.539+0000 7f122c1f7640 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55b4bcb0 0x563c55c4b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.539+0000 7f122b1f5640 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f111403d000 0x7f111403f4c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1220057000 tx=0x7f1220052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.539+0000 7f122c1f7640 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55b4bcb0 0x563c55c4b160 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.539+0000 7f122c1f7640 1 -- 172.21.15.165:0/113214991 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12240083e0 con 0x563c55b4bcb0 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.539+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c4ba40 con 0x563c55b4bcb0 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.539+0000 7f122c1f7640 1 -- 172.21.15.165:0/113214991 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f12240083e0 con 0x563c55b4bcb0 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.540+0000 7f122df0c800 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c4d540 0x563c55c4f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.540+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c50150 con 0x563c55c4d540 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.540+0000 7f122b9f6640 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c4d540 0x563c55c4f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.540+0000 7f122b9f6640 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c4d540 0x563c55c4f9c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.540+0000 7f122b9f6640 1 -- 172.21.15.165:0/113214991 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c4d540 2024-09-22T08:11:07.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.540+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c4c290 con 0x563c55b4bcb0 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.540+0000 7f122c1f7640 1 -- 172.21.15.165:0/113214991 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f12240083e0 con 0x563c55b4bcb0 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.541+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c4c6e0 con 0x563c55b4bcb0 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.541+0000 7f122c1f7640 1 -- 172.21.15.165:0/113214991 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f12240083e0 con 0x563c55b4bcb0 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.541+0000 7f122df0c800 1 Processor -- start 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.541+0000 7f122df0c800 1 -- start start 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.541+0000 7f122df0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c5eb30 0x563c55c5ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.541+0000 7f122df0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c55a41d50 con 0x563c55c5eb30 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.541+0000 7f122c1f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c5eb30 0x563c55c5ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.541+0000 7f122c1f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c5eb30 0x563c55c5ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52376/0 (socket says 172.21.15.165:52376) 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.541+0000 7f122c1f7640 1 -- 172.21.15.165:0/2616130840 learned_addr learned my addr 172.21.15.165:0/2616130840 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.542+0000 7f122c1f7640 1 -- 172.21.15.165:0/2616130840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c55c5f590 con 0x563c55c5eb30 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.542+0000 7f122c1f7640 1 --2- 172.21.15.165:0/2616130840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c5eb30 0x563c55c5ef50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x563c55c45a40 tx=0x7f122400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.542+0000 7f11117fa640 1 -- 172.21.15.165:0/2616130840 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1224007dc0 con 0x563c55c5eb30 2024-09-22T08:11:07.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.542+0000 7f11117fa640 1 -- 172.21.15.165:0/2616130840 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f122401e020 con 0x563c55c5eb30 2024-09-22T08:11:07.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.542+0000 7f11117fa640 1 -- 172.21.15.165:0/2616130840 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1224019570 con 0x563c55c5eb30 2024-09-22T08:11:07.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.542+0000 7f122df0c800 1 -- 172.21.15.165:0/2616130840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c55c5fdc0 con 0x563c55c5eb30 2024-09-22T08:11:07.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.542+0000 7f122df0c800 1 -- 172.21.15.165:0/2616130840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c55c60360 con 0x563c55c5eb30 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.543+0000 7f11117fa640 1 -- 172.21.15.165:0/2616130840 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1224016040 con 0x563c55c5eb30 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.543+0000 7f11117fa640 1 --2- 172.21.15.165:0/2616130840 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f110403d000 0x7f110403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.543+0000 7f11117fa640 1 -- 172.21.15.165:0/2616130840 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f122401f030 con 0x563c55c5eb30 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.543+0000 7f122b9f6640 1 --2- 172.21.15.165:0/2616130840 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f110403d000 0x7f110403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.543+0000 7f122df0c800 1 Processor -- start 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.543+0000 7f122b9f6640 1 --2- 172.21.15.165:0/2616130840 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f110403d000 0x7f110403f4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x563c55c45c00 tx=0x7f121c052a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.543+0000 7f122df0c800 1 -- start start 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.544+0000 7f122df0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c6ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.544+0000 7f122df0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c55abed20 con 0x563c55c6b630 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.544+0000 7f122c1f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c6ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.544+0000 7f122c1f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c6ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52386/0 (socket says 172.21.15.165:52386) 2024-09-22T08:11:07.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.544+0000 7f122c1f7640 1 -- 172.21.15.165:0/4285833950 learned_addr learned my addr 172.21.15.165:0/4285833950 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.544+0000 7f122c1f7640 1 -- 172.21.15.165:0/4285833950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c55c6c000 con 0x563c55c6b630 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.544+0000 7f122c1f7640 1 --2- 172.21.15.165:0/4285833950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c6ba10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1224007fd0 tx=0x7f1224014340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260080833de8d925 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.544+0000 7f110affd640 1 -- 172.21.15.165:0/4285833950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f122401d070 con 0x563c55c6b630 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.544+0000 7f110affd640 1 -- 172.21.15.165:0/4285833950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1224017ac0 con 0x563c55c6b630 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.544+0000 7f110affd640 1 -- 172.21.15.165:0/4285833950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1224056070 con 0x563c55c6b630 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 -- 172.21.15.165:0/4285833950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 msgr2=0x563c55c6ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 --2- 172.21.15.165:0/4285833950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c6ba10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1224007fd0 tx=0x7f1224014340 comp rx=0 tx=0).stop 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 -- 172.21.15.165:0/4285833950 shutdown_connections 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 --2- 172.21.15.165:0/4285833950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c6ba10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 -- 172.21.15.165:0/4285833950 >> 172.21.15.165:0/4285833950 conn(0x563c55c67a30 msgr2=0x563c55c65c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 -- 172.21.15.165:0/4285833950 shutdown_connections 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 -- 172.21.15.165:0/4285833950 wait complete. 2024-09-22T08:11:07.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 Processor -- start 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 -- start start 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c72bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.545+0000 7f122df0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c55c6c640 con 0x563c55c6b630 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.546+0000 7f122c1f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c72bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.546+0000 7f122c1f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c72bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52402/0 (socket says 172.21.15.165:52402) 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.546+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 learned_addr learned my addr 172.21.15.165:0/3000777602 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.546+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c55c73130 con 0x563c55c6b630 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.546+0000 7f122c1f7640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c72bd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1224054900 tx=0x7f1224054570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.546+0000 7f11097fa640 1 -- 172.21.15.165:0/3000777602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1224044070 con 0x563c55c6b630 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.546+0000 7f11097fa640 1 -- 172.21.15.165:0/3000777602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1224031070 con 0x563c55c6b630 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.546+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c55c733c0 con 0x563c55c6b630 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.546+0000 7f11097fa640 1 -- 172.21.15.165:0/3000777602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1224054de0 con 0x563c55c6b630 2024-09-22T08:11:07.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.546+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c55c73d40 con 0x563c55c6b630 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.547+0000 7f11097fa640 1 -- 172.21.15.165:0/3000777602 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f12240173b0 con 0x563c55c6b630 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.547+0000 7f11097fa640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f10f403d000 0x7f10f403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.547+0000 7f11097fa640 1 -- 172.21.15.165:0/3000777602 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f122402dc90 con 0x563c55c6b630 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.547+0000 7f122b9f6640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f10f403d000 0x7f10f403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.547+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.547+0000 7f122df0c800 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55c7e4e0 0x563c55c809a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.547+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c810f0 con 0x563c55c7e4e0 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.547+0000 7f122b1f5640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55c7e4e0 0x563c55c809a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122b9f6640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f10f403d000 0x7f10f403f4c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f121c0035e0 tx=0x7f121c036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122b1f5640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55c7e4e0 0x563c55c809a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 20 realm 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c81520 con 0x563c55c7e4e0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c81df0 con 0x563c55c7e4e0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.548+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c82190 con 0x563c55c7e4e0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122df0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122df0c800 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c82ef0 0x563c55c852e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c85820 con 0x563c55c82ef0 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122c1f7640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c82ef0 0x563c55c852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122c1f7640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c82ef0 0x563c55c852e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f12240083e0 con 0x563c55c82ef0 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122df0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122df0c800 20 searching for the correct realm 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122df0c800 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563c55c87860 0x563c55c89d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.549+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c87860 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.550+0000 7f122b9f6640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563c55c87860 0x563c55c89d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.550+0000 7f122b9f6640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563c55c87860 0x563c55c89d20 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.550+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.550+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c82ef0 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.550+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f12240083e0 con 0x563c55c82ef0 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.550+0000 7f122c1f7640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1224019040 0x7f1224035a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.550+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x7f1224019040 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.551+0000 7f122b1f5640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1224019040 0x7f1224035a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.551+0000 7f122b1f5640 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1224019040 0x7f1224035a10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.551+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x7f1224019040 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.551+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c7e4e0 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.551+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.551+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c7e4e0 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.552+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.552+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x7f1224019040 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.552+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x7f1224019040 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.552+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x7f1224019040 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.552+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x7f1224019040 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.552+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c82ef0 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.552+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12240083e0 con 0x563c55c82ef0 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.552+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c87860 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.553+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.553+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c7e4e0 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.553+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.553+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x7f1224019040 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.553+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x7f1224019040 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.553+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c7e4e0 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.553+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.553+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c82ef0 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.554+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f12240083e0 con 0x563c55c82ef0 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.554+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c87860 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.554+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.554+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c87860 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.554+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.554+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x7f1224019040 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.554+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x7f1224019040 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.554+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c87860 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.555+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.555+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c87860 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.555+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.555+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c7e4e0 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.555+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.555+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c7e4e0 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.555+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.555+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x7f1224019040 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.556+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x7f1224019040 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.556+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c87860 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.556+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.556+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c82ef0 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.556+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12240083e0 con 0x563c55c82ef0 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.556+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c7e4e0 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.556+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.556+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x7f1224019040 2024-09-22T08:11:07.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.557+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x7f1224019040 2024-09-22T08:11:07.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.557+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c87860 2024-09-22T08:11:07.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.557+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.557+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x7f1224019040 2024-09-22T08:11:07.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.557+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x7f1224019040 2024-09-22T08:11:07.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.557+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c82ef0 2024-09-22T08:11:07.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.557+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1224067040 con 0x563c55c82ef0 2024-09-22T08:11:07.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.557+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c87860 2024-09-22T08:11:07.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.557+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x7f1224019040 2024-09-22T08:11:07.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1220051070 con 0x7f1224019040 2024-09-22T08:11:07.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c7e4e0 2024-09-22T08:11:07.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a3f0 con 0x563c55c82ef0 2024-09-22T08:11:07.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1224067040 con 0x563c55c82ef0 2024-09-22T08:11:07.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122df0c800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122df0c800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122df0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122df0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122df0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122df0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.558+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c86260 con 0x563c55c7e4e0 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c866e0 con 0x563c55c7e4e0 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1220051070 con 0x563c55c7e4e0 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c86b80 con 0x563c55c7e4e0 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f12200891c0 con 0x563c55c7e4e0 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 20 zone default found 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 4 Realm: () 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 20 zonegroup default 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8a870 con 0x7f1224019040 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x7f1224019040 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.559+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8c3c0 con 0x563c55c87860 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.560+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.560+0000 7f122df0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.560+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.560+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8c870 con 0x563c55c87860 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.560+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.560+0000 7f122df0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.560+0000 7f122df0c800 20 started sync module instance, tier type = 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.560+0000 7f122df0c800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.560+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8b700 con 0x563c55c82ef0 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.561+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1224067040 con 0x563c55c82ef0 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.561+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94817137245184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8b700 con 0x563c55c82ef0 2024-09-22T08:11:07.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.561+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8d3a0 con 0x563c55c7e4e0 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.562+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94817137245184] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1224067040 con 0x563c55c82ef0 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.562+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x563c55c7e4e0 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.562+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94817137249936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8b700 con 0x563c55c7e4e0 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.562+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8de40 con 0x563c55c87860 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.563+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94817137249936] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x563c55c7e4e0 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.563+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.563+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94817137252656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8e1e0 con 0x563c55c87860 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.563+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8ecc0 con 0x563c55c82ef0 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.564+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1224067040 con 0x563c55c82ef0 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.564+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94817137256400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c8f560 con 0x563c55c82ef0 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.564+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c90040 con 0x563c55c7e4e0 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.564+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94817137252656] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.565+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x563c55c7e4e0 2024-09-22T08:11:07.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.565+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94817137261392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c90040 con 0x563c55c7e4e0 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.565+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c90a90 con 0x7f1224019040 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.565+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94817137256400] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1224067040 con 0x563c55c82ef0 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.566+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94817137261392] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x563c55c7e4e0 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.566+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x7f1224019040 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.566+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94817137258672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c905a0 con 0x7f1224019040 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.566+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c91360 con 0x7f1224019040 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.567+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94817137258672] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x7f1224019040 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.567+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x7f1224019040 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.568+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94817137242704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c910f0 con 0x7f1224019040 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.568+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c91940 con 0x7f1224019040 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.569+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94817137242704] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x7f1224019040 2024-09-22T08:11:07.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.569+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x7f1224019040 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.569+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94817137266208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c91750 con 0x7f1224019040 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.569+0000 7f122df0c800 20 add_watcher() i=0 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.569+0000 7f122df0c800 20 add_watcher() i=1 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.569+0000 7f122df0c800 20 add_watcher() i=2 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.569+0000 7f122df0c800 20 add_watcher() i=3 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.569+0000 7f122df0c800 20 add_watcher() i=4 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.569+0000 7f122df0c800 20 add_watcher() i=5 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.569+0000 7f122df0c800 20 add_watcher() i=6 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.570+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94817137266208] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x7f1224019040 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.570+0000 7f122df0c800 20 add_watcher() i=7 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.570+0000 7f122df0c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.570+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55c94db0 con 0x563c55c7e4e0 2024-09-22T08:11:07.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.570+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f12200891c0 con 0x563c55c7e4e0 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.570+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94817137267264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c92140 con 0x563c55c7e4e0 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.571+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94817137267264] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x563c55c7e4e0 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.571+0000 7f10e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.571+0000 7f122df0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.571+0000 7f122df0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.571+0000 7f122df0c800 5 note: GC not initialized 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.571+0000 7f10e0fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.571+0000 7f122df0c800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.572+0000 7f122df0c800 20 Filter name: none 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.572+0000 7f105a7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.572+0000 7f122df0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.572+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c55cc7c20 con 0x563c55c82ef0 2024-09-22T08:11:07.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.572+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f1224067040 con 0x563c55c82ef0 2024-09-22T08:11:07.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.572+0000 7f122df0c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:07.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.573+0000 7f10e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.573+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94817137267264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55c93610 con 0x563c55c7e4e0 2024-09-22T08:11:07.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.574+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94817137267264] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x563c55c7e4e0 2024-09-22T08:11:07.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.574+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94817137245184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55cc5a70 con 0x563c55c82ef0 2024-09-22T08:11:07.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.575+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94817137245184] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1224067040 con 0x563c55c82ef0 2024-09-22T08:11:07.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.575+0000 7f122df0c800 20 remove_watcher() i=0 2024-09-22T08:11:07.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.575+0000 7f122df0c800 2 removed watcher, disabling cache 2024-09-22T08:11:07.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.575+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94817137249936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55cc5a70 con 0x563c55c7e4e0 2024-09-22T08:11:07.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.576+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94817137249936] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x563c55c7e4e0 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.577+0000 7f122df0c800 20 remove_watcher() i=1 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.577+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94817137252656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55cc5a70 con 0x563c55c87860 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.578+0000 7f122b9f6640 1 -- 172.21.15.165:0/3000777602 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94817137252656] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f121c01b070 con 0x563c55c87860 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.578+0000 7f122df0c800 20 remove_watcher() i=2 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.578+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94817137256400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55cc5a70 con 0x563c55c82ef0 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.578+0000 7f122c1f7640 1 -- 172.21.15.165:0/3000777602 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94817137256400] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1224067040 con 0x563c55c82ef0 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.579+0000 7f122df0c800 20 remove_watcher() i=3 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.579+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94817137261392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55cc5a70 con 0x563c55c7e4e0 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.580+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94817137261392] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x563c55c7e4e0 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.580+0000 7f122df0c800 20 remove_watcher() i=4 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.580+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94817137258672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55cc5a70 con 0x7f1224019040 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.581+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94817137258672] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x7f1224019040 2024-09-22T08:11:07.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.581+0000 7f122df0c800 20 remove_watcher() i=5 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.581+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94817137242704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55cc5a70 con 0x7f1224019040 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.582+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94817137242704] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x7f1224019040 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.582+0000 7f122df0c800 20 remove_watcher() i=6 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.582+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94817137266208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c55cc5a70 con 0x7f1224019040 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94817137266208] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12200891c0 con 0x7f1224019040 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 20 remove_watcher() i=7 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1224019040 msgr2=0x7f1224035a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1224019040 0x7f1224035a10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55c7e4e0 msgr2=0x563c55c809a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55c7e4e0 0x563c55c809a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c82ef0 msgr2=0x563c55c852e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c82ef0 0x563c55c852e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563c55c87860 msgr2=0x563c55c89d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563c55c87860 0x563c55c89d20 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f10f403d000 msgr2=0x7f10f403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f10f403d000 0x7f10f403f4c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f121c0035e0 tx=0x7f121c036000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 msgr2=0x563c55c72bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 --2- 172.21.15.165:0/3000777602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c6b630 0x563c55c72bd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1224054900 tx=0x7f1224054570 comp rx=0 tx=0).stop 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122b1f5640 1 -- 172.21.15.165:0/3000777602 reap_dead start 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 shutdown_connections 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 >> 172.21.15.165:0/3000777602 conn(0x563c55c67a30 msgr2=0x563c55c65c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 shutdown_connections 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.583+0000 7f122df0c800 1 -- 172.21.15.165:0/3000777602 wait complete. 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/2616130840 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f110403d000 msgr2=0x7f110403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/2616130840 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f110403d000 0x7f110403f4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x563c55c45c00 tx=0x7f121c052a80 comp rx=0 tx=0).stop 2024-09-22T08:11:07.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/2616130840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c5eb30 msgr2=0x563c55c5ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/2616130840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c5eb30 0x563c55c5ef50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x563c55c45a40 tx=0x7f122400af40 comp rx=0 tx=0).stop 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/2616130840 shutdown_connections 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/2616130840 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f110403d000 0x7f110403f4c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/2616130840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55c5eb30 0x563c55c5ef50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/2616130840 >> 172.21.15.165:0/2616130840 conn(0x563c55c52ee0 msgr2=0x563c55c532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/2616130840 shutdown_connections 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/2616130840 wait complete. 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55b4bcb0 msgr2=0x563c55c4b160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55b4bcb0 0x563c55c4b160 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c4d540 msgr2=0x563c55c4f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c4d540 0x563c55c4f9c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f111403d000 msgr2=0x7f111403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f111403d000 0x7f111403f4c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1220057000 tx=0x7f1220052000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 msgr2=0x563c55c43b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55c43b10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f121c001330 tx=0x7f121c001250 comp rx=0 tx=0).stop 2024-09-22T08:11:07.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 shutdown_connections 2024-09-22T08:11:07.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563c55c4d540 0x563c55c4f9c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563c55b4bcb0 0x563c55c4b160 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f111403d000 0x7f111403f4c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 --2- 172.21.15.165:0/113214991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c55b4a9e0 0x563c55c43b10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 >> 172.21.15.165:0/113214991 conn(0x563c55b45db0 msgr2=0x563c55c352c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 shutdown_connections 2024-09-22T08:11:07.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.584+0000 7f122df0c800 1 -- 172.21.15.165:0/113214991 wait complete. 2024-09-22T08:11:07.594 INFO:teuthology.orchestra.run.smithi165.stdout:{"key":"bucket:myfoo","ver":{"tag":"_YMOM8gLC07AV8EJM5EE2NO0","ver":2},"mtime":"2024-09-22T08:11:07.305285Z","data":{"bucket":{"name":"myfoo","marker":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","bucket_id":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-22T08:11:06.203755Z","linked":false,"has_bucket_info":false}} 2024-09-22T08:11:07.594 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_YMOM8gLC07AV8EJM5EE2NO0', 'ver': 2}, 'mtime': '2024-09-22T08:11:07.305285Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'bucket_id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-22T08:11:06.203755Z', 'linked': False, 'has_bucket_info': False}} 2024-09-22T08:11:07.594 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1'] 2024-09-22T08:11:07.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1'] 2024-09-22T08:11:07.595 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:07.683 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:07.683 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:07.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.683+0000 7f6cb2b22800 1 Processor -- start 2024-09-22T08:11:07.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.683+0000 7f6cb2b22800 1 -- start start 2024-09-22T08:11:07.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.683+0000 7f6cb2b22800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ba1dbc2b20 0x55ba1dbc4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.683+0000 7f6cb2b22800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba1da49a20 con 0x55ba1dbbf010 2024-09-22T08:11:07.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.683+0000 7f6cb2b22800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ba1da497d0 con 0x55ba1dbc2b20 2024-09-22T08:11:07.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.684+0000 7f6ca5f01640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ba1dbc2b20 0x55ba1dbc4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.684+0000 7f6cae702640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55ba1dbbf010 0x55ba1dbc1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33752/0 (socket says 172.21.15.165:33752) 2024-09-22T08:11:07.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.684+0000 7f6cae702640 1 -- 172.21.15.165:0/3903172874 learned_addr learned my addr 172.21.15.165:0/3903172874 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:07.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.684+0000 7f6ca5f01640 1 -- 172.21.15.165:0/3903172874 >> v1:172.21.15.53:6789/0 conn(0x55ba1dbbf010 legacy=0x55ba1dbc1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.684+0000 7f6ca5f01640 1 -- 172.21.15.165:0/3903172874 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba1dbc65a0 con 0x55ba1dbc2b20 2024-09-22T08:11:07.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6ca5f01640 1 --2- 172.21.15.165:0/3903172874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbc2b20 0x55ba1dbc4f10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800a470 tx=0x7f6c98045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bbf2af5d84b3c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6cadf01640 1 -- 172.21.15.165:0/3903172874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c98053570 con 0x55ba1dbc2b20 2024-09-22T08:11:07.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6cadf01640 1 -- 172.21.15.165:0/3903172874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c98058070 con 0x55ba1dbc2b20 2024-09-22T08:11:07.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6cadf01640 1 -- 172.21.15.165:0/3903172874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c98053880 con 0x55ba1dbc2b20 2024-09-22T08:11:07.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6cb2b22800 1 -- 172.21.15.165:0/3903172874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbc2b20 msgr2=0x55ba1dbc4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/3903172874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbc2b20 0x55ba1dbc4f10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800a470 tx=0x7f6c98045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:07.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6cb2b22800 1 -- 172.21.15.165:0/3903172874 shutdown_connections 2024-09-22T08:11:07.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/3903172874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbc2b20 0x55ba1dbc4f10 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6cb2b22800 1 -- 172.21.15.165:0/3903172874 >> 172.21.15.165:0/3903172874 conn(0x55ba1dbb8bd0 msgr2=0x55ba1dbbb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6cb2b22800 1 -- 172.21.15.165:0/3903172874 shutdown_connections 2024-09-22T08:11:07.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.686+0000 7f6cb2b22800 1 -- 172.21.15.165:0/3903172874 wait complete. 2024-09-22T08:11:07.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.700+0000 7f6cb2b22800 1 Processor -- start 2024-09-22T08:11:07.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.700+0000 7f6cb2b22800 1 -- start start 2024-09-22T08:11:07.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.700+0000 7f6cb2b22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dbbe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.700+0000 7f6cb2b22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ba1da56dd0 con 0x55ba1dbbf010 2024-09-22T08:11:07.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.701+0000 7f6cae702640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dbbe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.701+0000 7f6cae702640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dbbe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52422/0 (socket says 172.21.15.165:52422) 2024-09-22T08:11:07.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.701+0000 7f6cae702640 1 -- 172.21.15.165:0/4240034587 learned_addr learned my addr 172.21.15.165:0/4240034587 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.701+0000 7f6cae702640 1 -- 172.21.15.165:0/4240034587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba1dbbed90 con 0x55ba1dbbf010 2024-09-22T08:11:07.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.701+0000 7f6cae702640 1 --2- 172.21.15.165:0/4240034587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dbbe7a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0001df0 tx=0x7f6ca000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec756b85effa6b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.701+0000 7f6b9c608640 1 -- 172.21.15.165:0/4240034587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca0012020 con 0x55ba1dbbf010 2024-09-22T08:11:07.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.701+0000 7f6b9c608640 1 -- 172.21.15.165:0/4240034587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca000e470 con 0x55ba1dbbf010 2024-09-22T08:11:07.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.701+0000 7f6b9c608640 1 -- 172.21.15.165:0/4240034587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca000e7f0 con 0x55ba1dbbf010 2024-09-22T08:11:07.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 -- 172.21.15.165:0/4240034587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 msgr2=0x55ba1dbbe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/4240034587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dbbe7a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0001df0 tx=0x7f6ca000b6c0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 -- 172.21.15.165:0/4240034587 shutdown_connections 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/4240034587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dbbe7a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 -- 172.21.15.165:0/4240034587 >> 172.21.15.165:0/4240034587 conn(0x55ba1dbb8bd0 msgr2=0x55ba1dca9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 -- 172.21.15.165:0/4240034587 shutdown_connections 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 -- 172.21.15.165:0/4240034587 wait complete. 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 Processor -- start 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 -- start start 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dcb7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.702+0000 7f6cb2b22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ba1dbc5840 con 0x55ba1dbbf010 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.703+0000 7f6cae702640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dcb7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.703+0000 7f6cae702640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dcb7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52424/0 (socket says 172.21.15.165:52424) 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.703+0000 7f6cae702640 1 -- 172.21.15.165:0/2064598680 learned_addr learned my addr 172.21.15.165:0/2064598680 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.703+0000 7f6cae702640 1 -- 172.21.15.165:0/2064598680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba1dcb8390 con 0x55ba1dbbf010 2024-09-22T08:11:07.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.703+0000 7f6cae702640 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dcb7e30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55ba1dbbe2d0 tx=0x7f6ca0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.703+0000 7f6b9ae05640 1 -- 172.21.15.165:0/2064598680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca0012030 con 0x55ba1dbbf010 2024-09-22T08:11:07.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.703+0000 7f6b9ae05640 1 -- 172.21.15.165:0/2064598680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca001a6d0 con 0x55ba1dbbf010 2024-09-22T08:11:07.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.703+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba1dcb8620 con 0x55ba1dbbf010 2024-09-22T08:11:07.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.703+0000 7f6b9ae05640 1 -- 172.21.15.165:0/2064598680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca001a9d0 con 0x55ba1dbbf010 2024-09-22T08:11:07.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.703+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba1dcb9020 con 0x55ba1dbbf010 2024-09-22T08:11:07.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.704+0000 7f6b9ae05640 1 -- 172.21.15.165:0/2064598680 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6ca0015020 con 0x55ba1dbbf010 2024-09-22T08:11:07.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.704+0000 7f6b9ae05640 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b9403cfb0 0x7f6b9403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.704+0000 7f6b9ae05640 1 -- 172.21.15.165:0/2064598680 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6ca0020030 con 0x55ba1dbbf010 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.704+0000 7f6ca5f01640 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b9403cfb0 0x7f6b9403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.705+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dbc2b20 0x55ba1dcbf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.705+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcbf9c0 con 0x55ba1dbc2b20 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.705+0000 7f6caef03640 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dbc2b20 0x55ba1dcbf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.705+0000 7f6ca5f01640 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b9403cfb0 0x7f6b9403f470 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6c98057000 tx=0x7f6c98052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.705+0000 7f6caef03640 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dbc2b20 0x55ba1dcbf480 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.705+0000 7f6caef03640 1 -- 172.21.15.165:0/2064598680 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ca800a4d0 con 0x55ba1dbc2b20 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.705+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcbfd60 con 0x55ba1dbc2b20 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.706+0000 7f6caef03640 1 -- 172.21.15.165:0/2064598680 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ca800a4d0 con 0x55ba1dbc2b20 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.706+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcc18a0 0x55ba1dcc3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.706+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcc44a0 con 0x55ba1dcc18a0 2024-09-22T08:11:07.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.706+0000 7f6cae702640 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcc18a0 0x55ba1dcc3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.706+0000 7f6cae702640 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcc18a0 0x55ba1dcc3d10 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.706+0000 7f6cae702640 1 -- 172.21.15.165:0/2064598680 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcc18a0 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.706+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcc05b0 con 0x55ba1dbc2b20 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.706+0000 7f6caef03640 1 -- 172.21.15.165:0/2064598680 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ca800a4d0 con 0x55ba1dbc2b20 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.706+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcc0a10 con 0x55ba1dbc2b20 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.707+0000 7f6caef03640 1 -- 172.21.15.165:0/2064598680 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ca800a4d0 con 0x55ba1dbc2b20 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.707+0000 7f6cb2b22800 1 Processor -- start 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.707+0000 7f6cb2b22800 1 -- start start 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.707+0000 7f6cb2b22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcd2e50 0x55ba1dcd3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.707+0000 7f6cb2b22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ba1dab5d50 con 0x55ba1dcd2e50 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.707+0000 7f6caef03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcd2e50 0x55ba1dcd3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.708+0000 7f6caef03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcd2e50 0x55ba1dcd3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52432/0 (socket says 172.21.15.165:52432) 2024-09-22T08:11:07.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.708+0000 7f6caef03640 1 -- 172.21.15.165:0/1107249124 learned_addr learned my addr 172.21.15.165:0/1107249124 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.708+0000 7f6caef03640 1 -- 172.21.15.165:0/1107249124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba1dcd38b0 con 0x55ba1dcd2e50 2024-09-22T08:11:07.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.708+0000 7f6caef03640 1 --2- 172.21.15.165:0/1107249124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcd2e50 0x55ba1dcd3270 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x55ba1dcb91f0 tx=0x7f6ca8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.708+0000 7f6b93fff640 1 -- 172.21.15.165:0/1107249124 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8014450 con 0x55ba1dcd2e50 2024-09-22T08:11:07.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.708+0000 7f6b93fff640 1 -- 172.21.15.165:0/1107249124 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca8014610 con 0x55ba1dcd2e50 2024-09-22T08:11:07.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.708+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1107249124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba1dcd40e0 con 0x55ba1dcd2e50 2024-09-22T08:11:07.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.708+0000 7f6b93fff640 1 -- 172.21.15.165:0/1107249124 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8014930 con 0x55ba1dcd2e50 2024-09-22T08:11:07.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.708+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1107249124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba1dcd4680 con 0x55ba1dcd2e50 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.709+0000 7f6b93fff640 1 -- 172.21.15.165:0/1107249124 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6ca8011040 con 0x55ba1dcd2e50 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.709+0000 7f6b93fff640 1 --2- 172.21.15.165:0/1107249124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8803cfb0 0x7f6b8803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.709+0000 7f6b93fff640 1 -- 172.21.15.165:0/1107249124 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6ca801e070 con 0x55ba1dcd2e50 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.710+0000 7f6cae702640 1 --2- 172.21.15.165:0/1107249124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8803cfb0 0x7f6b8803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.710+0000 7f6cb2b22800 1 Processor -- start 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.710+0000 7f6cb2b22800 1 -- start start 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.710+0000 7f6cae702640 1 --2- 172.21.15.165:0/1107249124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8803cfb0 0x7f6b8803f470 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55ba1dcb9f50 tx=0x7f6ca000ef30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.710+0000 7f6cb2b22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dcdfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.710+0000 7f6cb2b22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ba1dbbd1f0 con 0x55ba1dcdf910 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.710+0000 7f6caef03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dcdfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.710+0000 7f6caef03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dcdfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52442/0 (socket says 172.21.15.165:52442) 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.710+0000 7f6caef03640 1 -- 172.21.15.165:0/1147046351 learned_addr learned my addr 172.21.15.165:0/1147046351 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.710+0000 7f6caef03640 1 -- 172.21.15.165:0/1147046351 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba1dce02e0 con 0x55ba1dcdf910 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6caef03640 1 --2- 172.21.15.165:0/1147046351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dcdfcf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8022ea0 tx=0x7f6ca8011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a4f355883478bd server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6b91ffb640 1 -- 172.21.15.165:0/1147046351 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8053280 con 0x55ba1dcdf910 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6b91ffb640 1 -- 172.21.15.165:0/1147046351 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca8011bc0 con 0x55ba1dcdf910 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6b91ffb640 1 -- 172.21.15.165:0/1147046351 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8014ad0 con 0x55ba1dcdf910 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1147046351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 msgr2=0x55ba1dcdfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/1147046351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dcdfcf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8022ea0 tx=0x7f6ca8011700 comp rx=0 tx=0).stop 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1147046351 shutdown_connections 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/1147046351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dcdfcf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1147046351 >> 172.21.15.165:0/1147046351 conn(0x55ba1dcdbd10 msgr2=0x55ba1dcd9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1147046351 shutdown_connections 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1147046351 wait complete. 2024-09-22T08:11:07.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.711+0000 7f6cb2b22800 1 Processor -- start 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6cb2b22800 1 -- start start 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6cb2b22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dce6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6cb2b22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ba1dce0920 con 0x55ba1dcdf910 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6caef03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dce6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6caef03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dce6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52456/0 (socket says 172.21.15.165:52456) 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 learned_addr learned my addr 172.21.15.165:0/2284791506 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba1dce73d0 con 0x55ba1dcdf910 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6caef03640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dce6e70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8011740 tx=0x7f6ca8054710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6b7ffff640 1 -- 172.21.15.165:0/2284791506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8045950 con 0x55ba1dcdf910 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6b7ffff640 1 -- 172.21.15.165:0/2284791506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca8032070 con 0x55ba1dcdf910 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba1dce7660 con 0x55ba1dcdf910 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6b7ffff640 1 -- 172.21.15.165:0/2284791506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8045b30 con 0x55ba1dcdf910 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.712+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba1dce7fe0 con 0x55ba1dcdf910 2024-09-22T08:11:07.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.713+0000 7f6b7ffff640 1 -- 172.21.15.165:0/2284791506 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6ca8045150 con 0x55ba1dcdf910 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.713+0000 7f6b7ffff640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b7803cfb0 0x7f6b7803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.714+0000 7f6b7ffff640 1 -- 172.21.15.165:0/2284791506 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6ca800e040 con 0x55ba1dcdf910 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.714+0000 7f6cae702640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b7803cfb0 0x7f6b7803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.714+0000 7f6cae702640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b7803cfb0 0x7f6b7803f470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0022710 tx=0x7f6ca0042000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.714+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.714+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dcf2980 0x55ba1dcf4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.714+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcf5590 con 0x55ba1dcf2980 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.714+0000 7f6ca5f01640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dcf2980 0x55ba1dcf4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6ca5f01640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dcf2980 0x55ba1dcf4e40 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 20 realm 2024-09-22T08:11:07.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcf59c0 con 0x55ba1dcf2980 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcf6290 con 0x55ba1dcf2980 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.715+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcf6630 con 0x55ba1dcf2980 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6cb2b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcf7390 0x55ba1dcf9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcf9d90 con 0x55ba1dcf7390 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6caef03640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcf7390 0x55ba1dcf9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6caef03640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcf7390 0x55ba1dcf9780 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6cb2b22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6cb2b22800 20 searching for the correct realm 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ba1dcfbd40 0x55ba1dcfe200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcfbd40 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.716+0000 7f6cae702640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ba1dcfbd40 0x55ba1dcfe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.717+0000 7f6cae702640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ba1dcfbd40 0x55ba1dcfe200 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.717+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.717+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf7390 2024-09-22T08:11:07.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.717+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.717+0000 7f6caef03640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6ca8014070 0x7f6ca804d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.717+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x7f6ca8014070 2024-09-22T08:11:07.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.717+0000 7f6ca5f01640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6ca8014070 0x7f6ca804d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.718+0000 7f6ca5f01640 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6ca8014070 0x7f6ca804d260 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.718+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.718+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf2980 2024-09-22T08:11:07.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.718+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.718+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf2980 2024-09-22T08:11:07.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.718+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.718+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x7f6ca8014070 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.719+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.719+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x7f6ca8014070 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.719+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.719+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf7390 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.719+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.719+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcfbd40 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.719+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.719+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf2980 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.720+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.720+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x7f6ca8014070 2024-09-22T08:11:07.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.720+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.720+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf2980 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.720+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.720+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf7390 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.720+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.720+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcfbd40 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.720+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.720+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcfbd40 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.721+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.721+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x7f6ca8014070 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.721+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.721+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcfbd40 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.722+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.722+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcfbd40 2024-09-22T08:11:07.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.722+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.722+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf2980 2024-09-22T08:11:07.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.722+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.722+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf2980 2024-09-22T08:11:07.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.722+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.722+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x7f6ca8014070 2024-09-22T08:11:07.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.722+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.722+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcfbd40 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.723+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.723+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf7390 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.723+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.723+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf2980 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.723+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.723+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x7f6ca8014070 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.723+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.723+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcfbd40 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.724+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.724+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x7f6ca8014070 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.724+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.724+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf7390 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.724+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.724+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcfbd40 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.724+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.724+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x7f6ca8014070 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf2980 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfe880 con 0x55ba1dcf7390 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:07.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfa780 con 0x55ba1dcf2980 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfb020 con 0x55ba1dcf2980 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.725+0000 7f6cb2b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcfed00 con 0x55ba1dcf2980 2024-09-22T08:11:07.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 20 zone default found 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 4 Realm: () 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 20 zonegroup default 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dcff100 con 0x7f6ca8014070 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd00f60 con 0x55ba1dcfbd40 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.726+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd01440 con 0x55ba1dcfbd40 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.727+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.727+0000 7f6cb2b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.727+0000 7f6cb2b22800 20 started sync module instance, tier type = 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.727+0000 7f6cb2b22800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.727+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd003d0 con 0x55ba1dcf7390 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.728+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.728+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94257852450800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd00030 con 0x55ba1dcf7390 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.728+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd02370 con 0x55ba1dcf2980 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.729+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94257852450800] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.729+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.729+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94257852455072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd02370 con 0x55ba1dcf2980 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.729+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd02d30 con 0x55ba1dcfbd40 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.730+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94257852455072] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.730+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.731+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94257852456640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd022e0 con 0x55ba1dcfbd40 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.731+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd03c20 con 0x55ba1dcf7390 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.731+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.731+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94257852456640] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.731+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94257852463472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd04010 con 0x55ba1dcf7390 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.732+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd04a80 con 0x55ba1dcf2980 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.733+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.733+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94257852466512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd04a40 con 0x55ba1dcf2980 2024-09-22T08:11:07.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.733+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94257852463472] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.733+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd03150 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.734+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94257852466512] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.734+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.734+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94257852468256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd03150 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.734+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd05ed0 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.735+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94257852468256] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.735+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.735+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94257852470640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd05e40 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.735+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd06890 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.736+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94257852470640] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.736+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.736+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94257852474240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd06850 con 0x7f6ca8014070 2024-09-22T08:11:07.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.736+0000 7f6cb2b22800 20 add_watcher() i=0 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.736+0000 7f6cb2b22800 20 add_watcher() i=1 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.736+0000 7f6cb2b22800 20 add_watcher() i=2 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.736+0000 7f6cb2b22800 20 add_watcher() i=3 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.736+0000 7f6cb2b22800 20 add_watcher() i=4 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.736+0000 7f6cb2b22800 20 add_watcher() i=5 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.736+0000 7f6cb2b22800 20 add_watcher() i=6 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.737+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94257852474240] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.737+0000 7f6cb2b22800 20 add_watcher() i=7 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.737+0000 7f6cb2b22800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.737+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd09dd0 con 0x55ba1dcf2980 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.737+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.737+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94257852471696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd07160 con 0x55ba1dcf2980 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.738+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94257852471696] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.738+0000 7f6b64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.738+0000 7f6cb2b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.738+0000 7f6cb2b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.738+0000 7f6cb2b22800 5 note: GC not initialized 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.739+0000 7f6adf7fe640 20 reqs_thread_entry: start 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.739+0000 7f6cb2b22800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.739+0000 7f6cb2b22800 20 Filter name: none 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.739+0000 7f6add7fa640 20 reqs_thread_entry: start 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.739+0000 7f6cb2b22800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.739+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.739+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd3d160 con 0x7f6ca8014070 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:11:07.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd3f250 con 0x55ba1dcf7390 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 : miss 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.740+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd40c50 con 0x7f6ca8014070 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.741+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(64 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.741+0000 7f6cb2b22800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:07.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.741+0000 7f6cb2b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:07.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.741+0000 7f6cb2b22800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:07.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.741+0000 7f6cb2b22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:07.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.741+0000 7f6cb2b22800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:07.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.741+0000 7f6cb2b22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:07.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.741+0000 7f6cb2b22800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-22T08:11:07.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.741+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd45230 con 0x55ba1dcf7390 2024-09-22T08:11:07.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.742+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.742+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:66 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd4afc0 con 0x7f6ca8014070 2024-09-22T08:11:07.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(66 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6cb2b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:07.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6cb2b22800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:07.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6cb2b22800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:07.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6cb2b22800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1, ofs0, ns] 2024-09-22T08:11:07.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94257852715760 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd45660 con 0x7f6ca8014070 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== watch-notify(notify (1) cookie 94257852470640 notify 137438953476 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55ba1dd41040 con 0x7f6ca8014070 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6b91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94257852470640 notifier 4500 bl.length()=760 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6b91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6b91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6b91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6b91ffb640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6b74003ea0 con 0x7f6ca8014070 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.743+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(67 notify.6 [notify cookie 94257852715760 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.744+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.744+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== watch-notify(notify_complete (2) cookie 94257852715760 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba1dd40190 con 0x7f6ca8014070 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.744+0000 7f6cb2b22800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_sources= new_sources= 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.744+0000 7f6cb2b22800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential sources added=[] removed=[] 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.744+0000 7f6cb2b22800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_dests= new_dests= 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.744+0000 7f6cb2b22800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential dests added=[] removed=[] 2024-09-22T08:11:07.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.744+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd412d0 con 0x7f6ca8014070 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.745+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(69 fud.buckets [call] v32'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.745+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd412d0 con 0x55ba1dcf7390 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6cb2b22800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6cb2b22800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6cb2b22800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94257852715728 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd49e00 con 0x7f6ca8014070 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== watch-notify(notify (1) cookie 94257852470640 notify 137438953477 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f6c98082040 con 0x7f6ca8014070 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6b917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94257852470640 notifier 4500 bl.length()=314 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6b917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6b917fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:07.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(71 notify.6 [notify cookie 94257852715728 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.746+0000 7f6b917fa640 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6ae4003400 con 0x7f6ca8014070 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.747+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== watch-notify(notify_complete (2) cookie 94257852715728 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba1dbc65a0 con 0x7f6ca8014070 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.747+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.747+0000 7f6b64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.748+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94257852471696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd3ae80 con 0x55ba1dcf2980 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.748+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94257852471696] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.748+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94257852450800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd3ae80 con 0x55ba1dcf7390 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.749+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94257852450800] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.749+0000 7f6cb2b22800 20 remove_watcher() i=0 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.749+0000 7f6cb2b22800 2 removed watcher, disabling cache 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.749+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94257852455072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd3ae80 con 0x55ba1dcf2980 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.751+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94257852455072] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.751+0000 7f6cb2b22800 20 remove_watcher() i=1 2024-09-22T08:11:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.751+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94257852456640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd3ae80 con 0x55ba1dcfbd40 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.751+0000 7f6cae702640 1 -- 172.21.15.165:0/2284791506 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94257852456640] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca001ad50 con 0x55ba1dcfbd40 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.751+0000 7f6cb2b22800 20 remove_watcher() i=2 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.751+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94257852463472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd01ec0 con 0x55ba1dcf7390 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.753+0000 7f6caef03640 1 -- 172.21.15.165:0/2284791506 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94257852463472] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca802a070 con 0x55ba1dcf7390 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.753+0000 7f6cb2b22800 20 remove_watcher() i=3 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.753+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94257852466512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd01ec0 con 0x55ba1dcf2980 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.754+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94257852466512] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x55ba1dcf2980 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.754+0000 7f6cb2b22800 20 remove_watcher() i=4 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.754+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94257852468256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd01ec0 con 0x7f6ca8014070 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.754+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94257852468256] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.754+0000 7f6cb2b22800 20 remove_watcher() i=5 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.755+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94257852470640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd04c20 con 0x7f6ca8014070 2024-09-22T08:11:07.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.756+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94257852470640] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.756+0000 7f6cb2b22800 20 remove_watcher() i=6 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.756+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94257852474240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba1dd01ec0 con 0x7f6ca8014070 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94257852474240] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98051070 con 0x7f6ca8014070 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 20 remove_watcher() i=7 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6ca8014070 msgr2=0x7f6ca804d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6ca8014070 0x7f6ca804d260 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dcf2980 msgr2=0x55ba1dcf4e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dcf2980 0x55ba1dcf4e40 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcf7390 msgr2=0x55ba1dcf9780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcf7390 0x55ba1dcf9780 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ba1dcfbd40 msgr2=0x55ba1dcfe200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ba1dcfbd40 0x55ba1dcfe200 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b7803cfb0 msgr2=0x7f6b7803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b7803cfb0 0x7f6b7803f470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0022710 tx=0x7f6ca0042000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 msgr2=0x55ba1dce6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6ca5f01640 1 -- 172.21.15.165:0/2284791506 reap_dead start 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dce6e70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8011740 tx=0x7f6ca8054710 comp rx=0 tx=0).stop 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 shutdown_connections 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2284791506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcdf910 0x55ba1dce6e70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 >> 172.21.15.165:0/2284791506 conn(0x55ba1dcdbd10 msgr2=0x55ba1dcd9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 shutdown_connections 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2284791506 wait complete. 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1107249124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8803cfb0 msgr2=0x7f6b8803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/1107249124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8803cfb0 0x7f6b8803f470 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55ba1dcb9f50 tx=0x7f6ca000ef30 comp rx=0 tx=0).stop 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1107249124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcd2e50 msgr2=0x55ba1dcd3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/1107249124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcd2e50 0x55ba1dcd3270 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x55ba1dcb91f0 tx=0x7f6ca8018830 comp rx=0 tx=0).stop 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1107249124 shutdown_connections 2024-09-22T08:11:07.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/1107249124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8803cfb0 0x7f6b8803f470 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/1107249124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dcd2e50 0x55ba1dcd3270 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1107249124 >> 172.21.15.165:0/1107249124 conn(0x55ba1dcc7200 msgr2=0x55ba1dcc75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1107249124 shutdown_connections 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.757+0000 7f6cb2b22800 1 -- 172.21.15.165:0/1107249124 wait complete. 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dbc2b20 msgr2=0x55ba1dcbf480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dbc2b20 0x55ba1dcbf480 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcc18a0 msgr2=0x55ba1dcc3d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcc18a0 0x55ba1dcc3d10 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b9403cfb0 msgr2=0x7f6b9403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b9403cfb0 0x7f6b9403f470 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6c98057000 tx=0x7f6c98052000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 msgr2=0x55ba1dcb7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dcb7e30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55ba1dbbe2d0 tx=0x7f6ca0000bc0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 shutdown_connections 2024-09-22T08:11:07.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ba1dcc18a0 0x55ba1dcc3d10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ba1dbc2b20 0x55ba1dcbf480 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b9403cfb0 0x7f6b9403f470 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 --2- 172.21.15.165:0/2064598680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba1dbbf010 0x55ba1dcb7e30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 >> 172.21.15.165:0/2064598680 conn(0x55ba1dbb8bd0 msgr2=0x55ba1dca95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 shutdown_connections 2024-09-22T08:11:07.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.758+0000 7f6cb2b22800 1 -- 172.21.15.165:0/2064598680 wait complete. 2024-09-22T08:11:07.769 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-22T08:11:07.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-22T08:11:07.769 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-22T08:11:07.813 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:07.814 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:07.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.814+0000 7f6caa93e800 1 Processor -- start 2024-09-22T08:11:07.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.814+0000 7f6caa93e800 1 -- start start 2024-09-22T08:11:07.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.814+0000 7f6caa93e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55868dbcdff0 0x55868dbd03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.814+0000 7f6caa93e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55868da58a20 con 0x55868dbd0920 2024-09-22T08:11:07.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.814+0000 7f6caa93e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55868da587d0 con 0x55868dbcdff0 2024-09-22T08:11:07.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.814+0000 7f6ca66c0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55868dbcdff0 0x55868dbd03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.814+0000 7f6ca5ebf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55868dbd0920 0x55868dbd2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33760/0 (socket says 172.21.15.165:33760) 2024-09-22T08:11:07.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.814+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/1665756943 learned_addr learned my addr 172.21.15.165:0/1665756943 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:07.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.814+0000 7f6ca66c0640 1 -- 172.21.15.165:0/1665756943 >> v1:172.21.15.53:6789/0 conn(0x55868dbd0920 legacy=0x55868dbd2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.815+0000 7f6ca66c0640 1 -- 172.21.15.165:0/1665756943 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868dbd5580 con 0x55868dbcdff0 2024-09-22T08:11:07.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.816+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/1665756943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dbd03e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800a470 tx=0x7f6c98045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417852687ef49576 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.816+0000 7f6ca56be640 1 -- 172.21.15.165:0/1665756943 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c98053570 con 0x55868dbcdff0 2024-09-22T08:11:07.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.816+0000 7f6ca56be640 1 -- 172.21.15.165:0/1665756943 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c98058070 con 0x55868dbcdff0 2024-09-22T08:11:07.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.816+0000 7f6ca56be640 1 -- 172.21.15.165:0/1665756943 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c98053880 con 0x55868dbcdff0 2024-09-22T08:11:07.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.817+0000 7f6caa93e800 1 -- 172.21.15.165:0/1665756943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 msgr2=0x55868dbd03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.817+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1665756943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dbd03e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800a470 tx=0x7f6c98045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:07.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.817+0000 7f6caa93e800 1 -- 172.21.15.165:0/1665756943 shutdown_connections 2024-09-22T08:11:07.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.817+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1665756943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dbd03e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.817+0000 7f6caa93e800 1 -- 172.21.15.165:0/1665756943 >> 172.21.15.165:0/1665756943 conn(0x55868dbc7bb0 msgr2=0x55868dbca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.817+0000 7f6caa93e800 1 -- 172.21.15.165:0/1665756943 shutdown_connections 2024-09-22T08:11:07.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.817+0000 7f6caa93e800 1 -- 172.21.15.165:0/1665756943 wait complete. 2024-09-22T08:11:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.831+0000 7f6caa93e800 1 Processor -- start 2024-09-22T08:11:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.831+0000 7f6caa93e800 1 -- start start 2024-09-22T08:11:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.831+0000 7f6caa93e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dbcd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.831+0000 7f6caa93e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55868da65dd0 con 0x55868dbcdff0 2024-09-22T08:11:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.831+0000 7f6ca66c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dbcd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.831+0000 7f6ca66c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dbcd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52478/0 (socket says 172.21.15.165:52478) 2024-09-22T08:11:07.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.831+0000 7f6ca66c0640 1 -- 172.21.15.165:0/2272199571 learned_addr learned my addr 172.21.15.165:0/2272199571 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.832+0000 7f6ca66c0640 1 -- 172.21.15.165:0/2272199571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868dbcdd50 con 0x55868dbcdff0 2024-09-22T08:11:07.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.832+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/2272199571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dbcd760 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6c98025c20 tx=0x7f6c98051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfe01e7dc67ab0c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.832+0000 7f6b94608640 1 -- 172.21.15.165:0/2272199571 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c98053570 con 0x55868dbcdff0 2024-09-22T08:11:07.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.832+0000 7f6b94608640 1 -- 172.21.15.165:0/2272199571 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c98063070 con 0x55868dbcdff0 2024-09-22T08:11:07.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.832+0000 7f6b94608640 1 -- 172.21.15.165:0/2272199571 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c98053840 con 0x55868dbcdff0 2024-09-22T08:11:07.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 -- 172.21.15.165:0/2272199571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 msgr2=0x55868dbcd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 --2- 172.21.15.165:0/2272199571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dbcd760 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6c98025c20 tx=0x7f6c98051000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 -- 172.21.15.165:0/2272199571 shutdown_connections 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 --2- 172.21.15.165:0/2272199571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dbcd760 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 -- 172.21.15.165:0/2272199571 >> 172.21.15.165:0/2272199571 conn(0x55868dbc7bb0 msgr2=0x55868dcb89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 -- 172.21.15.165:0/2272199571 shutdown_connections 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 -- 172.21.15.165:0/2272199571 wait complete. 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 Processor -- start 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 -- start start 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dcc6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6caa93e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55868dbd4820 con 0x55868dbcdff0 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6ca66c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dcc6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6ca66c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dcc6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52492/0 (socket says 172.21.15.165:52492) 2024-09-22T08:11:07.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.833+0000 7f6ca66c0640 1 -- 172.21.15.165:0/1438932829 learned_addr learned my addr 172.21.15.165:0/1438932829 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.834+0000 7f6ca66c0640 1 -- 172.21.15.165:0/1438932829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868dcc7180 con 0x55868dbcdff0 2024-09-22T08:11:07.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.834+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dcc6c20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6c98053d60 tx=0x7f6c98002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.834+0000 7f6b92e05640 1 -- 172.21.15.165:0/1438932829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c98068470 con 0x55868dbcdff0 2024-09-22T08:11:07.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.834+0000 7f6b92e05640 1 -- 172.21.15.165:0/1438932829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c98068610 con 0x55868dbcdff0 2024-09-22T08:11:07.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.834+0000 7f6b92e05640 1 -- 172.21.15.165:0/1438932829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c980688f0 con 0x55868dbcdff0 2024-09-22T08:11:07.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.834+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55868dcc7410 con 0x55868dbcdff0 2024-09-22T08:11:07.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.834+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55868dcc7e10 con 0x55868dbcdff0 2024-09-22T08:11:07.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.835+0000 7f6b92e05640 1 -- 172.21.15.165:0/1438932829 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6c98068a90 con 0x55868dbcdff0 2024-09-22T08:11:07.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.835+0000 7f6b92e05640 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8c03cfb0 0x7f6b8c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.835+0000 7f6b92e05640 1 -- 172.21.15.165:0/1438932829 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6c98098a60 con 0x55868dbcdff0 2024-09-22T08:11:07.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.835+0000 7f6ca5ebf640 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8c03cfb0 0x7f6b8c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.835+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dbd0920 0x55868dcce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.835+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dcc8a00 con 0x55868dbd0920 2024-09-22T08:11:07.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.835+0000 7f6ca6ec1640 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dbd0920 0x55868dcce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.836+0000 7f6ca5ebf640 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8c03cfb0 0x7f6b8c03f470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c001d70 tx=0x7f6c9c0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.836+0000 7f6ca6ec1640 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dbd0920 0x55868dcce270 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.836+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/1438932829 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ca000a4d0 con 0x55868dbd0920 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.836+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dcc82e0 con 0x55868dbd0920 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.836+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/1438932829 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ca000a4d0 con 0x55868dbd0920 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.836+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dcd0720 0x55868dcd2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.836+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dcd31e0 con 0x55868dcd0720 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.836+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dcd0720 0x55868dcd2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.837+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dcd0720 0x55868dcd2b10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.837+0000 7f6ca66c0640 1 -- 172.21.15.165:0/1438932829 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c98079020 con 0x55868dcd0720 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.837+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dccf500 con 0x55868dbd0920 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.837+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/1438932829 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ca000a4d0 con 0x55868dbd0920 2024-09-22T08:11:07.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.837+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dccf9a0 con 0x55868dbd0920 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.838+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/1438932829 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ca000a4d0 con 0x55868dbd0920 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.838+0000 7f6caa93e800 1 Processor -- start 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.838+0000 7f6caa93e800 1 -- start start 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.838+0000 7f6caa93e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dce1ab0 0x55868dce1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.838+0000 7f6caa93e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55868dac4d50 con 0x55868dce1ab0 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.838+0000 7f6ca6ec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dce1ab0 0x55868dce1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.838+0000 7f6ca6ec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dce1ab0 0x55868dce1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52506/0 (socket says 172.21.15.165:52506) 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.838+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3402297854 learned_addr learned my addr 172.21.15.165:0/3402297854 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.839+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3402297854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868dce2510 con 0x55868dce1ab0 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.839+0000 7f6ca6ec1640 1 --2- 172.21.15.165:0/3402297854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dce1ab0 0x55868dce1ed0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55868dcce7f0 tx=0x7f6ca0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.839+0000 7f6b8bfff640 1 -- 172.21.15.165:0/3402297854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca0014450 con 0x55868dce1ab0 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.839+0000 7f6b8bfff640 1 -- 172.21.15.165:0/3402297854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca00145f0 con 0x55868dce1ab0 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.839+0000 7f6caa93e800 1 -- 172.21.15.165:0/3402297854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55868dce2d40 con 0x55868dce1ab0 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.839+0000 7f6b8bfff640 1 -- 172.21.15.165:0/3402297854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca0014910 con 0x55868dce1ab0 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.839+0000 7f6caa93e800 1 -- 172.21.15.165:0/3402297854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55868dce32e0 con 0x55868dce1ab0 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.840+0000 7f6b8bfff640 1 -- 172.21.15.165:0/3402297854 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6ca0011040 con 0x55868dce1ab0 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.840+0000 7f6b8bfff640 1 --2- 172.21.15.165:0/3402297854 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8003cfb0 0x7f6b8003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.840+0000 7f6b8bfff640 1 -- 172.21.15.165:0/3402297854 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6ca001e070 con 0x55868dce1ab0 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.840+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/3402297854 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8003cfb0 0x7f6b8003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.840+0000 7f6caa93e800 1 Processor -- start 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.840+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/3402297854 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8003cfb0 0x7f6b8003f470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55868dcce890 tx=0x7f6c98052bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.840+0000 7f6caa93e800 1 -- start start 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.841+0000 7f6caa93e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcee950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.841+0000 7f6caa93e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55868dbcc1a0 con 0x55868dcee550 2024-09-22T08:11:07.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.841+0000 7f6ca6ec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.841+0000 7f6ca6ec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcee950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52518/0 (socket says 172.21.15.165:52518) 2024-09-22T08:11:07.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.841+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/4049945565 learned_addr learned my addr 172.21.15.165:0/4049945565 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.841+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/4049945565 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868dceef40 con 0x55868dcee550 2024-09-22T08:11:07.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.841+0000 7f6ca6ec1640 1 --2- 172.21.15.165:0/4049945565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcee950 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0016fd0 tx=0x7f6ca0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b50796b9367c814 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.841+0000 7f6b89ffb640 1 -- 172.21.15.165:0/4049945565 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca004b070 con 0x55868dcee550 2024-09-22T08:11:07.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.841+0000 7f6b89ffb640 1 -- 172.21.15.165:0/4049945565 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca0051070 con 0x55868dcee550 2024-09-22T08:11:07.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.841+0000 7f6b89ffb640 1 -- 172.21.15.165:0/4049945565 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca0022db0 con 0x55868dcee550 2024-09-22T08:11:07.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 -- 172.21.15.165:0/4049945565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 msgr2=0x55868dcee950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 --2- 172.21.15.165:0/4049945565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcee950 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0016fd0 tx=0x7f6ca0011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:07.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 -- 172.21.15.165:0/4049945565 shutdown_connections 2024-09-22T08:11:07.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 --2- 172.21.15.165:0/4049945565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcee950 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 -- 172.21.15.165:0/4049945565 >> 172.21.15.165:0/4049945565 conn(0x55868dcea950 msgr2=0x55868dce8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 -- 172.21.15.165:0/4049945565 shutdown_connections 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 -- 172.21.15.165:0/4049945565 wait complete. 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 Processor -- start 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 -- start start 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcf5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6caa93e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55868dcef560 con 0x55868dcee550 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6ca6ec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcf5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6ca6ec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcf5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52524/0 (socket says 172.21.15.165:52524) 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.842+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 learned_addr learned my addr 172.21.15.165:0/3447454613 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.843+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868dcf60d0 con 0x55868dcee550 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.843+0000 7f6ca6ec1640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcf5b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0053630 tx=0x7f6ca0054740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.843+0000 7f6b77fff640 1 -- 172.21.15.165:0/3447454613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca004b030 con 0x55868dcee550 2024-09-22T08:11:07.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.843+0000 7f6b77fff640 1 -- 172.21.15.165:0/3447454613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca0011330 con 0x55868dcee550 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.843+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55868dcf6360 con 0x55868dcee550 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.843+0000 7f6b77fff640 1 -- 172.21.15.165:0/3447454613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca0054bc0 con 0x55868dcee550 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.843+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55868dcf6ef0 con 0x55868dcee550 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.844+0000 7f6b77fff640 1 -- 172.21.15.165:0/3447454613 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6ca0045980 con 0x55868dcee550 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.844+0000 7f6b77fff640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b7003cfb0 0x7f6b7003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.844+0000 7f6b77fff640 1 -- 172.21.15.165:0/3447454613 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6ca004c070 con 0x55868dcee550 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.844+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b7003cfb0 0x7f6b7003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.844+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b7003cfb0 0x7f6b7003f470 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c98052fd0 tx=0x7f6c9808b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dd015d0 0x55868dd03a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd041e0 con 0x55868dd015d0 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6ca5ebf640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dd015d0 0x55868dd03a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6ca5ebf640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dd015d0 0x55868dd03a90 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c9c009050 con 0x55868dd015d0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 20 realm 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd00920 con 0x55868dd015d0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c9c009050 con 0x55868dd015d0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.845+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd04cd0 con 0x55868dd015d0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c9c009050 con 0x55868dd015d0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6caa93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd055a0 con 0x55868dd015d0 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c9c009050 con 0x55868dd015d0 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6caa93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dd05fc0 0x55868dd083b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd08af0 con 0x55868dd05fc0 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6ca6ec1640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dd05fc0 0x55868dd083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.846+0000 7f6ca6ec1640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dd05fc0 0x55868dd083b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.847+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.847+0000 7f6caa93e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.847+0000 7f6caa93e800 20 searching for the correct realm 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.847+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55868dd0aaa0 0x55868dd0cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.847+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd0aaa0 2024-09-22T08:11:07.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.847+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55868dd0aaa0 0x55868dd0cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.847+0000 7f6ca66c0640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55868dd0aaa0 0x55868dd0cf60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.847+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.847+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd05fc0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.848+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.848+0000 7f6ca6ec1640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6ca0014070 0x7f6ca0023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.848+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x7f6ca0014070 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.848+0000 7f6ca5ebf640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6ca0014070 0x7f6ca0023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.848+0000 7f6ca5ebf640 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6ca0014070 0x7f6ca0023420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.848+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c009050 con 0x7f6ca0014070 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.849+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd015d0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.849+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c009050 con 0x55868dd015d0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.849+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd015d0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.849+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.849+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x7f6ca0014070 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.849+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.849+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x7f6ca0014070 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.849+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.850+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd05fc0 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.850+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.850+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd0aaa0 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.850+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.850+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd015d0 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.850+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.850+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x7f6ca0014070 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.850+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.851+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd015d0 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.851+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.851+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd05fc0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.851+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.851+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd0aaa0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.851+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.851+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd0aaa0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.851+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.851+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x7f6ca0014070 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.852+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.852+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd0aaa0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.852+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.852+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd0aaa0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.852+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.852+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd015d0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.852+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.852+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd015d0 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.853+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.853+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x7f6ca0014070 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.853+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.853+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd0aaa0 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.853+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.853+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd05fc0 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.853+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.853+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd015d0 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.853+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.853+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x7f6ca0014070 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.854+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.854+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd0aaa0 2024-09-22T08:11:07.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.854+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.854+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x7f6ca0014070 2024-09-22T08:11:07.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.854+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.854+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd05fc0 2024-09-22T08:11:07.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.855+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.855+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd0aaa0 2024-09-22T08:11:07.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.855+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.855+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x7f6ca0014070 2024-09-22T08:11:07.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.855+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.855+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd015d0 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.855+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.855+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0d5e0 con 0x55868dd05fc0 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd094b0 con 0x55868dd015d0 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd09d50 con 0x55868dd015d0 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0da60 con 0x55868dd015d0 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 zone default found 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 4 Realm: () 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:07.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 zonegroup default 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.856+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0de20 con 0x7f6ca0014070 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6caa93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0fc50 con 0x55868dd0aaa0 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6caa93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd100c0 con 0x55868dd0aaa0 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6caa93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:07.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6caa93e800 20 started sync module instance, tier type = 2024-09-22T08:11:07.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6caa93e800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:07.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.857+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0f0f0 con 0x55868dd05fc0 2024-09-22T08:11:07.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.858+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.858+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94036393260256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0ed50 con 0x55868dd05fc0 2024-09-22T08:11:07.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.858+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd10ff0 con 0x55868dd015d0 2024-09-22T08:11:07.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.859+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94036393260256] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.859+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.860+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94036393264416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd10ff0 con 0x55868dd015d0 2024-09-22T08:11:07.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.860+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd119f0 con 0x55868dd0aaa0 2024-09-22T08:11:07.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.861+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94036393264416] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.861+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.861+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94036393265984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd10f60 con 0x55868dd0aaa0 2024-09-22T08:11:07.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.861+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd128b0 con 0x55868dd05fc0 2024-09-22T08:11:07.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.862+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94036393265984] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.862+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.862+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94036393270752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd128b0 con 0x55868dd05fc0 2024-09-22T08:11:07.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.862+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd13320 con 0x55868dd015d0 2024-09-22T08:11:07.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.863+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.863+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94036393274896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd132e0 con 0x55868dd015d0 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.863+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd142d0 con 0x7f6ca0014070 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.863+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94036393270752] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.864+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94036393274896] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.864+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.864+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94036393278944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd134c0 con 0x7f6ca0014070 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.864+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd14ba0 con 0x7f6ca0014070 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.865+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94036393278944] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.865+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.865+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94036393272320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd134c0 con 0x7f6ca0014070 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.865+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd151c0 con 0x7f6ca0014070 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.866+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.866+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94036393272320] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.866+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94036393282832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd15130 con 0x7f6ca0014070 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.866+0000 7f6caa93e800 20 add_watcher() i=0 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.866+0000 7f6caa93e800 20 add_watcher() i=1 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.866+0000 7f6caa93e800 20 add_watcher() i=2 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.866+0000 7f6caa93e800 20 add_watcher() i=3 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.866+0000 7f6caa93e800 20 add_watcher() i=4 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.866+0000 7f6caa93e800 20 add_watcher() i=5 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.866+0000 7f6caa93e800 20 add_watcher() i=6 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.867+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94036393282832] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.867+0000 7f6caa93e800 20 add_watcher() i=7 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.867+0000 7f6caa93e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.867+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd18600 con 0x55868dd015d0 2024-09-22T08:11:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.867+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.867+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94036393281184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd159b0 con 0x55868dd015d0 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.868+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94036393281184] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.868+0000 7f6b5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.868+0000 7f6caa93e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.868+0000 7f6caa93e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.868+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd211c0 con 0x55868dd015d0 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.870+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.870+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd217f0 con 0x7f6ca0014070 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.870+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.871+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd21c50 con 0x55868dd0aaa0 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.871+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.871+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22050 con 0x55868dd015d0 2024-09-22T08:11:07.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.872+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'113 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.872+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1efd0 con 0x55868dd05fc0 2024-09-22T08:11:07.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.873+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.873+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1efd0 con 0x55868dd0aaa0 2024-09-22T08:11:07.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.874+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.874+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1efd0 con 0x55868dd015d0 2024-09-22T08:11:07.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.875+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.875+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22bb0 con 0x7f6ca0014070 2024-09-22T08:11:07.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.876+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.876+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22bb0 con 0x55868dd05fc0 2024-09-22T08:11:07.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.878+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.878+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22bb0 con 0x55868dd0aaa0 2024-09-22T08:11:07.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.879+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.879+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22bb0 con 0x55868dd05fc0 2024-09-22T08:11:07.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.879+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.879+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22bb0 con 0x7f6ca0014070 2024-09-22T08:11:07.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.881+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.881+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22bb0 con 0x55868dd05fc0 2024-09-22T08:11:07.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.882+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.882+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22c40 con 0x7f6ca0014070 2024-09-22T08:11:07.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.883+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.883+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22c40 con 0x55868dd015d0 2024-09-22T08:11:07.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.884+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.884+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22c40 con 0x55868dd0aaa0 2024-09-22T08:11:07.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.885+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.885+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22d30 con 0x55868dd05fc0 2024-09-22T08:11:07.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.886+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.886+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd230f0 con 0x55868dd0aaa0 2024-09-22T08:11:07.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.887+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.887+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd23030 con 0x55868dd015d0 2024-09-22T08:11:07.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.888+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.888+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd23030 con 0x55868dd015d0 2024-09-22T08:11:07.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.889+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.889+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd23030 con 0x55868dd0aaa0 2024-09-22T08:11:07.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.890+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.890+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd23030 con 0x55868dd05fc0 2024-09-22T08:11:07.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.891+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.891+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd23030 con 0x55868dd0aaa0 2024-09-22T08:11:07.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.892+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.892+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd23030 con 0x55868dd0aaa0 2024-09-22T08:11:07.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.892+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.893+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1ee00 con 0x55868dd0aaa0 2024-09-22T08:11:07.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.893+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.893+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1ee00 con 0x55868dd0aaa0 2024-09-22T08:11:07.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.894+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.894+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1ee00 con 0x7f6ca0014070 2024-09-22T08:11:07.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.895+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.895+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1ee00 con 0x55868dd0aaa0 2024-09-22T08:11:07.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.896+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.896+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1ee00 con 0x7f6ca0014070 2024-09-22T08:11:07.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.897+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.897+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1ee00 con 0x55868dd0aaa0 2024-09-22T08:11:07.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.898+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.898+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1ee00 con 0x7f6ca0014070 2024-09-22T08:11:07.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.899+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.899+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd1ee00 con 0x55868dd05fc0 2024-09-22T08:11:07.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.900+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.900+0000 7f6ad77fe640 20 reqs_thread_entry: start 2024-09-22T08:11:07.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.900+0000 7f6caa93e800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:07.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.900+0000 7f6caa93e800 20 Filter name: none 2024-09-22T08:11:07.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6ad57fa640 20 reqs_thread_entry: start 2024-09-22T08:11:07.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6caa93e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:11:07.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6caa93e800 20 rados->read ofs=0 len=0 2024-09-22T08:11:07.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd4de00 con 0x7f6ca0014070 2024-09-22T08:11:07.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6caa93e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:11:07.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6caa93e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-22T08:11:07.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6caa93e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:11:07.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6caa93e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:07.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55868dd503c0 con 0x7f6ca0014070 2024-09-22T08:11:07.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.901+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.903 INFO:teuthology.orchestra.run.smithi165.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-22T08:11:07.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.902+0000 7f6b5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:07.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.902+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94036393281184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd22050 con 0x55868dd015d0 2024-09-22T08:11:07.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.903+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94036393281184] v32'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.903+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94036393260256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd146a0 con 0x55868dd05fc0 2024-09-22T08:11:07.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.904+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94036393260256] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.904+0000 7f6caa93e800 20 remove_watcher() i=0 2024-09-22T08:11:07.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.904+0000 7f6caa93e800 2 removed watcher, disabling cache 2024-09-22T08:11:07.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.904+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94036393264416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0f4e0 con 0x55868dd015d0 2024-09-22T08:11:07.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.905+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94036393264416] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.905+0000 7f6caa93e800 20 remove_watcher() i=1 2024-09-22T08:11:07.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.905+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94036393265984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0f4e0 con 0x55868dd0aaa0 2024-09-22T08:11:07.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.907+0000 7f6ca66c0640 1 -- 172.21.15.165:0/3447454613 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94036393265984] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c98079020 con 0x55868dd0aaa0 2024-09-22T08:11:07.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.907+0000 7f6caa93e800 20 remove_watcher() i=2 2024-09-22T08:11:07.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.907+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94036393270752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0f4e0 con 0x55868dd05fc0 2024-09-22T08:11:07.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.907+0000 7f6ca6ec1640 1 -- 172.21.15.165:0/3447454613 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94036393270752] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ca003c020 con 0x55868dd05fc0 2024-09-22T08:11:07.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.907+0000 7f6caa93e800 20 remove_watcher() i=3 2024-09-22T08:11:07.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.907+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94036393274896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd11de0 con 0x55868dd015d0 2024-09-22T08:11:07.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.908+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94036393274896] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x55868dd015d0 2024-09-22T08:11:07.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.908+0000 7f6caa93e800 20 remove_watcher() i=4 2024-09-22T08:11:07.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.908+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94036393278944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0f4e0 con 0x7f6ca0014070 2024-09-22T08:11:07.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.909+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94036393278944] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.909+0000 7f6caa93e800 20 remove_watcher() i=5 2024-09-22T08:11:07.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.909+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94036393272320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd13de0 con 0x7f6ca0014070 2024-09-22T08:11:07.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.910+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94036393272320] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.910+0000 7f6caa93e800 20 remove_watcher() i=6 2024-09-22T08:11:07.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.910+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94036393282832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55868dd0f4e0 con 0x7f6ca0014070 2024-09-22T08:11:07.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94036393282832] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9c029040 con 0x7f6ca0014070 2024-09-22T08:11:07.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 20 remove_watcher() i=7 2024-09-22T08:11:07.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6ca0014070 msgr2=0x7f6ca0023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6ca0014070 0x7f6ca0023420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dd015d0 msgr2=0x55868dd03a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dd015d0 0x55868dd03a90 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dd05fc0 msgr2=0x55868dd083b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dd05fc0 0x55868dd083b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55868dd0aaa0 msgr2=0x55868dd0cf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55868dd0aaa0 0x55868dd0cf60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b7003cfb0 msgr2=0x7f6b7003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b7003cfb0 0x7f6b7003f470 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c98052fd0 tx=0x7f6c9808b000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 msgr2=0x55868dcf5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3447454613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dcee550 0x55868dcf5b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0053630 tx=0x7f6ca0054740 comp rx=0 tx=0).stop 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 reap_dead start 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6ca5ebf640 1 -- 172.21.15.165:0/3447454613 reap_dead start 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 shutdown_connections 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.911+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 >> 172.21.15.165:0/3447454613 conn(0x55868dcea950 msgr2=0x55868dce8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 shutdown_connections 2024-09-22T08:11:07.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/3447454613 wait complete. 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/3402297854 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8003cfb0 msgr2=0x7f6b8003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3402297854 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8003cfb0 0x7f6b8003f470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55868dcce890 tx=0x7f6c98052bc0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/3402297854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dce1ab0 msgr2=0x55868dce1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3402297854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dce1ab0 0x55868dce1ed0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55868dcce7f0 tx=0x7f6ca0018830 comp rx=0 tx=0).stop 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/3402297854 shutdown_connections 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3402297854 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8003cfb0 0x7f6b8003f470 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/3402297854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dce1ab0 0x55868dce1ed0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/3402297854 >> 172.21.15.165:0/3402297854 conn(0x55868dcd5e60 msgr2=0x55868dcd6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/3402297854 shutdown_connections 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/3402297854 wait complete. 2024-09-22T08:11:07.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dbd0920 msgr2=0x55868dcce270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dbd0920 0x55868dcce270 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dcd0720 msgr2=0x55868dcd2b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dcd0720 0x55868dcd2b10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8c03cfb0 msgr2=0x7f6b8c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8c03cfb0 0x7f6b8c03f470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c001d70 tx=0x7f6c9c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 msgr2=0x55868dcc6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dcc6c20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6c98053d60 tx=0x7f6c98002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 shutdown_connections 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55868dcd0720 0x55868dcd2b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55868dbd0920 0x55868dcce270 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b8c03cfb0 0x7f6b8c03f470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 --2- 172.21.15.165:0/1438932829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55868dbcdff0 0x55868dcc6c20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 >> 172.21.15.165:0/1438932829 conn(0x55868dbc7bb0 msgr2=0x55868dcb8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 shutdown_connections 2024-09-22T08:11:07.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.912+0000 7f6caa93e800 1 -- 172.21.15.165:0/1438932829 wait complete. 2024-09-22T08:11:07.921 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-22T08:11:07.922 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-22T08:11:07.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-22T08:11:07.922 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-22T08:11:07.968 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:07.969 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:07.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.968+0000 7fd110f25800 1 Processor -- start 2024-09-22T08:11:07.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.968+0000 7fd110f25800 1 -- start start 2024-09-22T08:11:07.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.969+0000 7fd110f25800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556dc13a7cf0 0x556dc14394c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.969+0000 7fd110f25800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556dc12bfa20 con 0x556dc1439a00 2024-09-22T08:11:07.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.969+0000 7fd110f25800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556dc12bf7d0 con 0x556dc13a7cf0 2024-09-22T08:11:07.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.969+0000 7fd10cb33640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556dc13a7cf0 0x556dc14394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.969+0000 7fd10cb33640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556dc13a7cf0 0x556dc14394c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52534/0 (socket says 172.21.15.165:52534) 2024-09-22T08:11:07.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.969+0000 7fd10cb33640 1 -- 172.21.15.165:0/4179194124 learned_addr learned my addr 172.21.15.165:0/4179194124 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.969+0000 7fd10c332640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x556dc1439a00 0x556dc143bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33766/0 (socket says 172.21.15.165:33766) 2024-09-22T08:11:07.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.969+0000 7fd10cb33640 1 -- 172.21.15.165:0/4179194124 >> v1:172.21.15.53:6789/0 conn(0x556dc1439a00 legacy=0x556dc143bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.969+0000 7fd10cb33640 1 -- 172.21.15.165:0/4179194124 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc143e780 con 0x556dc13a7cf0 2024-09-22T08:11:07.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.971+0000 7fd10cb33640 1 --2- 172.21.15.165:0/4179194124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc14394c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc005fd0 tx=0x7fd0fc045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20245343e11e0be server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.971+0000 7fd10bb31640 1 -- 172.21.15.165:0/4179194124 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc04e600 con 0x556dc13a7cf0 2024-09-22T08:11:07.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.971+0000 7fd10bb31640 1 -- 172.21.15.165:0/4179194124 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0fc04e7a0 con 0x556dc13a7cf0 2024-09-22T08:11:07.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.971+0000 7fd10bb31640 1 -- 172.21.15.165:0/4179194124 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc04eaa0 con 0x556dc13a7cf0 2024-09-22T08:11:07.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.972+0000 7fd110f25800 1 -- 172.21.15.165:0/4179194124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 msgr2=0x556dc14394c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.972+0000 7fd110f25800 1 --2- 172.21.15.165:0/4179194124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc14394c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc005fd0 tx=0x7fd0fc045cf0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.972+0000 7fd110f25800 1 -- 172.21.15.165:0/4179194124 shutdown_connections 2024-09-22T08:11:07.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.972+0000 7fd110f25800 1 --2- 172.21.15.165:0/4179194124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc14394c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.972+0000 7fd110f25800 1 -- 172.21.15.165:0/4179194124 >> 172.21.15.165:0/4179194124 conn(0x556dc142ebb0 msgr2=0x556dc1431010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.972+0000 7fd110f25800 1 -- 172.21.15.165:0/4179194124 shutdown_connections 2024-09-22T08:11:07.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.972+0000 7fd110f25800 1 -- 172.21.15.165:0/4179194124 wait complete. 2024-09-22T08:11:07.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.986+0000 7fd110f25800 1 Processor -- start 2024-09-22T08:11:07.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.986+0000 7fd110f25800 1 -- start start 2024-09-22T08:11:07.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.986+0000 7fd110f25800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc1526230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.986+0000 7fd110f25800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556dc12ccdd0 con 0x556dc13a7cf0 2024-09-22T08:11:07.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.986+0000 7fd10cb33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc1526230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.986+0000 7fd10cb33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc1526230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52540/0 (socket says 172.21.15.165:52540) 2024-09-22T08:11:07.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.986+0000 7fd10cb33640 1 -- 172.21.15.165:0/1102401671 learned_addr learned my addr 172.21.15.165:0/1102401671 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.986+0000 7fd10cb33640 1 -- 172.21.15.165:0/1102401671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc1526820 con 0x556dc13a7cf0 2024-09-22T08:11:07.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.987+0000 7fd10cb33640 1 --2- 172.21.15.165:0/1102401671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc1526230 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc005fd0 tx=0x7fd0fc050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6060ae9956e6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.987+0000 7fcffae0d640 1 -- 172.21.15.165:0/1102401671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc04ea80 con 0x556dc13a7cf0 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.987+0000 7fcffae0d640 1 -- 172.21.15.165:0/1102401671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0fc066070 con 0x556dc13a7cf0 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.987+0000 7fcffae0d640 1 -- 172.21.15.165:0/1102401671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc04edc0 con 0x556dc13a7cf0 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 -- 172.21.15.165:0/1102401671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 msgr2=0x556dc1526230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 --2- 172.21.15.165:0/1102401671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc1526230 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc005fd0 tx=0x7fd0fc050000 comp rx=0 tx=0).stop 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 -- 172.21.15.165:0/1102401671 shutdown_connections 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 --2- 172.21.15.165:0/1102401671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc1526230 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 -- 172.21.15.165:0/1102401671 >> 172.21.15.165:0/1102401671 conn(0x556dc142ebb0 msgr2=0x556dc1521bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 -- 172.21.15.165:0/1102401671 shutdown_connections 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 -- 172.21.15.165:0/1102401671 wait complete. 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 Processor -- start 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 -- start start 2024-09-22T08:11:07.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc152dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd110f25800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556dc143da20 con 0x556dc13a7cf0 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd10cb33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc152dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd10cb33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc152dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52544/0 (socket says 172.21.15.165:52544) 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.988+0000 7fd10cb33640 1 -- 172.21.15.165:0/2728734640 learned_addr learned my addr 172.21.15.165:0/2728734640 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.989+0000 7fd10cb33640 1 -- 172.21.15.165:0/2728734640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc152e1b0 con 0x556dc13a7cf0 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.989+0000 7fd10cb33640 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc152dc50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc063040 tx=0x7fd0fc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.989+0000 7fcff960a640 1 -- 172.21.15.165:0/2728734640 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc06d420 con 0x556dc13a7cf0 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.989+0000 7fcff960a640 1 -- 172.21.15.165:0/2728734640 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0fc071030 con 0x556dc13a7cf0 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.989+0000 7fcff960a640 1 -- 172.21.15.165:0/2728734640 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc06d6f0 con 0x556dc13a7cf0 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.989+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dc152e440 con 0x556dc13a7cf0 2024-09-22T08:11:07.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.989+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc152ee40 con 0x556dc13a7cf0 2024-09-22T08:11:08.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.990+0000 7fcff960a640 1 -- 172.21.15.165:0/2728734640 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd0fc06d8e0 con 0x556dc13a7cf0 2024-09-22T08:11:08.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.990+0000 7fcff960a640 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff403cfb0 0x7fcff403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.990+0000 7fcff960a640 1 -- 172.21.15.165:0/2728734640 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd0fc098ce0 con 0x556dc13a7cf0 2024-09-22T08:11:08.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.990+0000 7fd10c332640 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff403cfb0 0x7fcff403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.990+0000 7fd110f25800 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1439a00 0x556dc15352a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.990+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc15357e0 con 0x556dc1439a00 2024-09-22T08:11:08.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.990+0000 7fd10d334640 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1439a00 0x556dc15352a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.991+0000 7fd10c332640 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff403cfb0 0x7fcff403f470 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001e30 tx=0x7fd0f4001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.991+0000 7fd10d334640 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1439a00 0x556dc15352a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.991+0000 7fd10d334640 1 -- 172.21.15.165:0/2728734640 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc1439a00 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.991+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc1535b80 con 0x556dc1439a00 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.991+0000 7fd10d334640 1 -- 172.21.15.165:0/2728734640 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc1439a00 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.991+0000 7fd110f25800 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc1537680 0x556dc1539af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.991+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc153a280 con 0x556dc1537680 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.991+0000 7fd10cb33640 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc1537680 0x556dc1539af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.992+0000 7fd10cb33640 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc1537680 0x556dc1539af0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.992+0000 7fd10cb33640 1 -- 172.21.15.165:0/2728734640 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1537680 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.992+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc15363d0 con 0x556dc1439a00 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.992+0000 7fd10d334640 1 -- 172.21.15.165:0/2728734640 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc1439a00 2024-09-22T08:11:08.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.992+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc1536820 con 0x556dc1439a00 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.993+0000 7fd10d334640 1 -- 172.21.15.165:0/2728734640 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc1439a00 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.993+0000 7fd110f25800 1 Processor -- start 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.993+0000 7fd110f25800 1 -- start start 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.993+0000 7fd110f25800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1548c60 0x556dc1549080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.993+0000 7fd110f25800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556dc132bd50 con 0x556dc1548c60 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.993+0000 7fd10d334640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1548c60 0x556dc1549080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.993+0000 7fd10d334640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1548c60 0x556dc1549080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52548/0 (socket says 172.21.15.165:52548) 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.993+0000 7fd10d334640 1 -- 172.21.15.165:0/3382570296 learned_addr learned my addr 172.21.15.165:0/3382570296 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.994+0000 7fd10d334640 1 -- 172.21.15.165:0/3382570296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc15496c0 con 0x556dc1548c60 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.994+0000 7fd10d334640 1 --2- 172.21.15.165:0/3382570296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1548c60 0x556dc1549080 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x556dc152fb50 tx=0x7fd10400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.994+0000 7fcff27fc640 1 -- 172.21.15.165:0/3382570296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd104007dc0 con 0x556dc1548c60 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.994+0000 7fcff27fc640 1 -- 172.21.15.165:0/3382570296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10401e020 con 0x556dc1548c60 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.994+0000 7fd110f25800 1 -- 172.21.15.165:0/3382570296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dc1549ef0 con 0x556dc1548c60 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.994+0000 7fcff27fc640 1 -- 172.21.15.165:0/3382570296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd104019570 con 0x556dc1548c60 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.994+0000 7fd110f25800 1 -- 172.21.15.165:0/3382570296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc154a490 con 0x556dc1548c60 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.995+0000 7fcff27fc640 1 -- 172.21.15.165:0/3382570296 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd104016040 con 0x556dc1548c60 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.995+0000 7fcff27fc640 1 --2- 172.21.15.165:0/3382570296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe403d000 0x7fcfe403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.995+0000 7fcff27fc640 1 -- 172.21.15.165:0/3382570296 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd10401f030 con 0x556dc1548c60 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.995+0000 7fd10cb33640 1 --2- 172.21.15.165:0/3382570296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe403d000 0x7fcfe403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.995+0000 7fd110f25800 1 Processor -- start 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.995+0000 7fd10cb33640 1 --2- 172.21.15.165:0/3382570296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe403d000 0x7fcfe403f4c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x556dc152fd30 tx=0x7fd0fc061e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.995+0000 7fd110f25800 1 -- start start 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.996+0000 7fd110f25800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc1555b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.996+0000 7fd110f25800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556dc1526b90 con 0x556dc1555740 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.996+0000 7fd10d334640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc1555b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.996+0000 7fd10d334640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc1555b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52550/0 (socket says 172.21.15.165:52550) 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.996+0000 7fd10d334640 1 -- 172.21.15.165:0/3192678848 learned_addr learned my addr 172.21.15.165:0/3192678848 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.996+0000 7fd10d334640 1 -- 172.21.15.165:0/3192678848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc1556130 con 0x556dc1555740 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.996+0000 7fd10d334640 1 --2- 172.21.15.165:0/3192678848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc1555b40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd104007fd0 tx=0x7fd104014340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c0a82ccbc10084 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.996+0000 7fcfe3fff640 1 -- 172.21.15.165:0/3192678848 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd10401d070 con 0x556dc1555740 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.996+0000 7fcfe3fff640 1 -- 172.21.15.165:0/3192678848 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd104056070 con 0x556dc1555740 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.996+0000 7fcfe3fff640 1 -- 172.21.15.165:0/3192678848 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd104017bf0 con 0x556dc1555740 2024-09-22T08:11:08.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 -- 172.21.15.165:0/3192678848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 msgr2=0x556dc1555b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 --2- 172.21.15.165:0/3192678848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc1555b40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd104007fd0 tx=0x7fd104014340 comp rx=0 tx=0).stop 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 -- 172.21.15.165:0/3192678848 shutdown_connections 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 --2- 172.21.15.165:0/3192678848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc1555b40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 -- 172.21.15.165:0/3192678848 >> 172.21.15.165:0/3192678848 conn(0x556dc1551b40 msgr2=0x556dc154fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 -- 172.21.15.165:0/3192678848 shutdown_connections 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 -- 172.21.15.165:0/3192678848 wait complete. 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 Processor -- start 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 -- start start 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc155ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd110f25800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556dc1556750 con 0x556dc1555740 2024-09-22T08:11:08.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd10d334640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc155ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd10d334640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc155ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52560/0 (socket says 172.21.15.165:52560) 2024-09-22T08:11:08.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.997+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 learned_addr learned my addr 172.21.15.165:0/2784532467 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.998+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc155d250 con 0x556dc1555740 2024-09-22T08:11:08.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.998+0000 7fd10d334640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc155ccf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd104056220 tx=0x7fd104054570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.998+0000 7fcfe27fc640 1 -- 172.21.15.165:0/2784532467 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd104044070 con 0x556dc1555740 2024-09-22T08:11:08.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.998+0000 7fcfe27fc640 1 -- 172.21.15.165:0/2784532467 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd104031070 con 0x556dc1555740 2024-09-22T08:11:08.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.998+0000 7fcfe27fc640 1 -- 172.21.15.165:0/2784532467 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1040455a0 con 0x556dc1555740 2024-09-22T08:11:08.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.998+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dc155d4e0 con 0x556dc1555740 2024-09-22T08:11:08.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.998+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc155de60 con 0x556dc1555740 2024-09-22T08:11:08.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.999+0000 7fcfe27fc640 1 -- 172.21.15.165:0/2784532467 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd1040173b0 con 0x556dc1555740 2024-09-22T08:11:08.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.999+0000 7fcfe27fc640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfd803cfb0 0x7fcfd803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.999+0000 7fcfe27fc640 1 -- 172.21.15.165:0/2784532467 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd10402dc90 con 0x556dc1555740 2024-09-22T08:11:08.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.999+0000 7fd10cb33640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfd803cfb0 0x7fcfd803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:07.999+0000 7fd10cb33640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfd803cfb0 0x7fcfd803f470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc04ec10 tx=0x7fd0fc089000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.000+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.000+0000 7fd110f25800 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1568650 0x556dc156ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.000+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc156b260 con 0x556dc1568650 2024-09-22T08:11:08.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.000+0000 7fd10c332640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1568650 0x556dc156ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.000+0000 7fd10c332640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1568650 0x556dc156ab10 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.000+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0f400f610 con 0x556dc1568650 2024-09-22T08:11:08.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.000+0000 7fd110f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.000+0000 7fd110f25800 20 realm 2024-09-22T08:11:08.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.000+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.000+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc15679a0 con 0x556dc1568650 2024-09-22T08:11:08.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0f400f610 con 0x556dc1568650 2024-09-22T08:11:08.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:08.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc156bd50 con 0x556dc1568650 2024-09-22T08:11:08.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0f400f610 con 0x556dc1568650 2024-09-22T08:11:08.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc156c620 con 0x556dc1568650 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0f400f610 con 0x556dc1568650 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc156d040 0x556dc156f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc156fb70 con 0x556dc156d040 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd10d334640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc156d040 0x556dc156f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.001+0000 7fd10d334640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc156d040 0x556dc156f430 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.002+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.002+0000 7fd110f25800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:08.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.002+0000 7fd110f25800 20 searching for the correct realm 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.002+0000 7fd110f25800 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556dc1571b20 0x556dc1573fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.002+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1571b20 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.002+0000 7fd10cb33640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556dc1571b20 0x556dc1573fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.002+0000 7fd10cb33640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556dc1571b20 0x556dc1573fe0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.002+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.002+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc156d040 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.003+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.003+0000 7fd10d334640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd104019040 0x7fd104045950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.003+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x7fd104019040 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.003+0000 7fd10c332640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd104019040 0x7fd104045950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.003+0000 7fd10c332640 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd104019040 0x7fd104045950 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.004+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f610 con 0x7fd104019040 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.004+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1568650 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.004+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f610 con 0x556dc1568650 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.004+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1568650 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.004+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd0f402b040 con 0x556dc1568650 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.004+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x7fd104019040 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.004+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f402b040 con 0x7fd104019040 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.004+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x7fd104019040 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.005+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f402b040 con 0x7fd104019040 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.005+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc156d040 2024-09-22T08:11:08.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.005+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.005+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1571b20 2024-09-22T08:11:08.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.005+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.005+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1568650 2024-09-22T08:11:08.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.005+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f402b040 con 0x556dc1568650 2024-09-22T08:11:08.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.005+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x7fd104019040 2024-09-22T08:11:08.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.006+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f402b040 con 0x7fd104019040 2024-09-22T08:11:08.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.006+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1568650 2024-09-22T08:11:08.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.006+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f402b040 con 0x556dc1568650 2024-09-22T08:11:08.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.006+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc156d040 2024-09-22T08:11:08.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.006+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.006+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1571b20 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.006+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.006+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1571b20 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.007+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.007+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x7fd104019040 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.007+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f402b040 con 0x7fd104019040 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.007+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1571b20 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.007+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.007+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1571b20 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.007+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.007+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1568650 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.008+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f402b040 con 0x556dc1568650 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.008+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1568650 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.008+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd0f402b040 con 0x556dc1568650 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.008+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x7fd104019040 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.008+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f402b040 con 0x7fd104019040 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.008+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1571b20 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.008+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.008+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc156d040 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.009+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.009+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1568650 2024-09-22T08:11:08.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.009+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f402b040 con 0x556dc1568650 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.009+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x7fd104019040 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.009+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.009+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1571b20 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.009+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.009+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x7fd104019040 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.010+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.010+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc156d040 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.010+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.010+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1571b20 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.010+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.010+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x7fd104019040 2024-09-22T08:11:08.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc1568650 2024-09-22T08:11:08.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574660 con 0x556dc156d040 2024-09-22T08:11:08.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:08.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:08.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:08.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:08.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc1570560 con 0x556dc1568650 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.011+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc1570e00 con 0x556dc1568650 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574ae0 con 0x556dc1568650 2024-09-22T08:11:08.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:08.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 20 zone default found 2024-09-22T08:11:08.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 4 Realm: () 2024-09-22T08:11:08.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:08.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:08.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:08.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 20 zonegroup default 2024-09-22T08:11:08.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc1574b00 con 0x7fd104019040 2024-09-22T08:11:08.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.012+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc1576960 con 0x556dc1571b20 2024-09-22T08:11:08.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.013+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.013+0000 7fd110f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.013+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.013+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc1576e40 con 0x556dc1571b20 2024-09-22T08:11:08.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.013+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.013+0000 7fd110f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.013+0000 7fd110f25800 20 started sync module instance, tier type = 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.013+0000 7fd110f25800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.013+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1575dd0 con 0x556dc156d040 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.014+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.014+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93929883525888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1575dd0 con 0x556dc156d040 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.014+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1577920 con 0x556dc1568650 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.015+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93929883525888] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.015+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.015+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93929883530256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1575dd0 con 0x556dc1568650 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.015+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc15783b0 con 0x556dc1571b20 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.016+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93929883530256] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.016+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.016+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93929883523360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1575d40 con 0x556dc1571b20 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.016+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1579270 con 0x556dc156d040 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.017+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93929883523360] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.017+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.017+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93929883536832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1579690 con 0x556dc156d040 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.017+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc157a050 con 0x556dc1568650 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.018+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93929883536832] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.018+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.019+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93929883540864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1579690 con 0x556dc1568650 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.019+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc157aaa0 con 0x7fd104019040 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.019+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.020+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93929883542960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc157a9d0 con 0x7fd104019040 2024-09-22T08:11:08.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.020+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc157b9d0 con 0x7fd104019040 2024-09-22T08:11:08.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.020+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93929883540864] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.021+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93929883542960] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.021+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.021+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93929883545232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc157b4e0 con 0x7fd104019040 2024-09-22T08:11:08.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.021+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc157bea0 con 0x7fd104019040 2024-09-22T08:11:08.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93929883545232] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93929883537888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc157bea0 con 0x7fd104019040 2024-09-22T08:11:08.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd110f25800 20 add_watcher() i=0 2024-09-22T08:11:08.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd110f25800 20 add_watcher() i=1 2024-09-22T08:11:08.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd110f25800 20 add_watcher() i=2 2024-09-22T08:11:08.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd110f25800 20 add_watcher() i=3 2024-09-22T08:11:08.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd110f25800 20 add_watcher() i=4 2024-09-22T08:11:08.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd110f25800 20 add_watcher() i=5 2024-09-22T08:11:08.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd110f25800 20 add_watcher() i=6 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93929883537888] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd110f25800 20 add_watcher() i=7 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.022+0000 7fd110f25800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.023+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc157f360 con 0x556dc1568650 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.023+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.023+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93929883561200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc157c010 con 0x556dc1568650 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.024+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93929883561200] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.024+0000 7fcfc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.024+0000 7fd110f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.024+0000 7fd110f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.024+0000 7fd110f25800 5 note: GC not initialized 2024-09-22T08:11:08.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.024+0000 7fcfc1fe3640 20 reqs_thread_entry: start 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.024+0000 7fd110f25800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.024+0000 7fd110f25800 20 Filter name: none 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fcf337fe640 20 reqs_thread_entry: start 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc15b26f0 con 0x7fd104019040 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:11:08.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc15b47e0 con 0x556dc156d040 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.025+0000 7fd110f25800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 : miss 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc15b61f0 con 0x7fd104019040 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(64 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:08.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.026+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc15b9930 con 0x7fd104019040 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.027+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(65 fud.buckets [call] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.027+0000 7fd110f25800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.027+0000 7fd110f25800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.027+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc15b8960 con 0x556dc156d040 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.027+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.027+0000 7fd110f25800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:08.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.027+0000 7fd110f25800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.027+0000 7fd110f25800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.027+0000 7fd110f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.028+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc15bd480 con 0x556dc156d040 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fd110f25800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fd110f25800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fd110f25800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93929883799200 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dc15ba780 con 0x7fd104019040 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== watch-notify(notify (1) cookie 93929883545232 notify 137438953478 ret 0) ==== 380+0+0 (crc 0 0 0) 0x556dc15b65e0 con 0x7fd104019040 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fcfe3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 93929883545232 notifier 4514 bl.length()=338 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fcfe3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fcfe3fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:08.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fcfe3fff640 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcfd0003ea0 con 0x7fd104019040 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(68 notify.6 [notify cookie 93929883799200 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.029+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.030+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== watch-notify(notify_complete (2) cookie 93929883799200 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556dc15b5710 con 0x7fd104019040 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.030+0000 7fcfc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.030+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93929883561200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc15b0410 con 0x556dc1568650 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.031+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93929883561200] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.031+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93929883525888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc15b0410 con 0x556dc156d040 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.032+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93929883525888] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.032+0000 7fd110f25800 20 remove_watcher() i=0 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.032+0000 7fd110f25800 2 removed watcher, disabling cache 2024-09-22T08:11:08.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.032+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93929883530256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc15b0410 con 0x556dc1568650 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.033+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93929883530256] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.033+0000 7fd110f25800 20 remove_watcher() i=1 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.033+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93929883523360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc15b0410 con 0x556dc1571b20 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.034+0000 7fd10cb33640 1 -- 172.21.15.165:0/2784532467 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93929883523360] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0fc07d070 con 0x556dc1571b20 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.034+0000 7fd110f25800 20 remove_watcher() i=2 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.034+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93929883536832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1577410 con 0x556dc156d040 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.035+0000 7fd10d334640 1 -- 172.21.15.165:0/2784532467 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93929883536832] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1040083e0 con 0x556dc156d040 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.035+0000 7fd110f25800 20 remove_watcher() i=3 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.035+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93929883540864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1575920 con 0x556dc1568650 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.036+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93929883540864] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x556dc1568650 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.036+0000 7fd110f25800 20 remove_watcher() i=4 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.036+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93929883542960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1578dc0 con 0x7fd104019040 2024-09-22T08:11:08.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.037+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93929883542960] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.037+0000 7fd110f25800 20 remove_watcher() i=5 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.037+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93929883545232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc1575920 con 0x7fd104019040 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.038+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93929883545232] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.038+0000 7fd110f25800 20 remove_watcher() i=6 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.038+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93929883537888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dc157a5b0 con 0x7fd104019040 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93929883537888] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f403b040 con 0x7fd104019040 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 20 remove_watcher() i=7 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd104019040 msgr2=0x7fd104045950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd104019040 0x7fd104045950 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1568650 msgr2=0x556dc156ab10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1568650 0x556dc156ab10 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc156d040 msgr2=0x556dc156f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc156d040 0x556dc156f430 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556dc1571b20 msgr2=0x556dc1573fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556dc1571b20 0x556dc1573fe0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfd803cfb0 msgr2=0x7fcfd803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfd803cfb0 0x7fcfd803f470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc04ec10 tx=0x7fd0fc089000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 msgr2=0x556dc155ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd110f25800 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc155ccf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd104056220 tx=0x7fd104054570 comp rx=0 tx=0).stop 2024-09-22T08:11:08.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.039+0000 7fd10c332640 1 -- 172.21.15.165:0/2784532467 reap_dead start 2024-09-22T08:11:08.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 shutdown_connections 2024-09-22T08:11:08.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 --2- 172.21.15.165:0/2784532467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1555740 0x556dc155ccf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 >> 172.21.15.165:0/2784532467 conn(0x556dc1551b40 msgr2=0x556dc154fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 shutdown_connections 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/2784532467 wait complete. 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/3382570296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe403d000 msgr2=0x7fcfe403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 --2- 172.21.15.165:0/3382570296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe403d000 0x7fcfe403f4c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x556dc152fd30 tx=0x7fd0fc061e50 comp rx=0 tx=0).stop 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/3382570296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1548c60 msgr2=0x556dc1549080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 --2- 172.21.15.165:0/3382570296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1548c60 0x556dc1549080 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x556dc152fb50 tx=0x7fd10400af40 comp rx=0 tx=0).stop 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/3382570296 shutdown_connections 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 --2- 172.21.15.165:0/3382570296 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe403d000 0x7fcfe403f4c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 --2- 172.21.15.165:0/3382570296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc1548c60 0x556dc1549080 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/3382570296 >> 172.21.15.165:0/3382570296 conn(0x556dc153d010 msgr2=0x556dc153d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/3382570296 shutdown_connections 2024-09-22T08:11:08.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/3382570296 wait complete. 2024-09-22T08:11:08.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1439a00 msgr2=0x556dc15352a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1439a00 0x556dc15352a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc1537680 msgr2=0x556dc1539af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc1537680 0x556dc1539af0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff403cfb0 msgr2=0x7fcff403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff403cfb0 0x7fcff403f470 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001e30 tx=0x7fd0f4001390 comp rx=0 tx=0).stop 2024-09-22T08:11:08.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 msgr2=0x556dc152dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.040+0000 7fd110f25800 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc152dc50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc063040 tx=0x7fd0fc003330 comp rx=0 tx=0).stop 2024-09-22T08:11:08.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.041+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 shutdown_connections 2024-09-22T08:11:08.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.041+0000 7fd110f25800 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556dc1537680 0x556dc1539af0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.041+0000 7fd110f25800 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556dc1439a00 0x556dc15352a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.041+0000 7fd110f25800 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff403cfb0 0x7fcff403f470 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.041+0000 7fd110f25800 1 --2- 172.21.15.165:0/2728734640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556dc13a7cf0 0x556dc152dc50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.041+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 >> 172.21.15.165:0/2728734640 conn(0x556dc142ebb0 msgr2=0x556dc15203a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.041+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 shutdown_connections 2024-09-22T08:11:08.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.041+0000 7fd110f25800 1 -- 172.21.15.165:0/2728734640 wait complete. 2024-09-22T08:11:08.061 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1'] 2024-09-22T08:11:08.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1'] 2024-09-22T08:11:08.061 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:08.110 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:08.110 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:08.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.110+0000 7f783c322800 1 Processor -- start 2024-09-22T08:11:08.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.110+0000 7f783c322800 1 -- start start 2024-09-22T08:11:08.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.110+0000 7f783c322800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f7b1081550 0x55f7b11124d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.110+0000 7f783c322800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7b0f98a20 con 0x55f7b1112a40 2024-09-22T08:11:08.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.110+0000 7f783c322800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f7b0f987d0 con 0x55f7b1081550 2024-09-22T08:11:08.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.111+0000 7f7837fae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f7b1081550 0x55f7b11124d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.111+0000 7f7837fae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f7b1081550 0x55f7b11124d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52568/0 (socket says 172.21.15.165:52568) 2024-09-22T08:11:08.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.111+0000 7f7837fae640 1 -- 172.21.15.165:0/2765852356 learned_addr learned my addr 172.21.15.165:0/2765852356 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.111+0000 7f7837fae640 1 -- 172.21.15.165:0/2765852356 >> v1:172.21.15.53:6789/0 conn(0x55f7b1112a40 legacy=0x55f7b1114f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.111+0000 7f7837fae640 1 -- 172.21.15.165:0/2765852356 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b11177f0 con 0x55f7b1081550 2024-09-22T08:11:08.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.113+0000 7f7837fae640 1 --2- 172.21.15.165:0/2765852356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b11124d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f782800a520 tx=0x7f7828045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5eb3e9fd70e6ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.113+0000 7f7836fac640 1 -- 172.21.15.165:0/2765852356 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7828055070 con 0x55f7b1081550 2024-09-22T08:11:08.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.113+0000 7f7836fac640 1 -- 172.21.15.165:0/2765852356 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78280515b0 con 0x55f7b1081550 2024-09-22T08:11:08.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.113+0000 7f7836fac640 1 -- 172.21.15.165:0/2765852356 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78280518d0 con 0x55f7b1081550 2024-09-22T08:11:08.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.113+0000 7f783c322800 1 -- 172.21.15.165:0/2765852356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 msgr2=0x55f7b11124d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.113+0000 7f783c322800 1 --2- 172.21.15.165:0/2765852356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b11124d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f782800a520 tx=0x7f7828045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.113+0000 7f783c322800 1 -- 172.21.15.165:0/2765852356 shutdown_connections 2024-09-22T08:11:08.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.113+0000 7f783c322800 1 --2- 172.21.15.165:0/2765852356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b11124d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.114+0000 7f783c322800 1 -- 172.21.15.165:0/2765852356 >> 172.21.15.165:0/2765852356 conn(0x55f7b1107c00 msgr2=0x55f7b110a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.114+0000 7f783c322800 1 -- 172.21.15.165:0/2765852356 shutdown_connections 2024-09-22T08:11:08.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.114+0000 7f783c322800 1 -- 172.21.15.165:0/2765852356 wait complete. 2024-09-22T08:11:08.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.127+0000 7f783c322800 1 Processor -- start 2024-09-22T08:11:08.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.127+0000 7f783c322800 1 -- start start 2024-09-22T08:11:08.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.128+0000 7f783c322800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b11ff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.128+0000 7f783c322800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7b0fa5dd0 con 0x55f7b1081550 2024-09-22T08:11:08.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.128+0000 7f7837fae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b11ff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.128+0000 7f7837fae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b11ff2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52570/0 (socket says 172.21.15.165:52570) 2024-09-22T08:11:08.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.128+0000 7f7837fae640 1 -- 172.21.15.165:0/2765128299 learned_addr learned my addr 172.21.15.165:0/2765128299 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.128+0000 7f7837fae640 1 -- 172.21.15.165:0/2765128299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b11ff8b0 con 0x55f7b1081550 2024-09-22T08:11:08.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.128+0000 7f7837fae640 1 --2- 172.21.15.165:0/2765128299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b11ff2c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f78280460d0 tx=0x7f7828051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14983075d50804e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.129+0000 7f7725e0b640 1 -- 172.21.15.165:0/2765128299 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78280519d0 con 0x55f7b1081550 2024-09-22T08:11:08.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.129+0000 7f7725e0b640 1 -- 172.21.15.165:0/2765128299 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7828051b70 con 0x55f7b1081550 2024-09-22T08:11:08.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.129+0000 7f7725e0b640 1 -- 172.21.15.165:0/2765128299 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7828051e50 con 0x55f7b1081550 2024-09-22T08:11:08.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.129+0000 7f783c322800 1 -- 172.21.15.165:0/2765128299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 msgr2=0x55f7b11ff2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.129+0000 7f783c322800 1 --2- 172.21.15.165:0/2765128299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b11ff2c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f78280460d0 tx=0x7f7828051000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.129+0000 7f783c322800 1 -- 172.21.15.165:0/2765128299 shutdown_connections 2024-09-22T08:11:08.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.129+0000 7f783c322800 1 --2- 172.21.15.165:0/2765128299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b11ff2c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.129+0000 7f783c322800 1 -- 172.21.15.165:0/2765128299 >> 172.21.15.165:0/2765128299 conn(0x55f7b1107c00 msgr2=0x55f7b11fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.129+0000 7f783c322800 1 -- 172.21.15.165:0/2765128299 shutdown_connections 2024-09-22T08:11:08.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.129+0000 7f783c322800 1 -- 172.21.15.165:0/2765128299 wait complete. 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.130+0000 7f783c322800 1 Processor -- start 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.130+0000 7f783c322800 1 -- start start 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.130+0000 7f783c322800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b1206cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.130+0000 7f783c322800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7b1116a90 con 0x55f7b1081550 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.130+0000 7f7837fae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b1206cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.130+0000 7f7837fae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b1206cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52574/0 (socket says 172.21.15.165:52574) 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.130+0000 7f7837fae640 1 -- 172.21.15.165:0/4219463124 learned_addr learned my addr 172.21.15.165:0/4219463124 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.130+0000 7f7837fae640 1 -- 172.21.15.165:0/4219463124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b1207230 con 0x55f7b1081550 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.130+0000 7f7837fae640 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b1206cd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f78280460d0 tx=0x7f7828002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.131+0000 7f771ffff640 1 -- 172.21.15.165:0/4219463124 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7828073020 con 0x55f7b1081550 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.131+0000 7f771ffff640 1 -- 172.21.15.165:0/4219463124 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782806f580 con 0x55f7b1081550 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.131+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7b12074c0 con 0x55f7b1081550 2024-09-22T08:11:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.131+0000 7f771ffff640 1 -- 172.21.15.165:0/4219463124 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f782806f8a0 con 0x55f7b1081550 2024-09-22T08:11:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.131+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b12080d0 con 0x55f7b1081550 2024-09-22T08:11:08.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.131+0000 7f771ffff640 1 -- 172.21.15.165:0/4219463124 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7828076020 con 0x55f7b1081550 2024-09-22T08:11:08.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.132+0000 7f771ffff640 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f772003cfb0 0x7f772003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.132+0000 7f771ffff640 1 -- 172.21.15.165:0/4219463124 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f782806b040 con 0x55f7b1081550 2024-09-22T08:11:08.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.132+0000 7f78377ad640 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f772003cfb0 0x7f772003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.132+0000 7f783c322800 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1112a40 0x55f7b120e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.132+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b120e860 con 0x55f7b1112a40 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.132+0000 7f78387af640 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1112a40 0x55f7b120e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.132+0000 7f78377ad640 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f772003cfb0 0x7f772003f470 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f782c001e50 tx=0x7f782c0013d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.132+0000 7f78387af640 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1112a40 0x55f7b120e320 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.133+0000 7f78387af640 1 -- 172.21.15.165:0/4219463124 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f783000a4d0 con 0x55f7b1112a40 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.133+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b120ec00 con 0x55f7b1112a40 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.133+0000 7f78387af640 1 -- 172.21.15.165:0/4219463124 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f783000a4d0 con 0x55f7b1112a40 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.133+0000 7f783c322800 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1210740 0x55f7b1212bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.133+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1213340 con 0x55f7b1210740 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.133+0000 7f7837fae640 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1210740 0x55f7b1212bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.133+0000 7f7837fae640 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1210740 0x55f7b1212bb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.134+0000 7f7837fae640 1 -- 172.21.15.165:0/4219463124 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7828057030 con 0x55f7b1210740 2024-09-22T08:11:08.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.134+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b120f450 con 0x55f7b1112a40 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.134+0000 7f78387af640 1 -- 172.21.15.165:0/4219463124 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f783000a4d0 con 0x55f7b1112a40 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.134+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b120f870 con 0x55f7b1112a40 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.134+0000 7f78387af640 1 -- 172.21.15.165:0/4219463124 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f783000a4d0 con 0x55f7b1112a40 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.134+0000 7f783c322800 1 Processor -- start 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.135+0000 7f783c322800 1 -- start start 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.135+0000 7f783c322800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1221cd0 0x55f7b12220f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.135+0000 7f783c322800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7b1004d50 con 0x55f7b1221cd0 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.135+0000 7f78387af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1221cd0 0x55f7b12220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.135+0000 7f78387af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1221cd0 0x55f7b12220f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52586/0 (socket says 172.21.15.165:52586) 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.135+0000 7f78387af640 1 -- 172.21.15.165:0/71437070 learned_addr learned my addr 172.21.15.165:0/71437070 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.135+0000 7f78387af640 1 -- 172.21.15.165:0/71437070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b1222730 con 0x55f7b1221cd0 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.136+0000 7f78387af640 1 --2- 172.21.15.165:0/71437070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1221cd0 0x55f7b12220f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55f7b1208ba0 tx=0x7f7830018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.136+0000 7f771d7fa640 1 -- 172.21.15.165:0/71437070 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7830014450 con 0x55f7b1221cd0 2024-09-22T08:11:08.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.136+0000 7f771d7fa640 1 -- 172.21.15.165:0/71437070 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78300145f0 con 0x55f7b1221cd0 2024-09-22T08:11:08.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.136+0000 7f783c322800 1 -- 172.21.15.165:0/71437070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7b1222f60 con 0x55f7b1221cd0 2024-09-22T08:11:08.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.136+0000 7f771d7fa640 1 -- 172.21.15.165:0/71437070 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7830014910 con 0x55f7b1221cd0 2024-09-22T08:11:08.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.136+0000 7f783c322800 1 -- 172.21.15.165:0/71437070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b1223500 con 0x55f7b1221cd0 2024-09-22T08:11:08.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.137+0000 7f771d7fa640 1 -- 172.21.15.165:0/71437070 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7830011040 con 0x55f7b1221cd0 2024-09-22T08:11:08.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.137+0000 7f771d7fa640 1 --2- 172.21.15.165:0/71437070 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f771003cfb0 0x7f771003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.137+0000 7f771d7fa640 1 -- 172.21.15.165:0/71437070 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f783001e070 con 0x55f7b1221cd0 2024-09-22T08:11:08.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.137+0000 7f7837fae640 1 --2- 172.21.15.165:0/71437070 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f771003cfb0 0x7f771003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.137+0000 7f783c322800 1 Processor -- start 2024-09-22T08:11:08.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.137+0000 7f783c322800 1 -- start start 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.137+0000 7f7837fae640 1 --2- 172.21.15.165:0/71437070 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f771003cfb0 0x7f771003f470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7828096a10 tx=0x7f78280968e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.137+0000 7f783c322800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b122eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.137+0000 7f783c322800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7b11ffc20 con 0x55f7b122e750 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.138+0000 7f78387af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b122eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.138+0000 7f78387af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b122eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52588/0 (socket says 172.21.15.165:52588) 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.138+0000 7f78387af640 1 -- 172.21.15.165:0/3684104053 learned_addr learned my addr 172.21.15.165:0/3684104053 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.138+0000 7f78387af640 1 -- 172.21.15.165:0/3684104053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b122f140 con 0x55f7b122e750 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.138+0000 7f78387af640 1 --2- 172.21.15.165:0/3684104053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b122eb50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7830016fd0 tx=0x7f7830011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620b0b0c7dda43ed server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.138+0000 7f7716ffd640 1 -- 172.21.15.165:0/3684104053 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7830051020 con 0x55f7b122e750 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.138+0000 7f7716ffd640 1 -- 172.21.15.165:0/3684104053 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78300560d0 con 0x55f7b122e750 2024-09-22T08:11:08.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.138+0000 7f7716ffd640 1 -- 172.21.15.165:0/3684104053 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7830028070 con 0x55f7b122e750 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 -- 172.21.15.165:0/3684104053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 msgr2=0x55f7b122eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 --2- 172.21.15.165:0/3684104053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b122eb50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7830016fd0 tx=0x7f7830011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 -- 172.21.15.165:0/3684104053 shutdown_connections 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 --2- 172.21.15.165:0/3684104053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b122eb50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 -- 172.21.15.165:0/3684104053 >> 172.21.15.165:0/3684104053 conn(0x55f7b122ab70 msgr2=0x55f7b1228db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 -- 172.21.15.165:0/3684104053 shutdown_connections 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 -- 172.21.15.165:0/3684104053 wait complete. 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 Processor -- start 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 -- start start 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b1235d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f783c322800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7b122f760 con 0x55f7b122e750 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f78387af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b1235d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f78387af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b1235d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52592/0 (socket says 172.21.15.165:52592) 2024-09-22T08:11:08.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.139+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 learned_addr learned my addr 172.21.15.165:0/3555017933 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.140+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b1236290 con 0x55f7b122e750 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.140+0000 7f78387af640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b1235d30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7830053610 tx=0x7f7830011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.140+0000 7f77157fa640 1 -- 172.21.15.165:0/3555017933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7830031070 con 0x55f7b122e750 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.140+0000 7f77157fa640 1 -- 172.21.15.165:0/3555017933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7830016440 con 0x55f7b122e750 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.140+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7b1236520 con 0x55f7b122e750 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.140+0000 7f77157fa640 1 -- 172.21.15.165:0/3555017933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7830054a00 con 0x55f7b122e750 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.140+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b1236ea0 con 0x55f7b122e750 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.141+0000 7f77157fa640 1 -- 172.21.15.165:0/3555017933 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7830034070 con 0x55f7b122e750 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.141+0000 7f77157fa640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f770003cfb0 0x7f770003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.141+0000 7f77157fa640 1 -- 172.21.15.165:0/3555017933 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f783000e040 con 0x55f7b122e750 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.141+0000 7f7837fae640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f770003cfb0 0x7f770003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.141+0000 7f7837fae640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f770003cfb0 0x7f770003f470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f782805a7d0 tx=0x7f7828085000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1241820 0x55f7b1243ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1244430 con 0x55f7b1241820 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f78377ad640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1241820 0x55f7b1243ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f78377ad640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1241820 0x55f7b1243ce0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f782c010580 con 0x55f7b1241820 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 20 realm 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1240b70 con 0x55f7b1241820 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f782c010580 con 0x55f7b1241820 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.142+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1244f20 con 0x55f7b1241820 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f782c010580 con 0x55f7b1241820 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f783c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b12457f0 con 0x55f7b1241820 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f782c010580 con 0x55f7b1241820 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f783c322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f783c322800 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1246210 0x55f7b1248600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1248d40 con 0x55f7b1246210 2024-09-22T08:11:08.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f78387af640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1246210 0x55f7b1248600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.143+0000 7f78387af640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1246210 0x55f7b1248600 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f783c322800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f783c322800 20 searching for the correct realm 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f783c322800 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f7b124ad10 0x55f7b124d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b124ad10 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f7837fae640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f7b124ad10 0x55f7b124d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f7837fae640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f7b124ad10 0x55f7b124d1d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1246210 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f78387af640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7830036070 0x7f7830038080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.144+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x7f7830036070 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.145+0000 7f78377ad640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7830036070 0x7f7830038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.145+0000 7f78377ad640 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7830036070 0x7f7830038080 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.145+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c010580 con 0x7f7830036070 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.145+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1241820 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.146+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c010580 con 0x55f7b1241820 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.146+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1241820 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.146+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f782c02a040 con 0x55f7b1241820 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.146+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x7f7830036070 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.146+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x7f7830036070 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.146+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x7f7830036070 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.146+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x7f7830036070 2024-09-22T08:11:08.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.146+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1246210 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.147+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.147+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b124ad10 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.147+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.147+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1241820 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.147+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x55f7b1241820 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.147+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x7f7830036070 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.147+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x7f7830036070 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.147+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1241820 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.148+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x55f7b1241820 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.148+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1246210 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.148+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.148+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b124ad10 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.148+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.148+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b124ad10 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.148+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.148+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x7f7830036070 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.148+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x7f7830036070 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.148+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b124ad10 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.149+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.149+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b124ad10 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.149+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.149+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1241820 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.149+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x55f7b1241820 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.149+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1241820 2024-09-22T08:11:08.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.149+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f782c02a040 con 0x55f7b1241820 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.149+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x7f7830036070 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.150+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x7f7830036070 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.150+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b124ad10 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.150+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.150+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1246210 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.150+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.150+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1241820 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.150+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x55f7b1241820 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.150+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x7f7830036070 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.151+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x7f7830036070 2024-09-22T08:11:08.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.151+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b124ad10 2024-09-22T08:11:08.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.151+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.151+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x7f7830036070 2024-09-22T08:11:08.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.151+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c02a040 con 0x7f7830036070 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.151+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1246210 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.151+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.151+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b124ad10 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.151+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.151+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x7f7830036070 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1241820 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124d8a0 con 0x55f7b1246210 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:08.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1249700 con 0x55f7b1241820 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.152+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1249fa0 con 0x55f7b1241820 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1249340 con 0x55f7b1241820 2024-09-22T08:11:08.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 20 zone default found 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 4 Realm: () 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 20 zonegroup default 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124e1d0 con 0x7f7830036070 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.153+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124fe10 con 0x55f7b124ad10 2024-09-22T08:11:08.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.154+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.154+0000 7f783c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.154+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.154+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b12502a0 con 0x55f7b124ad10 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.154+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.154+0000 7f783c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.154+0000 7f783c322800 20 started sync module instance, tier type = 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.154+0000 7f783c322800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.154+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124ebe0 con 0x55f7b1246210 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.155+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.155+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522317270992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b124e840 con 0x55f7b1246210 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.155+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b12511d0 con 0x55f7b1241820 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.156+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522317270992] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.156+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.156+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522317276928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b12511d0 con 0x55f7b1241820 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.156+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1251c00 con 0x55f7b124ad10 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.157+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522317276928] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.157+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.157+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522317278496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1251140 con 0x55f7b124ad10 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.157+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1252af0 con 0x55f7b1246210 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.158+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.158+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522317285440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1253390 con 0x55f7b1246210 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.158+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522317278496] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.158+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1253920 con 0x55f7b1241820 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.159+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.159+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522317283360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1253920 con 0x55f7b1241820 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.159+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1254890 con 0x7f7830036070 2024-09-22T08:11:08.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.159+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522317285440] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.160+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522317283360] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.160+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.160+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522317292384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1253b00 con 0x7f7830036070 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.160+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1255130 con 0x7f7830036070 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.161+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522317292384] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.161+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.161+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522317287136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1254f60 con 0x7f7830036070 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.162+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b12557b0 con 0x7f7830036070 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522317287136] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522317294736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b12555a0 con 0x7f7830036070 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 20 add_watcher() i=0 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 20 add_watcher() i=1 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 20 add_watcher() i=2 2024-09-22T08:11:08.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 20 add_watcher() i=3 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 20 add_watcher() i=4 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 20 add_watcher() i=5 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 20 add_watcher() i=6 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522317294736] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 20 add_watcher() i=7 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.163+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1258bd0 con 0x55f7b1241820 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.164+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.164+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522317295792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1255f30 con 0x55f7b1241820 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.165+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522317295792] v32'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.165+0000 7f76edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.165+0000 7f783c322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.165+0000 7f783c322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:08.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.165+0000 7f783c322800 5 note: GC not initialized 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.165+0000 7f76ecfe1640 20 reqs_thread_entry: start 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.165+0000 7f783c322800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.165+0000 7f783c322800 20 Filter name: none 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f76667fc640 20 reqs_thread_entry: start 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b128c030 con 0x55f7b1241820 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:08.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b128e120 con 0x55f7b1246210 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 : miss 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.166+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b128fa00 con 0x7f7830036070 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.167+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(64 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.167+0000 7f783c322800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.167+0000 7f783c322800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.167+0000 7f783c322800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.167+0000 7f783c322800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:08.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.167+0000 7f783c322800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:08.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.167+0000 7f783c322800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:08.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.167+0000 7f783c322800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-22T08:11:08.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.167+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1294050 con 0x7f7830036070 2024-09-22T08:11:08.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.169+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(65 fud.buckets [call] v32'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.169+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:66 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1299db0 con 0x7f7830036070 2024-09-22T08:11:08.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.170+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(66 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.170+0000 7f783c322800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:08.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.170+0000 7f783c322800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:08.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.170+0000 7f783c322800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:08.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.170+0000 7f783c322800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1, ofs0, ns] 2024-09-22T08:11:08.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.170+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94522317537472 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1294480 con 0x7f7830036070 2024-09-22T08:11:08.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== watch-notify(notify (1) cookie 94522317287136 notify 137438953479 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55f7b128fdf0 con 0x7f7830036070 2024-09-22T08:11:08.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f7716ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94522317287136 notifier 4521 bl.length()=760 2024-09-22T08:11:08.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f7716ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f7716ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f7716ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f7716ffd640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f76fc003ea0 con 0x7f7830036070 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(67 notify.6 [notify cookie 94522317537472 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== watch-notify(notify_complete (2) cookie 94522317537472 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f7b128ef20 con 0x7f7830036070 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f783c322800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_sources= new_sources= 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f783c322800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential sources added=[] removed=[] 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f783c322800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_dests= new_dests= 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f783c322800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential dests added=[] removed=[] 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.171+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b12900a0 con 0x55f7b1246210 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.172+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.172+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b12900a0 con 0x55f7b1246210 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.173+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.173+0000 7f783c322800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.173+0000 7f783c322800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.173+0000 7f783c322800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.173+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94522317537440 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1298c20 con 0x7f7830036070 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.174+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== watch-notify(notify (1) cookie 94522317287136 notify 137438953480 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55f7b0f98a20 con 0x7f7830036070 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.174+0000 7f77167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94522317287136 notifier 4521 bl.length()=314 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.174+0000 7f77167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.174+0000 7f77167fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.174+0000 7f77167fc640 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f766c003400 con 0x7f7830036070 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.174+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(71 notify.6 [notify cookie 94522317537440 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.174+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== watch-notify(notify_complete (2) cookie 94522317537440 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f782c01dc30 con 0x7f7830036070 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.174+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.175+0000 7f76edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.175+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522317295792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1289d50 con 0x55f7b1241820 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.176+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94522317295792] v32'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.176+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522317270992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1289d50 con 0x55f7b1246210 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.177+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94522317270992] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.177+0000 7f783c322800 20 remove_watcher() i=0 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.177+0000 7f783c322800 2 removed watcher, disabling cache 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.177+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522317276928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1289d50 con 0x55f7b1241820 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.178+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94522317276928] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.178+0000 7f783c322800 20 remove_watcher() i=1 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.178+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522317278496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1289d50 con 0x55f7b124ad10 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.179+0000 7f7837fae640 1 -- 172.21.15.165:0/3555017933 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94522317278496] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7828057030 con 0x55f7b124ad10 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.179+0000 7f783c322800 20 remove_watcher() i=2 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.179+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522317285440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1250700 con 0x55f7b1246210 2024-09-22T08:11:08.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.180+0000 7f78387af640 1 -- 172.21.15.165:0/3555017933 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94522317285440] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7830033030 con 0x55f7b1246210 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.180+0000 7f783c322800 20 remove_watcher() i=3 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.180+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522317283360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1250d20 con 0x55f7b1241820 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.181+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94522317283360] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x55f7b1241820 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.181+0000 7f783c322800 20 remove_watcher() i=4 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.181+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522317292384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1250700 con 0x7f7830036070 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.182+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94522317292384] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.182+0000 7f783c322800 20 remove_watcher() i=5 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.182+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522317287136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1252020 con 0x7f7830036070 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.183+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94522317287136] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.183+0000 7f783c322800 20 remove_watcher() i=6 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.183+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522317294736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7b1250d20 con 0x7f7830036070 2024-09-22T08:11:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94522317294736] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f782c03a040 con 0x7f7830036070 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 20 remove_watcher() i=7 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7830036070 msgr2=0x7f7830038080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7830036070 0x7f7830038080 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1241820 msgr2=0x55f7b1243ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1241820 0x55f7b1243ce0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1246210 msgr2=0x55f7b1248600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1246210 0x55f7b1248600 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f7b124ad10 msgr2=0x55f7b124d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f7b124ad10 0x55f7b124d1d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f770003cfb0 msgr2=0x7f770003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f770003cfb0 0x7f770003f470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f782805a7d0 tx=0x7f7828085000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 msgr2=0x55f7b1235d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f78377ad640 1 -- 172.21.15.165:0/3555017933 reap_dead start 2024-09-22T08:11:08.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b1235d30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7830053610 tx=0x7f7830011f60 comp rx=0 tx=0).stop 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 shutdown_connections 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 --2- 172.21.15.165:0/3555017933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b122e750 0x55f7b1235d30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 >> 172.21.15.165:0/3555017933 conn(0x55f7b122ab70 msgr2=0x55f7b1228d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 shutdown_connections 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.184+0000 7f783c322800 1 -- 172.21.15.165:0/3555017933 wait complete. 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/71437070 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f771003cfb0 msgr2=0x7f771003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/71437070 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f771003cfb0 0x7f771003f470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7828096a10 tx=0x7f78280968e0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/71437070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1221cd0 msgr2=0x55f7b12220f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/71437070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1221cd0 0x55f7b12220f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55f7b1208ba0 tx=0x7f7830018830 comp rx=0 tx=0).stop 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/71437070 shutdown_connections 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/71437070 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f771003cfb0 0x7f771003f470 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/71437070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1221cd0 0x55f7b12220f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/71437070 >> 172.21.15.165:0/71437070 conn(0x55f7b1216080 msgr2=0x55f7b1216460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/71437070 shutdown_connections 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/71437070 wait complete. 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1112a40 msgr2=0x55f7b120e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1112a40 0x55f7b120e320 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1210740 msgr2=0x55f7b1212bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1210740 0x55f7b1212bb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f772003cfb0 msgr2=0x7f772003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f772003cfb0 0x7f772003f470 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f782c001e50 tx=0x7f782c0013d0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 msgr2=0x55f7b1206cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b1206cd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f78280460d0 tx=0x7f7828002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 shutdown_connections 2024-09-22T08:11:08.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f7b1210740 0x55f7b1212bb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f7b1112a40 0x55f7b120e320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f772003cfb0 0x7f772003f470 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 --2- 172.21.15.165:0/4219463124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7b1081550 0x55f7b1206cd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 >> 172.21.15.165:0/4219463124 conn(0x55f7b1107c00 msgr2=0x55f7b12005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 shutdown_connections 2024-09-22T08:11:08.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.185+0000 7f783c322800 1 -- 172.21.15.165:0/4219463124 wait complete. 2024-09-22T08:11:08.196 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-22T08:11:08.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-22T08:11:08.196 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-22T08:11:08.240 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:08.240 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:08.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.240+0000 7f4916d23800 1 Processor -- start 2024-09-22T08:11:08.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.240+0000 7f4916d23800 1 -- start start 2024-09-22T08:11:08.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.240+0000 7f4916d23800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562f0baeebf0 0x562f0baf10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.240+0000 7f4916d23800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562f0b973a20 con 0x562f0ba5bd10 2024-09-22T08:11:08.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.240+0000 7f4916d23800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562f0b9737d0 con 0x562f0baeebf0 2024-09-22T08:11:08.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.241+0000 7f491220b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562f0baeebf0 0x562f0baf10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.241+0000 7f4912a0c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x562f0ba5bd10 0x562f0baed4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33774/0 (socket says 172.21.15.165:33774) 2024-09-22T08:11:08.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.241+0000 7f4912a0c640 1 -- 172.21.15.165:0/1347633623 learned_addr learned my addr 172.21.15.165:0/1347633623 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:08.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.241+0000 7f491220b640 1 -- 172.21.15.165:0/1347633623 >> v1:172.21.15.53:6789/0 conn(0x562f0ba5bd10 legacy=0x562f0baed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.241+0000 7f491220b640 1 -- 172.21.15.165:0/1347633623 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0baf27c0 con 0x562f0baeebf0 2024-09-22T08:11:08.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.243+0000 7f491220b640 1 --2- 172.21.15.165:0/1347633623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0baeebf0 0x562f0baf10b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00a470 tx=0x7f48fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641d4df56f5e96c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.243+0000 7f4911a0a640 1 -- 172.21.15.165:0/1347633623 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48fc053570 con 0x562f0baeebf0 2024-09-22T08:11:08.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.243+0000 7f4911a0a640 1 -- 172.21.15.165:0/1347633623 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48fc058070 con 0x562f0baeebf0 2024-09-22T08:11:08.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.243+0000 7f4911a0a640 1 -- 172.21.15.165:0/1347633623 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48fc053880 con 0x562f0baeebf0 2024-09-22T08:11:08.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.244+0000 7f4916d23800 1 -- 172.21.15.165:0/1347633623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0baeebf0 msgr2=0x562f0baf10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.244+0000 7f4916d23800 1 --2- 172.21.15.165:0/1347633623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0baeebf0 0x562f0baf10b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00a470 tx=0x7f48fc045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:08.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.244+0000 7f4916d23800 1 -- 172.21.15.165:0/1347633623 shutdown_connections 2024-09-22T08:11:08.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.244+0000 7f4916d23800 1 --2- 172.21.15.165:0/1347633623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0baeebf0 0x562f0baf10b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.244+0000 7f4916d23800 1 -- 172.21.15.165:0/1347633623 >> 172.21.15.165:0/1347633623 conn(0x562f0bae2bb0 msgr2=0x562f0bae5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.244+0000 7f4916d23800 1 -- 172.21.15.165:0/1347633623 shutdown_connections 2024-09-22T08:11:08.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.244+0000 7f4916d23800 1 -- 172.21.15.165:0/1347633623 wait complete. 2024-09-22T08:11:08.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.257+0000 7f4916d23800 1 Processor -- start 2024-09-22T08:11:08.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.257+0000 7f4916d23800 1 -- start start 2024-09-22T08:11:08.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.258+0000 7f4916d23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbda230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.258+0000 7f4916d23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562f0b980dd0 con 0x562f0ba5bd10 2024-09-22T08:11:08.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.258+0000 7f4912a0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbda230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.258+0000 7f4912a0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbda230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52614/0 (socket says 172.21.15.165:52614) 2024-09-22T08:11:08.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.258+0000 7f4912a0c640 1 -- 172.21.15.165:0/2377966723 learned_addr learned my addr 172.21.15.165:0/2377966723 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.258+0000 7f4912a0c640 1 -- 172.21.15.165:0/2377966723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0bbda820 con 0x562f0ba5bd10 2024-09-22T08:11:08.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.258+0000 7f4912a0c640 1 --2- 172.21.15.165:0/2377966723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbda230 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4904001df0 tx=0x7f490400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dae148268d27e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.259+0000 7f4800e09640 1 -- 172.21.15.165:0/2377966723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4904012020 con 0x562f0ba5bd10 2024-09-22T08:11:08.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.259+0000 7f4800e09640 1 -- 172.21.15.165:0/2377966723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490400e470 con 0x562f0ba5bd10 2024-09-22T08:11:08.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.259+0000 7f4800e09640 1 -- 172.21.15.165:0/2377966723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490400e7f0 con 0x562f0ba5bd10 2024-09-22T08:11:08.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.259+0000 7f4916d23800 1 -- 172.21.15.165:0/2377966723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 msgr2=0x562f0bbda230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.259+0000 7f4916d23800 1 --2- 172.21.15.165:0/2377966723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbda230 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4904001df0 tx=0x7f490400b6c0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.259+0000 7f4916d23800 1 -- 172.21.15.165:0/2377966723 shutdown_connections 2024-09-22T08:11:08.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.259+0000 7f4916d23800 1 --2- 172.21.15.165:0/2377966723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbda230 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.259+0000 7f4916d23800 1 -- 172.21.15.165:0/2377966723 >> 172.21.15.165:0/2377966723 conn(0x562f0bae2bb0 msgr2=0x562f0bbd5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.259+0000 7f4916d23800 1 -- 172.21.15.165:0/2377966723 shutdown_connections 2024-09-22T08:11:08.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.259+0000 7f4916d23800 1 -- 172.21.15.165:0/2377966723 wait complete. 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.260+0000 7f4916d23800 1 Processor -- start 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.260+0000 7f4916d23800 1 -- start start 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.260+0000 7f4916d23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbe1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.260+0000 7f4916d23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562f0baf1a60 con 0x562f0ba5bd10 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.260+0000 7f4912a0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbe1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.260+0000 7f4912a0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbe1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52630/0 (socket says 172.21.15.165:52630) 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.260+0000 7f4912a0c640 1 -- 172.21.15.165:0/3414120588 learned_addr learned my addr 172.21.15.165:0/3414120588 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.261+0000 7f4912a0c640 1 -- 172.21.15.165:0/3414120588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0bbe22a0 con 0x562f0ba5bd10 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.261+0000 7f4912a0c640 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbe1d40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x562f0bbdb1c0 tx=0x7f4904000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.261+0000 7f47ff606640 1 -- 172.21.15.165:0/3414120588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4904012030 con 0x562f0ba5bd10 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.261+0000 7f47ff606640 1 -- 172.21.15.165:0/3414120588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490401a6d0 con 0x562f0ba5bd10 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.261+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f0bbe2530 con 0x562f0ba5bd10 2024-09-22T08:11:08.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.261+0000 7f47ff606640 1 -- 172.21.15.165:0/3414120588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490401a9d0 con 0x562f0ba5bd10 2024-09-22T08:11:08.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.261+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0bbe2f30 con 0x562f0ba5bd10 2024-09-22T08:11:08.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.262+0000 7f47ff606640 1 -- 172.21.15.165:0/3414120588 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4904015020 con 0x562f0ba5bd10 2024-09-22T08:11:08.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.262+0000 7f47ff606640 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47f803cfb0 0x7f47f803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.262+0000 7f47ff606640 1 -- 172.21.15.165:0/3414120588 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4904020030 con 0x562f0ba5bd10 2024-09-22T08:11:08.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.262+0000 7f491220b640 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47f803cfb0 0x7f47f803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.262+0000 7f4916d23800 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0baeebf0 0x562f0bbe9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.262+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bbe98d0 con 0x562f0baeebf0 2024-09-22T08:11:08.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.262+0000 7f491320d640 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0baeebf0 0x562f0bbe9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.263+0000 7f491220b640 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47f803cfb0 0x7f47f803f470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f48fc057000 tx=0x7f48fc052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.263+0000 7f491320d640 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0baeebf0 0x562f0bbe9390 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.263+0000 7f491320d640 1 -- 172.21.15.165:0/3414120588 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f490c00a4d0 con 0x562f0baeebf0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.263+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bbe9c70 con 0x562f0baeebf0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.263+0000 7f491320d640 1 -- 172.21.15.165:0/3414120588 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f490c00a4d0 con 0x562f0baeebf0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.263+0000 7f4916d23800 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bbeb7b0 0x562f0bbedc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.263+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bbee3b0 con 0x562f0bbeb7b0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.263+0000 7f4912a0c640 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bbeb7b0 0x562f0bbedc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.264+0000 7f4912a0c640 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bbeb7b0 0x562f0bbedc20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.264+0000 7f4912a0c640 1 -- 172.21.15.165:0/3414120588 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bbeb7b0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.264+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bbea4c0 con 0x562f0baeebf0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.264+0000 7f491320d640 1 -- 172.21.15.165:0/3414120588 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f490c00a4d0 con 0x562f0baeebf0 2024-09-22T08:11:08.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.264+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bbea920 con 0x562f0baeebf0 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.264+0000 7f491320d640 1 -- 172.21.15.165:0/3414120588 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f490c00a4d0 con 0x562f0baeebf0 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.265+0000 7f4916d23800 1 Processor -- start 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.265+0000 7f4916d23800 1 -- start start 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.265+0000 7f4916d23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bbfcd60 0x562f0bbfd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.265+0000 7f4916d23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562f0b9dfd50 con 0x562f0bbfcd60 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.265+0000 7f491320d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bbfcd60 0x562f0bbfd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.265+0000 7f491320d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bbfcd60 0x562f0bbfd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52640/0 (socket says 172.21.15.165:52640) 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.265+0000 7f491320d640 1 -- 172.21.15.165:0/804886245 learned_addr learned my addr 172.21.15.165:0/804886245 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.265+0000 7f491320d640 1 -- 172.21.15.165:0/804886245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0bbfd7c0 con 0x562f0bbfcd60 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.266+0000 7f491320d640 1 --2- 172.21.15.165:0/804886245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bbfcd60 0x562f0bbfd180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x562f0bbe3100 tx=0x7f490c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.266+0000 7f47fce01640 1 -- 172.21.15.165:0/804886245 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490c014450 con 0x562f0bbfcd60 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.266+0000 7f47fce01640 1 -- 172.21.15.165:0/804886245 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490c014610 con 0x562f0bbfcd60 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.266+0000 7f47fce01640 1 -- 172.21.15.165:0/804886245 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490c014930 con 0x562f0bbfcd60 2024-09-22T08:11:08.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.266+0000 7f4916d23800 1 -- 172.21.15.165:0/804886245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f0bbfdff0 con 0x562f0bbfcd60 2024-09-22T08:11:08.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.266+0000 7f4916d23800 1 -- 172.21.15.165:0/804886245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0bbfe590 con 0x562f0bbfcd60 2024-09-22T08:11:08.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.267+0000 7f47fce01640 1 -- 172.21.15.165:0/804886245 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f490c011040 con 0x562f0bbfcd60 2024-09-22T08:11:08.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.267+0000 7f47fce01640 1 --2- 172.21.15.165:0/804886245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47ec03cfb0 0x7f47ec03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.267+0000 7f47fce01640 1 -- 172.21.15.165:0/804886245 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f490c01e070 con 0x562f0bbfcd60 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.267+0000 7f4912a0c640 1 --2- 172.21.15.165:0/804886245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47ec03cfb0 0x7f47ec03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.267+0000 7f4916d23800 1 Processor -- start 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.267+0000 7f4916d23800 1 -- start start 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.267+0000 7f4912a0c640 1 --2- 172.21.15.165:0/804886245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47ec03cfb0 0x7f47ec03f470 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x562f0bbe3e60 tx=0x7f49040011d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.267+0000 7f4916d23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc09c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.267+0000 7f4916d23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562f0bbdac50 con 0x562f0bc09800 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.268+0000 7f491320d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc09c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.268+0000 7f491320d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc09c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52642/0 (socket says 172.21.15.165:52642) 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.268+0000 7f491320d640 1 -- 172.21.15.165:0/1418855901 learned_addr learned my addr 172.21.15.165:0/1418855901 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.268+0000 7f491320d640 1 -- 172.21.15.165:0/1418855901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0bc0a1f0 con 0x562f0bc09800 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.268+0000 7f491320d640 1 --2- 172.21.15.165:0/1418855901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc09c00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f490c016fd0 tx=0x7f490c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0783fbb6b62d570 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.268+0000 7f47f67fc640 1 -- 172.21.15.165:0/1418855901 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490c056070 con 0x562f0bc09800 2024-09-22T08:11:08.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.268+0000 7f47f67fc640 1 -- 172.21.15.165:0/1418855901 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490c0532d0 con 0x562f0bc09800 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.268+0000 7f47f67fc640 1 -- 172.21.15.165:0/1418855901 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490c0167c0 con 0x562f0bc09800 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 -- 172.21.15.165:0/1418855901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 msgr2=0x562f0bc09c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 --2- 172.21.15.165:0/1418855901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc09c00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f490c016fd0 tx=0x7f490c011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 -- 172.21.15.165:0/1418855901 shutdown_connections 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 --2- 172.21.15.165:0/1418855901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc09c00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 -- 172.21.15.165:0/1418855901 >> 172.21.15.165:0/1418855901 conn(0x562f0bc05c00 msgr2=0x562f0bc03e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 -- 172.21.15.165:0/1418855901 shutdown_connections 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 -- 172.21.15.165:0/1418855901 wait complete. 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 Processor -- start 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 -- start start 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc10e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f4916d23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562f0bc0a810 con 0x562f0bc09800 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f491320d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc10e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f491320d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc10e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52650/0 (socket says 172.21.15.165:52650) 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 learned_addr learned my addr 172.21.15.165:0/956494715 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.269+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f0bc113a0 con 0x562f0bc09800 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.270+0000 7f491320d640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc10e40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f490c011fd0 tx=0x7f490c054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.270+0000 7f47f4ff9640 1 -- 172.21.15.165:0/956494715 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490c031020 con 0x562f0bc09800 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.270+0000 7f47f4ff9640 1 -- 172.21.15.165:0/956494715 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490c053480 con 0x562f0bc09800 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.270+0000 7f47f4ff9640 1 -- 172.21.15.165:0/956494715 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490c0168f0 con 0x562f0bc09800 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.270+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f0bc11630 con 0x562f0bc09800 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.270+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0bc11fb0 con 0x562f0bc09800 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.271+0000 7f47f4ff9640 1 -- 172.21.15.165:0/956494715 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f490c034020 con 0x562f0bc09800 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.271+0000 7f47f4ff9640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47dc03cfb0 0x7f47dc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.271+0000 7f47f4ff9640 1 -- 172.21.15.165:0/956494715 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f490c00e040 con 0x562f0bc09800 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.271+0000 7f4912a0c640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47dc03cfb0 0x7f47dc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.271+0000 7f4912a0c640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47dc03cfb0 0x7f47dc03f470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4904022a80 tx=0x7f490404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.271+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.271+0000 7f4916d23800 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0bc1c8d0 0x562f0bc1ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.271+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc1f4e0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f491220b640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0bc1c8d0 0x562f0bc1ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f491220b640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0bc1c8d0 0x562f0bc1ed90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f4916d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f4916d23800 20 realm 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc1f910 con 0x562f0bc1c8d0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f4916d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f4916d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc201e0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.272+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc20580 con 0x562f0bc1c8d0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bc212e0 0x562f0bc236d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc23ce0 con 0x562f0bc212e0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f491320d640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bc212e0 0x562f0bc236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f491320d640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bc212e0 0x562f0bc236d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 20 searching for the correct realm 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562f0bc25c90 0x562f0bc28150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.273+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc25c90 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.274+0000 7f4912a0c640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562f0bc25c90 0x562f0bc28150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.274+0000 7f4912a0c640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562f0bc25c90 0x562f0bc28150 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.274+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.274+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc212e0 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.274+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.274+0000 7f491320d640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f490c036020 0x7f490c02d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.274+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x7f490c036020 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.275+0000 7f491220b640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f490c036020 0x7f490c02d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.275+0000 7f491220b640 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f490c036020 0x7f490c02d480 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.275+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.275+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.275+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.275+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.276+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.276+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x7f490c036020 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.276+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.276+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x7f490c036020 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.276+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.276+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc212e0 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.276+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.276+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc25c90 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.277+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.277+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.277+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.277+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x7f490c036020 2024-09-22T08:11:08.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.277+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.277+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.277+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.277+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc212e0 2024-09-22T08:11:08.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.278+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.278+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc25c90 2024-09-22T08:11:08.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.278+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.278+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc25c90 2024-09-22T08:11:08.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.278+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.278+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x7f490c036020 2024-09-22T08:11:08.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.278+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.278+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc25c90 2024-09-22T08:11:08.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.279+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.279+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc25c90 2024-09-22T08:11:08.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.279+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.279+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.279+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.279+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.279+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.279+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x7f490c036020 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.279+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.279+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc25c90 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.280+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.280+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc212e0 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.280+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.280+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.280+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.280+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x7f490c036020 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.280+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.280+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc25c90 2024-09-22T08:11:08.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.281+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.281+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x7f490c036020 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.281+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.281+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc212e0 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.281+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.281+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc25c90 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x7f490c036020 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc287d0 con 0x562f0bc212e0 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f4916d23800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f4916d23800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f4916d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f4916d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f4916d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f4916d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.282+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc246a0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc24f40 con 0x562f0bc1c8d0 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc28c50 con 0x562f0bc1c8d0 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 20 zone default found 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 4 Realm: () 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 20 zonegroup default 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc29010 con 0x7f490c036020 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.283+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2ae40 con 0x562f0bc25c90 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.284+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.284+0000 7f4916d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.284+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.284+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2b2d0 con 0x562f0bc25c90 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.284+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.284+0000 7f4916d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.284+0000 7f4916d23800 20 started sync module instance, tier type = 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.284+0000 7f4916d23800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.284+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2a2e0 con 0x562f0bc212e0 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.285+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.285+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94760060757712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc29f40 con 0x562f0bc212e0 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.285+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2c200 con 0x562f0bc1c8d0 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.286+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94760060757712] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.286+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.286+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94760060761904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2c200 con 0x562f0bc1c8d0 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.286+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2ccb0 con 0x562f0bc25c90 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.287+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.287+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94760060766096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2d550 con 0x562f0bc25c90 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.287+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2e030 con 0x562f0bc212e0 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.287+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94760060761904] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.288+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.288+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94760060771136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2e420 con 0x562f0bc212e0 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.288+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2ee80 con 0x562f0bc1c8d0 2024-09-22T08:11:08.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.288+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94760060766096] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.289+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.289+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94760060768416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2ee80 con 0x562f0bc1c8d0 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.289+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2f8f0 con 0x7f490c036020 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.289+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94760060771136] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.290+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94760060768416] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.290+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.290+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94760060777440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2f8b0 con 0x7f490c036020 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.290+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc30190 con 0x7f490c036020 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.291+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94760060777440] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.291+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.291+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94760060763472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2f8b0 con 0x7f490c036020 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.292+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc307b0 con 0x7f490c036020 2024-09-22T08:11:08.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.292+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.292+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94760060763472] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94760060781312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc30720 con 0x7f490c036020 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 20 add_watcher() i=0 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 20 add_watcher() i=1 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 20 add_watcher() i=2 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 20 add_watcher() i=3 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 20 add_watcher() i=4 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 20 add_watcher() i=5 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 20 add_watcher() i=6 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94760060781312] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 20 add_watcher() i=7 2024-09-22T08:11:08.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:08.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.293+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc33c90 con 0x562f0bc1c8d0 2024-09-22T08:11:08.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.294+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.294+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94760060779744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc33c90 con 0x562f0bc1c8d0 2024-09-22T08:11:08.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.295+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94760060779744] v32'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.295+0000 7f47c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.295+0000 7f4916d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:08.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.295+0000 7f4916d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:08.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.295+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3c7c0 con 0x562f0bc1c8d0 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.296+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.296+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3ce70 con 0x7f490c036020 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.297+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.297+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3d2b0 con 0x562f0bc25c90 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.298+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.298+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3db00 con 0x562f0bc1c8d0 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.299+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'122 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.299+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3db00 con 0x562f0bc212e0 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.300+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.300+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3dc30 con 0x562f0bc25c90 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.301+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.301+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e130 con 0x562f0bc1c8d0 2024-09-22T08:11:08.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.302+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.302+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e130 con 0x7f490c036020 2024-09-22T08:11:08.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.303+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.304+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e200 con 0x562f0bc212e0 2024-09-22T08:11:08.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.304+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.304+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e290 con 0x562f0bc25c90 2024-09-22T08:11:08.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.305+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.306+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e350 con 0x562f0bc212e0 2024-09-22T08:11:08.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.306+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.306+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e710 con 0x7f490c036020 2024-09-22T08:11:08.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.307+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.307+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e510 con 0x562f0bc212e0 2024-09-22T08:11:08.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.308+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.308+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e510 con 0x7f490c036020 2024-09-22T08:11:08.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.310+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.310+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e510 con 0x562f0bc1c8d0 2024-09-22T08:11:08.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.310+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.311+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc25c90 2024-09-22T08:11:08.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.312+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.312+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc212e0 2024-09-22T08:11:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.312+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.312+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc25c90 2024-09-22T08:11:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.313+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.313+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc1c8d0 2024-09-22T08:11:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.314+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.314+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc1c8d0 2024-09-22T08:11:08.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.315+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.315+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc25c90 2024-09-22T08:11:08.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.316+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.316+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc212e0 2024-09-22T08:11:08.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.317+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.317+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc25c90 2024-09-22T08:11:08.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.318+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.318+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc25c90 2024-09-22T08:11:08.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.319+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.319+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc25c90 2024-09-22T08:11:08.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.320+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.320+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e5f0 con 0x562f0bc25c90 2024-09-22T08:11:08.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.321+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.321+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e5f0 con 0x7f490c036020 2024-09-22T08:11:08.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.322+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.322+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc25c90 2024-09-22T08:11:08.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.323+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.323+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x7f490c036020 2024-09-22T08:11:08.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.324+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.324+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc25c90 2024-09-22T08:11:08.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.325+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.325+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x7f490c036020 2024-09-22T08:11:08.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.326+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.326+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc3e590 con 0x562f0bc212e0 2024-09-22T08:11:08.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.327+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4743fff640 20 reqs_thread_entry: start 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4916d23800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4916d23800 20 Filter name: none 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4741ffb640 20 reqs_thread_entry: start 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4916d23800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4916d23800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc69810 con 0x7f490c036020 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4916d23800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4916d23800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4916d23800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:11:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.328+0000 7f4916d23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:08.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.329+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc6be00 con 0x7f490c036020 2024-09-22T08:11:08.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.329+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.329+0000 7f4916d23800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-22T08:11:08.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.329+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc6bdc0 con 0x7f490c036020 2024-09-22T08:11:08.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f4916d23800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:11:08.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94760061024624 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc6add0 con 0x562f0bc25c90 2024-09-22T08:11:08.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== watch-notify(notify (1) cookie 94760060766096 notify 137438953475 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562f0bc3c3a0 con 0x562f0bc25c90 2024-09-22T08:11:08.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f47f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94760060766096 notifier 4528 bl.length()=170 2024-09-22T08:11:08.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(97 notify.2 [notify cookie 94760061024624 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f47f67fc640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f47d8003d60 con 0x562f0bc25c90 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== watch-notify(notify_complete (2) cookie 94760061024624 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f490404a040 con 0x562f0bc25c90 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f4916d23800 10 removing email index: 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f4916d23800 10 removing user buckets index 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.330+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc6b940 con 0x7f490c036020 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(99 fud.buckets [delete] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f4916d23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94760061024576 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc6a920 con 0x7f490c036020 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== watch-notify(notify (1) cookie 94760060763472 notify 137438953481 ret 0) ==== 202+0+0 (crc 0 0 0) 0x562f0bc3ce70 con 0x7f490c036020 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f47f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94760060763472 notifier 4528 bl.length()=160 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(100 notify.6 [notify cookie 94760061024576 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f47f5ffb640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f47480032c0 con 0x7f490c036020 2024-09-22T08:11:08.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== watch-notify(notify_complete (2) cookie 94760061024576 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562f0bc3c990 con 0x7f490c036020 2024-09-22T08:11:08.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f4916d23800 10 removing user index: fud 2024-09-22T08:11:08.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.332+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc6a8d0 con 0x7f490c036020 2024-09-22T08:11:08.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.333+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(102 fud [call,call,delete] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.333+0000 7f4916d23800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-22T08:11:08.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.333+0000 7f4916d23800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.333+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94760061021488 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc6a8d0 con 0x7f490c036020 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.333+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== watch-notify(notify (1) cookie 94760060777440 notify 137438953482 ret 0) ==== 194+0+0 (crc 0 0 0) 0x562f0bc3c990 con 0x7f490c036020 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.333+0000 7f47f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94760060777440 notifier 4528 bl.length()=152 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.334+0000 7f47f67fc640 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f47d8003d60 con 0x7f490c036020 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.334+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(103 notify.5 [notify cookie 94760061021488 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.334+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.334+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 36 ==== watch-notify(notify_complete (2) cookie 94760061021488 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562f0bc3c780 con 0x7f490c036020 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.335+0000 7f47c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.335+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94760060779744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc6ad30 con 0x562f0bc1c8d0 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.336+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94760060779744] v32'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.336+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94760060757712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc6ad30 con 0x562f0bc212e0 2024-09-22T08:11:08.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.337+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94760060757712] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.337+0000 7f4916d23800 20 remove_watcher() i=0 2024-09-22T08:11:08.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.337+0000 7f4916d23800 2 removed watcher, disabling cache 2024-09-22T08:11:08.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.337+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94760060761904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc6ad30 con 0x562f0bc1c8d0 2024-09-22T08:11:08.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.338+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94760060761904] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.338+0000 7f4916d23800 20 remove_watcher() i=1 2024-09-22T08:11:08.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.338+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94760060766096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2b730 con 0x562f0bc25c90 2024-09-22T08:11:08.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.339+0000 7f4912a0c640 1 -- 172.21.15.165:0/956494715 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94760060766096] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490401ad50 con 0x562f0bc25c90 2024-09-22T08:11:08.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.339+0000 7f4916d23800 20 remove_watcher() i=2 2024-09-22T08:11:08.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.339+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94760060771136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2c790 con 0x562f0bc212e0 2024-09-22T08:11:08.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.340+0000 7f491320d640 1 -- 172.21.15.165:0/956494715 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94760060771136] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02a070 con 0x562f0bc212e0 2024-09-22T08:11:08.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.340+0000 7f4916d23800 20 remove_watcher() i=3 2024-09-22T08:11:08.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.340+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94760060768416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2b730 con 0x562f0bc1c8d0 2024-09-22T08:11:08.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.341+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94760060768416] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x562f0bc1c8d0 2024-09-22T08:11:08.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.341+0000 7f4916d23800 20 remove_watcher() i=4 2024-09-22T08:11:08.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.341+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94760060777440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2db40 con 0x7f490c036020 2024-09-22T08:11:08.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.342+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94760060777440] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.342+0000 7f4916d23800 20 remove_watcher() i=5 2024-09-22T08:11:08.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.342+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94760060763472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2c790 con 0x7f490c036020 2024-09-22T08:11:08.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.343+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94760060763472] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.343+0000 7f4916d23800 20 remove_watcher() i=6 2024-09-22T08:11:08.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.343+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94760060781312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f0bc2b730 con 0x7f490c036020 2024-09-22T08:11:08.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 <== osd.0 v2:172.21.15.53:6800/2902972477 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94760060781312] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc051070 con 0x7f490c036020 2024-09-22T08:11:08.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 20 remove_watcher() i=7 2024-09-22T08:11:08.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f490c036020 msgr2=0x7f490c02d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f490c036020 0x7f490c02d480 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0bc1c8d0 msgr2=0x562f0bc1ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0bc1c8d0 0x562f0bc1ed90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bc212e0 msgr2=0x562f0bc236d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bc212e0 0x562f0bc236d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562f0bc25c90 msgr2=0x562f0bc28150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562f0bc25c90 0x562f0bc28150 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47dc03cfb0 msgr2=0x7f47dc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47dc03cfb0 0x7f47dc03f470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4904022a80 tx=0x7f490404f000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 msgr2=0x562f0bc10e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f491220b640 1 -- 172.21.15.165:0/956494715 reap_dead start 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc10e40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f490c011fd0 tx=0x7f490c054720 comp rx=0 tx=0).stop 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 shutdown_connections 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 --2- 172.21.15.165:0/956494715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bc09800 0x562f0bc10e40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 >> 172.21.15.165:0/956494715 conn(0x562f0bc05c00 msgr2=0x562f0bc03e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 shutdown_connections 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/956494715 wait complete. 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/804886245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47ec03cfb0 msgr2=0x7f47ec03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 --2- 172.21.15.165:0/804886245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47ec03cfb0 0x7f47ec03f470 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x562f0bbe3e60 tx=0x7f49040011d0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 -- 172.21.15.165:0/804886245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bbfcd60 msgr2=0x562f0bbfd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.344+0000 7f4916d23800 1 --2- 172.21.15.165:0/804886245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bbfcd60 0x562f0bbfd180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x562f0bbe3100 tx=0x7f490c018830 comp rx=0 tx=0).stop 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/804886245 shutdown_connections 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 --2- 172.21.15.165:0/804886245 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47ec03cfb0 0x7f47ec03f470 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 --2- 172.21.15.165:0/804886245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0bbfcd60 0x562f0bbfd180 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/804886245 >> 172.21.15.165:0/804886245 conn(0x562f0bbf1110 msgr2=0x562f0bbf14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/804886245 shutdown_connections 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/804886245 wait complete. 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0baeebf0 msgr2=0x562f0bbe9390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0baeebf0 0x562f0bbe9390 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bbeb7b0 msgr2=0x562f0bbedc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bbeb7b0 0x562f0bbedc20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47f803cfb0 msgr2=0x7f47f803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47f803cfb0 0x7f47f803f470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f48fc057000 tx=0x7f48fc052000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 msgr2=0x562f0bbe1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbe1d40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x562f0bbdb1c0 tx=0x7f4904000bc0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 shutdown_connections 2024-09-22T08:11:08.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562f0bbeb7b0 0x562f0bbedc20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x562f0baeebf0 0x562f0bbe9390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f47f803cfb0 0x7f47f803f470 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 --2- 172.21.15.165:0/3414120588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f0ba5bd10 0x562f0bbe1d40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 >> 172.21.15.165:0/3414120588 conn(0x562f0bae2bb0 msgr2=0x562f0bbdb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 shutdown_connections 2024-09-22T08:11:08.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.345+0000 7f4916d23800 1 -- 172.21.15.165:0/3414120588 wait complete. 2024-09-22T08:11:08.355 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-22T08:11:08.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-22T08:11:08.355 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-22T08:11:08.409 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:08.410 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:08.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.409+0000 7fb296a40800 1 Processor -- start 2024-09-22T08:11:08.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.409+0000 7fb296a40800 1 -- start start 2024-09-22T08:11:08.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.410+0000 7fb296a40800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c1427840f0 0x55c1427864e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.410+0000 7fb296a40800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c14260ea20 con 0x55c142786a20 2024-09-22T08:11:08.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.410+0000 7fb296a40800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c14260e7d0 con 0x55c1427840f0 2024-09-22T08:11:08.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.410+0000 7fb29452a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c1427840f0 0x55c1427864e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.410+0000 7fb293d29640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55c142786a20 0x55c142788e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33778/0 (socket says 172.21.15.165:33778) 2024-09-22T08:11:08.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.410+0000 7fb29452a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c1427840f0 0x55c1427864e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52662/0 (socket says 172.21.15.165:52662) 2024-09-22T08:11:08.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.410+0000 7fb293d29640 1 -- 172.21.15.165:0/925547025 learned_addr learned my addr 172.21.15.165:0/925547025 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:08.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.410+0000 7fb29452a640 1 -- 172.21.15.165:0/925547025 >> v1:172.21.15.53:6789/0 conn(0x55c142786a20 legacy=0x55c142788e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.410+0000 7fb29452a640 1 -- 172.21.15.165:0/925547025 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14278b5d0 con 0x55c1427840f0 2024-09-22T08:11:08.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.412+0000 7fb29452a640 1 --2- 172.21.15.165:0/925547025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c1427864e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb284005fd0 tx=0x7fb284045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17bc3a6e2ea77e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.412+0000 7fb293528640 1 -- 172.21.15.165:0/925547025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb284058530 con 0x55c1427840f0 2024-09-22T08:11:08.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.412+0000 7fb293528640 1 -- 172.21.15.165:0/925547025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2840586d0 con 0x55c1427840f0 2024-09-22T08:11:08.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.412+0000 7fb293528640 1 -- 172.21.15.165:0/925547025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2840589d0 con 0x55c1427840f0 2024-09-22T08:11:08.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.413+0000 7fb296a40800 1 -- 172.21.15.165:0/925547025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 msgr2=0x55c1427864e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.413+0000 7fb296a40800 1 --2- 172.21.15.165:0/925547025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c1427864e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb284005fd0 tx=0x7fb284045c30 comp rx=0 tx=0).stop 2024-09-22T08:11:08.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.413+0000 7fb296a40800 1 -- 172.21.15.165:0/925547025 shutdown_connections 2024-09-22T08:11:08.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.413+0000 7fb296a40800 1 --2- 172.21.15.165:0/925547025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c1427864e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.413+0000 7fb296a40800 1 -- 172.21.15.165:0/925547025 >> 172.21.15.165:0/925547025 conn(0x55c14277dc30 msgr2=0x55c142780070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.413+0000 7fb296a40800 1 -- 172.21.15.165:0/925547025 shutdown_connections 2024-09-22T08:11:08.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.413+0000 7fb296a40800 1 -- 172.21.15.165:0/925547025 wait complete. 2024-09-22T08:11:08.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.426+0000 7fb296a40800 1 Processor -- start 2024-09-22T08:11:08.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.426+0000 7fb296a40800 1 -- start start 2024-09-22T08:11:08.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.426+0000 7fb296a40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c142783880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.427+0000 7fb296a40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c14261bdd0 con 0x55c1427840f0 2024-09-22T08:11:08.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.427+0000 7fb29452a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c142783880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.427+0000 7fb29452a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c142783880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52672/0 (socket says 172.21.15.165:52672) 2024-09-22T08:11:08.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.427+0000 7fb29452a640 1 -- 172.21.15.165:0/3645782229 learned_addr learned my addr 172.21.15.165:0/3645782229 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.427+0000 7fb29452a640 1 -- 172.21.15.165:0/3645782229 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c142783e70 con 0x55c1427840f0 2024-09-22T08:11:08.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.427+0000 7fb29452a640 1 --2- 172.21.15.165:0/3645782229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c142783880 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb284025a60 tx=0x7fb284051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1d6194bd6edb35 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.427+0000 7fb18260c640 1 -- 172.21.15.165:0/3645782229 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2840589b0 con 0x55c1427840f0 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.427+0000 7fb18260c640 1 -- 172.21.15.165:0/3645782229 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb284068070 con 0x55c1427840f0 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.427+0000 7fb18260c640 1 -- 172.21.15.165:0/3645782229 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb284058c80 con 0x55c1427840f0 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.428+0000 7fb296a40800 1 -- 172.21.15.165:0/3645782229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 msgr2=0x55c142783880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.428+0000 7fb296a40800 1 --2- 172.21.15.165:0/3645782229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c142783880 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb284025a60 tx=0x7fb284051000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.428+0000 7fb296a40800 1 -- 172.21.15.165:0/3645782229 shutdown_connections 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.428+0000 7fb296a40800 1 --2- 172.21.15.165:0/3645782229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c142783880 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.428+0000 7fb296a40800 1 -- 172.21.15.165:0/3645782229 >> 172.21.15.165:0/3645782229 conn(0x55c14277dc30 msgr2=0x55c14286eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.428+0000 7fb296a40800 1 -- 172.21.15.165:0/3645782229 shutdown_connections 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.428+0000 7fb296a40800 1 -- 172.21.15.165:0/3645782229 wait complete. 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.428+0000 7fb296a40800 1 Processor -- start 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.429+0000 7fb296a40800 1 -- start start 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.429+0000 7fb296a40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c14287ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.429+0000 7fb296a40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c14278a8c0 con 0x55c1427840f0 2024-09-22T08:11:08.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.429+0000 7fb29452a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c14287ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.429+0000 7fb29452a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c14287ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52674/0 (socket says 172.21.15.165:52674) 2024-09-22T08:11:08.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.429+0000 7fb29452a640 1 -- 172.21.15.165:0/2615628430 learned_addr learned my addr 172.21.15.165:0/2615628430 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.429+0000 7fb29452a640 1 -- 172.21.15.165:0/2615628430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14287d210 con 0x55c1427840f0 2024-09-22T08:11:08.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.429+0000 7fb29452a640 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c14287ccb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb284025a60 tx=0x7fb284003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.430+0000 7fb180e09640 1 -- 172.21.15.165:0/2615628430 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2840635f0 con 0x55c1427840f0 2024-09-22T08:11:08.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.430+0000 7fb180e09640 1 -- 172.21.15.165:0/2615628430 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb284063790 con 0x55c1427840f0 2024-09-22T08:11:08.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.430+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c14287d4a0 con 0x55c1427840f0 2024-09-22T08:11:08.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.430+0000 7fb180e09640 1 -- 172.21.15.165:0/2615628430 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb284063a90 con 0x55c1427840f0 2024-09-22T08:11:08.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.430+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14287de50 con 0x55c1427840f0 2024-09-22T08:11:08.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.430+0000 7fb180e09640 1 -- 172.21.15.165:0/2615628430 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb284075020 con 0x55c1427840f0 2024-09-22T08:11:08.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.431+0000 7fb180e09640 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb17c03cfb0 0x7fb17c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.431+0000 7fb180e09640 1 -- 172.21.15.165:0/2615628430 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb284098900 con 0x55c1427840f0 2024-09-22T08:11:08.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.431+0000 7fb293d29640 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb17c03cfb0 0x7fb17c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.431+0000 7fb296a40800 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c142786a20 0x55c1428842b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.431+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428847f0 con 0x55c142786a20 2024-09-22T08:11:08.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.431+0000 7fb294d2b640 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c142786a20 0x55c1428842b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.431+0000 7fb293d29640 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb17c03cfb0 0x7fb17c03f470 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb27c001d70 tx=0x7fb27c0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.431+0000 7fb294d2b640 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c142786a20 0x55c1428842b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.432+0000 7fb294d2b640 1 -- 172.21.15.165:0/2615628430 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb28c0083e0 con 0x55c142786a20 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.432+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c142884b90 con 0x55c142786a20 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.432+0000 7fb294d2b640 1 -- 172.21.15.165:0/2615628430 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb28c0083e0 con 0x55c142786a20 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.432+0000 7fb296a40800 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c142886650 0x55c142888af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.432+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c142889280 con 0x55c142886650 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.432+0000 7fb29452a640 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c142886650 0x55c142888af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.432+0000 7fb29452a640 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c142886650 0x55c142888af0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.433+0000 7fb29452a640 1 -- 172.21.15.165:0/2615628430 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb28406dd50 con 0x55c142886650 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.433+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428853e0 con 0x55c142786a20 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.433+0000 7fb294d2b640 1 -- 172.21.15.165:0/2615628430 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb28c0083e0 con 0x55c142786a20 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.433+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428857c0 con 0x55c142786a20 2024-09-22T08:11:08.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.433+0000 7fb294d2b640 1 -- 172.21.15.165:0/2615628430 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb28c0083e0 con 0x55c142786a20 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.433+0000 7fb296a40800 1 Processor -- start 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.433+0000 7fb296a40800 1 -- start start 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.434+0000 7fb296a40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c142897c60 0x55c142898080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.434+0000 7fb296a40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c14267ad50 con 0x55c142897c60 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.434+0000 7fb294d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c142897c60 0x55c142898080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.434+0000 7fb294d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c142897c60 0x55c142898080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52684/0 (socket says 172.21.15.165:52684) 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.434+0000 7fb294d2b640 1 -- 172.21.15.165:0/699699462 learned_addr learned my addr 172.21.15.165:0/699699462 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.434+0000 7fb294d2b640 1 -- 172.21.15.165:0/699699462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1428986c0 con 0x55c142897c60 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.434+0000 7fb294d2b640 1 --2- 172.21.15.165:0/699699462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c142897c60 0x55c142898080 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x55c14287eb50 tx=0x7fb28c00af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.435+0000 7fb179ffb640 1 -- 172.21.15.165:0/699699462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c007d60 con 0x55c142897c60 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.435+0000 7fb179ffb640 1 -- 172.21.15.165:0/699699462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28c01e020 con 0x55c142897c60 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.435+0000 7fb296a40800 1 -- 172.21.15.165:0/699699462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c142898ef0 con 0x55c142897c60 2024-09-22T08:11:08.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.435+0000 7fb179ffb640 1 -- 172.21.15.165:0/699699462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c019590 con 0x55c142897c60 2024-09-22T08:11:08.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.435+0000 7fb296a40800 1 -- 172.21.15.165:0/699699462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c142899490 con 0x55c142897c60 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb179ffb640 1 -- 172.21.15.165:0/699699462 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb28c016040 con 0x55c142897c60 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb179ffb640 1 --2- 172.21.15.165:0/699699462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16c03d000 0x7fb16c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb179ffb640 1 -- 172.21.15.165:0/699699462 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb28c01f030 con 0x55c142897c60 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb29452a640 1 --2- 172.21.15.165:0/699699462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16c03d000 0x7fb16c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb296a40800 1 Processor -- start 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb296a40800 1 -- start start 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb29452a640 1 --2- 172.21.15.165:0/699699462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16c03d000 0x7fb16c03f4c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55c14287ed30 tx=0x7fb28406cd70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb296a40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb296a40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c142782210 con 0x55c1428a4720 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb294d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb294d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52686/0 (socket says 172.21.15.165:52686) 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.436+0000 7fb294d2b640 1 -- 172.21.15.165:0/241683974 learned_addr learned my addr 172.21.15.165:0/241683974 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb294d2b640 1 -- 172.21.15.165:0/241683974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1428a5110 con 0x55c1428a4720 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb294d2b640 1 --2- 172.21.15.165:0/241683974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428a4b20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb28c054590 tx=0x7fb28c016f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3be36cacb0e633 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb1737fe640 1 -- 172.21.15.165:0/241683974 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c01d070 con 0x55c1428a4720 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb1737fe640 1 -- 172.21.15.165:0/241683974 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28c04dbc0 con 0x55c1428a4720 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb1737fe640 1 -- 172.21.15.165:0/241683974 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c045130 con 0x55c1428a4720 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb296a40800 1 -- 172.21.15.165:0/241683974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 msgr2=0x55c1428a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb296a40800 1 --2- 172.21.15.165:0/241683974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428a4b20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb28c054590 tx=0x7fb28c016f80 comp rx=0 tx=0).stop 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb296a40800 1 -- 172.21.15.165:0/241683974 shutdown_connections 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb296a40800 1 --2- 172.21.15.165:0/241683974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428a4b20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb296a40800 1 -- 172.21.15.165:0/241683974 >> 172.21.15.165:0/241683974 conn(0x55c1428a0b20 msgr2=0x55c14289ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.437+0000 7fb296a40800 1 -- 172.21.15.165:0/241683974 shutdown_connections 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.438+0000 7fb296a40800 1 -- 172.21.15.165:0/241683974 wait complete. 2024-09-22T08:11:08.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.438+0000 7fb296a40800 1 Processor -- start 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.438+0000 7fb296a40800 1 -- start start 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.438+0000 7fb296a40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.438+0000 7fb296a40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c1428a5730 con 0x55c1428a4720 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.438+0000 7fb294d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.438+0000 7fb294d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52694/0 (socket says 172.21.15.165:52694) 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.438+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 learned_addr learned my addr 172.21.15.165:0/3146431891 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.438+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1428ac280 con 0x55c1428a4720 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.439+0000 7fb294d2b640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428abd20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb28c016fc0 tx=0x7fb28c054520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.439+0000 7fb171ffb640 1 -- 172.21.15.165:0/3146431891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c044070 con 0x55c1428a4720 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.439+0000 7fb171ffb640 1 -- 172.21.15.165:0/3146431891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28c031070 con 0x55c1428a4720 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.439+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c1428ac510 con 0x55c1428a4720 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.439+0000 7fb171ffb640 1 -- 172.21.15.165:0/3146431891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb28c014340 con 0x55c1428a4720 2024-09-22T08:11:08.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.439+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1428ace90 con 0x55c1428a4720 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.439+0000 7fb171ffb640 1 -- 172.21.15.165:0/3146431891 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb28c0144e0 con 0x55c1428a4720 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.440+0000 7fb171ffb640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16403cfb0 0x7fb16403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.440+0000 7fb171ffb640 1 -- 172.21.15.165:0/3146431891 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb28c004280 con 0x55c1428a4720 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.440+0000 7fb29452a640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16403cfb0 0x7fb16403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.440+0000 7fb29452a640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16403cfb0 0x7fb16403f470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb284059fd0 tx=0x7fb28408a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.440+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.440+0000 7fb296a40800 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c1428b7610 0x55c1428b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.440+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ba220 con 0x55c1428b7610 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.440+0000 7fb293d29640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c1428b7610 0x55c1428b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb293d29640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c1428b7610 0x55c1428b9ad0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb27c009050 con 0x55c1428b7610 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb296a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb296a40800 20 realm 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428b6960 con 0x55c1428b7610 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb27c009050 con 0x55c1428b7610 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb296a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb296a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428bad10 con 0x55c1428b7610 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.441+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb27c009050 con 0x55c1428b7610 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428bb5e0 con 0x55c1428b7610 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb27c009050 con 0x55c1428b7610 2024-09-22T08:11:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c1428bc000 0x55c1428be3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428beb30 con 0x55c1428bc000 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb294d2b640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c1428bc000 0x55c1428be3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb294d2b640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c1428bc000 0x55c1428be3f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb28c0083e0 con 0x55c1428bc000 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 20 searching for the correct realm 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55c1428c0ae0 0x55c1428c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.442+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428c0ae0 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.443+0000 7fb29452a640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55c1428c0ae0 0x55c1428c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.443+0000 7fb29452a640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55c1428c0ae0 0x55c1428c2fa0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.443+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.443+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428bc000 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.443+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb28c0083e0 con 0x55c1428bc000 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.443+0000 7fb294d2b640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb28c019040 0x7fb28c015600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.443+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x7fb28c019040 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.444+0000 7fb293d29640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb28c019040 0x7fb28c015600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.444+0000 7fb293d29640 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb28c019040 0x7fb28c015600 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.444+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c009050 con 0x7fb28c019040 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.444+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428b7610 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.444+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c009050 con 0x55c1428b7610 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.444+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428b7610 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.445+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.445+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x7fb28c019040 2024-09-22T08:11:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.445+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.445+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x7fb28c019040 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.445+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.445+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428bc000 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.445+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c0083e0 con 0x55c1428bc000 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.445+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428c0ae0 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.446+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.446+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428b7610 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.446+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.446+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x7fb28c019040 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.446+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.446+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428b7610 2024-09-22T08:11:08.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.446+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.446+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428bc000 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.447+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb28c0083e0 con 0x55c1428bc000 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.447+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428c0ae0 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.447+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.447+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428c0ae0 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.447+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.447+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x7fb28c019040 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.447+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.447+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428c0ae0 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.448+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.448+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428c0ae0 2024-09-22T08:11:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.448+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.448+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428b7610 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.448+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.448+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428b7610 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.448+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.448+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x7fb28c019040 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.449+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.449+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428c0ae0 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.449+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.449+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428bc000 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.449+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c0083e0 con 0x55c1428bc000 2024-09-22T08:11:08.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.449+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428b7610 2024-09-22T08:11:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.449+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.449+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x7fb28c019040 2024-09-22T08:11:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.450+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.450+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428c0ae0 2024-09-22T08:11:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.450+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.450+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x7fb28c019040 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.450+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.450+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428bc000 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.450+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c068040 con 0x55c1428bc000 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.450+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428c0ae0 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x7fb28c019040 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428b7610 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3620 con 0x55c1428bc000 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb28c068040 con 0x55c1428bc000 2024-09-22T08:11:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb296a40800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb296a40800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb296a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb296a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb296a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb296a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.451+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428bf4f0 con 0x55c1428b7610 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428bfd90 con 0x55c1428b7610 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3aa0 con 0x55c1428b7610 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 20 zone default found 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 4 Realm: () 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 20 zonegroup default 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c3e40 con 0x7fb28c019040 2024-09-22T08:11:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.452+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c5c50 con 0x55c1428c0ae0 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.453+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.453+0000 7fb296a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.453+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.453+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c60c0 con 0x55c1428c0ae0 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.453+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.453+0000 7fb296a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.453+0000 7fb296a40800 20 started sync module instance, tier type = 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.453+0000 7fb296a40800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:08.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.453+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c50f0 con 0x55c1428bc000 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.454+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28c068040 con 0x55c1428bc000 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.454+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94288533542384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c50f0 con 0x55c1428bc000 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.454+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c6c00 con 0x55c1428b7610 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.455+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.455+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94288533546704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c6c00 con 0x55c1428b7610 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.455+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c7ba0 con 0x55c1428c0ae0 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.455+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94288533542384] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28c068040 con 0x55c1428bc000 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.456+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94288533546704] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.456+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.456+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94288533550832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c6ff0 con 0x55c1428c0ae0 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.456+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c8560 con 0x55c1428bc000 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.457+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94288533550832] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.457+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28c068040 con 0x55c1428bc000 2024-09-22T08:11:08.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.457+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94288533553328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c8980 con 0x55c1428bc000 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.457+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c9340 con 0x55c1428b7610 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.458+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94288533553328] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28c068040 con 0x55c1428bc000 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.458+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.458+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94288533557360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c8980 con 0x55c1428b7610 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.458+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c9d90 con 0x7fb28c019040 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.459+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94288533557360] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.459+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.459+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94288533559456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428c8980 con 0x7fb28c019040 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.459+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ca7a0 con 0x7fb28c019040 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.460+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94288533559456] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.460+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.460+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94288533554864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ca7a0 con 0x7fb28c019040 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.460+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428cb160 con 0x7fb28c019040 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.461+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.461+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94288533554864] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.461+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94288533564592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428cb0d0 con 0x7fb28c019040 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.461+0000 7fb296a40800 20 add_watcher() i=0 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.461+0000 7fb296a40800 20 add_watcher() i=1 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.461+0000 7fb296a40800 20 add_watcher() i=2 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.461+0000 7fb296a40800 20 add_watcher() i=3 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.461+0000 7fb296a40800 20 add_watcher() i=4 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.461+0000 7fb296a40800 20 add_watcher() i=5 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.461+0000 7fb296a40800 20 add_watcher() i=6 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.462+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94288533564592] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.462+0000 7fb296a40800 20 add_watcher() i=7 2024-09-22T08:11:08.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.462+0000 7fb296a40800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.462+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ce680 con 0x55c1428b7610 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.463+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.463+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94288533562096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428cba10 con 0x55c1428b7610 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94288533562096] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb14afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb296a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb296a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb296a40800 5 note: GC not initialized 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb149fe3640 20 reqs_thread_entry: start 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb296a40800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb296a40800 20 Filter name: none 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb142ffd640 20 reqs_thread_entry: start 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb296a40800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-22T08:11:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.464+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c142901c30 con 0x7fb28c019040 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1429000c0 con 0x7fb28c019040 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:11:08.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.465+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c142900940 con 0x7fb28c019040 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb296a40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb296a40800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb296a40800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94288533783696 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1429056d0 con 0x55c1428bc000 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== watch-notify(notify (1) cookie 94288533553328 notify 137438953484 ret 0) ==== 652+0+0 (crc 0 0 0) 0x55c1428ac510 con 0x55c1428bc000 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb1737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94288533553328 notifier 4535 bl.length()=610 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb1737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb1737fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 notify.3 [notify cookie 94288533783696 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb28c068040 con 0x55c1428bc000 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.466+0000 7fb1737fe640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb158003ea0 con 0x55c1428bc000 2024-09-22T08:11:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.467+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28c068040 con 0x55c1428bc000 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.467+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== watch-notify(notify_complete (2) cookie 94288533783696 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c1428ac280 con 0x55c1428bc000 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.467+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c142900440 con 0x7fb28c019040 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb296a40800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb296a40800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb296a40800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94288533783616 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c1429056d0 con 0x55c1428c0ae0 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== watch-notify(notify (1) cookie 94288533550832 notify 137438953476 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55c14287de50 con 0x55c1428c0ae0 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb1737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94288533550832 notifier 4535 bl.length()=192 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb1737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb1737fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb1737fe640 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb158003ea0 con 0x55c1428c0ae0 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(68 notify.2 [notify cookie 94288533783616 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.468+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== watch-notify(notify_complete (2) cookie 94288533783616 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c14287d4a0 con 0x55c1428c0ae0 2024-09-22T08:11:08.482 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-22T08:11:08.466232Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:08.466221Z","tags":[],"group_ids":[]} 2024-09-22T08:11:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.469+0000 7fb14afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.469+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94288533562096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ff790 con 0x55c1428b7610 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.470+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94288533562096] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.470+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94288533542384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ff790 con 0x55c1428bc000 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.471+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94288533542384] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28c068040 con 0x55c1428bc000 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.471+0000 7fb296a40800 20 remove_watcher() i=0 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.471+0000 7fb296a40800 2 removed watcher, disabling cache 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.471+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94288533546704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ff790 con 0x55c1428b7610 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.472+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94288533546704] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.472+0000 7fb296a40800 20 remove_watcher() i=1 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.472+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94288533550832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ff790 con 0x55c1428c0ae0 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.473+0000 7fb29452a640 1 -- 172.21.15.165:0/3146431891 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94288533550832] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb284087030 con 0x55c1428c0ae0 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.473+0000 7fb296a40800 20 remove_watcher() i=2 2024-09-22T08:11:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.473+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94288533553328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ff790 con 0x55c1428bc000 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.474+0000 7fb294d2b640 1 -- 172.21.15.165:0/3146431891 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94288533553328] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb28c068040 con 0x55c1428bc000 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.474+0000 7fb296a40800 20 remove_watcher() i=3 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.474+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94288533557360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ff790 con 0x55c1428b7610 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.475+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94288533557360] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x55c1428b7610 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.475+0000 7fb296a40800 20 remove_watcher() i=4 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.475+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94288533559456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ff790 con 0x7fb28c019040 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.476+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94288533559456] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.476+0000 7fb296a40800 20 remove_watcher() i=5 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.476+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94288533554864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ff790 con 0x7fb28c019040 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.477+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94288533554864] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.477+0000 7fb296a40800 20 remove_watcher() i=6 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.477+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94288533564592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c1428ff790 con 0x7fb28c019040 2024-09-22T08:11:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94288533564592] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb27c029040 con 0x7fb28c019040 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 20 remove_watcher() i=7 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb28c019040 msgr2=0x7fb28c015600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb28c019040 0x7fb28c015600 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c1428b7610 msgr2=0x55c1428b9ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c1428b7610 0x55c1428b9ad0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c1428bc000 msgr2=0x55c1428be3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c1428bc000 0x55c1428be3f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55c1428c0ae0 msgr2=0x55c1428c2fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55c1428c0ae0 0x55c1428c2fa0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16403cfb0 msgr2=0x7fb16403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16403cfb0 0x7fb16403f470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb284059fd0 tx=0x7fb28408a000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 msgr2=0x55c1428abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb293d29640 1 -- 172.21.15.165:0/3146431891 reap_dead start 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.478+0000 7fb296a40800 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428abd20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb28c016fc0 tx=0x7fb28c054520 comp rx=0 tx=0).stop 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 shutdown_connections 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 --2- 172.21.15.165:0/3146431891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1428a4720 0x55c1428abd20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 >> 172.21.15.165:0/3146431891 conn(0x55c1428a0b20 msgr2=0x55c14289ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 shutdown_connections 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/3146431891 wait complete. 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/699699462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16c03d000 msgr2=0x7fb16c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 --2- 172.21.15.165:0/699699462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16c03d000 0x7fb16c03f4c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55c14287ed30 tx=0x7fb28406cd70 comp rx=0 tx=0).stop 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/699699462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c142897c60 msgr2=0x55c142898080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 --2- 172.21.15.165:0/699699462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c142897c60 0x55c142898080 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x55c14287eb50 tx=0x7fb28c00af20 comp rx=0 tx=0).stop 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/699699462 shutdown_connections 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 --2- 172.21.15.165:0/699699462 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb16c03d000 0x7fb16c03f4c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 --2- 172.21.15.165:0/699699462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c142897c60 0x55c142898080 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/699699462 >> 172.21.15.165:0/699699462 conn(0x55c14288c010 msgr2=0x55c14288c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/699699462 shutdown_connections 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/699699462 wait complete. 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c142786a20 msgr2=0x55c1428842b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c142786a20 0x55c1428842b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c142886650 msgr2=0x55c142888af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c142886650 0x55c142888af0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb17c03cfb0 msgr2=0x7fb17c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb17c03cfb0 0x7fb17c03f470 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb27c001d70 tx=0x7fb27c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 msgr2=0x55c14287ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.479+0000 7fb296a40800 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c14287ccb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb284025a60 tx=0x7fb284003330 comp rx=0 tx=0).stop 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.480+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 shutdown_connections 2024-09-22T08:11:08.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.480+0000 7fb296a40800 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55c142886650 0x55c142888af0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.480+0000 7fb296a40800 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55c142786a20 0x55c1428842b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.480+0000 7fb296a40800 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb17c03cfb0 0x7fb17c03f470 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.480+0000 7fb296a40800 1 --2- 172.21.15.165:0/2615628430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1427840f0 0x55c14287ccb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.480+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 >> 172.21.15.165:0/2615628430 conn(0x55c14277dc30 msgr2=0x55c14286e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.480+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 shutdown_connections 2024-09-22T08:11:08.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.480+0000 7fb296a40800 1 -- 172.21.15.165:0/2615628430 wait complete. 2024-09-22T08:11:08.493 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-22T08:11:08.466232Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:08.466221Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:08.493 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-22T08:11:08.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-22T08:11:08.493 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-22T08:11:08.542 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:08.542 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:08.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.542+0000 7f54b6f0c800 1 Processor -- start 2024-09-22T08:11:08.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.542+0000 7f54b6f0c800 1 -- start start 2024-09-22T08:11:08.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.542+0000 7f54b6f0c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bede78fbb0 0x55bede791fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.542+0000 7f54b6f0c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bede616a20 con 0x55bede78c0a0 2024-09-22T08:11:08.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.542+0000 7f54b6f0c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55bede6167d0 con 0x55bede78fbb0 2024-09-22T08:11:08.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.542+0000 7f54b41f5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bede78fbb0 0x55bede791fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.542+0000 7f54b49f6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55bede78c0a0 0x55bede78e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33782/0 (socket says 172.21.15.165:33782) 2024-09-22T08:11:08.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.542+0000 7f54b49f6640 1 -- 172.21.15.165:0/3745774399 learned_addr learned my addr 172.21.15.165:0/3745774399 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:08.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.542+0000 7f54b41f5640 1 --2- 172.21.15.165:0/3745774399 >> v2:172.21.15.53:3300/0 conn(0x55bede78fbb0 0x55bede791fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52710/0 (socket says 172.21.15.165:52710) 2024-09-22T08:11:08.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.543+0000 7f54b41f5640 1 -- 172.21.15.165:0/3745774399 >> v1:172.21.15.53:6789/0 conn(0x55bede78c0a0 legacy=0x55bede78e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.543+0000 7f54b41f5640 1 -- 172.21.15.165:0/3745774399 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede793580 con 0x55bede78fbb0 2024-09-22T08:11:08.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.544+0000 7f54b41f5640 1 --2- 172.21.15.165:0/3745774399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78fbb0 0x55bede791fa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f54a800a470 tx=0x7f54a8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4c0a87cb605cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.544+0000 7f54b39f4640 1 -- 172.21.15.165:0/3745774399 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a8053570 con 0x55bede78fbb0 2024-09-22T08:11:08.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.545+0000 7f54b39f4640 1 -- 172.21.15.165:0/3745774399 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a8058070 con 0x55bede78fbb0 2024-09-22T08:11:08.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.545+0000 7f54b39f4640 1 -- 172.21.15.165:0/3745774399 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a8053880 con 0x55bede78fbb0 2024-09-22T08:11:08.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.545+0000 7f54b6f0c800 1 -- 172.21.15.165:0/3745774399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78fbb0 msgr2=0x55bede791fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.545+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/3745774399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78fbb0 0x55bede791fa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f54a800a470 tx=0x7f54a8045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:08.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.545+0000 7f54b6f0c800 1 -- 172.21.15.165:0/3745774399 shutdown_connections 2024-09-22T08:11:08.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.545+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/3745774399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78fbb0 0x55bede791fa0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.545+0000 7f54b6f0c800 1 -- 172.21.15.165:0/3745774399 >> 172.21.15.165:0/3745774399 conn(0x55bede785c00 msgr2=0x55bede788040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.545+0000 7f54b6f0c800 1 -- 172.21.15.165:0/3745774399 shutdown_connections 2024-09-22T08:11:08.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.545+0000 7f54b6f0c800 1 -- 172.21.15.165:0/3745774399 wait complete. 2024-09-22T08:11:08.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.559+0000 7f54b6f0c800 1 Processor -- start 2024-09-22T08:11:08.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.559+0000 7f54b6f0c800 1 -- start start 2024-09-22T08:11:08.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.559+0000 7f54b6f0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede87b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.559+0000 7f54b6f0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bede623dd0 con 0x55bede78c0a0 2024-09-22T08:11:08.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.559+0000 7f54b49f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede87b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.559+0000 7f54b49f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede87b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52718/0 (socket says 172.21.15.165:52718) 2024-09-22T08:11:08.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.559+0000 7f54b49f6640 1 -- 172.21.15.165:0/3348008791 learned_addr learned my addr 172.21.15.165:0/3348008791 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.560+0000 7f54b49f6640 1 -- 172.21.15.165:0/3348008791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede87b610 con 0x55bede78c0a0 2024-09-22T08:11:08.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.560+0000 7f54b49f6640 1 --2- 172.21.15.165:0/3348008791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede87b020 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f54a4001e40 tx=0x7f54a4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d094041588e39527 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.560+0000 7f53a2e0d640 1 -- 172.21.15.165:0/3348008791 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a4012020 con 0x55bede78c0a0 2024-09-22T08:11:08.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.560+0000 7f53a2e0d640 1 -- 172.21.15.165:0/3348008791 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a400e5a0 con 0x55bede78c0a0 2024-09-22T08:11:08.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.560+0000 7f53a2e0d640 1 -- 172.21.15.165:0/3348008791 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a400e8a0 con 0x55bede78c0a0 2024-09-22T08:11:08.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 -- 172.21.15.165:0/3348008791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 msgr2=0x55bede87b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/3348008791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede87b020 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f54a4001e40 tx=0x7f54a4001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:08.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 -- 172.21.15.165:0/3348008791 shutdown_connections 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/3348008791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede87b020 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 -- 172.21.15.165:0/3348008791 >> 172.21.15.165:0/3348008791 conn(0x55bede785c00 msgr2=0x55bede8769a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 -- 172.21.15.165:0/3348008791 shutdown_connections 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 -- 172.21.15.165:0/3348008791 wait complete. 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 Processor -- start 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 -- start start 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede78b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b6f0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bede792870 con 0x55bede78c0a0 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b49f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede78b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b49f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede78b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52734/0 (socket says 172.21.15.165:52734) 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.561+0000 7f54b49f6640 1 -- 172.21.15.165:0/1467495792 learned_addr learned my addr 172.21.15.165:0/1467495792 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.562+0000 7f54b49f6640 1 -- 172.21.15.165:0/1467495792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede78bd20 con 0x55bede78c0a0 2024-09-22T08:11:08.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.562+0000 7f54b49f6640 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede78b7c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f54a400c010 tx=0x7f54a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.562+0000 7f53a160a640 1 -- 172.21.15.165:0/1467495792 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a4012030 con 0x55bede78c0a0 2024-09-22T08:11:08.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.562+0000 7f53a160a640 1 -- 172.21.15.165:0/1467495792 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a40014a0 con 0x55bede78c0a0 2024-09-22T08:11:08.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.562+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bede78a0d0 con 0x55bede78c0a0 2024-09-22T08:11:08.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.562+0000 7f53a160a640 1 -- 172.21.15.165:0/1467495792 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54a401a7a0 con 0x55bede78c0a0 2024-09-22T08:11:08.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.562+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bede78a690 con 0x55bede78c0a0 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.563+0000 7f53a160a640 1 -- 172.21.15.165:0/1467495792 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f54a4015020 con 0x55bede78c0a0 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.563+0000 7f53a160a640 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f539c03cfb0 0x7f539c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.563+0000 7f53a160a640 1 -- 172.21.15.165:0/1467495792 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f54a4020030 con 0x55bede78c0a0 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.563+0000 7f54b41f5640 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f539c03cfb0 0x7f539c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.563+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede78fbb0 0x55bede88c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.563+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede88c5a0 con 0x55bede78fbb0 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.563+0000 7f54b51f7640 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede78fbb0 0x55bede88c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.564+0000 7f54b41f5640 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f539c03cfb0 0x7f539c03f470 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f54a8057000 tx=0x7f54a8052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.564+0000 7f54b51f7640 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede78fbb0 0x55bede88c060 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.564+0000 7f54b51f7640 1 -- 172.21.15.165:0/1467495792 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54ac00a4d0 con 0x55bede78fbb0 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.564+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede78ab90 con 0x55bede78fbb0 2024-09-22T08:11:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.564+0000 7f54b51f7640 1 -- 172.21.15.165:0/1467495792 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54ac00a4d0 con 0x55bede78fbb0 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.564+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede88e8d0 0x55bede890cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.564+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede891390 con 0x55bede88e8d0 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.564+0000 7f54b49f6640 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede88e8d0 0x55bede890cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.565+0000 7f54b49f6640 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede88e8d0 0x55bede890cc0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.565+0000 7f54b49f6640 1 -- 172.21.15.165:0/1467495792 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54a40189b0 con 0x55bede88e8d0 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.565+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede88d770 con 0x55bede78fbb0 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.565+0000 7f54b51f7640 1 -- 172.21.15.165:0/1467495792 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54ac00a4d0 con 0x55bede78fbb0 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.565+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede88dc40 con 0x55bede78fbb0 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.566+0000 7f54b51f7640 1 -- 172.21.15.165:0/1467495792 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f54ac00a4d0 con 0x55bede78fbb0 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.566+0000 7f54b6f0c800 1 Processor -- start 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.566+0000 7f54b6f0c800 1 -- start start 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.566+0000 7f54b6f0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede89fd10 0x55bede8a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.566+0000 7f54b6f0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bede682d50 con 0x55bede89fd10 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.566+0000 7f54b51f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede89fd10 0x55bede8a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.566+0000 7f54b51f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede89fd10 0x55bede8a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52748/0 (socket says 172.21.15.165:52748) 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.566+0000 7f54b51f7640 1 -- 172.21.15.165:0/4192508340 learned_addr learned my addr 172.21.15.165:0/4192508340 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.567+0000 7f54b51f7640 1 -- 172.21.15.165:0/4192508340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede8a0770 con 0x55bede89fd10 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.567+0000 7f54b51f7640 1 --2- 172.21.15.165:0/4192508340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede89fd10 0x55bede8a0130 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00a2a0 tx=0x7f54ac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.567+0000 7f539a7fc640 1 -- 172.21.15.165:0/4192508340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ac014450 con 0x55bede89fd10 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.567+0000 7f539a7fc640 1 -- 172.21.15.165:0/4192508340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ac0145f0 con 0x55bede89fd10 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.567+0000 7f54b6f0c800 1 -- 172.21.15.165:0/4192508340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bede8a0fa0 con 0x55bede89fd10 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.567+0000 7f539a7fc640 1 -- 172.21.15.165:0/4192508340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ac014910 con 0x55bede89fd10 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.567+0000 7f54b6f0c800 1 -- 172.21.15.165:0/4192508340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bede8a1540 con 0x55bede89fd10 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.568+0000 7f539a7fc640 1 -- 172.21.15.165:0/4192508340 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f54ac011040 con 0x55bede89fd10 2024-09-22T08:11:08.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.568+0000 7f539a7fc640 1 --2- 172.21.15.165:0/4192508340 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538c03d000 0x7f538c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.568+0000 7f539a7fc640 1 -- 172.21.15.165:0/4192508340 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f54ac01e070 con 0x55bede89fd10 2024-09-22T08:11:08.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.568+0000 7f54b49f6640 1 --2- 172.21.15.165:0/4192508340 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538c03d000 0x7f538c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.568+0000 7f54b6f0c800 1 Processor -- start 2024-09-22T08:11:08.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.568+0000 7f54b6f0c800 1 -- start start 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.568+0000 7f54b49f6640 1 --2- 172.21.15.165:0/4192508340 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538c03d000 0x7f538c03f4c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55bede88ca20 tx=0x7f54a402c9d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.568+0000 7f54b6f0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.568+0000 7f54b6f0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bede87ba40 con 0x55bede8ac750 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.569+0000 7f54b51f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.569+0000 7f54b51f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52762/0 (socket says 172.21.15.165:52762) 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.569+0000 7f54b51f7640 1 -- 172.21.15.165:0/1580703930 learned_addr learned my addr 172.21.15.165:0/1580703930 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.569+0000 7f54b51f7640 1 -- 172.21.15.165:0/1580703930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede8ad140 con 0x55bede8ac750 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.569+0000 7f54b51f7640 1 --2- 172.21.15.165:0/1580703930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8acb50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f54ac016fd0 tx=0x7f54ac011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce2841f2319709c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.569+0000 7f538bfff640 1 -- 172.21.15.165:0/1580703930 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ac051020 con 0x55bede8ac750 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.569+0000 7f538bfff640 1 -- 172.21.15.165:0/1580703930 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ac016440 con 0x55bede8ac750 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.569+0000 7f538bfff640 1 -- 172.21.15.165:0/1580703930 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ac028070 con 0x55bede8ac750 2024-09-22T08:11:08.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1580703930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 msgr2=0x55bede8acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1580703930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8acb50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f54ac016fd0 tx=0x7f54ac011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1580703930 shutdown_connections 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1580703930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8acb50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1580703930 >> 172.21.15.165:0/1580703930 conn(0x55bede8a8b50 msgr2=0x55bede8a6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1580703930 shutdown_connections 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1580703930 wait complete. 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 Processor -- start 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 -- start start 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b6f0c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bede8ad760 con 0x55bede8ac750 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b51f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b51f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52776/0 (socket says 172.21.15.165:52776) 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.570+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 learned_addr learned my addr 172.21.15.165:0/2908459956 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.571+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bede8b4290 con 0x55bede8ac750 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.571+0000 7f54b51f7640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8b3d30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f54ac016fd0 tx=0x7f54ac054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.571+0000 7f538a7fc640 1 -- 172.21.15.165:0/2908459956 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ac045e20 con 0x55bede8ac750 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.571+0000 7f538a7fc640 1 -- 172.21.15.165:0/2908459956 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ac032070 con 0x55bede8ac750 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.571+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bede8b4520 con 0x55bede8ac750 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.571+0000 7f538a7fc640 1 -- 172.21.15.165:0/2908459956 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ac054a00 con 0x55bede8ac750 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.571+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bede8b4ea0 con 0x55bede8ac750 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.572+0000 7f538a7fc640 1 -- 172.21.15.165:0/2908459956 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f54ac054c30 con 0x55bede8ac750 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.572+0000 7f538a7fc640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538003cfb0 0x7f538003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.572+0000 7f538a7fc640 1 -- 172.21.15.165:0/2908459956 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f54ac00e040 con 0x55bede8ac750 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.572+0000 7f54b49f6640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538003cfb0 0x7f538003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.572+0000 7f54b49f6640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538003cfb0 0x7f538003f470 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54a401a6a0 tx=0x7f54a404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.573+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.573+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede8bf850 0x55bede8c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.573+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8c2460 con 0x55bede8bf850 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.573+0000 7f54b41f5640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede8bf850 0x55bede8c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.573+0000 7f54b41f5640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede8bf850 0x55bede8c1d10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.573+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.573+0000 7f54b6f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.573+0000 7f54b6f0c800 20 realm 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.573+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.573+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8c2890 con 0x55bede8bf850 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8c3160 con 0x55bede8bf850 2024-09-22T08:11:08.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8c3500 con 0x55bede8bf850 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede8c4260 0x55bede8c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8c6c60 con 0x55bede8c4260 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b51f7640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede8c4260 0x55bede8c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.574+0000 7f54b51f7640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede8c4260 0x55bede8c6650 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.575+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.575+0000 7f54b6f0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:08.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.575+0000 7f54b6f0c800 20 searching for the correct realm 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.575+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55bede8c8c10 0x55bede8cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.575+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c8c10 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.575+0000 7f54b49f6640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55bede8c8c10 0x55bede8cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.575+0000 7f54b49f6640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55bede8c8c10 0x55bede8cb0d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.575+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.575+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c4260 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.576+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.576+0000 7f54b51f7640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f54ac014070 0x7f54ac037460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.576+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x7f54ac014070 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.576+0000 7f54b41f5640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f54ac014070 0x7f54ac037460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.576+0000 7f54b41f5640 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f54ac014070 0x7f54ac037460 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.576+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.577+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8bf850 2024-09-22T08:11:08.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.577+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.577+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8bf850 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.577+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.577+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x7f54ac014070 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.577+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.577+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x7f54ac014070 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.577+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.577+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c4260 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.578+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.578+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c8c10 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.578+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.578+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8bf850 2024-09-22T08:11:08.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.578+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.578+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x7f54ac014070 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.578+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.578+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8bf850 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.579+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.579+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c4260 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.579+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.579+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c8c10 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.579+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.579+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c8c10 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.579+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.579+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x7f54ac014070 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.579+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.579+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c8c10 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.580+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.580+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c8c10 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.580+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.580+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8bf850 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.580+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.580+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8bf850 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.580+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.580+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x7f54ac014070 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.581+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.581+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c8c10 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.581+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.581+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c4260 2024-09-22T08:11:08.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.581+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.581+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8bf850 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.581+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.581+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x7f54ac014070 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.581+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.581+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c8c10 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.582+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.582+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x7f54ac014070 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.582+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.582+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c4260 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.582+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.582+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c8c10 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.582+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.582+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x7f54ac014070 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8bf850 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cb750 con 0x55bede8c4260 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8c7620 con 0x55bede8bf850 2024-09-22T08:11:08.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8c7ec0 con 0x55bede8bf850 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.583+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8c7260 con 0x55bede8bf850 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 20 zone default found 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 4 Realm: () 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:08.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 20 zonegroup default 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cc080 con 0x7f54ac014070 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cddd0 con 0x55bede8c8c10 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.584+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8ce260 con 0x55bede8c8c10 2024-09-22T08:11:08.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.585+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.585+0000 7f54b6f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.585+0000 7f54b6f0c800 20 started sync module instance, tier type = 2024-09-22T08:11:08.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.585+0000 7f54b6f0c800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:08.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.585+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8ccba0 con 0x55bede8c4260 2024-09-22T08:11:08.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.586+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.586+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94278265917600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8ccba0 con 0x55bede8c4260 2024-09-22T08:11:08.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.586+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8ced60 con 0x55bede8bf850 2024-09-22T08:11:08.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.587+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94278265917600] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.587+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.587+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94278265923632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8ccba0 con 0x55bede8bf850 2024-09-22T08:11:08.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.587+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cf810 con 0x55bede8c8c10 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.588+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94278265923632] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.588+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.588+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94278265915120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8ccb10 con 0x55bede8c8c10 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.588+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d06d0 con 0x55bede8c4260 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.589+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94278265915120] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.589+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.589+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94278265930272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d0640 con 0x55bede8c4260 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.589+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d1590 con 0x55bede8bf850 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.590+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.590+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94278265934048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d1500 con 0x55bede8bf850 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.590+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d24d0 con 0x7f54ac014070 2024-09-22T08:11:08.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.590+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94278265930272] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.591+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94278265934048] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.591+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.591+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94278265937824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d2490 con 0x7f54ac014070 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.591+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d2d70 con 0x7f54ac014070 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.592+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94278265937824] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.592+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.592+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94278265932480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d2490 con 0x7f54ac014070 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.592+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d3340 con 0x7f54ac014070 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.593+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94278265932480] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.593+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.593+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94278265940080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d3340 con 0x7f54ac014070 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.593+0000 7f54b6f0c800 20 add_watcher() i=0 2024-09-22T08:11:08.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.593+0000 7f54b6f0c800 20 add_watcher() i=1 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.593+0000 7f54b6f0c800 20 add_watcher() i=2 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.593+0000 7f54b6f0c800 20 add_watcher() i=3 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.593+0000 7f54b6f0c800 20 add_watcher() i=4 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.593+0000 7f54b6f0c800 20 add_watcher() i=5 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.593+0000 7f54b6f0c800 20 add_watcher() i=6 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.594+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94278265940080] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.594+0000 7f54b6f0c800 20 add_watcher() i=7 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.594+0000 7f54b6f0c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.594+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d6830 con 0x55bede8bf850 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.595+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.595+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94278265942576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d3bc0 con 0x55bede8bf850 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.595+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94278265942576] v32'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f536afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f54b6f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f54b6f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f54b6f0c800 5 note: GC not initialized 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f5369fe3640 20 reqs_thread_entry: start 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f54b6f0c800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f54b6f0c800 20 Filter name: none 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f52db7fe640 20 reqs_thread_entry: start 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f54b6f0c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.596+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede909c90 con 0x7f54ac014070 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-22T08:11:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede909620 con 0x55bede8c4260 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 : miss 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.597+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede90d4c0 con 0x7f54ac014070 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.598+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(64 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.598+0000 7f54b6f0c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.598+0000 7f54b6f0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.598+0000 7f54b6f0c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.598+0000 7f54b6f0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.598+0000 7f54b6f0c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.598+0000 7f54b6f0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.598+0000 7f54b6f0c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.598+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede911a80 con 0x55bede8c4260 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.599+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.599+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 8.8 8:131dd858:root::.bucket.meta.testx%3amyfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede915390 con 0x55bede8bf850 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.600+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [create,call,writefull 0~420,setxattr (203)] v32'3 uv3 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.600+0000 7f54b6f0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x7 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.600+0000 7f54b6f0c800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.600+0000 7f54b6f0c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:11:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.600+0000 7f54b6f0c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1, ofs0, ns] 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.600+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94278266204608 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede914dc0 con 0x7f54ac014070 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== watch-notify(notify (1) cookie 94278265937824 notify 137438953483 ret 0) ==== 897+0+0 (crc 0 0 0) 0x55bede915730 con 0x7f54ac014070 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f538bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94278265937824 notifier 4542 bl.length()=855 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f538bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x7 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(67 notify.5 [notify cookie 94278266204608 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f538bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f538bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f538bfff640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5378003ea0 con 0x7f54ac014070 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== watch-notify(notify_complete (2) cookie 94278266204608 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bede911580 con 0x7f54ac014070 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f54b6f0c800 20 handle_bi_update(): bucket=testx:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_sources= new_sources= 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f54b6f0c800 20 handle_bi_update(): bucket=testx:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential sources added=[] removed=[] 2024-09-22T08:11:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f54b6f0c800 20 handle_bi_update(): bucket=testx:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_dests= new_dests= 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f54b6f0c800 20 handle_bi_update(): bucket=testx:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential dests added=[] removed=[] 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.601+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede914f40 con 0x55bede8bf850 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.602+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.602+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede914f40 con 0x55bede8bf850 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f54b6f0c800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f54b6f0c800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f54b6f0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94278266210960 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede914eb0 con 0x55bede8bf850 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify (1) cookie 94278265934048 notify 137438953489 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55bede9152e0 con 0x55bede8bf850 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f538bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94278265934048 notifier 4542 bl.length()=348 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f538bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f538bfff640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-22T08:11:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f538bfff640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5378003ea0 con 0x55bede8bf850 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.603+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(71 notify.4 [notify cookie 94278266210960 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.604+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.604+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== watch-notify(notify_complete (2) cookie 94278266210960 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bede9141d0 con 0x55bede8bf850 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.604+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede914f40 con 0x55bede8c4260 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.605+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(73 myfoo [call,delete] v32'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.605+0000 7f54b6f0c800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.605+0000 7f54b6f0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.605+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94278266210960 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede914eb0 con 0x7f54ac014070 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.605+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== watch-notify(notify (1) cookie 94278265932480 notify 137438953484 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55bede9141d0 con 0x7f54ac014070 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.605+0000 7f538b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94278265932480 notifier 4542 bl.length()=149 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.605+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(74 notify.6 [notify cookie 94278266210960 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.605+0000 7f538b7fe640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f52e80032c0 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.606+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== watch-notify(notify_complete (2) cookie 94278266210960 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bede911580 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.606+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.606+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede914ec0 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.607+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(76 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.607+0000 7f54b6f0c800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 from cache 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.607+0000 7f54b6f0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1, ofs0, ns] 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.607+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94278266182496 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bede914ec0 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.607+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== watch-notify(notify (1) cookie 94278265932480 notify 137438953485 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55bede911580 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.607+0000 7f538bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94278265932480 notifier 4542 bl.length()=206 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.607+0000 7f538bfff640 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5378003ea0 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.607+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(77 notify.6 [notify cookie 94278266182496 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.607+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.607+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== watch-notify(notify_complete (2) cookie 94278266182496 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bede90d8b0 con 0x7f54ac014070 2024-09-22T08:11:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.608+0000 7f536afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.608+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94278265942576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede907840 con 0x55bede8bf850 2024-09-22T08:11:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.609+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94278265942576] v32'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.609+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94278265917600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede907840 con 0x55bede8c4260 2024-09-22T08:11:08.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.610+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94278265917600] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.610+0000 7f54b6f0c800 20 remove_watcher() i=0 2024-09-22T08:11:08.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.610+0000 7f54b6f0c800 2 removed watcher, disabling cache 2024-09-22T08:11:08.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.610+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94278265923632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede907840 con 0x55bede8bf850 2024-09-22T08:11:08.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.611+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94278265923632] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.611+0000 7f54b6f0c800 20 remove_watcher() i=1 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.611+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94278265915120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede907840 con 0x55bede8c8c10 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.612+0000 7f54b49f6640 1 -- 172.21.15.165:0/2908459956 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94278265915120] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a4034070 con 0x55bede8c8c10 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.612+0000 7f54b6f0c800 20 remove_watcher() i=2 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.612+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94278265930272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cd0a0 con 0x55bede8c4260 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.613+0000 7f54b51f7640 1 -- 172.21.15.165:0/2908459956 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94278265930272] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ac02a070 con 0x55bede8c4260 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.613+0000 7f54b6f0c800 20 remove_watcher() i=3 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.613+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94278265934048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8ce830 con 0x55bede8bf850 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.614+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94278265934048] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x55bede8bf850 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.614+0000 7f54b6f0c800 20 remove_watcher() i=4 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.614+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94278265937824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cc6f0 con 0x7f54ac014070 2024-09-22T08:11:08.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.615+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94278265937824] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.615+0000 7f54b6f0c800 20 remove_watcher() i=5 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.615+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94278265932480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8d0220 con 0x7f54ac014070 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.616+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94278265932480] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.616+0000 7f54b6f0c800 20 remove_watcher() i=6 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.616+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94278265940080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bede8cd0a0 con 0x7f54ac014070 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94278265940080] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a8051070 con 0x7f54ac014070 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 20 remove_watcher() i=7 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f54ac014070 msgr2=0x7f54ac037460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f54ac014070 0x7f54ac037460 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede8bf850 msgr2=0x55bede8c1d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede8bf850 0x55bede8c1d10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede8c4260 msgr2=0x55bede8c6650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede8c4260 0x55bede8c6650 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55bede8c8c10 msgr2=0x55bede8cb0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55bede8c8c10 0x55bede8cb0d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538003cfb0 msgr2=0x7f538003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538003cfb0 0x7f538003f470 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54a401a6a0 tx=0x7f54a404e000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 msgr2=0x55bede8b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b41f5640 1 -- 172.21.15.165:0/2908459956 reap_dead start 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8b3d30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f54ac016fd0 tx=0x7f54ac054720 comp rx=0 tx=0).stop 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 shutdown_connections 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/2908459956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede8ac750 0x55bede8b3d30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.617+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 >> 172.21.15.165:0/2908459956 conn(0x55bede8a8b50 msgr2=0x55bede8a6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 shutdown_connections 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/2908459956 wait complete. 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/4192508340 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538c03d000 msgr2=0x7f538c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/4192508340 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538c03d000 0x7f538c03f4c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55bede88ca20 tx=0x7f54a402c9d0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/4192508340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede89fd10 msgr2=0x55bede8a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/4192508340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede89fd10 0x55bede8a0130 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00a2a0 tx=0x7f54ac018830 comp rx=0 tx=0).stop 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/4192508340 shutdown_connections 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/4192508340 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f538c03d000 0x7f538c03f4c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/4192508340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede89fd10 0x55bede8a0130 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/4192508340 >> 172.21.15.165:0/4192508340 conn(0x55bede8940c0 msgr2=0x55bede8944a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/4192508340 shutdown_connections 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/4192508340 wait complete. 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede78fbb0 msgr2=0x55bede88c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede78fbb0 0x55bede88c060 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede88e8d0 msgr2=0x55bede890cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede88e8d0 0x55bede890cc0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f539c03cfb0 msgr2=0x7f539c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f539c03cfb0 0x7f539c03f470 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f54a8057000 tx=0x7f54a8052000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 msgr2=0x55bede78b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede78b7c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f54a400c010 tx=0x7f54a4000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 shutdown_connections 2024-09-22T08:11:08.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55bede88e8d0 0x55bede890cc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55bede78fbb0 0x55bede88c060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f539c03cfb0 0x7f539c03f470 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 --2- 172.21.15.165:0/1467495792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bede78c0a0 0x55bede78b7c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 >> 172.21.15.165:0/1467495792 conn(0x55bede785c00 msgr2=0x55bede87c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 shutdown_connections 2024-09-22T08:11:08.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.618+0000 7f54b6f0c800 1 -- 172.21.15.165:0/1467495792 wait complete. 2024-09-22T08:11:08.631 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-22T08:11:08.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-22T08:11:08.631 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-22T08:11:08.674 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:08.674 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:08.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.674+0000 7f8ac5d33800 1 Processor -- start 2024-09-22T08:11:08.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.675+0000 7f8ac5d33800 1 -- start start 2024-09-22T08:11:08.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.675+0000 7f8ac5d33800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5583a3ea5c20 0x5583a3ea6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.675+0000 7f8ac5d33800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583a3d32a20 con 0x5583a3eaa890 2024-09-22T08:11:08.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.675+0000 7f8ac5d33800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5583a3d327d0 con 0x5583a3ea5c20 2024-09-22T08:11:08.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.675+0000 7f8ac1999640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5583a3ea5c20 0x5583a3ea6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.675+0000 7f8ab9198640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5583a3eaa890 0x5583a3eaccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33794/0 (socket says 172.21.15.165:33794) 2024-09-22T08:11:08.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.675+0000 7f8ac1999640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5583a3ea5c20 0x5583a3ea6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52788/0 (socket says 172.21.15.165:52788) 2024-09-22T08:11:08.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.675+0000 7f8ab9198640 1 -- 172.21.15.165:0/1910034174 learned_addr learned my addr 172.21.15.165:0/1910034174 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:08.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.675+0000 7f8ac1999640 1 -- 172.21.15.165:0/1910034174 >> v1:172.21.15.53:6789/0 conn(0x5583a3eaa890 legacy=0x5583a3eaccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.675+0000 7f8ac1999640 1 -- 172.21.15.165:0/1910034174 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a3eaf580 con 0x5583a3ea5c20 2024-09-22T08:11:08.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.677+0000 7f8ac1999640 1 --2- 172.21.15.165:0/1910034174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3ea6020 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400a470 tx=0x7f8ab4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207bedbbce7a4f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.677+0000 7f8ac1198640 1 -- 172.21.15.165:0/1910034174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ab4053570 con 0x5583a3ea5c20 2024-09-22T08:11:08.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.677+0000 7f8ac1198640 1 -- 172.21.15.165:0/1910034174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab4058070 con 0x5583a3ea5c20 2024-09-22T08:11:08.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.677+0000 7f8ac1198640 1 -- 172.21.15.165:0/1910034174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ab4053880 con 0x5583a3ea5c20 2024-09-22T08:11:08.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.678+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1910034174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 msgr2=0x5583a3ea6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.678+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/1910034174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3ea6020 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400a470 tx=0x7f8ab4045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:08.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.678+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1910034174 shutdown_connections 2024-09-22T08:11:08.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.678+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/1910034174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3ea6020 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.678+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1910034174 >> 172.21.15.165:0/1910034174 conn(0x5583a3ea1310 msgr2=0x5583a3ea3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.678+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1910034174 shutdown_connections 2024-09-22T08:11:08.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.678+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1910034174 wait complete. 2024-09-22T08:11:08.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.691+0000 7f8ac5d33800 1 Processor -- start 2024-09-22T08:11:08.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.692+0000 7f8ac5d33800 1 -- start start 2024-09-22T08:11:08.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.692+0000 7f8ac5d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3ea7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.692+0000 7f8ac5d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5583a3d3fdd0 con 0x5583a3ea5c20 2024-09-22T08:11:08.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.692+0000 7f8ac1999640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3ea7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.692+0000 7f8ac1999640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3ea7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52790/0 (socket says 172.21.15.165:52790) 2024-09-22T08:11:08.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.692+0000 7f8ac1999640 1 -- 172.21.15.165:0/4016480866 learned_addr learned my addr 172.21.15.165:0/4016480866 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.692+0000 7f8ac1999640 1 -- 172.21.15.165:0/4016480866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a3ea85e0 con 0x5583a3ea5c20 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f8ac1999640 1 --2- 172.21.15.165:0/4016480866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3ea7ff0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4025c20 tx=0x7f8ab4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9c4a945d595791 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f89afe07640 1 -- 172.21.15.165:0/4016480866 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ab4053a20 con 0x5583a3ea5c20 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f89afe07640 1 -- 172.21.15.165:0/4016480866 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab4063070 con 0x5583a3ea5c20 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f89afe07640 1 -- 172.21.15.165:0/4016480866 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ab4053cf0 con 0x5583a3ea5c20 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f8ac5d33800 1 -- 172.21.15.165:0/4016480866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 msgr2=0x5583a3ea7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/4016480866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3ea7ff0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4025c20 tx=0x7f8ab4051000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f8ac5d33800 1 -- 172.21.15.165:0/4016480866 shutdown_connections 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/4016480866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3ea7ff0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f8ac5d33800 1 -- 172.21.15.165:0/4016480866 >> 172.21.15.165:0/4016480866 conn(0x5583a3ea1310 msgr2=0x5583a3f92a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f8ac5d33800 1 -- 172.21.15.165:0/4016480866 shutdown_connections 2024-09-22T08:11:08.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.693+0000 7f8ac5d33800 1 -- 172.21.15.165:0/4016480866 wait complete. 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.694+0000 7f8ac5d33800 1 Processor -- start 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.694+0000 7f8ac5d33800 1 -- start start 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.694+0000 7f8ac5d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3fa0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.694+0000 7f8ac5d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5583a3eae820 con 0x5583a3ea5c20 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.694+0000 7f8ac1999640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3fa0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.694+0000 7f8ac1999640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3fa0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52792/0 (socket says 172.21.15.165:52792) 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.694+0000 7f8ac1999640 1 -- 172.21.15.165:0/3290927503 learned_addr learned my addr 172.21.15.165:0/3290927503 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.694+0000 7f8ac1999640 1 -- 172.21.15.165:0/3290927503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a3fa1200 con 0x5583a3ea5c20 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.695+0000 7f8ac1999640 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3fa0ca0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4025c20 tx=0x7f8ab4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.695+0000 7f89ae604640 1 -- 172.21.15.165:0/3290927503 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ab406c030 con 0x5583a3ea5c20 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.695+0000 7f89ae604640 1 -- 172.21.15.165:0/3290927503 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab4068660 con 0x5583a3ea5c20 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.695+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583a3fa1490 con 0x5583a3ea5c20 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.695+0000 7f89ae604640 1 -- 172.21.15.165:0/3290927503 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ab4068940 con 0x5583a3ea5c20 2024-09-22T08:11:08.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.695+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a3fa1e90 con 0x5583a3ea5c20 2024-09-22T08:11:08.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.696+0000 7f89ae604640 1 -- 172.21.15.165:0/3290927503 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8ab4068ae0 con 0x5583a3ea5c20 2024-09-22T08:11:08.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.696+0000 7f89ae604640 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f89a803cfb0 0x7f89a803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.696+0000 7f89ae604640 1 -- 172.21.15.165:0/3290927503 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8ab4098b30 con 0x5583a3ea5c20 2024-09-22T08:11:08.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.696+0000 7f8ab9198640 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f89a803cfb0 0x7f89a803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.696+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3eaa890 0x5583a3fa82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.696+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fa8830 con 0x5583a3eaa890 2024-09-22T08:11:08.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.696+0000 7f8ac219a640 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3eaa890 0x5583a3fa82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.696+0000 7f8ab9198640 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f89a803cfb0 0x7f89a803f470 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8aac001d70 tx=0x7f8aac0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.697+0000 7f8ac219a640 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3eaa890 0x5583a3fa82f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.697+0000 7f8ac219a640 1 -- 172.21.15.165:0/3290927503 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8abc00a4d0 con 0x5583a3eaa890 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.697+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fa8bd0 con 0x5583a3eaa890 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.697+0000 7f8ac219a640 1 -- 172.21.15.165:0/3290927503 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8abc00a4d0 con 0x5583a3eaa890 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.697+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3faa6d0 0x5583a3facb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.697+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fad2e0 con 0x5583a3faa6d0 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.697+0000 7f8ac1999640 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3faa6d0 0x5583a3facb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.697+0000 7f8ac1999640 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3faa6d0 0x5583a3facb50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.698+0000 7f8ac1999640 1 -- 172.21.15.165:0/3290927503 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ab4051070 con 0x5583a3faa6d0 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.698+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fa9420 con 0x5583a3eaa890 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.698+0000 7f8ac219a640 1 -- 172.21.15.165:0/3290927503 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8abc00a4d0 con 0x5583a3eaa890 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.698+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fa9870 con 0x5583a3eaa890 2024-09-22T08:11:08.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.698+0000 7f8ac219a640 1 -- 172.21.15.165:0/3290927503 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8abc00a4d0 con 0x5583a3eaa890 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.699+0000 7f8ac5d33800 1 Processor -- start 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.699+0000 7f8ac5d33800 1 -- start start 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.699+0000 7f8ac5d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fbbc60 0x5583a3fbc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.699+0000 7f8ac5d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5583a3d9ed50 con 0x5583a3fbbc60 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.699+0000 7f8ac219a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fbbc60 0x5583a3fbc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.699+0000 7f8ac219a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fbbc60 0x5583a3fbc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52804/0 (socket says 172.21.15.165:52804) 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.699+0000 7f8ac219a640 1 -- 172.21.15.165:0/1827167910 learned_addr learned my addr 172.21.15.165:0/1827167910 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.699+0000 7f8ac219a640 1 -- 172.21.15.165:0/1827167910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a3fbc6c0 con 0x5583a3fbbc60 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.699+0000 7f8ac219a640 1 --2- 172.21.15.165:0/1827167910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fbbc60 0x5583a3fbc080 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00a2a0 tx=0x7f8abc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.700+0000 7f89a77fe640 1 -- 172.21.15.165:0/1827167910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc014450 con 0x5583a3fbbc60 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.700+0000 7f89a77fe640 1 -- 172.21.15.165:0/1827167910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc0145f0 con 0x5583a3fbbc60 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.700+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1827167910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583a3fbcef0 con 0x5583a3fbbc60 2024-09-22T08:11:08.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.700+0000 7f89a77fe640 1 -- 172.21.15.165:0/1827167910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc014910 con 0x5583a3fbbc60 2024-09-22T08:11:08.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.700+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1827167910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a3fbd490 con 0x5583a3fbbc60 2024-09-22T08:11:08.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.700+0000 7f89a77fe640 1 -- 172.21.15.165:0/1827167910 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8abc011040 con 0x5583a3fbbc60 2024-09-22T08:11:08.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f89a77fe640 1 --2- 172.21.15.165:0/1827167910 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f899c03cfb0 0x7f899c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f89a77fe640 1 -- 172.21.15.165:0/1827167910 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8abc01e070 con 0x5583a3fbbc60 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f8ac1999640 1 --2- 172.21.15.165:0/1827167910 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f899c03cfb0 0x7f899c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f8ac5d33800 1 Processor -- start 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f8ac5d33800 1 -- start start 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f8ac1999640 1 --2- 172.21.15.165:0/1827167910 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f899c03cfb0 0x7f899c03f470 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5583a3fa2d90 tx=0x7f8ab407b9a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f8ac5d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fc8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f8ac5d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5583a3ea6a30 con 0x5583a3fc8700 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f8ac219a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fc8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f8ac219a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fc8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52818/0 (socket says 172.21.15.165:52818) 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.701+0000 7f8ac219a640 1 -- 172.21.15.165:0/1779758929 learned_addr learned my addr 172.21.15.165:0/1779758929 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f8ac219a640 1 -- 172.21.15.165:0/1779758929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a3fc90f0 con 0x5583a3fc8700 2024-09-22T08:11:08.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f8ac219a640 1 --2- 172.21.15.165:0/1779758929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fc8b00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8abc016fd0 tx=0x7f8abc011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405f7069f21dc39f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f89a57fa640 1 -- 172.21.15.165:0/1779758929 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc04b070 con 0x5583a3fc8700 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f89a57fa640 1 -- 172.21.15.165:0/1779758929 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc051070 con 0x5583a3fc8700 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f89a57fa640 1 -- 172.21.15.165:0/1779758929 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc053320 con 0x5583a3fc8700 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1779758929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 msgr2=0x5583a3fc8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/1779758929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fc8b00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8abc016fd0 tx=0x7f8abc011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1779758929 shutdown_connections 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/1779758929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fc8b00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1779758929 >> 172.21.15.165:0/1779758929 conn(0x5583a3fc4b00 msgr2=0x5583a3fc2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1779758929 shutdown_connections 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.702+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1779758929 wait complete. 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.703+0000 7f8ac5d33800 1 Processor -- start 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.703+0000 7f8ac5d33800 1 -- start start 2024-09-22T08:11:08.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.703+0000 7f8ac5d33800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fcfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.703+0000 7f8ac5d33800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5583a3fc9710 con 0x5583a3fc8700 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.703+0000 7f8ac219a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fcfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.703+0000 7f8ac219a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fcfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52820/0 (socket says 172.21.15.165:52820) 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.703+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 learned_addr learned my addr 172.21.15.165:0/902971871 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.703+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a3fd0220 con 0x5583a3fc8700 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.703+0000 7f8ac219a640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fcfcc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0014d0 tx=0x7f8abc0547b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.703+0000 7f89937fe640 1 -- 172.21.15.165:0/902971871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc04b040 con 0x5583a3fc8700 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.704+0000 7f89937fe640 1 -- 172.21.15.165:0/902971871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc04de50 con 0x5583a3fc8700 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.704+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583a3fd04b0 con 0x5583a3fc8700 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.704+0000 7f89937fe640 1 -- 172.21.15.165:0/902971871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc011460 con 0x5583a3fc8700 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.704+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a3fd0e30 con 0x5583a3fc8700 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.704+0000 7f89937fe640 1 -- 172.21.15.165:0/902971871 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8abc0459f0 con 0x5583a3fc8700 2024-09-22T08:11:08.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.705+0000 7f89937fe640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f898c03d000 0x7f898c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.705+0000 7f89937fe640 1 -- 172.21.15.165:0/902971871 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8abc00e040 con 0x5583a3fc8700 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.705+0000 7f8ac1999640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f898c03d000 0x7f898c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.705+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.705+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3fdb780 0x5583a3fddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.705+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fde340 con 0x5583a3fdb780 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.705+0000 7f8ab9198640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3fdb780 0x5583a3fddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.705+0000 7f8ac1999640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f898c03d000 0x7f898c03f4c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ab407bb60 tx=0x7f8ab4080000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.705+0000 7f8ab9198640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3fdb780 0x5583a3fddbf0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aac009050 con 0x5583a3fdb780 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 20 realm 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fdab50 con 0x5583a3fdb780 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aac009050 con 0x5583a3fdb780 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fdee20 con 0x5583a3fdb780 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aac009050 con 0x5583a3fdb780 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fdf6f0 con 0x5583a3fdb780 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8aac009050 con 0x5583a3fdb780 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3fe0030 0x5583a3fe2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe2b60 con 0x5583a3fe0030 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.706+0000 7f8ac219a640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3fe0030 0x5583a3fe2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.707+0000 7f8ac219a640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3fe0030 0x5583a3fe2420 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.707+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.707+0000 7f8ac5d33800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.707+0000 7f8ac5d33800 20 searching for the correct realm 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.707+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5583a3fe4be0 0x5583a3fe70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.707+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe4be0 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.707+0000 7f8ac1999640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5583a3fe4be0 0x5583a3fe70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.707+0000 7f8ac1999640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5583a3fe4be0 0x5583a3fe70a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.708+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.708+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe0030 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.708+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.708+0000 7f8ac219a640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8abc037070 0x7f8abc024800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.708+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x7f8abc037070 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.708+0000 7f8ab9198640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8abc037070 0x7f8abc024800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.708+0000 7f8ab9198640 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8abc037070 0x7f8abc024800 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.709+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac009050 con 0x7f8abc037070 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.709+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fdb780 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.709+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac009050 con 0x5583a3fdb780 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.709+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fdb780 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.709+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.709+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x7f8abc037070 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.709+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.709+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x7f8abc037070 2024-09-22T08:11:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.710+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.710+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe0030 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.710+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.710+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe4be0 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.710+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.710+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fdb780 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.710+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.710+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x7f8abc037070 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.711+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.711+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fdb780 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.711+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.711+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe0030 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.711+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.711+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe4be0 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.711+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.711+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe4be0 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.711+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.711+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x7f8abc037070 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.712+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.712+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe4be0 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.712+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.712+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe4be0 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.712+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.712+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fdb780 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.713+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.713+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fdb780 2024-09-22T08:11:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.713+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.713+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x7f8abc037070 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.713+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.713+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe4be0 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.713+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.713+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe0030 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.714+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.714+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fdb780 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.714+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.714+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x7f8abc037070 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.714+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.714+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe4be0 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.714+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.714+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x7f8abc037070 2024-09-22T08:11:08.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.715+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.715+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe0030 2024-09-22T08:11:08.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.715+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.715+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe4be0 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.715+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.715+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x7f8abc037070 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.715+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.715+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fdb780 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe7770 con 0x5583a3fe0030 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:08.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe35e0 con 0x5583a3fdb780 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe31f0 con 0x5583a3fdb780 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.716+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe3f90 con 0x5583a3fdb780 2024-09-22T08:11:08.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 zone default found 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 4 Realm: () 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 zonegroup default 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe3a80 con 0x7f8abc037070 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe9b30 con 0x5583a3fe4be0 2024-09-22T08:11:08.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fea0e0 con 0x5583a3fe4be0 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 started sync module instance, tier type = 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.717+0000 7f8ac5d33800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.718+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fe8f80 con 0x5583a3fe0030 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.719+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.719+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94023880444624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fea540 con 0x5583a3fe0030 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.719+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3feae10 con 0x5583a3fdb780 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.720+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94023880444624] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.720+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.720+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94023880446832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fea9f0 con 0x5583a3fdb780 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.720+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3feb8a0 con 0x5583a3fe4be0 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.721+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94023880446832] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.721+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.721+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94023880451392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fea960 con 0x5583a3fe4be0 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.721+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fec760 con 0x5583a3fe0030 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.722+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94023880451392] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.722+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.722+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94023880458928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fec6d0 con 0x5583a3fe0030 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.722+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fed620 con 0x5583a3fdb780 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.723+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.723+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94023880462704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3feda40 con 0x5583a3fdb780 2024-09-22T08:11:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.723+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fee560 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.723+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94023880458928] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.724+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94023880462704] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.725+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.725+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94023880466480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fed590 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.725+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3feee00 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.726+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94023880466480] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.726+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.726+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94023880461136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fed590 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.726+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fef420 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.727+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94023880461136] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.727+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.727+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94023880468736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fef420 con 0x7f8abc037070 2024-09-22T08:11:08.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.727+0000 7f8ac5d33800 20 add_watcher() i=0 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.727+0000 7f8ac5d33800 20 add_watcher() i=1 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.727+0000 7f8ac5d33800 20 add_watcher() i=2 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.727+0000 7f8ac5d33800 20 add_watcher() i=3 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.727+0000 7f8ac5d33800 20 add_watcher() i=4 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.727+0000 7f8ac5d33800 20 add_watcher() i=5 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.727+0000 7f8ac5d33800 20 add_watcher() i=6 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.728+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94023880468736] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.728+0000 7f8ac5d33800 20 add_watcher() i=7 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.728+0000 7f8ac5d33800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.728+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a3ff2910 con 0x5583a3fdb780 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.728+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.729+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94023880471312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3fefca0 con 0x5583a3fdb780 2024-09-22T08:11:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.729+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94023880471312] v32'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.730+0000 7f8973fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.730+0000 7f8ac5d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.730+0000 7f8ac5d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.730+0000 7f8ac5d33800 5 note: GC not initialized 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.730+0000 7f8972ffd640 20 reqs_thread_entry: start 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.730+0000 7f8ac5d33800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.730+0000 7f8ac5d33800 20 Filter name: none 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.730+0000 7f8970ff9640 20 reqs_thread_entry: start 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.730+0000 7f8ac5d33800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.730+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583a40257c0 con 0x5583a3fdb780 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.731+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.731+0000 7f8ac5d33800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.731+0000 7f8973fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.732+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94023880471312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a3ff13e0 con 0x5583a3fdb780 2024-09-22T08:11:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.732+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94023880471312] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.732+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94023880444624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a4023610 con 0x5583a3fe0030 2024-09-22T08:11:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.733+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94023880444624] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.733+0000 7f8ac5d33800 20 remove_watcher() i=0 2024-09-22T08:11:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.733+0000 7f8ac5d33800 2 removed watcher, disabling cache 2024-09-22T08:11:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.733+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94023880446832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a4023610 con 0x5583a3fdb780 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.735+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94023880446832] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.735+0000 7f8ac5d33800 20 remove_watcher() i=1 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.735+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94023880451392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a4023610 con 0x5583a3fe4be0 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.736+0000 7f8ac1999640 1 -- 172.21.15.165:0/902971871 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94023880451392] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab4090070 con 0x5583a3fe4be0 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.736+0000 7f8ac5d33800 20 remove_watcher() i=2 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.736+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94023880458928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a4023610 con 0x5583a3fe0030 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.736+0000 7f8ac219a640 1 -- 172.21.15.165:0/902971871 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94023880458928] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc02a070 con 0x5583a3fe0030 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.737+0000 7f8ac5d33800 20 remove_watcher() i=3 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.737+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94023880462704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a4023610 con 0x5583a3fdb780 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.737+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94023880462704] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x5583a3fdb780 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.737+0000 7f8ac5d33800 20 remove_watcher() i=4 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.737+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94023880466480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a4023610 con 0x7f8abc037070 2024-09-22T08:11:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.738+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94023880466480] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.738+0000 7f8ac5d33800 20 remove_watcher() i=5 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.738+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94023880461136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a4023610 con 0x7f8abc037070 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.739+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94023880461136] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.739+0000 7f8ac5d33800 20 remove_watcher() i=6 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.739+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94023880468736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583a4023610 con 0x7f8abc037070 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.740+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94023880468736] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac029040 con 0x7f8abc037070 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.740+0000 7f8ac5d33800 20 remove_watcher() i=7 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8abc037070 msgr2=0x7f8abc024800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8abc037070 0x7f8abc024800 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3fdb780 msgr2=0x5583a3fddbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3fdb780 0x5583a3fddbf0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3fe0030 msgr2=0x5583a3fe2420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3fe0030 0x5583a3fe2420 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5583a3fe4be0 msgr2=0x5583a3fe70a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5583a3fe4be0 0x5583a3fe70a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f898c03d000 msgr2=0x7f898c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f898c03d000 0x7f898c03f4c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ab407bb60 tx=0x7f8ab4080000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 msgr2=0x5583a3fcfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ab9198640 1 -- 172.21.15.165:0/902971871 reap_dead start 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fcfcc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0014d0 tx=0x7f8abc0547b0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 shutdown_connections 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/902971871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fc8700 0x5583a3fcfcc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 >> 172.21.15.165:0/902971871 conn(0x5583a3fc4b00 msgr2=0x5583a3fc2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 shutdown_connections 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/902971871 wait complete. 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1827167910 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f899c03cfb0 msgr2=0x7f899c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/1827167910 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f899c03cfb0 0x7f899c03f470 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5583a3fa2d90 tx=0x7f8ab407b9a0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1827167910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fbbc60 msgr2=0x5583a3fbc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/1827167910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fbbc60 0x5583a3fbc080 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00a2a0 tx=0x7f8abc018830 comp rx=0 tx=0).stop 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1827167910 shutdown_connections 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/1827167910 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f899c03cfb0 0x7f899c03f470 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/1827167910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3fbbc60 0x5583a3fbc080 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1827167910 >> 172.21.15.165:0/1827167910 conn(0x5583a3fb0010 msgr2=0x5583a3fb03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1827167910 shutdown_connections 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.741+0000 7f8ac5d33800 1 -- 172.21.15.165:0/1827167910 wait complete. 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3eaa890 msgr2=0x5583a3fa82f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3eaa890 0x5583a3fa82f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3faa6d0 msgr2=0x5583a3facb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3faa6d0 0x5583a3facb50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f89a803cfb0 msgr2=0x7f89a803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f89a803cfb0 0x7f89a803f470 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8aac001d70 tx=0x7f8aac0012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 msgr2=0x5583a3fa0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3fa0ca0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4025c20 tx=0x7f8ab4002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 shutdown_connections 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583a3faa6d0 0x5583a3facb50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583a3eaa890 0x5583a3fa82f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f89a803cfb0 0x7f89a803f470 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 --2- 172.21.15.165:0/3290927503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583a3ea5c20 0x5583a3fa0ca0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 >> 172.21.15.165:0/3290927503 conn(0x5583a3ea1310 msgr2=0x5583a3f92580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 shutdown_connections 2024-09-22T08:11:08.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.742+0000 7f8ac5d33800 1 -- 172.21.15.165:0/3290927503 wait complete. 2024-09-22T08:11:08.752 INFO:teuthology.orchestra.run.smithi165.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"ugUFknkO8qNisLA80pW/VmnB","ver":2},"mtime":"2024-09-22T08:11:08.603213Z","data":{"bucket":{"name":"myfoo","marker":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","bucket_id":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-22T08:11:06.203755Z","linked":true,"has_bucket_info":false}} 2024-09-22T08:11:08.752 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'ugUFknkO8qNisLA80pW/VmnB', 'ver': 2}, 'mtime': '2024-09-22T08:11:08.603213Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'bucket_id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-22T08:11:06.203755Z', 'linked': True, 'has_bucket_info': False}} 2024-09-22T08:11:08.753 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-22T08:11:08.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-22T08:11:08.753 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-22T08:11:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.839+0000 7f697f0bb800 1 Processor -- start 2024-09-22T08:11:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.839+0000 7f697f0bb800 1 -- start start 2024-09-22T08:11:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.839+0000 7f697f0bb800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556e11b8a080 0x556e11b8c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.839+0000 7f697f0bb800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556e11a14a20 con 0x556e11b8c9b0 2024-09-22T08:11:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.839+0000 7f697f0bb800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556e11a147d0 con 0x556e11b8a080 2024-09-22T08:11:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.840+0000 7f697cba5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556e11b8a080 0x556e11b8c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.840+0000 7f697c3a4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x556e11b8c9b0 0x556e11b8eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33806/0 (socket says 172.21.15.165:33806) 2024-09-22T08:11:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.840+0000 7f697cba5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556e11b8a080 0x556e11b8c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52828/0 (socket says 172.21.15.165:52828) 2024-09-22T08:11:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.840+0000 7f697c3a4640 1 -- 172.21.15.165:0/3410780781 learned_addr learned my addr 172.21.15.165:0/3410780781 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.840+0000 7f697cba5640 1 -- 172.21.15.165:0/3410780781 >> v1:172.21.15.53:6789/0 conn(0x556e11b8c9b0 legacy=0x556e11b8eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.840+0000 7f697cba5640 1 -- 172.21.15.165:0/3410780781 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e11b91560 con 0x556e11b8a080 2024-09-22T08:11:08.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697cba5640 1 --2- 172.21.15.165:0/3410780781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11b8c470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f696c005fd0 tx=0x7f696c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bef0b26c5d047b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697bba3640 1 -- 172.21.15.165:0/3410780781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696c058530 con 0x556e11b8a080 2024-09-22T08:11:08.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697bba3640 1 -- 172.21.15.165:0/3410780781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c0586d0 con 0x556e11b8a080 2024-09-22T08:11:08.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697bba3640 1 -- 172.21.15.165:0/3410780781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696c0589d0 con 0x556e11b8a080 2024-09-22T08:11:08.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697f0bb800 1 -- 172.21.15.165:0/3410780781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 msgr2=0x556e11b8c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3410780781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11b8c470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f696c005fd0 tx=0x7f696c045c30 comp rx=0 tx=0).stop 2024-09-22T08:11:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697f0bb800 1 -- 172.21.15.165:0/3410780781 shutdown_connections 2024-09-22T08:11:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3410780781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11b8c470 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697f0bb800 1 -- 172.21.15.165:0/3410780781 >> 172.21.15.165:0/3410780781 conn(0x556e11b83be0 msgr2=0x556e11b86020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697f0bb800 1 -- 172.21.15.165:0/3410780781 shutdown_connections 2024-09-22T08:11:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.842+0000 7f697f0bb800 1 -- 172.21.15.165:0/3410780781 wait complete. 2024-09-22T08:11:08.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.856+0000 7f697f0bb800 1 Processor -- start 2024-09-22T08:11:08.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.856+0000 7f697f0bb800 1 -- start start 2024-09-22T08:11:08.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.856+0000 7f697f0bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c79010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.856+0000 7f697f0bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e11a21dd0 con 0x556e11b8a080 2024-09-22T08:11:08.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.856+0000 7f697cba5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c79010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.856+0000 7f697cba5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c79010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52836/0 (socket says 172.21.15.165:52836) 2024-09-22T08:11:08.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.857+0000 7f697cba5640 1 -- 172.21.15.165:0/2975676952 learned_addr learned my addr 172.21.15.165:0/2975676952 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.857+0000 7f697cba5640 1 -- 172.21.15.165:0/2975676952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e11c79600 con 0x556e11b8a080 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.857+0000 7f697cba5640 1 --2- 172.21.15.165:0/2975676952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c79010 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f696c025a60 tx=0x7f696c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be245a2d90ae85f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.857+0000 7f686ae0d640 1 -- 172.21.15.165:0/2975676952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696c0589b0 con 0x556e11b8a080 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.857+0000 7f686ae0d640 1 -- 172.21.15.165:0/2975676952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c068070 con 0x556e11b8a080 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.857+0000 7f686ae0d640 1 -- 172.21.15.165:0/2975676952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696c058c80 con 0x556e11b8a080 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 -- 172.21.15.165:0/2975676952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 msgr2=0x556e11c79010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 --2- 172.21.15.165:0/2975676952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c79010 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f696c025a60 tx=0x7f696c051000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 -- 172.21.15.165:0/2975676952 shutdown_connections 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 --2- 172.21.15.165:0/2975676952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c79010 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 -- 172.21.15.165:0/2975676952 >> 172.21.15.165:0/2975676952 conn(0x556e11b83be0 msgr2=0x556e11c74990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 -- 172.21.15.165:0/2975676952 shutdown_connections 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 -- 172.21.15.165:0/2975676952 wait complete. 2024-09-22T08:11:08.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 Processor -- start 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 -- start start 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c80980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.858+0000 7f697f0bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e11b90850 con 0x556e11b8a080 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.859+0000 7f697cba5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c80980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.859+0000 7f697cba5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c80980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52848/0 (socket says 172.21.15.165:52848) 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.859+0000 7f697cba5640 1 -- 172.21.15.165:0/3190773978 learned_addr learned my addr 172.21.15.165:0/3190773978 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.859+0000 7f697cba5640 1 -- 172.21.15.165:0/3190773978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e11c80ee0 con 0x556e11b8a080 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.859+0000 7f697cba5640 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c80980 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f696c025a60 tx=0x7f696c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.859+0000 7f686960a640 1 -- 172.21.15.165:0/3190773978 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696c0635f0 con 0x556e11b8a080 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.859+0000 7f686960a640 1 -- 172.21.15.165:0/3190773978 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c063790 con 0x556e11b8a080 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.859+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e11c81170 con 0x556e11b8a080 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.859+0000 7f686960a640 1 -- 172.21.15.165:0/3190773978 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696c063a90 con 0x556e11b8a080 2024-09-22T08:11:08.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.859+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e11c81b70 con 0x556e11b8a080 2024-09-22T08:11:08.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.860+0000 7f686960a640 1 -- 172.21.15.165:0/3190773978 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f696c075020 con 0x556e11b8a080 2024-09-22T08:11:08.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.860+0000 7f686960a640 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f686403cfb0 0x7f686403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.860+0000 7f686960a640 1 -- 172.21.15.165:0/3190773978 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f696c098a30 con 0x556e11b8a080 2024-09-22T08:11:08.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.860+0000 7f697c3a4640 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f686403cfb0 0x7f686403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.860+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11b8c9b0 0x556e11c87fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.860+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11c82750 con 0x556e11b8c9b0 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.861+0000 7f697d3a6640 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11b8c9b0 0x556e11c87fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.861+0000 7f697c3a4640 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f686403cfb0 0x7f686403f470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6964001d70 tx=0x7f69640012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.861+0000 7f697d3a6640 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11b8c9b0 0x556e11c87fd0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.861+0000 7f697d3a6640 1 -- 172.21.15.165:0/3190773978 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69740083e0 con 0x556e11b8c9b0 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.861+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11c88a10 con 0x556e11b8c9b0 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.861+0000 7f697d3a6640 1 -- 172.21.15.165:0/3190773978 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69740083e0 con 0x556e11b8c9b0 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.861+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11c8a320 0x556e11c8c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.861+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11c8cf50 con 0x556e11c8a320 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.862+0000 7f697cba5640 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11c8a320 0x556e11c8c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.862+0000 7f697cba5640 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11c8a320 0x556e11c8c7c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.862+0000 7f697cba5640 1 -- 172.21.15.165:0/3190773978 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f696c06dd00 con 0x556e11c8a320 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.862+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11c89260 con 0x556e11b8c9b0 2024-09-22T08:11:08.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.862+0000 7f697d3a6640 1 -- 172.21.15.165:0/3190773978 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69740083e0 con 0x556e11b8c9b0 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.862+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11c89640 con 0x556e11b8c9b0 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.863+0000 7f697d3a6640 1 -- 172.21.15.165:0/3190773978 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69740083e0 con 0x556e11b8c9b0 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.863+0000 7f697f0bb800 1 Processor -- start 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.863+0000 7f697f0bb800 1 -- start start 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.863+0000 7f697f0bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11c9b930 0x556e11c9bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.863+0000 7f697f0bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e11a80d50 con 0x556e11c9b930 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.863+0000 7f697d3a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11c9b930 0x556e11c9bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.863+0000 7f697d3a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11c9b930 0x556e11c9bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52854/0 (socket says 172.21.15.165:52854) 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.863+0000 7f697d3a6640 1 -- 172.21.15.165:0/257146902 learned_addr learned my addr 172.21.15.165:0/257146902 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.864+0000 7f697d3a6640 1 -- 172.21.15.165:0/257146902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e11c9c390 con 0x556e11c9b930 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.864+0000 7f697d3a6640 1 --2- 172.21.15.165:0/257146902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11c9b930 0x556e11c9bd50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x556e11c81f90 tx=0x7f697400af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.864+0000 7f68627fc640 1 -- 172.21.15.165:0/257146902 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6974007d60 con 0x556e11c9b930 2024-09-22T08:11:08.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.864+0000 7f68627fc640 1 -- 172.21.15.165:0/257146902 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697401e020 con 0x556e11c9b930 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.864+0000 7f697f0bb800 1 -- 172.21.15.165:0/257146902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e11c9cbc0 con 0x556e11c9b930 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.864+0000 7f68627fc640 1 -- 172.21.15.165:0/257146902 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6974019590 con 0x556e11c9b930 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.864+0000 7f697f0bb800 1 -- 172.21.15.165:0/257146902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e11c9d160 con 0x556e11c9b930 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.865+0000 7f68627fc640 1 -- 172.21.15.165:0/257146902 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6974016040 con 0x556e11c9b930 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.865+0000 7f68627fc640 1 --2- 172.21.15.165:0/257146902 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f685403cfb0 0x7f685403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.865+0000 7f68627fc640 1 -- 172.21.15.165:0/257146902 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f697401f030 con 0x556e11c9b930 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.865+0000 7f697cba5640 1 --2- 172.21.15.165:0/257146902 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f685403cfb0 0x7f685403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.865+0000 7f697f0bb800 1 Processor -- start 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f697cba5640 1 --2- 172.21.15.165:0/257146902 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f685403cfb0 0x7f685403f470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x556e11c82170 tx=0x7f696c063cf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f697f0bb800 1 -- start start 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f697f0bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11b88480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f697f0bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e11c79970 con 0x556e11b88080 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f697d3a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11b88480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f697d3a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11b88480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52860/0 (socket says 172.21.15.165:52860) 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f697d3a6640 1 -- 172.21.15.165:0/4110918173 learned_addr learned my addr 172.21.15.165:0/4110918173 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f697d3a6640 1 -- 172.21.15.165:0/4110918173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e11b88a70 con 0x556e11b88080 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f697d3a6640 1 --2- 172.21.15.165:0/4110918173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11b88480 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6974054630 tx=0x7f6974015e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ef2729c42e43d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f6853fff640 1 -- 172.21.15.165:0/4110918173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6974051020 con 0x556e11b88080 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f6853fff640 1 -- 172.21.15.165:0/4110918173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6974017e00 con 0x556e11b88080 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.866+0000 7f6853fff640 1 -- 172.21.15.165:0/4110918173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6974044020 con 0x556e11b88080 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 -- 172.21.15.165:0/4110918173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 msgr2=0x556e11b88480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4110918173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11b88480 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6974054630 tx=0x7f6974015e90 comp rx=0 tx=0).stop 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 -- 172.21.15.165:0/4110918173 shutdown_connections 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4110918173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11b88480 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 -- 172.21.15.165:0/4110918173 >> 172.21.15.165:0/4110918173 conn(0x556e11ca4770 msgr2=0x556e11ca29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 -- 172.21.15.165:0/4110918173 shutdown_connections 2024-09-22T08:11:08.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 -- 172.21.15.165:0/4110918173 wait complete. 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 Processor -- start 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 -- start start 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11cb1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.867+0000 7f697f0bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e11b890e0 con 0x556e11b88080 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.868+0000 7f697d3a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11cb1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.868+0000 7f697d3a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11cb1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52872/0 (socket says 172.21.15.165:52872) 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.868+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 learned_addr learned my addr 172.21.15.165:0/4283272193 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.868+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e11cb2000 con 0x556e11b88080 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.868+0000 7f697d3a6640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11cb1aa0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6974015ed0 tx=0x7f69740545c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.868+0000 7f68527fc640 1 -- 172.21.15.165:0/4283272193 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6974031070 con 0x556e11b88080 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.868+0000 7f68527fc640 1 -- 172.21.15.165:0/4283272193 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6974016330 con 0x556e11b88080 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.868+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e11cb2290 con 0x556e11b88080 2024-09-22T08:11:08.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.868+0000 7f68527fc640 1 -- 172.21.15.165:0/4283272193 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6974051040 con 0x556e11b88080 2024-09-22T08:11:08.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.868+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e11cb2c10 con 0x556e11b88080 2024-09-22T08:11:08.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.869+0000 7f68527fc640 1 -- 172.21.15.165:0/4283272193 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6974034070 con 0x556e11b88080 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.869+0000 7f68527fc640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f684803cfb0 0x7f684803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.869+0000 7f68527fc640 1 -- 172.21.15.165:0/4283272193 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f697404d070 con 0x556e11b88080 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.869+0000 7f697cba5640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f684803cfb0 0x7f684803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.870+0000 7f697cba5640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f684803cfb0 0x7f684803f470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f696c097080 tx=0x7f696c08a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.870+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.870+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11cbd460 0x556e11cbf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.870+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc0070 con 0x556e11cbd460 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.870+0000 7f697c3a4640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11cbd460 0x556e11cbf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.870+0000 7f697c3a4640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11cbd460 0x556e11cbf920 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 20 realm 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11cbc7b0 con 0x556e11cbd460 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc0b60 con 0x556e11cbd460 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc1430 con 0x556e11cbd460 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11cc1e50 0x556e11cc4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc4980 con 0x556e11cc1e50 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.871+0000 7f697d3a6640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11cc1e50 0x556e11cc4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.872+0000 7f697d3a6640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11cc1e50 0x556e11cc4240 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.872+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.872+0000 7f697f0bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.872+0000 7f697f0bb800 20 searching for the correct realm 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.872+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556e11cc6930 0x556e11cc8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.872+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc6930 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.872+0000 7f697cba5640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556e11cc6930 0x556e11cc8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.872+0000 7f697cba5640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556e11cc6930 0x556e11cc8df0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.873+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.873+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc1e50 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.873+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.873+0000 7f697d3a6640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6974036060 0x7f697403a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.873+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x7f6974036060 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.873+0000 7f697c3a4640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6974036060 0x7f697403a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.874+0000 7f697c3a4640 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6974036060 0x7f697403a1b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.874+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x7f6974036060 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.874+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cbd460 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.874+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.874+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cbd460 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.874+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.874+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x7f6974036060 2024-09-22T08:11:08.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.874+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x7f6974036060 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.875+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x7f6974036060 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.875+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x7f6974036060 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.875+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc1e50 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.875+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.875+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc6930 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.875+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.875+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cbd460 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.875+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.875+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x7f6974036060 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.876+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x7f6974036060 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.876+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cbd460 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.876+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.876+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc1e50 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.876+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.876+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc6930 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.876+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.876+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc6930 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.877+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.877+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x7f6974036060 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.877+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x7f6974036060 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.877+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc6930 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.877+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.877+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc6930 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.877+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.877+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cbd460 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.878+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.878+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cbd460 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.878+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.878+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x7f6974036060 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.878+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x7f6974036060 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.878+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc6930 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.878+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.878+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc1e50 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.878+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.878+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cbd460 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.879+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.879+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x7f6974036060 2024-09-22T08:11:08.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.879+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x7f6974036060 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.879+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc6930 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.879+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.879+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x7f6974036060 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.879+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x7f6974036060 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.879+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc1e50 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.880+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.880+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc6930 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.880+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.880+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x7f6974036060 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.880+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6964009050 con 0x7f6974036060 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.880+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cbd460 2024-09-22T08:11:08.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.880+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.880+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9470 con 0x556e11cc1e50 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc5340 con 0x556e11cbd460 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc5be0 con 0x556e11cbd460 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6964009050 con 0x556e11cbd460 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc98f0 con 0x556e11cbd460 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 zone default found 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 4 Realm: () 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 zonegroup default 2024-09-22T08:11:08.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.881+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11cc9c90 con 0x7f6974036060 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697f0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccbac0 con 0x556e11cc6930 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697f0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccbf20 con 0x556e11cc6930 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697f0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697f0bb800 20 started sync module instance, tier type = 2024-09-22T08:11:08.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697f0bb800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.882+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccaf60 con 0x556e11cc1e50 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.883+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.883+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93931233391712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccaf60 con 0x556e11cc1e50 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.883+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccca50 con 0x556e11cbd460 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.884+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93931233391712] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.885+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.885+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93931233396032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccaf60 con 0x556e11cbd460 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.885+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccd4f0 con 0x556e11cc6930 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.886+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93931233396032] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.886+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.886+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93931233398752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccd890 con 0x556e11cc6930 2024-09-22T08:11:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.886+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11cce350 con 0x556e11cc1e50 2024-09-22T08:11:08.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.887+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93931233398752] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.887+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.887+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93931233402400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11cce740 con 0x556e11cc1e50 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.887+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccf180 con 0x556e11cbd460 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.888+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.888+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93931233406032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccf140 con 0x556e11cbd460 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.888+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11cd0140 con 0x7f6974036060 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.888+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93931233402400] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.888+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93931233406032] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.889+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.889+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93931233410160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11cd0140 con 0x7f6974036060 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.889+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11cd05b0 con 0x7f6974036060 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.890+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93931233410160] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.890+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.890+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93931233389232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11cd0140 con 0x7f6974036060 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.890+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11cd0f50 con 0x7f6974036060 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.891+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93931233389232] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.891+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.891+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93931233412464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11cd0f10 con 0x7f6974036060 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.891+0000 7f697f0bb800 20 add_watcher() i=0 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.891+0000 7f697f0bb800 20 add_watcher() i=1 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.891+0000 7f697f0bb800 20 add_watcher() i=2 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.891+0000 7f697f0bb800 20 add_watcher() i=3 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.891+0000 7f697f0bb800 20 add_watcher() i=4 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.891+0000 7f697f0bb800 20 add_watcher() i=5 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.891+0000 7f697f0bb800 20 add_watcher() i=6 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.892+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93931233412464] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.892+0000 7f697f0bb800 20 add_watcher() i=7 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.892+0000 7f697f0bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.892+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11cd4460 con 0x556e11cbd460 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.892+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.892+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93931233413520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11cd17f0 con 0x556e11cbd460 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.893+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93931233413520] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.893+0000 7f6832fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.893+0000 7f697f0bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.893+0000 7f697f0bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.893+0000 7f697f0bb800 5 note: GC not initialized 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f6831fe3640 20 reqs_thread_entry: start 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:08.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 20 Filter name: none 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f67a37fe640 20 reqs_thread_entry: start 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11d077f0 con 0x556e11cbd460 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.894+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11d098e0 con 0x556e11cbd460 2024-09-22T08:11:08.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 : miss 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 20 rados->read ofs=0 len=0 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 8.8 8:131dd858:root::.bucket.meta.testx%3amyfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11d0b1f0 con 0x556e11cbd460 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv3 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 20 rados_obj.operate() r=0 bl.length=420 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-22T08:11:08.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.895+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11d0f8c0 con 0x556e11cbd460 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.896+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.896+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:66 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11d131d0 con 0x7f6974036060 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(66 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [create,call,writefull 0~387,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697f0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x7 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697f0bb800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697f0bb800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697f0bb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1, ofs0, ns] 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93931233676976 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11d12ab0 con 0x7f6974036060 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== watch-notify(notify (1) cookie 93931233389232 notify 137438953486 ret 0) ==== 778+0+0 (crc 0 0 0) 0x556e11d13570 con 0x7f6974036060 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f6853fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 93931233389232 notifier 4556 bl.length()=736 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f6853fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x7 2024-09-22T08:11:08.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f6853fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f6853fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(67 notify.6 [notify cookie 93931233676976 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f6853fff640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6840003ea0 con 0x7f6974036060 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== watch-notify(notify_complete (2) cookie 93931233676976 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556e11d0f2f0 con 0x7f6974036060 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697f0bb800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_sources= new_sources= 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697f0bb800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential sources added=[] removed=[] 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697f0bb800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_dests= new_dests= 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697f0bb800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential dests added=[] removed=[] 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.898+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11d0d960 con 0x556e11cc1e50 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.900+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.900+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11d0d960 con 0x556e11cc1e50 2024-09-22T08:11:08.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f697f0bb800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f697f0bb800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f697f0bb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93931233662128 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11d0df00 con 0x7f6974036060 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== watch-notify(notify (1) cookie 93931233389232 notify 137438953487 ret 0) ==== 356+0+0 (crc 0 0 0) 0x556e11d0b5e0 con 0x7f6974036060 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f6853fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 93931233389232 notifier 4556 bl.length()=314 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f6853fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f6853fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f6853fff640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6840003ea0 con 0x7f6974036060 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(71 notify.6 [notify cookie 93931233662128 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== watch-notify(notify_complete (2) cookie 93931233662128 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556e11d0a710 con 0x7f6974036060 2024-09-22T08:11:08.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.901+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11d0df00 con 0x556e11cbd460 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.902+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.902+0000 7f697f0bb800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.902+0000 7f697f0bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.903+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 93931233662128 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11d0df00 con 0x556e11cbd460 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.903+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify (1) cookie 93931233406032 notify 137438953490 ret 0) ==== 197+0+0 (crc 0 0 0) 0x556e11d0a710 con 0x556e11cbd460 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.903+0000 7f68537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 93931233406032 notifier 4556 bl.length()=155 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.903+0000 7f68537fe640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f67b00032c0 con 0x556e11cbd460 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.903+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(74 notify.4 [notify cookie 93931233662128 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.903+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.903+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== watch-notify(notify_complete (2) cookie 93931233662128 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556e11a14a20 con 0x556e11cbd460 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.903+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 8.8 8:131dd858:root::.bucket.meta.testx%3amyfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11d0df00 con 0x556e11cbd460 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.904+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.904+0000 7f697f0bb800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 from cache 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.904+0000 7f697f0bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1, ofs0, ns] 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.904+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 93931233654960 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e11d0df00 con 0x7f6974036060 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.905+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== watch-notify(notify (1) cookie 93931233410160 notify 137438953488 ret 0) ==== 254+0+0 (crc 0 0 0) 0x556e11a14a20 con 0x7f6974036060 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.905+0000 7f6853fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 93931233410160 notifier 4556 bl.length()=212 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.905+0000 7f6853fff640 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6840003ea0 con 0x7f6974036060 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.905+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(77 notify.5 [notify cookie 93931233654960 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.905+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.905+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== watch-notify(notify_complete (2) cookie 93931233654960 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f696403c8a0 con 0x7f6974036060 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.906+0000 7f6832fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.906+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93931233413520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11d05510 con 0x556e11cbd460 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.907+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93931233413520] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.907+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93931233391712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11d05510 con 0x556e11cc1e50 2024-09-22T08:11:08.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.908+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93931233391712] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.908+0000 7f697f0bb800 20 remove_watcher() i=0 2024-09-22T08:11:08.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.908+0000 7f697f0bb800 2 removed watcher, disabling cache 2024-09-22T08:11:08.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.908+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93931233396032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11d05510 con 0x556e11cbd460 2024-09-22T08:11:08.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.909+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93931233396032] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.909+0000 7f697f0bb800 20 remove_watcher() i=1 2024-09-22T08:11:08.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.909+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93931233398752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11d05510 con 0x556e11cc6930 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.910+0000 7f697cba5640 1 -- 172.21.15.165:0/4283272193 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93931233398752] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f696c0a2040 con 0x556e11cc6930 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.910+0000 7f697f0bb800 20 remove_watcher() i=2 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.910+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93931233402400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccc540 con 0x556e11cc1e50 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.911+0000 7f697d3a6640 1 -- 172.21.15.165:0/4283272193 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93931233402400] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6974033030 con 0x556e11cc1e50 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.911+0000 7f697f0bb800 20 remove_watcher() i=3 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.911+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93931233406032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccc540 con 0x556e11cbd460 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.912+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93931233406032] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x556e11cbd460 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.912+0000 7f697f0bb800 20 remove_watcher() i=4 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.912+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93931233410160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccc540 con 0x7f6974036060 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.913+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93931233410160] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.913+0000 7f697f0bb800 20 remove_watcher() i=5 2024-09-22T08:11:08.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.913+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93931233389232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccfc70 con 0x7f6974036060 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.914+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93931233389232] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.914+0000 7f697f0bb800 20 remove_watcher() i=6 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.914+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93931233412464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e11ccc540 con 0x7f6974036060 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93931233412464] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69640381c0 con 0x7f6974036060 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 20 remove_watcher() i=7 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6974036060 msgr2=0x7f697403a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6974036060 0x7f697403a1b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11cbd460 msgr2=0x556e11cbf920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11cbd460 0x556e11cbf920 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11cc1e50 msgr2=0x556e11cc4240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11cc1e50 0x556e11cc4240 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556e11cc6930 msgr2=0x556e11cc8df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556e11cc6930 0x556e11cc8df0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f684803cfb0 msgr2=0x7f684803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f684803cfb0 0x7f684803f470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f696c097080 tx=0x7f696c08a000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 msgr2=0x556e11cb1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 --2- 172.21.15.165:0/4283272193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b88080 0x556e11cb1aa0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6974015ed0 tx=0x7f69740545c0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 reap_dead start 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697c3a4640 1 -- 172.21.15.165:0/4283272193 reap_dead start 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 shutdown_connections 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 >> 172.21.15.165:0/4283272193 conn(0x556e11ca4770 msgr2=0x556e11ca2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 shutdown_connections 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/4283272193 wait complete. 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/257146902 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f685403cfb0 msgr2=0x7f685403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 --2- 172.21.15.165:0/257146902 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f685403cfb0 0x7f685403f470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x556e11c82170 tx=0x7f696c063cf0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/257146902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11c9b930 msgr2=0x556e11c9bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 --2- 172.21.15.165:0/257146902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11c9b930 0x556e11c9bd50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x556e11c81f90 tx=0x7f697400af20 comp rx=0 tx=0).stop 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/257146902 shutdown_connections 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 --2- 172.21.15.165:0/257146902 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f685403cfb0 0x7f685403f470 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 --2- 172.21.15.165:0/257146902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11c9b930 0x556e11c9bd50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.915+0000 7f697f0bb800 1 -- 172.21.15.165:0/257146902 >> 172.21.15.165:0/257146902 conn(0x556e11c8fce0 msgr2=0x556e11c900c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 -- 172.21.15.165:0/257146902 shutdown_connections 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 -- 172.21.15.165:0/257146902 wait complete. 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11b8c9b0 msgr2=0x556e11c87fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11b8c9b0 0x556e11c87fd0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11c8a320 msgr2=0x556e11c8c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11c8a320 0x556e11c8c7c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f686403cfb0 msgr2=0x7f686403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f686403cfb0 0x7f686403f470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6964001d70 tx=0x7f69640012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 msgr2=0x556e11c80980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c80980 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f696c025a60 tx=0x7f696c003330 comp rx=0 tx=0).stop 2024-09-22T08:11:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 shutdown_connections 2024-09-22T08:11:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556e11c8a320 0x556e11c8c7c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556e11b8c9b0 0x556e11c87fd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f686403cfb0 0x7f686403f470 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 --2- 172.21.15.165:0/3190773978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e11b8a080 0x556e11c80980 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 >> 172.21.15.165:0/3190773978 conn(0x556e11b83be0 msgr2=0x556e11c73180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 shutdown_connections 2024-09-22T08:11:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.916+0000 7f697f0bb800 1 -- 172.21.15.165:0/3190773978 wait complete. 2024-09-22T08:11:08.928 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-22T08:11:08.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-22T08:11:08.928 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-22T08:11:08.975 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:08.975 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:08.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.975+0000 7fe659ab9800 1 Processor -- start 2024-09-22T08:11:08.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.975+0000 7fe659ab9800 1 -- start start 2024-09-22T08:11:08.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.975+0000 7fe659ab9800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558b3d3847e0 0x558b3d3854e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.975+0000 7fe659ab9800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b3d210a20 con 0x558b3d385a20 2024-09-22T08:11:08.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.975+0000 7fe659ab9800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558b3d2107d0 con 0x558b3d3847e0 2024-09-22T08:11:08.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.975+0000 7fe6575a3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558b3d3847e0 0x558b3d3854e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.975+0000 7fe656da2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558b3d385a20 0x558b3d38a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33816/0 (socket says 172.21.15.165:33816) 2024-09-22T08:11:08.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.975+0000 7fe656da2640 1 -- 172.21.15.165:0/3925954970 learned_addr learned my addr 172.21.15.165:0/3925954970 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:08.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.976+0000 7fe6575a3640 1 -- 172.21.15.165:0/3925954970 >> v1:172.21.15.53:6789/0 conn(0x558b3d385a20 legacy=0x558b3d38a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.976+0000 7fe6575a3640 1 -- 172.21.15.165:0/3925954970 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d384ee0 con 0x558b3d3847e0 2024-09-22T08:11:08.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.977+0000 7fe6575a3640 1 --2- 172.21.15.165:0/3925954970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d3854e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe64800a470 tx=0x7fe648045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfbb858861a4a17 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.978+0000 7fe6565a1640 1 -- 172.21.15.165:0/3925954970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe648053570 con 0x558b3d3847e0 2024-09-22T08:11:08.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.978+0000 7fe6565a1640 1 -- 172.21.15.165:0/3925954970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648058070 con 0x558b3d3847e0 2024-09-22T08:11:08.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.978+0000 7fe6565a1640 1 -- 172.21.15.165:0/3925954970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe648053880 con 0x558b3d3847e0 2024-09-22T08:11:08.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.978+0000 7fe659ab9800 1 -- 172.21.15.165:0/3925954970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 msgr2=0x558b3d3854e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.978+0000 7fe659ab9800 1 --2- 172.21.15.165:0/3925954970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d3854e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe64800a470 tx=0x7fe648045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:08.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.978+0000 7fe659ab9800 1 -- 172.21.15.165:0/3925954970 shutdown_connections 2024-09-22T08:11:08.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.978+0000 7fe659ab9800 1 --2- 172.21.15.165:0/3925954970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d3854e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.978+0000 7fe659ab9800 1 -- 172.21.15.165:0/3925954970 >> 172.21.15.165:0/3925954970 conn(0x558b3d37fbb0 msgr2=0x558b3d382010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.978+0000 7fe659ab9800 1 -- 172.21.15.165:0/3925954970 shutdown_connections 2024-09-22T08:11:08.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.978+0000 7fe659ab9800 1 -- 172.21.15.165:0/3925954970 wait complete. 2024-09-22T08:11:08.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.992+0000 7fe659ab9800 1 Processor -- start 2024-09-22T08:11:08.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.992+0000 7fe659ab9800 1 -- start start 2024-09-22T08:11:08.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.992+0000 7fe659ab9800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d473f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.992+0000 7fe659ab9800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b3d21ddd0 con 0x558b3d3847e0 2024-09-22T08:11:08.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.993+0000 7fe6575a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d473f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.993+0000 7fe6575a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d473f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52884/0 (socket says 172.21.15.165:52884) 2024-09-22T08:11:08.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.993+0000 7fe6575a3640 1 -- 172.21.15.165:0/16365371 learned_addr learned my addr 172.21.15.165:0/16365371 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.993+0000 7fe6575a3640 1 -- 172.21.15.165:0/16365371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d474500 con 0x558b3d3847e0 2024-09-22T08:11:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.993+0000 7fe6575a3640 1 --2- 172.21.15.165:0/16365371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d473f10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe648025c20 tx=0x7fe648051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d242e62704c995 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.993+0000 7fe54560a640 1 -- 172.21.15.165:0/16365371 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe648053a20 con 0x558b3d3847e0 2024-09-22T08:11:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.993+0000 7fe54560a640 1 -- 172.21.15.165:0/16365371 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648063070 con 0x558b3d3847e0 2024-09-22T08:11:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.993+0000 7fe54560a640 1 -- 172.21.15.165:0/16365371 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe648053cf0 con 0x558b3d3847e0 2024-09-22T08:11:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.994+0000 7fe659ab9800 1 -- 172.21.15.165:0/16365371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 msgr2=0x558b3d473f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.994+0000 7fe659ab9800 1 --2- 172.21.15.165:0/16365371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d473f10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe648025c20 tx=0x7fe648051000 comp rx=0 tx=0).stop 2024-09-22T08:11:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.994+0000 7fe659ab9800 1 -- 172.21.15.165:0/16365371 shutdown_connections 2024-09-22T08:11:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.994+0000 7fe659ab9800 1 --2- 172.21.15.165:0/16365371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d473f10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.994+0000 7fe659ab9800 1 -- 172.21.15.165:0/16365371 >> 172.21.15.165:0/16365371 conn(0x558b3d37fbb0 msgr2=0x558b3d46f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.994+0000 7fe659ab9800 1 -- 172.21.15.165:0/16365371 shutdown_connections 2024-09-22T08:11:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.994+0000 7fe659ab9800 1 -- 172.21.15.165:0/16365371 wait complete. 2024-09-22T08:11:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.994+0000 7fe659ab9800 1 Processor -- start 2024-09-22T08:11:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.994+0000 7fe659ab9800 1 -- start start 2024-09-22T08:11:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.995+0000 7fe659ab9800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d2f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.995+0000 7fe659ab9800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b3d386290 con 0x558b3d3847e0 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.995+0000 7fe6575a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d2f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.995+0000 7fe6575a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d2f88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52894/0 (socket says 172.21.15.165:52894) 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.995+0000 7fe6575a3640 1 -- 172.21.15.165:0/1967278874 learned_addr learned my addr 172.21.15.165:0/1967278874 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.995+0000 7fe6575a3640 1 -- 172.21.15.165:0/1967278874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d2f8de0 con 0x558b3d3847e0 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.995+0000 7fe6575a3640 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d2f88a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe648025c20 tx=0x7fe648002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.995+0000 7fe543e07640 1 -- 172.21.15.165:0/1967278874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe64806c030 con 0x558b3d3847e0 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.996+0000 7fe543e07640 1 -- 172.21.15.165:0/1967278874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648068660 con 0x558b3d3847e0 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.996+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b3d481a30 con 0x558b3d3847e0 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.996+0000 7fe543e07640 1 -- 172.21.15.165:0/1967278874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe648068940 con 0x558b3d3847e0 2024-09-22T08:11:08.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.996+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b3d481e90 con 0x558b3d3847e0 2024-09-22T08:11:09.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.996+0000 7fe543e07640 1 -- 172.21.15.165:0/1967278874 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe648068ae0 con 0x558b3d3847e0 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.997+0000 7fe543e07640 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53c03d000 0x7fe53c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.997+0000 7fe543e07640 1 -- 172.21.15.165:0/1967278874 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe648098b70 con 0x558b3d3847e0 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.997+0000 7fe656da2640 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53c03d000 0x7fe53c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.997+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d385a20 0x558b3d485dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.997+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d486420 con 0x558b3d385a20 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.997+0000 7fe657da4640 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d385a20 0x558b3d485dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.997+0000 7fe656da2640 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53c03d000 0x7fe53c03f4c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe64c001d70 tx=0x7fe64c0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.997+0000 7fe657da4640 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d385a20 0x558b3d485dd0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.998+0000 7fe657da4640 1 -- 172.21.15.165:0/1967278874 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe65000a4d0 con 0x558b3d385a20 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.998+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d486d00 con 0x558b3d385a20 2024-09-22T08:11:09.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.998+0000 7fe657da4640 1 -- 172.21.15.165:0/1967278874 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe65000a4d0 con 0x558b3d385a20 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.998+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d488610 0x558b3d48aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.998+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d48b240 con 0x558b3d488610 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.998+0000 7fe6575a3640 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d488610 0x558b3d48aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.998+0000 7fe6575a3640 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d488610 0x558b3d48aab0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.999+0000 7fe6575a3640 1 -- 172.21.15.165:0/1967278874 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe648051070 con 0x558b3d488610 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.999+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d487550 con 0x558b3d385a20 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.999+0000 7fe657da4640 1 -- 172.21.15.165:0/1967278874 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe65000a4d0 con 0x558b3d385a20 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.999+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d487930 con 0x558b3d385a20 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.999+0000 7fe657da4640 1 -- 172.21.15.165:0/1967278874 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe65000a4d0 con 0x558b3d385a20 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:08.999+0000 7fe659ab9800 1 Processor -- start 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.000+0000 7fe659ab9800 1 -- start start 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.000+0000 7fe659ab9800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d499bf0 0x558b3d49a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.000+0000 7fe659ab9800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b3d27cd50 con 0x558b3d499bf0 2024-09-22T08:11:09.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.000+0000 7fe657da4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d499bf0 0x558b3d49a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.000+0000 7fe657da4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d499bf0 0x558b3d49a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52910/0 (socket says 172.21.15.165:52910) 2024-09-22T08:11:09.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.000+0000 7fe657da4640 1 -- 172.21.15.165:0/1890212874 learned_addr learned my addr 172.21.15.165:0/1890212874 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.000+0000 7fe657da4640 1 -- 172.21.15.165:0/1890212874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d49a650 con 0x558b3d499bf0 2024-09-22T08:11:09.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.000+0000 7fe657da4640 1 --2- 172.21.15.165:0/1890212874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d499bf0 0x558b3d49a010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x558b3d2f84e0 tx=0x7fe650018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.000+0000 7fe541602640 1 -- 172.21.15.165:0/1890212874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe650014450 con 0x558b3d499bf0 2024-09-22T08:11:09.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.001+0000 7fe541602640 1 -- 172.21.15.165:0/1890212874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe650014610 con 0x558b3d499bf0 2024-09-22T08:11:09.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.001+0000 7fe659ab9800 1 -- 172.21.15.165:0/1890212874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b3d49ae80 con 0x558b3d499bf0 2024-09-22T08:11:09.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.001+0000 7fe541602640 1 -- 172.21.15.165:0/1890212874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe650014930 con 0x558b3d499bf0 2024-09-22T08:11:09.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.001+0000 7fe659ab9800 1 -- 172.21.15.165:0/1890212874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b3d49b420 con 0x558b3d499bf0 2024-09-22T08:11:09.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.001+0000 7fe541602640 1 -- 172.21.15.165:0/1890212874 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe650011040 con 0x558b3d499bf0 2024-09-22T08:11:09.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe541602640 1 --2- 172.21.15.165:0/1890212874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53003cfb0 0x7fe53003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe541602640 1 -- 172.21.15.165:0/1890212874 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe65001e070 con 0x558b3d499bf0 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe6575a3640 1 --2- 172.21.15.165:0/1890212874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53003cfb0 0x7fe53003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe659ab9800 1 Processor -- start 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe659ab9800 1 -- start start 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe6575a3640 1 --2- 172.21.15.165:0/1890212874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53003cfb0 0x7fe53003f470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x558b3d4833d0 tx=0x7fe64807cf90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe659ab9800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe659ab9800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b3d4748d0 con 0x558b3d4a6690 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe657da4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe657da4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4a6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52912/0 (socket says 172.21.15.165:52912) 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.002+0000 7fe657da4640 1 -- 172.21.15.165:0/2881686648 learned_addr learned my addr 172.21.15.165:0/2881686648 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe657da4640 1 -- 172.21.15.165:0/2881686648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d4a7080 con 0x558b3d4a6690 2024-09-22T08:11:09.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe657da4640 1 --2- 172.21.15.165:0/2881686648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4a6a90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe650016fd0 tx=0x7fe650011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca64b6da0ade67f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe53affd640 1 -- 172.21.15.165:0/2881686648 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe650011da0 con 0x558b3d4a6690 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe53affd640 1 -- 172.21.15.165:0/2881686648 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6500532d0 con 0x558b3d4a6690 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe53affd640 1 -- 172.21.15.165:0/2881686648 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6500168f0 con 0x558b3d4a6690 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe659ab9800 1 -- 172.21.15.165:0/2881686648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 msgr2=0x558b3d4a6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe659ab9800 1 --2- 172.21.15.165:0/2881686648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4a6a90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe650016fd0 tx=0x7fe650011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe659ab9800 1 -- 172.21.15.165:0/2881686648 shutdown_connections 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe659ab9800 1 --2- 172.21.15.165:0/2881686648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4a6a90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe659ab9800 1 -- 172.21.15.165:0/2881686648 >> 172.21.15.165:0/2881686648 conn(0x558b3d4a2a90 msgr2=0x558b3d4a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe659ab9800 1 -- 172.21.15.165:0/2881686648 shutdown_connections 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.003+0000 7fe659ab9800 1 -- 172.21.15.165:0/2881686648 wait complete. 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.004+0000 7fe659ab9800 1 Processor -- start 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.004+0000 7fe659ab9800 1 -- start start 2024-09-22T08:11:09.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.004+0000 7fe659ab9800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.004+0000 7fe659ab9800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b3d4a76a0 con 0x558b3d4a6690 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.004+0000 7fe657da4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.004+0000 7fe657da4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52920/0 (socket says 172.21.15.165:52920) 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.004+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 learned_addr learned my addr 172.21.15.165:0/742794605 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.004+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b3d4ae230 con 0x558b3d4a6690 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.004+0000 7fe657da4640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4adcd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe6500016e0 tx=0x7fe650054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.005+0000 7fe5397fa640 1 -- 172.21.15.165:0/742794605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6500168f0 con 0x558b3d4a6690 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.005+0000 7fe5397fa640 1 -- 172.21.15.165:0/742794605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe650032070 con 0x558b3d4a6690 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.005+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b3d4ae4c0 con 0x558b3d4a6690 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.005+0000 7fe5397fa640 1 -- 172.21.15.165:0/742794605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe650014c20 con 0x558b3d4a6690 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.005+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b3d4aee40 con 0x558b3d4a6690 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.005+0000 7fe5397fa640 1 -- 172.21.15.165:0/742794605 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe650056070 con 0x558b3d4a6690 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.006+0000 7fe5397fa640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe52003cfb0 0x7fe52003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.006+0000 7fe5397fa640 1 -- 172.21.15.165:0/742794605 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe65000e040 con 0x558b3d4a6690 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.006+0000 7fe6575a3640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe52003cfb0 0x7fe52003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.006+0000 7fe6575a3640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe52003cfb0 0x7fe52003f470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x558b3d48b640 tx=0x7fe648087000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.006+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.006+0000 7fe659ab9800 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d4b9790 0x558b3d4bbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.006+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4bc3a0 con 0x558b3d4b9790 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.006+0000 7fe656da2640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d4b9790 0x558b3d4bbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe656da2640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d4b9790 0x558b3d4bbc50 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe64c009050 con 0x558b3d4b9790 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 20 realm 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4b8ae0 con 0x558b3d4b9790 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe64c009050 con 0x558b3d4b9790 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4bce90 con 0x558b3d4b9790 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe64c009050 con 0x558b3d4b9790 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.007+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4bd760 con 0x558b3d4b9790 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe64c009050 con 0x558b3d4b9790 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe659ab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe659ab9800 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d4be180 0x558b3d4c0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c0cb0 con 0x558b3d4be180 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe657da4640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d4be180 0x558b3d4c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe657da4640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d4be180 0x558b3d4c0570 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe659ab9800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe659ab9800 20 searching for the correct realm 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe659ab9800 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x558b3d4c2c60 0x558b3d4c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4c2c60 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.008+0000 7fe6575a3640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x558b3d4c2c60 0x558b3d4c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.009+0000 7fe6575a3640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x558b3d4c2c60 0x558b3d4c5120 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.009+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.009+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4be180 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.009+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.009+0000 7fe657da4640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe650014070 0x7fe65004b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.009+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x7fe650014070 2024-09-22T08:11:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.009+0000 7fe656da2640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe650014070 0x7fe65004b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.010+0000 7fe656da2640 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe650014070 0x7fe65004b900 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.010+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c009050 con 0x7fe650014070 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.010+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4b9790 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.010+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c009050 con 0x558b3d4b9790 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.010+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4b9790 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.011+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.011+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x7fe650014070 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.011+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.011+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x7fe650014070 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.011+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.011+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4be180 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.011+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.011+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4c2c60 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.012+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.012+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4b9790 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.012+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.012+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x7fe650014070 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.012+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.012+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4b9790 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.012+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.012+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4be180 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.013+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.013+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4c2c60 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.013+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.013+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4c2c60 2024-09-22T08:11:09.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.013+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.013+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x7fe650014070 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.013+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.013+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4c2c60 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.014+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.014+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4c2c60 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.014+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.014+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4b9790 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.014+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.014+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4b9790 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.014+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.014+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x7fe650014070 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.014+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.014+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4c2c60 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.015+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.015+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4be180 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.015+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.015+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4b9790 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.015+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.015+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x7fe650014070 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.015+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.015+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4c2c60 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.016+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.016+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x7fe650014070 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.016+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.016+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4be180 2024-09-22T08:11:09.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.016+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.016+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4c2c60 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.016+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.016+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x7fe650014070 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.016+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4b9790 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c57a0 con 0x558b3d4be180 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c16a0 con 0x558b3d4b9790 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c1f40 con 0x558b3d4b9790 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.017+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c5c20 con 0x558b3d4b9790 2024-09-22T08:11:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 20 zone default found 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 4 Realm: () 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 20 zonegroup default 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c6070 con 0x7fe650014070 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c7ea0 con 0x558b3d4c2c60 2024-09-22T08:11:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.018+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c8380 con 0x558b3d4c2c60 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.019+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.019+0000 7fe659ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.019+0000 7fe659ab9800 20 started sync module instance, tier type = 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.019+0000 7fe659ab9800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.019+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c7340 con 0x558b3d4be180 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.019+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.020+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94056517236528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c6fa0 con 0x558b3d4be180 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.020+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c92b0 con 0x558b3d4b9790 2024-09-22T08:11:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.020+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94056517236528] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.021+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.021+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94056517240800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c92b0 con 0x558b3d4b9790 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.021+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c9cb0 con 0x558b3d4c2c60 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.022+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.022+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94056517244864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4ca550 con 0x558b3d4c2c60 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.022+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cb000 con 0x558b3d4be180 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.022+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94056517240800] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.023+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94056517244864] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.023+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.023+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94056517247136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4caae0 con 0x558b3d4be180 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.023+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cb8e0 con 0x558b3d4b9790 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.024+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.024+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94056517252080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cb850 con 0x558b3d4b9790 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.024+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cc8b0 con 0x7fe650014070 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.024+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94056517247136] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.025+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.025+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94056517252080] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.025+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94056517256096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cc870 con 0x7fe650014070 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.025+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cbcd0 con 0x7fe650014070 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.026+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94056517256096] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.026+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.026+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94056517242368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cce10 con 0x7fe650014070 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.026+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cd7d0 con 0x7fe650014070 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.027+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94056517242368] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.027+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.027+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94056517254352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cd7d0 con 0x7fe650014070 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.027+0000 7fe659ab9800 20 add_watcher() i=0 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.027+0000 7fe659ab9800 20 add_watcher() i=1 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.027+0000 7fe659ab9800 20 add_watcher() i=2 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.027+0000 7fe659ab9800 20 add_watcher() i=3 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.027+0000 7fe659ab9800 20 add_watcher() i=4 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.027+0000 7fe659ab9800 20 add_watcher() i=5 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.027+0000 7fe659ab9800 20 add_watcher() i=6 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.028+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94056517254352] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.028+0000 7fe659ab9800 20 add_watcher() i=7 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.028+0000 7fe659ab9800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.028+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4d0c30 con 0x558b3d4b9790 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.028+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.028+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94056517273232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cd940 con 0x558b3d4b9790 2024-09-22T08:11:09.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.029+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94056517273232] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.030+0000 7fe50dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.030+0000 7fe659ab9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:09.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.030+0000 7fe659ab9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:09.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.030+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4d9790 con 0x558b3d4b9790 2024-09-22T08:11:09.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.031+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.031+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4d9dc0 con 0x7fe650014070 2024-09-22T08:11:09.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.032+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.032+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4da220 con 0x558b3d4c2c60 2024-09-22T08:11:09.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.033+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.033+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4da790 con 0x558b3d4b9790 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.034+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'135 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.034+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4dabd0 con 0x558b3d4be180 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.035+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.035+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4dab60 con 0x558b3d4c2c60 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.035+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.035+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db1b0 con 0x558b3d4b9790 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.036+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.037+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db010 con 0x7fe650014070 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.037+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.037+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db010 con 0x558b3d4be180 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.038+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.038+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db010 con 0x558b3d4c2c60 2024-09-22T08:11:09.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.039+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.039+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db010 con 0x558b3d4be180 2024-09-22T08:11:09.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.040+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.040+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db010 con 0x7fe650014070 2024-09-22T08:11:09.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.040+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.040+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db010 con 0x558b3d4be180 2024-09-22T08:11:09.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.041+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.041+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db030 con 0x7fe650014070 2024-09-22T08:11:09.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.042+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.042+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db030 con 0x558b3d4b9790 2024-09-22T08:11:09.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.043+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.043+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db050 con 0x558b3d4c2c60 2024-09-22T08:11:09.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.044+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.044+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db0e0 con 0x558b3d4be180 2024-09-22T08:11:09.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.045+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.045+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db0e0 con 0x558b3d4c2c60 2024-09-22T08:11:09.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.046+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.046+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db0e0 con 0x558b3d4b9790 2024-09-22T08:11:09.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.047+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.047+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db0e0 con 0x558b3d4b9790 2024-09-22T08:11:09.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.048+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.048+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db0e0 con 0x558b3d4c2c60 2024-09-22T08:11:09.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.049+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.049+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db180 con 0x558b3d4be180 2024-09-22T08:11:09.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.050+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.050+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db180 con 0x558b3d4c2c60 2024-09-22T08:11:09.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.051+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.051+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db1a0 con 0x558b3d4c2c60 2024-09-22T08:11:09.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.052+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.052+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db1e0 con 0x558b3d4c2c60 2024-09-22T08:11:09.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.053+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.053+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db1e0 con 0x558b3d4c2c60 2024-09-22T08:11:09.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.054+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.054+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db220 con 0x7fe650014070 2024-09-22T08:11:09.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.055+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.055+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db260 con 0x558b3d4c2c60 2024-09-22T08:11:09.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.056+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.056+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db260 con 0x7fe650014070 2024-09-22T08:11:09.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.057+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.057+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db260 con 0x558b3d4c2c60 2024-09-22T08:11:09.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.058+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.058+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db290 con 0x7fe650014070 2024-09-22T08:11:09.061 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.059+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.061 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.059+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4db290 con 0x558b3d4be180 2024-09-22T08:11:09.061 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.060+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.060+0000 7fe50cfe1640 20 reqs_thread_entry: start 2024-09-22T08:11:09.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.060+0000 7fe659ab9800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:09.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.060+0000 7fe659ab9800 20 Filter name: none 2024-09-22T08:11:09.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.060+0000 7fe4867fc640 20 reqs_thread_entry: start 2024-09-22T08:11:09.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.060+0000 7fe659ab9800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-22T08:11:09.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.060+0000 7fe659ab9800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.060+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d5061a0 con 0x7fe650014070 2024-09-22T08:11:09.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.061+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.061+0000 7fe659ab9800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T08:11:09.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.061+0000 7fe659ab9800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-22T08:11:09.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.061+0000 7fe659ab9800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-22T08:11:09.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.061+0000 7fe659ab9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:09.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.061+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d5061a0 con 0x558b3d4b9790 2024-09-22T08:11:09.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.061+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.061+0000 7fe659ab9800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-22T08:11:09.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.061+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d5061a0 con 0x7fe650014070 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.062+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.062+0000 7fe659ab9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.062+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94056517498544 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d5090c0 con 0x558b3d4c2c60 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.062+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== watch-notify(notify (1) cookie 94056517244864 notify 137438953477 ret 0) ==== 212+0+0 (crc 0 0 0) 0x558b3d4da760 con 0x558b3d4c2c60 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.062+0000 7fe53affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94056517244864 notifier 4563 bl.length()=170 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.062+0000 7fe53affd640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe51c003d60 con 0x558b3d4c2c60 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.063+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(97 notify.2 [notify cookie 94056517498544 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.063+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.063+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== watch-notify(notify_complete (2) cookie 94056517498544 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558b3d4d9da0 con 0x558b3d4c2c60 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.063+0000 7fe659ab9800 10 removing email index: 2024-09-22T08:11:09.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.063+0000 7fe659ab9800 10 removing user buckets index 2024-09-22T08:11:09.067 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.063+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d506b50 con 0x558b3d4b9790 2024-09-22T08:11:09.067 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.067 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe659ab9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-22T08:11:09.067 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94056517494432 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d506ac0 con 0x558b3d4b9790 2024-09-22T08:11:09.067 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== watch-notify(notify (1) cookie 94056517252080 notify 137438953491 ret 0) ==== 217+0+0 (crc 0 0 0) 0x558b3d4d9170 con 0x558b3d4b9790 2024-09-22T08:11:09.067 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe53a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94056517252080 notifier 4563 bl.length()=175 2024-09-22T08:11:09.067 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(100 notify.4 [notify cookie 94056517494432 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.067 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe53a7fc640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe48c0032c0 con 0x558b3d4b9790 2024-09-22T08:11:09.068 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== watch-notify(notify_complete (2) cookie 94056517494432 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558b3d4da1d0 con 0x558b3d4b9790 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe659ab9800 10 removing user index: testx$tenanteduser 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.064+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d507f60 con 0x7fe650014070 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.065+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.065+0000 7fe659ab9800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.065+0000 7fe659ab9800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.065+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94056517502080 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b3d507f60 con 0x558b3d4be180 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.066+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== watch-notify(notify (1) cookie 94056517247136 notify 137438953485 ret 0) ==== 209+0+0 (crc 0 0 0) 0x558b3d4aee40 con 0x558b3d4be180 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.066+0000 7fe53affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94056517247136 notifier 4563 bl.length()=167 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.066+0000 7fe53affd640 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe51c003d60 con 0x558b3d4be180 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.066+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(103 notify.3 [notify cookie 94056517502080 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.066+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.066+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== watch-notify(notify_complete (2) cookie 94056517502080 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558b3d4ae4c0 con 0x558b3d4be180 2024-09-22T08:11:09.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.067+0000 7fe50dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.067+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94056517273232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d5066a0 con 0x558b3d4b9790 2024-09-22T08:11:09.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.068+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94056517273232] v32'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.068+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94056517236528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4d0690 con 0x558b3d4be180 2024-09-22T08:11:09.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.069+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94056517236528] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.069+0000 7fe659ab9800 20 remove_watcher() i=0 2024-09-22T08:11:09.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.069+0000 7fe659ab9800 2 removed watcher, disabling cache 2024-09-22T08:11:09.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.069+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94056517240800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c7730 con 0x558b3d4b9790 2024-09-22T08:11:09.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.070+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94056517240800] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.070+0000 7fe659ab9800 20 remove_watcher() i=1 2024-09-22T08:11:09.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.070+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94056517244864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c7730 con 0x558b3d4c2c60 2024-09-22T08:11:09.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.071+0000 7fe6575a3640 1 -- 172.21.15.165:0/742794605 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94056517244864] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe648051070 con 0x558b3d4c2c60 2024-09-22T08:11:09.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.071+0000 7fe659ab9800 20 remove_watcher() i=2 2024-09-22T08:11:09.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.071+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94056517247136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c7730 con 0x558b3d4be180 2024-09-22T08:11:09.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.072+0000 7fe657da4640 1 -- 172.21.15.165:0/742794605 <== osd.2 v2:172.21.15.165:6808/3197121696 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94056517247136] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe65002a070 con 0x558b3d4be180 2024-09-22T08:11:09.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.072+0000 7fe659ab9800 20 remove_watcher() i=3 2024-09-22T08:11:09.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.072+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94056517252080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c7730 con 0x558b3d4b9790 2024-09-22T08:11:09.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.073+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.1 v2:172.21.15.165:6816/2347568643 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94056517252080] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x558b3d4b9790 2024-09-22T08:11:09.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.073+0000 7fe659ab9800 20 remove_watcher() i=4 2024-09-22T08:11:09.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.073+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94056517256096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cb3f0 con 0x7fe650014070 2024-09-22T08:11:09.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.074+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94056517256096] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.074+0000 7fe659ab9800 20 remove_watcher() i=5 2024-09-22T08:11:09.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.074+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94056517242368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4cb3f0 con 0x7fe650014070 2024-09-22T08:11:09.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.075+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94056517242368] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.075+0000 7fe659ab9800 20 remove_watcher() i=6 2024-09-22T08:11:09.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.075+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94056517254352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b3d4c8e00 con 0x7fe650014070 2024-09-22T08:11:09.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94056517254352] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64c029040 con 0x7fe650014070 2024-09-22T08:11:09.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 20 remove_watcher() i=7 2024-09-22T08:11:09.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe650014070 msgr2=0x7fe65004b900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe650014070 0x7fe65004b900 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d4b9790 msgr2=0x558b3d4bbc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d4b9790 0x558b3d4bbc50 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d4be180 msgr2=0x558b3d4c0570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d4be180 0x558b3d4c0570 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x558b3d4c2c60 msgr2=0x558b3d4c5120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x558b3d4c2c60 0x558b3d4c5120 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe52003cfb0 msgr2=0x7fe52003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe52003cfb0 0x7fe52003f470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x558b3d48b640 tx=0x7fe648087000 comp rx=0 tx=0).stop 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 msgr2=0x558b3d4adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe656da2640 1 -- 172.21.15.165:0/742794605 reap_dead start 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4adcd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe6500016e0 tx=0x7fe650054720 comp rx=0 tx=0).stop 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 shutdown_connections 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 --2- 172.21.15.165:0/742794605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d4a6690 0x558b3d4adcd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 >> 172.21.15.165:0/742794605 conn(0x558b3d4a2a90 msgr2=0x558b3d4a0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 shutdown_connections 2024-09-22T08:11:09.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.076+0000 7fe659ab9800 1 -- 172.21.15.165:0/742794605 wait complete. 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1890212874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53003cfb0 msgr2=0x7fe53003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1890212874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53003cfb0 0x7fe53003f470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x558b3d4833d0 tx=0x7fe64807cf90 comp rx=0 tx=0).stop 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1890212874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d499bf0 msgr2=0x558b3d49a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1890212874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d499bf0 0x558b3d49a010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x558b3d2f84e0 tx=0x7fe650018830 comp rx=0 tx=0).stop 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1890212874 shutdown_connections 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1890212874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53003cfb0 0x7fe53003f470 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1890212874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d499bf0 0x558b3d49a010 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1890212874 >> 172.21.15.165:0/1890212874 conn(0x558b3d48dfa0 msgr2=0x558b3d48e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1890212874 shutdown_connections 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1890212874 wait complete. 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d385a20 msgr2=0x558b3d485dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d385a20 0x558b3d485dd0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d488610 msgr2=0x558b3d48aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d488610 0x558b3d48aab0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53c03d000 msgr2=0x7fe53c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53c03d000 0x7fe53c03f4c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe64c001d70 tx=0x7fe64c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 msgr2=0x558b3d2f88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d2f88a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe648025c20 tx=0x7fe648002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 shutdown_connections 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558b3d488610 0x558b3d48aab0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x558b3d385a20 0x558b3d485dd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe53c03d000 0x7fe53c03f4c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 --2- 172.21.15.165:0/1967278874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b3d3847e0 0x558b3d2f88a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 >> 172.21.15.165:0/1967278874 conn(0x558b3d37fbb0 msgr2=0x558b3d46e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 shutdown_connections 2024-09-22T08:11:09.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.077+0000 7fe659ab9800 1 -- 172.21.15.165:0/1967278874 wait complete. 2024-09-22T08:11:09.094 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-22T08:11:09.097 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-22T08:11:09.099 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:09.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-22T08:11:09.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-22T08:11:09.100 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-22T08:11:09.146 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:09.146 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:09.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.145+0000 7f3f5cf40800 1 Processor -- start 2024-09-22T08:11:09.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.145+0000 7f3f5cf40800 1 -- start start 2024-09-22T08:11:09.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.145+0000 7f3f5cf40800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e2dea9abe0 0x55e2dea9d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.145+0000 7f3f5cf40800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2de91fa20 con 0x55e2dea07cf0 2024-09-22T08:11:09.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.145+0000 7f3f5cf40800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e2de91f7d0 con 0x55e2dea9abe0 2024-09-22T08:11:09.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.146+0000 7f3f504bf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e2dea9abe0 0x55e2dea9d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.146+0000 7f3f504bf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e2dea9abe0 0x55e2dea9d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52928/0 (socket says 172.21.15.165:52928) 2024-09-22T08:11:09.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.146+0000 7f3f504bf640 1 -- 172.21.15.165:0/3433325343 learned_addr learned my addr 172.21.15.165:0/3433325343 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.146+0000 7f3f58cc0640 1 --1- 172.21.15.165:0/3433325343 >> v1:172.21.15.53:6789/0 conn(0x55e2dea07cf0 0x55e2dea994c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33832/0 (socket says 172.21.15.165:33832) 2024-09-22T08:11:09.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.146+0000 7f3f504bf640 1 -- 172.21.15.165:0/3433325343 >> v1:172.21.15.53:6789/0 conn(0x55e2dea07cf0 legacy=0x55e2dea994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.146+0000 7f3f504bf640 1 -- 172.21.15.165:0/3433325343 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2dea9e780 con 0x55e2dea9abe0 2024-09-22T08:11:09.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.148+0000 7f3f504bf640 1 --2- 172.21.15.165:0/3433325343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea9abe0 0x55e2dea9d0a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000a520 tx=0x7f3f40045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ccd2fdab301c71 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.148+0000 7f3f53fff640 1 -- 172.21.15.165:0/3433325343 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40055070 con 0x55e2dea9abe0 2024-09-22T08:11:09.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.148+0000 7f3f53fff640 1 -- 172.21.15.165:0/3433325343 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f400515b0 con 0x55e2dea9abe0 2024-09-22T08:11:09.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.148+0000 7f3f53fff640 1 -- 172.21.15.165:0/3433325343 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f400518d0 con 0x55e2dea9abe0 2024-09-22T08:11:09.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.148+0000 7f3f5cf40800 1 -- 172.21.15.165:0/3433325343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea9abe0 msgr2=0x55e2dea9d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.148+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/3433325343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea9abe0 0x55e2dea9d0a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000a520 tx=0x7f3f40045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.148+0000 7f3f5cf40800 1 -- 172.21.15.165:0/3433325343 shutdown_connections 2024-09-22T08:11:09.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.148+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/3433325343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea9abe0 0x55e2dea9d0a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.148+0000 7f3f5cf40800 1 -- 172.21.15.165:0/3433325343 >> 172.21.15.165:0/3433325343 conn(0x55e2dea8ebb0 msgr2=0x55e2dea91010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.149+0000 7f3f5cf40800 1 -- 172.21.15.165:0/3433325343 shutdown_connections 2024-09-22T08:11:09.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.149+0000 7f3f5cf40800 1 -- 172.21.15.165:0/3433325343 wait complete. 2024-09-22T08:11:09.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.163+0000 7f3f5cf40800 1 Processor -- start 2024-09-22T08:11:09.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.163+0000 7f3f5cf40800 1 -- start start 2024-09-22T08:11:09.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.163+0000 7f3f5cf40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb86220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.163+0000 7f3f5cf40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e2de92cdd0 con 0x55e2dea07cf0 2024-09-22T08:11:09.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.163+0000 7f3f58cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb86220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.163+0000 7f3f58cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb86220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52930/0 (socket says 172.21.15.165:52930) 2024-09-22T08:11:09.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.163+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1425517124 learned_addr learned my addr 172.21.15.165:0/1425517124 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.163+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1425517124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2deb86810 con 0x55e2dea07cf0 2024-09-22T08:11:09.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.164+0000 7f3f58cc0640 1 --2- 172.21.15.165:0/1425517124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb86220 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3f48001eb0 tx=0x7f3f4800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76de7625b2c55b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.164+0000 7f3e46e0d640 1 -- 172.21.15.165:0/1425517124 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4800e5c0 con 0x55e2dea07cf0 2024-09-22T08:11:09.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.164+0000 7f3e46e0d640 1 -- 172.21.15.165:0/1425517124 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f48006070 con 0x55e2dea07cf0 2024-09-22T08:11:09.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.164+0000 7f3e46e0d640 1 -- 172.21.15.165:0/1425517124 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4800e8b0 con 0x55e2dea07cf0 2024-09-22T08:11:09.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1425517124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 msgr2=0x55e2deb86220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1425517124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb86220 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3f48001eb0 tx=0x7f3f4800b6c0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1425517124 shutdown_connections 2024-09-22T08:11:09.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1425517124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb86220 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1425517124 >> 172.21.15.165:0/1425517124 conn(0x55e2dea8ebb0 msgr2=0x55e2deb81ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1425517124 shutdown_connections 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1425517124 wait complete. 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 Processor -- start 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 -- start start 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb8dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f5cf40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e2dea9da20 con 0x55e2dea07cf0 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f58cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb8dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f58cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb8dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52936/0 (socket says 172.21.15.165:52936) 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.165+0000 7f3f58cc0640 1 -- 172.21.15.165:0/469233585 learned_addr learned my addr 172.21.15.165:0/469233585 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.166+0000 7f3f58cc0640 1 -- 172.21.15.165:0/469233585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2deb8e290 con 0x55e2dea07cf0 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.166+0000 7f3f58cc0640 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb8dd30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x55e2deb871b0 tx=0x7f3f48000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.166+0000 7f3e4560a640 1 -- 172.21.15.165:0/469233585 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4801a7c0 con 0x55e2dea07cf0 2024-09-22T08:11:09.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.166+0000 7f3e4560a640 1 -- 172.21.15.165:0/469233585 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4801a960 con 0x55e2dea07cf0 2024-09-22T08:11:09.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.166+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2deb8e520 con 0x55e2dea07cf0 2024-09-22T08:11:09.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.166+0000 7f3e4560a640 1 -- 172.21.15.165:0/469233585 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4801ac40 con 0x55e2dea07cf0 2024-09-22T08:11:09.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.166+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2deb8eea0 con 0x55e2dea07cf0 2024-09-22T08:11:09.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.167+0000 7f3e4560a640 1 -- 172.21.15.165:0/469233585 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3f48017070 con 0x55e2dea07cf0 2024-09-22T08:11:09.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.167+0000 7f3e4560a640 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e4003cfb0 0x7f3e4003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.167+0000 7f3e4560a640 1 -- 172.21.15.165:0/469233585 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3f48015020 con 0x55e2dea07cf0 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.167+0000 7f3f504bf640 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e4003cfb0 0x7f3e4003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.168+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2dea9abe0 0x55e2deb95380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.168+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2deb958c0 con 0x55e2dea9abe0 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.168+0000 7f3f594c1640 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2dea9abe0 0x55e2deb95380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.168+0000 7f3f504bf640 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e4003cfb0 0x7f3e4003f470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f40057000 tx=0x7f3f40052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.168+0000 7f3f594c1640 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2dea9abe0 0x55e2deb95380 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.168+0000 7f3f594c1640 1 -- 172.21.15.165:0/469233585 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f5400a4d0 con 0x55e2dea9abe0 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.168+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2deb95c60 con 0x55e2dea9abe0 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.169+0000 7f3f594c1640 1 -- 172.21.15.165:0/469233585 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f5400a4d0 con 0x55e2dea9abe0 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.169+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2deb97720 0x55e2deb99bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.169+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2deb9a350 con 0x55e2deb97720 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.169+0000 7f3f58cc0640 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2deb97720 0x55e2deb99bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.169+0000 7f3f58cc0640 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2deb97720 0x55e2deb99bc0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.169+0000 7f3f58cc0640 1 -- 172.21.15.165:0/469233585 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f4802e070 con 0x55e2deb97720 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.169+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2deb964b0 con 0x55e2dea9abe0 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.170+0000 7f3f594c1640 1 -- 172.21.15.165:0/469233585 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f5400a4d0 con 0x55e2dea9abe0 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.170+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2deb968a0 con 0x55e2dea9abe0 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.170+0000 7f3f594c1640 1 -- 172.21.15.165:0/469233585 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3f5400a4d0 con 0x55e2dea9abe0 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.170+0000 7f3f5cf40800 1 Processor -- start 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.171+0000 7f3f5cf40800 1 -- start start 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.171+0000 7f3f5cf40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2deba8cb0 0x55e2deba90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.171+0000 7f3f5cf40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e2de98bd50 con 0x55e2deba8cb0 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.171+0000 7f3f594c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2deba8cb0 0x55e2deba90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.171+0000 7f3f594c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2deba8cb0 0x55e2deba90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52944/0 (socket says 172.21.15.165:52944) 2024-09-22T08:11:09.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.171+0000 7f3f594c1640 1 -- 172.21.15.165:0/2959678317 learned_addr learned my addr 172.21.15.165:0/2959678317 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.171+0000 7f3f594c1640 1 -- 172.21.15.165:0/2959678317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2deba9710 con 0x55e2deba8cb0 2024-09-22T08:11:09.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.171+0000 7f3f594c1640 1 --2- 172.21.15.165:0/2959678317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2deba8cb0 0x55e2deba90d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400a2a0 tx=0x7f3f54018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.171+0000 7f3e3e7fc640 1 -- 172.21.15.165:0/2959678317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f54014450 con 0x55e2deba8cb0 2024-09-22T08:11:09.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.172+0000 7f3e3e7fc640 1 -- 172.21.15.165:0/2959678317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f540145f0 con 0x55e2deba8cb0 2024-09-22T08:11:09.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.172+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2959678317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2deba9f40 con 0x55e2deba8cb0 2024-09-22T08:11:09.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.172+0000 7f3e3e7fc640 1 -- 172.21.15.165:0/2959678317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f54014910 con 0x55e2deba8cb0 2024-09-22T08:11:09.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.172+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2959678317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2debaa4e0 con 0x55e2deba8cb0 2024-09-22T08:11:09.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.172+0000 7f3e3e7fc640 1 -- 172.21.15.165:0/2959678317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3f54011040 con 0x55e2deba8cb0 2024-09-22T08:11:09.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.173+0000 7f3e3e7fc640 1 --2- 172.21.15.165:0/2959678317 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e3003d000 0x7f3e3003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.173+0000 7f3e3e7fc640 1 -- 172.21.15.165:0/2959678317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3f5401e070 con 0x55e2deba8cb0 2024-09-22T08:11:09.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.173+0000 7f3f58cc0640 1 --2- 172.21.15.165:0/2959678317 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e3003d000 0x7f3e3003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.173+0000 7f3f5cf40800 1 Processor -- start 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.173+0000 7f3f58cc0640 1 --2- 172.21.15.165:0/2959678317 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e3003d000 0x7f3e3003f4c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f48053310 tx=0x7f3f4801c640 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.173+0000 7f3f5cf40800 1 -- start start 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.173+0000 7f3f5cf40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debb5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.173+0000 7f3f5cf40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e2deb86c40 con 0x55e2debb56d0 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.173+0000 7f3f594c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debb5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.173+0000 7f3f594c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debb5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52948/0 (socket says 172.21.15.165:52948) 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.174+0000 7f3f594c1640 1 -- 172.21.15.165:0/2144864027 learned_addr learned my addr 172.21.15.165:0/2144864027 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.174+0000 7f3f594c1640 1 -- 172.21.15.165:0/2144864027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2debb60c0 con 0x55e2debb56d0 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.174+0000 7f3f594c1640 1 --2- 172.21.15.165:0/2144864027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debb5ad0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3f54018430 tx=0x7f3f54001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591f23ecb2640b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.174+0000 7f3e2ffff640 1 -- 172.21.15.165:0/2144864027 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f54051020 con 0x55e2debb56d0 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.174+0000 7f3e2ffff640 1 -- 172.21.15.165:0/2144864027 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f54022df0 con 0x55e2debb56d0 2024-09-22T08:11:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.174+0000 7f3e2ffff640 1 -- 172.21.15.165:0/2144864027 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f54028070 con 0x55e2debb56d0 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2144864027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 msgr2=0x55e2debb5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/2144864027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debb5ad0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3f54018430 tx=0x7f3f54001440 comp rx=0 tx=0).stop 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2144864027 shutdown_connections 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/2144864027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debb5ad0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2144864027 >> 172.21.15.165:0/2144864027 conn(0x55e2debb1ad0 msgr2=0x55e2debafd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2144864027 shutdown_connections 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2144864027 wait complete. 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 Processor -- start 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 -- start start 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debbccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.175+0000 7f3f5cf40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e2debb66e0 con 0x55e2debb56d0 2024-09-22T08:11:09.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.176+0000 7f3f594c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debbccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.176+0000 7f3f594c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debbccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52960/0 (socket says 172.21.15.165:52960) 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.176+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 learned_addr learned my addr 172.21.15.165:0/1907787915 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.176+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2debbd250 con 0x55e2debb56d0 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.176+0000 7f3f594c1640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debbccf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3f54018430 tx=0x7f3f54011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.176+0000 7f3e2e7fc640 1 -- 172.21.15.165:0/1907787915 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f54031020 con 0x55e2debb56d0 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.176+0000 7f3e2e7fc640 1 -- 172.21.15.165:0/1907787915 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f54011330 con 0x55e2debb56d0 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.176+0000 7f3e2e7fc640 1 -- 172.21.15.165:0/1907787915 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f54045900 con 0x55e2debb56d0 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.176+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2debbd4e0 con 0x55e2debb56d0 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.176+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2debbde60 con 0x55e2debb56d0 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.177+0000 7f3e2e7fc640 1 -- 172.21.15.165:0/1907787915 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3f54034020 con 0x55e2debb56d0 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.177+0000 7f3e2e7fc640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e2403cfb0 0x7f3e2403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.177+0000 7f3e2e7fc640 1 -- 172.21.15.165:0/1907787915 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3f5400e040 con 0x55e2debb56d0 2024-09-22T08:11:09.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.177+0000 7f3f58cc0640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e2403cfb0 0x7f3e2403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.178+0000 7f3f58cc0640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e2403cfb0 0x7f3e2403f470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3f4801bc30 tx=0x7f3f4804e070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.178+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.178+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2debc8840 0x55e2debcad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.178+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debcb450 con 0x55e2debc8840 2024-09-22T08:11:09.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.178+0000 7f3f504bf640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2debc8840 0x55e2debcad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f504bf640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2debc8840 0x55e2debcad00 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 20 realm 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debcb880 con 0x55e2debc8840 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debcc150 con 0x55e2debc8840 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.179+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debcc4f0 con 0x55e2debc8840 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f5cf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2debcd250 0x55e2debcf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debcfc50 con 0x55e2debcd250 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f594c1640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2debcd250 0x55e2debcf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f594c1640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2debcd250 0x55e2debcf640 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f5cf40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f5cf40800 20 searching for the correct realm 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e2debd1c20 0x55e2debd40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.180+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debd1c20 2024-09-22T08:11:09.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.181+0000 7f3f58cc0640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e2debd1c20 0x55e2debd40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.181+0000 7f3f58cc0640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e2debd1c20 0x55e2debd40e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.181+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.181+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debcd250 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.181+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.181+0000 7f3f594c1640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3f54036020 0x7f3f540179e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.181+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x7f3f54036020 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.182+0000 7f3f504bf640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3f54036020 0x7f3f540179e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.182+0000 7f3f504bf640 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3f54036020 0x7f3f540179e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.182+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x7f3f54036020 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.182+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debc8840 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.183+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.183+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debc8840 2024-09-22T08:11:09.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.183+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.183+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x7f3f54036020 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.183+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x7f3f54036020 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.183+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x7f3f54036020 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.183+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x7f3f54036020 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.183+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debcd250 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.184+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.184+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debd1c20 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.184+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.184+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debc8840 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.184+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.184+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x7f3f54036020 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.184+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x7f3f54036020 2024-09-22T08:11:09.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.184+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debc8840 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.185+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.185+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debcd250 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.185+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.185+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debd1c20 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.185+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.185+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debd1c20 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.185+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.185+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x7f3f54036020 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.186+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x7f3f54036020 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.186+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debd1c20 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.186+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.186+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debd1c20 2024-09-22T08:11:09.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.186+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.186+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debc8840 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.186+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.186+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debc8840 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.186+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.186+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x7f3f54036020 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.187+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x7f3f54036020 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.187+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debd1c20 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.187+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.187+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debcd250 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.187+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.187+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debc8840 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.187+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.187+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x7f3f54036020 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.188+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x7f3f54036020 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.188+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debd1c20 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.188+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.188+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x7f3f54036020 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.188+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x7f3f54036020 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.188+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debcd250 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.188+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.189+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debd1c20 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.189+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.189+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x7f3f54036020 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.189+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40057030 con 0x7f3f54036020 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.189+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debc8840 2024-09-22T08:11:09.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.189+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.189+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4760 con 0x55e2debcd250 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.189+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.189+0000 7f3f5cf40800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd0610 con 0x55e2debc8840 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd0eb0 con 0x55e2debc8840 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f40057030 con 0x55e2debc8840 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4be0 con 0x55e2debc8840 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 zone default found 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 4 Realm: () 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 zonegroup default 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.190+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd4f80 con 0x7f3f54036020 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f5cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd6d90 con 0x55e2debd1c20 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f5cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd71e0 con 0x55e2debd1c20 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f5cf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f5cf40800 20 started sync module instance, tier type = 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f5cf40800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.191+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd6230 con 0x55e2debcd250 2024-09-22T08:11:09.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.192+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.192+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94432887924256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd5e90 con 0x55e2debcd250 2024-09-22T08:11:09.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.193+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd8110 con 0x55e2debc8840 2024-09-22T08:11:09.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.194+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.194+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94432887929952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd8570 con 0x55e2debc8840 2024-09-22T08:11:09.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.194+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd9070 con 0x55e2debd1c20 2024-09-22T08:11:09.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.194+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94432887924256] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.195+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94432887929952] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.195+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.195+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94432887933792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd8080 con 0x55e2debd1c20 2024-09-22T08:11:09.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.195+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd9a80 con 0x55e2debcd250 2024-09-22T08:11:09.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.196+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94432887933792] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.196+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.196+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94432887936464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd9ea0 con 0x55e2debcd250 2024-09-22T08:11:09.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.196+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debda730 con 0x55e2debc8840 2024-09-22T08:11:09.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.197+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94432887936464] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.197+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.197+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94432887937520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debda2c0 con 0x55e2debc8840 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.197+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debdb1b0 con 0x7f3f54036020 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.198+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.198+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94432887937520] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.198+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94432887942336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debdb0e0 con 0x7f3f54036020 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.198+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd9e30 con 0x7f3f54036020 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.199+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94432887942336] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.199+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.199+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94432887938608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debdbbf0 con 0x7f3f54036020 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.199+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debdc5b0 con 0x7f3f54036020 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.200+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.200+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94432887938608] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.200+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94432887947520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debdc520 con 0x7f3f54036020 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.200+0000 7f3f5cf40800 20 add_watcher() i=0 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.200+0000 7f3f5cf40800 20 add_watcher() i=1 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.200+0000 7f3f5cf40800 20 add_watcher() i=2 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.200+0000 7f3f5cf40800 20 add_watcher() i=3 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.200+0000 7f3f5cf40800 20 add_watcher() i=4 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.200+0000 7f3f5cf40800 20 add_watcher() i=5 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.200+0000 7f3f5cf40800 20 add_watcher() i=6 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.201+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94432887947520] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.201+0000 7f3f5cf40800 20 add_watcher() i=7 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.201+0000 7f3f5cf40800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.201+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2debdfeb0 con 0x55e2debc8840 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.202+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.202+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94432887949648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debdd330 con 0x55e2debc8840 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.203+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94432887949648] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.203+0000 7f3e0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.203+0000 7f3f5cf40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.203+0000 7f3f5cf40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.203+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe8680 con 0x55e2debc8840 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.204+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.204+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe8680 con 0x7f3f54036020 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.205+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.205+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe90c0 con 0x55e2debd1c20 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.206+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.206+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe9910 con 0x55e2debc8840 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.207+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'140 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.207+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe6ce0 con 0x55e2debcd250 2024-09-22T08:11:09.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.208+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.208+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe6ce0 con 0x55e2debd1c20 2024-09-22T08:11:09.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.209+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.209+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe6ce0 con 0x55e2debc8840 2024-09-22T08:11:09.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.210+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.210+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe6ce0 con 0x7f3f54036020 2024-09-22T08:11:09.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.211+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.211+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe6ce0 con 0x55e2debcd250 2024-09-22T08:11:09.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.213+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.213+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe6db0 con 0x55e2debd1c20 2024-09-22T08:11:09.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.213+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.214+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe6db0 con 0x55e2debcd250 2024-09-22T08:11:09.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.214+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.215+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe6db0 con 0x7f3f54036020 2024-09-22T08:11:09.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.216+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.216+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debe6db0 con 0x55e2debcd250 2024-09-22T08:11:09.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.217+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.217+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x7f3f54036020 2024-09-22T08:11:09.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.218+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.218+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debc8840 2024-09-22T08:11:09.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.219+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.219+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debd1c20 2024-09-22T08:11:09.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.220+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.220+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debcd250 2024-09-22T08:11:09.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.221+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.221+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debd1c20 2024-09-22T08:11:09.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.222+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.222+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debc8840 2024-09-22T08:11:09.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.223+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.223+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debc8840 2024-09-22T08:11:09.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.224+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.224+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debd1c20 2024-09-22T08:11:09.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.225+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.225+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debcd250 2024-09-22T08:11:09.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.226+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.226+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debd1c20 2024-09-22T08:11:09.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.227+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.227+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debd1c20 2024-09-22T08:11:09.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.228+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.228+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debd1c20 2024-09-22T08:11:09.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.228+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.228+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debd1c20 2024-09-22T08:11:09.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.229+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.229+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x7f3f54036020 2024-09-22T08:11:09.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.230+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.230+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debd1c20 2024-09-22T08:11:09.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.231+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.231+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x7f3f54036020 2024-09-22T08:11:09.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.232+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.232+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debd1c20 2024-09-22T08:11:09.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.233+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.233+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x7f3f54036020 2024-09-22T08:11:09.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.234+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.234+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debea470 con 0x55e2debcd250 2024-09-22T08:11:09.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.235+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3e0e7e4640 20 reqs_thread_entry: start 2024-09-22T08:11:09.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:09.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 20 Filter name: none 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3e07fff640 20 reqs_thread_entry: start 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2dec15380 con 0x55e2debcd250 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 : miss 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.236+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:95 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2dec16d80 con 0x7f3f54036020 2024-09-22T08:11:09.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(95 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 20 get_obj_state: octx=0x7f3f40051bb0 obj=myfoo:four state=0x55e2dec17af8 s->prefetch_data=0 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:96 3.36s0 3:6cc5e6d0:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1_four:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2dec19d70 con 0x55e2debcd250 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(96 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1_four [call out=24b,getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 276+0+898 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 10 manifest: total_size = 4 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 20 get_obj_state: setting s->obj_tag to cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7570586972405375817 2024-09-22T08:11:09.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 20 get_obj_state: octx=0x7f3f40051bb0 obj=myfoo:four state=0x55e2dec17af8 s->prefetch_data=0 2024-09-22T08:11:09.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 20 prepare_atomic_modification: state is not atomic. state=0x55e2dec17af8 2024-09-22T08:11:09.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 20 bucket index object: :.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6 2024-09-22T08:11:09.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.237+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:97 4.2f 4:f6147bda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2dec1daa0 con 0x55e2debc8840 2024-09-22T08:11:09.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.238+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(97 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.238+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:98 3.36s0 3:6cc5e6d0:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2dec1daa0 con 0x55e2debcd250 2024-09-22T08:11:09.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.240+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(98 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.240+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:99 4.2f 4:f6147bda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2dec1e530 con 0x55e2debc8840 2024-09-22T08:11:09.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.241+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(99 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.241+0000 7f3e2ffff640 20 handle_completion(): completion ok for obj=four 2024-09-22T08:11:09.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.241+0000 7f3e0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.241+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94432887949648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2dec1e530 con 0x55e2debc8840 2024-09-22T08:11:09.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.242+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94432887949648] v32'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.242+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94432887924256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2dec1e530 con 0x55e2debcd250 2024-09-22T08:11:09.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.243+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94432887924256] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.243+0000 7f3f5cf40800 20 remove_watcher() i=0 2024-09-22T08:11:09.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.243+0000 7f3f5cf40800 2 removed watcher, disabling cache 2024-09-22T08:11:09.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.243+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94432887929952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd6620 con 0x55e2debc8840 2024-09-22T08:11:09.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.244+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94432887929952] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.244+0000 7f3f5cf40800 20 remove_watcher() i=1 2024-09-22T08:11:09.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.244+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94432887933792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd7c60 con 0x55e2debd1c20 2024-09-22T08:11:09.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.245+0000 7f3f58cc0640 1 -- 172.21.15.165:0/1907787915 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94432887933792] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4803b070 con 0x55e2debd1c20 2024-09-22T08:11:09.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.245+0000 7f3f5cf40800 20 remove_watcher() i=2 2024-09-22T08:11:09.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.245+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94432887936464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd6620 con 0x55e2debcd250 2024-09-22T08:11:09.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.246+0000 7f3f594c1640 1 -- 172.21.15.165:0/1907787915 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94432887936464] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f5402a070 con 0x55e2debcd250 2024-09-22T08:11:09.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.246+0000 7f3f5cf40800 20 remove_watcher() i=3 2024-09-22T08:11:09.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.246+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94432887937520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd8b60 con 0x55e2debc8840 2024-09-22T08:11:09.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.247+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94432887937520] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x55e2debc8840 2024-09-22T08:11:09.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.247+0000 7f3f5cf40800 20 remove_watcher() i=4 2024-09-22T08:11:09.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.247+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94432887942336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd7c60 con 0x7f3f54036020 2024-09-22T08:11:09.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.248+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94432887942336] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.248+0000 7f3f5cf40800 20 remove_watcher() i=5 2024-09-22T08:11:09.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.248+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94432887938608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd6620 con 0x7f3f54036020 2024-09-22T08:11:09.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.249+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94432887938608] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.249+0000 7f3f5cf40800 20 remove_watcher() i=6 2024-09-22T08:11:09.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.249+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94432887947520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2debd8b60 con 0x7f3f54036020 2024-09-22T08:11:09.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94432887947520] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f400881c0 con 0x7f3f54036020 2024-09-22T08:11:09.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 20 remove_watcher() i=7 2024-09-22T08:11:09.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3f54036020 msgr2=0x7f3f540179e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f3f54036020 0x7f3f540179e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2debc8840 msgr2=0x55e2debcad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2debc8840 0x55e2debcad00 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2debcd250 msgr2=0x55e2debcf640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2debcd250 0x55e2debcf640 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e2debd1c20 msgr2=0x55e2debd40e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e2debd1c20 0x55e2debd40e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e2403cfb0 msgr2=0x7f3e2403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e2403cfb0 0x7f3e2403f470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3f4801bc30 tx=0x7f3f4804e070 comp rx=0 tx=0).stop 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 msgr2=0x55e2debbccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/1907787915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2debb56d0 0x55e2debbccf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3f54018430 tx=0x7f3f54011f60 comp rx=0 tx=0).stop 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 reap_dead start 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f504bf640 1 -- 172.21.15.165:0/1907787915 reap_dead start 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 shutdown_connections 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 >> 172.21.15.165:0/1907787915 conn(0x55e2debb1ad0 msgr2=0x55e2debafce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 shutdown_connections 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.250+0000 7f3f5cf40800 1 -- 172.21.15.165:0/1907787915 wait complete. 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2959678317 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e3003d000 msgr2=0x7f3e3003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/2959678317 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e3003d000 0x7f3e3003f4c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f48053310 tx=0x7f3f4801c640 comp rx=0 tx=0).stop 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2959678317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2deba8cb0 msgr2=0x55e2deba90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/2959678317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2deba8cb0 0x55e2deba90d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400a2a0 tx=0x7f3f54018830 comp rx=0 tx=0).stop 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2959678317 shutdown_connections 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/2959678317 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e3003d000 0x7f3e3003f4c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/2959678317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2deba8cb0 0x55e2deba90d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2959678317 >> 172.21.15.165:0/2959678317 conn(0x55e2deb9d060 msgr2=0x55e2deb9d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2959678317 shutdown_connections 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/2959678317 wait complete. 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2dea9abe0 msgr2=0x55e2deb95380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2dea9abe0 0x55e2deb95380 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2deb97720 msgr2=0x55e2deb99bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2deb97720 0x55e2deb99bc0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e4003cfb0 msgr2=0x7f3e4003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e4003cfb0 0x7f3e4003f470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f40057000 tx=0x7f3f40052000 comp rx=0 tx=0).stop 2024-09-22T08:11:09.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 msgr2=0x55e2deb8dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb8dd30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x55e2deb871b0 tx=0x7f3f48000bc0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 shutdown_connections 2024-09-22T08:11:09.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e2deb97720 0x55e2deb99bc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e2dea9abe0 0x55e2deb95380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f3e4003cfb0 0x7f3e4003f470 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 --2- 172.21.15.165:0/469233585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2dea07cf0 0x55e2deb8dd30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 >> 172.21.15.165:0/469233585 conn(0x55e2dea8ebb0 msgr2=0x55e2deb87710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 shutdown_connections 2024-09-22T08:11:09.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.251+0000 7f3f5cf40800 1 -- 172.21.15.165:0/469233585 wait complete. 2024-09-22T08:11:09.262 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:11:09.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-22T08:11:09.262 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-22T08:11:09.306 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:09.306 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:09.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.305+0000 7f2775528800 1 Processor -- start 2024-09-22T08:11:09.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.305+0000 7f2775528800 1 -- start start 2024-09-22T08:11:09.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.305+0000 7f2775528800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561d1822c510 0x561d182bd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.305+0000 7f2775528800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d18143a20 con 0x561d182bda10 2024-09-22T08:11:09.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.305+0000 7f2775528800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561d181437d0 con 0x561d1822c510 2024-09-22T08:11:09.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.306+0000 7f277115d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561d1822c510 0x561d182bd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.306+0000 7f277115d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561d1822c510 0x561d182bd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52964/0 (socket says 172.21.15.165:52964) 2024-09-22T08:11:09.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.306+0000 7f277115d640 1 -- 172.21.15.165:0/3124593576 learned_addr learned my addr 172.21.15.165:0/3124593576 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.306+0000 7f277095c640 1 --1- 172.21.15.165:0/3124593576 >> v1:172.21.15.53:6789/0 conn(0x561d182bda10 0x561d182bfed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33848/0 (socket says 172.21.15.165:33848) 2024-09-22T08:11:09.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.306+0000 7f277115d640 1 -- 172.21.15.165:0/3124593576 >> v1:172.21.15.53:6789/0 conn(0x561d182bda10 legacy=0x561d182bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.306+0000 7f277115d640 1 -- 172.21.15.165:0/3124593576 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d182c2790 con 0x561d1822c510 2024-09-22T08:11:09.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.308+0000 7f277115d640 1 --2- 172.21.15.165:0/3124593576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d182bd4d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2764005fd0 tx=0x7f2764045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbba94093dd4d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.308+0000 7f2763fff640 1 -- 172.21.15.165:0/3124593576 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276404e600 con 0x561d1822c510 2024-09-22T08:11:09.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.308+0000 7f2763fff640 1 -- 172.21.15.165:0/3124593576 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276404e7a0 con 0x561d1822c510 2024-09-22T08:11:09.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.308+0000 7f2763fff640 1 -- 172.21.15.165:0/3124593576 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276404eaa0 con 0x561d1822c510 2024-09-22T08:11:09.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.309+0000 7f2775528800 1 -- 172.21.15.165:0/3124593576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 msgr2=0x561d182bd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.309+0000 7f2775528800 1 --2- 172.21.15.165:0/3124593576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d182bd4d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2764005fd0 tx=0x7f2764045cf0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.309+0000 7f2775528800 1 -- 172.21.15.165:0/3124593576 shutdown_connections 2024-09-22T08:11:09.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.309+0000 7f2775528800 1 --2- 172.21.15.165:0/3124593576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d182bd4d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.309+0000 7f2775528800 1 -- 172.21.15.165:0/3124593576 >> 172.21.15.165:0/3124593576 conn(0x561d182b2be0 msgr2=0x561d182b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.309+0000 7f2775528800 1 -- 172.21.15.165:0/3124593576 shutdown_connections 2024-09-22T08:11:09.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.309+0000 7f2775528800 1 -- 172.21.15.165:0/3124593576 wait complete. 2024-09-22T08:11:09.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.323+0000 7f2775528800 1 Processor -- start 2024-09-22T08:11:09.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.323+0000 7f2775528800 1 -- start start 2024-09-22T08:11:09.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.323+0000 7f2775528800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.323+0000 7f2775528800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561d18150dd0 con 0x561d1822c510 2024-09-22T08:11:09.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.323+0000 7f277115d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.323+0000 7f277115d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183aa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52970/0 (socket says 172.21.15.165:52970) 2024-09-22T08:11:09.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.323+0000 7f277115d640 1 -- 172.21.15.165:0/3125007636 learned_addr learned my addr 172.21.15.165:0/3125007636 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.323+0000 7f277115d640 1 -- 172.21.15.165:0/3125007636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d183aa7d0 con 0x561d1822c510 2024-09-22T08:11:09.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f277115d640 1 --2- 172.21.15.165:0/3125007636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183aa1e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2764005fd0 tx=0x7f2764050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd0e49a175f93a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f265f606640 1 -- 172.21.15.165:0/3125007636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276404eb40 con 0x561d1822c510 2024-09-22T08:11:09.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f265f606640 1 -- 172.21.15.165:0/3125007636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2764066070 con 0x561d1822c510 2024-09-22T08:11:09.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f265f606640 1 -- 172.21.15.165:0/3125007636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276404ee50 con 0x561d1822c510 2024-09-22T08:11:09.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f2775528800 1 -- 172.21.15.165:0/3125007636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 msgr2=0x561d183aa1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f2775528800 1 --2- 172.21.15.165:0/3125007636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183aa1e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2764005fd0 tx=0x7f2764050000 comp rx=0 tx=0).stop 2024-09-22T08:11:09.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f2775528800 1 -- 172.21.15.165:0/3125007636 shutdown_connections 2024-09-22T08:11:09.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f2775528800 1 --2- 172.21.15.165:0/3125007636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183aa1e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f2775528800 1 -- 172.21.15.165:0/3125007636 >> 172.21.15.165:0/3125007636 conn(0x561d182b2be0 msgr2=0x561d183a5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f2775528800 1 -- 172.21.15.165:0/3125007636 shutdown_connections 2024-09-22T08:11:09.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.324+0000 7f2775528800 1 -- 172.21.15.165:0/3125007636 wait complete. 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.325+0000 7f2775528800 1 Processor -- start 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.325+0000 7f2775528800 1 -- start start 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.325+0000 7f2775528800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.325+0000 7f2775528800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561d182c1a30 con 0x561d1822c510 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.325+0000 7f277115d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.325+0000 7f277115d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52974/0 (socket says 172.21.15.165:52974) 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.325+0000 7f277115d640 1 -- 172.21.15.165:0/565247950 learned_addr learned my addr 172.21.15.165:0/565247950 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.326+0000 7f277115d640 1 -- 172.21.15.165:0/565247950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d183b21b0 con 0x561d1822c510 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.326+0000 7f277115d640 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183b1c50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2764063040 tx=0x7f2764003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.326+0000 7f265de03640 1 -- 172.21.15.165:0/565247950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276406d550 con 0x561d1822c510 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.326+0000 7f265de03640 1 -- 172.21.15.165:0/565247950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2764071030 con 0x561d1822c510 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.326+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d183b2440 con 0x561d1822c510 2024-09-22T08:11:09.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.326+0000 7f265de03640 1 -- 172.21.15.165:0/565247950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276406d820 con 0x561d1822c510 2024-09-22T08:11:09.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.326+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d183b2e40 con 0x561d1822c510 2024-09-22T08:11:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.327+0000 7f265de03640 1 -- 172.21.15.165:0/565247950 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f276406d9c0 con 0x561d1822c510 2024-09-22T08:11:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.327+0000 7f265de03640 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f265803d000 0x7f265803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.327+0000 7f265de03640 1 -- 172.21.15.165:0/565247950 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2764098d20 con 0x561d1822c510 2024-09-22T08:11:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.327+0000 7f277095c640 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f265803d000 0x7f265803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.327+0000 7f2775528800 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d182bda10 0x561d183b92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.327+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183b3a30 con 0x561d182bda10 2024-09-22T08:11:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.327+0000 7f277195e640 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d182bda10 0x561d183b92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.327+0000 7f277095c640 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f265803d000 0x7f265803f4c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2768001e30 tx=0x7f2768001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.328+0000 7f277195e640 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d182bda10 0x561d183b92a0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.328+0000 7f277195e640 1 -- 172.21.15.165:0/565247950 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f276c0083e0 con 0x561d182bda10 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.328+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183b9d20 con 0x561d182bda10 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.328+0000 7f277195e640 1 -- 172.21.15.165:0/565247950 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f276c0083e0 con 0x561d182bda10 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.328+0000 7f2775528800 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183bb630 0x561d183bdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.328+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183be260 con 0x561d183bb630 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.328+0000 7f277115d640 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183bb630 0x561d183bdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.329+0000 7f277115d640 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183bb630 0x561d183bdad0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.329+0000 7f277115d640 1 -- 172.21.15.165:0/565247950 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f276407d070 con 0x561d183bb630 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.329+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183ba570 con 0x561d182bda10 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.329+0000 7f277195e640 1 -- 172.21.15.165:0/565247950 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f276c0083e0 con 0x561d182bda10 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.329+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183ba910 con 0x561d182bda10 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.329+0000 7f277195e640 1 -- 172.21.15.165:0/565247950 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f276c0083e0 con 0x561d182bda10 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.330+0000 7f2775528800 1 Processor -- start 2024-09-22T08:11:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.330+0000 7f2775528800 1 -- start start 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.330+0000 7f2775528800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183ccc10 0x561d183cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.330+0000 7f2775528800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561d181afd50 con 0x561d183ccc10 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.330+0000 7f277195e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183ccc10 0x561d183cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.330+0000 7f277195e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183ccc10 0x561d183cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52978/0 (socket says 172.21.15.165:52978) 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.330+0000 7f277195e640 1 -- 172.21.15.165:0/3343552256 learned_addr learned my addr 172.21.15.165:0/3343552256 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.330+0000 7f277195e640 1 -- 172.21.15.165:0/3343552256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d183cd670 con 0x561d183ccc10 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.330+0000 7f277195e640 1 --2- 172.21.15.165:0/3343552256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183ccc10 0x561d183cd030 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x561d183b3240 tx=0x7f276c00af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.331+0000 7f2656ffd640 1 -- 172.21.15.165:0/3343552256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c007d60 con 0x561d183ccc10 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.331+0000 7f2656ffd640 1 -- 172.21.15.165:0/3343552256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c01e020 con 0x561d183ccc10 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.331+0000 7f2775528800 1 -- 172.21.15.165:0/3343552256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d183cdea0 con 0x561d183ccc10 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.331+0000 7f2656ffd640 1 -- 172.21.15.165:0/3343552256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c019590 con 0x561d183ccc10 2024-09-22T08:11:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.331+0000 7f2775528800 1 -- 172.21.15.165:0/3343552256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d183ce440 con 0x561d183ccc10 2024-09-22T08:11:09.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f2656ffd640 1 -- 172.21.15.165:0/3343552256 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f276c016040 con 0x561d183ccc10 2024-09-22T08:11:09.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f2656ffd640 1 --2- 172.21.15.165:0/3343552256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f264803d000 0x7f264803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f2656ffd640 1 -- 172.21.15.165:0/3343552256 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f276c01f030 con 0x561d183ccc10 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f277115d640 1 --2- 172.21.15.165:0/3343552256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f264803d000 0x7f264803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f2775528800 1 Processor -- start 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f2775528800 1 -- start start 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f277115d640 1 --2- 172.21.15.165:0/3343552256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f264803d000 0x7f264803f4c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f276406b010 tx=0x7f276406b9e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f2775528800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183d9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f2775528800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561d183aab40 con 0x561d183d96d0 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f277195e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183d9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f277195e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183d9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52994/0 (socket says 172.21.15.165:52994) 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.332+0000 7f277195e640 1 -- 172.21.15.165:0/771272354 learned_addr learned my addr 172.21.15.165:0/771272354 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f277195e640 1 -- 172.21.15.165:0/771272354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d183da0c0 con 0x561d183d96d0 2024-09-22T08:11:09.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f277195e640 1 --2- 172.21.15.165:0/771272354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183d9ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f276c054590 tx=0x7f276c014b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea3a2efd7b0ba1d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f2654ff9640 1 -- 172.21.15.165:0/771272354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c01d070 con 0x561d183d96d0 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f2654ff9640 1 -- 172.21.15.165:0/771272354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c04dbc0 con 0x561d183d96d0 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f2654ff9640 1 -- 172.21.15.165:0/771272354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c045130 con 0x561d183d96d0 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f2775528800 1 -- 172.21.15.165:0/771272354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 msgr2=0x561d183d9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f2775528800 1 --2- 172.21.15.165:0/771272354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183d9ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f276c054590 tx=0x7f276c014b20 comp rx=0 tx=0).stop 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f2775528800 1 -- 172.21.15.165:0/771272354 shutdown_connections 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f2775528800 1 --2- 172.21.15.165:0/771272354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183d9ad0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f2775528800 1 -- 172.21.15.165:0/771272354 >> 172.21.15.165:0/771272354 conn(0x561d183d5ad0 msgr2=0x561d183d3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f2775528800 1 -- 172.21.15.165:0/771272354 shutdown_connections 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.333+0000 7f2775528800 1 -- 172.21.15.165:0/771272354 wait complete. 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.334+0000 7f2775528800 1 Processor -- start 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.334+0000 7f2775528800 1 -- start start 2024-09-22T08:11:09.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.334+0000 7f2775528800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183e0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.334+0000 7f2775528800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561d183da6e0 con 0x561d183d96d0 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.334+0000 7f277195e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183e0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.334+0000 7f277195e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183e0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:52996/0 (socket says 172.21.15.165:52996) 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.334+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 learned_addr learned my addr 172.21.15.165:0/22891729 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.334+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d183e1230 con 0x561d183d96d0 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.335+0000 7f277195e640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183e0cd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f276c014b60 tx=0x7f276c054520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.335+0000 7f2646ffd640 1 -- 172.21.15.165:0/22891729 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c044070 con 0x561d183d96d0 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.335+0000 7f2646ffd640 1 -- 172.21.15.165:0/22891729 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c031070 con 0x561d183d96d0 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.335+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d183e14c0 con 0x561d183d96d0 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.335+0000 7f2646ffd640 1 -- 172.21.15.165:0/22891729 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c014470 con 0x561d183d96d0 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.335+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d183e1e40 con 0x561d183d96d0 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.335+0000 7f2646ffd640 1 -- 172.21.15.165:0/22891729 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f276c014610 con 0x561d183d96d0 2024-09-22T08:11:09.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.336+0000 7f2646ffd640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f263c03d000 0x7f263c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.336+0000 7f2646ffd640 1 -- 172.21.15.165:0/22891729 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f276c004280 con 0x561d183d96d0 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.336+0000 7f277115d640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f263c03d000 0x7f263c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.336+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.336+0000 7f2775528800 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d183ec590 0x561d183eea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.336+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183ef1a0 con 0x561d183ec590 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.336+0000 7f277095c640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d183ec590 0x561d183eea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.336+0000 7f277115d640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f263c03d000 0x7f263c03f4c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f276404e5a0 tx=0x7f2764088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.336+0000 7f277095c640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d183ec590 0x561d183eea50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f276800f610 con 0x561d183ec590 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 20 realm 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183eb8e0 con 0x561d183ec590 2024-09-22T08:11:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f276800f610 con 0x561d183ec590 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183efc80 con 0x561d183ec590 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f276800f610 con 0x561d183ec590 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183f0550 con 0x561d183ec590 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f276800f610 con 0x561d183ec590 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183f0e90 0x561d183f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183f39c0 con 0x561d183f0e90 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.337+0000 7f277195e640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183f0e90 0x561d183f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.338+0000 7f277195e640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183f0e90 0x561d183f3280 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.338+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.338+0000 7f2775528800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.338+0000 7f2775528800 20 searching for the correct realm 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.338+0000 7f2775528800 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x561d183f5a40 0x561d183f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.338+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f5a40 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.338+0000 7f277115d640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x561d183f5a40 0x561d183f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.338+0000 7f277115d640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x561d183f5a40 0x561d183f7f00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.339+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.339+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f0e90 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.339+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.339+0000 7f277195e640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f276c019040 0x7f276c01d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.339+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x7f276c019040 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.339+0000 7f277095c640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f276c019040 0x7f276c01d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.340+0000 7f277095c640 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f276c019040 0x7f276c01d840 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.340+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276800f610 con 0x7f276c019040 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.340+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183ec590 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.340+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276800f610 con 0x561d183ec590 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.340+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183ec590 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.340+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f276802b040 con 0x561d183ec590 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.340+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x7f276c019040 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.340+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276802b040 con 0x7f276c019040 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.341+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x7f276c019040 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.341+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276802b040 con 0x7f276c019040 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.341+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f0e90 2024-09-22T08:11:09.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.341+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.341+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f5a40 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.341+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.341+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183ec590 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.341+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276802b040 con 0x561d183ec590 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.341+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x7f276c019040 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.342+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276802b040 con 0x7f276c019040 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.342+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183ec590 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.342+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276802b040 con 0x561d183ec590 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.342+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f0e90 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.342+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.342+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f5a40 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.342+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.342+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f5a40 2024-09-22T08:11:09.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.343+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.343+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x7f276c019040 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.343+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276802b040 con 0x7f276c019040 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.343+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f5a40 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.343+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.343+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f5a40 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.343+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.343+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183ec590 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.344+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276802b040 con 0x561d183ec590 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.344+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183ec590 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.344+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f276802b040 con 0x561d183ec590 2024-09-22T08:11:09.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.344+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x7f276c019040 2024-09-22T08:11:09.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.344+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276802b040 con 0x7f276c019040 2024-09-22T08:11:09.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.344+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f5a40 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.344+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.344+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f0e90 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.345+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.345+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183ec590 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.345+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276802b040 con 0x561d183ec590 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.345+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x7f276c019040 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.345+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.345+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f5a40 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.345+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.345+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x7f276c019040 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.346+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.346+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f0e90 2024-09-22T08:11:09.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.346+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.346+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f5a40 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.346+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.346+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x7f276c019040 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183ec590 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d183f85d0 con 0x561d183f0e90 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:09.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183f4440 con 0x561d183ec590 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.347+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183f4050 con 0x561d183ec590 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183f4df0 con 0x561d183ec590 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:09.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 20 zone default found 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 4 Realm: () 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 20 zonegroup default 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183f8a50 con 0x7f276c019040 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.348+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183fa5a0 con 0x561d183f5a40 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.349+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.349+0000 7f2775528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.349+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.349+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183faa30 con 0x561d183f5a40 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.349+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.349+0000 7f2775528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.349+0000 7f2775528800 20 started sync module instance, tier type = 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.349+0000 7f2775528800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.349+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183f98e0 con 0x561d183f0e90 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.350+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.350+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94682960862688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183f98e0 con 0x561d183f0e90 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.350+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183fb570 con 0x561d183ec590 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.351+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94682960862688] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.351+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.351+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94682960867456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183f98e0 con 0x561d183ec590 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.351+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183fc030 con 0x561d183f5a40 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.352+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94682960867456] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.352+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.352+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94682960860208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183f9850 con 0x561d183f5a40 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.352+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183fcef0 con 0x561d183f0e90 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.353+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.353+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94682960860208] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.353+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94682960874560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183fd2e0 con 0x561d183f0e90 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.353+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183fdcd0 con 0x561d183ec590 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.354+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94682960874560] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.355+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.355+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94682960872480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183fdcd0 con 0x561d183ec590 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.355+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183fe740 con 0x7f276c019040 2024-09-22T08:11:09.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.355+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94682960872480] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.356+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.356+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94682960880176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183fdcd0 con 0x7f276c019040 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.356+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183ff150 con 0x7f276c019040 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.356+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94682960880176] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.357+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.357+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94682960877600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183ff150 con 0x7f276c019040 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.357+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183ffb10 con 0x7f276c019040 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.358+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.358+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94682960885344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d183fff30 con 0x7f276c019040 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.358+0000 7f2775528800 20 add_watcher() i=0 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.358+0000 7f2775528800 20 add_watcher() i=1 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.358+0000 7f2775528800 20 add_watcher() i=2 2024-09-22T08:11:09.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.358+0000 7f2775528800 20 add_watcher() i=3 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.358+0000 7f2775528800 20 add_watcher() i=4 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.358+0000 7f2775528800 20 add_watcher() i=5 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.358+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94682960877600] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.358+0000 7f2775528800 20 add_watcher() i=6 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.359+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94682960885344] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.359+0000 7f2775528800 20 add_watcher() i=7 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.359+0000 7f2775528800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.359+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d183fedb0 con 0x561d183ec590 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.359+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.359+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94682960886400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d184008f0 con 0x561d183ec590 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.360+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94682960886400] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.360+0000 7f26277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.360+0000 7f2775528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:09.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.360+0000 7f2775528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:09.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.360+0000 7f2775528800 5 note: GC not initialized 2024-09-22T08:11:09.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.360+0000 7f26267e4640 20 reqs_thread_entry: start 2024-09-22T08:11:09.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.361+0000 7f2775528800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:09.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.361+0000 7f2775528800 20 Filter name: none 2024-09-22T08:11:09.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.361+0000 7f2597fff640 20 reqs_thread_entry: start 2024-09-22T08:11:09.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.361+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.361+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d18436380 con 0x561d183f0e90 2024-09-22T08:11:09.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.361+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.361+0000 7f2775528800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:09.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.361+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.361+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d18436cf0 con 0x7f276c019040 2024-09-22T08:11:09.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.362+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.362+0000 7f2775528800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:09.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.362+0000 7f2775528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:11:09.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.362+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.362+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d18436d30 con 0x561d183f0e90 2024-09-22T08:11:09.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.362+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.362+0000 7f2775528800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.362+0000 7f2775528800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.362+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d18438480 con 0x7f276c019040 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(65 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 4.0 4:018ba9d6:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d18437a80 con 0x561d183f5a40 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 4.1f 4:fb2ab228:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d1843cff0 con 0x561d183f5a40 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 4.b 4:d327c397:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d1843f8a0 con 0x561d183f0e90 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 4.2e 4:777aca84:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d184421e0 con 0x561d183f5a40 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 4.1 4:832f56df:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d18444ff0 con 0x561d183f0e90 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 4.c 4:32d44c4f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d184421e0 con 0x561d183ec590 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 4.2f 4:f6147bda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d18449fd0 con 0x561d183ec590 2024-09-22T08:11:09.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:73 4.1a 4:58540eb0:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d1844ce90 con 0x561d183f0e90 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 4.1c 4:39fae181:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d1844f850 con 0x7f276c019040 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 4.12 4:4b80fb86:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d18452540 con 0x561d183ec590 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:76 4.25 4:a6efb879:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d18452540 con 0x561d183f5a40 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(69 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(68 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(70 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(74 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(73 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(76 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(71 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(72 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.363+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(75 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.364+0000 7f26277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.364+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94682960886400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d1844f850 con 0x561d183ec590 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.365+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94682960886400] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.365+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94682960862688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d18433d20 con 0x561d183f0e90 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.366+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94682960862688] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.366+0000 7f2775528800 20 remove_watcher() i=0 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.366+0000 7f2775528800 2 removed watcher, disabling cache 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.366+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94682960867456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d18433d20 con 0x561d183ec590 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.367+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94682960867456] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.367+0000 7f2775528800 20 remove_watcher() i=1 2024-09-22T08:11:09.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.367+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94682960860208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d18433d20 con 0x561d183f5a40 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.369+0000 7f277115d640 1 -- 172.21.15.165:0/22891729 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94682960860208] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276407d070 con 0x561d183f5a40 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.369+0000 7f2775528800 20 remove_watcher() i=2 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.369+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94682960874560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d18433d20 con 0x561d183f0e90 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.370+0000 7f277195e640 1 -- 172.21.15.165:0/22891729 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94682960874560] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276c0083e0 con 0x561d183f0e90 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.370+0000 7f2775528800 20 remove_watcher() i=3 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.370+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94682960872480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d18433d20 con 0x561d183ec590 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.371+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94682960872480] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x561d183ec590 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.371+0000 7f2775528800 20 remove_watcher() i=4 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.371+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94682960880176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d18433d20 con 0x7f276c019040 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.372+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94682960880176] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.372+0000 7f2775528800 20 remove_watcher() i=5 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.372+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94682960877600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d18433d20 con 0x7f276c019040 2024-09-22T08:11:09.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.373+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94682960877600] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.373+0000 7f2775528800 20 remove_watcher() i=6 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.373+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94682960885344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d18433d20 con 0x7f276c019040 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94682960885344] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276803b040 con 0x7f276c019040 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 20 remove_watcher() i=7 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f276c019040 msgr2=0x7f276c01d840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f276c019040 0x7f276c01d840 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d183ec590 msgr2=0x561d183eea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d183ec590 0x561d183eea50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183f0e90 msgr2=0x561d183f3280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183f0e90 0x561d183f3280 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x561d183f5a40 msgr2=0x561d183f7f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x561d183f5a40 0x561d183f7f00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f263c03d000 msgr2=0x7f263c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f263c03d000 0x7f263c03f4c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f276404e5a0 tx=0x7f2764088000 comp rx=0 tx=0).stop 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 msgr2=0x561d183e0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f277095c640 1 -- 172.21.15.165:0/22891729 reap_dead start 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183e0cd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f276c014b60 tx=0x7f276c054520 comp rx=0 tx=0).stop 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 shutdown_connections 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/22891729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183d96d0 0x561d183e0cd0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 >> 172.21.15.165:0/22891729 conn(0x561d183d5ad0 msgr2=0x561d183d3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 shutdown_connections 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/22891729 wait complete. 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/3343552256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f264803d000 msgr2=0x7f264803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/3343552256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f264803d000 0x7f264803f4c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f276406b010 tx=0x7f276406b9e0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/3343552256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183ccc10 msgr2=0x561d183cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/3343552256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183ccc10 0x561d183cd030 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x561d183b3240 tx=0x7f276c00af20 comp rx=0 tx=0).stop 2024-09-22T08:11:09.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/3343552256 shutdown_connections 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/3343552256 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f264803d000 0x7f264803f4c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 --2- 172.21.15.165:0/3343552256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d183ccc10 0x561d183cd030 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/3343552256 >> 172.21.15.165:0/3343552256 conn(0x561d183c0fc0 msgr2=0x561d183c13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.374+0000 7f2775528800 1 -- 172.21.15.165:0/3343552256 shutdown_connections 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 -- 172.21.15.165:0/3343552256 wait complete. 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d182bda10 msgr2=0x561d183b92a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d182bda10 0x561d183b92a0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183bb630 msgr2=0x561d183bdad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183bb630 0x561d183bdad0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f265803d000 msgr2=0x7f265803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f265803d000 0x7f265803f4c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2768001e30 tx=0x7f2768001390 comp rx=0 tx=0).stop 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 msgr2=0x561d183b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183b1c50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2764063040 tx=0x7f2764003330 comp rx=0 tx=0).stop 2024-09-22T08:11:09.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 shutdown_connections 2024-09-22T08:11:09.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561d183bb630 0x561d183bdad0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561d182bda10 0x561d183b92a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f265803d000 0x7f265803f4c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 --2- 172.21.15.165:0/565247950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d1822c510 0x561d183b1c50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 >> 172.21.15.165:0/565247950 conn(0x561d182b2be0 msgr2=0x561d183ab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 shutdown_connections 2024-09-22T08:11:09.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.375+0000 7f2775528800 1 -- 172.21.15.165:0/565247950 wait complete. 2024-09-22T08:11:09.388 INFO:teuthology.orchestra.run.smithi165.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"083396ec-d900-46a5-a2e2-dd86e7b6cca3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","marker":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-22T08:11:08.897445Z","creation_time":"2024-09-22T08:11:06.203755Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-22T08:11:09.388 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '083396ec-d900-46a5-a2e2-dd86e7b6cca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'marker': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:11:08.897445Z', 'creation_time': '2024-09-22T08:11:06.203755Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-22T08:11:09.388 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-22T08:11:09.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-22T08:11:09.389 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-22T08:11:09.471 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:09.471 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:09.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.470+0000 7f928f80f800 1 Processor -- start 2024-09-22T08:11:09.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.470+0000 7f928f80f800 1 -- start start 2024-09-22T08:11:09.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.470+0000 7f928f80f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561638ed5560 0x561638ed3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.470+0000 7f928f80f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561638deaa20 con 0x561638ed4080 2024-09-22T08:11:09.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.470+0000 7f928f80f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561638dea7d0 con 0x561638ed5560 2024-09-22T08:11:09.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.470+0000 7f928af22640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561638ed5560 0x561638ed3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.470+0000 7f9283fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x561638ed4080 0x561638f674e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33854/0 (socket says 172.21.15.165:33854) 2024-09-22T08:11:09.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.470+0000 7f9283fff640 1 -- 172.21.15.165:0/882335757 learned_addr learned my addr 172.21.15.165:0/882335757 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:09.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.471+0000 7f928af22640 1 -- 172.21.15.165:0/882335757 >> v1:172.21.15.53:6789/0 conn(0x561638ed4080 legacy=0x561638f674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.471+0000 7f928a721640 1 -- 172.21.15.165:0/882335757 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943141957 0 0) 0x561638deaa20 con 0x561638ed4080 2024-09-22T08:11:09.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.471+0000 7f928af22640 1 -- 172.21.15.165:0/882335757 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561638ed4670 con 0x561638ed5560 2024-09-22T08:11:09.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928af22640 1 --2- 172.21.15.165:0/882335757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed5560 0x561638ed3b40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f927c00a470 tx=0x7f927c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c637d5d3de984b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928a721640 1 -- 172.21.15.165:0/882335757 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c053570 con 0x561638ed5560 2024-09-22T08:11:09.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928a721640 1 -- 172.21.15.165:0/882335757 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c058070 con 0x561638ed5560 2024-09-22T08:11:09.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928a721640 1 -- 172.21.15.165:0/882335757 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c053880 con 0x561638ed5560 2024-09-22T08:11:09.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928f80f800 1 -- 172.21.15.165:0/882335757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed5560 msgr2=0x561638ed3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928f80f800 1 --2- 172.21.15.165:0/882335757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed5560 0x561638ed3b40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f927c00a470 tx=0x7f927c045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:09.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928f80f800 1 -- 172.21.15.165:0/882335757 shutdown_connections 2024-09-22T08:11:09.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928f80f800 1 --2- 172.21.15.165:0/882335757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed5560 0x561638ed3b40 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928f80f800 1 -- 172.21.15.165:0/882335757 >> 172.21.15.165:0/882335757 conn(0x561638f5ada0 msgr2=0x561638f5d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928f80f800 1 -- 172.21.15.165:0/882335757 shutdown_connections 2024-09-22T08:11:09.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.473+0000 7f928f80f800 1 -- 172.21.15.165:0/882335757 wait complete. 2024-09-22T08:11:09.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.487+0000 7f928f80f800 1 Processor -- start 2024-09-22T08:11:09.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.487+0000 7f928f80f800 1 -- start start 2024-09-22T08:11:09.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.487+0000 7f928f80f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639050fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.487+0000 7f928f80f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561638df7dd0 con 0x561638ed4080 2024-09-22T08:11:09.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.487+0000 7f928af22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639050fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.488+0000 7f928af22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639050fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53026/0 (socket says 172.21.15.165:53026) 2024-09-22T08:11:09.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.488+0000 7f928af22640 1 -- 172.21.15.165:0/802534039 learned_addr learned my addr 172.21.15.165:0/802534039 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.488+0000 7f928af22640 1 -- 172.21.15.165:0/802534039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616390515a0 con 0x561638ed4080 2024-09-22T08:11:09.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.488+0000 7f928af22640 1 --2- 172.21.15.165:0/802534039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639050fb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f927c025c20 tx=0x7f927c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2156f6f3a382a262 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.488+0000 7f9178e09640 1 -- 172.21.15.165:0/802534039 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c053570 con 0x561638ed4080 2024-09-22T08:11:09.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.488+0000 7f9178e09640 1 -- 172.21.15.165:0/802534039 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c063030 con 0x561638ed4080 2024-09-22T08:11:09.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.488+0000 7f9178e09640 1 -- 172.21.15.165:0/802534039 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c053840 con 0x561638ed4080 2024-09-22T08:11:09.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 -- 172.21.15.165:0/802534039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 msgr2=0x561639050fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 --2- 172.21.15.165:0/802534039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639050fb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f927c025c20 tx=0x7f927c051000 comp rx=0 tx=0).stop 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 -- 172.21.15.165:0/802534039 shutdown_connections 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 --2- 172.21.15.165:0/802534039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639050fb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 -- 172.21.15.165:0/802534039 >> 172.21.15.165:0/802534039 conn(0x561638f5ada0 msgr2=0x56163904c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 -- 172.21.15.165:0/802534039 shutdown_connections 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 -- 172.21.15.165:0/802534039 wait complete. 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 Processor -- start 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 -- start start 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639058a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.489+0000 7f928f80f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561638f68e10 con 0x561638ed4080 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.490+0000 7f928af22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639058a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.490+0000 7f928af22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639058a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53030/0 (socket says 172.21.15.165:53030) 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.490+0000 7f928af22640 1 -- 172.21.15.165:0/763368250 learned_addr learned my addr 172.21.15.165:0/763368250 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.490+0000 7f928af22640 1 -- 172.21.15.165:0/763368250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561639058f90 con 0x561638ed4080 2024-09-22T08:11:09.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.490+0000 7f928af22640 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639058a30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f927c054fd0 tx=0x7f927c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.490+0000 7f9177606640 1 -- 172.21.15.165:0/763368250 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c068420 con 0x561638ed4080 2024-09-22T08:11:09.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.490+0000 7f9177606640 1 -- 172.21.15.165:0/763368250 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c0685c0 con 0x561638ed4080 2024-09-22T08:11:09.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.490+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561639059220 con 0x561638ed4080 2024-09-22T08:11:09.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.490+0000 7f9177606640 1 -- 172.21.15.165:0/763368250 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c0688a0 con 0x561638ed4080 2024-09-22T08:11:09.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.490+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561639059db0 con 0x561638ed4080 2024-09-22T08:11:09.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.491+0000 7f9177606640 1 -- 172.21.15.165:0/763368250 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f927c068ad0 con 0x561638ed4080 2024-09-22T08:11:09.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.491+0000 7f9177606640 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f917003cfb0 0x7f917003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.491+0000 7f9177606640 1 -- 172.21.15.165:0/763368250 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f927c098f10 con 0x561638ed4080 2024-09-22T08:11:09.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.491+0000 7f9283fff640 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f917003cfb0 0x7f917003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.492+0000 7f928f80f800 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561638ed5560 0x561639060080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.492+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56163905a800 con 0x561638ed5560 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.492+0000 7f928b723640 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561638ed5560 0x561639060080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.492+0000 7f9283fff640 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f917003cfb0 0x7f917003f470 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9274000c00 tx=0x7f92740013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.492+0000 7f928b723640 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561638ed5560 0x561639060080 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.492+0000 7f928b723640 1 -- 172.21.15.165:0/763368250 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f928400a4d0 con 0x561638ed5560 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.492+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56163905a120 con 0x561638ed5560 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.493+0000 7f928b723640 1 -- 172.21.15.165:0/763368250 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f928400a4d0 con 0x561638ed5560 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.493+0000 7f928f80f800 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639062530 0x561639064920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.493+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561639064ff0 con 0x561639062530 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.493+0000 7f928af22640 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639062530 0x561639064920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.493+0000 7f928af22640 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639062530 0x561639064920 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.493+0000 7f928af22640 1 -- 172.21.15.165:0/763368250 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f927c051070 con 0x561639062530 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.493+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616390613d0 con 0x561638ed5560 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.493+0000 7f928b723640 1 -- 172.21.15.165:0/763368250 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f928400a4d0 con 0x561638ed5560 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.494+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561639061870 con 0x561638ed5560 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.494+0000 7f928b723640 1 -- 172.21.15.165:0/763368250 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f928400a4d0 con 0x561638ed5560 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.494+0000 7f928f80f800 1 Processor -- start 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.494+0000 7f928f80f800 1 -- start start 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.494+0000 7f928f80f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639073970 0x561639073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.494+0000 7f928f80f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561638e56d50 con 0x561639073970 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.494+0000 7f928b723640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639073970 0x561639073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.494+0000 7f928b723640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639073970 0x561639073d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53032/0 (socket says 172.21.15.165:53032) 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.494+0000 7f928b723640 1 -- 172.21.15.165:0/1039508203 learned_addr learned my addr 172.21.15.165:0/1039508203 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.495+0000 7f928b723640 1 -- 172.21.15.165:0/1039508203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616390743d0 con 0x561639073970 2024-09-22T08:11:09.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.495+0000 7f928b723640 1 --2- 172.21.15.165:0/1039508203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639073970 0x561639073d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x561639060600 tx=0x7f9284018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.495+0000 7f9174e01640 1 -- 172.21.15.165:0/1039508203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92840180d0 con 0x561639073970 2024-09-22T08:11:09.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.495+0000 7f9174e01640 1 -- 172.21.15.165:0/1039508203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9284018270 con 0x561639073970 2024-09-22T08:11:09.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.495+0000 7f9174e01640 1 -- 172.21.15.165:0/1039508203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9284014450 con 0x561639073970 2024-09-22T08:11:09.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.495+0000 7f928f80f800 1 -- 172.21.15.165:0/1039508203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561639074c00 con 0x561639073970 2024-09-22T08:11:09.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.495+0000 7f928f80f800 1 -- 172.21.15.165:0/1039508203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616390751a0 con 0x561639073970 2024-09-22T08:11:09.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.496+0000 7f9174e01640 1 -- 172.21.15.165:0/1039508203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9284011040 con 0x561639073970 2024-09-22T08:11:09.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.496+0000 7f9174e01640 1 --2- 172.21.15.165:0/1039508203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f916403cfb0 0x7f916403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.496+0000 7f9174e01640 1 -- 172.21.15.165:0/1039508203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f928401e070 con 0x561639073970 2024-09-22T08:11:09.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.496+0000 7f928af22640 1 --2- 172.21.15.165:0/1039508203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f916403cfb0 0x7f916403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.496+0000 7f928f80f800 1 Processor -- start 2024-09-22T08:11:09.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f928af22640 1 --2- 172.21.15.165:0/1039508203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f916403cfb0 0x7f916403f470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x5616390606a0 tx=0x7f927c089040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f928f80f800 1 -- start start 2024-09-22T08:11:09.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f928f80f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639080830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f928f80f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561639051970 con 0x561639080430 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f928b723640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639080830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f928b723640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639080830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53038/0 (socket says 172.21.15.165:53038) 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f928b723640 1 -- 172.21.15.165:0/1780963645 learned_addr learned my addr 172.21.15.165:0/1780963645 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f928b723640 1 -- 172.21.15.165:0/1780963645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561639080e20 con 0x561639080430 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f928b723640 1 --2- 172.21.15.165:0/1780963645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639080830 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f928400a150 tx=0x7f9284045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2853e0511408f714 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f916e7fc640 1 -- 172.21.15.165:0/1780963645 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9284016570 con 0x561639080430 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f916e7fc640 1 -- 172.21.15.165:0/1780963645 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928404b070 con 0x561639080430 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.497+0000 7f916e7fc640 1 -- 172.21.15.165:0/1780963645 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f928402bb90 con 0x561639080430 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 -- 172.21.15.165:0/1780963645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 msgr2=0x561639080830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 --2- 172.21.15.165:0/1780963645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639080830 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f928400a150 tx=0x7f9284045490 comp rx=0 tx=0).stop 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 -- 172.21.15.165:0/1780963645 shutdown_connections 2024-09-22T08:11:09.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 --2- 172.21.15.165:0/1780963645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639080830 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 -- 172.21.15.165:0/1780963645 >> 172.21.15.165:0/1780963645 conn(0x56163907c830 msgr2=0x56163907aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 -- 172.21.15.165:0/1780963645 shutdown_connections 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 -- 172.21.15.165:0/1780963645 wait complete. 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 Processor -- start 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 -- start start 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639087980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.498+0000 7f928f80f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561639081440 con 0x561639080430 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.499+0000 7f928b723640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639087980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.499+0000 7f928b723640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639087980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53052/0 (socket says 172.21.15.165:53052) 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.499+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 learned_addr learned my addr 172.21.15.165:0/995972746 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.499+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561639087ee0 con 0x561639080430 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.499+0000 7f928b723640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639087980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f92840454d0 tx=0x7f9284054300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.499+0000 7f916cff9640 1 -- 172.21.15.165:0/995972746 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9284022a60 con 0x561639080430 2024-09-22T08:11:09.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.499+0000 7f916cff9640 1 -- 172.21.15.165:0/995972746 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9284022c00 con 0x561639080430 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.499+0000 7f916cff9640 1 -- 172.21.15.165:0/995972746 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9284014680 con 0x561639080430 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.499+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561639088170 con 0x561639080430 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.499+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561639088d00 con 0x561639080430 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.500+0000 7f916cff9640 1 -- 172.21.15.165:0/995972746 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9284014820 con 0x561639080430 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.500+0000 7f916cff9640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f915403cfb0 0x7f915403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.500+0000 7f916cff9640 1 -- 172.21.15.165:0/995972746 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9284034070 con 0x561639080430 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f928af22640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f915403cfb0 0x7f915403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f928f80f800 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561639093440 0x561639095900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561639096050 con 0x561639093440 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f9283fff640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561639093440 0x561639095900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f928af22640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f915403cfb0 0x7f915403f470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f927c0678d0 tx=0x7f927c08f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f9283fff640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561639093440 0x561639095900 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f927400f5f0 con 0x561639093440 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f928f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f928f80f800 20 realm 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.501+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616390927b0 con 0x561639093440 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f927400f5f0 con 0x561639093440 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561639096b30 con 0x561639093440 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f927400f5f0 con 0x561639093440 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561639097400 con 0x561639093440 2024-09-22T08:11:09.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f927400f5f0 con 0x561639093440 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639097d00 0x56163909a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928b723640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639097d00 0x56163909a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56163909a870 con 0x561639097d00 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.502+0000 7f928b723640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639097d00 0x56163909a110 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.503+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.503+0000 7f928f80f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.503+0000 7f928f80f800 20 searching for the correct realm 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.503+0000 7f928f80f800 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56163909c950 0x56163909ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.503+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x56163909c950 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.503+0000 7f928af22640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56163909c950 0x56163909ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.503+0000 7f928af22640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56163909c950 0x56163909ee10 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.503+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.503+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639097d00 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.504+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.504+0000 7f928b723640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9284014070 0x7f9284017030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.504+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x7f9284014070 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.504+0000 7f9283fff640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9284014070 0x7f9284017030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.504+0000 7f9283fff640 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9284014070 0x7f9284017030 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.505+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927400f5f0 con 0x7f9284014070 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.505+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639093440 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.505+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927400f5f0 con 0x561639093440 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.505+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639093440 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.505+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f927402b040 con 0x561639093440 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.505+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x7f9284014070 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.505+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927402b040 con 0x7f9284014070 2024-09-22T08:11:09.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.505+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x7f9284014070 2024-09-22T08:11:09.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.506+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927402b040 con 0x7f9284014070 2024-09-22T08:11:09.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.506+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639097d00 2024-09-22T08:11:09.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.506+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.506+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x56163909c950 2024-09-22T08:11:09.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.506+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.506+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639093440 2024-09-22T08:11:09.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.506+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927402b040 con 0x561639093440 2024-09-22T08:11:09.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.506+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x7f9284014070 2024-09-22T08:11:09.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.507+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927402b040 con 0x7f9284014070 2024-09-22T08:11:09.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.507+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639093440 2024-09-22T08:11:09.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.507+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927402b040 con 0x561639093440 2024-09-22T08:11:09.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.507+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639097d00 2024-09-22T08:11:09.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.507+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.507+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x56163909c950 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.507+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.507+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x56163909c950 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.507+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.507+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x7f9284014070 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.508+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927402b040 con 0x7f9284014070 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.508+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x56163909c950 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.508+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.508+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x56163909c950 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.508+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.508+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639093440 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.508+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927402b040 con 0x561639093440 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.508+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639093440 2024-09-22T08:11:09.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.509+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f927402b040 con 0x561639093440 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.509+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x7f9284014070 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.509+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927402b040 con 0x7f9284014070 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.509+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x56163909c950 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.509+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.509+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639097d00 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.509+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.509+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639093440 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.510+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927402b040 con 0x561639093440 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.510+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x7f9284014070 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.510+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.510+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x56163909c950 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.510+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.510+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x7f9284014070 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.510+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.510+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639097d00 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.511+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.511+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x56163909c950 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.511+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.511+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x7f9284014070 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.511+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.511+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639093440 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.511+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.511+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909f4e0 con 0x561639097d00 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:09.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56163909b380 con 0x561639093440 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56163909afc0 con 0x561639093440 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56163909bd20 con 0x561639093440 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 zone default found 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 4 Realm: () 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 zonegroup default 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.512+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56163909f960 con 0x7f9284014070 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616390a14d0 con 0x56163909c950 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928f80f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616390a19b0 con 0x56163909c950 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928f80f800 20 started sync module instance, tier type = 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928f80f800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.513+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639097d00 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.514+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.514+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94653446228960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a22c0 con 0x561639097d00 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.514+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a2b10 con 0x561639093440 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.515+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94653446228960] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.515+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.515+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94653446233616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a2800 con 0x561639093440 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.516+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a32c0 con 0x56163909c950 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.517+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94653446233616] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.517+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.517+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94653446237584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a36e0 con 0x56163909c950 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.517+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a40e0 con 0x561639097d00 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.518+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94653446237584] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.518+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.518+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94653446234736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a44d0 con 0x561639097d00 2024-09-22T08:11:09.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.518+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a4f10 con 0x561639093440 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.519+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.519+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94653446244832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a4ed0 con 0x561639093440 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.519+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a5ed0 con 0x7f9284014070 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.519+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94653446234736] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.520+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.520+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94653446248960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a5ed0 con 0x7f9284014070 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.520+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94653446244832] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.520+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a68e0 con 0x7f9284014070 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.521+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94653446248960] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.521+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.521+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94653446247248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a6430 con 0x7f9284014070 2024-09-22T08:11:09.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.521+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a6df0 con 0x7f9284014070 2024-09-22T08:11:09.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.522+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94653446247248] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.522+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.522+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94653446241264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a6df0 con 0x7f9284014070 2024-09-22T08:11:09.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.522+0000 7f928f80f800 20 add_watcher() i=0 2024-09-22T08:11:09.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.522+0000 7f928f80f800 20 add_watcher() i=1 2024-09-22T08:11:09.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.522+0000 7f928f80f800 20 add_watcher() i=2 2024-09-22T08:11:09.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.522+0000 7f928f80f800 20 add_watcher() i=3 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.522+0000 7f928f80f800 20 add_watcher() i=4 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.522+0000 7f928f80f800 20 add_watcher() i=5 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.522+0000 7f928f80f800 20 add_watcher() i=6 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.523+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94653446241264] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.523+0000 7f928f80f800 20 add_watcher() i=7 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.523+0000 7f928f80f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.523+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616390aa260 con 0x561639093440 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.523+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.523+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94653446265920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a6f60 con 0x561639093440 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.524+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94653446265920] v32'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.524+0000 7f91417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.524+0000 7f928f80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.524+0000 7f928f80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:09.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.524+0000 7f928f80f800 5 note: GC not initialized 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.525+0000 7f90bbfff640 20 reqs_thread_entry: start 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.525+0000 7f928f80f800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.525+0000 7f928f80f800 20 Filter name: none 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.525+0000 7f90b9ffb640 20 reqs_thread_entry: start 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.525+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390dcc30 con 0x7f9284014070 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.525+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.525+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909afc0 con 0x7f9284014070 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.526+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.526+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56163909afc0 con 0x56163909c950 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.526+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.526+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a36e0 con 0x7f9284014070 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.526+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.526+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a36e0 con 0x561639093440 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.527+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.527+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a36e0 con 0x561639097d00 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.527+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.527+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.527+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.527+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.528+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.528+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.528+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.528+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639097d00 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.528+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.528+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639097d00 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.528+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.528+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.529+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.529+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.529+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.529+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.529+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.529+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639093440 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.529+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.529+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.530+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.530+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639093440 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.530+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.530+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.530+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.530+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.530+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.530+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639093440 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.531+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.531+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639097d00 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.531+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'16 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.531+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639097d00 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.531+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.531+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639093440 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.531+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.531+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x7f9284014070 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.532+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.532+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639097d00 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.532+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.532+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x7f9284014070 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.533+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.533+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.533+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.533+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.534+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.534+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x56163909c950 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.534+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.534+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639093440 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.534+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.534+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x561639097d00 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.534+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f928403e020 con 0x561639097d00 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.534+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616390a07f0 con 0x7f9284014070 2024-09-22T08:11:09.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.535+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.546 INFO:teuthology.orchestra.run.smithi165.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-22T08:11:09.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.536+0000 7f91417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.536+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94653446265920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390dcbf0 con 0x561639093440 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.538+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94653446265920] v32'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.538+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94653446228960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56163909afc0 con 0x561639097d00 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.538+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94653446228960] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928407e040 con 0x561639097d00 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.539+0000 7f928f80f800 20 remove_watcher() i=0 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.539+0000 7f928f80f800 2 removed watcher, disabling cache 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.539+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94653446233616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a36e0 con 0x561639093440 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.540+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94653446233616] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.540+0000 7f928f80f800 20 remove_watcher() i=1 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.540+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94653446237584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390dcbf0 con 0x56163909c950 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.541+0000 7f928af22640 1 -- 172.21.15.165:0/995972746 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94653446237584] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927c09a040 con 0x56163909c950 2024-09-22T08:11:09.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.541+0000 7f928f80f800 20 remove_watcher() i=2 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.541+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94653446234736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a36e0 con 0x561639097d00 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.542+0000 7f928b723640 1 -- 172.21.15.165:0/995972746 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94653446234736] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928407e040 con 0x561639097d00 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.542+0000 7f928f80f800 20 remove_watcher() i=3 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.542+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94653446244832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a36e0 con 0x561639093440 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.543+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94653446244832] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x561639093440 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.543+0000 7f928f80f800 20 remove_watcher() i=4 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.543+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94653446248960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a36e0 con 0x7f9284014070 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.544+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94653446248960] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f927403b040 con 0x7f9284014070 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.544+0000 7f928f80f800 20 remove_watcher() i=5 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.544+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94653446247248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a36e0 con 0x7f9284014070 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.545+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94653446247248] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9274058040 con 0x7f9284014070 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.545+0000 7f928f80f800 20 remove_watcher() i=6 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.545+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94653446241264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616390a36e0 con 0x7f9284014070 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94653446241264] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9274058040 con 0x7f9284014070 2024-09-22T08:11:09.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 20 remove_watcher() i=7 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9284014070 msgr2=0x7f9284017030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9284014070 0x7f9284017030 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561639093440 msgr2=0x561639095900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561639093440 0x561639095900 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639097d00 msgr2=0x56163909a110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639097d00 0x56163909a110 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56163909c950 msgr2=0x56163909ee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56163909c950 0x56163909ee10 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f915403cfb0 msgr2=0x7f915403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f915403cfb0 0x7f915403f470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f927c0678d0 tx=0x7f927c08f000 comp rx=0 tx=0).stop 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 msgr2=0x561639087980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f9283fff640 1 -- 172.21.15.165:0/995972746 reap_dead start 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639087980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f92840454d0 tx=0x7f9284054300 comp rx=0 tx=0).stop 2024-09-22T08:11:09.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 shutdown_connections 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 --2- 172.21.15.165:0/995972746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639080430 0x561639087980 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 >> 172.21.15.165:0/995972746 conn(0x56163907c830 msgr2=0x56163907aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 shutdown_connections 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/995972746 wait complete. 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/1039508203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f916403cfb0 msgr2=0x7f916403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 --2- 172.21.15.165:0/1039508203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f916403cfb0 0x7f916403f470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x5616390606a0 tx=0x7f927c089040 comp rx=0 tx=0).stop 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 -- 172.21.15.165:0/1039508203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639073970 msgr2=0x561639073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.546+0000 7f928f80f800 1 --2- 172.21.15.165:0/1039508203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639073970 0x561639073d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x561639060600 tx=0x7f9284018830 comp rx=0 tx=0).stop 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/1039508203 shutdown_connections 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 --2- 172.21.15.165:0/1039508203 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f916403cfb0 0x7f916403f470 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 --2- 172.21.15.165:0/1039508203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561639073970 0x561639073d90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/1039508203 >> 172.21.15.165:0/1039508203 conn(0x561639067d20 msgr2=0x561639068100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/1039508203 shutdown_connections 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/1039508203 wait complete. 2024-09-22T08:11:09.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561638ed5560 msgr2=0x561639060080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561638ed5560 0x561639060080 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639062530 msgr2=0x561639064920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639062530 0x561639064920 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f917003cfb0 msgr2=0x7f917003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f917003cfb0 0x7f917003f470 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9274000c00 tx=0x7f92740013b0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 msgr2=0x561639058a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639058a30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f927c054fd0 tx=0x7f927c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 shutdown_connections 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561639062530 0x561639064920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561638ed5560 0x561639060080 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f917003cfb0 0x7f917003f470 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 --2- 172.21.15.165:0/763368250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561638ed4080 0x561639058a30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 >> 172.21.15.165:0/763368250 conn(0x561638f5ada0 msgr2=0x5616390523a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 shutdown_connections 2024-09-22T08:11:09.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.547+0000 7f928f80f800 1 -- 172.21.15.165:0/763368250 wait complete. 2024-09-22T08:11:09.557 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-22T08:11:09.558 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-22T08:11:09.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-22T08:11:09.558 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-22T08:11:09.644 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:09.645 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:09.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.643+0000 7effa8b39800 1 Processor -- start 2024-09-22T08:11:09.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.643+0000 7effa8b39800 1 -- start start 2024-09-22T08:11:09.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.643+0000 7effa8b39800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5562e384a0a0 0x5562e384c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.643+0000 7effa8b39800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562e36d4a20 con 0x5562e384c9d0 2024-09-22T08:11:09.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.643+0000 7effa8b39800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5562e36d47d0 con 0x5562e384a0a0 2024-09-22T08:11:09.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.644+0000 7effa47c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5562e384a0a0 0x5562e384c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.644+0000 7effa3fc6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5562e384c9d0 0x5562e384edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33860/0 (socket says 172.21.15.165:33860) 2024-09-22T08:11:09.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.644+0000 7effa3fc6640 1 -- 172.21.15.165:0/2939881535 learned_addr learned my addr 172.21.15.165:0/2939881535 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:09.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.644+0000 7effa47c7640 1 -- 172.21.15.165:0/2939881535 >> v1:172.21.15.53:6789/0 conn(0x5562e384c9d0 legacy=0x5562e384edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.644+0000 7effa47c7640 1 -- 172.21.15.165:0/2939881535 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e3851580 con 0x5562e384a0a0 2024-09-22T08:11:09.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.644+0000 7effa37c5640 1 -- 172.21.15.165:0/2939881535 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1713481130 0 0) 0x5562e36d4a20 con 0x5562e384c9d0 2024-09-22T08:11:09.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa47c7640 1 --2- 172.21.15.165:0/2939881535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e384c490 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7eff94005fd0 tx=0x7eff94045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee0734367e0a32d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa37c5640 1 -- 172.21.15.165:0/2939881535 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff94058530 con 0x5562e384a0a0 2024-09-22T08:11:09.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa37c5640 1 -- 172.21.15.165:0/2939881535 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff940586d0 con 0x5562e384a0a0 2024-09-22T08:11:09.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa37c5640 1 -- 172.21.15.165:0/2939881535 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff940589d0 con 0x5562e384a0a0 2024-09-22T08:11:09.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa8b39800 1 -- 172.21.15.165:0/2939881535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 msgr2=0x5562e384c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa8b39800 1 --2- 172.21.15.165:0/2939881535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e384c490 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7eff94005fd0 tx=0x7eff94045c30 comp rx=0 tx=0).stop 2024-09-22T08:11:09.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa8b39800 1 -- 172.21.15.165:0/2939881535 shutdown_connections 2024-09-22T08:11:09.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa8b39800 1 --2- 172.21.15.165:0/2939881535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e384c490 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa8b39800 1 -- 172.21.15.165:0/2939881535 >> 172.21.15.165:0/2939881535 conn(0x5562e3843be0 msgr2=0x5562e3846020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa8b39800 1 -- 172.21.15.165:0/2939881535 shutdown_connections 2024-09-22T08:11:09.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.646+0000 7effa8b39800 1 -- 172.21.15.165:0/2939881535 wait complete. 2024-09-22T08:11:09.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.660+0000 7effa8b39800 1 Processor -- start 2024-09-22T08:11:09.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.660+0000 7effa8b39800 1 -- start start 2024-09-22T08:11:09.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.660+0000 7effa8b39800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e3938e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.660+0000 7effa8b39800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562e36e1dd0 con 0x5562e384a0a0 2024-09-22T08:11:09.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.660+0000 7effa47c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e3938e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.661+0000 7effa47c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e3938e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53068/0 (socket says 172.21.15.165:53068) 2024-09-22T08:11:09.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.661+0000 7effa47c7640 1 -- 172.21.15.165:0/2485165384 learned_addr learned my addr 172.21.15.165:0/2485165384 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.661+0000 7effa47c7640 1 -- 172.21.15.165:0/2485165384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e3939450 con 0x5562e384a0a0 2024-09-22T08:11:09.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.661+0000 7effa47c7640 1 --2- 172.21.15.165:0/2485165384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e3938e60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7eff94025a60 tx=0x7eff94051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f373114e413a965 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.661+0000 7efe9260c640 1 -- 172.21.15.165:0/2485165384 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff94068070 con 0x5562e384a0a0 2024-09-22T08:11:09.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.661+0000 7efe9260c640 1 -- 172.21.15.165:0/2485165384 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff94058880 con 0x5562e384a0a0 2024-09-22T08:11:09.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.661+0000 7efe9260c640 1 -- 172.21.15.165:0/2485165384 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff94058ba0 con 0x5562e384a0a0 2024-09-22T08:11:09.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 -- 172.21.15.165:0/2485165384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 msgr2=0x5562e3938e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 --2- 172.21.15.165:0/2485165384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e3938e60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7eff94025a60 tx=0x7eff94051000 comp rx=0 tx=0).stop 2024-09-22T08:11:09.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 -- 172.21.15.165:0/2485165384 shutdown_connections 2024-09-22T08:11:09.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 --2- 172.21.15.165:0/2485165384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e3938e60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 -- 172.21.15.165:0/2485165384 >> 172.21.15.165:0/2485165384 conn(0x5562e3843be0 msgr2=0x5562e39347e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 -- 172.21.15.165:0/2485165384 shutdown_connections 2024-09-22T08:11:09.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 -- 172.21.15.165:0/2485165384 wait complete. 2024-09-22T08:11:09.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 Processor -- start 2024-09-22T08:11:09.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 -- start start 2024-09-22T08:11:09.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e39408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.662+0000 7effa8b39800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562e3850870 con 0x5562e384a0a0 2024-09-22T08:11:09.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.663+0000 7effa47c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e39408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.663+0000 7effa47c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e39408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53078/0 (socket says 172.21.15.165:53078) 2024-09-22T08:11:09.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.663+0000 7effa47c7640 1 -- 172.21.15.165:0/2997943485 learned_addr learned my addr 172.21.15.165:0/2997943485 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.663+0000 7effa47c7640 1 -- 172.21.15.165:0/2997943485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e3940e10 con 0x5562e384a0a0 2024-09-22T08:11:09.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.663+0000 7effa47c7640 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e39408b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7eff94025a60 tx=0x7eff94003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.663+0000 7efe90e09640 1 -- 172.21.15.165:0/2997943485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff94068040 con 0x5562e384a0a0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.663+0000 7efe90e09640 1 -- 172.21.15.165:0/2997943485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff94071070 con 0x5562e384a0a0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.663+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562e39410a0 con 0x5562e384a0a0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.663+0000 7efe90e09640 1 -- 172.21.15.165:0/2997943485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff940637b0 con 0x5562e384a0a0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.663+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562e3941a20 con 0x5562e384a0a0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.664+0000 7efe90e09640 1 -- 172.21.15.165:0/2997943485 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7eff940639e0 con 0x5562e384a0a0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.664+0000 7efe90e09640 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe8c03cfb0 0x7efe8c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.664+0000 7efe90e09640 1 -- 172.21.15.165:0/2997943485 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff94098080 con 0x5562e384a0a0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.664+0000 7effa3fc6640 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe8c03cfb0 0x7efe8c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.664+0000 7effa8b39800 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e384c9d0 0x5562e3947f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.665+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e3942670 con 0x5562e384c9d0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.665+0000 7effa4fc8640 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e384c9d0 0x5562e3947f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.665+0000 7effa3fc6640 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe8c03cfb0 0x7efe8c03f470 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7eff8c000c00 tx=0x7eff8c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.665+0000 7effa4fc8640 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e384c9d0 0x5562e3947f00 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.665+0000 7effa4fc8640 1 -- 172.21.15.165:0/2997943485 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff9c0083e0 con 0x5562e384c9d0 2024-09-22T08:11:09.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.665+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e3941f00 con 0x5562e384c9d0 2024-09-22T08:11:09.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.665+0000 7effa4fc8640 1 -- 172.21.15.165:0/2997943485 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff9c0083e0 con 0x5562e384c9d0 2024-09-22T08:11:09.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.666+0000 7effa8b39800 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e394a3b0 0x5562e394c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.666+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e394ce70 con 0x5562e394a3b0 2024-09-22T08:11:09.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.666+0000 7effa47c7640 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e394a3b0 0x5562e394c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.666+0000 7effa47c7640 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e394a3b0 0x5562e394c7a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.666+0000 7effa47c7640 1 -- 172.21.15.165:0/2997943485 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e394a3b0 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.666+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e3949250 con 0x5562e384c9d0 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.667+0000 7effa4fc8640 1 -- 172.21.15.165:0/2997943485 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff9c0083e0 con 0x5562e384c9d0 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.667+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e3949730 con 0x5562e384c9d0 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.667+0000 7effa4fc8640 1 -- 172.21.15.165:0/2997943485 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff9c0083e0 con 0x5562e384c9d0 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.667+0000 7effa8b39800 1 Processor -- start 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.667+0000 7effa8b39800 1 -- start start 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.667+0000 7effa8b39800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e395b7f0 0x5562e395bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.667+0000 7effa8b39800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562e3740d50 con 0x5562e395b7f0 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.668+0000 7effa4fc8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e395b7f0 0x5562e395bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.668+0000 7effa4fc8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e395b7f0 0x5562e395bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53088/0 (socket says 172.21.15.165:53088) 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.668+0000 7effa4fc8640 1 -- 172.21.15.165:0/3948496359 learned_addr learned my addr 172.21.15.165:0/3948496359 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.668+0000 7effa4fc8640 1 -- 172.21.15.165:0/3948496359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e395c250 con 0x5562e395b7f0 2024-09-22T08:11:09.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.668+0000 7effa4fc8640 1 --2- 172.21.15.165:0/3948496359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e395b7f0 0x5562e395bc10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5562e39418b0 tx=0x7eff9c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.668+0000 7efe89ffb640 1 -- 172.21.15.165:0/3948496359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c007dc0 con 0x5562e395b7f0 2024-09-22T08:11:09.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.668+0000 7efe89ffb640 1 -- 172.21.15.165:0/3948496359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c01e020 con 0x5562e395b7f0 2024-09-22T08:11:09.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.668+0000 7effa8b39800 1 -- 172.21.15.165:0/3948496359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562e395ca80 con 0x5562e395b7f0 2024-09-22T08:11:09.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.668+0000 7efe89ffb640 1 -- 172.21.15.165:0/3948496359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c019570 con 0x5562e395b7f0 2024-09-22T08:11:09.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.668+0000 7effa8b39800 1 -- 172.21.15.165:0/3948496359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562e395d020 con 0x5562e395b7f0 2024-09-22T08:11:09.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.669+0000 7efe89ffb640 1 -- 172.21.15.165:0/3948496359 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7eff9c016040 con 0x5562e395b7f0 2024-09-22T08:11:09.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.669+0000 7efe89ffb640 1 --2- 172.21.15.165:0/3948496359 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7c03cfb0 0x7efe7c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.669+0000 7efe89ffb640 1 -- 172.21.15.165:0/3948496359 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff9c01f030 con 0x5562e395b7f0 2024-09-22T08:11:09.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.669+0000 7effa47c7640 1 --2- 172.21.15.165:0/3948496359 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7c03cfb0 0x7efe7c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.670+0000 7effa8b39800 1 Processor -- start 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.670+0000 7effa8b39800 1 -- start start 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.670+0000 7effa47c7640 1 --2- 172.21.15.165:0/3948496359 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7c03cfb0 0x7efe7c03f470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5562e3948520 tx=0x7eff94063f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.670+0000 7effa8b39800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e3968690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.670+0000 7effa8b39800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562e39397c0 con 0x5562e3968290 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.670+0000 7effa4fc8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e3968690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.670+0000 7effa4fc8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e3968690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53102/0 (socket says 172.21.15.165:53102) 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.670+0000 7effa4fc8640 1 -- 172.21.15.165:0/3233443154 learned_addr learned my addr 172.21.15.165:0/3233443154 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.670+0000 7effa4fc8640 1 -- 172.21.15.165:0/3233443154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e3968c80 con 0x5562e3968290 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.670+0000 7effa4fc8640 1 --2- 172.21.15.165:0/3233443154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e3968690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0549f0 tx=0x7eff9c019ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7766915380057f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7efe837fe640 1 -- 172.21.15.165:0/3233443154 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c01d040 con 0x5562e3968290 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7efe837fe640 1 -- 172.21.15.165:0/3233443154 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c023460 con 0x5562e3968290 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7efe837fe640 1 -- 172.21.15.165:0/3233443154 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c019c30 con 0x5562e3968290 2024-09-22T08:11:09.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7effa8b39800 1 -- 172.21.15.165:0/3233443154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 msgr2=0x5562e3968690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7effa8b39800 1 --2- 172.21.15.165:0/3233443154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e3968690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0549f0 tx=0x7eff9c019ae0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7effa8b39800 1 -- 172.21.15.165:0/3233443154 shutdown_connections 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7effa8b39800 1 --2- 172.21.15.165:0/3233443154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e3968690 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7effa8b39800 1 -- 172.21.15.165:0/3233443154 >> 172.21.15.165:0/3233443154 conn(0x5562e3964690 msgr2=0x5562e39628d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7effa8b39800 1 -- 172.21.15.165:0/3233443154 shutdown_connections 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7effa8b39800 1 -- 172.21.15.165:0/3233443154 wait complete. 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7effa8b39800 1 Processor -- start 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.671+0000 7effa8b39800 1 -- start start 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7effa8b39800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e396f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7effa8b39800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5562e39692a0 con 0x5562e3968290 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7effa4fc8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e396f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7effa4fc8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e396f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53110/0 (socket says 172.21.15.165:53110) 2024-09-22T08:11:09.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 learned_addr learned my addr 172.21.15.165:0/2384202014 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e396fe00 con 0x5562e3968290 2024-09-22T08:11:09.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7effa4fc8640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e396f8a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7eff9c019bb0 tx=0x7eff9c054980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7efe81ffb640 1 -- 172.21.15.165:0/2384202014 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c031070 con 0x5562e3968290 2024-09-22T08:11:09.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7efe81ffb640 1 -- 172.21.15.165:0/2384202014 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c04c040 con 0x5562e3968290 2024-09-22T08:11:09.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562e3970090 con 0x5562e3968290 2024-09-22T08:11:09.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7efe81ffb640 1 -- 172.21.15.165:0/2384202014 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c01d040 con 0x5562e3968290 2024-09-22T08:11:09.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.672+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562e3970c20 con 0x5562e3968290 2024-09-22T08:11:09.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.673+0000 7efe81ffb640 1 -- 172.21.15.165:0/2384202014 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7eff9c034070 con 0x5562e3968290 2024-09-22T08:11:09.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.673+0000 7efe81ffb640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7403cf60 0x7efe7403f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.673+0000 7efe81ffb640 1 -- 172.21.15.165:0/2384202014 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff9c052020 con 0x5562e3968290 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.673+0000 7effa47c7640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7403cf60 0x7efe7403f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.674+0000 7effa47c7640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7403cf60 0x7efe7403f420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7eff94075f90 tx=0x7eff94084000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.674+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.674+0000 7effa8b39800 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e397b1c0 0x5562e397d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.674+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e397ddd0 con 0x5562e397b1c0 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.674+0000 7effa3fc6640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e397b1c0 0x5562e397d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.674+0000 7effa3fc6640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e397b1c0 0x5562e397d680 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8c00f5f0 con 0x5562e397b1c0 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 20 realm 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e397a510 con 0x5562e397b1c0 2024-09-22T08:11:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8c00f5f0 con 0x5562e397b1c0 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e397e8c0 con 0x5562e397b1c0 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8c00f5f0 con 0x5562e397b1c0 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e397f190 con 0x5562e397b1c0 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff8c00f5f0 con 0x5562e397b1c0 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e397fbb0 0x5562e3981fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e3982710 con 0x5562e397fbb0 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.675+0000 7effa4fc8640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e397fbb0 0x5562e3981fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.676+0000 7effa4fc8640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e397fbb0 0x5562e3981fa0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.676+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.676+0000 7effa8b39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.676+0000 7effa8b39800 20 searching for the correct realm 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.676+0000 7effa8b39800 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5562e39846c0 0x5562e3986b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.676+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e39846c0 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.676+0000 7effa47c7640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5562e39846c0 0x5562e3986b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.676+0000 7effa47c7640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5562e39846c0 0x5562e3986b80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.677+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.677+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397fbb0 2024-09-22T08:11:09.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.677+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.677+0000 7effa4fc8640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7eff9c036070 0x7eff9c045580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.677+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x7eff9c036070 2024-09-22T08:11:09.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.677+0000 7effa3fc6640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7eff9c036070 0x7eff9c045580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.678+0000 7effa3fc6640 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7eff9c036070 0x7eff9c045580 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.678+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c00f5f0 con 0x7eff9c036070 2024-09-22T08:11:09.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.678+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397b1c0 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.678+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c00f5f0 con 0x5562e397b1c0 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.678+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397b1c0 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.678+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7eff8c02b040 con 0x5562e397b1c0 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.678+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x7eff9c036070 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.678+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c02b040 con 0x7eff9c036070 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.678+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x7eff9c036070 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.679+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c02b040 con 0x7eff9c036070 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.679+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397fbb0 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.679+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.679+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e39846c0 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.679+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.679+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397b1c0 2024-09-22T08:11:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.679+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c02b040 con 0x5562e397b1c0 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.679+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x7eff9c036070 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.680+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c02b040 con 0x7eff9c036070 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.680+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397b1c0 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.680+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c02b040 con 0x5562e397b1c0 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.680+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397fbb0 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.680+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.680+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e39846c0 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.680+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.680+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e39846c0 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.681+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.681+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x7eff9c036070 2024-09-22T08:11:09.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.681+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c02b040 con 0x7eff9c036070 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.681+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e39846c0 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.681+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.681+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e39846c0 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.681+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.681+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397b1c0 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.681+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c02b040 con 0x5562e397b1c0 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.681+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397b1c0 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.682+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff8c02b040 con 0x5562e397b1c0 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.682+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x7eff9c036070 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.682+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c02b040 con 0x7eff9c036070 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.682+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e39846c0 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.682+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.682+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397fbb0 2024-09-22T08:11:09.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.682+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.682+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397b1c0 2024-09-22T08:11:09.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.683+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c02b040 con 0x5562e397b1c0 2024-09-22T08:11:09.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.683+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x7eff9c036070 2024-09-22T08:11:09.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.683+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.683+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e39846c0 2024-09-22T08:11:09.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.683+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.683+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x7eff9c036070 2024-09-22T08:11:09.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.683+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.683+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397fbb0 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.684+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.684+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e39846c0 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.684+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.684+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x7eff9c036070 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.684+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.684+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397b1c0 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.684+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.684+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5562e3987250 con 0x5562e397fbb0 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:09.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e39830d0 con 0x5562e397b1c0 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e3983970 con 0x5562e397b1c0 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e39876d0 con 0x5562e397b1c0 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 zone default found 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 4 Realm: () 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 zonegroup default 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.685+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e39876d0 con 0x7eff9c036070 2024-09-22T08:11:09.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e3989570 con 0x5562e39846c0 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e3989910 con 0x5562e39846c0 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa8b39800 20 started sync module instance, tier type = 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa8b39800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.686+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e3988a00 con 0x5562e397fbb0 2024-09-22T08:11:09.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.687+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.687+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93883213582112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e3988a00 con 0x5562e397fbb0 2024-09-22T08:11:09.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.687+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398a3d0 con 0x5562e397b1c0 2024-09-22T08:11:09.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.688+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93883213582112] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.689+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.689+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93883213586112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398a390 con 0x5562e397b1c0 2024-09-22T08:11:09.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.689+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398ae90 con 0x5562e39846c0 2024-09-22T08:11:09.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.690+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93883213586112] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.690+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.690+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93883213588864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398b280 con 0x5562e39846c0 2024-09-22T08:11:09.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.690+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398bcd0 con 0x5562e397fbb0 2024-09-22T08:11:09.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.691+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93883213588864] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.691+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.691+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93883213592512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398c0c0 con 0x5562e397fbb0 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.691+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398cb00 con 0x5562e397b1c0 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.692+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.692+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93883213596112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398cac0 con 0x5562e397b1c0 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.692+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398dac0 con 0x7eff9c036070 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.692+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93883213592512] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.693+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93883213596112] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.693+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.693+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93883213600240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398cca0 con 0x7eff9c036070 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.693+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398e360 con 0x7eff9c036070 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.694+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93883213600240] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.694+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.694+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93883213579600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398cca0 con 0x7eff9c036070 2024-09-22T08:11:09.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.694+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398e8c0 con 0x7eff9c036070 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.695+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93883213579600] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.695+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.695+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93883213603760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398e880 con 0x7eff9c036070 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.695+0000 7effa8b39800 20 add_watcher() i=0 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.695+0000 7effa8b39800 20 add_watcher() i=1 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.695+0000 7effa8b39800 20 add_watcher() i=2 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.695+0000 7effa8b39800 20 add_watcher() i=3 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.695+0000 7effa8b39800 20 add_watcher() i=4 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.695+0000 7effa8b39800 20 add_watcher() i=5 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.695+0000 7effa8b39800 20 add_watcher() i=6 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.696+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93883213603760] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.696+0000 7effa8b39800 20 add_watcher() i=7 2024-09-22T08:11:09.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.696+0000 7effa8b39800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.696+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e3991e10 con 0x5562e397b1c0 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.696+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.696+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93883213602016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398f190 con 0x5562e397b1c0 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.697+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93883213602016] v32'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.697+0000 7efe5a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.697+0000 7effa8b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.697+0000 7effa8b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 5 note: GC not initialized 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7efe597e2640 20 reqs_thread_entry: start 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 20 Filter name: none 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7efdcaffd640 20 reqs_thread_entry: start 2024-09-22T08:11:09.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e39c51f0 con 0x5562e397b1c0 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.698+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e39c7c80 con 0x5562e397fbb0 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa8b39800 20 disabling bucket name=myfoo 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa8b39800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e39c5c60 con 0x5562e397fbb0 2024-09-22T08:11:09.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa8b39800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa8b39800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa8b39800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa8b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 : miss 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa8b39800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.699+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e39c8550 con 0x7eff9c036070 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.700+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(65 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.700+0000 7effa8b39800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.700+0000 7effa8b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.700+0000 7effa8b39800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.700+0000 7effa8b39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.700+0000 7effa8b39800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.700+0000 7effa8b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:09.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.700+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:66 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e39cfd70 con 0x7eff9c036070 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(66 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7effa8b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7effa8b39800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7effa8b39800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7effa8b39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1, ofs0, ns] 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93883213843472 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e39cead0 con 0x7eff9c036070 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== watch-notify(notify (1) cookie 93883213579600 notify 137438953489 ret 0) ==== 802+0+0 (crc 0 0 0) 0x5562e39c8940 con 0x7eff9c036070 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7efe837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 93883213579600 notifier 4591 bl.length()=760 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(67 notify.6 [notify cookie 93883213843472 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7efe837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7efe837fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7efe837fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:09.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.701+0000 7efe837fe640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efe68003ea0 con 0x7eff9c036070 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.702+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.702+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== watch-notify(notify_complete (2) cookie 93883213843472 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5562e39c7a60 con 0x7eff9c036070 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.702+0000 7effa8b39800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_sources= new_sources= 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.702+0000 7effa8b39800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential sources added=[] removed=[] 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.702+0000 7effa8b39800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_dests= new_dests= 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.702+0000 7effa8b39800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential dests added=[] removed=[] 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.702+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e39cac10 con 0x5562e397b1c0 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7effa8b39800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7effa8b39800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7effa8b39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93883213834416 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5562e39c6cd0 con 0x5562e397b1c0 2024-09-22T08:11:09.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 93883213596112 notify 137438953492 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5562e39c7a60 con 0x5562e397b1c0 2024-09-22T08:11:09.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7efe837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 93883213596112 notifier 4591 bl.length()=567 2024-09-22T08:11:09.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7efe837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:09.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7efe837fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:09.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7efe837fe640 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efe68003ea0 con 0x5562e397b1c0 2024-09-22T08:11:09.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(70 notify.4 [notify cookie 93883213834416 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.703+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.704+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 93883213834416 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7eff8c018040 con 0x5562e397b1c0 2024-09-22T08:11:09.724 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:09.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.704+0000 7efe5a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.704+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93883213602016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e39c2ef0 con 0x5562e397b1c0 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.705+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93883213602016] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.705+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93883213582112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e39c2ef0 con 0x5562e397fbb0 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.706+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93883213582112] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.706+0000 7effa8b39800 20 remove_watcher() i=0 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.706+0000 7effa8b39800 2 removed watcher, disabling cache 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.706+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93883213586112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e39c2ef0 con 0x5562e397b1c0 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.708+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93883213586112] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.708+0000 7effa8b39800 20 remove_watcher() i=1 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.708+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93883213588864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e39c2ef0 con 0x5562e39846c0 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.709+0000 7effa47c7640 1 -- 172.21.15.165:0/2384202014 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93883213588864] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff94063cd0 con 0x5562e39846c0 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.709+0000 7effa8b39800 20 remove_watcher() i=2 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.709+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93883213592512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e3989ec0 con 0x5562e397fbb0 2024-09-22T08:11:09.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.710+0000 7effa4fc8640 1 -- 172.21.15.165:0/2384202014 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93883213592512] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff9c033030 con 0x5562e397fbb0 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.710+0000 7effa8b39800 20 remove_watcher() i=3 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.710+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93883213596112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398a980 con 0x5562e397b1c0 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.711+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93883213596112] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x5562e397b1c0 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.711+0000 7effa8b39800 20 remove_watcher() i=4 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.711+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93883213600240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398b7c0 con 0x7eff9c036070 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.712+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93883213600240] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.712+0000 7effa8b39800 20 remove_watcher() i=5 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.712+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93883213579600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e3989ec0 con 0x7eff9c036070 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.713+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93883213579600] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.713+0000 7effa8b39800 20 remove_watcher() i=6 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.713+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93883213603760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5562e398a980 con 0x7eff9c036070 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93883213603760] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8c03b040 con 0x7eff9c036070 2024-09-22T08:11:09.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 20 remove_watcher() i=7 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7eff9c036070 msgr2=0x7eff9c045580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7eff9c036070 0x7eff9c045580 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e397b1c0 msgr2=0x5562e397d680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e397b1c0 0x5562e397d680 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e397fbb0 msgr2=0x5562e3981fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e397fbb0 0x5562e3981fa0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5562e39846c0 msgr2=0x5562e3986b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5562e39846c0 0x5562e3986b80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7403cf60 msgr2=0x7efe7403f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7403cf60 0x7efe7403f420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7eff94075f90 tx=0x7eff94084000 comp rx=0 tx=0).stop 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 msgr2=0x5562e396f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 --2- 172.21.15.165:0/2384202014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e3968290 0x5562e396f8a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7eff9c019bb0 tx=0x7eff9c054980 comp rx=0 tx=0).stop 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 reap_dead start 2024-09-22T08:11:09.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa3fc6640 1 -- 172.21.15.165:0/2384202014 reap_dead start 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 shutdown_connections 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 >> 172.21.15.165:0/2384202014 conn(0x5562e3964690 msgr2=0x5562e39628a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 shutdown_connections 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.714+0000 7effa8b39800 1 -- 172.21.15.165:0/2384202014 wait complete. 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/3948496359 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7c03cfb0 msgr2=0x7efe7c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/3948496359 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7c03cfb0 0x7efe7c03f470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5562e3948520 tx=0x7eff94063f60 comp rx=0 tx=0).stop 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/3948496359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e395b7f0 msgr2=0x5562e395bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/3948496359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e395b7f0 0x5562e395bc10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5562e39418b0 tx=0x7eff9c00af40 comp rx=0 tx=0).stop 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/3948496359 shutdown_connections 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/3948496359 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe7c03cfb0 0x7efe7c03f470 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/3948496359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e395b7f0 0x5562e395bc10 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/3948496359 >> 172.21.15.165:0/3948496359 conn(0x5562e394fba0 msgr2=0x5562e394ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/3948496359 shutdown_connections 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/3948496359 wait complete. 2024-09-22T08:11:09.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e384c9d0 msgr2=0x5562e3947f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e384c9d0 0x5562e3947f00 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e394a3b0 msgr2=0x5562e394c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e394a3b0 0x5562e394c7a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe8c03cfb0 msgr2=0x7efe8c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe8c03cfb0 0x7efe8c03f470 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7eff8c000c00 tx=0x7eff8c0013b0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 msgr2=0x5562e39408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e39408b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7eff94025a60 tx=0x7eff94003330 comp rx=0 tx=0).stop 2024-09-22T08:11:09.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 shutdown_connections 2024-09-22T08:11:09.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5562e394a3b0 0x5562e394c7a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5562e384c9d0 0x5562e3947f00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efe8c03cfb0 0x7efe8c03f470 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 --2- 172.21.15.165:0/2997943485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562e384a0a0 0x5562e39408b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 >> 172.21.15.165:0/2997943485 conn(0x5562e3843be0 msgr2=0x5562e393a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 shutdown_connections 2024-09-22T08:11:09.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.715+0000 7effa8b39800 1 -- 172.21.15.165:0/2997943485 wait complete. 2024-09-22T08:11:09.735 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:09.737 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-22T08:11:09.737 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-22T08:11:09.737 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-22T08:11:09.781 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:09.781 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:09.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.780+0000 7fb5f8292800 1 Processor -- start 2024-09-22T08:11:09.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.780+0000 7fb5f8292800 1 -- start start 2024-09-22T08:11:09.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.780+0000 7fb5f8292800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f4b58b59d0 0x55f4b58b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.781+0000 7fb5f8292800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4b573ca20 con 0x55f4b5824d30 2024-09-22T08:11:09.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.781+0000 7fb5f8292800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f4b573c7d0 con 0x55f4b58b59d0 2024-09-22T08:11:09.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.781+0000 7fb5f557b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f4b58b59d0 0x55f4b58b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.781+0000 7fb5f5d7c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f4b5824d30 0x55f4b58b4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:33874/0 (socket says 172.21.15.165:33874) 2024-09-22T08:11:09.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.781+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3229393590 learned_addr learned my addr 172.21.15.165:0/3229393590 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:09.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.781+0000 7fb5f557b640 1 -- 172.21.15.165:0/3229393590 >> v1:172.21.15.53:6789/0 conn(0x55f4b5824d30 legacy=0x55f4b58b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.781+0000 7fb5f4d7a640 1 -- 172.21.15.165:0/3229393590 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2483409477 0 0) 0x55f4b573ca20 con 0x55f4b5824d30 2024-09-22T08:11:09.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.781+0000 7fb5f557b640 1 -- 172.21.15.165:0/3229393590 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b58b9570 con 0x55f4b58b59d0 2024-09-22T08:11:09.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.783+0000 7fb5f557b640 1 --2- 172.21.15.165:0/3229393590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b58b59d0 0x55f4b58b7e90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000a470 tx=0x7fb5e0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48538213a3b4e4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.783+0000 7fb5f4d7a640 1 -- 172.21.15.165:0/3229393590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e0053570 con 0x55f4b58b59d0 2024-09-22T08:11:09.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.783+0000 7fb5f4d7a640 1 -- 172.21.15.165:0/3229393590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e0058070 con 0x55f4b58b59d0 2024-09-22T08:11:09.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.783+0000 7fb5f4d7a640 1 -- 172.21.15.165:0/3229393590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e0053880 con 0x55f4b58b59d0 2024-09-22T08:11:09.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.784+0000 7fb5f8292800 1 -- 172.21.15.165:0/3229393590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b58b59d0 msgr2=0x55f4b58b7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.784+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3229393590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b58b59d0 0x55f4b58b7e90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000a470 tx=0x7fb5e0045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:09.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.784+0000 7fb5f8292800 1 -- 172.21.15.165:0/3229393590 shutdown_connections 2024-09-22T08:11:09.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.784+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3229393590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b58b59d0 0x55f4b58b7e90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.784+0000 7fb5f8292800 1 -- 172.21.15.165:0/3229393590 >> 172.21.15.165:0/3229393590 conn(0x55f4b58abbb0 msgr2=0x55f4b58ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.784+0000 7fb5f8292800 1 -- 172.21.15.165:0/3229393590 shutdown_connections 2024-09-22T08:11:09.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.784+0000 7fb5f8292800 1 -- 172.21.15.165:0/3229393590 wait complete. 2024-09-22T08:11:09.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.798+0000 7fb5f8292800 1 Processor -- start 2024-09-22T08:11:09.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.798+0000 7fb5f8292800 1 -- start start 2024-09-22T08:11:09.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.799+0000 7fb5f8292800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.799+0000 7fb5f8292800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4b5749dd0 con 0x55f4b5824d30 2024-09-22T08:11:09.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.799+0000 7fb5f5d7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.799+0000 7fb5f5d7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53126/0 (socket says 172.21.15.165:53126) 2024-09-22T08:11:09.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.799+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/1572914105 learned_addr learned my addr 172.21.15.165:0/1572914105 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.799+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/1572914105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b59a1430 con 0x55f4b5824d30 2024-09-22T08:11:09.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.799+0000 7fb5f5d7c640 1 --2- 172.21.15.165:0/1572914105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a0e40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8006fa0 tx=0x7fb5e8001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6fbcd5d1f18869 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.799+0000 7fb4e3e07640 1 -- 172.21.15.165:0/1572914105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e8003450 con 0x55f4b5824d30 2024-09-22T08:11:09.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.800+0000 7fb4e3e07640 1 -- 172.21.15.165:0/1572914105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8003610 con 0x55f4b5824d30 2024-09-22T08:11:09.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.800+0000 7fb4e3e07640 1 -- 172.21.15.165:0/1572914105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e8003970 con 0x55f4b5824d30 2024-09-22T08:11:09.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.800+0000 7fb5f8292800 1 -- 172.21.15.165:0/1572914105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 msgr2=0x55f4b59a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.800+0000 7fb5f8292800 1 --2- 172.21.15.165:0/1572914105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a0e40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8006fa0 tx=0x7fb5e8001b00 comp rx=0 tx=0).stop 2024-09-22T08:11:09.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.800+0000 7fb5f8292800 1 -- 172.21.15.165:0/1572914105 shutdown_connections 2024-09-22T08:11:09.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.800+0000 7fb5f8292800 1 --2- 172.21.15.165:0/1572914105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a0e40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.800+0000 7fb5f8292800 1 -- 172.21.15.165:0/1572914105 >> 172.21.15.165:0/1572914105 conn(0x55f4b58abbb0 msgr2=0x55f4b599c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.800+0000 7fb5f8292800 1 -- 172.21.15.165:0/1572914105 shutdown_connections 2024-09-22T08:11:09.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.800+0000 7fb5f8292800 1 -- 172.21.15.165:0/1572914105 wait complete. 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.801+0000 7fb5f8292800 1 Processor -- start 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.801+0000 7fb5f8292800 1 -- start start 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.801+0000 7fb5f8292800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.801+0000 7fb5f8292800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4b58b8810 con 0x55f4b5824d30 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.801+0000 7fb5f5d7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.801+0000 7fb5f5d7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53140/0 (socket says 172.21.15.165:53140) 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.801+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3253787380 learned_addr learned my addr 172.21.15.165:0/3253787380 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.801+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3253787380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b59a8eb0 con 0x55f4b5824d30 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.801+0000 7fb5f5d7c640 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a8950 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8001330 tx=0x7fb5e8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.802+0000 7fb4e2604640 1 -- 172.21.15.165:0/3253787380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e8014a10 con 0x55f4b5824d30 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.802+0000 7fb4e2604640 1 -- 172.21.15.165:0/3253787380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8014bb0 con 0x55f4b5824d30 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.802+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4b59a9140 con 0x55f4b5824d30 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.802+0000 7fb4e2604640 1 -- 172.21.15.165:0/3253787380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e801e3f0 con 0x55f4b5824d30 2024-09-22T08:11:09.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.802+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b59a9b40 con 0x55f4b5824d30 2024-09-22T08:11:09.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.803+0000 7fb4e2604640 1 -- 172.21.15.165:0/3253787380 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb5e8010070 con 0x55f4b5824d30 2024-09-22T08:11:09.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.803+0000 7fb4e2604640 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4dc03d000 0x7fb4dc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.803+0000 7fb4e2604640 1 -- 172.21.15.165:0/3253787380 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb5e8018070 con 0x55f4b5824d30 2024-09-22T08:11:09.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.803+0000 7fb5f557b640 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4dc03d000 0x7fb4dc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.803+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b58b59d0 0x55f4b59affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.803+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59b04e0 con 0x55f4b58b59d0 2024-09-22T08:11:09.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.803+0000 7fb5f657d640 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b58b59d0 0x55f4b59affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.803+0000 7fb5f557b640 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4dc03d000 0x7fb4dc03f4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0057000 tx=0x7fb5e0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.803+0000 7fb5f657d640 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b58b59d0 0x55f4b59affa0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.804+0000 7fb5f657d640 1 -- 172.21.15.165:0/3253787380 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b58b59d0 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.804+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59b0880 con 0x55f4b58b59d0 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.804+0000 7fb5f657d640 1 -- 172.21.15.165:0/3253787380 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b58b59d0 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.804+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59b2380 0x55f4b59b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.804+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59b4f90 con 0x55f4b59b2380 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.804+0000 7fb5f5d7c640 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59b2380 0x55f4b59b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.804+0000 7fb5f5d7c640 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59b2380 0x55f4b59b4800 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.805+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3253787380 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59b2380 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.805+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59b10d0 con 0x55f4b58b59d0 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.805+0000 7fb5f657d640 1 -- 172.21.15.165:0/3253787380 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b58b59d0 2024-09-22T08:11:09.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.805+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59b1520 con 0x55f4b58b59d0 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.805+0000 7fb5f657d640 1 -- 172.21.15.165:0/3253787380 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b58b59d0 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.806+0000 7fb5f8292800 1 Processor -- start 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.806+0000 7fb5f8292800 1 -- start start 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.806+0000 7fb5f8292800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59c3970 0x55f4b59c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.806+0000 7fb5f8292800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4b57a8d50 con 0x55f4b59c3970 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.806+0000 7fb5f657d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59c3970 0x55f4b59c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.806+0000 7fb5f657d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59c3970 0x55f4b59c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53150/0 (socket says 172.21.15.165:53150) 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.806+0000 7fb5f657d640 1 -- 172.21.15.165:0/3284249523 learned_addr learned my addr 172.21.15.165:0/3284249523 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.806+0000 7fb5f657d640 1 -- 172.21.15.165:0/3284249523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b59c43d0 con 0x55f4b59c3970 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.807+0000 7fb5f657d640 1 --2- 172.21.15.165:0/3284249523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59c3970 0x55f4b59c3d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x55f4b59aa8a0 tx=0x7fb5f000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.807+0000 7fb4db7fe640 1 -- 172.21.15.165:0/3284249523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0007dc0 con 0x55f4b59c3970 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.807+0000 7fb4db7fe640 1 -- 172.21.15.165:0/3284249523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f001e020 con 0x55f4b59c3970 2024-09-22T08:11:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.807+0000 7fb5f8292800 1 -- 172.21.15.165:0/3284249523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4b59c4c00 con 0x55f4b59c3970 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.807+0000 7fb4db7fe640 1 -- 172.21.15.165:0/3284249523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0019570 con 0x55f4b59c3970 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.807+0000 7fb5f8292800 1 -- 172.21.15.165:0/3284249523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b59c51a0 con 0x55f4b59c3970 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.808+0000 7fb4db7fe640 1 -- 172.21.15.165:0/3284249523 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb5f0016040 con 0x55f4b59c3970 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.808+0000 7fb4db7fe640 1 --2- 172.21.15.165:0/3284249523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4d003cfb0 0x7fb4d003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.808+0000 7fb4db7fe640 1 -- 172.21.15.165:0/3284249523 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb5f001f030 con 0x55f4b59c3970 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.808+0000 7fb5f5d7c640 1 --2- 172.21.15.165:0/3284249523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4d003cfb0 0x7fb4d003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.808+0000 7fb5f8292800 1 Processor -- start 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.808+0000 7fb5f5d7c640 1 --2- 172.21.15.165:0/3284249523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4d003cfb0 0x7fb4d003f470 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55f4b59aaa40 tx=0x7fb5e8052a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.808+0000 7fb5f8292800 1 -- start start 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.808+0000 7fb5f8292800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.808+0000 7fb5f8292800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4b59a1860 con 0x55f4b59d04b0 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.809+0000 7fb5f657d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.809+0000 7fb5f657d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53158/0 (socket says 172.21.15.165:53158) 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.809+0000 7fb5f657d640 1 -- 172.21.15.165:0/3663740107 learned_addr learned my addr 172.21.15.165:0/3663740107 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.809+0000 7fb5f657d640 1 -- 172.21.15.165:0/3663740107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b59d0e80 con 0x55f4b59d04b0 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.809+0000 7fb5f657d640 1 --2- 172.21.15.165:0/3663740107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d0890 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0014d90 tx=0x7fb5f0014d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4807dc54da32fa server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.809+0000 7fb4d97fa640 1 -- 172.21.15.165:0/3663740107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0051020 con 0x55f4b59d04b0 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.809+0000 7fb4d97fa640 1 -- 172.21.15.165:0/3663740107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f00560d0 con 0x55f4b59d04b0 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.809+0000 7fb4d97fa640 1 -- 172.21.15.165:0/3663740107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f001d070 con 0x55f4b59d04b0 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 -- 172.21.15.165:0/3663740107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 msgr2=0x55f4b59d0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3663740107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d0890 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0014d90 tx=0x7fb5f0014d00 comp rx=0 tx=0).stop 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 -- 172.21.15.165:0/3663740107 shutdown_connections 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3663740107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d0890 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 -- 172.21.15.165:0/3663740107 >> 172.21.15.165:0/3663740107 conn(0x55f4b59cc8b0 msgr2=0x55f4b59caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 -- 172.21.15.165:0/3663740107 shutdown_connections 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 -- 172.21.15.165:0/3663740107 wait complete. 2024-09-22T08:11:09.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 Processor -- start 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 -- start start 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f8292800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4b59d14c0 con 0x55f4b59d04b0 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f657d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f657d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:53162/0 (socket says 172.21.15.165:53162) 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.810+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 learned_addr learned my addr 172.21.15.165:0/3697504164 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.811+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b59d7f70 con 0x55f4b59d04b0 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.811+0000 7fb5f657d640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d7a10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0053530 tx=0x7fb5f00545f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.811+0000 7fb4c77fe640 1 -- 172.21.15.165:0/3697504164 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0045470 con 0x55f4b59d04b0 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.811+0000 7fb4c77fe640 1 -- 172.21.15.165:0/3697504164 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f0031070 con 0x55f4b59d04b0 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.811+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4b59d8200 con 0x55f4b59d04b0 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.811+0000 7fb4c77fe640 1 -- 172.21.15.165:0/3697504164 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f00173b0 con 0x55f4b59d04b0 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.811+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b59d8b80 con 0x55f4b59d04b0 2024-09-22T08:11:09.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.812+0000 7fb4c77fe640 1 -- 172.21.15.165:0/3697504164 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb5f0017550 con 0x55f4b59d04b0 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.812+0000 7fb4c77fe640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4c003cfb0 0x7fb4c003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.812+0000 7fb4c77fe640 1 -- 172.21.15.165:0/3697504164 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb5f003eb40 con 0x55f4b59d04b0 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.812+0000 7fb5f5d7c640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4c003cfb0 0x7fb4c003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.812+0000 7fb5f5d7c640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4c003cfb0 0x7fb4c003f470 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80035e0 tx=0x7fb5e8036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.813+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.813+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b59e3340 0x55f4b59e5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.813+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59e5f50 con 0x55f4b59e3340 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.813+0000 7fb5f557b640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b59e3340 0x55f4b59e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.813+0000 7fb5f557b640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b59e3340 0x55f4b59e5800 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.813+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.813+0000 7fb5f8292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.813+0000 7fb5f8292800 20 realm 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.813+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.813+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59e6380 con 0x55f4b59e3340 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59e6c50 con 0x55f4b59e3340 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59e6ff0 con 0x55f4b59e3340 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59e7d50 0x55f4b59ea140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ea750 con 0x55f4b59e7d50 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f657d640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59e7d50 0x55f4b59ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.814+0000 7fb5f657d640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59e7d50 0x55f4b59ea140 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.815+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.815+0000 7fb5f8292800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.815+0000 7fb5f8292800 20 searching for the correct realm 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.815+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f4b59ec700 0x55f4b59eebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.815+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59ec700 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.815+0000 7fb5f5d7c640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f4b59ec700 0x55f4b59eebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.815+0000 7fb5f5d7c640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f4b59ec700 0x55f4b59eebc0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.815+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.815+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e7d50 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.816+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.816+0000 7fb5f657d640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb5f0019040 0x7fb5f00479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.816+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x7fb5f0019040 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.816+0000 7fb5f557b640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb5f0019040 0x7fb5f00479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.816+0000 7fb5f557b640 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb5f0019040 0x7fb5f00479f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.816+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x7fb5f0019040 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.816+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e3340 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.817+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.817+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e3340 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.817+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.817+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x7fb5f0019040 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.817+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x7fb5f0019040 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.817+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x7fb5f0019040 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.817+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x7fb5f0019040 2024-09-22T08:11:09.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.817+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e7d50 2024-09-22T08:11:09.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.818+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.818+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59ec700 2024-09-22T08:11:09.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.818+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.818+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e3340 2024-09-22T08:11:09.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.818+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.818+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x7fb5f0019040 2024-09-22T08:11:09.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.818+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x7fb5f0019040 2024-09-22T08:11:09.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.818+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e3340 2024-09-22T08:11:09.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.819+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.819+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e7d50 2024-09-22T08:11:09.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.819+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.819+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59ec700 2024-09-22T08:11:09.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.819+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.819+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59ec700 2024-09-22T08:11:09.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.819+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.819+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x7fb5f0019040 2024-09-22T08:11:09.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.820+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x7fb5f0019040 2024-09-22T08:11:09.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.820+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59ec700 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.820+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.820+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59ec700 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.820+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.820+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e3340 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.820+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.820+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e3340 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.820+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.821+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x7fb5f0019040 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.821+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x7fb5f0019040 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.821+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59ec700 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.821+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.821+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e7d50 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.821+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.821+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e3340 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.821+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.821+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x7fb5f0019040 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.822+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x7fb5f0019040 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.822+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59ec700 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.822+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.822+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x7fb5f0019040 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.822+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x7fb5f0019040 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.822+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e7d50 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.822+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.822+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59ec700 2024-09-22T08:11:09.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x7fb5f0019040 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0051070 con 0x7fb5f0019040 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e3340 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef240 con 0x55f4b59e7d50 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f8292800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f8292800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f8292800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f8292800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:09.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f8292800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f8292800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.823+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59eb140 con 0x55f4b59e3340 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59eb9e0 con 0x55f4b59e3340 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5e0051070 con 0x55f4b59e3340 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef6c0 con 0x55f4b59e3340 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 20 zone default found 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 4 Realm: () 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 20 zonegroup default 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59ef720 con 0x7fb5f0019040 2024-09-22T08:11:09.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.824+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f1580 con 0x55f4b59ec700 2024-09-22T08:11:09.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.825+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.825+0000 7fb5f8292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.825+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.825+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f1a60 con 0x55f4b59ec700 2024-09-22T08:11:09.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.825+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.825+0000 7fb5f8292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.825+0000 7fb5f8292800 20 started sync module instance, tier type = 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.825+0000 7fb5f8292800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.825+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f09f0 con 0x55f4b59e7d50 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.826+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.826+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94509507481360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f09f0 con 0x55f4b59e7d50 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.826+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f24e0 con 0x55f4b59e3340 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.827+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94509507481360] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.827+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.827+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94509507486224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f09f0 con 0x55f4b59e3340 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.827+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f2f70 con 0x55f4b59ec700 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.828+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94509507486224] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.828+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.828+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94509507478848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f0960 con 0x55f4b59ec700 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.828+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f3e30 con 0x55f4b59e7d50 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.829+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94509507478848] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.829+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.829+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94509507492224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f3da0 con 0x55f4b59e7d50 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.829+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f4d20 con 0x55f4b59e3340 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.830+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.830+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94509507496048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f5140 con 0x55f4b59e3340 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.830+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f5bf0 con 0x7fb5f0019040 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.830+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94509507492224] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.831+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94509507496048] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.831+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.831+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94509507494480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f4c90 con 0x7fb5f0019040 2024-09-22T08:11:09.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.831+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f6490 con 0x7fb5f0019040 2024-09-22T08:11:09.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.832+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94509507494480] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.832+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.832+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94509507499728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f4c90 con 0x7fb5f0019040 2024-09-22T08:11:09.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.832+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f6a10 con 0x7fb5f0019040 2024-09-22T08:11:09.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.833+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94509507499728] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.833+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.833+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94509507503360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f69d0 con 0x7fb5f0019040 2024-09-22T08:11:09.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.833+0000 7fb5f8292800 20 add_watcher() i=0 2024-09-22T08:11:09.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.833+0000 7fb5f8292800 20 add_watcher() i=1 2024-09-22T08:11:09.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.833+0000 7fb5f8292800 20 add_watcher() i=2 2024-09-22T08:11:09.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.833+0000 7fb5f8292800 20 add_watcher() i=3 2024-09-22T08:11:09.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.833+0000 7fb5f8292800 20 add_watcher() i=4 2024-09-22T08:11:09.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.833+0000 7fb5f8292800 20 add_watcher() i=5 2024-09-22T08:11:09.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.833+0000 7fb5f8292800 20 add_watcher() i=6 2024-09-22T08:11:09.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.834+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94509507503360] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.834+0000 7fb5f8292800 20 add_watcher() i=7 2024-09-22T08:11:09.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.834+0000 7fb5f8292800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:09.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.834+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f9f60 con 0x55f4b59e3340 2024-09-22T08:11:09.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.835+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.835+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94509507501792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b59f9f60 con 0x55f4b59e3340 2024-09-22T08:11:09.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94509507501792] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb4a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb5f8292800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:09.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb5f8292800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:09.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb5f8292800 5 note: GC not initialized 2024-09-22T08:11:09.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb4a67fc640 20 reqs_thread_entry: start 2024-09-22T08:11:09.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb5f8292800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:09.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb5f8292800 20 Filter name: none 2024-09-22T08:11:09.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb417fff640 20 reqs_thread_entry: start 2024-09-22T08:11:09.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb5f8292800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:09.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.836+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2d2e0 con 0x55f4b59e3340 2024-09-22T08:11:09.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:09.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:09.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:09.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:09.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2cd30 con 0x55f4b59e7d50 2024-09-22T08:11:09.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 20 enabling bucket name=myfoo 2024-09-22T08:11:09.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:09.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2dd50 con 0x55f4b59e7d50 2024-09-22T08:11:09.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:09.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-22T08:11:09.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:09.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 : miss 2024-09-22T08:11:09.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.837+0000 7fb5f8292800 20 rados->read ofs=0 len=0 2024-09-22T08:11:09.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.838+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a30970 con 0x7fb5f0019040 2024-09-22T08:11:09.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.838+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(65 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.838+0000 7fb5f8292800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:09.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.838+0000 7fb5f8292800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:09.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.838+0000 7fb5f8292800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:09.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.838+0000 7fb5f8292800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:09.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.838+0000 7fb5f8292800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:09.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.838+0000 7fb5f8292800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 2024-09-22T08:11:09.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.838+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:66 8.1e 8:7cec0573:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a381e0 con 0x7fb5f0019040 2024-09-22T08:11:09.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.839+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(66 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.839+0000 7fb5f8292800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:09.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.839+0000 7fb5f8292800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:09.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.839+0000 7fb5f8292800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:09.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.839+0000 7fb5f8292800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1, ofs0, ns] 2024-09-22T08:11:09.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.839+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94509507743792 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a36ef0 con 0x7fb5f0019040 2024-09-22T08:11:09.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== watch-notify(notify (1) cookie 94509507499728 notify 137438953490 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55f4b5a30d60 con 0x7fb5f0019040 2024-09-22T08:11:09.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb4d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94509507499728 notifier 4598 bl.length()=760 2024-09-22T08:11:09.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb4d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 info.flags=0x17 2024-09-22T08:11:09.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb4d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1 to cache LRU end 2024-09-22T08:11:09.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb4d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:09.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb4d97fa640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb4b8003ea0 con 0x7fb5f0019040 2024-09-22T08:11:09.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(67 notify.6 [notify cookie 94509507743792 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== watch-notify(notify_complete (2) cookie 94509507743792 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f4b5a2ffb0 con 0x7fb5f0019040 2024-09-22T08:11:09.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb5f8292800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_sources= new_sources= 2024-09-22T08:11:09.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb5f8292800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential sources added=[] removed=[] 2024-09-22T08:11:09.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb5f8292800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): orig_dests= new_dests= 2024-09-22T08:11:09.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb5f8292800 20 handle_bi_update(): bucket=:myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1]): potential dests added=[] removed=[] 2024-09-22T08:11:09.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.840+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a31010 con 0x55f4b59e3340 2024-09-22T08:11:09.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb5f8292800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:09.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb5f8292800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:09.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb5f8292800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:09.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94509507721184 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2bc00 con 0x55f4b59e3340 2024-09-22T08:11:09.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 94509507496048 notify 137438953493 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55f4b5a2ffb0 con 0x55f4b59e3340 2024-09-22T08:11:09.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb4d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94509507496048 notifier 4598 bl.length()=567 2024-09-22T08:11:09.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb4d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:09.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb4d8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:09.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb4d8ff9640 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb420003430 con 0x55f4b59e3340 2024-09-22T08:11:09.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.841+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(70 notify.4 [notify cookie 94509507721184 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.842+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== watch-notify(notify_complete (2) cookie 94509507721184 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f4b58b9570 con 0x55f4b59e3340 2024-09-22T08:11:09.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.842+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.869 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:09.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.843+0000 7fb4a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:09.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.843+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94509507501792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2b000 con 0x55f4b59e3340 2024-09-22T08:11:09.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.844+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94509507501792] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.844+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94509507481360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2b000 con 0x55f4b59e7d50 2024-09-22T08:11:09.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.845+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94509507481360] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.845+0000 7fb5f8292800 20 remove_watcher() i=0 2024-09-22T08:11:09.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.845+0000 7fb5f8292800 2 removed watcher, disabling cache 2024-09-22T08:11:09.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.845+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94509507486224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2b000 con 0x55f4b59e3340 2024-09-22T08:11:09.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.846+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94509507486224] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.846+0000 7fb5f8292800 20 remove_watcher() i=1 2024-09-22T08:11:09.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.846+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94509507478848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2b000 con 0x55f4b59ec700 2024-09-22T08:11:09.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.847+0000 7fb5f5d7c640 1 -- 172.21.15.165:0/3697504164 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94509507478848] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e801b070 con 0x55f4b59ec700 2024-09-22T08:11:09.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.847+0000 7fb5f8292800 20 remove_watcher() i=2 2024-09-22T08:11:09.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.847+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94509507492224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2b000 con 0x55f4b59e7d50 2024-09-22T08:11:09.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.848+0000 7fb5f657d640 1 -- 172.21.15.165:0/3697504164 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94509507492224] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f00083e0 con 0x55f4b59e7d50 2024-09-22T08:11:09.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.848+0000 7fb5f8292800 20 remove_watcher() i=3 2024-09-22T08:11:09.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.848+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94509507496048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2b000 con 0x55f4b59e3340 2024-09-22T08:11:09.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.849+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94509507496048] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x55f4b59e3340 2024-09-22T08:11:09.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.849+0000 7fb5f8292800 20 remove_watcher() i=4 2024-09-22T08:11:09.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.849+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94509507494480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2b000 con 0x7fb5f0019040 2024-09-22T08:11:09.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.850+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94509507494480] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.850+0000 7fb5f8292800 20 remove_watcher() i=5 2024-09-22T08:11:09.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.850+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94509507499728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2b000 con 0x7fb5f0019040 2024-09-22T08:11:09.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.851+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94509507499728] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.851+0000 7fb5f8292800 20 remove_watcher() i=6 2024-09-22T08:11:09.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.851+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94509507503360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b5a2b000 con 0x7fb5f0019040 2024-09-22T08:11:09.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94509507503360] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00891c0 con 0x7fb5f0019040 2024-09-22T08:11:09.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 20 remove_watcher() i=7 2024-09-22T08:11:09.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb5f0019040 msgr2=0x7fb5f00479f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb5f0019040 0x7fb5f00479f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b59e3340 msgr2=0x55f4b59e5800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b59e3340 0x55f4b59e5800 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59e7d50 msgr2=0x55f4b59ea140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59e7d50 0x55f4b59ea140 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f4b59ec700 msgr2=0x55f4b59eebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f4b59ec700 0x55f4b59eebc0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4c003cfb0 msgr2=0x7fb4c003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4c003cfb0 0x7fb4c003f470 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80035e0 tx=0x7fb5e8036000 comp rx=0 tx=0).stop 2024-09-22T08:11:09.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 msgr2=0x55f4b59d7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3697504164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59d04b0 0x55f4b59d7a10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0053530 tx=0x7fb5f00545f0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 reap_dead start 2024-09-22T08:11:09.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f557b640 1 -- 172.21.15.165:0/3697504164 reap_dead start 2024-09-22T08:11:09.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 shutdown_connections 2024-09-22T08:11:09.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 >> 172.21.15.165:0/3697504164 conn(0x55f4b59cc8b0 msgr2=0x55f4b59caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 shutdown_connections 2024-09-22T08:11:09.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.852+0000 7fb5f8292800 1 -- 172.21.15.165:0/3697504164 wait complete. 2024-09-22T08:11:09.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3284249523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4d003cfb0 msgr2=0x7fb4d003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3284249523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4d003cfb0 0x7fb4d003f470 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55f4b59aaa40 tx=0x7fb5e8052a80 comp rx=0 tx=0).stop 2024-09-22T08:11:09.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3284249523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59c3970 msgr2=0x55f4b59c3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3284249523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59c3970 0x55f4b59c3d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x55f4b59aa8a0 tx=0x7fb5f000af40 comp rx=0 tx=0).stop 2024-09-22T08:11:09.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3284249523 shutdown_connections 2024-09-22T08:11:09.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3284249523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4d003cfb0 0x7fb4d003f470 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3284249523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b59c3970 0x55f4b59c3d90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3284249523 >> 172.21.15.165:0/3284249523 conn(0x55f4b59b7d20 msgr2=0x55f4b59b8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3284249523 shutdown_connections 2024-09-22T08:11:09.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3284249523 wait complete. 2024-09-22T08:11:09.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b58b59d0 msgr2=0x55f4b59affa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b58b59d0 0x55f4b59affa0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59b2380 msgr2=0x55f4b59b4800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59b2380 0x55f4b59b4800 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4dc03d000 msgr2=0x7fb4dc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4dc03d000 0x7fb4dc03f4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0057000 tx=0x7fb5e0052000 comp rx=0 tx=0).stop 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 msgr2=0x55f4b59a8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a8950 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8001330 tx=0x7fb5e8001250 comp rx=0 tx=0).stop 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 shutdown_connections 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f4b59b2380 0x55f4b59b4800 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f4b58b59d0 0x55f4b59affa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb4dc03d000 0x7fb4dc03f4c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 --2- 172.21.15.165:0/3253787380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4b5824d30 0x55f4b59a8950 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 >> 172.21.15.165:0/3253787380 conn(0x55f4b58abbb0 msgr2=0x55f4b59a2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 shutdown_connections 2024-09-22T08:11:09.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:09.853+0000 7fb5f8292800 1 -- 172.21.15.165:0/3253787380 wait complete. 2024-09-22T08:11:09.884 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:09.891 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-22T08:11:10.116 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-22T08:11:10.122 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:25.122 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-22T08:11:25.123 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-22T08:11:25.123 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-22T08:11:25.176 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:25.176 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:25.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.176+0000 7ffb00a98800 1 Processor -- start 2024-09-22T08:11:25.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.176+0000 7ffb00a98800 1 -- start start 2024-09-22T08:11:25.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.176+0000 7ffb00a98800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f6d1ec37e0 0x55f6d1ec44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.177+0000 7ffb00a98800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f6d1d4fa20 con 0x55f6d1ec4a20 2024-09-22T08:11:25.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.177+0000 7ffb00a98800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f6d1d4f7d0 con 0x55f6d1ec37e0 2024-09-22T08:11:25.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.177+0000 7ffafe582640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f6d1ec37e0 0x55f6d1ec44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.177+0000 7ffafe582640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f6d1ec37e0 0x55f6d1ec44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57818/0 (socket says 172.21.15.165:57818) 2024-09-22T08:11:25.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.177+0000 7ffafdd81640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f6d1ec4a20 0x55f6d1ec9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:36074/0 (socket says 172.21.15.165:36074) 2024-09-22T08:11:25.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.177+0000 7ffafe582640 1 -- 172.21.15.165:0/3102237533 learned_addr learned my addr 172.21.15.165:0/3102237533 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.177+0000 7ffafe582640 1 -- 172.21.15.165:0/3102237533 >> v1:172.21.15.53:6789/0 conn(0x55f6d1ec4a20 legacy=0x55f6d1ec9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.177+0000 7ffafe582640 1 -- 172.21.15.165:0/3102237533 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d1ec3ee0 con 0x55f6d1ec37e0 2024-09-22T08:11:25.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.179+0000 7ffafe582640 1 --2- 172.21.15.165:0/3102237533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1ec44e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000a520 tx=0x7ffaf0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c85c19a90be61d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.179+0000 7ffafd580640 1 -- 172.21.15.165:0/3102237533 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf0055070 con 0x55f6d1ec37e0 2024-09-22T08:11:25.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.179+0000 7ffafd580640 1 -- 172.21.15.165:0/3102237533 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf00515b0 con 0x55f6d1ec37e0 2024-09-22T08:11:25.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.180+0000 7ffafd580640 1 -- 172.21.15.165:0/3102237533 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf00518d0 con 0x55f6d1ec37e0 2024-09-22T08:11:25.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.180+0000 7ffb00a98800 1 -- 172.21.15.165:0/3102237533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 msgr2=0x55f6d1ec44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.180+0000 7ffb00a98800 1 --2- 172.21.15.165:0/3102237533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1ec44e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000a520 tx=0x7ffaf0045ba0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.180+0000 7ffb00a98800 1 -- 172.21.15.165:0/3102237533 shutdown_connections 2024-09-22T08:11:25.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.180+0000 7ffb00a98800 1 --2- 172.21.15.165:0/3102237533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1ec44e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.180+0000 7ffb00a98800 1 -- 172.21.15.165:0/3102237533 >> 172.21.15.165:0/3102237533 conn(0x55f6d1ebebb0 msgr2=0x55f6d1ec1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.180+0000 7ffb00a98800 1 -- 172.21.15.165:0/3102237533 shutdown_connections 2024-09-22T08:11:25.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.180+0000 7ffb00a98800 1 -- 172.21.15.165:0/3102237533 wait complete. 2024-09-22T08:11:25.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.198+0000 7ffb00a98800 1 Processor -- start 2024-09-22T08:11:25.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.198+0000 7ffb00a98800 1 -- start start 2024-09-22T08:11:25.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.198+0000 7ffb00a98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fb2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.198+0000 7ffb00a98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1d5cdd0 con 0x55f6d1ec37e0 2024-09-22T08:11:25.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.198+0000 7ffafe582640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fb2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.198+0000 7ffafe582640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fb2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57826/0 (socket says 172.21.15.165:57826) 2024-09-22T08:11:25.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.198+0000 7ffafe582640 1 -- 172.21.15.165:0/197432792 learned_addr learned my addr 172.21.15.165:0/197432792 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.199+0000 7ffafe582640 1 -- 172.21.15.165:0/197432792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d1fb3500 con 0x55f6d1ec37e0 2024-09-22T08:11:25.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.199+0000 7ffafe582640 1 --2- 172.21.15.165:0/197432792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fb2f10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00460d0 tx=0x7ffaf0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd8983e0a845fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.199+0000 7ff9ec608640 1 -- 172.21.15.165:0/197432792 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf00519d0 con 0x55f6d1ec37e0 2024-09-22T08:11:25.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.200+0000 7ff9ec608640 1 -- 172.21.15.165:0/197432792 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf0051b70 con 0x55f6d1ec37e0 2024-09-22T08:11:25.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.200+0000 7ff9ec608640 1 -- 172.21.15.165:0/197432792 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf0051e50 con 0x55f6d1ec37e0 2024-09-22T08:11:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.200+0000 7ffb00a98800 1 -- 172.21.15.165:0/197432792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 msgr2=0x55f6d1fb2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.200+0000 7ffb00a98800 1 --2- 172.21.15.165:0/197432792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fb2f10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00460d0 tx=0x7ffaf0051000 comp rx=0 tx=0).stop 2024-09-22T08:11:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.200+0000 7ffb00a98800 1 -- 172.21.15.165:0/197432792 shutdown_connections 2024-09-22T08:11:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.200+0000 7ffb00a98800 1 --2- 172.21.15.165:0/197432792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fb2f10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.200+0000 7ffb00a98800 1 -- 172.21.15.165:0/197432792 >> 172.21.15.165:0/197432792 conn(0x55f6d1ebebb0 msgr2=0x55f6d1fae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.201+0000 7ffb00a98800 1 -- 172.21.15.165:0/197432792 shutdown_connections 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.201+0000 7ffb00a98800 1 -- 172.21.15.165:0/197432792 wait complete. 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.201+0000 7ffb00a98800 1 Processor -- start 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.201+0000 7ffb00a98800 1 -- start start 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.201+0000 7ffb00a98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fbdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.201+0000 7ffb00a98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1ec5290 con 0x55f6d1ec37e0 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.201+0000 7ffafe582640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fbdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.201+0000 7ffafe582640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fbdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57830/0 (socket says 172.21.15.165:57830) 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.201+0000 7ffafe582640 1 -- 172.21.15.165:0/1524004945 learned_addr learned my addr 172.21.15.165:0/1524004945 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.202+0000 7ffafe582640 1 -- 172.21.15.165:0/1524004945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d1fbe130 con 0x55f6d1ec37e0 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.202+0000 7ffafe582640 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fbdbd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00460d0 tx=0x7ffaf0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.202+0000 7ff9eae05640 1 -- 172.21.15.165:0/1524004945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf00705a0 con 0x55f6d1ec37e0 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.202+0000 7ff9eae05640 1 -- 172.21.15.165:0/1524004945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf0075070 con 0x55f6d1ec37e0 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.202+0000 7ff9eae05640 1 -- 172.21.15.165:0/1524004945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf00708b0 con 0x55f6d1ec37e0 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.202+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6d1fbe3c0 con 0x55f6d1ec37e0 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.203+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6d1fbefd0 con 0x55f6d1ec37e0 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.204+0000 7ff9eae05640 1 -- 172.21.15.165:0/1524004945 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ffaf0058070 con 0x55f6d1ec37e0 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.204+0000 7ff9eae05640 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9e403cfb0 0x7ff9e403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.204+0000 7ff9eae05640 1 -- 172.21.15.165:0/1524004945 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffaf0064070 con 0x55f6d1ec37e0 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.204+0000 7ffafdd81640 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9e403cfb0 0x7ff9e403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.204+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ec4a20 0x55f6d1fc5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.204+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d1fc5760 con 0x55f6d1ec4a20 2024-09-22T08:11:25.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.204+0000 7ffafdd81640 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9e403cfb0 0x7ff9e403f470 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4001e30 tx=0x7ffaf4001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.204+0000 7ffafed83640 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ec4a20 0x55f6d1fc5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.205+0000 7ffafed83640 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ec4a20 0x55f6d1fc5220 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.205+0000 7ffafed83640 1 -- 172.21.15.165:0/1524004945 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffaf800a4d0 con 0x55f6d1ec4a20 2024-09-22T08:11:25.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.205+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d1fc5b00 con 0x55f6d1ec4a20 2024-09-22T08:11:25.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.205+0000 7ffafed83640 1 -- 172.21.15.165:0/1524004945 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffaf800a4d0 con 0x55f6d1ec4a20 2024-09-22T08:11:25.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.205+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1fc7600 0x55f6d1fc9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.205+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d1fca230 con 0x55f6d1fc7600 2024-09-22T08:11:25.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.206+0000 7ffafe582640 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1fc7600 0x55f6d1fc9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.206+0000 7ffafe582640 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1fc7600 0x55f6d1fc9aa0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.206+0000 7ffafe582640 1 -- 172.21.15.165:0/1524004945 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d1fc7600 2024-09-22T08:11:25.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.206+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d1fc6350 con 0x55f6d1ec4a20 2024-09-22T08:11:25.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.206+0000 7ffafed83640 1 -- 172.21.15.165:0/1524004945 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffaf800a4d0 con 0x55f6d1ec4a20 2024-09-22T08:11:25.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.206+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d1fc67b0 con 0x55f6d1ec4a20 2024-09-22T08:11:25.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.207+0000 7ffafed83640 1 -- 172.21.15.165:0/1524004945 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffaf800a4d0 con 0x55f6d1ec4a20 2024-09-22T08:11:25.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.207+0000 7ffb00a98800 1 Processor -- start 2024-09-22T08:11:25.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.207+0000 7ffb00a98800 1 -- start start 2024-09-22T08:11:25.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.207+0000 7ffb00a98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fd8c40 0x55f6d1fd9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.207+0000 7ffb00a98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1dbbd50 con 0x55f6d1fd8c40 2024-09-22T08:11:25.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.208+0000 7ffafed83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fd8c40 0x55f6d1fd9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.208+0000 7ffafed83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fd8c40 0x55f6d1fd9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57836/0 (socket says 172.21.15.165:57836) 2024-09-22T08:11:25.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.208+0000 7ffafed83640 1 -- 172.21.15.165:0/4160740272 learned_addr learned my addr 172.21.15.165:0/4160740272 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.208+0000 7ffafed83640 1 -- 172.21.15.165:0/4160740272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d1fd96a0 con 0x55f6d1fd8c40 2024-09-22T08:11:25.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.209+0000 7ffafed83640 1 --2- 172.21.15.165:0/4160740272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fd8c40 0x55f6d1fd9060 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55f6d1fbebd0 tx=0x7ffaf8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.210+0000 7ff9e3fff640 1 -- 172.21.15.165:0/4160740272 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8014450 con 0x55f6d1fd8c40 2024-09-22T08:11:25.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.210+0000 7ff9e3fff640 1 -- 172.21.15.165:0/4160740272 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf8014610 con 0x55f6d1fd8c40 2024-09-22T08:11:25.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.210+0000 7ffb00a98800 1 -- 172.21.15.165:0/4160740272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6d1fd9ed0 con 0x55f6d1fd8c40 2024-09-22T08:11:25.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.210+0000 7ff9e3fff640 1 -- 172.21.15.165:0/4160740272 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8014930 con 0x55f6d1fd8c40 2024-09-22T08:11:25.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.211+0000 7ffb00a98800 1 -- 172.21.15.165:0/4160740272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6d1fda470 con 0x55f6d1fd8c40 2024-09-22T08:11:25.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.211+0000 7ff9e3fff640 1 -- 172.21.15.165:0/4160740272 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ffaf8011040 con 0x55f6d1fd8c40 2024-09-22T08:11:25.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.212+0000 7ff9e3fff640 1 --2- 172.21.15.165:0/4160740272 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9d803d000 0x7ff9d803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.212+0000 7ff9e3fff640 1 -- 172.21.15.165:0/4160740272 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffaf801e070 con 0x55f6d1fd8c40 2024-09-22T08:11:25.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.212+0000 7ffafe582640 1 --2- 172.21.15.165:0/4160740272 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9d803d000 0x7ff9d803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.212+0000 7ffb00a98800 1 Processor -- start 2024-09-22T08:11:25.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.212+0000 7ffafe582640 1 --2- 172.21.15.165:0/4160740272 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9d803d000 0x7ff9d803f4c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55f6d1fbfcd0 tx=0x7ffaf0096470 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.212+0000 7ffb00a98800 1 -- start start 2024-09-22T08:11:25.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.212+0000 7ffb00a98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1fe5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.212+0000 7ffb00a98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1fb3870 con 0x55f6d1fe5680 2024-09-22T08:11:25.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.213+0000 7ffafed83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1fe5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.213+0000 7ffafed83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1fe5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57840/0 (socket says 172.21.15.165:57840) 2024-09-22T08:11:25.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.213+0000 7ffafed83640 1 -- 172.21.15.165:0/3280483617 learned_addr learned my addr 172.21.15.165:0/3280483617 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.213+0000 7ffafed83640 1 -- 172.21.15.165:0/3280483617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d1fe6070 con 0x55f6d1fe5680 2024-09-22T08:11:25.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.213+0000 7ffafed83640 1 --2- 172.21.15.165:0/3280483617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1fe5a80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8016fd0 tx=0x7ffaf802b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553ae77c477cfd83 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.213+0000 7ff9e1ffb640 1 -- 172.21.15.165:0/3280483617 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8022de0 con 0x55f6d1fe5680 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.213+0000 7ff9e1ffb640 1 -- 172.21.15.165:0/3280483617 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf8011da0 con 0x55f6d1fe5680 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.213+0000 7ff9e1ffb640 1 -- 172.21.15.165:0/3280483617 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8016930 con 0x55f6d1fe5680 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 -- 172.21.15.165:0/3280483617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 msgr2=0x55f6d1fe5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 --2- 172.21.15.165:0/3280483617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1fe5a80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8016fd0 tx=0x7ffaf802b4c0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 -- 172.21.15.165:0/3280483617 shutdown_connections 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 --2- 172.21.15.165:0/3280483617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1fe5a80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 -- 172.21.15.165:0/3280483617 >> 172.21.15.165:0/3280483617 conn(0x55f6d1fe1aa0 msgr2=0x55f6d1fdfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 -- 172.21.15.165:0/3280483617 shutdown_connections 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 -- 172.21.15.165:0/3280483617 wait complete. 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 Processor -- start 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 -- start start 2024-09-22T08:11:25.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1feccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.214+0000 7ffb00a98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f6d1fe6690 con 0x55f6d1fe5680 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.215+0000 7ffafed83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1feccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.215+0000 7ffafed83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1feccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57856/0 (socket says 172.21.15.165:57856) 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.215+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 learned_addr learned my addr 172.21.15.165:0/1766863128 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.215+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6d1fed210 con 0x55f6d1fe5680 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.215+0000 7ffafed83640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1feccb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8016fd0 tx=0x7ffaf8054670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.215+0000 7ff9cffff640 1 -- 172.21.15.165:0/1766863128 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf80167c0 con 0x55f6d1fe5680 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.215+0000 7ff9cffff640 1 -- 172.21.15.165:0/1766863128 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf8032020 con 0x55f6d1fe5680 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.215+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6d1fed4a0 con 0x55f6d1fe5680 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.215+0000 7ff9cffff640 1 -- 172.21.15.165:0/1766863128 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaf8014ad0 con 0x55f6d1fe5680 2024-09-22T08:11:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.215+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6d1fee030 con 0x55f6d1fe5680 2024-09-22T08:11:25.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.216+0000 7ff9cffff640 1 -- 172.21.15.165:0/1766863128 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ffaf804dd10 con 0x55f6d1fe5680 2024-09-22T08:11:25.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.216+0000 7ff9cffff640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9c803cfb0 0x7ff9c803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.216+0000 7ff9cffff640 1 -- 172.21.15.165:0/1766863128 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffaf8033030 con 0x55f6d1fe5680 2024-09-22T08:11:25.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.217+0000 7ffafe582640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9c803cfb0 0x7ff9c803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.217+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.217+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ff8720 0x55f6d1ffabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.217+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d1ffb330 con 0x55f6d1ff8720 2024-09-22T08:11:25.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.217+0000 7ffafdd81640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ff8720 0x55f6d1ffabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.217+0000 7ffafe582640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9c803cfb0 0x7ff9c803f470 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00507d0 tx=0x7ffaf0087000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.217+0000 7ffafdd81640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ff8720 0x55f6d1ffabe0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffaf400f610 con 0x55f6d1ff8720 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 20 realm 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d1ff7a70 con 0x55f6d1ff8720 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffaf400f610 con 0x55f6d1ff8720 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d1ffbe10 con 0x55f6d1ff8720 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffaf400f610 con 0x55f6d1ff8720 2024-09-22T08:11:25.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d1ffc6e0 con 0x55f6d1ff8720 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffaf400f610 con 0x55f6d1ff8720 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1ffd020 0x55f6d1fff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffafed83640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1ffd020 0x55f6d1fff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.218+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d1fffb50 con 0x55f6d1ffd020 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.219+0000 7ffafed83640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1ffd020 0x55f6d1fff410 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.219+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.219+0000 7ffb00a98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:25.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.219+0000 7ffb00a98800 20 searching for the correct realm 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.219+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f6d2001bd0 0x55f6d2004090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.219+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d2001bd0 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.219+0000 7ffafe582640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f6d2001bd0 0x55f6d2004090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.220+0000 7ffafe582640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f6d2001bd0 0x55f6d2004090 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.220+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.220+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ffd020 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.220+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.220+0000 7ffafed83640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ffaf8014070 0x7ffaf8023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.220+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x7ffaf8014070 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.220+0000 7ffafdd81640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ffaf8014070 0x7ffaf8023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.221+0000 7ffafdd81640 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ffaf8014070 0x7ffaf8023420 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.226 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.221+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf400f610 con 0x7ffaf8014070 2024-09-22T08:11:25.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.221+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ff8720 2024-09-22T08:11:25.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.221+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf400f610 con 0x55f6d1ff8720 2024-09-22T08:11:25.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.221+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ff8720 2024-09-22T08:11:25.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.222+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.222+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x7ffaf8014070 2024-09-22T08:11:25.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.222+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.222+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ffd020 2024-09-22T08:11:25.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.222+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.222+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ffd020 2024-09-22T08:11:25.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.222+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.223+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d2001bd0 2024-09-22T08:11:25.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.223+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.223+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ff8720 2024-09-22T08:11:25.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.223+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.223+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x7ffaf8014070 2024-09-22T08:11:25.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.223+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.223+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ff8720 2024-09-22T08:11:25.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.224+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.224+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ffd020 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.224+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.224+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d2001bd0 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.224+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.224+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d2001bd0 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.224+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.224+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x7ffaf8014070 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.225+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.225+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d2001bd0 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.225+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.225+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d2001bd0 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.225+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.225+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ff8720 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.225+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.225+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ff8720 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.226+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.226+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x7ffaf8014070 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.226+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.226+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d2001bd0 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.226+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.226+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ffd020 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.227+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.227+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ff8720 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.227+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.227+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x7ffaf8014070 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.227+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.227+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d2001bd0 2024-09-22T08:11:25.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.227+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.228+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x7ffaf8014070 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.228+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.228+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ffd020 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.228+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.228+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d2001bd0 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.228+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.228+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x7ffaf8014070 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ff8720 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2004760 con 0x55f6d1ffd020 2024-09-22T08:11:25.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffb00a98800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffb00a98800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffb00a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffb00a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffb00a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffb00a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d20005d0 con 0x55f6d1ff8720 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.229+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d20001e0 con 0x55f6d1ff8720 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2000f80 con 0x55f6d1ff8720 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 20 zone default found 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 4 Realm: () 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 20 zonegroup default 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2000aa0 con 0x7ffaf8014070 2024-09-22T08:11:25.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.230+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2006b00 con 0x55f6d2001bd0 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.231+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.231+0000 7ffb00a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.231+0000 7ffb00a98800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.231+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d20070e0 con 0x55f6d2001bd0 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.231+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.231+0000 7ffb00a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.231+0000 7ffb00a98800 20 started sync module instance, tier type = 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.231+0000 7ffb00a98800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.231+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2005f70 con 0x55f6d1ffd020 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.232+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.232+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94518573554368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2007540 con 0x55f6d1ffd020 2024-09-22T08:11:25.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.232+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2007f00 con 0x55f6d1ff8720 2024-09-22T08:11:25.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.233+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94518573554368] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.234+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.234+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94518573556688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2007f00 con 0x55f6d1ff8720 2024-09-22T08:11:25.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.234+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2008900 con 0x55f6d2001bd0 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.235+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.235+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94518573564944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d20091d0 con 0x55f6d2001bd0 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.235+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2009ce0 con 0x55f6d1ffd020 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.235+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94518573556688] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.236+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.236+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94518573569936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200a0d0 con 0x55f6d1ffd020 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.236+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200ab30 con 0x55f6d1ff8720 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.236+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94518573564944] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.239+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.239+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94518573567264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200aaf0 con 0x55f6d1ff8720 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.239+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200b5b0 con 0x7ffaf8014070 2024-09-22T08:11:25.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.239+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94518573569936] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.240+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94518573567264] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.240+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.240+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94518573562448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200a640 con 0x7ffaf8014070 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.240+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200be50 con 0x7ffaf8014070 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.241+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.241+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94518573578656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200a640 con 0x7ffaf8014070 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.241+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200c990 con 0x7ffaf8014070 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.241+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94518573562448] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.242+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.242+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94518573581408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200c950 con 0x7ffaf8014070 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.242+0000 7ffb00a98800 20 add_watcher() i=0 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.242+0000 7ffb00a98800 20 add_watcher() i=1 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.242+0000 7ffb00a98800 20 add_watcher() i=2 2024-09-22T08:11:25.246 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.242+0000 7ffb00a98800 20 add_watcher() i=3 2024-09-22T08:11:25.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.242+0000 7ffb00a98800 20 add_watcher() i=4 2024-09-22T08:11:25.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.242+0000 7ffb00a98800 20 add_watcher() i=5 2024-09-22T08:11:25.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.242+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94518573578656] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.242+0000 7ffb00a98800 20 add_watcher() i=6 2024-09-22T08:11:25.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.243+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94518573581408] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.243+0000 7ffb00a98800 20 add_watcher() i=7 2024-09-22T08:11:25.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.243+0000 7ffb00a98800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:25.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.243+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200b1f0 con 0x55f6d1ff8720 2024-09-22T08:11:25.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.244+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.244+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94518573579712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200d200 con 0x55f6d1ff8720 2024-09-22T08:11:25.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.245+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94518573579712] v34'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.245+0000 7ff9b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:25.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.245+0000 7ffb00a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:25.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.245+0000 7ffb00a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:25.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.245+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2018430 con 0x55f6d1ff8720 2024-09-22T08:11:25.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.246+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.246+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d20188e0 con 0x7ffaf8014070 2024-09-22T08:11:25.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.247+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.247+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2018ab0 con 0x55f6d2001bd0 2024-09-22T08:11:25.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.248+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.248+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019020 con 0x55f6d1ff8720 2024-09-22T08:11:25.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.249+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'153 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.249+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019020 con 0x55f6d1ffd020 2024-09-22T08:11:25.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.250+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.250+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019020 con 0x55f6d2001bd0 2024-09-22T08:11:25.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.251+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.251+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019300 con 0x55f6d1ff8720 2024-09-22T08:11:25.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.253+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.253+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019300 con 0x7ffaf8014070 2024-09-22T08:11:25.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.254+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.254+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019300 con 0x55f6d1ffd020 2024-09-22T08:11:25.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.255+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.255+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019390 con 0x55f6d2001bd0 2024-09-22T08:11:25.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.256+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.256+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019420 con 0x55f6d1ffd020 2024-09-22T08:11:25.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.257+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.257+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d20194b0 con 0x7ffaf8014070 2024-09-22T08:11:25.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.258+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.258+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d20194b0 con 0x55f6d1ffd020 2024-09-22T08:11:25.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.259+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.259+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d20194f0 con 0x7ffaf8014070 2024-09-22T08:11:25.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.260+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.260+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019520 con 0x55f6d1ff8720 2024-09-22T08:11:25.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.261+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.261+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019560 con 0x55f6d2001bd0 2024-09-22T08:11:25.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.262+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.262+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019be0 con 0x55f6d1ffd020 2024-09-22T08:11:25.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.263+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.263+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d2001bd0 2024-09-22T08:11:25.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.264+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.264+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d1ff8720 2024-09-22T08:11:25.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.265+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.265+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d1ff8720 2024-09-22T08:11:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.266+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.266+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d2001bd0 2024-09-22T08:11:25.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.268+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.268+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d1ffd020 2024-09-22T08:11:25.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.269+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.269+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d2001bd0 2024-09-22T08:11:25.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.270+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.270+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d2001bd0 2024-09-22T08:11:25.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.270+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.271+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d2001bd0 2024-09-22T08:11:25.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.271+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.271+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d2001bd0 2024-09-22T08:11:25.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.272+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.272+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x7ffaf8014070 2024-09-22T08:11:25.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.273+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.273+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d2001bd0 2024-09-22T08:11:25.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.274+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'19 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.274+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x7ffaf8014070 2024-09-22T08:11:25.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.276+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.276+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d2001bd0 2024-09-22T08:11:25.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.277+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'40 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.277+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x7ffaf8014070 2024-09-22T08:11:25.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.278+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.278+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2019a10 con 0x55f6d1ffd020 2024-09-22T08:11:25.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.279+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.279+0000 7ff9af7fe640 20 reqs_thread_entry: start 2024-09-22T08:11:25.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.279+0000 7ffb00a98800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:25.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.279+0000 7ffb00a98800 20 Filter name: none 2024-09-22T08:11:25.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.279+0000 7ff9ad7fa640 20 reqs_thread_entry: start 2024-09-22T08:11:25.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.279+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f90 con 0x55f6d1ff8720 2024-09-22T08:11:25.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.280+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.280+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.280+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.280+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.280+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.280+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.281+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.281+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.281+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.281+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.281+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.281+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.281+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.281+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.282+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.282+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.282+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.282+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.282+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.282+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.283+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.283+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.283+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.283+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.283+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.283+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.283+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.283+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.284+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.284+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.284+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.284+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.284+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.284+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.284+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.284+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.285+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.285+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.285+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.285+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.285+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x55f6d1ff8720 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.285+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.285+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.285+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.286+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.286+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.286+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.286+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.286+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.287+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.287+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.287+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.287+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.287+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.287+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.287+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.287+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.287+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.288+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.288+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.288+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.288+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.288+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.288+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.288+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.288+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.289+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.289+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.289+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf402b040 con 0x7ffaf8014070 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.289+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.289+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.289+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.290+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.290+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.290+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.290+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.290+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.290+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.291+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.291+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.291+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.291+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.291+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.291+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.291+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.291+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.292+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.292+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.292+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.292+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.292+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.292+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.293+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.293+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.293+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.293+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.293+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.293+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.293+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.293+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.294+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.294+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.294+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.294+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.294+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.294+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.294+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.294+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.295+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.295+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.295+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.295+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.295+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.295+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.295+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.295+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.295+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.296+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ff8720 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.296+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.296+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.296+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.296+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.296+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.296+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.296+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.296+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.297+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.297+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.297+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.297+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d1ffd020 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.297+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.297+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.297+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.297+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.298+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.298+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.298+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.298+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.298+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.298+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.298+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.298+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.298+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.298+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.299+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.299+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.299+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.299+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.299+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.299+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.299+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.299+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.300+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.300+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.300+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.300+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.300+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.300+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.300+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.300+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x7ffaf8014070 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.301+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.301+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.301+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.301+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.301+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv18 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.301+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016f50 con 0x55f6d2001bd0 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.301+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 58 ==== osd_op_reply(177 gc.27 [call out=1701b] v0'0 uv18 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.301+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2045aa0 con 0x7ffaf8014070 2024-09-22T08:11:25.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.302+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.302+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2044a90 con 0x7ffaf8014070 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.302+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.302+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2045aa0 con 0x7ffaf8014070 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.303+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.303+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2045aa0 con 0x55f6d2001bd0 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.303+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.303+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2044a90 con 0x55f6d2001bd0 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.303+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.303+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2045aa0 con 0x55f6d2001bd0 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.303+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.303+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2045aa0 con 0x7ffaf8014070 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.304+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.304+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2044a90 con 0x7ffaf8014070 2024-09-22T08:11:25.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.305+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.305+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2045aa0 con 0x7ffaf8014070 2024-09-22T08:11:25.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.305+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.305+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2045aa0 con 0x55f6d1ffd020 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.305+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.305+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2044a90 con 0x55f6d1ffd020 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.305+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.305+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2045aa0 con 0x55f6d1ffd020 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.306+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.307+0000 7ff9b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.307+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94518573579712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2016620 con 0x55f6d1ff8720 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.308+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94518573579712] v34'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.308+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94518573554368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d200bdc0 con 0x55f6d1ffd020 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.309+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94518573554368] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.309+0000 7ffb00a98800 20 remove_watcher() i=0 2024-09-22T08:11:25.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.309+0000 7ffb00a98800 2 removed watcher, disabling cache 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.309+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94518573556688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2005ac0 con 0x55f6d1ff8720 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.310+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94518573556688] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.310+0000 7ffb00a98800 20 remove_watcher() i=1 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.310+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94518573564944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2005ac0 con 0x55f6d2001bd0 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.311+0000 7ffafe582640 1 -- 172.21.15.165:0/1766863128 <== osd.3 v2:172.21.15.165:6800/215521179 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94518573564944] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf0057030 con 0x55f6d2001bd0 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.311+0000 7ffb00a98800 20 remove_watcher() i=2 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.311+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94518573569936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2005ac0 con 0x55f6d1ffd020 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.312+0000 7ffafed83640 1 -- 172.21.15.165:0/1766863128 <== osd.2 v2:172.21.15.165:6808/3197121696 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94518573569936] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf802a070 con 0x55f6d1ffd020 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.312+0000 7ffb00a98800 20 remove_watcher() i=3 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.312+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94518573567264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2005ac0 con 0x55f6d1ff8720 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.313+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.1 v2:172.21.15.165:6816/2347568643 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94518573567264] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf4048040 con 0x55f6d1ff8720 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.314+0000 7ffb00a98800 20 remove_watcher() i=4 2024-09-22T08:11:25.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.314+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94518573562448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2008d20 con 0x7ffaf8014070 2024-09-22T08:11:25.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.314+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94518573562448] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.315+0000 7ffb00a98800 20 remove_watcher() i=5 2024-09-22T08:11:25.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.315+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94518573578656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2007a50 con 0x7ffaf8014070 2024-09-22T08:11:25.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.316+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94518573578656] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.316+0000 7ffb00a98800 20 remove_watcher() i=6 2024-09-22T08:11:25.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.316+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94518573581408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f6d2007a50 con 0x7ffaf8014070 2024-09-22T08:11:25.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.317+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 <== osd.0 v2:172.21.15.53:6800/2902972477 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94518573581408] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffaf4048040 con 0x7ffaf8014070 2024-09-22T08:11:25.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.317+0000 7ffb00a98800 20 remove_watcher() i=7 2024-09-22T08:11:25.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.317+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ffaf8014070 msgr2=0x7ffaf8023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ffaf8014070 0x7ffaf8023420 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ff8720 msgr2=0x55f6d1ffabe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ff8720 0x55f6d1ffabe0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1ffd020 msgr2=0x55f6d1fff410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1ffd020 0x55f6d1fff410 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f6d2001bd0 msgr2=0x55f6d2004090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f6d2001bd0 0x55f6d2004090 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9c803cfb0 msgr2=0x7ff9c803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9c803cfb0 0x7ff9c803f470 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00507d0 tx=0x7ffaf0087000 comp rx=0 tx=0).stop 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 msgr2=0x55f6d1feccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1766863128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fe5680 0x55f6d1feccb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8016fd0 tx=0x7ffaf8054670 comp rx=0 tx=0).stop 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 reap_dead start 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffafdd81640 1 -- 172.21.15.165:0/1766863128 reap_dead start 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 shutdown_connections 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 >> 172.21.15.165:0/1766863128 conn(0x55f6d1fe1aa0 msgr2=0x55f6d1fdfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 shutdown_connections 2024-09-22T08:11:25.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/1766863128 wait complete. 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/4160740272 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9d803d000 msgr2=0x7ff9d803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 --2- 172.21.15.165:0/4160740272 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9d803d000 0x7ff9d803f4c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55f6d1fbfcd0 tx=0x7ffaf0096470 comp rx=0 tx=0).stop 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/4160740272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fd8c40 msgr2=0x55f6d1fd9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 --2- 172.21.15.165:0/4160740272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fd8c40 0x55f6d1fd9060 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55f6d1fbebd0 tx=0x7ffaf8018830 comp rx=0 tx=0).stop 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/4160740272 shutdown_connections 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 --2- 172.21.15.165:0/4160740272 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9d803d000 0x7ff9d803f4c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 --2- 172.21.15.165:0/4160740272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1fd8c40 0x55f6d1fd9060 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/4160740272 >> 172.21.15.165:0/4160740272 conn(0x55f6d1fccff0 msgr2=0x55f6d1fcd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/4160740272 shutdown_connections 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.318+0000 7ffb00a98800 1 -- 172.21.15.165:0/4160740272 wait complete. 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ec4a20 msgr2=0x55f6d1fc5220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ec4a20 0x55f6d1fc5220 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1fc7600 msgr2=0x55f6d1fc9aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1fc7600 0x55f6d1fc9aa0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9e403cfb0 msgr2=0x7ff9e403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9e403cfb0 0x7ff9e403f470 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4001e30 tx=0x7ffaf4001390 comp rx=0 tx=0).stop 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 msgr2=0x55f6d1fbdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fbdbd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00460d0 tx=0x7ffaf0002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 shutdown_connections 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f6d1fc7600 0x55f6d1fc9aa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f6d1ec4a20 0x55f6d1fc5220 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff9e403cfb0 0x7ff9e403f470 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 --2- 172.21.15.165:0/1524004945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f6d1ec37e0 0x55f6d1fbdbd0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 >> 172.21.15.165:0/1524004945 conn(0x55f6d1ebebb0 msgr2=0x55f6d1fb4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 shutdown_connections 2024-09-22T08:11:25.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.319+0000 7ffb00a98800 1 -- 172.21.15.165:0/1524004945 wait complete. 2024-09-22T08:11:25.328 INFO:teuthology.orchestra.run.smithi165.stdout:[{"tag":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9141746882524154286\u0000","time":"2024-09-22T08:11:25.121298+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_7","key":"","instance":""}]}] 2024-09-22T08:11:25.328 DEBUG:tasks.util.rgw: json result: [{'tag': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9141746882524154286\x00', 'time': '2024-09-22T08:11:25.121298+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_7', 'key': '', 'instance': ''}]}] 2024-09-22T08:11:25.328 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-22T08:11:25.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-22T08:11:25.329 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-22T08:11:25.371 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:25.371 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:25.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.371+0000 7feabf087800 1 Processor -- start 2024-09-22T08:11:25.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.371+0000 7feabf087800 1 -- start start 2024-09-22T08:11:25.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.371+0000 7feabf087800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5618035a99d0 0x5618035aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.371+0000 7feabf087800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561803434a20 con 0x5618035aaad0 2024-09-22T08:11:25.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.371+0000 7feabf087800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5618034347d0 con 0x5618035a99d0 2024-09-22T08:11:25.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.372+0000 7feabcb71640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5618035a99d0 0x5618035aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.372+0000 7feab7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5618035aaad0 0x5618035af620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:36084/0 (socket says 172.21.15.165:36084) 2024-09-22T08:11:25.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.372+0000 7feabcb71640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5618035a99d0 0x5618035aa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57866/0 (socket says 172.21.15.165:57866) 2024-09-22T08:11:25.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.372+0000 7feab7fff640 1 -- 172.21.15.165:0/1849534231 learned_addr learned my addr 172.21.15.165:0/1849534231 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:25.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.372+0000 7feabcb71640 1 -- 172.21.15.165:0/1849534231 >> v1:172.21.15.53:6789/0 conn(0x5618035aaad0 legacy=0x5618035af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.372+0000 7feabcb71640 1 -- 172.21.15.165:0/1849534231 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618035aa0d0 con 0x5618035a99d0 2024-09-22T08:11:25.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feabcb71640 1 --2- 172.21.15.165:0/1849534231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x5618035aa590 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7feab000a470 tx=0x7feab0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16000a00e121bf82 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feab77fe640 1 -- 172.21.15.165:0/1849534231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0053570 con 0x5618035a99d0 2024-09-22T08:11:25.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feab77fe640 1 -- 172.21.15.165:0/1849534231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab0058070 con 0x5618035a99d0 2024-09-22T08:11:25.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feab77fe640 1 -- 172.21.15.165:0/1849534231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0053880 con 0x5618035a99d0 2024-09-22T08:11:25.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feabf087800 1 -- 172.21.15.165:0/1849534231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 msgr2=0x5618035aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feabf087800 1 --2- 172.21.15.165:0/1849534231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x5618035aa590 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7feab000a470 tx=0x7feab0045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:25.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feabf087800 1 -- 172.21.15.165:0/1849534231 shutdown_connections 2024-09-22T08:11:25.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feabf087800 1 --2- 172.21.15.165:0/1849534231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x5618035aa590 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feabf087800 1 -- 172.21.15.165:0/1849534231 >> 172.21.15.165:0/1849534231 conn(0x5618035a4da0 msgr2=0x5618035a7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feabf087800 1 -- 172.21.15.165:0/1849534231 shutdown_connections 2024-09-22T08:11:25.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.374+0000 7feabf087800 1 -- 172.21.15.165:0/1849534231 wait complete. 2024-09-22T08:11:25.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.388+0000 7feabf087800 1 Processor -- start 2024-09-22T08:11:25.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.388+0000 7feabf087800 1 -- start start 2024-09-22T08:11:25.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.388+0000 7feabf087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x561803698f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.388+0000 7feabf087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561803441dd0 con 0x5618035a99d0 2024-09-22T08:11:25.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.389+0000 7feabcb71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x561803698f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.389+0000 7feabcb71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x561803698f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57878/0 (socket says 172.21.15.165:57878) 2024-09-22T08:11:25.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.389+0000 7feabcb71640 1 -- 172.21.15.165:0/2081866836 learned_addr learned my addr 172.21.15.165:0/2081866836 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.389+0000 7feabcb71640 1 -- 172.21.15.165:0/2081866836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561803699580 con 0x5618035a99d0 2024-09-22T08:11:25.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.389+0000 7feabcb71640 1 --2- 172.21.15.165:0/2081866836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x561803698f90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7feab0025c20 tx=0x7feab0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636747f415ae56bd server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.389+0000 7fe9aae05640 1 -- 172.21.15.165:0/2081866836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0053570 con 0x5618035a99d0 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.389+0000 7fe9aae05640 1 -- 172.21.15.165:0/2081866836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab0063070 con 0x5618035a99d0 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.389+0000 7fe9aae05640 1 -- 172.21.15.165:0/2081866836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0053840 con 0x5618035a99d0 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.390+0000 7feabf087800 1 -- 172.21.15.165:0/2081866836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 msgr2=0x561803698f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.390+0000 7feabf087800 1 --2- 172.21.15.165:0/2081866836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x561803698f90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7feab0025c20 tx=0x7feab0051000 comp rx=0 tx=0).stop 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.390+0000 7feabf087800 1 -- 172.21.15.165:0/2081866836 shutdown_connections 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.390+0000 7feabf087800 1 --2- 172.21.15.165:0/2081866836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x561803698f90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.390+0000 7feabf087800 1 -- 172.21.15.165:0/2081866836 >> 172.21.15.165:0/2081866836 conn(0x5618035a4da0 msgr2=0x561803694910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.390+0000 7feabf087800 1 -- 172.21.15.165:0/2081866836 shutdown_connections 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.390+0000 7feabf087800 1 -- 172.21.15.165:0/2081866836 wait complete. 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.390+0000 7feabf087800 1 Processor -- start 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.391+0000 7feabf087800 1 -- start start 2024-09-22T08:11:25.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.391+0000 7feabf087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x56180351f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.391+0000 7feabf087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618035ab340 con 0x5618035a99d0 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.391+0000 7feabcb71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x56180351f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.391+0000 7feabcb71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x56180351f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57882/0 (socket says 172.21.15.165:57882) 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.391+0000 7feabcb71640 1 -- 172.21.15.165:0/595780377 learned_addr learned my addr 172.21.15.165:0/595780377 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.391+0000 7feabcb71640 1 -- 172.21.15.165:0/595780377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56180351f7b0 con 0x5618035a99d0 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.391+0000 7feabcb71640 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x56180351f250 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7feab0053d60 tx=0x7feab0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.392+0000 7fe9a9602640 1 -- 172.21.15.165:0/595780377 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0068470 con 0x5618035a99d0 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.392+0000 7fe9a9602640 1 -- 172.21.15.165:0/595780377 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab0068610 con 0x5618035a99d0 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.392+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56180351db60 con 0x5618035a99d0 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.392+0000 7fe9a9602640 1 -- 172.21.15.165:0/595780377 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab00688f0 con 0x5618035a99d0 2024-09-22T08:11:25.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.392+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56180351e120 con 0x5618035a99d0 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.392+0000 7fe9a9602640 1 -- 172.21.15.165:0/595780377 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feab0068a90 con 0x5618035a99d0 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.393+0000 7fe9a9602640 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe9a403cfb0 0x7fe9a403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.393+0000 7fe9a9602640 1 -- 172.21.15.165:0/595780377 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feab0098a40 con 0x5618035a99d0 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.393+0000 7feab7fff640 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe9a403cfb0 0x7fe9a403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.393+0000 7feabf087800 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618035aaad0 0x5618036a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.393+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036aa3a0 con 0x5618035aaad0 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.393+0000 7feabd372640 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618035aaad0 0x5618036a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.393+0000 7feab7fff640 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe9a403cfb0 0x7fe9a403f470 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feaa8001d70 tx=0x7feaa80012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.393+0000 7feabd372640 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618035aaad0 0x5618036a9e60 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.394+0000 7feabd372640 1 -- 172.21.15.165:0/595780377 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feab800a4d0 con 0x5618035aaad0 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.394+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180351e610 con 0x5618035aaad0 2024-09-22T08:11:25.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.394+0000 7feabd372640 1 -- 172.21.15.165:0/595780377 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feab800a4d0 con 0x5618035aaad0 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.394+0000 7feabf087800 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036ac660 0x5618036aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.394+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036af120 con 0x5618036ac660 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.394+0000 7feabcb71640 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036ac660 0x5618036aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.394+0000 7feabcb71640 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036ac660 0x5618036aea50 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.395+0000 7feabcb71640 1 -- 172.21.15.165:0/595780377 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feab0079020 con 0x5618036ac660 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.395+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036ab470 con 0x5618035aaad0 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.395+0000 7feabd372640 1 -- 172.21.15.165:0/595780377 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feab800a4d0 con 0x5618035aaad0 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.395+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036ab890 con 0x5618035aaad0 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.395+0000 7feabd372640 1 -- 172.21.15.165:0/595780377 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feab800a4d0 con 0x5618035aaad0 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.395+0000 7feabf087800 1 Processor -- start 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.395+0000 7feabf087800 1 -- start start 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.396+0000 7feabf087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036bd990 0x5618036bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.396+0000 7feabf087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618034a0d50 con 0x5618036bd990 2024-09-22T08:11:25.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.396+0000 7feabd372640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036bd990 0x5618036bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.396+0000 7feabd372640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036bd990 0x5618036bddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57896/0 (socket says 172.21.15.165:57896) 2024-09-22T08:11:25.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.396+0000 7feabd372640 1 -- 172.21.15.165:0/2452617150 learned_addr learned my addr 172.21.15.165:0/2452617150 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.396+0000 7feabd372640 1 -- 172.21.15.165:0/2452617150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618036be3f0 con 0x5618036bd990 2024-09-22T08:11:25.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.396+0000 7feabd372640 1 --2- 172.21.15.165:0/2452617150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036bd990 0x5618036bddb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x56180351eb60 tx=0x7feab8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.397+0000 7fe9a27fc640 1 -- 172.21.15.165:0/2452617150 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab80180d0 con 0x5618036bd990 2024-09-22T08:11:25.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.397+0000 7fe9a27fc640 1 -- 172.21.15.165:0/2452617150 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab8018270 con 0x5618036bd990 2024-09-22T08:11:25.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.397+0000 7fe9a27fc640 1 -- 172.21.15.165:0/2452617150 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab8014450 con 0x5618036bd990 2024-09-22T08:11:25.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.397+0000 7feabf087800 1 -- 172.21.15.165:0/2452617150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618036bec20 con 0x5618036bd990 2024-09-22T08:11:25.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.397+0000 7feabf087800 1 -- 172.21.15.165:0/2452617150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618036bf1c0 con 0x5618036bd990 2024-09-22T08:11:25.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.397+0000 7fe9a27fc640 1 -- 172.21.15.165:0/2452617150 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feab8011040 con 0x5618036bd990 2024-09-22T08:11:25.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7fe9a27fc640 1 --2- 172.21.15.165:0/2452617150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe99403d000 0x7fe99403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7fe9a27fc640 1 -- 172.21.15.165:0/2452617150 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feab801e070 con 0x5618036bd990 2024-09-22T08:11:25.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7feabcb71640 1 --2- 172.21.15.165:0/2452617150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe99403d000 0x7fe99403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7feabf087800 1 Processor -- start 2024-09-22T08:11:25.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7feabcb71640 1 --2- 172.21.15.165:0/2452617150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe99403d000 0x7fe99403f4c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x5618036aa7b0 tx=0x7feab0096d20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7feabf087800 1 -- start start 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7feabf087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036ca810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7feabf087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561803699950 con 0x5618036ca410 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7feabd372640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7feabd372640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57898/0 (socket says 172.21.15.165:57898) 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.398+0000 7feabd372640 1 -- 172.21.15.165:0/3248572197 learned_addr learned my addr 172.21.15.165:0/3248572197 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.399+0000 7feabd372640 1 -- 172.21.15.165:0/3248572197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618036cae00 con 0x5618036ca410 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.399+0000 7feabd372640 1 --2- 172.21.15.165:0/3248572197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036ca810 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7feab8054340 tx=0x7feab8054610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e39799805d84b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.399+0000 7fe993fff640 1 -- 172.21.15.165:0/3248572197 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab802ba60 con 0x5618036ca410 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.399+0000 7fe993fff640 1 -- 172.21.15.165:0/3248572197 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab804b070 con 0x5618036ca410 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.399+0000 7fe993fff640 1 -- 172.21.15.165:0/3248572197 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab802bd30 con 0x5618036ca410 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.399+0000 7feabf087800 1 -- 172.21.15.165:0/3248572197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 msgr2=0x5618036ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.399+0000 7feabf087800 1 --2- 172.21.15.165:0/3248572197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036ca810 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7feab8054340 tx=0x7feab8054610 comp rx=0 tx=0).stop 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.399+0000 7feabf087800 1 -- 172.21.15.165:0/3248572197 shutdown_connections 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.399+0000 7feabf087800 1 --2- 172.21.15.165:0/3248572197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036ca810 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.399+0000 7feabf087800 1 -- 172.21.15.165:0/3248572197 >> 172.21.15.165:0/3248572197 conn(0x5618036c6810 msgr2=0x5618036c4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.400+0000 7feabf087800 1 -- 172.21.15.165:0/3248572197 shutdown_connections 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.400+0000 7feabf087800 1 -- 172.21.15.165:0/3248572197 wait complete. 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.400+0000 7feabf087800 1 Processor -- start 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.400+0000 7feabf087800 1 -- start start 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.400+0000 7feabf087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036d1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.400+0000 7feabf087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5618036cb420 con 0x5618036ca410 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.400+0000 7feabd372640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.400+0000 7feabd372640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57914/0 (socket says 172.21.15.165:57914) 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.400+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 learned_addr learned my addr 172.21.15.165:0/2692798726 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.401+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618036d1ef0 con 0x5618036ca410 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.401+0000 7feabd372640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036d1990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7feab80117d0 tx=0x7feab80542d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.401+0000 7fe9927fc640 1 -- 172.21.15.165:0/2692798726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab803b070 con 0x5618036ca410 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.401+0000 7fe9927fc640 1 -- 172.21.15.165:0/2692798726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab80145f0 con 0x5618036ca410 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.401+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618036d2180 con 0x5618036ca410 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.401+0000 7fe9927fc640 1 -- 172.21.15.165:0/2692798726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab80148d0 con 0x5618036ca410 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.401+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618036d2d10 con 0x5618036ca410 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.402+0000 7fe9927fc640 1 -- 172.21.15.165:0/2692798726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feab803e070 con 0x5618036ca410 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.402+0000 7fe9927fc640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe98803d050 0x7fe98803f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.402+0000 7fe9927fc640 1 -- 172.21.15.165:0/2692798726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feab8033070 con 0x5618036ca410 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.402+0000 7feabcb71640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe98803d050 0x7fe98803f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.403+0000 7feabcb71640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe98803d050 0x7fe98803f510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feab0052fd0 tx=0x7feab008a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.403+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.403+0000 7feabf087800 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618036dd430 0x5618036df8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.403+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036e0040 con 0x5618036dd430 2024-09-22T08:11:25.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.403+0000 7feab7fff640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618036dd430 0x5618036df8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.403+0000 7feab7fff640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618036dd430 0x5618036df8f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feaa8009050 con 0x5618036dd430 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 20 realm 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036dc780 con 0x5618036dd430 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feaa8009050 con 0x5618036dd430 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036e0b30 con 0x5618036dd430 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feaa8009050 con 0x5618036dd430 2024-09-22T08:11:25.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036e1400 con 0x5618036dd430 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feaa8009050 con 0x5618036dd430 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036e1e20 0x5618036e4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036e4950 con 0x5618036e1e20 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.404+0000 7feabd372640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036e1e20 0x5618036e4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.405+0000 7feabd372640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036e1e20 0x5618036e4210 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.405+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.405+0000 7feabf087800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.405+0000 7feabf087800 20 searching for the correct realm 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.405+0000 7feabf087800 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5618036e6900 0x5618036e8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.405+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e6900 2024-09-22T08:11:25.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.405+0000 7feabcb71640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5618036e6900 0x5618036e8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.405+0000 7feabcb71640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5618036e6900 0x5618036e8dc0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.406+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.406+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e1e20 2024-09-22T08:11:25.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.406+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.406+0000 7feabd372640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7feab805d3f0 0x7feab802d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.406+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x7feab805d3f0 2024-09-22T08:11:25.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.406+0000 7feab7fff640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7feab805d3f0 0x7feab802d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.406+0000 7feab7fff640 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7feab805d3f0 0x7feab802d900 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.407+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8009050 con 0x7feab805d3f0 2024-09-22T08:11:25.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.407+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036dd430 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.407+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8009050 con 0x5618036dd430 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.407+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036dd430 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.407+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.407+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x7feab805d3f0 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.408+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.408+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e1e20 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.408+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.408+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e1e20 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.408+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.408+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e6900 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.408+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.408+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036dd430 2024-09-22T08:11:25.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.408+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.408+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x7feab805d3f0 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.409+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.409+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036dd430 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.409+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.409+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e1e20 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.409+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.409+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e6900 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.409+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.409+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e6900 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.410+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.410+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x7feab805d3f0 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.410+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.410+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e6900 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.410+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.410+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e6900 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.410+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.410+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036dd430 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.411+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.411+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036dd430 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.411+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.411+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x7feab805d3f0 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.411+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.411+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e6900 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.411+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.412+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e1e20 2024-09-22T08:11:25.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.412+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.412+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036dd430 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.412+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.412+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x7feab805d3f0 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.412+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.412+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e6900 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.413+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.413+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x7feab805d3f0 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.413+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.413+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e1e20 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.413+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.413+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e6900 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.413+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.413+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x7feab805d3f0 2024-09-22T08:11:25.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036dd430 2024-09-22T08:11:25.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9440 con 0x5618036e1e20 2024-09-22T08:11:25.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:25.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:25.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:25.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:25.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:25.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036e5310 con 0x5618036dd430 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.414+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036e4f50 con 0x5618036dd430 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036e5d30 con 0x5618036dd430 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:25.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 20 zone default found 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 4 Realm: () 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 20 zonegroup default 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036e9d70 con 0x7feab805d3f0 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036eba40 con 0x5618036e6900 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.415+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036ebed0 con 0x5618036e6900 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.416+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.416+0000 7feabf087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.416+0000 7feabf087800 20 started sync module instance, tier type = 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.416+0000 7feabf087800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.416+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ea810 con 0x5618036e1e20 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.417+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.417+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94661136788480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ec7e0 con 0x5618036e1e20 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.417+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ed030 con 0x5618036dd430 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.418+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94661136788480] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.418+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.418+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94661136794416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ecd20 con 0x5618036dd430 2024-09-22T08:11:25.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.418+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ed840 con 0x5618036e6900 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.419+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.419+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94661136798480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ee0e0 con 0x5618036e6900 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.419+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036eebb0 con 0x5618036e1e20 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.419+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94661136794416] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.420+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94661136798480] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.420+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.420+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94661136803488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036edc30 con 0x5618036e1e20 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.420+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ef450 con 0x5618036dd430 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.421+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94661136803488] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.421+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.421+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94661136795536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036edc30 con 0x5618036dd430 2024-09-22T08:11:25.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.421+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036efb20 con 0x7feab805d3f0 2024-09-22T08:11:25.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.422+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94661136795536] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.422+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.422+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94661136807408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036efae0 con 0x7feab805d3f0 2024-09-22T08:11:25.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.422+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036efae0 con 0x7feab805d3f0 2024-09-22T08:11:25.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.423+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94661136807408] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.423+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.423+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94661136805792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036f0530 con 0x7feab805d3f0 2024-09-22T08:11:25.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.424+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036f0ef0 con 0x7feab805d3f0 2024-09-22T08:11:25.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.424+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.425+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94661136812608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036f1310 con 0x7feab805d3f0 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.425+0000 7feabf087800 20 add_watcher() i=0 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.425+0000 7feabf087800 20 add_watcher() i=1 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.425+0000 7feabf087800 20 add_watcher() i=2 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.425+0000 7feabf087800 20 add_watcher() i=3 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.425+0000 7feabf087800 20 add_watcher() i=4 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.425+0000 7feabf087800 20 add_watcher() i=5 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.425+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94661136805792] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.425+0000 7feabf087800 20 add_watcher() i=6 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.426+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94661136812608] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.426+0000 7feabf087800 20 add_watcher() i=7 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.426+0000 7feabf087800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.426+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5618036f1310 con 0x5618036dd430 2024-09-22T08:11:25.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.426+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.426+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94661136813664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036f1cd0 con 0x5618036dd430 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.427+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94661136813664] v34'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.427+0000 7fe972fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.427+0000 7feabf087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.427+0000 7feabf087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.427+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036f4230 con 0x5618036dd430 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.428+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.428+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fd660 con 0x7feab805d3f0 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.429+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.430+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fd660 con 0x5618036e6900 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.430+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.430+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fdf80 con 0x5618036dd430 2024-09-22T08:11:25.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.431+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'158 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.431+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe4f0 con 0x5618036e1e20 2024-09-22T08:11:25.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.432+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.432+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe4f0 con 0x5618036e6900 2024-09-22T08:11:25.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.433+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.434+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe580 con 0x5618036dd430 2024-09-22T08:11:25.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.435+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.435+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe5c0 con 0x7feab805d3f0 2024-09-22T08:11:25.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.436+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.436+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe5c0 con 0x5618036e1e20 2024-09-22T08:11:25.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.437+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.437+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe790 con 0x5618036e6900 2024-09-22T08:11:25.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.438+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.438+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe790 con 0x5618036e1e20 2024-09-22T08:11:25.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.439+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.439+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe8a0 con 0x7feab805d3f0 2024-09-22T08:11:25.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.440+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.440+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe8a0 con 0x5618036e1e20 2024-09-22T08:11:25.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.441+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.441+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe8a0 con 0x7feab805d3f0 2024-09-22T08:11:25.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.442+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.442+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe8e0 con 0x5618036dd430 2024-09-22T08:11:25.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.443+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.443+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe8c0 con 0x5618036e6900 2024-09-22T08:11:25.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.444+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.444+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe950 con 0x5618036e1e20 2024-09-22T08:11:25.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.445+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.445+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe950 con 0x5618036e6900 2024-09-22T08:11:25.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.446+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.446+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe9b0 con 0x5618036dd430 2024-09-22T08:11:25.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.447+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.447+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe9b0 con 0x5618036dd430 2024-09-22T08:11:25.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.448+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.448+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe9b0 con 0x5618036e6900 2024-09-22T08:11:25.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.450+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.450+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fe9f0 con 0x5618036e1e20 2024-09-22T08:11:25.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.451+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.451+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fea30 con 0x5618036e6900 2024-09-22T08:11:25.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.452+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.452+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036fea70 con 0x5618036e6900 2024-09-22T08:11:25.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.453+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.453+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036feab0 con 0x5618036e6900 2024-09-22T08:11:25.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.454+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.454+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036feab0 con 0x5618036e6900 2024-09-22T08:11:25.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.455+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.455+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036feaf0 con 0x7feab805d3f0 2024-09-22T08:11:25.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.456+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.456+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036feb30 con 0x5618036e6900 2024-09-22T08:11:25.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.457+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'20 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.457+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036feb30 con 0x7feab805d3f0 2024-09-22T08:11:25.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.458+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.458+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036feb30 con 0x5618036e6900 2024-09-22T08:11:25.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.459+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.459+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036feb30 con 0x7feab805d3f0 2024-09-22T08:11:25.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.460+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.460+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036feb70 con 0x5618036e1e20 2024-09-22T08:11:25.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.461+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.461+0000 7fe971fe3640 20 reqs_thread_entry: start 2024-09-22T08:11:25.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.461+0000 7feabf087800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:25.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.461+0000 7feabf087800 20 Filter name: none 2024-09-22T08:11:25.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.461+0000 7fe8e37fe640 20 reqs_thread_entry: start 2024-09-22T08:11:25.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.461+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-22T08:11:25.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.461+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:94 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.463+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(94 gc.29 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.463+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:95 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.463+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(95 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.463+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.463+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:96 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.463+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(96 gc.29 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.463+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:97 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.463+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== osd_op_reply(97 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.463+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.463+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:98 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.464+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(98 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.464+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.464+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:99 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.465+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 31 ==== osd_op_reply(99 gc.29 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.465+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-22T08:11:25.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.465+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:100 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.466+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(100 gc.30 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.466+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.466+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(101 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.466+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.466+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x7feab805d3f0 2024-09-22T08:11:25.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.467+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(102 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.467+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:103 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.467+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(103 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.467+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.467+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:104 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.467+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(104 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.467+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.467+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:105 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.469+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(105 gc.30 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.469+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-22T08:11:25.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.469+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:106 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.470+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(106 gc.31 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.470+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:107 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.470+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(107 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.470+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.470+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:108 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e1e20 2024-09-22T08:11:25.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.470+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(108 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.471+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:109 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.471+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== osd_op_reply(109 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.471+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.471+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:110 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.471+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 24 ==== osd_op_reply(110 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.471+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.471+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:111 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.472+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 25 ==== osd_op_reply(111 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.472+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-22T08:11:25.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.472+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:112 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.473+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(112 gc.0 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.473+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:113 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.473+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(113 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.473+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.473+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:114 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036dd430 2024-09-22T08:11:25.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.474+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(114 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.474+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:115 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.474+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(115 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.474+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.474+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:116 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.474+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(116 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.474+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.474+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:117 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.475+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(117 gc.0 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.475+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-22T08:11:25.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.475+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:118 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.476+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(118 gc.1 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.476+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:119 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.477+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(119 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.477+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.477+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:120 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x7feab805d3f0 2024-09-22T08:11:25.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.477+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(120 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.477+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:121 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.477+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(121 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.477+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.477+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:122 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.478+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== osd_op_reply(122 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.478+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.478+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:123 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.479+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(123 gc.1 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.479+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-22T08:11:25.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.479+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:124 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.480+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 32 ==== osd_op_reply(124 gc.2 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.480+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:125 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.480+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 33 ==== osd_op_reply(125 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.480+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.480+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:126 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.481+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 34 ==== osd_op_reply(126 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.481+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:127 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.481+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 35 ==== osd_op_reply(127 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.481+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.481+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:128 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.481+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 36 ==== osd_op_reply(128 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.481+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.481+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:129 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.482+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 37 ==== osd_op_reply(129 gc.2 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.482+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-22T08:11:25.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.482+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:130 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.483+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(130 gc.3 [call] v34'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.483+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:131 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.483+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 35 ==== osd_op_reply(131 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.483+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.483+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:132 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036dd430 2024-09-22T08:11:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.484+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 36 ==== osd_op_reply(132 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.484+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:133 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.484+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 37 ==== osd_op_reply(133 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.484+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.484+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:134 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.484+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 38 ==== osd_op_reply(134 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.484+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.484+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:135 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.485+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 39 ==== osd_op_reply(135 gc.3 [call] v34'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.485+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.485+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:136 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.486+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 26 ==== osd_op_reply(136 gc.4 [call] v34'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.486+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:137 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.486+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 27 ==== osd_op_reply(137 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.486+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.486+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:138 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e1e20 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.486+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 28 ==== osd_op_reply(138 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.486+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:139 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.487+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 29 ==== osd_op_reply(139 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.487+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.487+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:140 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.487+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 30 ==== osd_op_reply(140 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.487+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.487+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:141 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.488+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 31 ==== osd_op_reply(141 gc.4 [call] v34'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.488+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-22T08:11:25.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.488+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:142 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.489+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 38 ==== osd_op_reply(142 gc.5 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.489+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:143 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.489+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 39 ==== osd_op_reply(143 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.489+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.489+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:144 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.489+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 40 ==== osd_op_reply(144 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.489+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:145 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.489+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 41 ==== osd_op_reply(145 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.489+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.489+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:146 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.490+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 42 ==== osd_op_reply(146 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.490+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.490+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:147 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.491+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 43 ==== osd_op_reply(147 gc.5 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.491+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-22T08:11:25.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.491+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:148 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.492+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 40 ==== osd_op_reply(148 gc.6 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.492+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:149 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.492+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 41 ==== osd_op_reply(149 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.492+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.492+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:150 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036dd430 2024-09-22T08:11:25.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.492+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 42 ==== osd_op_reply(150 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.492+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:151 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.492+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 43 ==== osd_op_reply(151 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.492+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.492+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:152 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.493+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 44 ==== osd_op_reply(152 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.493+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.493+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:153 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.493+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 45 ==== osd_op_reply(153 gc.6 [call] v34'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.493+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-22T08:11:25.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.494+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:154 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.494+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 35 ==== osd_op_reply(154 gc.7 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.495+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:155 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.495+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 36 ==== osd_op_reply(155 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.495+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.495+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:156 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x7feab805d3f0 2024-09-22T08:11:25.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.495+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 37 ==== osd_op_reply(156 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.495+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:157 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.495+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 38 ==== osd_op_reply(157 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.495+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.496+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:158 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.496+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 39 ==== osd_op_reply(158 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.496+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.496+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:159 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.497+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 40 ==== osd_op_reply(159 gc.7 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.497+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-22T08:11:25.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.497+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:160 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.498+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 32 ==== osd_op_reply(160 gc.8 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.498+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:161 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.498+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 33 ==== osd_op_reply(161 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.498+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.498+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:162 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e1e20 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.498+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 34 ==== osd_op_reply(162 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.498+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:163 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.499+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 35 ==== osd_op_reply(163 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.499+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.499+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:164 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.499+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 36 ==== osd_op_reply(164 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.499+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.499+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:165 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.500+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 37 ==== osd_op_reply(165 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.500+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-22T08:11:25.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.500+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:166 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.501+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 44 ==== osd_op_reply(166 gc.9 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.501+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:167 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.501+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 45 ==== osd_op_reply(167 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.501+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.501+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:168 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.501+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 46 ==== osd_op_reply(168 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.501+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:169 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.502+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 47 ==== osd_op_reply(169 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.502+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.502+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:170 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.502+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 48 ==== osd_op_reply(170 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.502+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.502+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:171 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.503+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 49 ==== osd_op_reply(171 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.503+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.503+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:172 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.504+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 38 ==== osd_op_reply(172 gc.10 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.504+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:173 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.504+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 39 ==== osd_op_reply(173 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.504+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.504+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:174 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e1e20 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.504+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 40 ==== osd_op_reply(174 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.504+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:175 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.504+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 41 ==== osd_op_reply(175 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.504+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.504+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:176 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.505+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 42 ==== osd_op_reply(176 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.505+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.505+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:177 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.505+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 43 ==== osd_op_reply(177 gc.10 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.505+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-22T08:11:25.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.505+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:178 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.507+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 41 ==== osd_op_reply(178 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.507+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:179 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.507+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 42 ==== osd_op_reply(179 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.507+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.507+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:180 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x7feab805d3f0 2024-09-22T08:11:25.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.507+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 43 ==== osd_op_reply(180 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.507+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:181 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.508+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 44 ==== osd_op_reply(181 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.508+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.508+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:182 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.508+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 45 ==== osd_op_reply(182 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.508+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.508+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:183 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.509+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 46 ==== osd_op_reply(183 gc.11 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.509+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-22T08:11:25.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.509+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:184 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.510+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 44 ==== osd_op_reply(184 gc.12 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.510+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:185 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.510+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 45 ==== osd_op_reply(185 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.510+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.510+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:186 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e1e20 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.510+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 46 ==== osd_op_reply(186 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.510+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:187 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.511+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 47 ==== osd_op_reply(187 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.511+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.511+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:188 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.511+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 48 ==== osd_op_reply(188 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.511+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.511+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:189 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.512+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 49 ==== osd_op_reply(189 gc.12 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.512+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-22T08:11:25.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.512+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:190 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.513+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 47 ==== osd_op_reply(190 gc.13 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.513+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:191 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.514+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 48 ==== osd_op_reply(191 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.514+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.514+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:192 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x7feab805d3f0 2024-09-22T08:11:25.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.514+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 49 ==== osd_op_reply(192 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.514+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:193 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.514+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 50 ==== osd_op_reply(193 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.514+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.514+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:194 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.515+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 51 ==== osd_op_reply(194 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.515+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.515+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:195 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.516+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 52 ==== osd_op_reply(195 gc.13 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.516+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-22T08:11:25.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.516+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:196 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.517+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 46 ==== osd_op_reply(196 gc.14 [call] v34'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.517+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:197 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 47 ==== osd_op_reply(197 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:198 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036dd430 2024-09-22T08:11:25.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 48 ==== osd_op_reply(198 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:199 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 49 ==== osd_op_reply(199 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:200 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 50 ==== osd_op_reply(200 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.518+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:201 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.519+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 51 ==== osd_op_reply(201 gc.14 [call] v34'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.519+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-22T08:11:25.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.519+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:202 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.520+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 50 ==== osd_op_reply(202 gc.15 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.520+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:203 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.520+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 51 ==== osd_op_reply(203 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.520+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.520+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:204 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.521+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 52 ==== osd_op_reply(204 gc.15 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.521+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:205 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.521+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 53 ==== osd_op_reply(205 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.521+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.521+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:206 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.521+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 54 ==== osd_op_reply(206 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.521+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.521+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:207 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.522+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 55 ==== osd_op_reply(207 gc.15 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.522+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-22T08:11:25.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.522+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:208 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.523+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 50 ==== osd_op_reply(208 gc.16 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.523+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:209 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 51 ==== osd_op_reply(209 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:210 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e1e20 2024-09-22T08:11:25.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 52 ==== osd_op_reply(210 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:211 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 53 ==== osd_op_reply(211 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:212 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 54 ==== osd_op_reply(212 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.524+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:213 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.525+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 55 ==== osd_op_reply(213 gc.16 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.525+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-22T08:11:25.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.525+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:214 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.526+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 56 ==== osd_op_reply(214 gc.17 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.526+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:215 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.526+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 57 ==== osd_op_reply(215 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.526+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.526+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:216 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.527+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 58 ==== osd_op_reply(216 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.527+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:217 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.527+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 59 ==== osd_op_reply(217 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.527+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.527+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:218 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.527+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 60 ==== osd_op_reply(218 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.527+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.527+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:219 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.528+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 61 ==== osd_op_reply(219 gc.17 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.528+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-22T08:11:25.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.528+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:220 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.529+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 52 ==== osd_op_reply(220 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.529+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:221 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.529+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 53 ==== osd_op_reply(221 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.529+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.529+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:222 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036dd430 2024-09-22T08:11:25.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.530+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 54 ==== osd_op_reply(222 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.530+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:223 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.530+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 55 ==== osd_op_reply(223 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.530+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.530+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:224 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.530+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 56 ==== osd_op_reply(224 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.530+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.530+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:225 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.531+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 57 ==== osd_op_reply(225 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.531+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.531+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:226 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.532+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 58 ==== osd_op_reply(226 gc.19 [call] v34'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.532+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:227 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.532+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 59 ==== osd_op_reply(227 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.532+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.532+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:228 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036dd430 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.532+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 60 ==== osd_op_reply(228 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.532+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:229 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.532+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 61 ==== osd_op_reply(229 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.533+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.533+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:230 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.533+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 62 ==== osd_op_reply(230 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.533+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.533+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:231 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036dd430 2024-09-22T08:11:25.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.534+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 63 ==== osd_op_reply(231 gc.19 [call] v34'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.534+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-22T08:11:25.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.534+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:232 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.535+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 62 ==== osd_op_reply(232 gc.20 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.535+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:233 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.535+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 63 ==== osd_op_reply(233 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.535+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.535+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:234 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.535+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 64 ==== osd_op_reply(234 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.535+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:235 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.536+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 65 ==== osd_op_reply(235 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.536+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.536+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:236 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.536+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 66 ==== osd_op_reply(236 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.536+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.536+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:237 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.537+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 67 ==== osd_op_reply(237 gc.20 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.537+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-22T08:11:25.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.537+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:238 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.538+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 56 ==== osd_op_reply(238 gc.21 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.538+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:239 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.538+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 57 ==== osd_op_reply(239 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.538+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.538+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:240 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e1e20 2024-09-22T08:11:25.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.539+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 58 ==== osd_op_reply(240 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.539+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:241 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.539+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 59 ==== osd_op_reply(241 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.539+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.539+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:242 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.539+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 60 ==== osd_op_reply(242 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.539+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.539+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:243 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e1e20 2024-09-22T08:11:25.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.540+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 61 ==== osd_op_reply(243 gc.21 [call] v34'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.540+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-22T08:11:25.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.540+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:244 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.541+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 68 ==== osd_op_reply(244 gc.22 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.541+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:245 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.541+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 69 ==== osd_op_reply(245 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.541+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.541+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:246 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.542+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 70 ==== osd_op_reply(246 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.542+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:247 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.542+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 71 ==== osd_op_reply(247 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.542+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.542+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:248 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.542+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 72 ==== osd_op_reply(248 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.542+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.542+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:249 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.543+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 73 ==== osd_op_reply(249 gc.22 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.543+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.543+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:250 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.544+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 74 ==== osd_op_reply(250 gc.23 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.544+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:251 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.544+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 75 ==== osd_op_reply(251 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.544+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.544+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:252 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.544+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 76 ==== osd_op_reply(252 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.544+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:253 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.545+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 77 ==== osd_op_reply(253 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.545+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.545+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:254 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.545+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 78 ==== osd_op_reply(254 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.545+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.545+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:255 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.546+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 79 ==== osd_op_reply(255 gc.23 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.546+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.546+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:256 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.547+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 80 ==== osd_op_reply(256 gc.24 [call] v34'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.547+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:257 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.547+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 81 ==== osd_op_reply(257 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.547+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.547+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:258 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.547+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 82 ==== osd_op_reply(258 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.547+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:259 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.547+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 83 ==== osd_op_reply(259 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.547+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.547+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:260 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.548+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 84 ==== osd_op_reply(260 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.548+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.548+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:261 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.549+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 85 ==== osd_op_reply(261 gc.24 [call] v34'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.549+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.549+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:262 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.549+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 86 ==== osd_op_reply(262 gc.25 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.549+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:263 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 87 ==== osd_op_reply(263 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:264 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 88 ==== osd_op_reply(264 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:265 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 89 ==== osd_op_reply(265 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:266 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 90 ==== osd_op_reply(266 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.550+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:267 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.551+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 91 ==== osd_op_reply(267 gc.25 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.551+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.551+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:268 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.553+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 53 ==== osd_op_reply(268 gc.26 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.553+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:269 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.553+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 54 ==== osd_op_reply(269 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.553+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.553+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:270 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x7feab805d3f0 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.553+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 55 ==== osd_op_reply(270 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.553+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:271 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.553+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 56 ==== osd_op_reply(271 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.553+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.553+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:272 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.554+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 57 ==== osd_op_reply(272 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.554+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.554+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:273 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x7feab805d3f0 2024-09-22T08:11:25.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.555+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 58 ==== osd_op_reply(273 gc.26 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.555+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-22T08:11:25.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.555+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:274 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.556+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 92 ==== osd_op_reply(274 gc.27 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.556+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:275 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.556+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 93 ==== osd_op_reply(275 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.556+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.556+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:276 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803729bf0 con 0x5618036e6900 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.556+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 94 ==== osd_op_reply(276 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.556+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:277 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.556+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 95 ==== osd_op_reply(277 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.556+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.556+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:278 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372ac00 con 0x5618036e6900 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 96 ==== osd_op_reply(278 gc.27 [call out=1701b] v0'0 uv21 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 20 garbage collection: RGWGC::process iterating over entry tag='cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9141746882524154286', time=2024-09-22T08:11:25.121298+0000, chain.objs.size()=7 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_1 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:279 3.2es0 3:75e1e2a3:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372b280 con 0x5618036e1e20 2024-09-22T08:11:25.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_2 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:280 3.32s0 3:4db0516d:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180372de60 con 0x5618036e6900 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_3 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:281 3.34s0 3:2f03a1da:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618037309b0 con 0x5618036dd430 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_4 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:282 3.bs0 3:d13b4130:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561803733280 con 0x7feab805d3f0 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_5 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:283 3.6s0 3:61347426:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618037309b0 con 0x5618036dd430 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_6 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:284 3.3cs0 3:3ef2011b:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561803738020 con 0x5618036e1e20 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_7 2024-09-22T08:11:25.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.557+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:285 3.33s0 3:cfe5c863:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56180373a890 con 0x7feab805d3f0 2024-09-22T08:11:25.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.559+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 62 ==== osd_op_reply(279 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_1 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.561+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 97 ==== osd_op_reply(280 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_2 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.561+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 64 ==== osd_op_reply(283 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.562+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 59 ==== osd_op_reply(282 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_4 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.562+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 60 ==== osd_op_reply(285 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_7 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.564+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 63 ==== osd_op_reply(284 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_6 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.564+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 65 ==== osd_op_reply(281 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.1__shadow_.wHHOqTe4Ao4ilJ5JzajVncfVQUNEzJp_3 [call] v34'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.564+0000 7feabf087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:11:25.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.564+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:286 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618037303e0 con 0x5618036e6900 2024-09-22T08:11:25.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.570+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 98 ==== osd_op_reply(286 gc.27 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.570+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:287 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561803728d50 con 0x5618036e6900 2024-09-22T08:11:25.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.572+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 99 ==== osd_op_reply(287 gc.27 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.572+0000 7feabf087800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-22T08:11:25.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.572+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:288 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561803728d50 con 0x7feab805d3f0 2024-09-22T08:11:25.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.573+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 61 ==== osd_op_reply(288 gc.28 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.573+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:289 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803728d50 con 0x7feab805d3f0 2024-09-22T08:11:25.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 62 ==== osd_op_reply(289 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:290 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56180372f370 con 0x7feab805d3f0 2024-09-22T08:11:25.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 63 ==== osd_op_reply(290 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:291 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803728d50 con 0x7feab805d3f0 2024-09-22T08:11:25.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 64 ==== osd_op_reply(291 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:11:25.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:292 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561803728d50 con 0x7feab805d3f0 2024-09-22T08:11:25.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 65 ==== osd_op_reply(292 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feabf087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:11:25.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.574+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:293 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561803728d50 con 0x7feab805d3f0 2024-09-22T08:11:25.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.575+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 66 ==== osd_op_reply(293 gc.28 [call] v34'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.576+0000 7fe972fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:25.577 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.576+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94661136813664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618037285d0 con 0x5618036dd430 2024-09-22T08:11:25.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.577+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94661136813664] v34'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.577+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94661136788480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036f0e60 con 0x5618036e1e20 2024-09-22T08:11:25.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.578+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94661136788480] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.578+0000 7feabf087800 20 remove_watcher() i=0 2024-09-22T08:11:25.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.578+0000 7feabf087800 2 removed watcher, disabling cache 2024-09-22T08:11:25.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.578+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94661136794416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036f0e60 con 0x5618036dd430 2024-09-22T08:11:25.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.579+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94661136794416] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.579+0000 7feabf087800 20 remove_watcher() i=1 2024-09-22T08:11:25.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.579+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94661136798480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ec330 con 0x5618036e6900 2024-09-22T08:11:25.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.581+0000 7feabcb71640 1 -- 172.21.15.165:0/2692798726 <== osd.3 v2:172.21.15.165:6800/215521179 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94661136798480] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab008a070 con 0x5618036e6900 2024-09-22T08:11:25.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.581+0000 7feabf087800 20 remove_watcher() i=2 2024-09-22T08:11:25.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.581+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94661136803488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036f0e60 con 0x5618036e1e20 2024-09-22T08:11:25.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.582+0000 7feabd372640 1 -- 172.21.15.165:0/2692798726 <== osd.2 v2:172.21.15.165:6808/3197121696 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94661136803488] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feab805a040 con 0x5618036e1e20 2024-09-22T08:11:25.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.582+0000 7feabf087800 20 remove_watcher() i=3 2024-09-22T08:11:25.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.582+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94661136795536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ed310 con 0x5618036dd430 2024-09-22T08:11:25.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.583+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.1 v2:172.21.15.165:6816/2347568643 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94661136795536] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x5618036dd430 2024-09-22T08:11:25.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.583+0000 7feabf087800 20 remove_watcher() i=4 2024-09-22T08:11:25.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.583+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94661136807408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ee6a0 con 0x7feab805d3f0 2024-09-22T08:11:25.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.584+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94661136807408] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.584+0000 7feabf087800 20 remove_watcher() i=5 2024-09-22T08:11:25.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.584+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94661136805792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036f0e60 con 0x7feab805d3f0 2024-09-22T08:11:25.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.584+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94661136805792] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.584+0000 7feabf087800 20 remove_watcher() i=6 2024-09-22T08:11:25.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.584+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94661136812608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5618036ed310 con 0x7feab805d3f0 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 <== osd.0 v2:172.21.15.53:6800/2902972477 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94661136812608] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feaa8029040 con 0x7feab805d3f0 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 20 remove_watcher() i=7 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7feab805d3f0 msgr2=0x7feab802d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7feab805d3f0 0x7feab802d900 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618036dd430 msgr2=0x5618036df8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618036dd430 0x5618036df8f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036e1e20 msgr2=0x5618036e4210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036e1e20 0x5618036e4210 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5618036e6900 msgr2=0x5618036e8dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5618036e6900 0x5618036e8dc0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe98803d050 msgr2=0x7fe98803f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe98803d050 0x7fe98803f510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feab0052fd0 tx=0x7feab008a000 comp rx=0 tx=0).stop 2024-09-22T08:11:25.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 msgr2=0x5618036d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036d1990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7feab80117d0 tx=0x7feab80542d0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feab7fff640 1 -- 172.21.15.165:0/2692798726 reap_dead start 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 shutdown_connections 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2692798726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036ca410 0x5618036d1990 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 >> 172.21.15.165:0/2692798726 conn(0x5618036c6810 msgr2=0x5618036c4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 shutdown_connections 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2692798726 wait complete. 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2452617150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe99403d000 msgr2=0x7fe99403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2452617150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe99403d000 0x7fe99403f4c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x5618036aa7b0 tx=0x7feab0096d20 comp rx=0 tx=0).stop 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2452617150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036bd990 msgr2=0x5618036bddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2452617150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036bd990 0x5618036bddb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x56180351eb60 tx=0x7feab8018830 comp rx=0 tx=0).stop 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2452617150 shutdown_connections 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2452617150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe99403d000 0x7fe99403f4c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 --2- 172.21.15.165:0/2452617150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618036bd990 0x5618036bddb0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2452617150 >> 172.21.15.165:0/2452617150 conn(0x5618036b1d40 msgr2=0x5618036b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2452617150 shutdown_connections 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.586+0000 7feabf087800 1 -- 172.21.15.165:0/2452617150 wait complete. 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618035aaad0 msgr2=0x5618036a9e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618035aaad0 0x5618036a9e60 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036ac660 msgr2=0x5618036aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036ac660 0x5618036aea50 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe9a403cfb0 msgr2=0x7fe9a403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe9a403cfb0 0x7fe9a403f470 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feaa8001d70 tx=0x7feaa80012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 msgr2=0x56180351f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x56180351f250 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7feab0053d60 tx=0x7feab0002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 shutdown_connections 2024-09-22T08:11:25.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5618036ac660 0x5618036aea50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5618035aaad0 0x5618036a9e60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe9a403cfb0 0x7fe9a403f470 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 --2- 172.21.15.165:0/595780377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618035a99d0 0x56180351f250 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 >> 172.21.15.165:0/595780377 conn(0x5618035a4da0 msgr2=0x561803693100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 shutdown_connections 2024-09-22T08:11:25.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.587+0000 7feabf087800 1 -- 172.21.15.165:0/595780377 wait complete. 2024-09-22T08:11:25.596 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-22T08:11:25.596 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-22T08:11:25.597 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-22T08:11:25.680 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:25.680 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:25.681 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.680+0000 7fbbe7726800 1 Processor -- start 2024-09-22T08:11:25.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.680+0000 7fbbe7726800 1 -- start start 2024-09-22T08:11:25.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.680+0000 7fbbe7726800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55973b758bf0 0x55973b75e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.680+0000 7fbbe7726800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55973b5e3a20 con 0x55973b7577e0 2024-09-22T08:11:25.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.680+0000 7fbbe7726800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55973b5e37d0 con 0x55973b758bf0 2024-09-22T08:11:25.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.681+0000 7fbbdabd8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55973b758bf0 0x55973b75e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.681+0000 7fbbe33d9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55973b7577e0 0x55973b7584e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:36096/0 (socket says 172.21.15.165:36096) 2024-09-22T08:11:25.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.681+0000 7fbbe33d9640 1 -- 172.21.15.165:0/1742340438 learned_addr learned my addr 172.21.15.165:0/1742340438 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:25.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.681+0000 7fbbdabd8640 1 -- 172.21.15.165:0/1742340438 >> v1:172.21.15.53:6789/0 conn(0x55973b7577e0 legacy=0x55973b7584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.681+0000 7fbbdabd8640 1 -- 172.21.15.165:0/1742340438 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55973b757ee0 con 0x55973b758bf0 2024-09-22T08:11:25.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.683+0000 7fbbdabd8640 1 --2- 172.21.15.165:0/1742340438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b758bf0 0x55973b75e580 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00a470 tx=0x7fbbcc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd51eea646e551b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.683+0000 7fbbe2bd8640 1 -- 172.21.15.165:0/1742340438 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbcc053570 con 0x55973b758bf0 2024-09-22T08:11:25.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.683+0000 7fbbe2bd8640 1 -- 172.21.15.165:0/1742340438 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbcc058070 con 0x55973b758bf0 2024-09-22T08:11:25.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.683+0000 7fbbe2bd8640 1 -- 172.21.15.165:0/1742340438 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbcc053880 con 0x55973b758bf0 2024-09-22T08:11:25.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.684+0000 7fbbe7726800 1 -- 172.21.15.165:0/1742340438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b758bf0 msgr2=0x55973b75e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.684+0000 7fbbe7726800 1 --2- 172.21.15.165:0/1742340438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b758bf0 0x55973b75e580 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00a470 tx=0x7fbbcc045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:25.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.684+0000 7fbbe7726800 1 -- 172.21.15.165:0/1742340438 shutdown_connections 2024-09-22T08:11:25.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.684+0000 7fbbe7726800 1 --2- 172.21.15.165:0/1742340438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b758bf0 0x55973b75e580 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.684+0000 7fbbe7726800 1 -- 172.21.15.165:0/1742340438 >> 172.21.15.165:0/1742340438 conn(0x55973b752bb0 msgr2=0x55973b755010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.684+0000 7fbbe7726800 1 -- 172.21.15.165:0/1742340438 shutdown_connections 2024-09-22T08:11:25.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.684+0000 7fbbe7726800 1 -- 172.21.15.165:0/1742340438 wait complete. 2024-09-22T08:11:25.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.697+0000 7fbbe7726800 1 Processor -- start 2024-09-22T08:11:25.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.697+0000 7fbbe7726800 1 -- start start 2024-09-22T08:11:25.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.698+0000 7fbbe7726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b848030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.698+0000 7fbbe7726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55973b5f0dd0 con 0x55973b7577e0 2024-09-22T08:11:25.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.698+0000 7fbbe33d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b848030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.698+0000 7fbbe33d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b848030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57932/0 (socket says 172.21.15.165:57932) 2024-09-22T08:11:25.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.698+0000 7fbbe33d9640 1 -- 172.21.15.165:0/3783027282 learned_addr learned my addr 172.21.15.165:0/3783027282 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.698+0000 7fbbe33d9640 1 -- 172.21.15.165:0/3783027282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55973b848620 con 0x55973b7577e0 2024-09-22T08:11:25.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.698+0000 7fbbe33d9640 1 --2- 172.21.15.165:0/3783027282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b848030 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4001df0 tx=0x7fbbd400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af97e58b7c6d085 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.699+0000 7fbad160a640 1 -- 172.21.15.165:0/3783027282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbd4012020 con 0x55973b7577e0 2024-09-22T08:11:25.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.699+0000 7fbad160a640 1 -- 172.21.15.165:0/3783027282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd400e470 con 0x55973b7577e0 2024-09-22T08:11:25.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.699+0000 7fbad160a640 1 -- 172.21.15.165:0/3783027282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbd400e7f0 con 0x55973b7577e0 2024-09-22T08:11:25.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.699+0000 7fbbe7726800 1 -- 172.21.15.165:0/3783027282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 msgr2=0x55973b848030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.699+0000 7fbbe7726800 1 --2- 172.21.15.165:0/3783027282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b848030 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4001df0 tx=0x7fbbd400b6c0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.699+0000 7fbbe7726800 1 -- 172.21.15.165:0/3783027282 shutdown_connections 2024-09-22T08:11:25.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.699+0000 7fbbe7726800 1 --2- 172.21.15.165:0/3783027282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b848030 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.699+0000 7fbbe7726800 1 -- 172.21.15.165:0/3783027282 >> 172.21.15.165:0/3783027282 conn(0x55973b752bb0 msgr2=0x55973b8439b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.699+0000 7fbbe7726800 1 -- 172.21.15.165:0/3783027282 shutdown_connections 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.699+0000 7fbbe7726800 1 -- 172.21.15.165:0/3783027282 wait complete. 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.700+0000 7fbbe7726800 1 Processor -- start 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.700+0000 7fbbe7726800 1 -- start start 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.700+0000 7fbbe7726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b84fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.700+0000 7fbbe7726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55973b75eac0 con 0x55973b7577e0 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.700+0000 7fbbe33d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b84fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.700+0000 7fbbe33d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b84fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57942/0 (socket says 172.21.15.165:57942) 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.700+0000 7fbbe33d9640 1 -- 172.21.15.165:0/2048980701 learned_addr learned my addr 172.21.15.165:0/2048980701 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.700+0000 7fbbe33d9640 1 -- 172.21.15.165:0/2048980701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55973b850090 con 0x55973b7577e0 2024-09-22T08:11:25.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.701+0000 7fbbe33d9640 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b84fb30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x55973b848fc0 tx=0x7fbbd4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.701+0000 7fbacfe07640 1 -- 172.21.15.165:0/2048980701 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbd4012030 con 0x55973b7577e0 2024-09-22T08:11:25.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.701+0000 7fbacfe07640 1 -- 172.21.15.165:0/2048980701 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd401a6d0 con 0x55973b7577e0 2024-09-22T08:11:25.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.701+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55973b850320 con 0x55973b7577e0 2024-09-22T08:11:25.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.701+0000 7fbacfe07640 1 -- 172.21.15.165:0/2048980701 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbd401a9d0 con 0x55973b7577e0 2024-09-22T08:11:25.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.701+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55973b850d20 con 0x55973b7577e0 2024-09-22T08:11:25.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.702+0000 7fbacfe07640 1 -- 172.21.15.165:0/2048980701 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbbd4015020 con 0x55973b7577e0 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.702+0000 7fbacfe07640 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbac803cfb0 0x7fbac803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.702+0000 7fbacfe07640 1 -- 172.21.15.165:0/2048980701 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbbd4020030 con 0x55973b7577e0 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.702+0000 7fbbdabd8640 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbac803cfb0 0x7fbac803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.702+0000 7fbbe7726800 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b758bf0 0x55973b857180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.702+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8576c0 con 0x55973b758bf0 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.702+0000 7fbbe3bda640 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b758bf0 0x55973b857180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.702+0000 7fbbdabd8640 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbac803cfb0 0x7fbac803f470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc057000 tx=0x7fbbcc052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.703+0000 7fbbe3bda640 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b758bf0 0x55973b857180 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.703+0000 7fbbe3bda640 1 -- 172.21.15.165:0/2048980701 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbdc00a4d0 con 0x55973b758bf0 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.703+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b857a60 con 0x55973b758bf0 2024-09-22T08:11:25.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.703+0000 7fbbe3bda640 1 -- 172.21.15.165:0/2048980701 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbdc00a4d0 con 0x55973b758bf0 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.703+0000 7fbbe7726800 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b8595a0 0x55973b85ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.703+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b85c1a0 con 0x55973b8595a0 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.703+0000 7fbbe33d9640 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b8595a0 0x55973b85ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.704+0000 7fbbe33d9640 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b8595a0 0x55973b85ba10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.704+0000 7fbbe33d9640 1 -- 172.21.15.165:0/2048980701 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b8595a0 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.704+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8582b0 con 0x55973b758bf0 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.704+0000 7fbbe3bda640 1 -- 172.21.15.165:0/2048980701 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbdc00a4d0 con 0x55973b758bf0 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.704+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8586d0 con 0x55973b758bf0 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.704+0000 7fbbe3bda640 1 -- 172.21.15.165:0/2048980701 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbbdc00a4d0 con 0x55973b758bf0 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.705+0000 7fbbe7726800 1 Processor -- start 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.705+0000 7fbbe7726800 1 -- start start 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.705+0000 7fbbe7726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b86ab30 0x55973b86af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.705+0000 7fbbe7726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55973b64fd50 con 0x55973b86ab30 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.705+0000 7fbbe3bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b86ab30 0x55973b86af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.705+0000 7fbbe3bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b86ab30 0x55973b86af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57944/0 (socket says 172.21.15.165:57944) 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.705+0000 7fbbe3bda640 1 -- 172.21.15.165:0/513891549 learned_addr learned my addr 172.21.15.165:0/513891549 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.705+0000 7fbbe3bda640 1 -- 172.21.15.165:0/513891549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55973b86b590 con 0x55973b86ab30 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.706+0000 7fbbe3bda640 1 --2- 172.21.15.165:0/513891549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b86ab30 0x55973b86af50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55973b850ef0 tx=0x7fbbdc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.706+0000 7fbacd602640 1 -- 172.21.15.165:0/513891549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbdc014450 con 0x55973b86ab30 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.706+0000 7fbacd602640 1 -- 172.21.15.165:0/513891549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbdc014610 con 0x55973b86ab30 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.706+0000 7fbbe7726800 1 -- 172.21.15.165:0/513891549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55973b86bdc0 con 0x55973b86ab30 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.706+0000 7fbacd602640 1 -- 172.21.15.165:0/513891549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbdc014930 con 0x55973b86ab30 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.706+0000 7fbbe7726800 1 -- 172.21.15.165:0/513891549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55973b86c360 con 0x55973b86ab30 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.707+0000 7fbacd602640 1 -- 172.21.15.165:0/513891549 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbbdc011040 con 0x55973b86ab30 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.707+0000 7fbacd602640 1 --2- 172.21.15.165:0/513891549 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbabc03cfb0 0x7fbabc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.707+0000 7fbacd602640 1 -- 172.21.15.165:0/513891549 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbbdc01e070 con 0x55973b86ab30 2024-09-22T08:11:25.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.707+0000 7fbbe33d9640 1 --2- 172.21.15.165:0/513891549 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbabc03cfb0 0x7fbabc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.707+0000 7fbbe7726800 1 Processor -- start 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.707+0000 7fbbe33d9640 1 --2- 172.21.15.165:0/513891549 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbabc03cfb0 0x7fbabc03f470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4016780 tx=0x7fbbd4054040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.707+0000 7fbbe7726800 1 -- start start 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.707+0000 7fbbe7726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b8779b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.707+0000 7fbbe7726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55973b848a50 con 0x55973b8775b0 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.708+0000 7fbbe3bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b8779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.708+0000 7fbbe3bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b8779b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57956/0 (socket says 172.21.15.165:57956) 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.708+0000 7fbbe3bda640 1 -- 172.21.15.165:0/1406605671 learned_addr learned my addr 172.21.15.165:0/1406605671 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.708+0000 7fbbe3bda640 1 -- 172.21.15.165:0/1406605671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55973b877fa0 con 0x55973b8775b0 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.708+0000 7fbbe3bda640 1 --2- 172.21.15.165:0/1406605671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b8779b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc016fd0 tx=0x7fbbdc011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e5ef1a9bd57e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.708+0000 7fbac6ffd640 1 -- 172.21.15.165:0/1406605671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbdc016440 con 0x55973b8775b0 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.708+0000 7fbac6ffd640 1 -- 172.21.15.165:0/1406605671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbdc0532d0 con 0x55973b8775b0 2024-09-22T08:11:25.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.708+0000 7fbac6ffd640 1 -- 172.21.15.165:0/1406605671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbdc016930 con 0x55973b8775b0 2024-09-22T08:11:25.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 -- 172.21.15.165:0/1406605671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 msgr2=0x55973b8779b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 --2- 172.21.15.165:0/1406605671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b8779b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc016fd0 tx=0x7fbbdc011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:25.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 -- 172.21.15.165:0/1406605671 shutdown_connections 2024-09-22T08:11:25.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 --2- 172.21.15.165:0/1406605671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b8779b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 -- 172.21.15.165:0/1406605671 >> 172.21.15.165:0/1406605671 conn(0x55973b8739d0 msgr2=0x55973b871c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 -- 172.21.15.165:0/1406605671 shutdown_connections 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 -- 172.21.15.165:0/1406605671 wait complete. 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 Processor -- start 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 -- start start 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b87ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe7726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55973b8785c0 con 0x55973b8775b0 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe3bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b87ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe3bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b87ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57958/0 (socket says 172.21.15.165:57958) 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.709+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 learned_addr learned my addr 172.21.15.165:0/986316258 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.710+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55973b87f170 con 0x55973b8775b0 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.710+0000 7fbbe3bda640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b87ec10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc016fd0 tx=0x7fbbdc054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.710+0000 7fbac57fa640 1 -- 172.21.15.165:0/986316258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbdc031020 con 0x55973b8775b0 2024-09-22T08:11:25.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.710+0000 7fbac57fa640 1 -- 172.21.15.165:0/986316258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbdc014ad0 con 0x55973b8775b0 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.710+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55973b87f400 con 0x55973b8775b0 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.710+0000 7fbac57fa640 1 -- 172.21.15.165:0/986316258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbdc045960 con 0x55973b8775b0 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.710+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55973b87fd80 con 0x55973b8775b0 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.711+0000 7fbac57fa640 1 -- 172.21.15.165:0/986316258 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbbdc034020 con 0x55973b8775b0 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.711+0000 7fbac57fa640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbaac03d000 0x7fbaac03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.711+0000 7fbac57fa640 1 -- 172.21.15.165:0/986316258 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbbdc00e040 con 0x55973b8775b0 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.711+0000 7fbbe33d9640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbaac03d000 0x7fbaac03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.711+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.711+0000 7fbbe7726800 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b88a6b0 0x55973b88cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.711+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b88d2c0 con 0x55973b88a6b0 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.711+0000 7fbbdabd8640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b88a6b0 0x55973b88cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.711+0000 7fbbe33d9640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbaac03d000 0x7fbaac03f4c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbbd403f010 tx=0x7fbbd4045000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbdabd8640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b88a6b0 0x55973b88cb70 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 20 realm 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b88d6f0 con 0x55973b88a6b0 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b88dfc0 con 0x55973b88a6b0 2024-09-22T08:11:25.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.712+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b88e360 con 0x55973b88a6b0 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe7726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe7726800 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b88f0c0 0x55973b8914b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8919f0 con 0x55973b88f0c0 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe3bda640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b88f0c0 0x55973b8914b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe3bda640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b88f0c0 0x55973b8914b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbbdc02a070 con 0x55973b88f0c0 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe7726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:25.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe7726800 20 searching for the correct realm 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe7726800 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55973b893a30 0x55973b895ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b893a30 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.713+0000 7fbbe33d9640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55973b893a30 0x55973b895ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.714+0000 7fbbe33d9640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55973b893a30 0x55973b895ef0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.714+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.714+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88f0c0 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.714+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbbdc02a070 con 0x55973b88f0c0 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.714+0000 7fbbe3bda640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbbdc036020 0x7fbbdc04d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.714+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x7fbbdc036020 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.714+0000 7fbbdabd8640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbbdc036020 0x7fbbdc04d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.715+0000 7fbbdabd8640 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbbdc036020 0x7fbbdc04d260 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.731 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.715+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.715+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88a6b0 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.715+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.715+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88a6b0 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.715+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.715+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x7fbbdc036020 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.716+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.716+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88f0c0 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.716+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.716+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88f0c0 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.716+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.716+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b893a30 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.716+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.716+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88a6b0 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.717+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.717+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x7fbbdc036020 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.717+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.717+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88a6b0 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.717+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.717+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88f0c0 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.717+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.717+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b893a30 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.718+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.718+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b893a30 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.718+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.718+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x7fbbdc036020 2024-09-22T08:11:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.718+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.718+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b893a30 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.718+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.718+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b893a30 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.718+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.718+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88a6b0 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.719+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.719+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88a6b0 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.719+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.719+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x7fbbdc036020 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.719+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.719+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b893a30 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.719+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.719+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88f0c0 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.720+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.720+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88a6b0 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.720+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.720+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x7fbbdc036020 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.720+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.720+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b893a30 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.720+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.720+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x7fbbdc036020 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.721+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.721+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88f0c0 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.721+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.721+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b893a30 2024-09-22T08:11:25.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.721+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.721+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x7fbbdc036020 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.721+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.721+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88a6b0 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55973b8965c0 con 0x55973b88f0c0 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b892430 con 0x55973b88a6b0 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b892040 con 0x55973b88a6b0 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.722+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b892da0 con 0x55973b88a6b0 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 zone default found 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 4 Realm: () 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:25.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 zonegroup default 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8928b0 con 0x7fbbdc036020 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b898930 con 0x55973b893a30 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b898e10 con 0x55973b893a30 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 started sync module instance, tier type = 2024-09-22T08:11:25.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:25.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.723+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b897dd0 con 0x55973b88f0c0 2024-09-22T08:11:25.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.724+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.724+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94108027290048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b899720 con 0x55973b88f0c0 2024-09-22T08:11:25.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.725+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b899f70 con 0x55973b88a6b0 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.726+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94108027290048] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.726+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.726+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94108027294592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b899cd0 con 0x55973b88a6b0 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.726+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89a7f0 con 0x55973b893a30 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.727+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.727+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94108027298496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89b090 con 0x55973b893a30 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.727+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89bb80 con 0x55973b88f0c0 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.727+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94108027294592] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.728+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94108027298496] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.728+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.728+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94108027300832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8997a0 con 0x55973b88f0c0 2024-09-22T08:11:25.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.728+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89c460 con 0x55973b88a6b0 2024-09-22T08:11:25.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.729+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94108027300832] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.729+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.729+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94108027303504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89c420 con 0x55973b88a6b0 2024-09-22T08:11:25.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.729+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89cf10 con 0x7fbbdc036020 2024-09-22T08:11:25.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.730+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94108027303504] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.730+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.730+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94108027308528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89c420 con 0x7fbbdc036020 2024-09-22T08:11:25.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.730+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89d920 con 0x7fbbdc036020 2024-09-22T08:11:25.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.731+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94108027308528] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.731+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.732+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94108027305840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89db00 con 0x7fbbdc036020 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.732+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89e350 con 0x7fbbdc036020 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.733+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94108027305840] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.733+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.733+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94108027312176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89e1a0 con 0x7fbbdc036020 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.733+0000 7fbbe7726800 20 add_watcher() i=0 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.733+0000 7fbbe7726800 20 add_watcher() i=1 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.733+0000 7fbbe7726800 20 add_watcher() i=2 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.733+0000 7fbbe7726800 20 add_watcher() i=3 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.733+0000 7fbbe7726800 20 add_watcher() i=4 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.733+0000 7fbbe7726800 20 add_watcher() i=5 2024-09-22T08:11:25.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.733+0000 7fbbe7726800 20 add_watcher() i=6 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.734+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94108027312176] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.734+0000 7fbbe7726800 20 add_watcher() i=7 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.734+0000 7fbbe7726800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.734+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8a17d0 con 0x55973b88a6b0 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.734+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.734+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94108027313232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89eb30 con 0x55973b88a6b0 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.735+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94108027313232] v34'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.735+0000 7fba99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.735+0000 7fbbe7726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.735+0000 7fbbe7726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.735+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8a9f90 con 0x55973b88a6b0 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.736+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.736+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8aa540 con 0x7fbbdc036020 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.737+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.737+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8aaab0 con 0x55973b893a30 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.738+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.738+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8aaee0 con 0x55973b88a6b0 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.739+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.739+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ab450 con 0x55973b88f0c0 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.740+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.740+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ab450 con 0x55973b893a30 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.741+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.741+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ab880 con 0x55973b88a6b0 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.742+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.742+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ab990 con 0x7fbbdc036020 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.743+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'38 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.743+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8aba20 con 0x55973b88f0c0 2024-09-22T08:11:25.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.744+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.744+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8abab0 con 0x55973b893a30 2024-09-22T08:11:25.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.745+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.745+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8abc80 con 0x55973b88f0c0 2024-09-22T08:11:25.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.746+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.746+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8abc80 con 0x7fbbdc036020 2024-09-22T08:11:25.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.747+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.747+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8abc80 con 0x55973b88f0c0 2024-09-22T08:11:25.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.748+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.748+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8abd00 con 0x7fbbdc036020 2024-09-22T08:11:25.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.749+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.749+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8abd00 con 0x55973b88a6b0 2024-09-22T08:11:25.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.750+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.750+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8abd00 con 0x55973b893a30 2024-09-22T08:11:25.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.751+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'50 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.751+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b88f0c0 2024-09-22T08:11:25.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.752+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.752+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b893a30 2024-09-22T08:11:25.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.753+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.753+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b88a6b0 2024-09-22T08:11:25.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.754+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.754+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b88a6b0 2024-09-22T08:11:25.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.755+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.755+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b893a30 2024-09-22T08:11:25.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.756+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'51 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.756+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b88f0c0 2024-09-22T08:11:25.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.757+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.757+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b893a30 2024-09-22T08:11:25.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.758+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.758+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b893a30 2024-09-22T08:11:25.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.759+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.759+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b893a30 2024-09-22T08:11:25.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.760+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.760+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b893a30 2024-09-22T08:11:25.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.761+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.761+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x7fbbdc036020 2024-09-22T08:11:25.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.762+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.762+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x55973b893a30 2024-09-22T08:11:25.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.763+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.763+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8ac1b0 con 0x7fbbdc036020 2024-09-22T08:11:25.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.764+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.764+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8a99e0 con 0x55973b893a30 2024-09-22T08:11:25.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.765+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'52 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.765+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8a99e0 con 0x7fbbdc036020 2024-09-22T08:11:25.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.766+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.766+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8a99e0 con 0x55973b88f0c0 2024-09-22T08:11:25.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.767+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.767+0000 7fba98fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:25.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.767+0000 7fbbe7726800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:25.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.767+0000 7fbbe7726800 20 Filter name: none 2024-09-22T08:11:25.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.768+0000 7fba127fc640 20 reqs_thread_entry: start 2024-09-22T08:11:25.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.768+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.768+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.768+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88a6b0 2024-09-22T08:11:25.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.768+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.768+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.768+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.768+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.769+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.769+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x7fbbdc036020 2024-09-22T08:11:25.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.769+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.769+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.769+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.769+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.769+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.769+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.770+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.770+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.770+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.770+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.770+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.770+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88a6b0 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.770+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.770+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.771+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.771+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.771+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.771+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88f0c0 2024-09-22T08:11:25.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.771+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.771+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.771+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.771+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.772+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.772+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.772+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.772+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.772+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.772+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.773+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.773+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88a6b0 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.773+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.773+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.773+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.773+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.774+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.774+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x7fbbdc036020 2024-09-22T08:11:25.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.774+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.774+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.774+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.774+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.775+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.775+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88f0c0 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.775+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.775+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.775+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.775+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.775+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.775+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.776+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.776+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.776+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.776+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.776+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.776+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88f0c0 2024-09-22T08:11:25.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.776+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.776+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.777+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.777+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.777+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.777+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x7fbbdc036020 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.778+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.778+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.778+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.778+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.778+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.778+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88f0c0 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.778+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.778+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.779+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.779+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.779+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.779+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x7fbbdc036020 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.779+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.779+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.780+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.780+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.780+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.780+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88a6b0 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.780+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.780+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.780+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.780+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.781+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.781+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.781+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.781+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.781+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.781+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.781+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.781+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88f0c0 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.782+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.782+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.782+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.782+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.782+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.782+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.782+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.782+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.783+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.783+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.783+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.783+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.783+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.783+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.783+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.783+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.784+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.784+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.784+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.784+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.784+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.784+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.784+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.784+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.785+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.785+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.785+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.785+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.785+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.785+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88f0c0 2024-09-22T08:11:25.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.785+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.785+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.786+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.786+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.786+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.786+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.786+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.786+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.786+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.786+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.787+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.787+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.787+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.787+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.787+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.787+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.787+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.787+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.788+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.788+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.788+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.788+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.788+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.788+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.788+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.788+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.789+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.789+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.789+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.789+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x7fbbdc036020 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.790+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.790+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.790+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.790+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.790+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.790+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.790+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.790+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.791+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.791+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.791+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.791+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x7fbbdc036020 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.792+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.792+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.792+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.792+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.792+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.792+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b893a30 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.792+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.792+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b893a30 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.793+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.793+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.793+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.793+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x7fbbdc036020 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.793+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.794+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x7fbbdc036020 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.794+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.794+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.794+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.794+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d6a50 con 0x55973b88f0c0 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.794+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.794+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55973b8d7a60 con 0x55973b88f0c0 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.794+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.795+0000 7fba99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:25.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.795+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94108027313232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89fc00 con 0x55973b88a6b0 2024-09-22T08:11:25.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.796+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94108027313232] v34'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.796+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94108027290048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89dc50 con 0x55973b88f0c0 2024-09-22T08:11:25.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.797+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94108027290048] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.797+0000 7fbbe7726800 20 remove_watcher() i=0 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.797+0000 7fbbe7726800 2 removed watcher, disabling cache 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.797+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94108027294592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8981c0 con 0x55973b88a6b0 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.798+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94108027294592] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.798+0000 7fbbe7726800 20 remove_watcher() i=1 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.798+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94108027298496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8981c0 con 0x55973b893a30 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.799+0000 7fbbe33d9640 1 -- 172.21.15.165:0/986316258 <== osd.3 v2:172.21.15.165:6800/215521179 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94108027298496] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbd401ad50 con 0x55973b893a30 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.799+0000 7fbbe7726800 20 remove_watcher() i=2 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.799+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94108027300832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89a2c0 con 0x55973b88f0c0 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.800+0000 7fbbe3bda640 1 -- 172.21.15.165:0/986316258 <== osd.2 v2:172.21.15.165:6808/3197121696 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94108027300832] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbdc060040 con 0x55973b88f0c0 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.800+0000 7fbbe7726800 20 remove_watcher() i=3 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.800+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94108027303504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8981c0 con 0x55973b88a6b0 2024-09-22T08:11:25.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.801+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.1 v2:172.21.15.165:6816/2347568643 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94108027303504] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x55973b88a6b0 2024-09-22T08:11:25.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.802+0000 7fbbe7726800 20 remove_watcher() i=4 2024-09-22T08:11:25.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.802+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94108027308528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89abe0 con 0x7fbbdc036020 2024-09-22T08:11:25.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.803+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94108027308528] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.803+0000 7fbbe7726800 20 remove_watcher() i=5 2024-09-22T08:11:25.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.803+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94108027305840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b89a2c0 con 0x7fbbdc036020 2024-09-22T08:11:25.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.804+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94108027305840] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.804+0000 7fbbe7726800 20 remove_watcher() i=6 2024-09-22T08:11:25.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.804+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94108027312176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55973b8981c0 con 0x7fbbdc036020 2024-09-22T08:11:25.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 <== osd.0 v2:172.21.15.53:6800/2902972477 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94108027312176] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbcc051070 con 0x7fbbdc036020 2024-09-22T08:11:25.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 20 remove_watcher() i=7 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbbdc036020 msgr2=0x7fbbdc04d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fbbdc036020 0x7fbbdc04d260 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b88a6b0 msgr2=0x55973b88cb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b88a6b0 0x55973b88cb70 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b88f0c0 msgr2=0x55973b8914b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b88f0c0 0x55973b8914b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55973b893a30 msgr2=0x55973b895ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55973b893a30 0x55973b895ef0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbaac03d000 msgr2=0x7fbaac03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbaac03d000 0x7fbaac03f4c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbbd403f010 tx=0x7fbbd4045000 comp rx=0 tx=0).stop 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 msgr2=0x55973b87ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b87ec10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc016fd0 tx=0x7fbbdc054720 comp rx=0 tx=0).stop 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbdabd8640 1 -- 172.21.15.165:0/986316258 reap_dead start 2024-09-22T08:11:25.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 shutdown_connections 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/986316258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b8775b0 0x55973b87ec10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 >> 172.21.15.165:0/986316258 conn(0x55973b8739d0 msgr2=0x55973b871be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 shutdown_connections 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/986316258 wait complete. 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/513891549 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbabc03cfb0 msgr2=0x7fbabc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/513891549 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbabc03cfb0 0x7fbabc03f470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4016780 tx=0x7fbbd4054040 comp rx=0 tx=0).stop 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/513891549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b86ab30 msgr2=0x55973b86af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/513891549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b86ab30 0x55973b86af50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55973b850ef0 tx=0x7fbbdc018830 comp rx=0 tx=0).stop 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/513891549 shutdown_connections 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/513891549 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbabc03cfb0 0x7fbabc03f470 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 --2- 172.21.15.165:0/513891549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b86ab30 0x55973b86af50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/513891549 >> 172.21.15.165:0/513891549 conn(0x55973b85eee0 msgr2=0x55973b85f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/513891549 shutdown_connections 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.805+0000 7fbbe7726800 1 -- 172.21.15.165:0/513891549 wait complete. 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b758bf0 msgr2=0x55973b857180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b758bf0 0x55973b857180 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b8595a0 msgr2=0x55973b85ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b8595a0 0x55973b85ba10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbac803cfb0 msgr2=0x7fbac803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbac803cfb0 0x7fbac803f470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc057000 tx=0x7fbbcc052000 comp rx=0 tx=0).stop 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 msgr2=0x55973b84fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b84fb30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x55973b848fc0 tx=0x7fbbd4000bc0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 shutdown_connections 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55973b8595a0 0x55973b85ba10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55973b758bf0 0x55973b857180 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbac803cfb0 0x7fbac803f470 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 --2- 172.21.15.165:0/2048980701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55973b7577e0 0x55973b84fb30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 >> 172.21.15.165:0/2048980701 conn(0x55973b752bb0 msgr2=0x55973b849520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 shutdown_connections 2024-09-22T08:11:25.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.806+0000 7fbbe7726800 1 -- 172.21.15.165:0/2048980701 wait complete. 2024-09-22T08:11:25.815 INFO:teuthology.orchestra.run.smithi165.stdout:[] 2024-09-22T08:11:25.815 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:11:25.816 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-22T08:11:25.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-22T08:11:25.816 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-22T08:11:25.860 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:25.860 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:25.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.860+0000 7f51a9326800 1 Processor -- start 2024-09-22T08:11:25.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.860+0000 7f51a9326800 1 -- start start 2024-09-22T08:11:25.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.860+0000 7f51a9326800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5572bdecf510 0x5572bdf604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.860+0000 7f51a9326800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5572bdde6a20 con 0x5572bdf60a10 2024-09-22T08:11:25.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.860+0000 7f51a9326800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5572bdde67d0 con 0x5572bdecf510 2024-09-22T08:11:25.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.860+0000 7f51a4f09640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5572bdecf510 0x5572bdf604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.860+0000 7f51a4708640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5572bdf60a10 0x5572bdf62ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:36104/0 (socket says 172.21.15.165:36104) 2024-09-22T08:11:25.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.861+0000 7f51a4f09640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5572bdecf510 0x5572bdf604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57972/0 (socket says 172.21.15.165:57972) 2024-09-22T08:11:25.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.861+0000 7f51a4708640 1 -- 172.21.15.165:0/613752531 learned_addr learned my addr 172.21.15.165:0/613752531 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:25.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.861+0000 7f51a4f09640 1 -- 172.21.15.165:0/613752531 >> v1:172.21.15.53:6789/0 conn(0x5572bdf60a10 legacy=0x5572bdf62ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.861+0000 7f51a4f09640 1 -- 172.21.15.165:0/613752531 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572bdf65790 con 0x5572bdecf510 2024-09-22T08:11:25.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a4f09640 1 --2- 172.21.15.165:0/613752531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572bdf604d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5194005fd0 tx=0x7f5194045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b6a57727786468 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a3f07640 1 -- 172.21.15.165:0/613752531 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5194058530 con 0x5572bdecf510 2024-09-22T08:11:25.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a3f07640 1 -- 172.21.15.165:0/613752531 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51940586d0 con 0x5572bdecf510 2024-09-22T08:11:25.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a3f07640 1 -- 172.21.15.165:0/613752531 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51940589d0 con 0x5572bdecf510 2024-09-22T08:11:25.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a9326800 1 -- 172.21.15.165:0/613752531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 msgr2=0x5572bdf604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a9326800 1 --2- 172.21.15.165:0/613752531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572bdf604d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5194005fd0 tx=0x7f5194045c30 comp rx=0 tx=0).stop 2024-09-22T08:11:25.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a9326800 1 -- 172.21.15.165:0/613752531 shutdown_connections 2024-09-22T08:11:25.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a9326800 1 --2- 172.21.15.165:0/613752531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572bdf604d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a9326800 1 -- 172.21.15.165:0/613752531 >> 172.21.15.165:0/613752531 conn(0x5572bdf55be0 msgr2=0x5572bdf58020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a9326800 1 -- 172.21.15.165:0/613752531 shutdown_connections 2024-09-22T08:11:25.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.863+0000 7f51a9326800 1 -- 172.21.15.165:0/613752531 wait complete. 2024-09-22T08:11:25.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.877+0000 7f51a9326800 1 Processor -- start 2024-09-22T08:11:25.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.877+0000 7f51a9326800 1 -- start start 2024-09-22T08:11:25.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.877+0000 7f51a9326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be04d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.877+0000 7f51a9326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5572bddf3dd0 con 0x5572bdecf510 2024-09-22T08:11:25.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.877+0000 7f51a4f09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be04d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.877+0000 7f51a4f09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be04d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57976/0 (socket says 172.21.15.165:57976) 2024-09-22T08:11:25.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.877+0000 7f51a4f09640 1 -- 172.21.15.165:0/1720388538 learned_addr learned my addr 172.21.15.165:0/1720388538 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.878+0000 7f51a4f09640 1 -- 172.21.15.165:0/1720388538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572be04d7d0 con 0x5572bdecf510 2024-09-22T08:11:25.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.878+0000 7f51a4f09640 1 --2- 172.21.15.165:0/1720388538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be04d1e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5194025a60 tx=0x7f5194051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e37ca8ca8ee404 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.878+0000 7f5092e0d640 1 -- 172.21.15.165:0/1720388538 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5194058a30 con 0x5572bdecf510 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.878+0000 7f5092e0d640 1 -- 172.21.15.165:0/1720388538 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5194068070 con 0x5572bdecf510 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.878+0000 7f5092e0d640 1 -- 172.21.15.165:0/1720388538 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5194058d00 con 0x5572bdecf510 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 -- 172.21.15.165:0/1720388538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 msgr2=0x5572be04d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 --2- 172.21.15.165:0/1720388538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be04d1e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5194025a60 tx=0x7f5194051000 comp rx=0 tx=0).stop 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 -- 172.21.15.165:0/1720388538 shutdown_connections 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 --2- 172.21.15.165:0/1720388538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be04d1e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 -- 172.21.15.165:0/1720388538 >> 172.21.15.165:0/1720388538 conn(0x5572bdf55be0 msgr2=0x5572be048b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 -- 172.21.15.165:0/1720388538 shutdown_connections 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 -- 172.21.15.165:0/1720388538 wait complete. 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 Processor -- start 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 -- start start 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be054b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.879+0000 7f51a9326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5572bdf64a30 con 0x5572bdecf510 2024-09-22T08:11:25.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.880+0000 7f51a4f09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be054b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.880+0000 7f51a4f09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be054b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57984/0 (socket says 172.21.15.165:57984) 2024-09-22T08:11:25.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.880+0000 7f51a4f09640 1 -- 172.21.15.165:0/2672486760 learned_addr learned my addr 172.21.15.165:0/2672486760 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.880+0000 7f51a4f09640 1 -- 172.21.15.165:0/2672486760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572be0550c0 con 0x5572bdecf510 2024-09-22T08:11:25.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.880+0000 7f51a4f09640 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be054b60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5194025a60 tx=0x7f5194003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.880+0000 7f509160a640 1 -- 172.21.15.165:0/2672486760 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5194063650 con 0x5572bdecf510 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.880+0000 7f509160a640 1 -- 172.21.15.165:0/2672486760 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51940637f0 con 0x5572bdecf510 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.880+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572be055350 con 0x5572bdecf510 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.880+0000 7f509160a640 1 -- 172.21.15.165:0/2672486760 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5194063b10 con 0x5572bdecf510 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.880+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572be055d50 con 0x5572bdecf510 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.881+0000 7f509160a640 1 -- 172.21.15.165:0/2672486760 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5194075020 con 0x5572bdecf510 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.881+0000 7f509160a640 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f508c03cfb0 0x7f508c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.881+0000 7f509160a640 1 -- 172.21.15.165:0/2672486760 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5194098c10 con 0x5572bdecf510 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.882+0000 7f51a4708640 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f508c03cfb0 0x7f508c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.882+0000 7f51a9326800 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572bdf60a10 0x5572be05c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.882+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be056940 con 0x5572bdf60a10 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.882+0000 7f51a570a640 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572bdf60a10 0x5572be05c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.882+0000 7f51a4708640 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f508c03cfb0 0x7f508c03f470 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f518c001d70 tx=0x7f518c0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.882+0000 7f51a570a640 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572bdf60a10 0x5572be05c1b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.882+0000 7f51a570a640 1 -- 172.21.15.165:0/2672486760 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f519c0083e0 con 0x5572bdf60a10 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.882+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be05cc30 con 0x5572bdf60a10 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.883+0000 7f51a570a640 1 -- 172.21.15.165:0/2672486760 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f519c0083e0 con 0x5572bdf60a10 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.883+0000 7f51a9326800 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be05e540 0x5572be0609e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.883+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be061170 con 0x5572be05e540 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.883+0000 7f51a4f09640 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be05e540 0x5572be0609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.883+0000 7f51a4f09640 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be05e540 0x5572be0609e0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.883+0000 7f51a4f09640 1 -- 172.21.15.165:0/2672486760 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5194077c10 con 0x5572be05e540 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.883+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be05d480 con 0x5572bdf60a10 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.884+0000 7f51a570a640 1 -- 172.21.15.165:0/2672486760 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f519c0083e0 con 0x5572bdf60a10 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.884+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be05d8a0 con 0x5572bdf60a10 2024-09-22T08:11:25.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.884+0000 7f51a570a640 1 -- 172.21.15.165:0/2672486760 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f519c0083e0 con 0x5572bdf60a10 2024-09-22T08:11:25.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.884+0000 7f51a9326800 1 Processor -- start 2024-09-22T08:11:25.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.884+0000 7f51a9326800 1 -- start start 2024-09-22T08:11:25.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.884+0000 7f51a9326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be06fb30 0x5572be06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.884+0000 7f51a9326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5572bde52d50 con 0x5572be06fb30 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.885+0000 7f51a570a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be06fb30 0x5572be06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.885+0000 7f51a570a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be06fb30 0x5572be06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:57994/0 (socket says 172.21.15.165:57994) 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.885+0000 7f51a570a640 1 -- 172.21.15.165:0/86118165 learned_addr learned my addr 172.21.15.165:0/86118165 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.885+0000 7f51a570a640 1 -- 172.21.15.165:0/86118165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572be070590 con 0x5572be06fb30 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.885+0000 7f51a570a640 1 --2- 172.21.15.165:0/86118165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be06fb30 0x5572be06ff50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x5572be056150 tx=0x7f519c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.885+0000 7f508a7fc640 1 -- 172.21.15.165:0/86118165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c007dc0 con 0x5572be06fb30 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.885+0000 7f508a7fc640 1 -- 172.21.15.165:0/86118165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c01e020 con 0x5572be06fb30 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.885+0000 7f508a7fc640 1 -- 172.21.15.165:0/86118165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c019570 con 0x5572be06fb30 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.885+0000 7f51a9326800 1 -- 172.21.15.165:0/86118165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572be070dc0 con 0x5572be06fb30 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.886+0000 7f51a9326800 1 -- 172.21.15.165:0/86118165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572be071360 con 0x5572be06fb30 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.886+0000 7f508a7fc640 1 -- 172.21.15.165:0/86118165 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f519c016040 con 0x5572be06fb30 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.886+0000 7f508a7fc640 1 --2- 172.21.15.165:0/86118165 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507c03d000 0x7f507c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.886+0000 7f508a7fc640 1 -- 172.21.15.165:0/86118165 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f519c01f030 con 0x5572be06fb30 2024-09-22T08:11:25.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.887+0000 7f51a4f09640 1 --2- 172.21.15.165:0/86118165 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507c03d000 0x7f507c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.887+0000 7f51a9326800 1 Processor -- start 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.887+0000 7f51a9326800 1 -- start start 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.887+0000 7f51a4f09640 1 --2- 172.21.15.165:0/86118165 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507c03d000 0x7f507c03f4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5572be056330 tx=0x7f519406c390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.887+0000 7f51a9326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be07ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.887+0000 7f51a9326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5572be04db40 con 0x5572be07c610 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.887+0000 7f51a570a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be07ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.887+0000 7f51a570a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be07ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58000/0 (socket says 172.21.15.165:58000) 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.887+0000 7f51a570a640 1 -- 172.21.15.165:0/2219732362 learned_addr learned my addr 172.21.15.165:0/2219732362 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.887+0000 7f51a570a640 1 -- 172.21.15.165:0/2219732362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572be07d000 con 0x5572be07c610 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f51a570a640 1 --2- 172.21.15.165:0/2219732362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be07ca10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f519c014d40 tx=0x7f519c014340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5318624c7f5aeb72 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f507bfff640 1 -- 172.21.15.165:0/2219732362 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c051020 con 0x5572be07c610 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f507bfff640 1 -- 172.21.15.165:0/2219732362 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c014590 con 0x5572be07c610 2024-09-22T08:11:25.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f507bfff640 1 -- 172.21.15.165:0/2219732362 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c01d070 con 0x5572be07c610 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f51a9326800 1 -- 172.21.15.165:0/2219732362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 msgr2=0x5572be07ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f51a9326800 1 --2- 172.21.15.165:0/2219732362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be07ca10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f519c014d40 tx=0x7f519c014340 comp rx=0 tx=0).stop 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f51a9326800 1 -- 172.21.15.165:0/2219732362 shutdown_connections 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f51a9326800 1 --2- 172.21.15.165:0/2219732362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be07ca10 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f51a9326800 1 -- 172.21.15.165:0/2219732362 >> 172.21.15.165:0/2219732362 conn(0x5572be078a10 msgr2=0x5572be076c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f51a9326800 1 -- 172.21.15.165:0/2219732362 shutdown_connections 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f51a9326800 1 -- 172.21.15.165:0/2219732362 wait complete. 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.888+0000 7f51a9326800 1 Processor -- start 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f51a9326800 1 -- start start 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f51a9326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be083c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f51a9326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5572be07d620 con 0x5572be07c610 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f51a570a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be083c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f51a570a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be083c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58002/0 (socket says 172.21.15.165:58002) 2024-09-22T08:11:25.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 learned_addr learned my addr 172.21.15.165:0/518987308 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572be0841a0 con 0x5572be07c610 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f51a570a640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be083c40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f519c0533c0 tx=0x7f519c054570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f507a7fc640 1 -- 172.21.15.165:0/518987308 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c014e00 con 0x5572be07c610 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f507a7fc640 1 -- 172.21.15.165:0/518987308 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c031070 con 0x5572be07c610 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572be084430 con 0x5572be07c610 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.889+0000 7f507a7fc640 1 -- 172.21.15.165:0/518987308 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0174e0 con 0x5572be07c610 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.890+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572be084db0 con 0x5572be07c610 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.890+0000 7f507a7fc640 1 -- 172.21.15.165:0/518987308 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f519c017680 con 0x5572be07c610 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.890+0000 7f507a7fc640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507003d000 0x7f507003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.891+0000 7f507a7fc640 1 -- 172.21.15.165:0/518987308 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f519c03ec00 con 0x5572be07c610 2024-09-22T08:11:25.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.891+0000 7f51a4f09640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507003d000 0x7f507003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.891+0000 7f51a4f09640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507003d000 0x7f507003f4c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f51940883f0 tx=0x7f5194091000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.891+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.891+0000 7f51a9326800 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572be08f5d0 0x5572be091a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.891+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be0921e0 con 0x5572be08f5d0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.891+0000 7f51a4708640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572be08f5d0 0x5572be091a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a4708640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572be08f5d0 0x5572be091a90 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f518c009050 con 0x5572be08f5d0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 20 realm 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be08e920 con 0x5572be08f5d0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f518c009050 con 0x5572be08f5d0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be092cd0 con 0x5572be08f5d0 2024-09-22T08:11:25.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f518c009050 con 0x5572be08f5d0 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.892+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be0935a0 con 0x5572be08f5d0 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f518c009050 con 0x5572be08f5d0 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a9326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a9326800 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be093fc0 0x5572be0963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be096af0 con 0x5572be093fc0 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a570a640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be093fc0 0x5572be0963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a570a640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be093fc0 0x5572be0963b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f519c0083e0 con 0x5572be093fc0 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a9326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a9326800 20 searching for the correct realm 2024-09-22T08:11:25.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a9326800 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5572be098aa0 0x5572be09af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be098aa0 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.893+0000 7f51a4f09640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5572be098aa0 0x5572be09af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.894+0000 7f51a4f09640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5572be098aa0 0x5572be09af60 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.894+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.894+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be093fc0 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.894+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f519c0083e0 con 0x5572be093fc0 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.894+0000 7f51a570a640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f519c019040 0x7f519c036460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.894+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x7f519c019040 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.894+0000 7f51a4708640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f519c019040 0x7f519c036460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.895+0000 7f51a4708640 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f519c019040 0x7f519c036460 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.895+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c009050 con 0x7f519c019040 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.895+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be08f5d0 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.895+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c009050 con 0x5572be08f5d0 2024-09-22T08:11:25.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.895+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be08f5d0 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.895+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.895+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x7f519c019040 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.896+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.896+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be093fc0 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.896+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c0083e0 con 0x5572be093fc0 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.896+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be093fc0 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.896+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c0083e0 con 0x5572be093fc0 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.896+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be098aa0 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.896+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.896+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be08f5d0 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.896+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.896+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x7f519c019040 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.897+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.897+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be08f5d0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.897+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.897+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be093fc0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.897+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.897+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be098aa0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.897+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.897+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be098aa0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.898+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.898+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x7f519c019040 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.898+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.898+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be098aa0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.898+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.898+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be098aa0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.898+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.898+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be08f5d0 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.898+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.899+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be08f5d0 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.899+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.899+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x7f519c019040 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.899+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.899+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be098aa0 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.899+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.899+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be093fc0 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.899+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.899+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be08f5d0 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.900+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.900+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x7f519c019040 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.900+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.900+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be098aa0 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.900+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.900+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x7f519c019040 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.900+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.900+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be093fc0 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.901+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.901+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be098aa0 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.901+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.901+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x7f519c019040 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.901+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.901+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be08f5d0 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.901+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.901+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5572be09b5e0 con 0x5572be093fc0 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be0974b0 con 0x5572be08f5d0 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be097d50 con 0x5572be08f5d0 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be09ba60 con 0x5572be08f5d0 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 zone default found 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 4 Realm: () 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 zonegroup default 2024-09-22T08:11:25.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.902+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be09be60 con 0x7f519c019040 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be09dc90 con 0x5572be098aa0 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be09e130 con 0x5572be098aa0 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a9326800 20 started sync module instance, tier type = 2024-09-22T08:11:25.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a9326800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.903+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09d130 con 0x5572be093fc0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.904+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.904+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93951302948400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09d130 con 0x5572be093fc0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.904+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09ebf0 con 0x5572be08f5d0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.905+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93951302948400] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.905+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.905+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93951302952704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09d130 con 0x5572be08f5d0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.905+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09f660 con 0x5572be098aa0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.906+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93951302952704] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.907+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.907+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93951302955344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09fa00 con 0x5572be098aa0 2024-09-22T08:11:25.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.907+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a04a0 con 0x5572be093fc0 2024-09-22T08:11:25.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.908+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.908+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93951302955344] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.908+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93951302958960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a0d40 con 0x5572be093fc0 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.908+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09cc80 con 0x5572be08f5d0 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.909+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93951302958960] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.909+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.909+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93951302961296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a0cb0 con 0x5572be08f5d0 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.909+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a1e00 con 0x7f519c019040 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.910+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93951302961296] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.910+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.910+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93951302964016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a1e00 con 0x7f519c019040 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.910+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a27c0 con 0x7f519c019040 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.911+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93951302964016] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.911+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.911+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93951302966064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a27c0 con 0x7f519c019040 2024-09-22T08:11:25.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.911+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a3180 con 0x7f519c019040 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.912+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93951302966064] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.912+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.912+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93951302968560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a3180 con 0x7f519c019040 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.912+0000 7f51a9326800 20 add_watcher() i=0 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.912+0000 7f51a9326800 20 add_watcher() i=1 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.912+0000 7f51a9326800 20 add_watcher() i=2 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.912+0000 7f51a9326800 20 add_watcher() i=3 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.912+0000 7f51a9326800 20 add_watcher() i=4 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.912+0000 7f51a9326800 20 add_watcher() i=5 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.912+0000 7f51a9326800 20 add_watcher() i=6 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.913+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93951302968560] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.913+0000 7f51a9326800 20 add_watcher() i=7 2024-09-22T08:11:25.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.913+0000 7f51a9326800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.913+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a6640 con 0x5572be08f5d0 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.913+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.913+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93951302983632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a32f0 con 0x5572be08f5d0 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.914+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93951302983632] v34'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.914+0000 7f505b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.914+0000 7f51a9326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.914+0000 7f51a9326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.914+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0af200 con 0x5572be08f5d0 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.916+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.916+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0af830 con 0x7f519c019040 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.917+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.917+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0afc90 con 0x5572be098aa0 2024-09-22T08:11:25.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.918+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.918+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b06b0 con 0x5572be08f5d0 2024-09-22T08:11:25.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.919+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.919+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0ad040 con 0x5572be093fc0 2024-09-22T08:11:25.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.920+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.920+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0ad010 con 0x5572be098aa0 2024-09-22T08:11:25.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.921+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.921+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0ad140 con 0x5572be08f5d0 2024-09-22T08:11:25.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.922+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.922+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0ad140 con 0x7f519c019040 2024-09-22T08:11:25.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.923+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'40 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.923+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0ad240 con 0x5572be093fc0 2024-09-22T08:11:25.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.924+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.924+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be098aa0 2024-09-22T08:11:25.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.925+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.925+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be093fc0 2024-09-22T08:11:25.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.926+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.926+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x7f519c019040 2024-09-22T08:11:25.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.928+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.928+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be093fc0 2024-09-22T08:11:25.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.929+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.929+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x7f519c019040 2024-09-22T08:11:25.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.930+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.930+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be08f5d0 2024-09-22T08:11:25.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.931+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.931+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be098aa0 2024-09-22T08:11:25.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.932+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'53 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.932+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be093fc0 2024-09-22T08:11:25.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.933+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.933+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be098aa0 2024-09-22T08:11:25.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.934+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.934+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be08f5d0 2024-09-22T08:11:25.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.935+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.935+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be08f5d0 2024-09-22T08:11:25.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.936+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.936+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be098aa0 2024-09-22T08:11:25.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.937+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'54 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.937+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be093fc0 2024-09-22T08:11:25.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.938+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.938+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1160 con 0x5572be098aa0 2024-09-22T08:11:25.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.939+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.939+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b11b0 con 0x5572be098aa0 2024-09-22T08:11:25.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.940+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.940+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b11f0 con 0x5572be098aa0 2024-09-22T08:11:25.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.941+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.941+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b11e0 con 0x5572be098aa0 2024-09-22T08:11:25.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.942+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.942+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1220 con 0x7f519c019040 2024-09-22T08:11:25.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.943+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.943+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1260 con 0x5572be098aa0 2024-09-22T08:11:25.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.944+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.944+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1260 con 0x7f519c019040 2024-09-22T08:11:25.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.945+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.945+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1260 con 0x5572be098aa0 2024-09-22T08:11:25.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.946+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'55 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.947 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.946+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b1260 con 0x7f519c019040 2024-09-22T08:11:25.947 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.947+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.947+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b12a0 con 0x5572be093fc0 2024-09-22T08:11:25.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.948+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.948+0000 7f505a7e4640 20 reqs_thread_entry: start 2024-09-22T08:11:25.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.948+0000 7f51a9326800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:25.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f51a9326800 20 Filter name: none 2024-09-22T08:11:25.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f50537fe640 20 reqs_thread_entry: start 2024-09-22T08:11:25.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f51a9326800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:25.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f51a9326800 20 rados->read ofs=0 len=0 2024-09-22T08:11:25.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be0dc1c0 con 0x5572be08f5d0 2024-09-22T08:11:25.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f51a9326800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:25.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f51a9326800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:25.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f51a9326800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:25.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f51a9326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:25.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.949+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5572be0dea80 con 0x5572be093fc0 2024-09-22T08:11:25.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.950+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.952 INFO:teuthology.orchestra.run.smithi165.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-22T08:11:25.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.950+0000 7f505b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:25.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.950+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93951302983632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0b04e0 con 0x5572be08f5d0 2024-09-22T08:11:25.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.951+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93951302983632] v34'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.951+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93951302948400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a5fd0 con 0x5572be093fc0 2024-09-22T08:11:25.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.952+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93951302948400] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.952+0000 7f51a9326800 20 remove_watcher() i=0 2024-09-22T08:11:25.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.952+0000 7f51a9326800 2 removed watcher, disabling cache 2024-09-22T08:11:25.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.952+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93951302952704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09d630 con 0x5572be08f5d0 2024-09-22T08:11:25.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.954+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93951302952704] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.954+0000 7f51a9326800 20 remove_watcher() i=1 2024-09-22T08:11:25.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.954+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93951302955344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09e700 con 0x5572be098aa0 2024-09-22T08:11:25.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.955+0000 7f51a4f09640 1 -- 172.21.15.165:0/518987308 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93951302955344] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5194091070 con 0x5572be098aa0 2024-09-22T08:11:25.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.955+0000 7f51a9326800 20 remove_watcher() i=2 2024-09-22T08:11:25.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.955+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93951302958960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09e700 con 0x5572be093fc0 2024-09-22T08:11:25.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.956+0000 7f51a570a640 1 -- 172.21.15.165:0/518987308 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93951302958960] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c063060 con 0x5572be093fc0 2024-09-22T08:11:25.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.956+0000 7f51a9326800 20 remove_watcher() i=3 2024-09-22T08:11:25.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.956+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93951302961296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09e700 con 0x5572be08f5d0 2024-09-22T08:11:25.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.956+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93951302961296] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x5572be08f5d0 2024-09-22T08:11:25.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.956+0000 7f51a9326800 20 remove_watcher() i=4 2024-09-22T08:11:25.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.956+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93951302964016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a0890 con 0x7f519c019040 2024-09-22T08:11:25.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.958+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93951302964016] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.958+0000 7f51a9326800 20 remove_watcher() i=5 2024-09-22T08:11:25.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.958+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93951302966064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be09e700 con 0x7f519c019040 2024-09-22T08:11:25.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.958+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93951302966064] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.958+0000 7f51a9326800 20 remove_watcher() i=6 2024-09-22T08:11:25.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.958+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93951302968560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5572be0a1330 con 0x7f519c019040 2024-09-22T08:11:25.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.959+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93951302968560] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f518c029040 con 0x7f519c019040 2024-09-22T08:11:25.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.959+0000 7f51a9326800 20 remove_watcher() i=7 2024-09-22T08:11:25.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.959+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f519c019040 msgr2=0x7f519c036460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.959+0000 7f51a9326800 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f519c019040 0x7f519c036460 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.959+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572be08f5d0 msgr2=0x5572be091a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572be08f5d0 0x5572be091a90 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be093fc0 msgr2=0x5572be0963b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be093fc0 0x5572be0963b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5572be098aa0 msgr2=0x5572be09af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5572be098aa0 0x5572be09af60 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507003d000 msgr2=0x7f507003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507003d000 0x7f507003f4c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f51940883f0 tx=0x7f5194091000 comp rx=0 tx=0).stop 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 msgr2=0x5572be083c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a4708640 1 -- 172.21.15.165:0/518987308 reap_dead start 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be083c40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f519c0533c0 tx=0x7f519c054570 comp rx=0 tx=0).stop 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 shutdown_connections 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 --2- 172.21.15.165:0/518987308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be07c610 0x5572be083c40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 >> 172.21.15.165:0/518987308 conn(0x5572be078a10 msgr2=0x5572be076c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 shutdown_connections 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/518987308 wait complete. 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/86118165 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507c03d000 msgr2=0x7f507c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 --2- 172.21.15.165:0/86118165 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507c03d000 0x7f507c03f4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5572be056330 tx=0x7f519406c390 comp rx=0 tx=0).stop 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/86118165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be06fb30 msgr2=0x5572be06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 --2- 172.21.15.165:0/86118165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be06fb30 0x5572be06ff50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x5572be056150 tx=0x7f519c00af40 comp rx=0 tx=0).stop 2024-09-22T08:11:25.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/86118165 shutdown_connections 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 --2- 172.21.15.165:0/86118165 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f507c03d000 0x7f507c03f4c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 --2- 172.21.15.165:0/86118165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572be06fb30 0x5572be06ff50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/86118165 >> 172.21.15.165:0/86118165 conn(0x5572be063ee0 msgr2=0x5572be0642c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/86118165 shutdown_connections 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.960+0000 7f51a9326800 1 -- 172.21.15.165:0/86118165 wait complete. 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572bdf60a10 msgr2=0x5572be05c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572bdf60a10 0x5572be05c1b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be05e540 msgr2=0x5572be0609e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be05e540 0x5572be0609e0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f508c03cfb0 msgr2=0x7f508c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f508c03cfb0 0x7f508c03f470 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f518c001d70 tx=0x7f518c0012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 msgr2=0x5572be054b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be054b60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5194025a60 tx=0x7f5194003330 comp rx=0 tx=0).stop 2024-09-22T08:11:25.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 shutdown_connections 2024-09-22T08:11:25.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5572be05e540 0x5572be0609e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5572bdf60a10 0x5572be05c1b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f508c03cfb0 0x7f508c03f470 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 --2- 172.21.15.165:0/2672486760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5572bdecf510 0x5572be054b60 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:25.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 >> 172.21.15.165:0/2672486760 conn(0x5572bdf55be0 msgr2=0x5572be04e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:25.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 shutdown_connections 2024-09-22T08:11:25.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:25.961+0000 7f51a9326800 1 -- 172.21.15.165:0/2672486760 wait complete. 2024-09-22T08:11:25.970 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-22T08:11:25.977 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-22T08:11:25.982 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:26.010 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:26.019 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:26.063 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-22T08:11:26.068 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:26.068 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-22T08:11:26.069 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-22T08:11:26.069 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-22T08:11:26.114 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:26.114 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:26.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.114+0000 7f0980610800 1 Processor -- start 2024-09-22T08:11:26.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.114+0000 7f0980610800 1 -- start start 2024-09-22T08:11:26.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.114+0000 7f0980610800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fb22177cd0 0x55fb222094e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.114+0000 7f0980610800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fb2208fa20 con 0x55fb22209a20 2024-09-22T08:11:26.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.114+0000 7f0980610800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55fb2208f7d0 con 0x55fb22177cd0 2024-09-22T08:11:26.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.115+0000 7f097bccb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fb22177cd0 0x55fb222094e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.115+0000 7f097b4ca640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55fb22209a20 0x55fb2220bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:36114/0 (socket says 172.21.15.165:36114) 2024-09-22T08:11:26.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.115+0000 7f097b4ca640 1 -- 172.21.15.165:0/176387037 learned_addr learned my addr 172.21.15.165:0/176387037 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:26.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.115+0000 7f097bccb640 1 -- 172.21.15.165:0/176387037 >> v1:172.21.15.53:6789/0 conn(0x55fb22209a20 legacy=0x55fb2220bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.115+0000 7f097bccb640 1 -- 172.21.15.165:0/176387037 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2220e780 con 0x55fb22177cd0 2024-09-22T08:11:26.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.117+0000 7f097bccb640 1 --2- 172.21.15.165:0/176387037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222094e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f096c00a470 tx=0x7f096c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74558a1666652d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.117+0000 7f097acc9640 1 -- 172.21.15.165:0/176387037 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f096c053570 con 0x55fb22177cd0 2024-09-22T08:11:26.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.117+0000 7f097acc9640 1 -- 172.21.15.165:0/176387037 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f096c058070 con 0x55fb22177cd0 2024-09-22T08:11:26.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.117+0000 7f097acc9640 1 -- 172.21.15.165:0/176387037 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f096c053880 con 0x55fb22177cd0 2024-09-22T08:11:26.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.118+0000 7f0980610800 1 -- 172.21.15.165:0/176387037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 msgr2=0x55fb222094e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.118+0000 7f0980610800 1 --2- 172.21.15.165:0/176387037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222094e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f096c00a470 tx=0x7f096c045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:26.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.118+0000 7f0980610800 1 -- 172.21.15.165:0/176387037 shutdown_connections 2024-09-22T08:11:26.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.118+0000 7f0980610800 1 --2- 172.21.15.165:0/176387037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222094e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.118+0000 7f0980610800 1 -- 172.21.15.165:0/176387037 >> 172.21.15.165:0/176387037 conn(0x55fb221febb0 msgr2=0x55fb22201010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.118+0000 7f0980610800 1 -- 172.21.15.165:0/176387037 shutdown_connections 2024-09-22T08:11:26.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.118+0000 7f0980610800 1 -- 172.21.15.165:0/176387037 wait complete. 2024-09-22T08:11:26.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.132+0000 7f0980610800 1 Processor -- start 2024-09-22T08:11:26.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.132+0000 7f0980610800 1 -- start start 2024-09-22T08:11:26.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.132+0000 7f0980610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222f6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.132+0000 7f0980610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fb2209cdd0 con 0x55fb22177cd0 2024-09-22T08:11:26.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.132+0000 7f097bccb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.132+0000 7f097bccb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222f6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58022/0 (socket says 172.21.15.165:58022) 2024-09-22T08:11:26.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.132+0000 7f097bccb640 1 -- 172.21.15.165:0/4048094392 learned_addr learned my addr 172.21.15.165:0/4048094392 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.132+0000 7f097bccb640 1 -- 172.21.15.165:0/4048094392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb222f6880 con 0x55fb22177cd0 2024-09-22T08:11:26.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.133+0000 7f097bccb640 1 --2- 172.21.15.165:0/4048094392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222f6290 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f096c025c20 tx=0x7f096c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1088ae32bc5093 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.133+0000 7f0869e0b640 1 -- 172.21.15.165:0/4048094392 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f096c053570 con 0x55fb22177cd0 2024-09-22T08:11:26.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.133+0000 7f0869e0b640 1 -- 172.21.15.165:0/4048094392 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f096c063070 con 0x55fb22177cd0 2024-09-22T08:11:26.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.133+0000 7f0869e0b640 1 -- 172.21.15.165:0/4048094392 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f096c053840 con 0x55fb22177cd0 2024-09-22T08:11:26.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 -- 172.21.15.165:0/4048094392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 msgr2=0x55fb222f6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 --2- 172.21.15.165:0/4048094392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222f6290 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f096c025c20 tx=0x7f096c051000 comp rx=0 tx=0).stop 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 -- 172.21.15.165:0/4048094392 shutdown_connections 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 --2- 172.21.15.165:0/4048094392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222f6290 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 -- 172.21.15.165:0/4048094392 >> 172.21.15.165:0/4048094392 conn(0x55fb221febb0 msgr2=0x55fb222f1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 -- 172.21.15.165:0/4048094392 shutdown_connections 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 -- 172.21.15.165:0/4048094392 wait complete. 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 Processor -- start 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 -- start start 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222fdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f0980610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fb2220da20 con 0x55fb22177cd0 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f097bccb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222fdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f097bccb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222fdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58036/0 (socket says 172.21.15.165:58036) 2024-09-22T08:11:26.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.134+0000 7f097bccb640 1 -- 172.21.15.165:0/2691617321 learned_addr learned my addr 172.21.15.165:0/2691617321 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.135+0000 7f097bccb640 1 -- 172.21.15.165:0/2691617321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb222fe1e0 con 0x55fb22177cd0 2024-09-22T08:11:26.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.135+0000 7f097bccb640 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222fdc80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f096c053d60 tx=0x7f096c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.135+0000 7f0863fff640 1 -- 172.21.15.165:0/2691617321 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f096c068470 con 0x55fb22177cd0 2024-09-22T08:11:26.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.135+0000 7f0863fff640 1 -- 172.21.15.165:0/2691617321 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f096c068610 con 0x55fb22177cd0 2024-09-22T08:11:26.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.135+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb222fe470 con 0x55fb22177cd0 2024-09-22T08:11:26.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.135+0000 7f0863fff640 1 -- 172.21.15.165:0/2691617321 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f096c0688f0 con 0x55fb22177cd0 2024-09-22T08:11:26.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.135+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb222fee70 con 0x55fb22177cd0 2024-09-22T08:11:26.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.136+0000 7f0863fff640 1 -- 172.21.15.165:0/2691617321 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f096c068a90 con 0x55fb22177cd0 2024-09-22T08:11:26.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.136+0000 7f0863fff640 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f086403cfb0 0x7f086403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.136+0000 7f0863fff640 1 -- 172.21.15.165:0/2691617321 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f096c098b00 con 0x55fb22177cd0 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.136+0000 7f097b4ca640 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f086403cfb0 0x7f086403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.137+0000 7f0980610800 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22209a20 0x55fb223052d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.137+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb222ffa20 con 0x55fb22209a20 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.137+0000 7f097c4cc640 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22209a20 0x55fb223052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.137+0000 7f097b4ca640 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f086403cfb0 0x7f086403f470 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0964001d70 tx=0x7f09640012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.137+0000 7f097c4cc640 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22209a20 0x55fb223052d0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.137+0000 7f097c4cc640 1 -- 172.21.15.165:0/2691617321 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f097400a4d0 con 0x55fb22209a20 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.137+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb22305cf0 con 0x55fb22209a20 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.138+0000 7f097c4cc640 1 -- 172.21.15.165:0/2691617321 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f097400a4d0 con 0x55fb22209a20 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.138+0000 7f0980610800 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb22307600 0x55fb22309aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.138+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb2230a230 con 0x55fb22307600 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.138+0000 7f097bccb640 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb22307600 0x55fb22309aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.138+0000 7f097bccb640 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb22307600 0x55fb22309aa0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.138+0000 7f097bccb640 1 -- 172.21.15.165:0/2691617321 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f096c079020 con 0x55fb22307600 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.138+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb22306540 con 0x55fb22209a20 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.139+0000 7f097c4cc640 1 -- 172.21.15.165:0/2691617321 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f097400a4d0 con 0x55fb22209a20 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.139+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb223068e0 con 0x55fb22209a20 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.139+0000 7f097c4cc640 1 -- 172.21.15.165:0/2691617321 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f097400a4d0 con 0x55fb22209a20 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.139+0000 7f0980610800 1 Processor -- start 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.139+0000 7f0980610800 1 -- start start 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.139+0000 7f0980610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22318b00 0x55fb22318f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.139+0000 7f0980610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fb220fbd50 con 0x55fb22318b00 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.140+0000 7f097c4cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22318b00 0x55fb22318f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.140+0000 7f097c4cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22318b00 0x55fb22318f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58038/0 (socket says 172.21.15.165:58038) 2024-09-22T08:11:26.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.140+0000 7f097c4cc640 1 -- 172.21.15.165:0/3754399772 learned_addr learned my addr 172.21.15.165:0/3754399772 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.140+0000 7f097c4cc640 1 -- 172.21.15.165:0/3754399772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb22319560 con 0x55fb22318b00 2024-09-22T08:11:26.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.140+0000 7f097c4cc640 1 --2- 172.21.15.165:0/3754399772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22318b00 0x55fb22318f20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x55fb222feb10 tx=0x7f0974018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.140+0000 7f08617fa640 1 -- 172.21.15.165:0/3754399772 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0974014450 con 0x55fb22318b00 2024-09-22T08:11:26.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.140+0000 7f08617fa640 1 -- 172.21.15.165:0/3754399772 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0974014610 con 0x55fb22318b00 2024-09-22T08:11:26.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.140+0000 7f08617fa640 1 -- 172.21.15.165:0/3754399772 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0974014930 con 0x55fb22318b00 2024-09-22T08:11:26.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.140+0000 7f0980610800 1 -- 172.21.15.165:0/3754399772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb22319d90 con 0x55fb22318b00 2024-09-22T08:11:26.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.140+0000 7f0980610800 1 -- 172.21.15.165:0/3754399772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2231a330 con 0x55fb22318b00 2024-09-22T08:11:26.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.141+0000 7f08617fa640 1 -- 172.21.15.165:0/3754399772 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0974011040 con 0x55fb22318b00 2024-09-22T08:11:26.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.141+0000 7f08617fa640 1 --2- 172.21.15.165:0/3754399772 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f085403d000 0x7f085403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.141+0000 7f08617fa640 1 -- 172.21.15.165:0/3754399772 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f097401e070 con 0x55fb22318b00 2024-09-22T08:11:26.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.141+0000 7f097bccb640 1 --2- 172.21.15.165:0/3754399772 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f085403d000 0x7f085403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.142+0000 7f0980610800 1 Processor -- start 2024-09-22T08:11:26.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.142+0000 7f097bccb640 1 --2- 172.21.15.165:0/3754399772 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f085403d000 0x7f085403f4c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f096c052a80 tx=0x7f096c052bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.142+0000 7f0980610800 1 -- start start 2024-09-22T08:11:26.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.142+0000 7f0980610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb22325940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.142+0000 7f0980610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fb222f6c50 con 0x55fb22325540 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.142+0000 7f097c4cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb22325940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.142+0000 7f097c4cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb22325940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58044/0 (socket says 172.21.15.165:58044) 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.142+0000 7f097c4cc640 1 -- 172.21.15.165:0/2371258577 learned_addr learned my addr 172.21.15.165:0/2371258577 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.142+0000 7f097c4cc640 1 -- 172.21.15.165:0/2371258577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb22325f30 con 0x55fb22325540 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f097c4cc640 1 --2- 172.21.15.165:0/2371258577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb22325940 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0974054740 tx=0x7f097402b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b93b28c8d21d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f085affd640 1 -- 172.21.15.165:0/2371258577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f097404b070 con 0x55fb22325540 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f085affd640 1 -- 172.21.15.165:0/2371258577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0974051070 con 0x55fb22325540 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f085affd640 1 -- 172.21.15.165:0/2371258577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0974011da0 con 0x55fb22325540 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f0980610800 1 -- 172.21.15.165:0/2371258577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 msgr2=0x55fb22325940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f0980610800 1 --2- 172.21.15.165:0/2371258577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb22325940 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0974054740 tx=0x7f097402b4c0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f0980610800 1 -- 172.21.15.165:0/2371258577 shutdown_connections 2024-09-22T08:11:26.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f0980610800 1 --2- 172.21.15.165:0/2371258577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb22325940 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f0980610800 1 -- 172.21.15.165:0/2371258577 >> 172.21.15.165:0/2371258577 conn(0x55fb22321940 msgr2=0x55fb2231fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f0980610800 1 -- 172.21.15.165:0/2371258577 shutdown_connections 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f0980610800 1 -- 172.21.15.165:0/2371258577 wait complete. 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.143+0000 7f0980610800 1 Processor -- start 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f0980610800 1 -- start start 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f0980610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb2232cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f0980610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fb22326550 con 0x55fb22325540 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f097c4cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb2232cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f097c4cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb2232cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58048/0 (socket says 172.21.15.165:58048) 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 learned_addr learned my addr 172.21.15.165:0/1225376429 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2232d140 con 0x55fb22325540 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f097c4cc640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb2232cbe0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0974049040 tx=0x7f09740546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f08597fa640 1 -- 172.21.15.165:0/1225376429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f097404b040 con 0x55fb22325540 2024-09-22T08:11:26.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f08597fa640 1 -- 172.21.15.165:0/1225376429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0974011330 con 0x55fb22325540 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb2232d3d0 con 0x55fb22325540 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f08597fa640 1 -- 172.21.15.165:0/1225376429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0974054a60 con 0x55fb22325540 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.144+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2232dd50 con 0x55fb22325540 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.145+0000 7f08597fa640 1 -- 172.21.15.165:0/1225376429 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0974054c00 con 0x55fb22325540 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.145+0000 7f08597fa640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f084403d000 0x7f084403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.145+0000 7f08597fa640 1 -- 172.21.15.165:0/1225376429 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f097400e040 con 0x55fb22325540 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.145+0000 7f097bccb640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f084403d000 0x7f084403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.146+0000 7f097bccb640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f084403d000 0x7f084403f4c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f096c0823f0 tx=0x7f096c08b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.146+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.146+0000 7f0980610800 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22338680 0x55fb2233ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.146+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb2233b290 con 0x55fb22338680 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.146+0000 7f097b4ca640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22338680 0x55fb2233ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.146+0000 7f097b4ca640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22338680 0x55fb2233ab40 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0964009050 con 0x55fb22338680 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 20 realm 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb223379d0 con 0x55fb22338680 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0964009050 con 0x55fb22338680 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb2233bd80 con 0x55fb22338680 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0964009050 con 0x55fb22338680 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb2233c650 con 0x55fb22338680 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0964009050 con 0x55fb22338680 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb2233d070 0x55fb2233f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb2233fba0 con 0x55fb2233d070 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.147+0000 7f097c4cc640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb2233d070 0x55fb2233f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.148+0000 7f097c4cc640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb2233d070 0x55fb2233f460 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.148+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.148+0000 7f0980610800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.148+0000 7f0980610800 20 searching for the correct realm 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.148+0000 7f0980610800 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fb22341b50 0x55fb22344010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.148+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22341b50 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.148+0000 7f097bccb640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fb22341b50 0x55fb22344010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.148+0000 7f097bccb640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fb22341b50 0x55fb22344010 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.149+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.149+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb2233d070 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.149+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.149+0000 7f097c4cc640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0974037070 0x7f0974037450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.149+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x7f0974037070 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.149+0000 7f097b4ca640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0974037070 0x7f0974037450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.150+0000 7f097b4ca640 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0974037070 0x7f0974037450 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.150+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964009050 con 0x7f0974037070 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.150+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22338680 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.150+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964009050 con 0x55fb22338680 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.150+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22338680 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.150+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.150+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x7f0974037070 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.151+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.151+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb2233d070 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.151+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.151+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb2233d070 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.151+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.151+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22341b50 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.151+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.151+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22338680 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.152+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.152+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x7f0974037070 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.152+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.152+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22338680 2024-09-22T08:11:26.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.152+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.152+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb2233d070 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.152+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.152+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22341b50 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.153+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.153+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22341b50 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.153+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.153+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x7f0974037070 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.153+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.153+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22341b50 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.153+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.153+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22341b50 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.154+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.154+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22338680 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.154+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.154+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22338680 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.154+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.154+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x7f0974037070 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.154+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.154+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22341b50 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.155+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.155+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb2233d070 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.155+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.155+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22338680 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.155+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.155+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x7f0974037070 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.155+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.155+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22341b50 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.156+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.156+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x7f0974037070 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.156+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.156+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb2233d070 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.156+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.156+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22341b50 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.156+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.156+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x7f0974037070 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb22338680 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344690 con 0x55fb2233d070 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb22340560 con 0x55fb22338680 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.157+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb22340e00 con 0x55fb22338680 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344b10 con 0x55fb22338680 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 20 zone default found 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 4 Realm: () 2024-09-22T08:11:26.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 20 zonegroup default 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb22344f10 con 0x7f0974037070 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.158+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb22346d40 con 0x55fb22341b50 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.159+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.159+0000 7f0980610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.159+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.159+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb223471c0 con 0x55fb22341b50 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.159+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.159+0000 7f0980610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.159+0000 7f0980610800 20 started sync module instance, tier type = 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.159+0000 7f0980610800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.159+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb223461e0 con 0x55fb2233d070 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.160+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.160+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94537099011536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb22347ad0 con 0x55fb2233d070 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.160+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb22348320 con 0x55fb22338680 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.161+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94537099011536] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.161+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.161+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94537099015712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb22347f70 con 0x55fb22338680 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.161+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb22348a90 con 0x55fb22341b50 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.162+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94537099015712] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.162+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.162+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94537099019616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb22348e80 con 0x55fb22341b50 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.162+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb223498c0 con 0x55fb2233d070 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.163+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94537099019616] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.163+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.163+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94537099023248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb22349880 con 0x55fb2233d070 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.164+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb2234a350 con 0x55fb22338680 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.164+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94537099023248] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.165+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.165+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94537099026048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb2234a350 con 0x55fb22338680 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.165+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb2234ada0 con 0x7f0974037070 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.166+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.166+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94537099028656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb2234acd0 con 0x7f0974037070 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.166+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94537099026048] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.166+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb2234bb20 con 0x7f0974037070 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.167+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94537099028656] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.167+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.167+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94537099030928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb2234acd0 con 0x7f0974037070 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.167+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb2234acd0 con 0x7f0974037070 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.168+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94537099030928] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.168+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.168+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94537099032176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb2234c140 con 0x7f0974037070 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.168+0000 7f0980610800 20 add_watcher() i=0 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.168+0000 7f0980610800 20 add_watcher() i=1 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.168+0000 7f0980610800 20 add_watcher() i=2 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.168+0000 7f0980610800 20 add_watcher() i=3 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.168+0000 7f0980610800 20 add_watcher() i=4 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.168+0000 7f0980610800 20 add_watcher() i=5 2024-09-22T08:11:26.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.168+0000 7f0980610800 20 add_watcher() i=6 2024-09-22T08:11:26.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.169+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94537099032176] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.169+0000 7f0980610800 20 add_watcher() i=7 2024-09-22T08:11:26.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.169+0000 7f0980610800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:26.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.169+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb2234f660 con 0x55fb22338680 2024-09-22T08:11:26.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.169+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.169+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94537099034672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb2234c9f0 con 0x55fb22338680 2024-09-22T08:11:26.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.170+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94537099034672] v34'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f08327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f0980610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:26.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f0980610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:26.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f0980610800 5 note: GC not initialized 2024-09-22T08:11:26.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f08317e2640 20 reqs_thread_entry: start 2024-09-22T08:11:26.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f0980610800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:26.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f0980610800 20 Filter name: none 2024-09-22T08:11:26.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f082a7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:26.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f0980610800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.171+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb22382fc0 con 0x55fb2233d070 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 : miss 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.4 8:25e4b931:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb22384bb0 con 0x55fb2233d070 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(63 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 info.flags=0x17 2024-09-22T08:11:26.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 to cache LRU end 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 20 get_obj_state: octx=0x7f097402bd90 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55fb22386d78 s->prefetch_data=0 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.172+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 3.8s0 3:1317d0d6:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fb223890b0 con 0x55fb22341b50 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.173+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=858b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 304+0+898 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.173+0000 7f0980610800 10 manifest: total_size = 5 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.173+0000 7f0980610800 20 get_obj_state: setting s->obj_tag to _yrfXKBR8tc2N7MCLfWXPEbUpyUeCm0S 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.174+0000 7f08327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.174+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94537099034672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb22388a80 con 0x55fb22338680 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.175+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94537099034672] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.175+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94537099011536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb223890b0 con 0x55fb2233d070 2024-09-22T08:11:26.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.176+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94537099011536] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.176+0000 7f0980610800 20 remove_watcher() i=0 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.176+0000 7f0980610800 2 removed watcher, disabling cache 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.176+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94537099015712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb223890b0 con 0x55fb22338680 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.177+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94537099015712] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.177+0000 7f0980610800 20 remove_watcher() i=1 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.177+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94537099019616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb223890b0 con 0x55fb22341b50 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.178+0000 7f097bccb640 1 -- 172.21.15.165:0/1225376429 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94537099019616] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f096c079020 con 0x55fb22341b50 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.178+0000 7f0980610800 20 remove_watcher() i=2 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.178+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94537099023248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb223890b0 con 0x55fb2233d070 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.179+0000 7f097c4cc640 1 -- 172.21.15.165:0/1225376429 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94537099023248] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f097402a070 con 0x55fb2233d070 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.179+0000 7f0980610800 20 remove_watcher() i=3 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.179+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94537099026048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb223890b0 con 0x55fb22338680 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.180+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94537099026048] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x55fb22338680 2024-09-22T08:11:26.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.180+0000 7f0980610800 20 remove_watcher() i=4 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.180+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94537099028656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb223890b0 con 0x7f0974037070 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.181+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94537099028656] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.181+0000 7f0980610800 20 remove_watcher() i=5 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.181+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94537099030928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb223890b0 con 0x7f0974037070 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.182+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94537099030928] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.182+0000 7f0980610800 20 remove_watcher() i=6 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.182+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94537099032176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fb223890b0 con 0x7f0974037070 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94537099032176] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0964029040 con 0x7f0974037070 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 20 remove_watcher() i=7 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0974037070 msgr2=0x7f0974037450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0974037070 0x7f0974037450 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22338680 msgr2=0x55fb2233ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22338680 0x55fb2233ab40 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb2233d070 msgr2=0x55fb2233f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb2233d070 0x55fb2233f460 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fb22341b50 msgr2=0x55fb22344010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fb22341b50 0x55fb22344010 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f084403d000 msgr2=0x7f084403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f084403d000 0x7f084403f4c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f096c0823f0 tx=0x7f096c08b000 comp rx=0 tx=0).stop 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 msgr2=0x55fb2232cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f097b4ca640 1 -- 172.21.15.165:0/1225376429 reap_dead start 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb2232cbe0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0974049040 tx=0x7f09740546a0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 shutdown_connections 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 --2- 172.21.15.165:0/1225376429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22325540 0x55fb2232cbe0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 >> 172.21.15.165:0/1225376429 conn(0x55fb22321940 msgr2=0x55fb2231fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 shutdown_connections 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.183+0000 7f0980610800 1 -- 172.21.15.165:0/1225376429 wait complete. 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/3754399772 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f085403d000 msgr2=0x7f085403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/3754399772 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f085403d000 0x7f085403f4c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f096c052a80 tx=0x7f096c052bc0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/3754399772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22318b00 msgr2=0x55fb22318f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/3754399772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22318b00 0x55fb22318f20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x55fb222feb10 tx=0x7f0974018830 comp rx=0 tx=0).stop 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/3754399772 shutdown_connections 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/3754399772 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f085403d000 0x7f085403f4c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/3754399772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22318b00 0x55fb22318f20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/3754399772 >> 172.21.15.165:0/3754399772 conn(0x55fb2230ceb0 msgr2=0x55fb2230d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/3754399772 shutdown_connections 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/3754399772 wait complete. 2024-09-22T08:11:26.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22209a20 msgr2=0x55fb223052d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22209a20 0x55fb223052d0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb22307600 msgr2=0x55fb22309aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb22307600 0x55fb22309aa0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f086403cfb0 msgr2=0x7f086403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f086403cfb0 0x7f086403f470 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0964001d70 tx=0x7f09640012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 msgr2=0x55fb222fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222fdc80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f096c053d60 tx=0x7f096c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 shutdown_connections 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fb22307600 0x55fb22309aa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fb22209a20 0x55fb223052d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f086403cfb0 0x7f086403f470 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 --2- 172.21.15.165:0/2691617321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb22177cd0 0x55fb222fdc80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 >> 172.21.15.165:0/2691617321 conn(0x55fb221febb0 msgr2=0x55fb222f0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 shutdown_connections 2024-09-22T08:11:26.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.184+0000 7f0980610800 1 -- 172.21.15.165:0/2691617321 wait complete. 2024-09-22T08:11:26.194 INFO:teuthology.orchestra.run.smithi165.stdout:fooFoofooFooFULL_CONTROL 2024-09-22T08:11:26.195 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-22T08:11:26.197 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-22T08:11:26.202 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:26.202 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-22T08:11:26.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-22T08:11:26.203 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-22T08:11:26.247 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:26.247 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:26.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.247+0000 7f6271e0f800 1 Processor -- start 2024-09-22T08:11:26.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.247+0000 7f6271e0f800 1 -- start start 2024-09-22T08:11:26.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.248+0000 7f6271e0f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559febe45b90 0x559febe47f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.248+0000 7f6271e0f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559febccca20 con 0x559febe42080 2024-09-22T08:11:26.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.248+0000 7f6271e0f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559febccc7d0 con 0x559febe45b90 2024-09-22T08:11:26.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.248+0000 7f626f0ff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559febe45b90 0x559febe47f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.248+0000 7f626f900640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559febe42080 0x559febe44470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:36130/0 (socket says 172.21.15.165:36130) 2024-09-22T08:11:26.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.248+0000 7f626f900640 1 -- 172.21.15.165:0/3543611824 learned_addr learned my addr 172.21.15.165:0/3543611824 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:26.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.248+0000 7f626f0ff640 1 -- 172.21.15.165:0/3543611824 >> v1:172.21.15.53:6789/0 conn(0x559febe42080 legacy=0x559febe44470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.248+0000 7f626f0ff640 1 -- 172.21.15.165:0/3543611824 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559febe49560 con 0x559febe45b90 2024-09-22T08:11:26.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.250+0000 7f626f0ff640 1 --2- 172.21.15.165:0/3543611824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe45b90 0x559febe47f80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f626400a470 tx=0x7f6264045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576d31bda605fb33 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.250+0000 7f626e8fe640 1 -- 172.21.15.165:0/3543611824 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6264053570 con 0x559febe45b90 2024-09-22T08:11:26.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.250+0000 7f626e8fe640 1 -- 172.21.15.165:0/3543611824 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6264058070 con 0x559febe45b90 2024-09-22T08:11:26.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.250+0000 7f626e8fe640 1 -- 172.21.15.165:0/3543611824 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6264053880 con 0x559febe45b90 2024-09-22T08:11:26.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.251+0000 7f6271e0f800 1 -- 172.21.15.165:0/3543611824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe45b90 msgr2=0x559febe47f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.251+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3543611824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe45b90 0x559febe47f80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f626400a470 tx=0x7f6264045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:26.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.251+0000 7f6271e0f800 1 -- 172.21.15.165:0/3543611824 shutdown_connections 2024-09-22T08:11:26.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.251+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3543611824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe45b90 0x559febe47f80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.251+0000 7f6271e0f800 1 -- 172.21.15.165:0/3543611824 >> 172.21.15.165:0/3543611824 conn(0x559febe3bbe0 msgr2=0x559febe3e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.251+0000 7f6271e0f800 1 -- 172.21.15.165:0/3543611824 shutdown_connections 2024-09-22T08:11:26.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.251+0000 7f6271e0f800 1 -- 172.21.15.165:0/3543611824 wait complete. 2024-09-22T08:11:26.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.264+0000 7f6271e0f800 1 Processor -- start 2024-09-22T08:11:26.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.265+0000 7f6271e0f800 1 -- start start 2024-09-22T08:11:26.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.265+0000 7f6271e0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf31060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.265+0000 7f6271e0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559febcd9dd0 con 0x559febe42080 2024-09-22T08:11:26.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.265+0000 7f626f900640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf31060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.265+0000 7f626f900640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf31060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58062/0 (socket says 172.21.15.165:58062) 2024-09-22T08:11:26.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.265+0000 7f626f900640 1 -- 172.21.15.165:0/4263244861 learned_addr learned my addr 172.21.15.165:0/4263244861 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.265+0000 7f626f900640 1 -- 172.21.15.165:0/4263244861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559febf31650 con 0x559febe42080 2024-09-22T08:11:26.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f626f900640 1 --2- 172.21.15.165:0/4263244861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf31060 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6260001df0 tx=0x7f626000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd79338b6a6cac14 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f615de0b640 1 -- 172.21.15.165:0/4263244861 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6260012020 con 0x559febe42080 2024-09-22T08:11:26.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f615de0b640 1 -- 172.21.15.165:0/4263244861 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626000e470 con 0x559febe42080 2024-09-22T08:11:26.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f615de0b640 1 -- 172.21.15.165:0/4263244861 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626000e7f0 con 0x559febe42080 2024-09-22T08:11:26.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f6271e0f800 1 -- 172.21.15.165:0/4263244861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 msgr2=0x559febf31060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f6271e0f800 1 --2- 172.21.15.165:0/4263244861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf31060 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6260001df0 tx=0x7f626000b6c0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f6271e0f800 1 -- 172.21.15.165:0/4263244861 shutdown_connections 2024-09-22T08:11:26.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f6271e0f800 1 --2- 172.21.15.165:0/4263244861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf31060 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f6271e0f800 1 -- 172.21.15.165:0/4263244861 >> 172.21.15.165:0/4263244861 conn(0x559febe3bbe0 msgr2=0x559febf2c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f6271e0f800 1 -- 172.21.15.165:0/4263244861 shutdown_connections 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.266+0000 7f6271e0f800 1 -- 172.21.15.165:0/4263244861 wait complete. 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.267+0000 7f6271e0f800 1 Processor -- start 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.267+0000 7f6271e0f800 1 -- start start 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.267+0000 7f6271e0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf38b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.267+0000 7f6271e0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559febe48850 con 0x559febe42080 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.267+0000 7f626f900640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf38b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.267+0000 7f626f900640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf38b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58068/0 (socket says 172.21.15.165:58068) 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.267+0000 7f626f900640 1 -- 172.21.15.165:0/1653140126 learned_addr learned my addr 172.21.15.165:0/1653140126 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.267+0000 7f626f900640 1 -- 172.21.15.165:0/1653140126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559febf390d0 con 0x559febe42080 2024-09-22T08:11:26.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.268+0000 7f626f900640 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf38b70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x559febf31ff0 tx=0x7f6260000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.268+0000 7f6157fff640 1 -- 172.21.15.165:0/1653140126 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6260012030 con 0x559febe42080 2024-09-22T08:11:26.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.268+0000 7f6157fff640 1 -- 172.21.15.165:0/1653140126 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626001a6d0 con 0x559febe42080 2024-09-22T08:11:26.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.268+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559febf39360 con 0x559febe42080 2024-09-22T08:11:26.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.268+0000 7f6157fff640 1 -- 172.21.15.165:0/1653140126 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626001a9d0 con 0x559febe42080 2024-09-22T08:11:26.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.268+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559febf39d60 con 0x559febe42080 2024-09-22T08:11:26.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.269+0000 7f6157fff640 1 -- 172.21.15.165:0/1653140126 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6260015020 con 0x559febe42080 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.269+0000 7f6157fff640 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f615803cfb0 0x7f615803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.269+0000 7f6157fff640 1 -- 172.21.15.165:0/1653140126 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6260020030 con 0x559febe42080 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.269+0000 7f626f0ff640 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f615803cfb0 0x7f615803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.269+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febe45b90 0x559febf401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.269+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf40700 con 0x559febe45b90 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.269+0000 7f6270101640 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febe45b90 0x559febf401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.270+0000 7f626f0ff640 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f615803cfb0 0x7f615803f470 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6264057000 tx=0x7f6264052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.270+0000 7f6270101640 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febe45b90 0x559febf401c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.270+0000 7f6270101640 1 -- 172.21.15.165:0/1653140126 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f626800a4d0 con 0x559febe45b90 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.270+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf40aa0 con 0x559febe45b90 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.270+0000 7f6270101640 1 -- 172.21.15.165:0/1653140126 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f626800a4d0 con 0x559febe45b90 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.270+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf425e0 0x559febf44a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.270+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf451e0 con 0x559febf425e0 2024-09-22T08:11:26.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.270+0000 7f626f900640 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf425e0 0x559febf44a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.271+0000 7f626f900640 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf425e0 0x559febf44a50 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.271+0000 7f626f900640 1 -- 172.21.15.165:0/1653140126 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f626001ad50 con 0x559febf425e0 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.271+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf412f0 con 0x559febe45b90 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.271+0000 7f6270101640 1 -- 172.21.15.165:0/1653140126 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f626800a4d0 con 0x559febe45b90 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.271+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf41710 con 0x559febe45b90 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.271+0000 7f6270101640 1 -- 172.21.15.165:0/1653140126 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f626800a4d0 con 0x559febe45b90 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.272+0000 7f6271e0f800 1 Processor -- start 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.272+0000 7f6271e0f800 1 -- start start 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.272+0000 7f6271e0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febf53b70 0x559febf53f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.272+0000 7f6271e0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559febd38d50 con 0x559febf53b70 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.272+0000 7f6270101640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febf53b70 0x559febf53f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.272+0000 7f6270101640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febf53b70 0x559febf53f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58082/0 (socket says 172.21.15.165:58082) 2024-09-22T08:11:26.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.272+0000 7f6270101640 1 -- 172.21.15.165:0/1691405184 learned_addr learned my addr 172.21.15.165:0/1691405184 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.273+0000 7f6270101640 1 -- 172.21.15.165:0/1691405184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559febf545d0 con 0x559febf53b70 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.273+0000 7f6270101640 1 --2- 172.21.15.165:0/1691405184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febf53b70 0x559febf53f90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x559febf39f30 tx=0x7f6268018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.273+0000 7f61557fa640 1 -- 172.21.15.165:0/1691405184 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6268014450 con 0x559febf53b70 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.273+0000 7f61557fa640 1 -- 172.21.15.165:0/1691405184 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6268014610 con 0x559febf53b70 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.273+0000 7f6271e0f800 1 -- 172.21.15.165:0/1691405184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559febf54e00 con 0x559febf53b70 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.273+0000 7f61557fa640 1 -- 172.21.15.165:0/1691405184 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6268014930 con 0x559febf53b70 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.273+0000 7f6271e0f800 1 -- 172.21.15.165:0/1691405184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559febf553a0 con 0x559febf53b70 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.274+0000 7f61557fa640 1 -- 172.21.15.165:0/1691405184 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6268011040 con 0x559febf53b70 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.274+0000 7f61557fa640 1 --2- 172.21.15.165:0/1691405184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f614803d000 0x7f614803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.274+0000 7f61557fa640 1 -- 172.21.15.165:0/1691405184 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f626801e070 con 0x559febf53b70 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.274+0000 7f626f900640 1 --2- 172.21.15.165:0/1691405184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f614803d000 0x7f614803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.274+0000 7f6271e0f800 1 Processor -- start 2024-09-22T08:11:26.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.274+0000 7f6271e0f800 1 -- start start 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.274+0000 7f626f900640 1 --2- 172.21.15.165:0/1691405184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f614803d000 0x7f614803f4c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6260052a50 tx=0x7f62600011d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.275+0000 7f6271e0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febe40480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.275+0000 7f6271e0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559febf31a80 con 0x559febe40080 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.275+0000 7f6270101640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febe40480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.275+0000 7f6270101640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febe40480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58084/0 (socket says 172.21.15.165:58084) 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.275+0000 7f6270101640 1 -- 172.21.15.165:0/3237243158 learned_addr learned my addr 172.21.15.165:0/3237243158 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.275+0000 7f6270101640 1 -- 172.21.15.165:0/3237243158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559febe40a70 con 0x559febe40080 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.275+0000 7f6270101640 1 --2- 172.21.15.165:0/3237243158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febe40480 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6268054740 tx=0x7f626802b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e276a1fe2b3387da server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.275+0000 7f614effd640 1 -- 172.21.15.165:0/3237243158 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626804b070 con 0x559febe40080 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.275+0000 7f614effd640 1 -- 172.21.15.165:0/3237243158 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6268051070 con 0x559febe40080 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.275+0000 7f614effd640 1 -- 172.21.15.165:0/3237243158 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6268056070 con 0x559febe40080 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 -- 172.21.15.165:0/3237243158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 msgr2=0x559febe40480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3237243158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febe40480 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6268054740 tx=0x7f626802b4c0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 -- 172.21.15.165:0/3237243158 shutdown_connections 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3237243158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febe40480 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 -- 172.21.15.165:0/3237243158 >> 172.21.15.165:0/3237243158 conn(0x559febf5c9d0 msgr2=0x559febf5ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 -- 172.21.15.165:0/3237243158 shutdown_connections 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 -- 172.21.15.165:0/3237243158 wait complete. 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 Processor -- start 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 -- start start 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febf69de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6271e0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559febe410e0 con 0x559febe40080 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6270101640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febf69de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6270101640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febf69de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58096/0 (socket says 172.21.15.165:58096) 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.276+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 learned_addr learned my addr 172.21.15.165:0/3010418959 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.277+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559febf6a340 con 0x559febe40080 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.277+0000 7f6270101640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febf69de0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6268049040 tx=0x7f62680546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.277+0000 7f614d7fa640 1 -- 172.21.15.165:0/3010418959 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f626804b040 con 0x559febe40080 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.277+0000 7f614d7fa640 1 -- 172.21.15.165:0/3010418959 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62680167c0 con 0x559febe40080 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.277+0000 7f614d7fa640 1 -- 172.21.15.165:0/3010418959 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6268011330 con 0x559febe40080 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.277+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559febf6a5d0 con 0x559febe40080 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.277+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559febf6af50 con 0x559febe40080 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.278+0000 7f614d7fa640 1 -- 172.21.15.165:0/3010418959 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6268054850 con 0x559febe40080 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.278+0000 7f614d7fa640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f613803cfb0 0x7f613803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.278+0000 7f614d7fa640 1 -- 172.21.15.165:0/3010418959 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f626800e040 con 0x559febe40080 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.278+0000 7f626f900640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f613803cfb0 0x7f613803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.278+0000 7f626f900640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f613803cfb0 0x7f613803f470 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6260052e10 tx=0x7f6260051000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febf75930 0x559febf77df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf78540 con 0x559febf75930 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f626f0ff640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febf75930 0x559febf77df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f626f0ff640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febf75930 0x559febf77df0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f6271e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f6271e0f800 20 realm 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf78970 con 0x559febf75930 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.279+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf79240 con 0x559febf75930 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf795e0 con 0x559febf75930 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf7a340 0x559febf7c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf7cd40 con 0x559febf7a340 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6270101640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf7a340 0x559febf7c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.280+0000 7f6270101640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf7a340 0x559febf7c730 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.281+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.281+0000 7f6271e0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.281+0000 7f6271e0f800 20 searching for the correct realm 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.281+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559febf7ecf0 0x559febf811b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.281+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7ecf0 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.281+0000 7f626f900640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559febf7ecf0 0x559febf811b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.281+0000 7f626f900640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559febf7ecf0 0x559febf811b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.281+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.281+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7a340 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.282+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.282+0000 7f6270101640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6268014070 0x7f626803f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.282+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x7f6268014070 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.282+0000 7f626f0ff640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6268014070 0x7f626803f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.282+0000 7f626f0ff640 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6268014070 0x7f626803f850 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.283+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.283+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf75930 2024-09-22T08:11:26.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.283+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.283+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf75930 2024-09-22T08:11:26.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.283+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.283+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x7f6268014070 2024-09-22T08:11:26.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.283+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.283+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7a340 2024-09-22T08:11:26.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.284+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.284+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7a340 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.284+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.284+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7ecf0 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.284+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.284+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf75930 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.284+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.284+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x7f6268014070 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.285+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.285+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf75930 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.285+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.285+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7a340 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.285+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.285+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7ecf0 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.285+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.285+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7ecf0 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.286+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.286+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x7f6268014070 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.286+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.286+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7ecf0 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.286+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.286+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7ecf0 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.286+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.286+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf75930 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.286+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.286+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf75930 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.287+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.287+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x7f6268014070 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.287+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.287+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7ecf0 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.287+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.287+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7a340 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.287+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.287+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf75930 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.288+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.288+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x7f6268014070 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.288+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.288+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7ecf0 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.288+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.288+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x7f6268014070 2024-09-22T08:11:26.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.288+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.288+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7a340 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.289+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.289+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7ecf0 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.289+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.289+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x7f6268014070 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.289+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.289+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf75930 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.289+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.289+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559febf81830 con 0x559febf7a340 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:26.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf7d700 con 0x559febf75930 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf7dfa0 con 0x559febf75930 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf7d340 con 0x559febf75930 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 zone default found 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 4 Realm: () 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 zonegroup default 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.290+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf82160 con 0x7f6268014070 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f6271e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf83e60 con 0x559febf7ecf0 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f6271e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf84310 con 0x559febf7ecf0 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f6271e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f6271e0f800 20 started sync module instance, tier type = 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f6271e0f800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.291+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf82c30 con 0x559febf7a340 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.292+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.292+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94145347072032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf82890 con 0x559febf7a340 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.292+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf85240 con 0x559febf75930 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.293+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94145347072032] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.294+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.294+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94145347078000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf85240 con 0x559febf75930 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.294+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf85cf0 con 0x559febf7ecf0 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.295+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94145347078000] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.295+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.295+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94145347079568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf851b0 con 0x559febf7ecf0 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.295+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf86bb0 con 0x559febf7a340 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.296+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94145347079568] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.296+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.296+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94145347086080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf86b20 con 0x559febf7a340 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.296+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf87a70 con 0x559febf75930 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.297+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.297+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94145347089856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf87e90 con 0x559febf75930 2024-09-22T08:11:26.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.297+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf88930 con 0x7f6268014070 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.297+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94145347086080] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.298+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94145347089856] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.298+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.298+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94145347093504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf879e0 con 0x7f6268014070 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.298+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf891d0 con 0x7f6268014070 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.299+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94145347093504] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.299+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.299+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94145347088288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf879e0 con 0x7f6268014070 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.299+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf897a0 con 0x7f6268014070 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.300+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.300+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94145347097328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf89710 con 0x7f6268014070 2024-09-22T08:11:26.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.300+0000 7f6271e0f800 20 add_watcher() i=0 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.300+0000 7f6271e0f800 20 add_watcher() i=1 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.300+0000 7f6271e0f800 20 add_watcher() i=2 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.300+0000 7f6271e0f800 20 add_watcher() i=3 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.300+0000 7f6271e0f800 20 add_watcher() i=4 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.300+0000 7f6271e0f800 20 add_watcher() i=5 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.300+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94145347088288] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.300+0000 7f6271e0f800 20 add_watcher() i=6 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.301+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94145347097328] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.301+0000 7f6271e0f800 20 add_watcher() i=7 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.301+0000 7f6271e0f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.301+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febf88cd0 con 0x559febf75930 2024-09-22T08:11:26.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.301+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.301+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94145347099456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf88cd0 con 0x559febf75930 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.302+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94145347099456] v34'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.302+0000 7f6125fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.302+0000 7f6271e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.302+0000 7f6271e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 5 note: GC not initialized 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6124fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 20 Filter name: none 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f609e7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febfc0490 con 0x559febf7a340 2024-09-22T08:11:26.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 : miss 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.303+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.4 8:25e4b931:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febfc2050 con 0x559febf7a340 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(63 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6271e0f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6271e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 info.flags=0x17 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6271e0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 to cache LRU end 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6271e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6271e0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:26.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6271e0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 2024-09-22T08:11:26.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6271e0f800 20 get_obj_state: octx=0x7f626803ff40 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x559febfc4218 s->prefetch_data=0 2024-09-22T08:11:26.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 3.8s0 3:1317d0d6:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559febfc64f0 con 0x559febf7ecf0 2024-09-22T08:11:26.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=920b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+960 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6271e0f800 10 manifest: total_size = 5 2024-09-22T08:11:26.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.304+0000 7f6271e0f800 20 get_obj_state: setting s->obj_tag to _FfvZrvxC_LVS-yYCQp73QI6G80v3GKt 2024-09-22T08:11:26.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.305+0000 7f6125fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.305+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94145347099456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febfc5dd0 con 0x559febf75930 2024-09-22T08:11:26.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.306+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94145347099456] v34'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.306+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94145347072032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febfc5da0 con 0x559febf7a340 2024-09-22T08:11:26.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.307+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94145347072032] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.307+0000 7f6271e0f800 20 remove_watcher() i=0 2024-09-22T08:11:26.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.307+0000 7f6271e0f800 2 removed watcher, disabling cache 2024-09-22T08:11:26.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.307+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94145347078000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febfc5da0 con 0x559febf75930 2024-09-22T08:11:26.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.308+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94145347078000] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.308+0000 7f6271e0f800 20 remove_watcher() i=1 2024-09-22T08:11:26.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.308+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94145347079568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf89b40 con 0x559febf7ecf0 2024-09-22T08:11:26.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.309+0000 7f626f900640 1 -- 172.21.15.165:0/3010418959 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94145347079568] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626001ad50 con 0x559febf7ecf0 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.309+0000 7f6271e0f800 20 remove_watcher() i=2 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.309+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94145347086080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf83020 con 0x559febf7a340 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.310+0000 7f6270101640 1 -- 172.21.15.165:0/3010418959 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94145347086080] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f626802a070 con 0x559febf7a340 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.310+0000 7f6271e0f800 20 remove_watcher() i=3 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.310+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94145347089856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf84770 con 0x559febf75930 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.312+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94145347089856] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x559febf75930 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.312+0000 7f6271e0f800 20 remove_watcher() i=4 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.312+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94145347093504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf84d90 con 0x7f6268014070 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.313+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94145347093504] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.313+0000 7f6271e0f800 20 remove_watcher() i=5 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.313+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94145347088288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf86700 con 0x7f6268014070 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.314+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94145347088288] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.314+0000 7f6271e0f800 20 remove_watcher() i=6 2024-09-22T08:11:26.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.314+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94145347097328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559febf83020 con 0x7f6268014070 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.314+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94145347097328] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6264051070 con 0x7f6268014070 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.314+0000 7f6271e0f800 20 remove_watcher() i=7 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6268014070 msgr2=0x7f626803f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6268014070 0x7f626803f850 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febf75930 msgr2=0x559febf77df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febf75930 0x559febf77df0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf7a340 msgr2=0x559febf7c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf7a340 0x559febf7c730 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559febf7ecf0 msgr2=0x559febf811b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x559febf7ecf0 0x559febf811b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f613803cfb0 msgr2=0x7f613803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f613803cfb0 0x7f613803f470 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6260052e10 tx=0x7f6260051000 comp rx=0 tx=0).stop 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 msgr2=0x559febf69de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f626f0ff640 1 -- 172.21.15.165:0/3010418959 reap_dead start 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febf69de0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6268049040 tx=0x7f62680546a0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 shutdown_connections 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/3010418959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe40080 0x559febf69de0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 >> 172.21.15.165:0/3010418959 conn(0x559febf5c9d0 msgr2=0x559febf5abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 shutdown_connections 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/3010418959 wait complete. 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/1691405184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f614803d000 msgr2=0x7f614803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1691405184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f614803d000 0x7f614803f4c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6260052a50 tx=0x7f62600011d0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/1691405184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febf53b70 msgr2=0x559febf53f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1691405184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febf53b70 0x559febf53f90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x559febf39f30 tx=0x7f6268018830 comp rx=0 tx=0).stop 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/1691405184 shutdown_connections 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1691405184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f614803d000 0x7f614803f4c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1691405184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febf53b70 0x559febf53f90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/1691405184 >> 172.21.15.165:0/1691405184 conn(0x559febf47f20 msgr2=0x559febf48300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/1691405184 shutdown_connections 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.315+0000 7f6271e0f800 1 -- 172.21.15.165:0/1691405184 wait complete. 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febe45b90 msgr2=0x559febf401c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febe45b90 0x559febf401c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf425e0 msgr2=0x559febf44a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf425e0 0x559febf44a50 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f615803cfb0 msgr2=0x7f615803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f615803cfb0 0x7f615803f470 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6264057000 tx=0x7f6264052000 comp rx=0 tx=0).stop 2024-09-22T08:11:26.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 msgr2=0x559febf38b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf38b70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x559febf31ff0 tx=0x7f6260000bc0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 shutdown_connections 2024-09-22T08:11:26.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x559febf425e0 0x559febf44a50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x559febe45b90 0x559febf401c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f615803cfb0 0x7f615803f470 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 --2- 172.21.15.165:0/1653140126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559febe42080 0x559febf38b70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 >> 172.21.15.165:0/1653140126 conn(0x559febe3bbe0 msgr2=0x559febf32550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 shutdown_connections 2024-09-22T08:11:26.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.316+0000 7f6271e0f800 1 -- 172.21.15.165:0/1653140126 wait complete. 2024-09-22T08:11:26.330 INFO:teuthology.orchestra.run.smithi165.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-22T08:11:26.330 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-22T08:11:26.332 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-22T08:11:26.347 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:26.408 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-22T08:11:26.408 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-22T08:11:26.408 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-22T08:11:26.408 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-22T08:11:26.409 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-22T08:11:26.409 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-22T08:11:26.409 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-22T08:11:26.454 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:26.455 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:26.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.454+0000 7f2d34816800 1 Processor -- start 2024-09-22T08:11:26.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.455+0000 7f2d34816800 1 -- start start 2024-09-22T08:11:26.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.455+0000 7f2d34816800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e45d8bbbf0 0x55e45d8c1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.455+0000 7f2d34816800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e45d746a20 con 0x55e45d8ba7e0 2024-09-22T08:11:26.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.455+0000 7f2d34816800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e45d7467d0 con 0x55e45d8bbbf0 2024-09-22T08:11:26.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.455+0000 7f2d2f7e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e45d8bbbf0 0x55e45d8c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.455+0000 7f2d2ffe7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e45d8ba7e0 0x55e45d8bb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:36134/0 (socket says 172.21.15.165:36134) 2024-09-22T08:11:26.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.455+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/2117697814 learned_addr learned my addr 172.21.15.165:0/2117697814 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:26.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.455+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/2117697814 >> v1:172.21.15.53:6789/0 conn(0x55e45d8ba7e0 legacy=0x55e45d8bb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.455+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/2117697814 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45d8baee0 con 0x55e45d8bbbf0 2024-09-22T08:11:26.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.457+0000 7f2d2f7e6640 1 --2- 172.21.15.165:0/2117697814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8bbbf0 0x55e45d8c1580 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400a470 tx=0x7f2d24045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2641ff0e54988e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.457+0000 7f2d2efe5640 1 -- 172.21.15.165:0/2117697814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d24053570 con 0x55e45d8bbbf0 2024-09-22T08:11:26.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.457+0000 7f2d2efe5640 1 -- 172.21.15.165:0/2117697814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d24058070 con 0x55e45d8bbbf0 2024-09-22T08:11:26.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.457+0000 7f2d2efe5640 1 -- 172.21.15.165:0/2117697814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d24053880 con 0x55e45d8bbbf0 2024-09-22T08:11:26.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.458+0000 7f2d34816800 1 -- 172.21.15.165:0/2117697814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8bbbf0 msgr2=0x55e45d8c1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.458+0000 7f2d34816800 1 --2- 172.21.15.165:0/2117697814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8bbbf0 0x55e45d8c1580 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400a470 tx=0x7f2d24045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:26.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.458+0000 7f2d34816800 1 -- 172.21.15.165:0/2117697814 shutdown_connections 2024-09-22T08:11:26.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.458+0000 7f2d34816800 1 --2- 172.21.15.165:0/2117697814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8bbbf0 0x55e45d8c1580 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.458+0000 7f2d34816800 1 -- 172.21.15.165:0/2117697814 >> 172.21.15.165:0/2117697814 conn(0x55e45d8b5bb0 msgr2=0x55e45d8b8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.458+0000 7f2d34816800 1 -- 172.21.15.165:0/2117697814 shutdown_connections 2024-09-22T08:11:26.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.458+0000 7f2d34816800 1 -- 172.21.15.165:0/2117697814 wait complete. 2024-09-22T08:11:26.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.472+0000 7f2d34816800 1 Processor -- start 2024-09-22T08:11:26.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.472+0000 7f2d34816800 1 -- start start 2024-09-22T08:11:26.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.472+0000 7f2d34816800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d82e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.472+0000 7f2d34816800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e45d753dd0 con 0x55e45d8ba7e0 2024-09-22T08:11:26.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.472+0000 7f2d2ffe7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d82e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.472+0000 7f2d2ffe7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d82e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58118/0 (socket says 172.21.15.165:58118) 2024-09-22T08:11:26.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.472+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/3179807042 learned_addr learned my addr 172.21.15.165:0/3179807042 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.472+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/3179807042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45d9adb80 con 0x55e45d8ba7e0 2024-09-22T08:11:26.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.473+0000 7f2d2ffe7640 1 --2- 172.21.15.165:0/3179807042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d82e9f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2d20001e40 tx=0x7f2d20001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dd92d5cc30aa4f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.473+0000 7f2c1de0b640 1 -- 172.21.15.165:0/3179807042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d20012020 con 0x55e45d8ba7e0 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.473+0000 7f2c1de0b640 1 -- 172.21.15.165:0/3179807042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2000e5a0 con 0x55e45d8ba7e0 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.473+0000 7f2c1de0b640 1 -- 172.21.15.165:0/3179807042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d2000e8a0 con 0x55e45d8ba7e0 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 -- 172.21.15.165:0/3179807042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 msgr2=0x55e45d82e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 --2- 172.21.15.165:0/3179807042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d82e9f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2d20001e40 tx=0x7f2d20001e70 comp rx=0 tx=0).stop 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 -- 172.21.15.165:0/3179807042 shutdown_connections 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 --2- 172.21.15.165:0/3179807042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d82e9f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 -- 172.21.15.165:0/3179807042 >> 172.21.15.165:0/3179807042 conn(0x55e45d8b5bb0 msgr2=0x55e45d9a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 -- 172.21.15.165:0/3179807042 shutdown_connections 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 -- 172.21.15.165:0/3179807042 wait complete. 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 Processor -- start 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 -- start start 2024-09-22T08:11:26.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d9ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d34816800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e45d8c1ac0 con 0x55e45d8ba7e0 2024-09-22T08:11:26.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d2ffe7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d9ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d2ffe7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d9ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58132/0 (socket says 172.21.15.165:58132) 2024-09-22T08:11:26.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.474+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/2527130869 learned_addr learned my addr 172.21.15.165:0/2527130869 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.475+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/2527130869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45d9ab7f0 con 0x55e45d8ba7e0 2024-09-22T08:11:26.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.475+0000 7f2d2ffe7640 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d9ab290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2d200012b0 tx=0x7f2d20000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.475+0000 7f2c17fff640 1 -- 172.21.15.165:0/2527130869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d20012030 con 0x55e45d8ba7e0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.475+0000 7f2c17fff640 1 -- 172.21.15.165:0/2527130869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2001a750 con 0x55e45d8ba7e0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.475+0000 7f2c17fff640 1 -- 172.21.15.165:0/2527130869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d2001aa70 con 0x55e45d8ba7e0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.475+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e45d9a9ba0 con 0x55e45d8ba7e0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.475+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e45d9aa160 con 0x55e45d8ba7e0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.476+0000 7f2c17fff640 1 -- 172.21.15.165:0/2527130869 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2d20015020 con 0x55e45d8ba7e0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.476+0000 7f2c17fff640 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1803cfb0 0x7f2c1803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.476+0000 7f2c17fff640 1 -- 172.21.15.165:0/2527130869 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2d20020030 con 0x55e45d8ba7e0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.477+0000 7f2d2f7e6640 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1803cfb0 0x7f2c1803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.477+0000 7f2d34816800 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d8bbbf0 0x55e45d9bc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.477+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9bc580 con 0x55e45d8bbbf0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.477+0000 7f2d307e8640 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d8bbbf0 0x55e45d9bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.477+0000 7f2d2f7e6640 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1803cfb0 0x7f2c1803f470 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2d24057000 tx=0x7f2d24052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.477+0000 7f2d307e8640 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d8bbbf0 0x55e45d9bc040 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.477+0000 7f2d307e8640 1 -- 172.21.15.165:0/2527130869 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d2800a4d0 con 0x55e45d8bbbf0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.477+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9aa660 con 0x55e45d8bbbf0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.478+0000 7f2d307e8640 1 -- 172.21.15.165:0/2527130869 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d2800a4d0 con 0x55e45d8bbbf0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.478+0000 7f2d34816800 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9be8b0 0x55e45d9c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.478+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9c1370 con 0x55e45d9be8b0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.478+0000 7f2d2ffe7640 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9be8b0 0x55e45d9c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.478+0000 7f2d2ffe7640 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9be8b0 0x55e45d9c0ca0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.478+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/2527130869 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9be8b0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.478+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9bd750 con 0x55e45d8bbbf0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.479+0000 7f2d307e8640 1 -- 172.21.15.165:0/2527130869 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d2800a4d0 con 0x55e45d8bbbf0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.479+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9bdbf0 con 0x55e45d8bbbf0 2024-09-22T08:11:26.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.479+0000 7f2d307e8640 1 -- 172.21.15.165:0/2527130869 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d2800a4d0 con 0x55e45d8bbbf0 2024-09-22T08:11:26.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.479+0000 7f2d34816800 1 Processor -- start 2024-09-22T08:11:26.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.479+0000 7f2d34816800 1 -- start start 2024-09-22T08:11:26.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.479+0000 7f2d34816800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9cfd30 0x55e45d9d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.479+0000 7f2d34816800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e45d7b2d50 con 0x55e45d9cfd30 2024-09-22T08:11:26.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.480+0000 7f2d307e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9cfd30 0x55e45d9d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.480+0000 7f2d307e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9cfd30 0x55e45d9d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58140/0 (socket says 172.21.15.165:58140) 2024-09-22T08:11:26.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.480+0000 7f2d307e8640 1 -- 172.21.15.165:0/2551426962 learned_addr learned my addr 172.21.15.165:0/2551426962 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.480+0000 7f2d307e8640 1 -- 172.21.15.165:0/2551426962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45d9d0790 con 0x55e45d9cfd30 2024-09-22T08:11:26.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.480+0000 7f2d307e8640 1 --2- 172.21.15.165:0/2551426962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9cfd30 0x55e45d9d0150 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55e45d9bc960 tx=0x7f2d28018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.480+0000 7f2c157fa640 1 -- 172.21.15.165:0/2551426962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d28014450 con 0x55e45d9cfd30 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.480+0000 7f2c157fa640 1 -- 172.21.15.165:0/2551426962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d280145f0 con 0x55e45d9cfd30 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.480+0000 7f2c157fa640 1 -- 172.21.15.165:0/2551426962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d28014910 con 0x55e45d9cfd30 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.480+0000 7f2d34816800 1 -- 172.21.15.165:0/2551426962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e45d9d0fc0 con 0x55e45d9cfd30 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.480+0000 7f2d34816800 1 -- 172.21.15.165:0/2551426962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e45d9d1560 con 0x55e45d9cfd30 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.481+0000 7f2c157fa640 1 -- 172.21.15.165:0/2551426962 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2d28011040 con 0x55e45d9cfd30 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.481+0000 7f2c157fa640 1 --2- 172.21.15.165:0/2551426962 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c0803d000 0x7f2c0803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.481+0000 7f2c157fa640 1 -- 172.21.15.165:0/2551426962 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2d2801e070 con 0x55e45d9cfd30 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.481+0000 7f2d2ffe7640 1 --2- 172.21.15.165:0/2551426962 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c0803d000 0x7f2c0803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.482+0000 7f2d34816800 1 Processor -- start 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.482+0000 7f2d2ffe7640 1 --2- 172.21.15.165:0/2551426962 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c0803d000 0x7f2c0803f4c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55e45d9bca00 tx=0x7f2d2002df10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.482+0000 7f2d34816800 1 -- start start 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.482+0000 7f2d34816800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9dcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.482+0000 7f2d34816800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e45d9adef0 con 0x55e45d9dc6e0 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.482+0000 7f2d307e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9dcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.482+0000 7f2d307e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9dcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58142/0 (socket says 172.21.15.165:58142) 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.482+0000 7f2d307e8640 1 -- 172.21.15.165:0/3032867173 learned_addr learned my addr 172.21.15.165:0/3032867173 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.482+0000 7f2d307e8640 1 -- 172.21.15.165:0/3032867173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45d9dd0d0 con 0x55e45d9dc6e0 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2d307e8640 1 --2- 172.21.15.165:0/3032867173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9dcae0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2d280546e0 tx=0x7f2d28011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc32949f68aff68d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2c0effd640 1 -- 172.21.15.165:0/3032867173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d28051020 con 0x55e45d9dc6e0 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2c0effd640 1 -- 172.21.15.165:0/3032867173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d28022de0 con 0x55e45d9dc6e0 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2c0effd640 1 -- 172.21.15.165:0/3032867173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d28028070 con 0x55e45d9dc6e0 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2d34816800 1 -- 172.21.15.165:0/3032867173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 msgr2=0x55e45d9dcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2d34816800 1 --2- 172.21.15.165:0/3032867173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9dcae0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2d280546e0 tx=0x7f2d28011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2d34816800 1 -- 172.21.15.165:0/3032867173 shutdown_connections 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2d34816800 1 --2- 172.21.15.165:0/3032867173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9dcae0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2d34816800 1 -- 172.21.15.165:0/3032867173 >> 172.21.15.165:0/3032867173 conn(0x55e45d9d8b40 msgr2=0x55e45d9d6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2d34816800 1 -- 172.21.15.165:0/3032867173 shutdown_connections 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.483+0000 7f2d34816800 1 -- 172.21.15.165:0/3032867173 wait complete. 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.484+0000 7f2d34816800 1 Processor -- start 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.484+0000 7f2d34816800 1 -- start start 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.484+0000 7f2d34816800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.484+0000 7f2d34816800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e45d9dd6f0 con 0x55e45d9dc6e0 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.484+0000 7f2d307e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.484+0000 7f2d307e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9e3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58152/0 (socket says 172.21.15.165:58152) 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.484+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 learned_addr learned my addr 172.21.15.165:0/1971806469 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.484+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45d9e42b0 con 0x55e45d9dc6e0 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.484+0000 7f2d307e8640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9e3d50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2d28011b50 tx=0x7f2d28011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.484+0000 7f2c0d7fa640 1 -- 172.21.15.165:0/1971806469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d28016440 con 0x55e45d9dc6e0 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.485+0000 7f2c0d7fa640 1 -- 172.21.15.165:0/1971806469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d28032070 con 0x55e45d9dc6e0 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.485+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e45d9e4540 con 0x55e45d9dc6e0 2024-09-22T08:11:26.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.485+0000 7f2c0d7fa640 1 -- 172.21.15.165:0/1971806469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d28056200 con 0x55e45d9dc6e0 2024-09-22T08:11:26.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.485+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e45d9e4ec0 con 0x55e45d9dc6e0 2024-09-22T08:11:26.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.485+0000 7f2c0d7fa640 1 -- 172.21.15.165:0/1971806469 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2d2804dd10 con 0x55e45d9dc6e0 2024-09-22T08:11:26.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.485+0000 7f2c0d7fa640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bf803cf60 0x7f2bf803f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.486+0000 7f2c0d7fa640 1 -- 172.21.15.165:0/1971806469 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2d2800e040 con 0x55e45d9dc6e0 2024-09-22T08:11:26.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.486+0000 7f2d2ffe7640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bf803cf60 0x7f2bf803f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.486+0000 7f2d2ffe7640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bf803cf60 0x7f2bf803f420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d20018f90 tx=0x7f2d20048000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.486+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.486+0000 7f2d34816800 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d9ef820 0x55e45d9f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.486+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9f2430 con 0x55e45d9ef820 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.486+0000 7f2d2f7e6640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d9ef820 0x55e45d9f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d2f7e6640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d9ef820 0x55e45d9f1ce0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 20 realm 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9f2860 con 0x55e45d9ef820 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9f3130 con 0x55e45d9ef820 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9f34d0 con 0x55e45d9ef820 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.487+0000 7f2d34816800 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9f4230 0x55e45d9f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.488+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9f6c30 con 0x55e45d9f4230 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.488+0000 7f2d307e8640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9f4230 0x55e45d9f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.488+0000 7f2d307e8640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9f4230 0x55e45d9f6620 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.488+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.488+0000 7f2d34816800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.488+0000 7f2d34816800 20 searching for the correct realm 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.488+0000 7f2d34816800 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e45d9f8be0 0x55e45d9fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.488+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f8be0 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.488+0000 7f2d2ffe7640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e45d9f8be0 0x55e45d9fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.489+0000 7f2d2ffe7640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e45d9f8be0 0x55e45d9fb0a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.489+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.489+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f4230 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.489+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.489+0000 7f2d307e8640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d28014070 0x7f2d28023a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.489+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x7f2d28014070 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.489+0000 7f2d2f7e6640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d28014070 0x7f2d28023a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.490+0000 7f2d2f7e6640 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d28014070 0x7f2d28023a70 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.490+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.490+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9ef820 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.490+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.490+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9ef820 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.490+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.490+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x7f2d28014070 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.491+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.491+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f4230 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.491+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.491+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f4230 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.491+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.491+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f8be0 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.491+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.491+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9ef820 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.491+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.491+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x7f2d28014070 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.492+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.492+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9ef820 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.492+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.492+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f4230 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.492+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.492+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f8be0 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.492+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.492+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f8be0 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.493+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.493+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x7f2d28014070 2024-09-22T08:11:26.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.493+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.493+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f8be0 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.493+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.493+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f8be0 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.493+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.493+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9ef820 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.493+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.493+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9ef820 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.494+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.494+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x7f2d28014070 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.494+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.494+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f8be0 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.494+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.494+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f4230 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.494+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.494+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9ef820 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.495+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.495+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x7f2d28014070 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.495+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.495+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f8be0 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.495+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.495+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x7f2d28014070 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.495+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.495+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f4230 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.496+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.496+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f8be0 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.496+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.496+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x7f2d28014070 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.496+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.496+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9ef820 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.496+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.496+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fb720 con 0x55e45d9f4230 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9f75f0 con 0x55e45d9ef820 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9f7e90 con 0x55e45d9ef820 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.497+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9f7230 con 0x55e45d9ef820 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 zone default found 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 4 Realm: () 2024-09-22T08:11:26.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 zonegroup default 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fc050 con 0x7f2d28014070 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fddd0 con 0x55e45d9f8be0 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fe260 con 0x55e45d9f8be0 2024-09-22T08:11:26.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 started sync module instance, tier type = 2024-09-22T08:11:26.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:26.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.498+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fcba0 con 0x55e45d9f4230 2024-09-22T08:11:26.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.499+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.500+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94439311659200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fcba0 con 0x55e45d9f4230 2024-09-22T08:11:26.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.500+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fece0 con 0x55e45d9ef820 2024-09-22T08:11:26.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.501+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94439311659200] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.501+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.501+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94439311665680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fcba0 con 0x55e45d9ef820 2024-09-22T08:11:26.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.501+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9ff760 con 0x55e45d9f8be0 2024-09-22T08:11:26.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.502+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94439311665680] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.502+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.502+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94439311656688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9fcb10 con 0x55e45d9f8be0 2024-09-22T08:11:26.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.502+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da00650 con 0x55e45d9f4230 2024-09-22T08:11:26.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.503+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.503+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94439311656688] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.503+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94439311672192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da00e10 con 0x55e45d9f4230 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.503+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9ffba0 con 0x55e45d9ef820 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.504+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.504+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94439311676416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45d9ffba0 con 0x55e45d9ef820 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.504+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94439311672192] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.504+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da008a0 con 0x7f2d28014070 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.505+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94439311676416] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.506+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.506+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94439311677472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da00860 con 0x7f2d28014070 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.506+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da02910 con 0x7f2d28014070 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.507+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94439311677472] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.507+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.507+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94439311679040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da02910 con 0x7f2d28014070 2024-09-22T08:11:26.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.507+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da032d0 con 0x7f2d28014070 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.508+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94439311679040] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.508+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.508+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94439311681088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da032d0 con 0x7f2d28014070 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.508+0000 7f2d34816800 20 add_watcher() i=0 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.508+0000 7f2d34816800 20 add_watcher() i=1 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.508+0000 7f2d34816800 20 add_watcher() i=2 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.508+0000 7f2d34816800 20 add_watcher() i=3 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.508+0000 7f2d34816800 20 add_watcher() i=4 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.508+0000 7f2d34816800 20 add_watcher() i=5 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.508+0000 7f2d34816800 20 add_watcher() i=6 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.509+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94439311681088] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.509+0000 7f2d34816800 20 add_watcher() i=7 2024-09-22T08:11:26.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.509+0000 7f2d34816800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.509+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da06710 con 0x55e45d9ef820 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.509+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.509+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94439311696160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da03440 con 0x55e45d9ef820 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.510+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94439311696160] v34'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.510+0000 7f2be5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.510+0000 7f2d34816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.510+0000 7f2d34816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.510+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da0f200 con 0x55e45d9ef820 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.511+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.511+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da0f8d0 con 0x7f2d28014070 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.512+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.512+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da0fcf0 con 0x55e45d9f8be0 2024-09-22T08:11:26.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.513+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.513+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da101c0 con 0x55e45d9ef820 2024-09-22T08:11:26.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.514+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.514+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da107b0 con 0x55e45d9f4230 2024-09-22T08:11:26.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.515+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.515+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da10790 con 0x55e45d9f8be0 2024-09-22T08:11:26.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.516+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.516+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da10d80 con 0x55e45d9ef820 2024-09-22T08:11:26.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.518+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.518+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11210 con 0x7f2d28014070 2024-09-22T08:11:26.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.519+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'42 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.519+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11210 con 0x55e45d9f4230 2024-09-22T08:11:26.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.520+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.520+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da115f0 con 0x55e45d9f8be0 2024-09-22T08:11:26.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.521+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.521+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da114c0 con 0x55e45d9f4230 2024-09-22T08:11:26.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.521+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.522+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da115f0 con 0x7f2d28014070 2024-09-22T08:11:26.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.523+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.523+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f4230 2024-09-22T08:11:26.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.524+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.524+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x7f2d28014070 2024-09-22T08:11:26.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.525+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.525+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9ef820 2024-09-22T08:11:26.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.526+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.526+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f8be0 2024-09-22T08:11:26.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.527+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.527+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f4230 2024-09-22T08:11:26.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.528+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.528+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f8be0 2024-09-22T08:11:26.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.529+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.529+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9ef820 2024-09-22T08:11:26.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.530+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.530+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9ef820 2024-09-22T08:11:26.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.531+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.531+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f8be0 2024-09-22T08:11:26.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.532+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.532+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f4230 2024-09-22T08:11:26.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.533+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.533+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f8be0 2024-09-22T08:11:26.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.534+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.535+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f8be0 2024-09-22T08:11:26.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.535+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.535+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f8be0 2024-09-22T08:11:26.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.536+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.536+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f8be0 2024-09-22T08:11:26.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.537+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.537+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x7f2d28014070 2024-09-22T08:11:26.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.538+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.538+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f8be0 2024-09-22T08:11:26.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.539+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.539+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x7f2d28014070 2024-09-22T08:11:26.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.540+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.540+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f8be0 2024-09-22T08:11:26.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.541+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.541+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x7f2d28014070 2024-09-22T08:11:26.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.542+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.543+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da11ad0 con 0x55e45d9f4230 2024-09-22T08:11:26.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.543+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2be4fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 20 Filter name: none 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2b5e7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da3c9d0 con 0x55e45d9f4230 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 : miss 2024-09-22T08:11:26.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.544+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:95 8.4 8:25e4b931:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da3e320 con 0x55e45d9f4230 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(95 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d34816800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d34816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 info.flags=0x17 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d34816800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 to cache LRU end 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d34816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d34816800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d34816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:96 4.14 4:2b498fd9:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabb830 con 0x55e45d9f8be0 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(96 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:97 4.2f 4:f54133f0:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabb870 con 0x55e45d9ef820 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(97 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.545+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:98 4.25 4:a5cbd406:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabb870 con 0x55e45d9f8be0 2024-09-22T08:11:26.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.546+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(98 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2 [call out=430b] v0'0 uv13 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.546+0000 7f2d34816800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-22T08:11:26.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.546+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:99 4.21 4:85fba667:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabb870 con 0x7f2d28014070 2024-09-22T08:11:26.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.546+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(99 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.546+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:100 4.25 4:a612ed34:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabb870 con 0x55e45d9f8be0 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.547+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(100 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.4 [call out=89b] v0'0 uv10 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.547+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 4.17 4:ea4a627b:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabbdd0 con 0x7f2d28014070 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.547+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(101 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.547+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 4.26 4:65e002a8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabbdb0 con 0x7f2d28014070 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.547+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(102 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.547+0000 7f2d34816800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.547+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:103 4.38 4:1fcb08c8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabbdb0 con 0x55e45d9ef820 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.548+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(103 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.548+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:104 4.3c 4:3e89333a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabbdb0 con 0x55e45d9ef820 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.548+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(104 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8 [call out=429b] v0'0 uv5 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.548+0000 7f2d34816800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.548+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:105 4.25 4:a4b4b2e2:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabbdb0 con 0x55e45d9f8be0 2024-09-22T08:11:26.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.548+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== osd_op_reply(105 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.9 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.548+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:106 4.21 4:8663c65a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabbd90 con 0x7f2d28014070 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(106 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10 [call out=701b] v0'0 uv12 ondisk = 0) ==== 195+0+701 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d34816800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d34816800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d34816800 20 get_obj_state: octx=0x7f2d28051f40 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55e45da3eb88 s->prefetch_data=0 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:107 3.4s0 3:2376db2e:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_9c8454ddf7aa50116496bac348d7550d:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dab91a0 con 0x7f2d28014070 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(107 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_9c8454ddf7aa50116496bac348d7550d [call out=24b,getxattrs out=888b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+928 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d34816800 10 manifest: total_size = 6 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d34816800 20 get_obj_state: setting s->obj_tag to cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.15403647813236337216 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d34816800 20 get_obj_state: octx=0x7f2d28051f40 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55e45da3eb88 s->prefetch_data=0 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d34816800 20 prepare_atomic_modification: state is not atomic. state=0x55e45da3eb88 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d34816800 20 bucket index object: :.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2 2024-09-22T08:11:26.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.549+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:108 4.25 4:a5cbd406:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da43c20 con 0x55e45d9f8be0 2024-09-22T08:11:26.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.551+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(108 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2 [stat,call,call] v34'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.551+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:109 3.4s0 3:2376db2e:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da43c20 con 0x7f2d28014070 2024-09-22T08:11:26.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.552+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(109 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_9c8454ddf7aa50116496bac348d7550d [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.552+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:110 4.25 4:a5cbd406:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da446b0 con 0x55e45d9f8be0 2024-09-22T08:11:26.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.552+0000 7f2d34816800 20 get_obj_state: octx=0x7f2d28051f40 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55e45da3eb88 s->prefetch_data=0 2024-09-22T08:11:26.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.552+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:111 3.21s0 3:85bc570a:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_b1b9a972ccd8c962a473909b97007eb4:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da446b0 con 0x7f2d28014070 2024-09-22T08:11:26.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.553+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(111 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_b1b9a972ccd8c962a473909b97007eb4 [call out=24b,getxattrs out=888b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+928 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.553+0000 7f2d34816800 10 manifest: total_size = 3 2024-09-22T08:11:26.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.553+0000 7f2d34816800 20 get_obj_state: setting s->obj_tag to cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.16714754268330250410 2024-09-22T08:11:26.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.553+0000 7f2d34816800 20 get_obj_state: octx=0x7f2d28051f40 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55e45da3eb88 s->prefetch_data=0 2024-09-22T08:11:26.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.553+0000 7f2d34816800 20 prepare_atomic_modification: state is not atomic. state=0x55e45da3eb88 2024-09-22T08:11:26.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.553+0000 7f2d34816800 20 bucket index object: :.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6 2024-09-22T08:11:26.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.553+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:112 4.26 4:65e002a8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da492d0 con 0x7f2d28014070 2024-09-22T08:11:26.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.553+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 31 ==== osd_op_reply(110 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2 [stat,call,call] v34'15 uv15 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.553+0000 7f2c0effd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-22T08:11:26.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.554+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(112 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.554+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:113 3.21s0 3:85bc570a:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da40520 con 0x7f2d28014070 2024-09-22T08:11:26.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.556+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(113 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.556+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:114 4.26 4:65e002a8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da45290 con 0x7f2d28014070 2024-09-22T08:11:26.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.556+0000 7f2d34816800 20 get_obj_state: octx=0x7f2d28051f40 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55e45da3eb88 s->prefetch_data=0 2024-09-22T08:11:26.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.556+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:115 3.30s0 3:0f5e54ef:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da45290 con 0x55e45d9f8be0 2024-09-22T08:11:26.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.556+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 32 ==== osd_op_reply(115 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_c785e1ed2950e3e36b1e2ca01f299a54 [call out=24b,getxattrs out=886b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+926 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.556+0000 7f2d34816800 10 manifest: total_size = 4 2024-09-22T08:11:26.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.556+0000 7f2d34816800 20 get_obj_state: setting s->obj_tag to cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.3138787340907203788 2024-09-22T08:11:26.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.556+0000 7f2d34816800 20 get_obj_state: octx=0x7f2d28051f40 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55e45da3eb88 s->prefetch_data=0 2024-09-22T08:11:26.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.556+0000 7f2d34816800 20 prepare_atomic_modification: state is not atomic. state=0x55e45da3eb88 2024-09-22T08:11:26.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.556+0000 7f2d34816800 20 bucket index object: :.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8 2024-09-22T08:11:26.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.557+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:116 4.3c 4:3e89333a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da4a090 con 0x55e45d9ef820 2024-09-22T08:11:26.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.557+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(114 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.557+0000 7f2c0e7fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-22T08:11:26.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.558+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(116 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.558+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:117 3.30s0 3:0f5e54ef:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da40520 con 0x55e45d9f8be0 2024-09-22T08:11:26.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.559+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 33 ==== osd_op_reply(117 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.559+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:118 4.3c 4:3e89333a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da41980 con 0x55e45d9ef820 2024-09-22T08:11:26.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.559+0000 7f2d34816800 20 get_obj_state: octx=0x7f2d28051f40 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55e45da3eb88 s->prefetch_data=0 2024-09-22T08:11:26.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.559+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:119 3.19s0 3:990e3a24:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_24d27c169c2c881eb09a065116f2aa5c:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da42100 con 0x55e45d9ef820 2024-09-22T08:11:26.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.560+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(119 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_24d27c169c2c881eb09a065116f2aa5c [call out=24b,getxattrs out=886b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+926 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.560+0000 7f2d34816800 10 manifest: total_size = 5 2024-09-22T08:11:26.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.560+0000 7f2d34816800 20 get_obj_state: setting s->obj_tag to cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9714373164588200880 2024-09-22T08:11:26.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.560+0000 7f2d34816800 20 get_obj_state: octx=0x7f2d28051f40 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55e45da3eb88 s->prefetch_data=0 2024-09-22T08:11:26.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.560+0000 7f2d34816800 20 prepare_atomic_modification: state is not atomic. state=0x55e45da3eb88 2024-09-22T08:11:26.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.560+0000 7f2d34816800 20 bucket index object: :.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10 2024-09-22T08:11:26.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.560+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:120 4.21 4:8663c65a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da42100 con 0x7f2d28014070 2024-09-22T08:11:26.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.561+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(118 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.561+0000 7f2c0effd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-22T08:11:26.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.561+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== osd_op_reply(120 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.561+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:121 3.19s0 3:990e3a24:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da42100 con 0x55e45d9ef820 2024-09-22T08:11:26.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(121 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:122 4.21 4:8663c65a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da41980 con 0x7f2d28014070 2024-09-22T08:11:26.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d34816800 20 get_obj_state: octx=0x7f2d28051f40 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55e45da3eb88 s->prefetch_data=0 2024-09-22T08:11:26.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:123 3.8s0 3:1317d0d6:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da41980 con 0x55e45d9f8be0 2024-09-22T08:11:26.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 34 ==== osd_op_reply(123 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=920b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+960 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d34816800 10 manifest: total_size = 5 2024-09-22T08:11:26.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d34816800 20 get_obj_state: setting s->obj_tag to _FfvZrvxC_LVS-yYCQp73QI6G80v3GKt 2024-09-22T08:11:26.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d34816800 20 get_obj_state: octx=0x7f2d28051f40 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55e45da3eb88 s->prefetch_data=0 2024-09-22T08:11:26.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d34816800 20 prepare_atomic_modification: state is not atomic. state=0x55e45da3eb88 2024-09-22T08:11:26.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d34816800 20 bucket index object: :.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10 2024-09-22T08:11:26.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.563+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:124 4.21 4:8663c65a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da41980 con 0x7f2d28014070 2024-09-22T08:11:26.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.564+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(122 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10 [stat,call,call] v34'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.564+0000 7f2c0e7fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-22T08:11:26.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.565+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 35 ==== osd_op_reply(124 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10 [stat,call,call] v34'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.565+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:125 3.8s0 3:1317d0d6:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da4a290 con 0x55e45d9f8be0 2024-09-22T08:11:26.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 35 ==== osd_op_reply(125 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:126 4.21 4:8663c65a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da4a290 con 0x7f2d28014070 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:127 4.14 4:2b498fd9:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da4a290 con 0x55e45d9f8be0 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:128 4.2f 4:f54133f0:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da3e9a0 con 0x55e45d9ef820 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:129 4.25 4:a5cbd406:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da4d6d0 con 0x55e45d9f8be0 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:130 4.21 4:85fba667:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da50350 con 0x7f2d28014070 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:131 4.25 4:a612ed34:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da53110 con 0x55e45d9f8be0 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:132 4.17 4:ea4a627b:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55ed0 con 0x7f2d28014070 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:133 4.26 4:65e002a8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da58cd0 con 0x7f2d28014070 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:134 4.38 4:1fcb08c8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da5bb00 con 0x55e45d9ef820 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:135 4.3c 4:3e89333a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da5e930 con 0x55e45d9ef820 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:136 4.25 4:a4b4b2e2:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da617b0 con 0x55e45d9f8be0 2024-09-22T08:11:26.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.566+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:137 4.21 4:8663c65a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da645e0 con 0x7f2d28014070 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 36 ==== osd_op_reply(132 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 37 ==== osd_op_reply(130 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 38 ==== osd_op_reply(133 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 35 ==== osd_op_reply(128 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 36 ==== osd_op_reply(134 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 36 ==== osd_op_reply(127 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 37 ==== osd_op_reply(135 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 37 ==== osd_op_reply(129 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2 [call out=128b] v0'0 uv15 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 39 ==== osd_op_reply(126 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10 [stat,call,call] v34'16 uv16 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 38 ==== osd_op_reply(131 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.4 [call out=89b] v0'0 uv10 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2c0e7fc640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 40 ==== osd_op_reply(137 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10 [call out=128b] v0'0 uv16 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 39 ==== osd_op_reply(136 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.9 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d34816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d34816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d34816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d34816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d34816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5])"; uploads.size()=0; is_truncated=0 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:138 4.14 4:2b498fd9:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da50350 con 0x55e45d9f8be0 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:139 4.2f 4:f54133f0:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55ed0 con 0x55e45d9ef820 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:140 4.25 4:a5cbd406:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da50350 con 0x55e45d9f8be0 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:141 4.21 4:85fba667:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55ed0 con 0x7f2d28014070 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.567+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:142 4.25 4:a612ed34:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55ed0 con 0x55e45d9f8be0 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:143 4.17 4:ea4a627b:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55ed0 con 0x7f2d28014070 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 40 ==== osd_op_reply(138 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:144 4.26 4:65e002a8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55ed0 con 0x7f2d28014070 2024-09-22T08:11:26.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:145 4.38 4:1fcb08c8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55ed0 con 0x55e45d9ef820 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 38 ==== osd_op_reply(139 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 41 ==== osd_op_reply(140 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2 [call out=128b] v0'0 uv15 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:146 4.3c 4:3e89333a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da50350 con 0x55e45d9ef820 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:147 4.25 4:a4b4b2e2:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55ed0 con 0x55e45d9f8be0 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:148 4.21 4:8663c65a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da50350 con 0x7f2d28014070 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 41 ==== osd_op_reply(141 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 42 ==== osd_op_reply(143 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 43 ==== osd_op_reply(144 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 42 ==== osd_op_reply(142 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.4 [call out=89b] v0'0 uv10 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 43 ==== osd_op_reply(147 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.9 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 44 ==== osd_op_reply(148 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10 [call out=128b] v0'0 uv16 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 39 ==== osd_op_reply(145 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 40 ==== osd_op_reply(146 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.568+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da50350 con 0x55e45d9f4230 2024-09-22T08:11:26.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.569+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(149 foo.buckets [call] v34'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.569+0000 7f2d34816800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-22T08:11:26.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.569+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da5bb00 con 0x55e45d9f4230 2024-09-22T08:11:26.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.570+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== osd_op_reply(150 myfoo [call,call,delete] v34'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.570+0000 7f2d34816800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-22T08:11:26.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.570+0000 7f2d34816800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:11:26.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.570+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94439312046848 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabaac0 con 0x7f2d28014070 2024-09-22T08:11:26.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.571+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 45 ==== watch-notify(notify (1) cookie 94439311679040 notify 146028888089 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55e45da101c0 con 0x7f2d28014070 2024-09-22T08:11:26.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.571+0000 7f2c0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94439311679040 notifier 4647 bl.length()=149 2024-09-22T08:11:26.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.571+0000 7f2c0e7fc640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2b640032c0 con 0x7f2d28014070 2024-09-22T08:11:26.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.571+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 46 ==== osd_op_reply(151 notify.6 [notify cookie 94439312046848 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.571+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 47 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.571+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 48 ==== watch-notify(notify_complete (2) cookie 94439312046848 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e45da0fb20 con 0x7f2d28014070 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.571+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:153 8.4 8:25e4b931:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabaac0 con 0x55e45d9f4230 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.572+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 24 ==== osd_op_reply(153 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.572+0000 7f2d34816800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 from cache 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.572+0000 7f2d34816800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5, ofs0, ns] 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.572+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94439311999632 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da3e290 con 0x7f2d28014070 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.572+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 49 ==== watch-notify(notify (1) cookie 94439311679040 notify 146028888090 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55e45da0fb20 con 0x7f2d28014070 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.572+0000 7f2c0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94439311679040 notifier 4647 bl.length()=206 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.572+0000 7f2c0effd640 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2bf4003d60 con 0x7f2d28014070 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.572+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 50 ==== osd_op_reply(154 notify.6 [notify cookie 94439311999632 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 51 ==== osd_op_reply(155 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 52 ==== watch-notify(notify_complete (2) cookie 94439311999632 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e45da0f390 con 0x7f2d28014070 2024-09-22T08:11:26.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:156 4.14 4:2b498fd9:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45dabaac0 con 0x55e45d9f8be0 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:157 4.2f 4:f54133f0:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da44d10 con 0x55e45d9ef820 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:158 4.25 4:a5cbd406:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x55e45d9f8be0 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:159 4.21 4:85fba667:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da5e1b0 con 0x7f2d28014070 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:160 4.25 4:a612ed34:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da5e590 con 0x55e45d9f8be0 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:161 4.17 4:ea4a627b:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x7f2d28014070 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:162 4.26 4:65e002a8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da5e930 con 0x7f2d28014070 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:163 4.38 4:1fcb08c8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da5e590 con 0x55e45d9ef820 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:164 4.3c 4:3e89333a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da408f0 con 0x55e45d9ef820 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:165 4.25 4:a4b4b2e2:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da412c0 con 0x55e45d9f8be0 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.573+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:166 4.21 4:8663c65a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da5e1b0 con 0x7f2d28014070 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.574+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 41 ==== osd_op_reply(157 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.1 [delete] v34'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.574+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 44 ==== osd_op_reply(158 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.2 [delete] v34'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.574+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 53 ==== osd_op_reply(159 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.3 [delete] v34'17 uv17 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.575+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 54 ==== osd_op_reply(161 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.575+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 42 ==== osd_op_reply(164 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.8 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.575+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 45 ==== osd_op_reply(160 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.4 [delete] v34'17 uv17 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.575+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 55 ==== osd_op_reply(162 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.6 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.575+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 56 ==== osd_op_reply(166 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.10 [delete] v34'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.575+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 43 ==== osd_op_reply(163 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.7 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.575+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 46 ==== osd_op_reply(156 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.0 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.577+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 47 ==== osd_op_reply(165 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5.9 [delete] v34'18 uv18 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.577+0000 7f2d34816800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 : miss 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.577+0000 7f2d34816800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.577+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:167 6.6 6:62f24349:::pubsub..bucket.myfoo%2fcc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x55e45d9f8be0 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.577+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 48 ==== osd_op_reply(167 pubsub..bucket.myfoo/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.577+0000 7f2d34816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.577+0000 7f2d34816800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 info.flags=0x0 2024-09-22T08:11:26.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.577+0000 7f2d34816800 10 adding default.rgw.log++pubsub..bucket.myfoo/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 to cache LRU end 2024-09-22T08:11:26.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.577+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:168 6.6 6:62f24349:::pubsub..bucket.myfoo%2fcc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x55e45d9f8be0 2024-09-22T08:11:26.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.578+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 49 ==== osd_op_reply(168 pubsub..bucket.myfoo/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.5 [delete] v34'13 uv12 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.578+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x55e45d9f4230 2024-09-22T08:11:26.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.579+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 25 ==== osd_op_reply(169 foo.buckets [call] v34'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.579+0000 7f2be5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.579+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94439311696160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x55e45d9ef820 2024-09-22T08:11:26.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.580+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 44 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94439311696160] v34'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.580+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94439311659200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x55e45d9f4230 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.581+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 26 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94439311659200] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.581+0000 7f2d34816800 20 remove_watcher() i=0 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.581+0000 7f2d34816800 2 removed watcher, disabling cache 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.581+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94439311665680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x55e45d9ef820 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.582+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 45 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94439311665680] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.582+0000 7f2d34816800 20 remove_watcher() i=1 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.582+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94439311656688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x55e45d9f8be0 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.583+0000 7f2d2ffe7640 1 -- 172.21.15.165:0/1971806469 <== osd.3 v2:172.21.15.165:6800/215521179 50 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94439311656688] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d20018ce0 con 0x55e45d9f8be0 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.583+0000 7f2d34816800 20 remove_watcher() i=2 2024-09-22T08:11:26.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.583+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94439311672192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x55e45d9f4230 2024-09-22T08:11:26.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.584+0000 7f2d307e8640 1 -- 172.21.15.165:0/1971806469 <== osd.2 v2:172.21.15.165:6808/3197121696 27 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94439311672192] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d2802a070 con 0x55e45d9f4230 2024-09-22T08:11:26.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.584+0000 7f2d34816800 20 remove_watcher() i=3 2024-09-22T08:11:26.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.584+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94439311676416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x55e45d9ef820 2024-09-22T08:11:26.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.585+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.1 v2:172.21.15.165:6816/2347568643 46 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94439311676416] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x55e45d9ef820 2024-09-22T08:11:26.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.585+0000 7f2d34816800 20 remove_watcher() i=4 2024-09-22T08:11:26.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.585+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94439311677472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x7f2d28014070 2024-09-22T08:11:26.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.586+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 57 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94439311677472] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.586+0000 7f2d34816800 20 remove_watcher() i=5 2024-09-22T08:11:26.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.586+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94439311679040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x7f2d28014070 2024-09-22T08:11:26.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.587+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 58 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94439311679040] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.587+0000 7f2d34816800 20 remove_watcher() i=6 2024-09-22T08:11:26.588 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.587+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94439311681088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e45da55740 con 0x7f2d28014070 2024-09-22T08:11:26.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.588+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 <== osd.0 v2:172.21.15.53:6800/2902972477 59 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94439311681088] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24051070 con 0x7f2d28014070 2024-09-22T08:11:26.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.588+0000 7f2d34816800 20 remove_watcher() i=7 2024-09-22T08:11:26.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d28014070 msgr2=0x7f2d28023a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d28014070 0x7f2d28023a70 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d9ef820 msgr2=0x55e45d9f1ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d9ef820 0x55e45d9f1ce0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9f4230 msgr2=0x55e45d9f6620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9f4230 0x55e45d9f6620 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e45d9f8be0 msgr2=0x55e45d9fb0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e45d9f8be0 0x55e45d9fb0a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bf803cf60 msgr2=0x7f2bf803f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2bf803cf60 0x7f2bf803f420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d20018f90 tx=0x7f2d20048000 comp rx=0 tx=0).stop 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d2f7e6640 1 -- 172.21.15.165:0/1971806469 reap_dead start 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 msgr2=0x55e45d9e3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9e3d50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2d28011b50 tx=0x7f2d28011f60 comp rx=0 tx=0).stop 2024-09-22T08:11:26.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 shutdown_connections 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/1971806469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9dc6e0 0x55e45d9e3d50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 >> 172.21.15.165:0/1971806469 conn(0x55e45d9d8b40 msgr2=0x55e45d9d6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 shutdown_connections 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/1971806469 wait complete. 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/2551426962 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c0803d000 msgr2=0x7f2c0803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/2551426962 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c0803d000 0x7f2c0803f4c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55e45d9bca00 tx=0x7f2d2002df10 comp rx=0 tx=0).stop 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/2551426962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9cfd30 msgr2=0x55e45d9d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/2551426962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9cfd30 0x55e45d9d0150 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55e45d9bc960 tx=0x7f2d28018830 comp rx=0 tx=0).stop 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/2551426962 shutdown_connections 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/2551426962 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c0803d000 0x7f2c0803f4c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 --2- 172.21.15.165:0/2551426962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d9cfd30 0x55e45d9d0150 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/2551426962 >> 172.21.15.165:0/2551426962 conn(0x55e45d9c40e0 msgr2=0x55e45d9c44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/2551426962 shutdown_connections 2024-09-22T08:11:26.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.589+0000 7f2d34816800 1 -- 172.21.15.165:0/2551426962 wait complete. 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d8bbbf0 msgr2=0x55e45d9bc040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d8bbbf0 0x55e45d9bc040 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9be8b0 msgr2=0x55e45d9c0ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9be8b0 0x55e45d9c0ca0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1803cfb0 msgr2=0x7f2c1803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1803cfb0 0x7f2c1803f470 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2d24057000 tx=0x7f2d24052000 comp rx=0 tx=0).stop 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 msgr2=0x55e45d9ab290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d9ab290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2d200012b0 tx=0x7f2d20000ed0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 shutdown_connections 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e45d9be8b0 0x55e45d9c0ca0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e45d8bbbf0 0x55e45d9bc040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c1803cfb0 0x7f2c1803f470 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 --2- 172.21.15.165:0/2527130869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e45d8ba7e0 0x55e45d9ab290 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 >> 172.21.15.165:0/2527130869 conn(0x55e45d8b5bb0 msgr2=0x55e45d9a4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 shutdown_connections 2024-09-22T08:11:26.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.590+0000 7f2d34816800 1 -- 172.21.15.165:0/2527130869 wait complete. 2024-09-22T08:11:26.599 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-22T08:11:26.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-22T08:11:26.599 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-22T08:11:26.645 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:26.646 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:26.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.645+0000 7fcd51c2f800 1 Processor -- start 2024-09-22T08:11:26.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.645+0000 7fcd51c2f800 1 -- start start 2024-09-22T08:11:26.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.646+0000 7fcd51c2f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f8848cefe0 0x55f8848d6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.646+0000 7fcd51c2f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f88475ba20 con 0x55f8848cebe0 2024-09-22T08:11:26.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.646+0000 7fcd51c2f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f88475b7d0 con 0x55f8848cefe0 2024-09-22T08:11:26.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.646+0000 7fcd4ef18640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f8848cefe0 0x55f8848d6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.646+0000 7fcd4f719640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f8848cebe0 0x55f8848d3850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:36144/0 (socket says 172.21.15.165:36144) 2024-09-22T08:11:26.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.646+0000 7fcd4f719640 1 -- 172.21.15.165:0/4247368377 learned_addr learned my addr 172.21.15.165:0/4247368377 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:26.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.646+0000 7fcd4ef18640 1 -- 172.21.15.165:0/4247368377 >> v1:172.21.15.53:6789/0 conn(0x55f8848cebe0 legacy=0x55f8848d3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.646+0000 7fcd4ef18640 1 -- 172.21.15.165:0/4247368377 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8848d8590 con 0x55f8848cefe0 2024-09-22T08:11:26.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.648+0000 7fcd4ef18640 1 --2- 172.21.15.165:0/4247368377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cefe0 0x55f8848d6f80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800a470 tx=0x7fcd38045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b403e190063c04 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.648+0000 7fcd4e717640 1 -- 172.21.15.165:0/4247368377 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd38053570 con 0x55f8848cefe0 2024-09-22T08:11:26.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.648+0000 7fcd4e717640 1 -- 172.21.15.165:0/4247368377 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd38058070 con 0x55f8848cefe0 2024-09-22T08:11:26.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.648+0000 7fcd4e717640 1 -- 172.21.15.165:0/4247368377 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd38053880 con 0x55f8848cefe0 2024-09-22T08:11:26.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.649+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4247368377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cefe0 msgr2=0x55f8848d6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.649+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/4247368377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cefe0 0x55f8848d6f80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800a470 tx=0x7fcd38045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:26.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.649+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4247368377 shutdown_connections 2024-09-22T08:11:26.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.649+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/4247368377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cefe0 0x55f8848d6f80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.649+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4247368377 >> 172.21.15.165:0/4247368377 conn(0x55f8848ca310 msgr2=0x55f8848cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.649+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4247368377 shutdown_connections 2024-09-22T08:11:26.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.649+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4247368377 wait complete. 2024-09-22T08:11:26.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.663+0000 7fcd51c2f800 1 Processor -- start 2024-09-22T08:11:26.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.663+0000 7fcd51c2f800 1 -- start start 2024-09-22T08:11:26.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.663+0000 7fcd51c2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.663+0000 7fcd51c2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f884768dd0 con 0x55f8848cebe0 2024-09-22T08:11:26.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.663+0000 7fcd4f719640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.663+0000 7fcd4f719640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58178/0 (socket says 172.21.15.165:58178) 2024-09-22T08:11:26.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.663+0000 7fcd4f719640 1 -- 172.21.15.165:0/1540313556 learned_addr learned my addr 172.21.15.165:0/1540313556 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.663+0000 7fcd4f719640 1 -- 172.21.15.165:0/1540313556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8849c0610 con 0x55f8848cebe0 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.664+0000 7fcd4f719640 1 --2- 172.21.15.165:0/1540313556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c0020 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcd40001800 tx=0x7fcd40001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b02590082642c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.664+0000 7fcc3d60a640 1 -- 172.21.15.165:0/1540313556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd40004520 con 0x55f8848cebe0 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.664+0000 7fcc3d60a640 1 -- 172.21.15.165:0/1540313556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd400046c0 con 0x55f8848cebe0 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.664+0000 7fcc3d60a640 1 -- 172.21.15.165:0/1540313556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd400049e0 con 0x55f8848cebe0 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.664+0000 7fcd51c2f800 1 -- 172.21.15.165:0/1540313556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 msgr2=0x55f8849c0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.664+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/1540313556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c0020 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcd40001800 tx=0x7fcd40001cc0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.664+0000 7fcd51c2f800 1 -- 172.21.15.165:0/1540313556 shutdown_connections 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.664+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/1540313556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c0020 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.664+0000 7fcd51c2f800 1 -- 172.21.15.165:0/1540313556 >> 172.21.15.165:0/1540313556 conn(0x55f8848ca310 msgr2=0x55f8849bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.665+0000 7fcd51c2f800 1 -- 172.21.15.165:0/1540313556 shutdown_connections 2024-09-22T08:11:26.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.665+0000 7fcd51c2f800 1 -- 172.21.15.165:0/1540313556 wait complete. 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.665+0000 7fcd51c2f800 1 Processor -- start 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.665+0000 7fcd51c2f800 1 -- start start 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.665+0000 7fcd51c2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.665+0000 7fcd51c2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f8848d7850 con 0x55f8848cebe0 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.665+0000 7fcd4f719640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.665+0000 7fcd4f719640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58186/0 (socket says 172.21.15.165:58186) 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.665+0000 7fcd4f719640 1 -- 172.21.15.165:0/443893752 learned_addr learned my addr 172.21.15.165:0/443893752 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.665+0000 7fcd4f719640 1 -- 172.21.15.165:0/443893752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8849c80c0 con 0x55f8848cebe0 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.666+0000 7fcd4f719640 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c7b60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcd400066b0 tx=0x7fcd40001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.666+0000 7fcc3be07640 1 -- 172.21.15.165:0/443893752 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd40022020 con 0x55f8848cebe0 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.666+0000 7fcc3be07640 1 -- 172.21.15.165:0/443893752 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd400148c0 con 0x55f8848cebe0 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.666+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8849c8350 con 0x55f8848cebe0 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.666+0000 7fcc3be07640 1 -- 172.21.15.165:0/443893752 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd40014be0 con 0x55f8848cebe0 2024-09-22T08:11:26.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.666+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8849c8d50 con 0x55f8848cebe0 2024-09-22T08:11:26.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.667+0000 7fcc3be07640 1 -- 172.21.15.165:0/443893752 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcd40025020 con 0x55f8848cebe0 2024-09-22T08:11:26.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.667+0000 7fcc3be07640 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc3403cfb0 0x7fcc3403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.667+0000 7fcc3be07640 1 -- 172.21.15.165:0/443893752 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcd40018030 con 0x55f8848cebe0 2024-09-22T08:11:26.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.667+0000 7fcd4ef18640 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc3403cfb0 0x7fcc3403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.667+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f8848cefe0 0x55f8849cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.667+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8849cf6f0 con 0x55f8848cefe0 2024-09-22T08:11:26.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.667+0000 7fcd4ff1a640 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f8848cefe0 0x55f8849cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.668+0000 7fcd4ef18640 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc3403cfb0 0x7fcc3403f470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcd38057000 tx=0x7fcd38052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.668+0000 7fcd4ff1a640 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f8848cefe0 0x55f8849cf1b0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.668+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/443893752 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd480083e0 con 0x55f8848cefe0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.668+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8849cfa90 con 0x55f8848cefe0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.668+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/443893752 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd480083e0 con 0x55f8848cefe0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.668+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f8849d1590 0x55f8849d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.668+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8849d41a0 con 0x55f8849d1590 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.668+0000 7fcd4f719640 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f8849d1590 0x55f8849d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.669+0000 7fcd4f719640 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f8849d1590 0x55f8849d3a10 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.669+0000 7fcd4f719640 1 -- 172.21.15.165:0/443893752 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcd4001b070 con 0x55f8849d1590 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.669+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8849d02e0 con 0x55f8848cefe0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.669+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/443893752 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd480083e0 con 0x55f8848cefe0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.669+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8849d0710 con 0x55f8848cefe0 2024-09-22T08:11:26.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.670+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/443893752 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcd480083e0 con 0x55f8848cefe0 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.670+0000 7fcd51c2f800 1 Processor -- start 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.670+0000 7fcd51c2f800 1 -- start start 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.670+0000 7fcd51c2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8849e2b60 0x55f8849e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.670+0000 7fcd51c2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f8847c7d50 con 0x55f8849e2b60 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.670+0000 7fcd4ff1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8849e2b60 0x55f8849e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.670+0000 7fcd4ff1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8849e2b60 0x55f8849e2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58200/0 (socket says 172.21.15.165:58200) 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.670+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/4225442960 learned_addr learned my addr 172.21.15.165:0/4225442960 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.671+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/4225442960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8849e35c0 con 0x55f8849e2b60 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.671+0000 7fcd4ff1a640 1 --2- 172.21.15.165:0/4225442960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8849e2b60 0x55f8849e2f80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55f8849c9a90 tx=0x7fcd4800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.671+0000 7fcc39602640 1 -- 172.21.15.165:0/4225442960 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd48007dc0 con 0x55f8849e2b60 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.671+0000 7fcc39602640 1 -- 172.21.15.165:0/4225442960 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4801e020 con 0x55f8849e2b60 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.671+0000 7fcc39602640 1 -- 172.21.15.165:0/4225442960 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd48019570 con 0x55f8849e2b60 2024-09-22T08:11:26.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.671+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4225442960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8849e3df0 con 0x55f8849e2b60 2024-09-22T08:11:26.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.671+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4225442960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8849e4390 con 0x55f8849e2b60 2024-09-22T08:11:26.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.672+0000 7fcc39602640 1 -- 172.21.15.165:0/4225442960 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcd48016040 con 0x55f8849e2b60 2024-09-22T08:11:26.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.672+0000 7fcc39602640 1 --2- 172.21.15.165:0/4225442960 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc2803d000 0x7fcc2803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.672+0000 7fcc39602640 1 -- 172.21.15.165:0/4225442960 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcd4801f030 con 0x55f8849e2b60 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.672+0000 7fcd4f719640 1 --2- 172.21.15.165:0/4225442960 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc2803d000 0x7fcc2803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.672+0000 7fcd51c2f800 1 Processor -- start 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.672+0000 7fcd4f719640 1 --2- 172.21.15.165:0/4225442960 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc2803d000 0x7fcc2803f4c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55f8849c9c50 tx=0x7fcd40014e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.672+0000 7fcd51c2f800 1 -- start start 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.673+0000 7fcd51c2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8848d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.673+0000 7fcd51c2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f8849c0a40 con 0x55f8848d08f0 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.673+0000 7fcd4ff1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8848d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.673+0000 7fcd4ff1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8848d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58216/0 (socket says 172.21.15.165:58216) 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.673+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/4023214125 learned_addr learned my addr 172.21.15.165:0/4023214125 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.673+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/4023214125 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8848d1230 con 0x55f8848d08f0 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.673+0000 7fcd4ff1a640 1 --2- 172.21.15.165:0/4023214125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8848d0cf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcd48016e90 tx=0x7fcd48014710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7132c95f35bb8ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.673+0000 7fcc32ffd640 1 -- 172.21.15.165:0/4023214125 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd48051020 con 0x55f8848d08f0 2024-09-22T08:11:26.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.673+0000 7fcc32ffd640 1 -- 172.21.15.165:0/4023214125 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd48017cd0 con 0x55f8848d08f0 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.673+0000 7fcc32ffd640 1 -- 172.21.15.165:0/4023214125 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4801d070 con 0x55f8848d08f0 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4023214125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 msgr2=0x55f8848d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/4023214125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8848d0cf0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcd48016e90 tx=0x7fcd48014710 comp rx=0 tx=0).stop 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4023214125 shutdown_connections 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/4023214125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8848d0cf0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4023214125 >> 172.21.15.165:0/4023214125 conn(0x55f8849eba40 msgr2=0x55f8849e9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4023214125 shutdown_connections 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4023214125 wait complete. 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 Processor -- start 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 -- start start 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8849f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd51c2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f8848cf7b0 con 0x55f8848d08f0 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd4ff1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8849f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd4ff1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8849f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58220/0 (socket says 172.21.15.165:58220) 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.674+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 learned_addr learned my addr 172.21.15.165:0/2390084495 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.675+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8849f9440 con 0x55f8848d08f0 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.675+0000 7fcd4ff1a640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8849f8ee0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcd480533c0 tx=0x7fcd48054570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.675+0000 7fcc317fa640 1 -- 172.21.15.165:0/2390084495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd480560d0 con 0x55f8848d08f0 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.675+0000 7fcc317fa640 1 -- 172.21.15.165:0/2390084495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd48017e80 con 0x55f8848d08f0 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.675+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8849f96d0 con 0x55f8848d08f0 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.675+0000 7fcc317fa640 1 -- 172.21.15.165:0/2390084495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd48019a50 con 0x55f8848d08f0 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.675+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8849fa050 con 0x55f8848d08f0 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.676+0000 7fcc317fa640 1 -- 172.21.15.165:0/2390084495 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcd48033030 con 0x55f8848d08f0 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.676+0000 7fcc317fa640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc1803cfb0 0x7fcc1803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.676+0000 7fcc317fa640 1 -- 172.21.15.165:0/2390084495 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcd48031070 con 0x55f8848d08f0 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.676+0000 7fcd4f719640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc1803cfb0 0x7fcc1803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.676+0000 7fcd4f719640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc1803cfb0 0x7fcc1803f470 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd40004bb0 tx=0x7fcd40033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.677+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.677+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f884a047e0 0x55f884a06ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.677+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a073f0 con 0x55f884a047e0 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.677+0000 7fcd4ef18640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f884a047e0 0x55f884a06ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.677+0000 7fcd4ef18640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f884a047e0 0x55f884a06ca0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.677+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.677+0000 7fcd51c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.677+0000 7fcd51c2f800 20 realm 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.677+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.677+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a07820 con 0x55f884a047e0 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a080f0 con 0x55f884a047e0 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a08490 con 0x55f884a047e0 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f884a091f0 0x55f884a0b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a0bbf0 con 0x55f884a091f0 2024-09-22T08:11:26.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.678+0000 7fcd4ff1a640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f884a091f0 0x55f884a0b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.679+0000 7fcd4ff1a640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f884a091f0 0x55f884a0b5e0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.679+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.679+0000 7fcd51c2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.679+0000 7fcd51c2f800 20 searching for the correct realm 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.679+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f884a0dba0 0x55f884a10060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.679+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a0dba0 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.679+0000 7fcd4f719640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f884a0dba0 0x55f884a10060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.679+0000 7fcd4f719640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f884a0dba0 0x55f884a10060 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.679+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.679+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a091f0 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.680+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.680+0000 7fcd4ff1a640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcd48057040 0x7fcd480548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.680+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x7fcd48057040 2024-09-22T08:11:26.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.680+0000 7fcd4ef18640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcd48057040 0x7fcd480548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.680+0000 7fcd4ef18640 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcd48057040 0x7fcd480548e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.681+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.681+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a047e0 2024-09-22T08:11:26.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.681+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.681+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a047e0 2024-09-22T08:11:26.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.681+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.681+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x7fcd48057040 2024-09-22T08:11:26.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.681+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.681+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a091f0 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.682+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.682+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a091f0 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.682+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.682+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a0dba0 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.682+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.682+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a047e0 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.682+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.682+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x7fcd48057040 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.683+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.683+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a047e0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.683+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.683+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a091f0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.683+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.683+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a0dba0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.683+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.683+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a0dba0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.683+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.683+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x7fcd48057040 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.684+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.684+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a0dba0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.684+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.684+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a0dba0 2024-09-22T08:11:26.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.684+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.684+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a047e0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.684+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.684+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a047e0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.685+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.685+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x7fcd48057040 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.685+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.685+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a0dba0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.685+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.685+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a091f0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.686+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.686+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a047e0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.686+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.686+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x7fcd48057040 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.686+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.686+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a0dba0 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.687+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.687+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x7fcd48057040 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.687+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.687+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a091f0 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.687+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.687+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a0dba0 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.687+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.687+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x7fcd48057040 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a047e0 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f884a106e0 con 0x55f884a091f0 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a0c5b0 con 0x55f884a047e0 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.688+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a0ce50 con 0x55f884a047e0 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a0c1f0 con 0x55f884a047e0 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 20 zone default found 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 4 Realm: () 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 20 zonegroup default 2024-09-22T08:11:26.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a11010 con 0x7fcd48057040 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a12d60 con 0x55f884a0dba0 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.689+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a131f0 con 0x55f884a0dba0 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.690+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.690+0000 7fcd51c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.690+0000 7fcd51c2f800 20 started sync module instance, tier type = 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.690+0000 7fcd51c2f800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:26.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.690+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a11b30 con 0x55f884a091f0 2024-09-22T08:11:26.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.691+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.691+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94525865402416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a11b30 con 0x55f884a091f0 2024-09-22T08:11:26.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.691+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a13cf0 con 0x55f884a047e0 2024-09-22T08:11:26.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.692+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94525865402416] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.692+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.692+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94525865408448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a11b30 con 0x55f884a047e0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.692+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a147a0 con 0x55f884a0dba0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.693+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94525865408448] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.693+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.693+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94525865399936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a11aa0 con 0x55f884a0dba0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.693+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a15660 con 0x55f884a091f0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.694+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94525865399936] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.694+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.694+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94525865415088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a155d0 con 0x55f884a091f0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.695+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a16520 con 0x55f884a047e0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.695+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.695+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94525865418864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a16490 con 0x55f884a047e0 2024-09-22T08:11:26.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.695+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a17460 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.696+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94525865415088] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.696+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.696+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94525865422640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a17420 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.696+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a17e70 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.696+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94525865418864] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.697+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94525865422640] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.698+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.698+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94525865417296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a179c0 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.698+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a18710 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.698+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94525865417296] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94525865421072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a179c0 con 0x7fcd48057040 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 20 add_watcher() i=0 2024-09-22T08:11:26.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 20 add_watcher() i=1 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 20 add_watcher() i=2 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 20 add_watcher() i=3 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 20 add_watcher() i=4 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 20 add_watcher() i=5 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 20 add_watcher() i=6 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94525865421072] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 20 add_watcher() i=7 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.699+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a1b860 con 0x55f884a047e0 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.700+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.700+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94525865427552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a18b30 con 0x55f884a047e0 2024-09-22T08:11:26.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.701+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94525865427552] v34'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.701+0000 7fcc05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.701+0000 7fcd51c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.701+0000 7fcd51c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.701+0000 7fcd51c2f800 5 note: GC not initialized 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.701+0000 7fcc04fe1640 20 reqs_thread_entry: start 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.701+0000 7fcd51c2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.701+0000 7fcd51c2f800 20 Filter name: none 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.702+0000 7fcb7e7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.702+0000 7fcd51c2f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.702+0000 7fcd51c2f800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.702+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a4ebc0 con 0x55f884a047e0 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.702+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.702+0000 7fcd51c2f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:26.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.702+0000 7fcd51c2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.702+0000 7fcd51c2f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.702+0000 7fcd51c2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.702+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a54c90 con 0x55f884a047e0 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcd51c2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcd51c2f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcd51c2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94525865674528 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f884a50640 con 0x55f884a047e0 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 94525865418864 notify 146028888086 ret 0) ==== 621+0+0 (crc 0 0 0) 0x55f8848d8590 con 0x55f884a047e0 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcc32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94525865418864 notifier 4654 bl.length()=579 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcc32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcc32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcc32ffd640 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcc14003ea0 con 0x55f884a047e0 2024-09-22T08:11:26.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.703+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(64 notify.4 [notify cookie 94525865674528 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.704+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.704+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 94525865674528 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcd3805fb50 con 0x55f884a047e0 2024-09-22T08:11:26.717 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:26.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.705+0000 7fcc05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.705+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94525865427552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a4c900 con 0x55f884a047e0 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.706+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94525865427552] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.706+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94525865402416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a4c900 con 0x55f884a091f0 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.707+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94525865402416] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.707+0000 7fcd51c2f800 20 remove_watcher() i=0 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.707+0000 7fcd51c2f800 2 removed watcher, disabling cache 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.707+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94525865408448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a4c900 con 0x55f884a047e0 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.708+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94525865408448] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.708+0000 7fcd51c2f800 20 remove_watcher() i=1 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.708+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94525865399936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a4c900 con 0x55f884a0dba0 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.709+0000 7fcd4f719640 1 -- 172.21.15.165:0/2390084495 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94525865399936] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4001b070 con 0x55f884a0dba0 2024-09-22T08:11:26.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.709+0000 7fcd51c2f800 20 remove_watcher() i=2 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.709+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94525865415088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a137c0 con 0x55f884a091f0 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.710+0000 7fcd4ff1a640 1 -- 172.21.15.165:0/2390084495 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94525865415088] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd480083e0 con 0x55f884a091f0 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.710+0000 7fcd51c2f800 20 remove_watcher() i=3 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.710+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94525865418864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a11680 con 0x55f884a047e0 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.711+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94525865418864] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x55f884a047e0 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.711+0000 7fcd51c2f800 20 remove_watcher() i=4 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.711+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94525865422640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a151b0 con 0x7fcd48057040 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.712+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94525865422640] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.712+0000 7fcd51c2f800 20 remove_watcher() i=5 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.712+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94525865417296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a137c0 con 0x7fcd48057040 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.713+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94525865417296] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.713+0000 7fcd51c2f800 20 remove_watcher() i=6 2024-09-22T08:11:26.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.713+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94525865421072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f884a16070 con 0x7fcd48057040 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94525865421072] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd38051070 con 0x7fcd48057040 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 20 remove_watcher() i=7 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcd48057040 msgr2=0x7fcd480548e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcd48057040 0x7fcd480548e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f884a047e0 msgr2=0x55f884a06ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f884a047e0 0x55f884a06ca0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f884a091f0 msgr2=0x55f884a0b5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f884a091f0 0x55f884a0b5e0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f884a0dba0 msgr2=0x55f884a10060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f884a0dba0 0x55f884a10060 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc1803cfb0 msgr2=0x7fcc1803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc1803cfb0 0x7fcc1803f470 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd40004bb0 tx=0x7fcd40033000 comp rx=0 tx=0).stop 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 msgr2=0x55f8849f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/2390084495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848d08f0 0x55f8849f8ee0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcd480533c0 tx=0x7fcd48054570 comp rx=0 tx=0).stop 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 reap_dead start 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd4ef18640 1 -- 172.21.15.165:0/2390084495 reap_dead start 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 shutdown_connections 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 >> 172.21.15.165:0/2390084495 conn(0x55f8849eba40 msgr2=0x55f8849e9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 shutdown_connections 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.714+0000 7fcd51c2f800 1 -- 172.21.15.165:0/2390084495 wait complete. 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4225442960 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc2803d000 msgr2=0x7fcc2803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/4225442960 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc2803d000 0x7fcc2803f4c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55f8849c9c50 tx=0x7fcd40014e90 comp rx=0 tx=0).stop 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4225442960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8849e2b60 msgr2=0x55f8849e2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/4225442960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8849e2b60 0x55f8849e2f80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55f8849c9a90 tx=0x7fcd4800af40 comp rx=0 tx=0).stop 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4225442960 shutdown_connections 2024-09-22T08:11:26.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/4225442960 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc2803d000 0x7fcc2803f4c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/4225442960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8849e2b60 0x55f8849e2f80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4225442960 >> 172.21.15.165:0/4225442960 conn(0x55f8849d6f10 msgr2=0x55f8849d72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4225442960 shutdown_connections 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/4225442960 wait complete. 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f8848cefe0 msgr2=0x55f8849cf1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f8848cefe0 0x55f8849cf1b0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f8849d1590 msgr2=0x55f8849d3a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f8849d1590 0x55f8849d3a10 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc3403cfb0 msgr2=0x7fcc3403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc3403cfb0 0x7fcc3403f470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcd38057000 tx=0x7fcd38052000 comp rx=0 tx=0).stop 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 msgr2=0x55f8849c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c7b60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcd400066b0 tx=0x7fcd40001250 comp rx=0 tx=0).stop 2024-09-22T08:11:26.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 shutdown_connections 2024-09-22T08:11:26.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f8849d1590 0x55f8849d3a10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f8848cefe0 0x55f8849cf1b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcc3403cfb0 0x7fcc3403f470 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 --2- 172.21.15.165:0/443893752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f8848cebe0 0x55f8849c7b60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 >> 172.21.15.165:0/443893752 conn(0x55f8848ca310 msgr2=0x55f8849c1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 shutdown_connections 2024-09-22T08:11:26.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.715+0000 7fcd51c2f800 1 -- 172.21.15.165:0/443893752 wait complete. 2024-09-22T08:11:26.728 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:26.728 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-22T08:11:26.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-22T08:11:26.728 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-22T08:11:26.774 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:26.775 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:26.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.774+0000 7f6ce441b800 1 Processor -- start 2024-09-22T08:11:26.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.775+0000 7f6ce441b800 1 -- start start 2024-09-22T08:11:26.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.775+0000 7f6ce441b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556068dcac60 0x556068dcd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.775+0000 7f6ce441b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556068c56a20 con 0x556068dcd700 2024-09-22T08:11:26.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.775+0000 7f6ce441b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556068c567d0 con 0x556068dcac60 2024-09-22T08:11:26.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.775+0000 7f6cdfbeb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556068dcac60 0x556068dcd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.775+0000 7f6cd73ea640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x556068dcd700 0x556068dcfbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:36154/0 (socket says 172.21.15.165:36154) 2024-09-22T08:11:26.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.775+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1222413048 learned_addr learned my addr 172.21.15.165:0/1222413048 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:26.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.775+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1222413048 >> v1:172.21.15.53:6789/0 conn(0x556068dcd700 legacy=0x556068dcfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.775+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1222413048 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556068dd2480 con 0x556068dcac60 2024-09-22T08:11:26.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.777+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/1222413048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068dcd050 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000a470 tx=0x7f6cd0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839b735c16f9bf22 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.778+0000 7f6cdf3ea640 1 -- 172.21.15.165:0/1222413048 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd0053570 con 0x556068dcac60 2024-09-22T08:11:26.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.778+0000 7f6cdf3ea640 1 -- 172.21.15.165:0/1222413048 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd0058070 con 0x556068dcac60 2024-09-22T08:11:26.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.778+0000 7f6cdf3ea640 1 -- 172.21.15.165:0/1222413048 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd0053880 con 0x556068dcac60 2024-09-22T08:11:26.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.778+0000 7f6ce441b800 1 -- 172.21.15.165:0/1222413048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 msgr2=0x556068dcd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.778+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1222413048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068dcd050 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000a470 tx=0x7f6cd0045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:26.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.778+0000 7f6ce441b800 1 -- 172.21.15.165:0/1222413048 shutdown_connections 2024-09-22T08:11:26.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.778+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1222413048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068dcd050 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.778+0000 7f6ce441b800 1 -- 172.21.15.165:0/1222413048 >> 172.21.15.165:0/1222413048 conn(0x556068dc5310 msgr2=0x556068dc7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.778+0000 7f6ce441b800 1 -- 172.21.15.165:0/1222413048 shutdown_connections 2024-09-22T08:11:26.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.778+0000 7f6ce441b800 1 -- 172.21.15.165:0/1222413048 wait complete. 2024-09-22T08:11:26.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.792+0000 7f6ce441b800 1 Processor -- start 2024-09-22T08:11:26.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.792+0000 7f6ce441b800 1 -- start start 2024-09-22T08:11:26.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.792+0000 7f6ce441b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068eb9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.792+0000 7f6ce441b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556068c63dd0 con 0x556068dcac60 2024-09-22T08:11:26.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.792+0000 7f6cdfbeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068eb9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.792+0000 7f6cdfbeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068eb9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58248/0 (socket says 172.21.15.165:58248) 2024-09-22T08:11:26.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.792+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/3126351115 learned_addr learned my addr 172.21.15.165:0/3126351115 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.793+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/3126351115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556068eba540 con 0x556068dcac60 2024-09-22T08:11:26.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.793+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/3126351115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068eb9f50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0025c20 tx=0x7f6cd0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bf830d3f6f9797 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.793+0000 7f6bcde0b640 1 -- 172.21.15.165:0/3126351115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd0053a20 con 0x556068dcac60 2024-09-22T08:11:26.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.793+0000 7f6bcde0b640 1 -- 172.21.15.165:0/3126351115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd0063070 con 0x556068dcac60 2024-09-22T08:11:26.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.793+0000 7f6bcde0b640 1 -- 172.21.15.165:0/3126351115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd0053cf0 con 0x556068dcac60 2024-09-22T08:11:26.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 -- 172.21.15.165:0/3126351115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 msgr2=0x556068eb9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 --2- 172.21.15.165:0/3126351115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068eb9f50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0025c20 tx=0x7f6cd0051000 comp rx=0 tx=0).stop 2024-09-22T08:11:26.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 -- 172.21.15.165:0/3126351115 shutdown_connections 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 --2- 172.21.15.165:0/3126351115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068eb9f50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 -- 172.21.15.165:0/3126351115 >> 172.21.15.165:0/3126351115 conn(0x556068dc5310 msgr2=0x556068eb58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 -- 172.21.15.165:0/3126351115 shutdown_connections 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 -- 172.21.15.165:0/3126351115 wait complete. 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 Processor -- start 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 -- start start 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068ec1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.794+0000 7f6ce441b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556068dd1720 con 0x556068dcac60 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.795+0000 7f6cdfbeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068ec1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.795+0000 7f6cdfbeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068ec1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58264/0 (socket says 172.21.15.165:58264) 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.795+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/71222870 learned_addr learned my addr 172.21.15.165:0/71222870 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.795+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/71222870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556068ec1ea0 con 0x556068dcac60 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.795+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068ec1940 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0025c20 tx=0x7f6cd0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.795+0000 7f6bc7fff640 1 -- 172.21.15.165:0/71222870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd006c030 con 0x556068dcac60 2024-09-22T08:11:26.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.795+0000 7f6bc7fff640 1 -- 172.21.15.165:0/71222870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd0068660 con 0x556068dcac60 2024-09-22T08:11:26.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.795+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556068ec2130 con 0x556068dcac60 2024-09-22T08:11:26.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.795+0000 7f6bc7fff640 1 -- 172.21.15.165:0/71222870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd0068940 con 0x556068dcac60 2024-09-22T08:11:26.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.795+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556068ec2b30 con 0x556068dcac60 2024-09-22T08:11:26.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.796+0000 7f6bc7fff640 1 -- 172.21.15.165:0/71222870 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6cd0068ae0 con 0x556068dcac60 2024-09-22T08:11:26.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.796+0000 7f6bc7fff640 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bc803cfb0 0x7f6bc803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.796+0000 7f6bc7fff640 1 -- 172.21.15.165:0/71222870 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6cd0098bd0 con 0x556068dcac60 2024-09-22T08:11:26.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.796+0000 7f6cd73ea640 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bc803cfb0 0x7f6bc803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.797+0000 7f6ce441b800 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068dcd700 0x556068ec8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.797+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068ec94d0 con 0x556068dcd700 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.797+0000 7f6ce03ec640 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068dcd700 0x556068ec8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.797+0000 7f6cd73ea640 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bc803cfb0 0x7f6bc803f470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8001d70 tx=0x7f6cc80012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.797+0000 7f6ce03ec640 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068dcd700 0x556068ec8f90 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.797+0000 7f6ce03ec640 1 -- 172.21.15.165:0/71222870 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cd800a4d0 con 0x556068dcd700 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.797+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068ec9870 con 0x556068dcd700 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.797+0000 7f6ce03ec640 1 -- 172.21.15.165:0/71222870 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6cd800a4d0 con 0x556068dcd700 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.798+0000 7f6ce441b800 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068ecb370 0x556068ecd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.798+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068ecdfa0 con 0x556068ecb370 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.798+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068ecb370 0x556068ecd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.798+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068ecb370 0x556068ecd810 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.798+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/71222870 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6cd0051070 con 0x556068ecb370 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.798+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068eca0c0 con 0x556068dcd700 2024-09-22T08:11:26.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.798+0000 7f6ce03ec640 1 -- 172.21.15.165:0/71222870 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6cd800a4d0 con 0x556068dcd700 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.798+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068eca520 con 0x556068dcd700 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.799+0000 7f6ce03ec640 1 -- 172.21.15.165:0/71222870 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6cd800a4d0 con 0x556068dcd700 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.799+0000 7f6ce441b800 1 Processor -- start 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.799+0000 7f6ce441b800 1 -- start start 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.799+0000 7f6ce441b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dc9e20 0x556068ee2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.799+0000 7f6ce441b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556068cc2d50 con 0x556068dc9e20 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.799+0000 7f6ce03ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dc9e20 0x556068ee2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.799+0000 7f6ce03ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dc9e20 0x556068ee2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58272/0 (socket says 172.21.15.165:58272) 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.799+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1886348874 learned_addr learned my addr 172.21.15.165:0/1886348874 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.800+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1886348874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556068dca240 con 0x556068dc9e20 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.800+0000 7f6ce03ec640 1 --2- 172.21.15.165:0/1886348874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dc9e20 0x556068ee2b60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x556068ec2ef0 tx=0x7f6cd8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.800+0000 7f6bc57fa640 1 -- 172.21.15.165:0/1886348874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd8014450 con 0x556068dc9e20 2024-09-22T08:11:26.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.800+0000 7f6bc57fa640 1 -- 172.21.15.165:0/1886348874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd8014610 con 0x556068dc9e20 2024-09-22T08:11:26.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.800+0000 7f6ce441b800 1 -- 172.21.15.165:0/1886348874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556068ee30a0 con 0x556068dc9e20 2024-09-22T08:11:26.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.800+0000 7f6bc57fa640 1 -- 172.21.15.165:0/1886348874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd8014930 con 0x556068dc9e20 2024-09-22T08:11:26.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.800+0000 7f6ce441b800 1 -- 172.21.15.165:0/1886348874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556068ee3530 con 0x556068dc9e20 2024-09-22T08:11:26.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.801+0000 7f6bc57fa640 1 -- 172.21.15.165:0/1886348874 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6cd8011040 con 0x556068dc9e20 2024-09-22T08:11:26.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.801+0000 7f6bc57fa640 1 --2- 172.21.15.165:0/1886348874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bb803cfb0 0x7f6bb803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.801+0000 7f6bc57fa640 1 -- 172.21.15.165:0/1886348874 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6cd801e070 con 0x556068dc9e20 2024-09-22T08:11:26.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.801+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/1886348874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bb803cfb0 0x7f6bb803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.801+0000 7f6ce441b800 1 Processor -- start 2024-09-22T08:11:26.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.801+0000 7f6ce441b800 1 -- start start 2024-09-22T08:11:26.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.801+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/1886348874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bb803cfb0 0x7f6bb803f470 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x556068ec3a40 tx=0x7f6cd007b9a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.802+0000 7f6ce441b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068eecb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.802+0000 7f6ce441b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556068eba910 con 0x556068eec750 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.802+0000 7f6ce03ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068eecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.802+0000 7f6ce03ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068eecb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58282/0 (socket says 172.21.15.165:58282) 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.802+0000 7f6ce03ec640 1 -- 172.21.15.165:0/953895428 learned_addr learned my addr 172.21.15.165:0/953895428 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.802+0000 7f6ce03ec640 1 -- 172.21.15.165:0/953895428 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556068eed140 con 0x556068eec750 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.802+0000 7f6ce03ec640 1 --2- 172.21.15.165:0/953895428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068eecb50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8016fd0 tx=0x7f6cd8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2409e6df7c01c35f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.802+0000 7f6bbeffd640 1 -- 172.21.15.165:0/953895428 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd8011da0 con 0x556068eec750 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.802+0000 7f6bbeffd640 1 -- 172.21.15.165:0/953895428 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd80532d0 con 0x556068eec750 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.802+0000 7f6bbeffd640 1 -- 172.21.15.165:0/953895428 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd8016910 con 0x556068eec750 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 -- 172.21.15.165:0/953895428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 msgr2=0x556068eecb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 --2- 172.21.15.165:0/953895428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068eecb50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8016fd0 tx=0x7f6cd8011a80 comp rx=0 tx=0).stop 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 -- 172.21.15.165:0/953895428 shutdown_connections 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 --2- 172.21.15.165:0/953895428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068eecb50 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 -- 172.21.15.165:0/953895428 >> 172.21.15.165:0/953895428 conn(0x556068ee8b50 msgr2=0x556068ee6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 -- 172.21.15.165:0/953895428 shutdown_connections 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 -- 172.21.15.165:0/953895428 wait complete. 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 Processor -- start 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 -- start start 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068ef3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce441b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556068eed760 con 0x556068eec750 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce03ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068ef3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce03ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068ef3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58298/0 (socket says 172.21.15.165:58298) 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.803+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 learned_addr learned my addr 172.21.15.165:0/1986576715 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.804+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556068ef4280 con 0x556068eec750 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.804+0000 7f6ce03ec640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068ef3d20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8053610 tx=0x7f6cd8054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.804+0000 7f6bbd7fa640 1 -- 172.21.15.165:0/1986576715 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd8031020 con 0x556068eec750 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.804+0000 7f6bbd7fa640 1 -- 172.21.15.165:0/1986576715 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd80168f0 con 0x556068eec750 2024-09-22T08:11:26.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.804+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556068ef4510 con 0x556068eec750 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.804+0000 7f6bbd7fa640 1 -- 172.21.15.165:0/1986576715 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cd8014c00 con 0x556068eec750 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.804+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556068ef4e90 con 0x556068eec750 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.805+0000 7f6bbd7fa640 1 -- 172.21.15.165:0/1986576715 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6cd8034020 con 0x556068eec750 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.805+0000 7f6bbd7fa640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6ba803cfb0 0x7f6ba803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.805+0000 7f6bbd7fa640 1 -- 172.21.15.165:0/1986576715 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6cd800e040 con 0x556068eec750 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.805+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6ba803cfb0 0x7f6ba803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6ba803cfb0 0x7f6ba803f470 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6cd007ba50 tx=0x7f6cd0080000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068eff7f0 0x556068f01cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f02400 con 0x556068eff7f0 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6cd73ea640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068eff7f0 0x556068f01cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6cd73ea640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068eff7f0 0x556068f01cb0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6ce441b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6ce441b800 20 realm 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.806+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068efeb40 con 0x556068eff7f0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f02ef0 con 0x556068eff7f0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f037c0 con 0x556068eff7f0 2024-09-22T08:11:26.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068f041e0 0x556068f065d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f06d10 con 0x556068f041e0 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce03ec640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068f041e0 0x556068f065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.807+0000 7f6ce03ec640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068f041e0 0x556068f065d0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.808+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.808+0000 7f6ce441b800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.808+0000 7f6ce441b800 20 searching for the correct realm 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.808+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556068f08cc0 0x556068f0b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.808+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f08cc0 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.808+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556068f08cc0 0x556068f0b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.808+0000 7f6cdfbeb640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556068f08cc0 0x556068f0b180 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.808+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.808+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f041e0 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.809+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.809+0000 7f6ce03ec640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6cd8036020 0x7f6cd8001910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.809+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x7f6cd8036020 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.809+0000 7f6cd73ea640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6cd8036020 0x7f6cd8001910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.809+0000 7f6cd73ea640 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6cd8036020 0x7f6cd8001910 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.810+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.810+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068eff7f0 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.810+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.810+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068eff7f0 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.810+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.810+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x7f6cd8036020 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.810+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.810+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f041e0 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.810+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.811+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f041e0 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.811+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.811+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f08cc0 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.811+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.811+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068eff7f0 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.811+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.811+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x7f6cd8036020 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.811+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.811+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068eff7f0 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.812+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.812+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f041e0 2024-09-22T08:11:26.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.812+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.812+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f08cc0 2024-09-22T08:11:26.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.812+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.812+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f08cc0 2024-09-22T08:11:26.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.812+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.812+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x7f6cd8036020 2024-09-22T08:11:26.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.813+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.813+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f08cc0 2024-09-22T08:11:26.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.813+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.813+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f08cc0 2024-09-22T08:11:26.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.813+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.813+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068eff7f0 2024-09-22T08:11:26.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.813+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.813+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068eff7f0 2024-09-22T08:11:26.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.813+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.813+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x7f6cd8036020 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.814+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.814+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f08cc0 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.814+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.814+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f041e0 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.814+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.814+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068eff7f0 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.814+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.814+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x7f6cd8036020 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.815+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.815+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f08cc0 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.815+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.815+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x7f6cd8036020 2024-09-22T08:11:26.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.815+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.815+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f041e0 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.816+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.816+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f08cc0 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.816+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.816+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x7f6cd8036020 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.816+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.816+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068eff7f0 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556068f0b800 con 0x556068f041e0 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:26.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f076d0 con 0x556068eff7f0 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f07f70 con 0x556068eff7f0 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.817+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f0bc80 con 0x556068eff7f0 2024-09-22T08:11:26.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 20 zone default found 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 4 Realm: () 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 20 zonegroup default 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f0c040 con 0x7f6cd8036020 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f0de70 con 0x556068f08cc0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.818+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f0e2e0 con 0x556068f08cc0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.819+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.819+0000 7f6ce441b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.819+0000 7f6ce441b800 20 started sync module instance, tier type = 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.819+0000 7f6ce441b800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.819+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f0d310 con 0x556068f041e0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.820+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.820+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93872565835520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f0cf70 con 0x556068f041e0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.820+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f0f210 con 0x556068eff7f0 2024-09-22T08:11:26.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.821+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93872565835520] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.821+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.821+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93872565839680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f0f210 con 0x556068eff7f0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.821+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f0fc80 con 0x556068f08cc0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.822+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.822+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93872565843824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f10520 con 0x556068f08cc0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.822+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93872565839680] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.822+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f11020 con 0x556068f041e0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.823+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93872565843824] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.823+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.823+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93872565848848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f10fe0 con 0x556068f041e0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.823+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f119a0 con 0x556068eff7f0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.824+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.824+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93872565851376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f11dc0 con 0x556068eff7f0 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.824+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f128c0 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.824+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93872565848848] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.825+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93872565851376] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.825+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.825+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93872565855152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f11910 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.825+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f13160 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.826+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93872565855152] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.826+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.826+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93872565846128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f11910 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.826+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f13730 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.827+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93872565846128] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.827+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.827+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93872565857376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f13730 con 0x7f6cd8036020 2024-09-22T08:11:26.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.827+0000 7f6ce441b800 20 add_watcher() i=0 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.827+0000 7f6ce441b800 20 add_watcher() i=1 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.827+0000 7f6ce441b800 20 add_watcher() i=2 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.827+0000 7f6ce441b800 20 add_watcher() i=3 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.827+0000 7f6ce441b800 20 add_watcher() i=4 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.827+0000 7f6ce441b800 20 add_watcher() i=5 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.827+0000 7f6ce441b800 20 add_watcher() i=6 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.828+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93872565857376] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.828+0000 7f6ce441b800 20 add_watcher() i=7 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.828+0000 7f6ce441b800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.828+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f16c00 con 0x556068eff7f0 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.829+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.829+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93872565859872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f13fb0 con 0x556068eff7f0 2024-09-22T08:11:26.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.830+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93872565859872] v34'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.830+0000 7f6b967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.830+0000 7f6ce441b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:26.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.830+0000 7f6ce441b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:26.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.830+0000 7f6ce441b800 5 note: GC not initialized 2024-09-22T08:11:26.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.830+0000 7f6b957e2640 20 reqs_thread_entry: start 2024-09-22T08:11:26.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.830+0000 7f6ce441b800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:26.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.830+0000 7f6ce441b800 20 Filter name: none 2024-09-22T08:11:26.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.830+0000 7f6b8e7fc640 20 reqs_thread_entry: start 2024-09-22T08:11:26.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.830+0000 7f6ce441b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.831+0000 7f6ce441b800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.831+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f49f70 con 0x556068eff7f0 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.831+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.831+0000 7f6ce441b800 20 rados_obj.operate() r=0 bl.length=403 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.831+0000 7f6ce441b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.831+0000 7f6ce441b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.831+0000 7f6ce441b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.831+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f50140 con 0x556068eff7f0 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.832+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.832+0000 7f6ce441b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.832+0000 7f6ce441b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:26.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.832+0000 7f6ce441b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:11:26.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.832+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93872566106880 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556068f4b9f0 con 0x556068eff7f0 2024-09-22T08:11:26.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.832+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify (1) cookie 93872565851376 notify 146028888087 ret 0) ==== 609+0+0 (crc 0 0 0) 0x556068c56a20 con 0x556068eff7f0 2024-09-22T08:11:26.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.832+0000 7f6bbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 93872565851376 notifier 4661 bl.length()=567 2024-09-22T08:11:26.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.833+0000 7f6bbeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-22T08:11:26.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.833+0000 7f6bbeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:26.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.833+0000 7f6bbeffd640 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6ba4003ea0 con 0x556068eff7f0 2024-09-22T08:11:26.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.833+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(64 notify.4 [notify cookie 93872566106880 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.833+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.833+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== watch-notify(notify_complete (2) cookie 93872566106880 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6cc802bac0 con 0x556068eff7f0 2024-09-22T08:11:26.843 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-22T08:11:03.556482Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:11:03.556472Z","tags":[],"group_ids":[]} 2024-09-22T08:11:26.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.834+0000 7f6b967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.834+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93872565859872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f47cb0 con 0x556068eff7f0 2024-09-22T08:11:26.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.835+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93872565859872] v34'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.835+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93872565835520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f47cb0 con 0x556068f041e0 2024-09-22T08:11:26.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.836+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93872565835520] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.836+0000 7f6ce441b800 20 remove_watcher() i=0 2024-09-22T08:11:26.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.836+0000 7f6ce441b800 2 removed watcher, disabling cache 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.836+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93872565839680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f47cb0 con 0x556068eff7f0 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.837+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93872565839680] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.837+0000 7f6ce441b800 20 remove_watcher() i=1 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.837+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93872565843824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f47cb0 con 0x556068f08cc0 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.838+0000 7f6cdfbeb640 1 -- 172.21.15.165:0/1986576715 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93872565843824] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cd0090070 con 0x556068f08cc0 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.838+0000 7f6ce441b800 20 remove_watcher() i=2 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.838+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93872565848848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f47cb0 con 0x556068f041e0 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.839+0000 7f6ce03ec640 1 -- 172.21.15.165:0/1986576715 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93872565848848] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cd802a070 con 0x556068f041e0 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.839+0000 7f6ce441b800 20 remove_watcher() i=3 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.839+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93872565851376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f47cb0 con 0x556068eff7f0 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.840+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93872565851376] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x556068eff7f0 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.840+0000 7f6ce441b800 20 remove_watcher() i=4 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.840+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93872565855152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f47cb0 con 0x7f6cd8036020 2024-09-22T08:11:26.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.841+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93872565855152] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.841+0000 7f6ce441b800 20 remove_watcher() i=5 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.841+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93872565846128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f47cb0 con 0x7f6cd8036020 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.842+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93872565846128] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.842+0000 7f6ce441b800 20 remove_watcher() i=6 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.842+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93872565857376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556068f47cb0 con 0x7f6cd8036020 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.843+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93872565857376] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cc8009050 con 0x7f6cd8036020 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.843+0000 7f6ce441b800 20 remove_watcher() i=7 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.843+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6cd8036020 msgr2=0x7f6cd8001910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.843+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6cd8036020 0x7f6cd8001910 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.843+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068eff7f0 msgr2=0x556068f01cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.843+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068eff7f0 0x556068f01cb0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.843+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068f041e0 msgr2=0x556068f065d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.843+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068f041e0 0x556068f065d0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.843+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556068f08cc0 msgr2=0x556068f0b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.843+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x556068f08cc0 0x556068f0b180 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6ba803cfb0 msgr2=0x7f6ba803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6ba803cfb0 0x7f6ba803f470 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6cd007ba50 tx=0x7f6cd0080000 comp rx=0 tx=0).stop 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 msgr2=0x556068ef3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068ef3d20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8053610 tx=0x7f6cd8054720 comp rx=0 tx=0).stop 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6cd73ea640 1 -- 172.21.15.165:0/1986576715 reap_dead start 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 shutdown_connections 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1986576715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068eec750 0x556068ef3d20 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 >> 172.21.15.165:0/1986576715 conn(0x556068ee8b50 msgr2=0x556068ee6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 shutdown_connections 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1986576715 wait complete. 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1886348874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bb803cfb0 msgr2=0x7f6bb803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1886348874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bb803cfb0 0x7f6bb803f470 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x556068ec3a40 tx=0x7f6cd007b9a0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1886348874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dc9e20 msgr2=0x556068ee2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1886348874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dc9e20 0x556068ee2b60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x556068ec2ef0 tx=0x7f6cd8018830 comp rx=0 tx=0).stop 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1886348874 shutdown_connections 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1886348874 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bb803cfb0 0x7f6bb803f470 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 --2- 172.21.15.165:0/1886348874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dc9e20 0x556068ee2b60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1886348874 >> 172.21.15.165:0/1886348874 conn(0x556068ed0d60 msgr2=0x556068ed1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1886348874 shutdown_connections 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/1886348874 wait complete. 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068dcd700 msgr2=0x556068ec8f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068dcd700 0x556068ec8f90 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068ecb370 msgr2=0x556068ecd810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.844+0000 7f6ce441b800 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068ecb370 0x556068ecd810 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bc803cfb0 msgr2=0x7f6bc803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bc803cfb0 0x7f6bc803f470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8001d70 tx=0x7f6cc80012d0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 msgr2=0x556068ec1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068ec1940 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0025c20 tx=0x7f6cd0002fb0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 shutdown_connections 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x556068ecb370 0x556068ecd810 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556068dcd700 0x556068ec8f90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6bc803cfb0 0x7f6bc803f470 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 --2- 172.21.15.165:0/71222870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556068dcac60 0x556068ec1940 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 >> 172.21.15.165:0/71222870 conn(0x556068dc5310 msgr2=0x556068eb40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 shutdown_connections 2024-09-22T08:11:26.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.845+0000 7f6ce441b800 1 -- 172.21.15.165:0/71222870 wait complete. 2024-09-22T08:11:26.854 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-22T08:11:03.556482Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:11:03.556472Z', 'tags': [], 'group_ids': []} 2024-09-22T08:11:26.864 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:26.864 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-22T08:11:26.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-22T08:11:26.864 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-22T08:11:26.911 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:11:26.911 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:11:26.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.911+0000 7f011b725800 1 Processor -- start 2024-09-22T08:11:26.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.911+0000 7f011b725800 1 -- start start 2024-09-22T08:11:26.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.911+0000 7f011b725800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56395f90f8e0 0x56395f911da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.911+0000 7f011b725800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56395f797a20 con 0x56395f90bda0 2024-09-22T08:11:26.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.911+0000 7f011b725800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56395f7977d0 con 0x56395f90f8e0 2024-09-22T08:11:26.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.911+0000 7f010ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56395f90f8e0 0x56395f911da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.911+0000 7f01174a2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56395f90bda0 0x56395f90e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:36160/0 (socket says 172.21.15.165:36160) 2024-09-22T08:11:26.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.911+0000 7f01174a2640 1 -- 172.21.15.165:0/719781103 learned_addr learned my addr 172.21.15.165:0/719781103 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:11:26.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.912+0000 7f010ffff640 1 -- 172.21.15.165:0/719781103 >> v1:172.21.15.53:6789/0 conn(0x56395f90bda0 legacy=0x56395f90e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.912+0000 7f010ffff640 1 -- 172.21.15.165:0/719781103 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395f9134b0 con 0x56395f90f8e0 2024-09-22T08:11:26.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.913+0000 7f010ffff640 1 --2- 172.21.15.165:0/719781103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90f8e0 0x56395f911da0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f010000a470 tx=0x7f0100045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d1b011e5b9880b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.914+0000 7f0116ca1640 1 -- 172.21.15.165:0/719781103 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0100053570 con 0x56395f90f8e0 2024-09-22T08:11:26.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.914+0000 7f0116ca1640 1 -- 172.21.15.165:0/719781103 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0100058070 con 0x56395f90f8e0 2024-09-22T08:11:26.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.914+0000 7f0116ca1640 1 -- 172.21.15.165:0/719781103 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0100053880 con 0x56395f90f8e0 2024-09-22T08:11:26.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.914+0000 7f011b725800 1 -- 172.21.15.165:0/719781103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90f8e0 msgr2=0x56395f911da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.914+0000 7f011b725800 1 --2- 172.21.15.165:0/719781103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90f8e0 0x56395f911da0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f010000a470 tx=0x7f0100045a20 comp rx=0 tx=0).stop 2024-09-22T08:11:26.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.914+0000 7f011b725800 1 -- 172.21.15.165:0/719781103 shutdown_connections 2024-09-22T08:11:26.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.914+0000 7f011b725800 1 --2- 172.21.15.165:0/719781103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90f8e0 0x56395f911da0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.914+0000 7f011b725800 1 -- 172.21.15.165:0/719781103 >> 172.21.15.165:0/719781103 conn(0x56395f906310 msgr2=0x56395f908790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.914+0000 7f011b725800 1 -- 172.21.15.165:0/719781103 shutdown_connections 2024-09-22T08:11:26.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.914+0000 7f011b725800 1 -- 172.21.15.165:0/719781103 wait complete. 2024-09-22T08:11:26.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.928+0000 7f011b725800 1 Processor -- start 2024-09-22T08:11:26.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.928+0000 7f011b725800 1 -- start start 2024-09-22T08:11:26.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.928+0000 7f011b725800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395f9faf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.928+0000 7f011b725800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56395f7a4dd0 con 0x56395f90bda0 2024-09-22T08:11:26.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.928+0000 7f01174a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395f9faf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.928+0000 7f01174a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395f9faf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58320/0 (socket says 172.21.15.165:58320) 2024-09-22T08:11:26.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.928+0000 7f01174a2640 1 -- 172.21.15.165:0/2693002030 learned_addr learned my addr 172.21.15.165:0/2693002030 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.929+0000 7f01174a2640 1 -- 172.21.15.165:0/2693002030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395f9fb510 con 0x56395f90bda0 2024-09-22T08:11:26.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.929+0000 7f01174a2640 1 --2- 172.21.15.165:0/2693002030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395f9faf20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0108001df0 tx=0x7f010800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af73904eda42e4ff server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.929+0000 7f000560a640 1 -- 172.21.15.165:0/2693002030 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0108012020 con 0x56395f90bda0 2024-09-22T08:11:26.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.929+0000 7f000560a640 1 -- 172.21.15.165:0/2693002030 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010800e470 con 0x56395f90bda0 2024-09-22T08:11:26.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.929+0000 7f000560a640 1 -- 172.21.15.165:0/2693002030 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f010800e7f0 con 0x56395f90bda0 2024-09-22T08:11:26.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 -- 172.21.15.165:0/2693002030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 msgr2=0x56395f9faf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 --2- 172.21.15.165:0/2693002030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395f9faf20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0108001df0 tx=0x7f010800b6c0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 -- 172.21.15.165:0/2693002030 shutdown_connections 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 --2- 172.21.15.165:0/2693002030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395f9faf20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 -- 172.21.15.165:0/2693002030 >> 172.21.15.165:0/2693002030 conn(0x56395f906310 msgr2=0x56395f9f68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 -- 172.21.15.165:0/2693002030 shutdown_connections 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 -- 172.21.15.165:0/2693002030 wait complete. 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 Processor -- start 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 -- start start 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395fa02a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f011b725800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56395f912750 con 0x56395f90bda0 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f01174a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395fa02a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f01174a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395fa02a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58322/0 (socket says 172.21.15.165:58322) 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.930+0000 7f01174a2640 1 -- 172.21.15.165:0/35211451 learned_addr learned my addr 172.21.15.165:0/35211451 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.931+0000 7f01174a2640 1 -- 172.21.15.165:0/35211451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395fa02f90 con 0x56395f90bda0 2024-09-22T08:11:26.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.931+0000 7f01174a2640 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395fa02a30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x56395f9fbeb0 tx=0x7f0108000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.931+0000 7f0003e07640 1 -- 172.21.15.165:0/35211451 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0108012030 con 0x56395f90bda0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.931+0000 7f0003e07640 1 -- 172.21.15.165:0/35211451 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010801a6d0 con 0x56395f90bda0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.931+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56395fa03220 con 0x56395f90bda0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.931+0000 7f0003e07640 1 -- 172.21.15.165:0/35211451 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f010801a9d0 con 0x56395f90bda0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.931+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56395fa03c20 con 0x56395f90bda0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.932+0000 7f0003e07640 1 -- 172.21.15.165:0/35211451 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0108015020 con 0x56395f90bda0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.932+0000 7f0003e07640 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efffc03cfb0 0x7efffc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.932+0000 7f0003e07640 1 -- 172.21.15.165:0/35211451 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0108020030 con 0x56395f90bda0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.932+0000 7f010ffff640 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efffc03cfb0 0x7efffc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.932+0000 7f011b725800 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395f90f8e0 0x56395fa0a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.932+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa0a5c0 con 0x56395f90f8e0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.932+0000 7f0117ca3640 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395f90f8e0 0x56395fa0a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.933+0000 7f010ffff640 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efffc03cfb0 0x7efffc03f470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0100057000 tx=0x7f0100052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.933+0000 7f0117ca3640 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395f90f8e0 0x56395fa0a080 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.933+0000 7f0117ca3640 1 -- 172.21.15.165:0/35211451 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f011000a4d0 con 0x56395f90f8e0 2024-09-22T08:11:26.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.933+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa0a960 con 0x56395f90f8e0 2024-09-22T08:11:26.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.933+0000 7f0117ca3640 1 -- 172.21.15.165:0/35211451 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f011000a4d0 con 0x56395f90f8e0 2024-09-22T08:11:26.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.933+0000 7f011b725800 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa0c4a0 0x56395fa0e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.933+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa0f0a0 con 0x56395fa0c4a0 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.933+0000 7f01174a2640 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa0c4a0 0x56395fa0e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.934+0000 7f01174a2640 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa0c4a0 0x56395fa0e910 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.934+0000 7f01174a2640 1 -- 172.21.15.165:0/35211451 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa0c4a0 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.934+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa0b1b0 con 0x56395f90f8e0 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.934+0000 7f0117ca3640 1 -- 172.21.15.165:0/35211451 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f011000a4d0 con 0x56395f90f8e0 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.934+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa0b5d0 con 0x56395f90f8e0 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.935+0000 7f0117ca3640 1 -- 172.21.15.165:0/35211451 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f011000a4d0 con 0x56395f90f8e0 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.935+0000 7f011b725800 1 Processor -- start 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.935+0000 7f011b725800 1 -- start start 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.935+0000 7f011b725800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa1da30 0x56395fa1de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.935+0000 7f011b725800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56395f803d50 con 0x56395fa1da30 2024-09-22T08:11:26.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.935+0000 7f0117ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa1da30 0x56395fa1de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.935+0000 7f0117ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa1da30 0x56395fa1de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58336/0 (socket says 172.21.15.165:58336) 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.935+0000 7f0117ca3640 1 -- 172.21.15.165:0/3325528501 learned_addr learned my addr 172.21.15.165:0/3325528501 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.936+0000 7f0117ca3640 1 -- 172.21.15.165:0/3325528501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395fa1e490 con 0x56395fa1da30 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.936+0000 7f0117ca3640 1 --2- 172.21.15.165:0/3325528501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa1da30 0x56395fa1de50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x56395fa03df0 tx=0x7f0110018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.936+0000 7f0001602640 1 -- 172.21.15.165:0/3325528501 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0110014450 con 0x56395fa1da30 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.936+0000 7f0001602640 1 -- 172.21.15.165:0/3325528501 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0110014610 con 0x56395fa1da30 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.936+0000 7f011b725800 1 -- 172.21.15.165:0/3325528501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56395fa1ecc0 con 0x56395fa1da30 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.936+0000 7f0001602640 1 -- 172.21.15.165:0/3325528501 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0110014930 con 0x56395fa1da30 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.936+0000 7f011b725800 1 -- 172.21.15.165:0/3325528501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56395fa1f260 con 0x56395fa1da30 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.937+0000 7f0001602640 1 -- 172.21.15.165:0/3325528501 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0110011040 con 0x56395fa1da30 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.937+0000 7f0001602640 1 --2- 172.21.15.165:0/3325528501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efff003d000 0x7efff003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.937+0000 7f0001602640 1 -- 172.21.15.165:0/3325528501 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f011001e070 con 0x56395fa1da30 2024-09-22T08:11:26.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.937+0000 7f01174a2640 1 --2- 172.21.15.165:0/3325528501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efff003d000 0x7efff003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.937+0000 7f011b725800 1 Processor -- start 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.937+0000 7f011b725800 1 -- start start 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.937+0000 7f01174a2640 1 --2- 172.21.15.165:0/3325528501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efff003d000 0x7efff003f4c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0108052a50 tx=0x7f01080011d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.938+0000 7f011b725800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa2a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.938+0000 7f011b725800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56395f9fb940 con 0x56395fa2a470 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.938+0000 7f0117ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa2a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.938+0000 7f0117ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa2a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58350/0 (socket says 172.21.15.165:58350) 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.938+0000 7f0117ca3640 1 -- 172.21.15.165:0/2049689189 learned_addr learned my addr 172.21.15.165:0/2049689189 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.938+0000 7f0117ca3640 1 -- 172.21.15.165:0/2049689189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395fa2ae60 con 0x56395fa2a470 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.938+0000 7f0117ca3640 1 --2- 172.21.15.165:0/2049689189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa2a870 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0110018430 tx=0x7f0110014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f823bd2e84274b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.938+0000 7efffaffd640 1 -- 172.21.15.165:0/2049689189 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0110028070 con 0x56395fa2a470 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.938+0000 7efffaffd640 1 -- 172.21.15.165:0/2049689189 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01100532a0 con 0x56395fa2a470 2024-09-22T08:11:26.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.938+0000 7efffaffd640 1 -- 172.21.15.165:0/2049689189 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0110016910 con 0x56395fa2a470 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 -- 172.21.15.165:0/2049689189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 msgr2=0x56395fa2a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 --2- 172.21.15.165:0/2049689189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa2a870 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0110018430 tx=0x7f0110014ea0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 -- 172.21.15.165:0/2049689189 shutdown_connections 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 --2- 172.21.15.165:0/2049689189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa2a870 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 -- 172.21.15.165:0/2049689189 >> 172.21.15.165:0/2049689189 conn(0x56395fa26890 msgr2=0x56395fa24ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 -- 172.21.15.165:0/2049689189 shutdown_connections 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 -- 172.21.15.165:0/2049689189 wait complete. 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 Processor -- start 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 -- start start 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.939+0000 7f011b725800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56395fa2b480 con 0x56395fa2a470 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.940+0000 7f0117ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.940+0000 7f0117ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:58354/0 (socket says 172.21.15.165:58354) 2024-09-22T08:11:26.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.940+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 learned_addr learned my addr 172.21.15.165:0/2250023692 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:11:26.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.940+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395fa30f40 con 0x56395fa2a470 2024-09-22T08:11:26.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.940+0000 7f0117ca3640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa309e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f01100535e0 tx=0x7f01100546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.940+0000 7efff97fa640 1 -- 172.21.15.165:0/2250023692 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0110031070 con 0x56395fa2a470 2024-09-22T08:11:26.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.940+0000 7efff97fa640 1 -- 172.21.15.165:0/2250023692 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0110042b00 con 0x56395fa2a470 2024-09-22T08:11:26.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.940+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56395fa311d0 con 0x56395fa2a470 2024-09-22T08:11:26.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.940+0000 7efff97fa640 1 -- 172.21.15.165:0/2250023692 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0110042de0 con 0x56395fa2a470 2024-09-22T08:11:26.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.940+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56395fa31b50 con 0x56395fa2a470 2024-09-22T08:11:26.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.941+0000 7efff97fa640 1 -- 172.21.15.165:0/2250023692 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0110034070 con 0x56395fa2a470 2024-09-22T08:11:26.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.941+0000 7efff97fa640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7effe003d000 0x7effe003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.941+0000 7efff97fa640 1 -- 172.21.15.165:0/2250023692 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f011000e040 con 0x56395fa2a470 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.941+0000 7f01174a2640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7effe003d000 0x7effe003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.942+0000 7f01174a2640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7effe003d000 0x7effe003f4c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0108052e10 tx=0x7f0108051000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.942+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.942+0000 7f011b725800 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395fa3c360 0x56395fa3e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.942+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa3ef70 con 0x56395fa3c360 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.942+0000 7f010ffff640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395fa3c360 0x56395fa3e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.942+0000 7f010ffff640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395fa3c360 0x56395fa3e820 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 20 realm 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa3f3a0 con 0x56395fa3c360 2024-09-22T08:11:26.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa3fc70 con 0x56395fa3c360 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa40010 con 0x56395fa3c360 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa40d70 0x56395fa43160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa43770 con 0x56395fa40d70 2024-09-22T08:11:26.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.943+0000 7f0117ca3640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa40d70 0x56395fa43160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.944+0000 7f0117ca3640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa40d70 0x56395fa43160 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.944+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0110033030 con 0x56395fa40d70 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.944+0000 7f011b725800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.944+0000 7f011b725800 20 searching for the correct realm 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.944+0000 7f011b725800 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56395fa45720 0x56395fa47be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.944+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa45720 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.944+0000 7f01174a2640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56395fa45720 0x56395fa47be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.944+0000 7f01174a2640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56395fa45720 0x56395fa47be0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.945+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.945+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa40d70 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.945+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0110033030 con 0x56395fa40d70 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.945+0000 7f0117ca3640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0110036070 0x7f0110001960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:11:26.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.945+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x7f0110036070 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.945+0000 7f010ffff640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0110036070 0x7f0110001960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.946+0000 7f010ffff640 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0110036070 0x7f0110001960 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.946+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.946+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa3c360 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.946+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.946+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa3c360 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.946+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.946+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x7f0110036070 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.947+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.947+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa40d70 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.947+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.947+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa40d70 2024-09-22T08:11:26.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.947+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.947+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa45720 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.947+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.947+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa3c360 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.947+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.947+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x7f0110036070 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.948+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.948+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa3c360 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.948+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.948+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa40d70 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.948+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.948+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa45720 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.949+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.949+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa45720 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.949+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.949+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x7f0110036070 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.949+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.949+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa45720 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.949+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.949+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa45720 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.949+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.949+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa3c360 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.950+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.950+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa3c360 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.950+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.950+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x7f0110036070 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.950+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.950+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa45720 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.951+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.951+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa40d70 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.951+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.951+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa3c360 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.951+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.951+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x7f0110036070 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.951+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.951+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa45720 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.952+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.952+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x7f0110036070 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.952+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.952+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa40d70 2024-09-22T08:11:26.965 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.952+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.952+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa45720 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.952+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.952+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x7f0110036070 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa3c360 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48260 con 0x56395fa40d70 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:11:26.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa44130 con 0x56395fa3c360 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.953+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa43d70 con 0x56395fa3c360 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa44b50 con 0x56395fa3c360 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:11:26.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 20 zone default found 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 4 Realm: () 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 20 zonegroup default 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa48b90 con 0x7f0110036070 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.954+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4a860 con 0x56395fa45720 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.955+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.955+0000 7f011b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.955+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.955+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4ad10 con 0x56395fa45720 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.955+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.955+0000 7f011b725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.955+0000 7f011b725800 20 started sync module instance, tier type = 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.955+0000 7f011b725800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.955+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa49630 con 0x56395fa40d70 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.956+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.956+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94804417747488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa49290 con 0x56395fa40d70 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.956+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4bc40 con 0x56395fa3c360 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.957+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94804417747488] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.958+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.958+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94804417753456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4bc40 con 0x56395fa3c360 2024-09-22T08:11:26.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.958+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4c660 con 0x56395fa45720 2024-09-22T08:11:26.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.959+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.959+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94804417757520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4cf30 con 0x56395fa45720 2024-09-22T08:11:26.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.959+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4da10 con 0x56395fa40d70 2024-09-22T08:11:26.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.959+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94804417753456] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.960+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94804417757520] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.960+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.960+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94804417759872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4b790 con 0x56395fa40d70 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.960+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4e2f0 con 0x56395fa3c360 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.961+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.961+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94804417764864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4e280 con 0x56395fa3c360 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.961+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4f2a0 con 0x7f0110036070 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.961+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94804417759872] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.962+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94804417764864] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.962+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.962+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94804417762592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4e460 con 0x7f0110036070 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.962+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4fb40 con 0x7f0110036070 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.963+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.963+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94804417771152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4e460 con 0x7f0110036070 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.963+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa50660 con 0x7f0110036070 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.963+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94804417762592] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.964+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94804417771152] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.964+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.964+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94804417772208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4ed80 con 0x7f0110036070 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.964+0000 7f011b725800 20 add_watcher() i=0 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.964+0000 7f011b725800 20 add_watcher() i=1 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.964+0000 7f011b725800 20 add_watcher() i=2 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.964+0000 7f011b725800 20 add_watcher() i=3 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.964+0000 7f011b725800 20 add_watcher() i=4 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.964+0000 7f011b725800 20 add_watcher() i=5 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.964+0000 7f011b725800 20 add_watcher() i=6 2024-09-22T08:11:26.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.965+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94804417772208] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.965+0000 7f011b725800 20 add_watcher() i=7 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.965+0000 7f011b725800 2 all 8 watchers are set, enabling cache 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.965+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa53650 con 0x56395fa3c360 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.966+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.966+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94804417773904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa50b40 con 0x56395fa3c360 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.967+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94804417773904] v34'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.967+0000 7effcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.967+0000 7f011b725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.967+0000 7f011b725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.967+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5c150 con 0x56395fa3c360 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.968+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.968+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5c7e0 con 0x7f0110036070 2024-09-22T08:11:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.969+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.969+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5cc00 con 0x56395fa45720 2024-09-22T08:11:26.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.970+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.970+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5d450 con 0x56395fa3c360 2024-09-22T08:11:26.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.971+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.971+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa59ff0 con 0x56395fa40d70 2024-09-22T08:11:26.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.972+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.972+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa59ff0 con 0x56395fa45720 2024-09-22T08:11:26.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.973+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.973+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5a4e0 con 0x56395fa3c360 2024-09-22T08:11:26.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.974+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.974+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5dfb0 con 0x7f0110036070 2024-09-22T08:11:26.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.975+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'44 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.975+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5dfb0 con 0x56395fa40d70 2024-09-22T08:11:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.976+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.976+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5dfb0 con 0x56395fa45720 2024-09-22T08:11:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.977+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.977+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5dfb0 con 0x56395fa40d70 2024-09-22T08:11:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.978+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.978+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5dfb0 con 0x7f0110036070 2024-09-22T08:11:26.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.979+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.979+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e040 con 0x56395fa40d70 2024-09-22T08:11:26.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.980+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.980+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e040 con 0x7f0110036070 2024-09-22T08:11:26.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.981+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.982+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e040 con 0x56395fa3c360 2024-09-22T08:11:26.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.982+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.983+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e040 con 0x56395fa45720 2024-09-22T08:11:26.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.984+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.984+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e130 con 0x56395fa40d70 2024-09-22T08:11:26.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.985+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.985+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e130 con 0x56395fa45720 2024-09-22T08:11:26.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.986+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.986+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e0d0 con 0x56395fa3c360 2024-09-22T08:11:26.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.987+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.987+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e0d0 con 0x56395fa3c360 2024-09-22T08:11:26.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.988+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:26.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.988+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e0d0 con 0x56395fa45720 2024-09-22T08:11:26.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.989+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.989+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e170 con 0x56395fa40d70 2024-09-22T08:11:26.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.990+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:26.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.990+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e170 con 0x56395fa45720 2024-09-22T08:11:26.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.991+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.991+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e170 con 0x56395fa45720 2024-09-22T08:11:26.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.992+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.992+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e170 con 0x56395fa45720 2024-09-22T08:11:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.993+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.993+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e1b0 con 0x56395fa45720 2024-09-22T08:11:26.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.994+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.994+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e1b0 con 0x7f0110036070 2024-09-22T08:11:26.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.995+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.995+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e1f0 con 0x56395fa45720 2024-09-22T08:11:26.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.996+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.996+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e1f0 con 0x7f0110036070 2024-09-22T08:11:26.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.997+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:26.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.997+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e1f0 con 0x56395fa45720 2024-09-22T08:11:26.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.998+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:26.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.998+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e1f0 con 0x7f0110036070 2024-09-22T08:11:27.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.999+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:27.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:26.999+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5e230 con 0x56395fa40d70 2024-09-22T08:11:27.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.000+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:27.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.000+0000 7effccfe1640 20 reqs_thread_entry: start 2024-09-22T08:11:27.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.000+0000 7f011b725800 20 init_complete bucket index max shards: 11 2024-09-22T08:11:27.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.000+0000 7f011b725800 20 Filter name: none 2024-09-22T08:11:27.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.000+0000 7eff467fc640 20 reqs_thread_entry: start 2024-09-22T08:11:27.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.001+0000 7f011b725800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:11:27.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.001+0000 7f011b725800 20 rados->read ofs=0 len=0 2024-09-22T08:11:27.002 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.001+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa89150 con 0x56395fa3c360 2024-09-22T08:11:27.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.001+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:27.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.001+0000 7f011b725800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:11:27.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.001+0000 7f011b725800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:11:27.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.001+0000 7f011b725800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:11:27.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.001+0000 7f011b725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:11:27.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.001+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395fa8ba40 con 0x56395fa40d70 2024-09-22T08:11:27.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.001+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:27.003 INFO:teuthology.orchestra.run.smithi165.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-22T08:11:27.003 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.002+0000 7effcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:11:27.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.002+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94804417773904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa5d450 con 0x56395fa3c360 2024-09-22T08:11:27.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.003+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94804417773904] v34'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:27.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.003+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94804417747488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa50150 con 0x56395fa40d70 2024-09-22T08:11:27.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.004+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94804417747488] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:27.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.004+0000 7f011b725800 20 remove_watcher() i=0 2024-09-22T08:11:27.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.004+0000 7f011b725800 2 removed watcher, disabling cache 2024-09-22T08:11:27.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.004+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94804417753456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa50150 con 0x56395fa3c360 2024-09-22T08:11:27.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.005+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94804417753456] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:27.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.005+0000 7f011b725800 20 remove_watcher() i=1 2024-09-22T08:11:27.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.006+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94804417757520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4b170 con 0x56395fa45720 2024-09-22T08:11:27.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.006+0000 7f01174a2640 1 -- 172.21.15.165:0/2250023692 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94804417757520] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f010801ad50 con 0x56395fa45720 2024-09-22T08:11:27.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.007+0000 7f011b725800 20 remove_watcher() i=2 2024-09-22T08:11:27.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.007+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94804417759872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa50150 con 0x56395fa40d70 2024-09-22T08:11:27.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.007+0000 7f0117ca3640 1 -- 172.21.15.165:0/2250023692 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94804417759872] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0110061040 con 0x56395fa40d70 2024-09-22T08:11:27.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.007+0000 7f011b725800 20 remove_watcher() i=3 2024-09-22T08:11:27.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.007+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94804417764864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4b170 con 0x56395fa3c360 2024-09-22T08:11:27.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.009+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94804417764864] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x56395fa3c360 2024-09-22T08:11:27.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.009+0000 7f011b725800 20 remove_watcher() i=4 2024-09-22T08:11:27.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.009+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94804417762592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4ca80 con 0x7f0110036070 2024-09-22T08:11:27.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.010+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94804417762592] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:27.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.010+0000 7f011b725800 20 remove_watcher() i=5 2024-09-22T08:11:27.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.010+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94804417771152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa50150 con 0x7f0110036070 2024-09-22T08:11:27.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.011+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94804417771152] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:27.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.011+0000 7f011b725800 20 remove_watcher() i=6 2024-09-22T08:11:27.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.011+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94804417772208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395fa4de00 con 0x7f0110036070 2024-09-22T08:11:27.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94804417772208] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0100051070 con 0x7f0110036070 2024-09-22T08:11:27.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 20 remove_watcher() i=7 2024-09-22T08:11:27.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0110036070 msgr2=0x7f0110001960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0110036070 0x7f0110001960 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395fa3c360 msgr2=0x56395fa3e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395fa3c360 0x56395fa3e820 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa40d70 msgr2=0x56395fa43160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa40d70 0x56395fa43160 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56395fa45720 msgr2=0x56395fa47be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x56395fa45720 0x56395fa47be0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7effe003d000 msgr2=0x7effe003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7effe003d000 0x7effe003f4c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0108052e10 tx=0x7f0108051000 comp rx=0 tx=0).stop 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f010ffff640 1 -- 172.21.15.165:0/2250023692 reap_dead start 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 msgr2=0x56395fa309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa309e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f01100535e0 tx=0x7f01100546a0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 shutdown_connections 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/2250023692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa2a470 0x56395fa309e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 >> 172.21.15.165:0/2250023692 conn(0x56395fa26890 msgr2=0x56395fa24aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 shutdown_connections 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/2250023692 wait complete. 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/3325528501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efff003d000 msgr2=0x7efff003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/3325528501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efff003d000 0x7efff003f4c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0108052a50 tx=0x7f01080011d0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/3325528501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa1da30 msgr2=0x56395fa1de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/3325528501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa1da30 0x56395fa1de50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x56395fa03df0 tx=0x7f0110018830 comp rx=0 tx=0).stop 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/3325528501 shutdown_connections 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/3325528501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efff003d000 0x7efff003f4c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 --2- 172.21.15.165:0/3325528501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395fa1da30 0x56395fa1de50 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/3325528501 >> 172.21.15.165:0/3325528501 conn(0x56395fa11de0 msgr2=0x56395fa121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/3325528501 shutdown_connections 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.012+0000 7f011b725800 1 -- 172.21.15.165:0/3325528501 wait complete. 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395f90f8e0 msgr2=0x56395fa0a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395f90f8e0 0x56395fa0a080 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa0c4a0 msgr2=0x56395fa0e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa0c4a0 0x56395fa0e910 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efffc03cfb0 msgr2=0x7efffc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efffc03cfb0 0x7efffc03f470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0100057000 tx=0x7f0100052000 comp rx=0 tx=0).stop 2024-09-22T08:11:27.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 msgr2=0x56395fa02a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:11:27.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395fa02a30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x56395f9fbeb0 tx=0x7f0108000bc0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 shutdown_connections 2024-09-22T08:11:27.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56395fa0c4a0 0x56395fa0e910 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56395f90f8e0 0x56395fa0a080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efffc03cfb0 0x7efffc03f470 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 --2- 172.21.15.165:0/35211451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56395f90bda0 0x56395fa02a30 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:11:27.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 >> 172.21.15.165:0/35211451 conn(0x56395f906310 msgr2=0x56395f9fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:11:27.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 shutdown_connections 2024-09-22T08:11:27.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:11:27.013+0000 7f011b725800 1 -- 172.21.15.165:0/35211451 wait complete. 2024-09-22T08:11:27.022 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-22T08:11:27.043 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:11:27.089 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-22T08:12:02.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-22T08:12:02.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-22T08:12:02.091 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-22T08:12:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.143+0000 7ff499539800 1 Processor -- start 2024-09-22T08:12:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.143+0000 7ff499539800 1 -- start start 2024-09-22T08:12:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.143+0000 7ff499539800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f002191b80 0x55f002193f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.143+0000 7ff499539800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f002018a20 con 0x55f00218e070 2024-09-22T08:12:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.143+0000 7ff499539800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f0020187d0 con 0x55f002191b80 2024-09-22T08:12:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.144+0000 7ff4949c6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f002191b80 0x55f002193f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.144+0000 7ff4949c6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f002191b80 0x55f002193f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56070/0 (socket says 172.21.15.165:56070) 2024-09-22T08:12:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.144+0000 7ff4949c6640 1 -- 172.21.15.165:0/857329339 learned_addr learned my addr 172.21.15.165:0/857329339 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.144+0000 7ff4951c7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f00218e070 0x55f002190460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49436/0 (socket says 172.21.15.165:49436) 2024-09-22T08:12:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.144+0000 7ff48ffff640 1 -- 172.21.15.165:0/857329339 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576132645 0 0) 0x55f002018a20 con 0x55f00218e070 2024-09-22T08:12:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.144+0000 7ff48ffff640 1 -- 172.21.15.165:0/857329339 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff484001e10 con 0x55f00218e070 2024-09-22T08:12:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.144+0000 7ff4949c6640 1 -- 172.21.15.165:0/857329339 >> v1:172.21.15.53:6789/0 conn(0x55f00218e070 legacy=0x55f002190460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.144+0000 7ff4949c6640 1 -- 172.21.15.165:0/857329339 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f002195550 con 0x55f002191b80 2024-09-22T08:12:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.146+0000 7ff4949c6640 1 --2- 172.21.15.165:0/857329339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f002191b80 0x55f002193f70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff48000a520 tx=0x7ff480045aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3ded41c650be3e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.146+0000 7ff48ffff640 1 -- 172.21.15.165:0/857329339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff480056020 con 0x55f002191b80 2024-09-22T08:12:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.146+0000 7ff48ffff640 1 -- 172.21.15.165:0/857329339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff480052550 con 0x55f002191b80 2024-09-22T08:12:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.146+0000 7ff48ffff640 1 -- 172.21.15.165:0/857329339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff480052870 con 0x55f002191b80 2024-09-22T08:12:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.147+0000 7ff499539800 1 -- 172.21.15.165:0/857329339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f002191b80 msgr2=0x55f002193f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.147+0000 7ff499539800 1 --2- 172.21.15.165:0/857329339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f002191b80 0x55f002193f70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff48000a520 tx=0x7ff480045aa0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.147+0000 7ff499539800 1 -- 172.21.15.165:0/857329339 shutdown_connections 2024-09-22T08:12:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.147+0000 7ff499539800 1 --2- 172.21.15.165:0/857329339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f002191b80 0x55f002193f70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.147+0000 7ff499539800 1 -- 172.21.15.165:0/857329339 >> 172.21.15.165:0/857329339 conn(0x55f002187bb0 msgr2=0x55f00218a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.147+0000 7ff499539800 1 -- 172.21.15.165:0/857329339 shutdown_connections 2024-09-22T08:12:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.147+0000 7ff499539800 1 -- 172.21.15.165:0/857329339 wait complete. 2024-09-22T08:12:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.162+0000 7ff499539800 1 Processor -- start 2024-09-22T08:12:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.163+0000 7ff499539800 1 -- start start 2024-09-22T08:12:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.163+0000 7ff499539800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f00218d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.163+0000 7ff499539800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f002025dd0 con 0x55f00218e070 2024-09-22T08:12:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.163+0000 7ff4951c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f00218d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.163+0000 7ff4951c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f00218d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56080/0 (socket says 172.21.15.165:56080) 2024-09-22T08:12:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.163+0000 7ff4951c7640 1 -- 172.21.15.165:0/189558453 learned_addr learned my addr 172.21.15.165:0/189558453 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.164+0000 7ff4951c7640 1 -- 172.21.15.165:0/189558453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f00218ddd0 con 0x55f00218e070 2024-09-22T08:12:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.164+0000 7ff4951c7640 1 --2- 172.21.15.165:0/189558453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f00218d7e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff4880016c0 tx=0x7ff488001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fc7ff92e7c7590 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.164+0000 7ff383606640 1 -- 172.21.15.165:0/189558453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488013420 con 0x55f00218e070 2024-09-22T08:12:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.164+0000 7ff383606640 1 -- 172.21.15.165:0/189558453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4880135e0 con 0x55f00218e070 2024-09-22T08:12:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.164+0000 7ff383606640 1 -- 172.21.15.165:0/189558453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488013900 con 0x55f00218e070 2024-09-22T08:12:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 -- 172.21.15.165:0/189558453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 msgr2=0x55f00218d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 --2- 172.21.15.165:0/189558453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f00218d7e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff4880016c0 tx=0x7ff488001b80 comp rx=0 tx=0).stop 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 -- 172.21.15.165:0/189558453 shutdown_connections 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 --2- 172.21.15.165:0/189558453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f00218d7e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 -- 172.21.15.165:0/189558453 >> 172.21.15.165:0/189558453 conn(0x55f002187bb0 msgr2=0x55f002278840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 -- 172.21.15.165:0/189558453 shutdown_connections 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 -- 172.21.15.165:0/189558453 wait complete. 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 Processor -- start 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 -- start start 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f002286b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.165+0000 7ff499539800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f002194840 con 0x55f00218e070 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.166+0000 7ff4951c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f002286b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.166+0000 7ff4951c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f002286b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56096/0 (socket says 172.21.15.165:56096) 2024-09-22T08:12:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.166+0000 7ff4951c7640 1 -- 172.21.15.165:0/425742385 learned_addr learned my addr 172.21.15.165:0/425742385 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.166+0000 7ff4951c7640 1 -- 172.21.15.165:0/425742385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0022870d0 con 0x55f00218e070 2024-09-22T08:12:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.166+0000 7ff4951c7640 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f002286b70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff488001bc0 tx=0x7ff488001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.167+0000 7ff381e03640 1 -- 172.21.15.165:0/425742385 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488022020 con 0x55f00218e070 2024-09-22T08:12:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.167+0000 7ff381e03640 1 -- 172.21.15.165:0/425742385 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff488019040 con 0x55f00218e070 2024-09-22T08:12:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.167+0000 7ff381e03640 1 -- 172.21.15.165:0/425742385 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488004bb0 con 0x55f00218e070 2024-09-22T08:12:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.167+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0022873c0 con 0x55f00218e070 2024-09-22T08:12:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.167+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f002287f70 con 0x55f00218e070 2024-09-22T08:12:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.168+0000 7ff381e03640 1 -- 172.21.15.165:0/425742385 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff488025020 con 0x55f00218e070 2024-09-22T08:12:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.168+0000 7ff381e03640 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37c03d000 0x7ff37c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.168+0000 7ff381e03640 1 -- 172.21.15.165:0/425742385 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff4880544d0 con 0x55f00218e070 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.168+0000 7ff4949c6640 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37c03d000 0x7ff37c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.168+0000 7ff499539800 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f002191b80 0x55f00228e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.168+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00228e700 con 0x55f002191b80 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.168+0000 7ff4959c8640 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f002191b80 0x55f00228e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.169+0000 7ff4949c6640 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37c03d000 0x7ff37c03f4c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff480057000 tx=0x7ff480052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.169+0000 7ff4959c8640 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f002191b80 0x55f00228e1c0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.169+0000 7ff4959c8640 1 -- 172.21.15.165:0/425742385 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4900083e0 con 0x55f002191b80 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.169+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00228eaa0 con 0x55f002191b80 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.169+0000 7ff4959c8640 1 -- 172.21.15.165:0/425742385 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff4900083e0 con 0x55f002191b80 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.169+0000 7ff499539800 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022905e0 0x55f002292a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.169+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f002293210 con 0x55f0022905e0 2024-09-22T08:12:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.169+0000 7ff4951c7640 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022905e0 0x55f002292a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.170+0000 7ff4951c7640 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022905e0 0x55f002292a80 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.170+0000 7ff4951c7640 1 -- 172.21.15.165:0/425742385 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022905e0 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.170+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00228f2f0 con 0x55f002191b80 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.170+0000 7ff4959c8640 1 -- 172.21.15.165:0/425742385 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff4900083e0 con 0x55f002191b80 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.170+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00228f790 con 0x55f002191b80 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.171+0000 7ff4959c8640 1 -- 172.21.15.165:0/425742385 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff4900083e0 con 0x55f002191b80 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.171+0000 7ff499539800 1 Processor -- start 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.171+0000 7ff499539800 1 -- start start 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.171+0000 7ff499539800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022a1bf0 0x55f0022a2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.171+0000 7ff499539800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f002084d50 con 0x55f0022a1bf0 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.172+0000 7ff4959c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022a1bf0 0x55f0022a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.172+0000 7ff4959c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022a1bf0 0x55f0022a2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56102/0 (socket says 172.21.15.165:56102) 2024-09-22T08:12:02.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.172+0000 7ff4959c8640 1 -- 172.21.15.165:0/3031242687 learned_addr learned my addr 172.21.15.165:0/3031242687 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.172+0000 7ff4959c8640 1 -- 172.21.15.165:0/3031242687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0022a2650 con 0x55f0022a1bf0 2024-09-22T08:12:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.172+0000 7ff4959c8640 1 --2- 172.21.15.165:0/3031242687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022a1bf0 0x55f0022a2010 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55f002288b20 tx=0x7ff49000af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.172+0000 7ff37affd640 1 -- 172.21.15.165:0/3031242687 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff490007d60 con 0x55f0022a1bf0 2024-09-22T08:12:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.172+0000 7ff37affd640 1 -- 172.21.15.165:0/3031242687 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49001e020 con 0x55f0022a1bf0 2024-09-22T08:12:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.172+0000 7ff499539800 1 -- 172.21.15.165:0/3031242687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0022a2e80 con 0x55f0022a1bf0 2024-09-22T08:12:02.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.172+0000 7ff37affd640 1 -- 172.21.15.165:0/3031242687 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff490019590 con 0x55f0022a1bf0 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.172+0000 7ff499539800 1 -- 172.21.15.165:0/3031242687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0022a3420 con 0x55f0022a1bf0 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.174+0000 7ff37affd640 1 -- 172.21.15.165:0/3031242687 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff490016040 con 0x55f0022a1bf0 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.174+0000 7ff37affd640 1 --2- 172.21.15.165:0/3031242687 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37003cfb0 0x7ff37003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.174+0000 7ff37affd640 1 -- 172.21.15.165:0/3031242687 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff49001f030 con 0x55f0022a1bf0 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.174+0000 7ff4951c7640 1 --2- 172.21.15.165:0/3031242687 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37003cfb0 0x7ff37003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.174+0000 7ff499539800 1 Processor -- start 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.174+0000 7ff4951c7640 1 --2- 172.21.15.165:0/3031242687 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37003cfb0 0x7ff37003f470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55f002288cc0 tx=0x7ff488002130 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.174+0000 7ff499539800 1 -- start start 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.174+0000 7ff499539800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.174+0000 7ff499539800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f00218c220 con 0x55f0022ae630 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.175+0000 7ff4959c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.175+0000 7ff4959c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56118/0 (socket says 172.21.15.165:56118) 2024-09-22T08:12:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.175+0000 7ff4959c8640 1 -- 172.21.15.165:0/2447169232 learned_addr learned my addr 172.21.15.165:0/2447169232 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.175+0000 7ff4959c8640 1 -- 172.21.15.165:0/2447169232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0022af020 con 0x55f0022ae630 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.175+0000 7ff4959c8640 1 --2- 172.21.15.165:0/2447169232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022aea30 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff490054630 tx=0x7ff490014f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0f71f617ca826e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.175+0000 7ff378ff9640 1 -- 172.21.15.165:0/2447169232 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff490051020 con 0x55f0022ae630 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.175+0000 7ff378ff9640 1 -- 172.21.15.165:0/2447169232 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4900184e0 con 0x55f0022ae630 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.175+0000 7ff378ff9640 1 -- 172.21.15.165:0/2447169232 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff490044020 con 0x55f0022ae630 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 -- 172.21.15.165:0/2447169232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 msgr2=0x55f0022aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 --2- 172.21.15.165:0/2447169232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022aea30 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff490054630 tx=0x7ff490014f30 comp rx=0 tx=0).stop 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 -- 172.21.15.165:0/2447169232 shutdown_connections 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 --2- 172.21.15.165:0/2447169232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022aea30 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 -- 172.21.15.165:0/2447169232 >> 172.21.15.165:0/2447169232 conn(0x55f0022aaa30 msgr2=0x55f0022a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 -- 172.21.15.165:0/2447169232 shutdown_connections 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 -- 172.21.15.165:0/2447169232 wait complete. 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 Processor -- start 2024-09-22T08:12:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 -- start start 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.176+0000 7ff499539800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f0022af640 con 0x55f0022ae630 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.177+0000 7ff4959c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.177+0000 7ff4959c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56134/0 (socket says 172.21.15.165:56134) 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.177+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 learned_addr learned my addr 172.21.15.165:0/3766597193 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.177+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0022b6150 con 0x55f0022ae630 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.177+0000 7ff4959c8640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022b5bf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff490008fd0 tx=0x7ff4900545c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.177+0000 7ff366ffd640 1 -- 172.21.15.165:0/3766597193 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49001d070 con 0x55f0022ae630 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.177+0000 7ff366ffd640 1 -- 172.21.15.165:0/3766597193 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff490016c00 con 0x55f0022ae630 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.177+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0022b63e0 con 0x55f0022ae630 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.178+0000 7ff366ffd640 1 -- 172.21.15.165:0/3766597193 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff490045130 con 0x55f0022ae630 2024-09-22T08:12:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.178+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0022b6d60 con 0x55f0022ae630 2024-09-22T08:12:02.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.178+0000 7ff366ffd640 1 -- 172.21.15.165:0/3766597193 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff4900452d0 con 0x55f0022ae630 2024-09-22T08:12:02.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.179+0000 7ff366ffd640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff36003d000 0x7ff36003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.179+0000 7ff366ffd640 1 -- 172.21.15.165:0/3766597193 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff49004d050 con 0x55f0022ae630 2024-09-22T08:12:02.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.179+0000 7ff4951c7640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff36003d000 0x7ff36003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.179+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.179+0000 7ff499539800 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f0022c1500 0x55f0022c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.179+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022c40e0 con 0x55f0022c1500 2024-09-22T08:12:02.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.179+0000 7ff4949c6640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f0022c1500 0x55f0022c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.179+0000 7ff4951c7640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff36003d000 0x7ff36003f4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff4880064d0 tx=0x7ff488049000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.179+0000 7ff4949c6640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f0022c1500 0x55f0022c3990 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 20 realm 2024-09-22T08:12:02.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022c4510 con 0x55f0022c1500 2024-09-22T08:12:02.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022c4de0 con 0x55f0022c1500 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022c5180 con 0x55f0022c1500 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022c5ee0 0x55f0022c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.180+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022c8810 con 0x55f0022c5ee0 2024-09-22T08:12:02.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.181+0000 7ff4959c8640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022c5ee0 0x55f0022c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.181+0000 7ff4959c8640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022c5ee0 0x55f0022c82d0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.181+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.181+0000 7ff499539800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.181+0000 7ff499539800 20 searching for the correct realm 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.181+0000 7ff499539800 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f0022ca4b0 0x55f0022cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.181+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0022cd040 con 0x55f0022ca4b0 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.181+0000 7ff4951c7640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f0022ca4b0 0x55f0022cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.182+0000 7ff4951c7640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f0022ca4b0 0x55f0022cc970 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.182+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.182+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0022cd040 con 0x55f0022c5ee0 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.182+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.182+0000 7ff4959c8640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff490019040 0x7ff490023770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.182+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x7ff490019040 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.182+0000 7ff4949c6640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff490019040 0x7ff490023770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.183+0000 7ff4949c6640 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff490019040 0x7ff490023770 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.183+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x7ff490019040 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.183+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c1500 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.183+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.183+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c1500 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.184+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.184+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x7ff490019040 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.184+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x7ff490019040 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.184+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c5ee0 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.184+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.184+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c5ee0 2024-09-22T08:12:02.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.184+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.184+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022ca4b0 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.185+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.185+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c1500 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.185+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.185+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x7ff490019040 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.185+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x7ff490019040 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.185+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c1500 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.186+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.186+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c5ee0 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.186+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.186+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022ca4b0 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.186+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.186+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022ca4b0 2024-09-22T08:12:02.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.186+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.186+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x7ff490019040 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.187+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x7ff490019040 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.187+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022ca4b0 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.187+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.187+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022ca4b0 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.187+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.187+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c1500 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.187+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.187+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c1500 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.188+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.188+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x7ff490019040 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.188+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x7ff490019040 2024-09-22T08:12:02.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.188+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022ca4b0 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.188+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.188+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c5ee0 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.188+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.188+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c1500 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.189+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.189+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x7ff490019040 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.189+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x7ff490019040 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.189+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022ca4b0 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.189+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.189+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x7ff490019040 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.190+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x7ff490019040 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.190+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c5ee0 2024-09-22T08:12:02.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.190+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.190+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022ca4b0 2024-09-22T08:12:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.190+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.190+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x7ff490019040 2024-09-22T08:12:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.190+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff480050050 con 0x7ff490019040 2024-09-22T08:12:02.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.190+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c1500 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff490040040 con 0x55f0022c5ee0 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022c8db0 con 0x55f0022c1500 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.191+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022c91a0 con 0x55f0022c1500 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff480050050 con 0x55f0022c1500 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022c95c0 con 0x55f0022c1500 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 20 zone default found 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 4 Realm: () 2024-09-22T08:12:02.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 20 zonegroup default 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022cd4c0 con 0x7ff490019040 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.192+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022cf010 con 0x55f0022ca4b0 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.193+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.193+0000 7ff499539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.193+0000 7ff499539800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.193+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022cf4c0 con 0x55f0022ca4b0 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.193+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.193+0000 7ff499539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.193+0000 7ff499539800 20 started sync module instance, tier type = 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.193+0000 7ff499539800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.193+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022ce350 con 0x55f0022c5ee0 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.194+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.194+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94489317009520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022ce350 con 0x55f0022c5ee0 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.194+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d0040 con 0x55f0022c1500 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.195+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94489317009520] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.195+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.196+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94489317014288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d0000 con 0x55f0022c1500 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.196+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d0af0 con 0x55f0022ca4b0 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.197+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.197+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94489317017024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d1390 con 0x55f0022ca4b0 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.197+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d1e90 con 0x55f0022c5ee0 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.197+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94489317014288] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.198+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.198+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94489317022080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d2280 con 0x55f0022c5ee0 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.198+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d2cc0 con 0x55f0022c1500 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.198+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94489317017024] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.199+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94489317022080] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.199+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.199+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94489317007008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d27c0 con 0x55f0022c1500 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.199+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d32e0 con 0x7ff490019040 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.200+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94489317007008] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.200+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.200+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94489317019360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d32e0 con 0x7ff490019040 2024-09-22T08:12:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.200+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d3ca0 con 0x7ff490019040 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.202+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94489317019360] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.202+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.202+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94489317027680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d3ca0 con 0x7ff490019040 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.202+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d4590 con 0x7ff490019040 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.203+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.203+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94489317031584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d4a00 con 0x7ff490019040 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.203+0000 7ff499539800 20 add_watcher() i=0 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.203+0000 7ff499539800 20 add_watcher() i=1 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.203+0000 7ff499539800 20 add_watcher() i=2 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.203+0000 7ff499539800 20 add_watcher() i=3 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.203+0000 7ff499539800 20 add_watcher() i=4 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.203+0000 7ff499539800 20 add_watcher() i=5 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.203+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94489317027680] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.203+0000 7ff499539800 20 add_watcher() i=6 2024-09-22T08:12:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.204+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94489317031584] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.204+0000 7ff499539800 20 add_watcher() i=7 2024-09-22T08:12:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.204+0000 7ff499539800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.204+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d4a00 con 0x55f0022c1500 2024-09-22T08:12:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.204+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.204+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94489317033296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d49e0 con 0x55f0022c1500 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.205+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94489317033296] v34'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.205+0000 7ff34bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.205+0000 7ff499539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.205+0000 7ff499539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.205+0000 7ff499539800 5 note: GC not initialized 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.206+0000 7ff34afe5640 20 reqs_thread_entry: start 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.206+0000 7ff499539800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.206+0000 7ff499539800 20 Filter name: none 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.206+0000 7ff348fe1640 20 reqs_thread_entry: start 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.206+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b360 con 0x55f0022c1500 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.206+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.206+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b360 con 0x55f0022c5ee0 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.207+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.207+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b360 con 0x55f0022c1500 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.207+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.207+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b320 con 0x55f0022ca4b0 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.207+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.207+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b850 con 0x55f0022ca4b0 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.207+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.207+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b850 con 0x55f0022ca4b0 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.207+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.207+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b850 con 0x55f0022c1500 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.208+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.208+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b850 con 0x55f0022c1500 2024-09-22T08:12:02.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.208+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.208+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b7e0 con 0x55f0022ca4b0 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.208+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.208+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b7e0 con 0x55f0022ca4b0 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.208+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.208+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230b7e0 con 0x7ff490019040 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.209+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.209+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022c1500 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.209+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.209+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022c5ee0 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.209+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.209+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022ca4b0 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.210+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.210+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x7ff490019040 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.210+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.210+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x7ff490019040 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.210+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.210+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022ca4b0 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.211+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.211+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x7ff490019040 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.211+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.211+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022c1500 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.211+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.211+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022ca4b0 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.211+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.211+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x7ff490019040 2024-09-22T08:12:02.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.212+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.212+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022c5ee0 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.212+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.212+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x7ff490019040 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.212+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.212+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022c1500 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.213+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.213+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022c1500 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.213+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.213+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022ca4b0 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.213+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.213+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022c1500 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.213+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.213+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022c1500 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.213+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.214+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022ca4b0 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.214+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.214+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022ca4b0 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.214+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.214+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x55f0022ca4b0 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.214+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.214+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f00230ad30 con 0x7ff490019040 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.215+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.216+0000 7ff34bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.216+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94489317033296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d6c40 con 0x55f0022c1500 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.217+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94489317033296] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.217+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94489317009520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d4550 con 0x55f0022c5ee0 2024-09-22T08:12:02.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.218+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94489317009520] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.218+0000 7ff499539800 20 remove_watcher() i=0 2024-09-22T08:12:02.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.218+0000 7ff499539800 2 removed watcher, disabling cache 2024-09-22T08:12:02.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.218+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94489317014288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d4550 con 0x55f0022c1500 2024-09-22T08:12:02.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.219+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94489317014288] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.219+0000 7ff499539800 20 remove_watcher() i=1 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.219+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94489317017024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d4550 con 0x55f0022ca4b0 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.220+0000 7ff4951c7640 1 -- 172.21.15.165:0/3766597193 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94489317017024] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48800f030 con 0x55f0022ca4b0 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.220+0000 7ff499539800 20 remove_watcher() i=2 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.220+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94489317022080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d4550 con 0x55f0022c5ee0 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.221+0000 7ff4959c8640 1 -- 172.21.15.165:0/3766597193 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94489317022080] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff490053040 con 0x55f0022c5ee0 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.221+0000 7ff499539800 20 remove_watcher() i=3 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.221+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94489317007008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d1980 con 0x55f0022c1500 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.222+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94489317007008] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x55f0022c1500 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.222+0000 7ff499539800 20 remove_watcher() i=4 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.222+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94489317019360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d4550 con 0x7ff490019040 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.224+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94489317019360] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.224+0000 7ff499539800 20 remove_watcher() i=5 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.224+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94489317027680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022cdea0 con 0x7ff490019040 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.225+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94489317027680] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.225+0000 7ff499539800 20 remove_watcher() i=6 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.225+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94489317031584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0022d4550 con 0x7ff490019040 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94489317031584] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4800891c0 con 0x7ff490019040 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 20 remove_watcher() i=7 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff490019040 msgr2=0x7ff490023770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7ff490019040 0x7ff490023770 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f0022c1500 msgr2=0x55f0022c3990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f0022c1500 0x55f0022c3990 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022c5ee0 msgr2=0x55f0022c82d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022c5ee0 0x55f0022c82d0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f0022ca4b0 msgr2=0x55f0022cc970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f0022ca4b0 0x55f0022cc970 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff36003d000 msgr2=0x7ff36003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff36003d000 0x7ff36003f4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff4880064d0 tx=0x7ff488049000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 msgr2=0x55f0022b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 --2- 172.21.15.165:0/3766597193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022ae630 0x55f0022b5bf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff490008fd0 tx=0x7ff4900545c0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff4949c6640 1 -- 172.21.15.165:0/3766597193 reap_dead start 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 shutdown_connections 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.226+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 >> 172.21.15.165:0/3766597193 conn(0x55f0022aaa30 msgr2=0x55f0022a8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 shutdown_connections 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/3766597193 wait complete. 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/3031242687 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37003cfb0 msgr2=0x7ff37003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/3031242687 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37003cfb0 0x7ff37003f470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55f002288cc0 tx=0x7ff488002130 comp rx=0 tx=0).stop 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/3031242687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022a1bf0 msgr2=0x55f0022a2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/3031242687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022a1bf0 0x55f0022a2010 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55f002288b20 tx=0x7ff49000af20 comp rx=0 tx=0).stop 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/3031242687 shutdown_connections 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/3031242687 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37003cfb0 0x7ff37003f470 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/3031242687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0022a1bf0 0x55f0022a2010 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/3031242687 >> 172.21.15.165:0/3031242687 conn(0x55f002295fa0 msgr2=0x55f002296380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/3031242687 shutdown_connections 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/3031242687 wait complete. 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f002191b80 msgr2=0x55f00228e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f002191b80 0x55f00228e1c0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022905e0 msgr2=0x55f002292a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022905e0 0x55f002292a80 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37c03d000 msgr2=0x7ff37c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37c03d000 0x7ff37c03f4c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff480057000 tx=0x7ff480052000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 msgr2=0x55f002286b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f002286b70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff488001bc0 tx=0x7ff488001360 comp rx=0 tx=0).stop 2024-09-22T08:12:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 shutdown_connections 2024-09-22T08:12:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f0022905e0 0x55f002292a80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f002191b80 0x55f00228e1c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff37c03d000 0x7ff37c03f4c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.227+0000 7ff499539800 1 --2- 172.21.15.165:0/425742385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f00218e070 0x55f002286b70 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.228+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 >> 172.21.15.165:0/425742385 conn(0x55f002187bb0 msgr2=0x55f002278390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.228+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 shutdown_connections 2024-09-22T08:12:02.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.228+0000 7ff499539800 1 -- 172.21.15.165:0/425742385 wait complete. 2024-09-22T08:12:02.237 INFO:teuthology.orchestra.run.smithi165.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:12:02.237 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:12:02.238 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-22T08:12:02.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-22T08:12:02.238 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-22T08:12:02.281 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:02.281 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:02.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.280+0000 7f3707d26800 1 Processor -- start 2024-09-22T08:12:02.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.281+0000 7f3707d26800 1 -- start start 2024-09-22T08:12:02.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.281+0000 7f3707d26800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5604bdc5e8d0 0x5604bdc60d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.281+0000 7f3707d26800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5604bdae6a20 con 0x5604bdc5ac50 2024-09-22T08:12:02.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.281+0000 7f3707d26800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5604bdae67d0 con 0x5604bdc5e8d0 2024-09-22T08:12:02.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.281+0000 7f37031d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5604bdc5e8d0 0x5604bdc60d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.281+0000 7f37039d9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5604bdc5ac50 0x5604bdc5d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49438/0 (socket says 172.21.15.165:49438) 2024-09-22T08:12:02.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.281+0000 7f37039d9640 1 -- 172.21.15.165:0/305333848 learned_addr learned my addr 172.21.15.165:0/305333848 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:02.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.281+0000 7f37029d7640 1 -- 172.21.15.165:0/305333848 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250008221 0 0) 0x5604bdae6a20 con 0x5604bdc5ac50 2024-09-22T08:12:02.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.281+0000 7f37029d7640 1 -- 172.21.15.165:0/305333848 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36f0001e10 con 0x5604bdc5ac50 2024-09-22T08:12:02.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.282+0000 7f37031d8640 1 -- 172.21.15.165:0/305333848 >> v1:172.21.15.53:6789/0 conn(0x5604bdc5ac50 legacy=0x5604bdc5d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.282+0000 7f37031d8640 1 -- 172.21.15.165:0/305333848 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604bdc62470 con 0x5604bdc5e8d0 2024-09-22T08:12:02.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.283+0000 7f37031d8640 1 --2- 172.21.15.165:0/305333848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 0x5604bdc60d90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00a470 tx=0x7f36ec045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190464e07ae465b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.284+0000 7f37029d7640 1 -- 172.21.15.165:0/305333848 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36ec059070 con 0x5604bdc5e8d0 2024-09-22T08:12:02.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.284+0000 7f37029d7640 1 -- 172.21.15.165:0/305333848 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ec054570 con 0x5604bdc5e8d0 2024-09-22T08:12:02.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.284+0000 7f37029d7640 1 -- 172.21.15.165:0/305333848 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36ec054870 con 0x5604bdc5e8d0 2024-09-22T08:12:02.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.284+0000 7f3707d26800 1 -- 172.21.15.165:0/305333848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 msgr2=0x5604bdc60d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.284+0000 7f3707d26800 1 --2- 172.21.15.165:0/305333848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 0x5604bdc60d90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00a470 tx=0x7f36ec045920 comp rx=0 tx=0).stop 2024-09-22T08:12:02.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.284+0000 7f3707d26800 1 -- 172.21.15.165:0/305333848 shutdown_connections 2024-09-22T08:12:02.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.284+0000 7f3707d26800 1 --2- 172.21.15.165:0/305333848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 0x5604bdc60d90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.284+0000 7f3707d26800 1 -- 172.21.15.165:0/305333848 >> 172.21.15.165:0/305333848 conn(0x5604bdc55300 msgr2=0x5604bdc57780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.284+0000 7f3707d26800 1 -- 172.21.15.165:0/305333848 shutdown_connections 2024-09-22T08:12:02.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.284+0000 7f3707d26800 1 -- 172.21.15.165:0/305333848 wait complete. 2024-09-22T08:12:02.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.298+0000 7f3707d26800 1 Processor -- start 2024-09-22T08:12:02.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.298+0000 7f3707d26800 1 -- start start 2024-09-22T08:12:02.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.298+0000 7f3707d26800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5ac50 0x5604bdd49dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.298+0000 7f3707d26800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5604bdaf3dd0 con 0x5604bdc5ac50 2024-09-22T08:12:02.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.299+0000 7f37039d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5ac50 0x5604bdd49dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.299+0000 7f37039d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5ac50 0x5604bdd49dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56146/0 (socket says 172.21.15.165:56146) 2024-09-22T08:12:02.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.299+0000 7f37039d9640 1 -- 172.21.15.165:0/81234198 learned_addr learned my addr 172.21.15.165:0/81234198 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.299+0000 7f37039d9640 1 -- 172.21.15.165:0/81234198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604bdd4a3b0 con 0x5604bdc5ac50 2024-09-22T08:12:02.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.299+0000 7f37039d9640 1 --2- 172.21.15.165:0/81234198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5ac50 0x5604bdd49dc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f36f4001de0 tx=0x7f36f400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01f51a74fd9c74d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.299+0000 7f35f1e0b640 1 -- 172.21.15.165:0/81234198 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36f4012020 con 0x5604bdc5ac50 2024-09-22T08:12:02.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.299+0000 7f35f1e0b640 1 -- 172.21.15.165:0/81234198 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f400e470 con 0x5604bdc5ac50 2024-09-22T08:12:02.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.299+0000 7f35f1e0b640 1 -- 172.21.15.165:0/81234198 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36f400e7b0 con 0x5604bdc5ac50 2024-09-22T08:12:02.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.300+0000 7f3707d26800 1 -- 172.21.15.165:0/81234198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5ac50 msgr2=0x5604bdd49dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.300+0000 7f3707d26800 1 --2- 172.21.15.165:0/81234198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5ac50 0x5604bdd49dc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f36f4001de0 tx=0x7f36f400b6c0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.300+0000 7f3707d26800 1 -- 172.21.15.165:0/81234198 shutdown_connections 2024-09-22T08:12:02.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.300+0000 7f3707d26800 1 --2- 172.21.15.165:0/81234198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5ac50 0x5604bdd49dc0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.300+0000 7f3707d26800 1 -- 172.21.15.165:0/81234198 >> 172.21.15.165:0/81234198 conn(0x5604bdc55300 msgr2=0x5604bdd45740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.300+0000 7f3707d26800 1 -- 172.21.15.165:0/81234198 shutdown_connections 2024-09-22T08:12:02.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.300+0000 7f3707d26800 1 -- 172.21.15.165:0/81234198 wait complete. 2024-09-22T08:12:02.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.300+0000 7f3707d26800 1 Processor -- start 2024-09-22T08:12:02.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.300+0000 7f3707d26800 1 -- start start 2024-09-22T08:12:02.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.301+0000 7f3707d26800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 0x5604bdd4d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.301+0000 7f3707d26800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5604bdc61710 con 0x5604bdc5e8d0 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.301+0000 7f37039d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 0x5604bdd4d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.301+0000 7f37039d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 0x5604bdd4d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56150/0 (socket says 172.21.15.165:56150) 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.301+0000 7f37039d9640 1 -- 172.21.15.165:0/2847303636 learned_addr learned my addr 172.21.15.165:0/2847303636 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.301+0000 7f37039d9640 1 -- 172.21.15.165:0/2847303636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604bdd4ddc0 con 0x5604bdc5e8d0 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.302+0000 7f37039d9640 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 0x5604bdd4d860 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x5604bdd4ad50 tx=0x7f36f40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.302+0000 7f35ebfff640 1 -- 172.21.15.165:0/2847303636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36f4012030 con 0x5604bdc5e8d0 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.302+0000 7f35ebfff640 1 -- 172.21.15.165:0/2847303636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f400ee50 con 0x5604bdc5e8d0 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.302+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604bdd4c170 con 0x5604bdc5e8d0 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.302+0000 7f35ebfff640 1 -- 172.21.15.165:0/2847303636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36f401a700 con 0x5604bdc5e8d0 2024-09-22T08:12:02.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.302+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604bdd4c730 con 0x5604bdc5e8d0 2024-09-22T08:12:02.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.303+0000 7f35ebfff640 1 -- 172.21.15.165:0/2847303636 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f36f4015020 con 0x5604bdc5e8d0 2024-09-22T08:12:02.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.303+0000 7f35ebfff640 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35ec03d000 0x7f35ec03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.303+0000 7f35ebfff640 1 -- 172.21.15.165:0/2847303636 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f36f4020030 con 0x5604bdc5e8d0 2024-09-22T08:12:02.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.303+0000 7f37031d8640 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35ec03d000 0x7f35ec03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.303+0000 7f3707d26800 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd5a120 0x5604bdd5c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.303+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd5ca50 con 0x5604bdd5a120 2024-09-22T08:12:02.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.303+0000 7f37041da640 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd5a120 0x5604bdd5c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.304+0000 7f37031d8640 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35ec03d000 0x7f35ec03f4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5604bdbbeda0 tx=0x7f36ec050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.304+0000 7f37041da640 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd5a120 0x5604bdd5c510 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.304+0000 7f37041da640 1 -- 172.21.15.165:0/2847303636 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36fc00a4d0 con 0x5604bdd5a120 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.304+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd4cc60 con 0x5604bdd5a120 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.304+0000 7f37041da640 1 -- 172.21.15.165:0/2847303636 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36fc00a4d0 con 0x5604bdd5a120 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.304+0000 7f3707d26800 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd5ed80 0x5604bdd61170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.304+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd61840 con 0x5604bdd5ed80 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.304+0000 7f37039d9640 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd5ed80 0x5604bdd61170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.304+0000 7f37039d9640 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd5ed80 0x5604bdd61170 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.305+0000 7f37039d9640 1 -- 172.21.15.165:0/2847303636 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd5ed80 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.305+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd5dc20 con 0x5604bdd5a120 2024-09-22T08:12:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.305+0000 7f37041da640 1 -- 172.21.15.165:0/2847303636 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36fc00a4d0 con 0x5604bdd5a120 2024-09-22T08:12:02.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.305+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd5e0c0 con 0x5604bdd5a120 2024-09-22T08:12:02.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.305+0000 7f37041da640 1 -- 172.21.15.165:0/2847303636 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f36fc00a4d0 con 0x5604bdd5a120 2024-09-22T08:12:02.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.306+0000 7f3707d26800 1 Processor -- start 2024-09-22T08:12:02.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.306+0000 7f3707d26800 1 -- start start 2024-09-22T08:12:02.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.306+0000 7f3707d26800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd701c0 0x5604bdd705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.306+0000 7f3707d26800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5604bdb52d50 con 0x5604bdd701c0 2024-09-22T08:12:02.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.306+0000 7f37041da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd701c0 0x5604bdd705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.306+0000 7f37041da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd701c0 0x5604bdd705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56156/0 (socket says 172.21.15.165:56156) 2024-09-22T08:12:02.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.306+0000 7f37041da640 1 -- 172.21.15.165:0/3494048121 learned_addr learned my addr 172.21.15.165:0/3494048121 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.307+0000 7f37041da640 1 -- 172.21.15.165:0/3494048121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604bdd70c20 con 0x5604bdd701c0 2024-09-22T08:12:02.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.307+0000 7f37041da640 1 --2- 172.21.15.165:0/3494048121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd701c0 0x5604bdd705e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x5604bdd5ce30 tx=0x7f36fc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.307+0000 7f35e97fa640 1 -- 172.21.15.165:0/3494048121 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36fc014450 con 0x5604bdd701c0 2024-09-22T08:12:02.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.307+0000 7f35e97fa640 1 -- 172.21.15.165:0/3494048121 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36fc0145f0 con 0x5604bdd701c0 2024-09-22T08:12:02.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.307+0000 7f35e97fa640 1 -- 172.21.15.165:0/3494048121 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36fc014910 con 0x5604bdd701c0 2024-09-22T08:12:02.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.307+0000 7f3707d26800 1 -- 172.21.15.165:0/3494048121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604bdd71450 con 0x5604bdd701c0 2024-09-22T08:12:02.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.307+0000 7f3707d26800 1 -- 172.21.15.165:0/3494048121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604bdd719f0 con 0x5604bdd701c0 2024-09-22T08:12:02.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.308+0000 7f35e97fa640 1 -- 172.21.15.165:0/3494048121 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f36fc011040 con 0x5604bdd701c0 2024-09-22T08:12:02.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.308+0000 7f35e97fa640 1 --2- 172.21.15.165:0/3494048121 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35dc03cfb0 0x7f35dc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.308+0000 7f35e97fa640 1 -- 172.21.15.165:0/3494048121 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f36fc01e070 con 0x5604bdd701c0 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.308+0000 7f37039d9640 1 --2- 172.21.15.165:0/3494048121 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35dc03cfb0 0x7f35dc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.308+0000 7f3707d26800 1 Processor -- start 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f3707d26800 1 -- start start 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f37039d9640 1 --2- 172.21.15.165:0/3494048121 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35dc03cfb0 0x7f35dc03f470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x5604bdd5ced0 tx=0x7f36f400df50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f3707d26800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd7d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f3707d26800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5604bdd4a7e0 con 0x5604bdd7cc80 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f37041da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd7d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f37041da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd7d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56164/0 (socket says 172.21.15.165:56164) 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f37041da640 1 -- 172.21.15.165:0/1405916607 learned_addr learned my addr 172.21.15.165:0/1405916607 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f37041da640 1 -- 172.21.15.165:0/1405916607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604bdd7d650 con 0x5604bdd7cc80 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f37041da640 1 --2- 172.21.15.165:0/1405916607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd7d060 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f36fc016fd0 tx=0x7f36fc011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c65351a9f88808 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f35e2ffd640 1 -- 172.21.15.165:0/1405916607 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36fc04b070 con 0x5604bdd7cc80 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.309+0000 7f35e2ffd640 1 -- 172.21.15.165:0/1405916607 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36fc051070 con 0x5604bdd7cc80 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f35e2ffd640 1 -- 172.21.15.165:0/1405916607 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36fc022db0 con 0x5604bdd7cc80 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 -- 172.21.15.165:0/1405916607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 msgr2=0x5604bdd7d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 --2- 172.21.15.165:0/1405916607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd7d060 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f36fc016fd0 tx=0x7f36fc011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 -- 172.21.15.165:0/1405916607 shutdown_connections 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 --2- 172.21.15.165:0/1405916607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd7d060 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 -- 172.21.15.165:0/1405916607 >> 172.21.15.165:0/1405916607 conn(0x5604bdd79080 msgr2=0x5604bdd772c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 -- 172.21.15.165:0/1405916607 shutdown_connections 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 -- 172.21.15.165:0/1405916607 wait complete. 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 Processor -- start 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 -- start start 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd84260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.310+0000 7f3707d26800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5604bdd7dc90 con 0x5604bdd7cc80 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.311+0000 7f37041da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd84260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.311+0000 7f37041da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd84260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56174/0 (socket says 172.21.15.165:56174) 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.311+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 learned_addr learned my addr 172.21.15.165:0/1073579401 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.311+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604bdd847c0 con 0x5604bdd7cc80 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.311+0000 7f37041da640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd84260 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f36fc016fd0 tx=0x7f36fc054740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.311+0000 7f35e17fa640 1 -- 172.21.15.165:0/1073579401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36fc04b030 con 0x5604bdd7cc80 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.311+0000 7f35e17fa640 1 -- 172.21.15.165:0/1073579401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36fc011330 con 0x5604bdd7cc80 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.311+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604bdd84a50 con 0x5604bdd7cc80 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.311+0000 7f35e17fa640 1 -- 172.21.15.165:0/1073579401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36fc056070 con 0x5604bdd7cc80 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.311+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604bdd855e0 con 0x5604bdd7cc80 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.312+0000 7f35e17fa640 1 -- 172.21.15.165:0/1073579401 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f36fc056210 con 0x5604bdd7cc80 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.312+0000 7f35e17fa640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35cc03d000 0x7f35cc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.312+0000 7f35e17fa640 1 -- 172.21.15.165:0/1073579401 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f36fc04c070 con 0x5604bdd7cc80 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.312+0000 7f37039d9640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35cc03d000 0x7f35cc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f3707d26800 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd8fd20 0x5604bdd921e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd92930 con 0x5604bdd8fd20 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f37039d9640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35cc03d000 0x7f35cc03f4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36f401af70 tx=0x7f36f404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f37031d8640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd8fd20 0x5604bdd921e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f37031d8640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd8fd20 0x5604bdd921e0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f3707d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f3707d26800 20 realm 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.313+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd92d00 con 0x5604bdd8fd20 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd935d0 con 0x5604bdd8fd20 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd93970 con 0x5604bdd8fd20 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd94420 0x5604bdd96810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd96f70 con 0x5604bdd94420 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.314+0000 7f37041da640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd94420 0x5604bdd96810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.315+0000 7f37041da640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd94420 0x5604bdd96810 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.315+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.315+0000 7f3707d26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:02.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.315+0000 7f3707d26800 20 searching for the correct realm 2024-09-22T08:12:02.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.315+0000 7f3707d26800 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5604bdd99020 0x5604bdd9b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.315+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd99020 2024-09-22T08:12:02.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.315+0000 7f37039d9640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5604bdd99020 0x5604bdd9b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.315+0000 7f37039d9640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5604bdd99020 0x5604bdd9b4e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.316+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.316+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd94420 2024-09-22T08:12:02.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.316+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.316+0000 7f37041da640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f36fc014070 0x7f36fc0477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.316+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x7f36fc014070 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.316+0000 7f37031d8640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f36fc014070 0x7f36fc0477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.317+0000 7f37031d8640 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f36fc014070 0x7f36fc0477f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.317+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x7f36fc014070 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.317+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd8fd20 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.317+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.317+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd8fd20 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.317+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.317+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x7f36fc014070 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.318+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x7f36fc014070 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.318+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd94420 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.318+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.318+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd94420 2024-09-22T08:12:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.318+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.318+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd99020 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.318+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.318+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd8fd20 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.319+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.319+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x7f36fc014070 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.319+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x7f36fc014070 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.319+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd8fd20 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.319+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.319+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd94420 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.319+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.319+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd99020 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.320+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.320+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd99020 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.320+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.320+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x7f36fc014070 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.320+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x7f36fc014070 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.320+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd99020 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.321+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.321+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd99020 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.321+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.321+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd8fd20 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.321+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.321+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd8fd20 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.321+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.321+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x7f36fc014070 2024-09-22T08:12:02.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.321+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x7f36fc014070 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.321+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd99020 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.322+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.322+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd94420 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.322+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.322+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd8fd20 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.322+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.322+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x7f36fc014070 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.322+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x7f36fc014070 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.322+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd99020 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.323+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.323+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x7f36fc014070 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.323+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x7f36fc014070 2024-09-22T08:12:02.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.323+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd94420 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.323+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.323+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd99020 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.324+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.324+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x7f36fc014070 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.324+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec061430 con 0x7f36fc014070 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.324+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd8fd20 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.324+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.324+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9bbb0 con 0x5604bdd94420 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd97a50 con 0x5604bdd8fd20 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd97660 con 0x5604bdd8fd20 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36ec061430 con 0x5604bdd8fd20 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.325+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd983c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 zone default found 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 4 Realm: () 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 zonegroup default 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9c030 con 0x7f36fc014070 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9dbb0 con 0x5604bdd99020 2024-09-22T08:12:02.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9e020 con 0x5604bdd99020 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 started sync module instance, tier type = 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.326+0000 7f3707d26800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.327+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9cec0 con 0x5604bdd94420 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.328+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.328+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94578365026992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9cb20 con 0x5604bdd94420 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.328+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9ef50 con 0x5604bdd8fd20 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.329+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94578365026992] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.329+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.329+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94578365031552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9ef50 con 0x5604bdd8fd20 2024-09-22T08:12:02.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.329+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9f9e0 con 0x5604bdd99020 2024-09-22T08:12:02.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.330+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94578365031552] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.330+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.330+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94578365033120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9eec0 con 0x5604bdd99020 2024-09-22T08:12:02.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.330+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda08a0 con 0x5604bdd94420 2024-09-22T08:12:02.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.331+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.331+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94578365040080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda1140 con 0x5604bdd94420 2024-09-22T08:12:02.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.331+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94578365033120] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.331+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdd9fdd0 con 0x5604bdd8fd20 2024-09-22T08:12:02.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.332+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.332+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94578365040080] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.332+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94578365044016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda1950 con 0x5604bdd8fd20 2024-09-22T08:12:02.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.332+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda21a0 con 0x7f36fc014070 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.334+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.334+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94578365044016] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.334+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94578365045552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda2520 con 0x7f36fc014070 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.334+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda0c90 con 0x7f36fc014070 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.335+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94578365045552] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.335+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.335+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94578365041808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda2b10 con 0x7f36fc014070 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.335+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda34d0 con 0x7f36fc014070 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.336+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.336+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94578365050912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda38f0 con 0x7f36fc014070 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.336+0000 7f3707d26800 20 add_watcher() i=0 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.336+0000 7f3707d26800 20 add_watcher() i=1 2024-09-22T08:12:02.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.336+0000 7f3707d26800 20 add_watcher() i=2 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.336+0000 7f3707d26800 20 add_watcher() i=3 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.336+0000 7f3707d26800 20 add_watcher() i=4 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.336+0000 7f3707d26800 20 add_watcher() i=5 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.336+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94578365041808] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.336+0000 7f3707d26800 20 add_watcher() i=6 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.337+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94578365050912] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.337+0000 7f3707d26800 20 add_watcher() i=7 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.337+0000 7f3707d26800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.337+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda2030 con 0x5604bdd8fd20 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.337+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.337+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94578365051968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bdda42b0 con 0x5604bdd8fd20 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.338+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94578365051968] v34'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.338+0000 7f35b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.338+0000 7f3707d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.338+0000 7f3707d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.338+0000 7f3707d26800 5 note: GC not initialized 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.339+0000 7f35b8fe1640 20 reqs_thread_entry: start 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.339+0000 7f3707d26800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.339+0000 7f3707d26800 20 Filter name: none 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.339+0000 7f35327fc640 20 reqs_thread_entry: start 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.339+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda240 con 0x5604bdd8fd20 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.339+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.339+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda240 con 0x5604bdd94420 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.339+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.339+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda200 con 0x5604bdd8fd20 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.340+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.340+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda200 con 0x5604bdd99020 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.340+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.340+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda750 con 0x5604bdd99020 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.340+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.340+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda750 con 0x5604bdd99020 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.340+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.340+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda710 con 0x5604bdd8fd20 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.341+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.341+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda710 con 0x5604bdd8fd20 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.341+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.341+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda6c0 con 0x5604bdd99020 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.341+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.341+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda6c0 con 0x5604bdd99020 2024-09-22T08:12:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.341+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.341+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddda6c0 con 0x7f36fc014070 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.342+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.342+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd8fd20 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.342+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.342+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd94420 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.342+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.342+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd99020 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.342+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.342+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x7f36fc014070 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.343+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.343+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x7f36fc014070 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.343+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.343+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd99020 2024-09-22T08:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.343+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.343+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x7f36fc014070 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.344+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.344+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd8fd20 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.344+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.344+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd99020 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.344+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.344+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x7f36fc014070 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.344+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.344+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd94420 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.345+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.345+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x7f36fc014070 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.345+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.345+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd8fd20 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.345+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.345+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd8fd20 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.345+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.345+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd99020 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.345+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.345+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd8fd20 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.346+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.346+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd8fd20 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.346+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.346+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd99020 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.346+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.346+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd99020 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.346+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.346+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x5604bdd99020 2024-09-22T08:12:02.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.347+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.347+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd9c50 con 0x7f36fc014070 2024-09-22T08:12:02.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.347+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.348+0000 7f35b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.348+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94578365051968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd7650 con 0x5604bdd8fd20 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.349+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94578365051968] v34'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.349+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94578365026992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd7650 con 0x5604bdd94420 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.350+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94578365026992] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.350+0000 7f3707d26800 20 remove_watcher() i=0 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.350+0000 7f3707d26800 2 removed watcher, disabling cache 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.350+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94578365031552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd7650 con 0x5604bdd8fd20 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.351+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94578365031552] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.351+0000 7f3707d26800 20 remove_watcher() i=1 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.351+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94578365033120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd7650 con 0x5604bdd99020 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.352+0000 7f37039d9640 1 -- 172.21.15.165:0/1073579401 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94578365033120] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36f40187b0 con 0x5604bdd99020 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.352+0000 7f3707d26800 20 remove_watcher() i=2 2024-09-22T08:12:02.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.352+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94578365040080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd7650 con 0x5604bdd94420 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.353+0000 7f37041da640 1 -- 172.21.15.165:0/1073579401 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94578365040080] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36fc02a070 con 0x5604bdd94420 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.353+0000 7f3707d26800 20 remove_watcher() i=3 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.353+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94578365044016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd7650 con 0x5604bdd8fd20 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.355+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94578365044016] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x5604bdd8fd20 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.355+0000 7f3707d26800 20 remove_watcher() i=4 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.355+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94578365045552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd7650 con 0x7f36fc014070 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.356+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94578365045552] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.356+0000 7f3707d26800 20 remove_watcher() i=5 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.356+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94578365041808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd7650 con 0x7f36fc014070 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.357+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94578365041808] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.357+0000 7f3707d26800 20 remove_watcher() i=6 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.357+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94578365050912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604bddd7650 con 0x7f36fc014070 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.358+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94578365050912] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec08a1c0 con 0x7f36fc014070 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.358+0000 7f3707d26800 20 remove_watcher() i=7 2024-09-22T08:12:02.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.358+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f36fc014070 msgr2=0x7f36fc0477f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.358+0000 7f3707d26800 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f36fc014070 0x7f36fc0477f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.358+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd8fd20 msgr2=0x5604bdd921e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.358+0000 7f3707d26800 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd8fd20 0x5604bdd921e0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.358+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd94420 msgr2=0x5604bdd96810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.358+0000 7f3707d26800 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd94420 0x5604bdd96810 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.358+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5604bdd99020 msgr2=0x5604bdd9b4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.358+0000 7f3707d26800 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5604bdd99020 0x5604bdd9b4e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35cc03d000 msgr2=0x7f35cc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35cc03d000 0x7f35cc03f4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36f401af70 tx=0x7f36f404e000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 msgr2=0x5604bdd84260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 --2- 172.21.15.165:0/1073579401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd7cc80 0x5604bdd84260 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f36fc016fd0 tx=0x7f36fc054740 comp rx=0 tx=0).stop 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 reap_dead start 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f37031d8640 1 -- 172.21.15.165:0/1073579401 reap_dead start 2024-09-22T08:12:02.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 shutdown_connections 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 >> 172.21.15.165:0/1073579401 conn(0x5604bdd79080 msgr2=0x5604bdd77290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 shutdown_connections 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/1073579401 wait complete. 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/3494048121 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35dc03cfb0 msgr2=0x7f35dc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 --2- 172.21.15.165:0/3494048121 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35dc03cfb0 0x7f35dc03f470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x5604bdd5ced0 tx=0x7f36f400df50 comp rx=0 tx=0).stop 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/3494048121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd701c0 msgr2=0x5604bdd705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 --2- 172.21.15.165:0/3494048121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd701c0 0x5604bdd705e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x5604bdd5ce30 tx=0x7f36fc018830 comp rx=0 tx=0).stop 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/3494048121 shutdown_connections 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 --2- 172.21.15.165:0/3494048121 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35dc03cfb0 0x7f35dc03f470 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 --2- 172.21.15.165:0/3494048121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdd701c0 0x5604bdd705e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/3494048121 >> 172.21.15.165:0/3494048121 conn(0x5604bdd64570 msgr2=0x5604bdd64950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/3494048121 shutdown_connections 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/3494048121 wait complete. 2024-09-22T08:12:02.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd5a120 msgr2=0x5604bdd5c510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd5a120 0x5604bdd5c510 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd5ed80 msgr2=0x5604bdd61170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.359+0000 7f3707d26800 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd5ed80 0x5604bdd61170 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35ec03d000 msgr2=0x7f35ec03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35ec03d000 0x7f35ec03f4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5604bdbbeda0 tx=0x7f36ec050000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 msgr2=0x5604bdd4d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 0x5604bdd4d860 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x5604bdd4ad50 tx=0x7f36f40040e0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 shutdown_connections 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5604bdd5ed80 0x5604bdd61170 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5604bdd5a120 0x5604bdd5c510 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f35ec03d000 0x7f35ec03f4c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 --2- 172.21.15.165:0/2847303636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604bdc5e8d0 0x5604bdd4d860 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 >> 172.21.15.165:0/2847303636 conn(0x5604bdc55300 msgr2=0x5604bdd4b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 shutdown_connections 2024-09-22T08:12:02.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.360+0000 7f3707d26800 1 -- 172.21.15.165:0/2847303636 wait complete. 2024-09-22T08:12:02.369 INFO:teuthology.orchestra.run.smithi165.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:12:02.369 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:12:02.369 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-22T08:12:02.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-22T08:12:02.370 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-22T08:12:02.454 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:02.454 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:02.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.454+0000 7f2d9ea0e800 1 Processor -- start 2024-09-22T08:12:02.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.454+0000 7f2d9ea0e800 1 -- start start 2024-09-22T08:12:02.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.454+0000 7f2d9ea0e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e3d35b2cb0 0x55e3d35b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.454+0000 7f2d9ea0e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e3d343ca20 con 0x55e3d35b19e0 2024-09-22T08:12:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.454+0000 7f2d9ea0e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e3d343c7d0 con 0x55e3d35b2cb0 2024-09-22T08:12:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.454+0000 7f2d99858640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e3d35b2cb0 0x55e3d35b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.455+0000 7f2d99858640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e3d35b2cb0 0x55e3d35b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56190/0 (socket says 172.21.15.165:56190) 2024-09-22T08:12:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.455+0000 7f2d9a059640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e3d35b19e0 0x55e3d35b25a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49454/0 (socket says 172.21.15.165:49454) 2024-09-22T08:12:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.455+0000 7f2d99858640 1 -- 172.21.15.165:0/3823296408 learned_addr learned my addr 172.21.15.165:0/3823296408 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.455+0000 7f2d99858640 1 -- 172.21.15.165:0/3823296408 >> v1:172.21.15.53:6789/0 conn(0x55e3d35b19e0 legacy=0x55e3d35b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.455+0000 7f2d99858640 1 -- 172.21.15.165:0/3823296408 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3d35b20e0 con 0x55e3d35b2cb0 2024-09-22T08:12:02.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d99858640 1 --2- 172.21.15.165:0/3823296408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b2cb0 0x55e3d35b8640 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400a520 tx=0x7f2d84045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c45c4c4dffead3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d99057640 1 -- 172.21.15.165:0/3823296408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d84055070 con 0x55e3d35b2cb0 2024-09-22T08:12:02.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d99057640 1 -- 172.21.15.165:0/3823296408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d840515b0 con 0x55e3d35b2cb0 2024-09-22T08:12:02.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d99057640 1 -- 172.21.15.165:0/3823296408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d840518d0 con 0x55e3d35b2cb0 2024-09-22T08:12:02.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3823296408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b2cb0 msgr2=0x55e3d35b8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3823296408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b2cb0 0x55e3d35b8640 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400a520 tx=0x7f2d84045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3823296408 shutdown_connections 2024-09-22T08:12:02.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3823296408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b2cb0 0x55e3d35b8640 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3823296408 >> 172.21.15.165:0/3823296408 conn(0x55e3d35acdb0 msgr2=0x55e3d35af210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3823296408 shutdown_connections 2024-09-22T08:12:02.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.457+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3823296408 wait complete. 2024-09-22T08:12:02.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.471+0000 7f2d9ea0e800 1 Processor -- start 2024-09-22T08:12:02.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.471+0000 7f2d9ea0e800 1 -- start start 2024-09-22T08:12:02.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.471+0000 7f2d9ea0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.471+0000 7f2d9ea0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e3d3449dd0 con 0x55e3d35b19e0 2024-09-22T08:12:02.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.471+0000 7f2d9a059640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.471+0000 7f2d9a059640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56206/0 (socket says 172.21.15.165:56206) 2024-09-22T08:12:02.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.472+0000 7f2d9a059640 1 -- 172.21.15.165:0/1412829478 learned_addr learned my addr 172.21.15.165:0/1412829478 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.472+0000 7f2d9a059640 1 -- 172.21.15.165:0/1412829478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3d36a1570 con 0x55e3d35b19e0 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.472+0000 7f2d9a059640 1 --2- 172.21.15.165:0/1412829478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a0f80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0016e0 tx=0x7f2d8c001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee3a21d09c57a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.472+0000 7f2c88608640 1 -- 172.21.15.165:0/1412829478 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d8c013420 con 0x55e3d35b19e0 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.472+0000 7f2c88608640 1 -- 172.21.15.165:0/1412829478 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0135e0 con 0x55e3d35b19e0 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.472+0000 7f2c88608640 1 -- 172.21.15.165:0/1412829478 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d8c013900 con 0x55e3d35b19e0 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.473+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/1412829478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 msgr2=0x55e3d36a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.473+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/1412829478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a0f80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0016e0 tx=0x7f2d8c001ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.473+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/1412829478 shutdown_connections 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.473+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/1412829478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a0f80 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.473+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/1412829478 >> 172.21.15.165:0/1412829478 conn(0x55e3d35acdb0 msgr2=0x55e3d369c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.473+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/1412829478 shutdown_connections 2024-09-22T08:12:02.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.473+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/1412829478 wait complete. 2024-09-22T08:12:02.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.473+0000 7f2d9ea0e800 1 Processor -- start 2024-09-22T08:12:02.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.473+0000 7f2d9ea0e800 1 -- start start 2024-09-22T08:12:02.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.474+0000 7f2d9ea0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.474+0000 7f2d9ea0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e3d35b8b80 con 0x55e3d35b19e0 2024-09-22T08:12:02.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.474+0000 7f2d9a059640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.474+0000 7f2d9a059640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56222/0 (socket says 172.21.15.165:56222) 2024-09-22T08:12:02.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.474+0000 7f2d9a059640 1 -- 172.21.15.165:0/852977673 learned_addr learned my addr 172.21.15.165:0/852977673 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.474+0000 7f2d9a059640 1 -- 172.21.15.165:0/852977673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3d36a8fe0 con 0x55e3d35b19e0 2024-09-22T08:12:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.475+0000 7f2d9a059640 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a8a80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c000f80 tx=0x7f2d8c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.475+0000 7f2c86e05640 1 -- 172.21.15.165:0/852977673 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d8c022020 con 0x55e3d35b19e0 2024-09-22T08:12:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.475+0000 7f2c86e05640 1 -- 172.21.15.165:0/852977673 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d8c019040 con 0x55e3d35b19e0 2024-09-22T08:12:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.475+0000 7f2c86e05640 1 -- 172.21.15.165:0/852977673 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d8c004a40 con 0x55e3d35b19e0 2024-09-22T08:12:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.475+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3d36a9270 con 0x55e3d35b19e0 2024-09-22T08:12:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.475+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3d36a9c70 con 0x55e3d35b19e0 2024-09-22T08:12:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.476+0000 7f2c86e05640 1 -- 172.21.15.165:0/852977673 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2d8c025020 con 0x55e3d35b19e0 2024-09-22T08:12:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.476+0000 7f2c86e05640 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c8003cfb0 0x7f2c8003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.476+0000 7f2c86e05640 1 -- 172.21.15.165:0/852977673 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2d8c0545e0 con 0x55e3d35b19e0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.476+0000 7f2d99858640 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c8003cfb0 0x7f2c8003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.476+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d35b2cb0 0x55e3d36b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.476+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36b0610 con 0x55e3d35b2cb0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.476+0000 7f2d9a85a640 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d35b2cb0 0x55e3d36b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.477+0000 7f2d99858640 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c8003cfb0 0x7f2c8003f470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2d84057000 tx=0x7f2d84052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.477+0000 7f2d9a85a640 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d35b2cb0 0x55e3d36b00d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.477+0000 7f2d9a85a640 1 -- 172.21.15.165:0/852977673 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d940083e0 con 0x55e3d35b2cb0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.477+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36b09b0 con 0x55e3d35b2cb0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.477+0000 7f2d9a85a640 1 -- 172.21.15.165:0/852977673 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d940083e0 con 0x55e3d35b2cb0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.477+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36b24b0 0x55e3d36b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.477+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36b50e0 con 0x55e3d36b24b0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.477+0000 7f2d9a059640 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36b24b0 0x55e3d36b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.478+0000 7f2d9a059640 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36b24b0 0x55e3d36b4950 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.478+0000 7f2d9a059640 1 -- 172.21.15.165:0/852977673 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36b24b0 2024-09-22T08:12:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.478+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36b1200 con 0x55e3d35b2cb0 2024-09-22T08:12:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.478+0000 7f2d9a85a640 1 -- 172.21.15.165:0/852977673 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d940083e0 con 0x55e3d35b2cb0 2024-09-22T08:12:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.478+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36b1650 con 0x55e3d35b2cb0 2024-09-22T08:12:02.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.479+0000 7f2d9a85a640 1 -- 172.21.15.165:0/852977673 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d940083e0 con 0x55e3d35b2cb0 2024-09-22T08:12:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.479+0000 7f2d9ea0e800 1 Processor -- start 2024-09-22T08:12:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.479+0000 7f2d9ea0e800 1 -- start start 2024-09-22T08:12:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.479+0000 7f2d9ea0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35272e0 0x55e3d3525b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.479+0000 7f2d9ea0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e3d34a8d50 con 0x55e3d35272e0 2024-09-22T08:12:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.479+0000 7f2d9a85a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35272e0 0x55e3d3525b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.479+0000 7f2d9a85a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35272e0 0x55e3d3525b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56238/0 (socket says 172.21.15.165:56238) 2024-09-22T08:12:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.479+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3456300868 learned_addr learned my addr 172.21.15.165:0/3456300868 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.480+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3456300868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3d3527800 con 0x55e3d35272e0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.480+0000 7f2d9a85a640 1 --2- 172.21.15.165:0/3456300868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35272e0 0x55e3d3525b50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2d94005fd0 tx=0x7f2d9400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.480+0000 7f2c7ffff640 1 -- 172.21.15.165:0/3456300868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d94007dc0 con 0x55e3d35272e0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.480+0000 7f2c7ffff640 1 -- 172.21.15.165:0/3456300868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d9401e020 con 0x55e3d35272e0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.480+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3456300868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3d3526090 con 0x55e3d35272e0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.480+0000 7f2c7ffff640 1 -- 172.21.15.165:0/3456300868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d94019570 con 0x55e3d35272e0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.480+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3456300868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3d35265e0 con 0x55e3d35272e0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.481+0000 7f2c7ffff640 1 -- 172.21.15.165:0/3456300868 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2d94016040 con 0x55e3d35272e0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.481+0000 7f2c7ffff640 1 --2- 172.21.15.165:0/3456300868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c7403cfb0 0x7f2c7403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.481+0000 7f2c7ffff640 1 -- 172.21.15.165:0/3456300868 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2d9401f030 con 0x55e3d35272e0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.481+0000 7f2d9a059640 1 --2- 172.21.15.165:0/3456300868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c7403cfb0 0x7f2c7403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.482+0000 7f2d9ea0e800 1 Processor -- start 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.482+0000 7f2d9a059640 1 --2- 172.21.15.165:0/3456300868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c7403cfb0 0x7f2c7403f470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c052b90 tx=0x7f2d8c052800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.482+0000 7f2d9ea0e800 1 -- start start 2024-09-22T08:12:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.482+0000 7f2d9ea0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.482+0000 7f2d9ea0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e3d36a19a0 con 0x55e3d36d2750 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.482+0000 7f2d9a85a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.482+0000 7f2d9a85a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56246/0 (socket says 172.21.15.165:56246) 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.482+0000 7f2d9a85a640 1 -- 172.21.15.165:0/2984225952 learned_addr learned my addr 172.21.15.165:0/2984225952 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.482+0000 7f2d9a85a640 1 -- 172.21.15.165:0/2984225952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3d36d3140 con 0x55e3d36d2750 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2d9a85a640 1 --2- 172.21.15.165:0/2984225952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d2b50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2d94018fd0 tx=0x7f2d94014710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d93b2978117830f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2c7dffb640 1 -- 172.21.15.165:0/2984225952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d94051020 con 0x55e3d36d2750 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2c7dffb640 1 -- 172.21.15.165:0/2984225952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d940560d0 con 0x55e3d36d2750 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2c7dffb640 1 -- 172.21.15.165:0/2984225952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d9401d070 con 0x55e3d36d2750 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/2984225952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 msgr2=0x55e3d36d2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/2984225952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d2b50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2d94018fd0 tx=0x7f2d94014710 comp rx=0 tx=0).stop 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/2984225952 shutdown_connections 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/2984225952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d2b50 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/2984225952 >> 172.21.15.165:0/2984225952 conn(0x55e3d36ceb50 msgr2=0x55e3d36ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/2984225952 shutdown_connections 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.483+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/2984225952 wait complete. 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.484+0000 7f2d9ea0e800 1 Processor -- start 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.484+0000 7f2d9ea0e800 1 -- start start 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.484+0000 7f2d9ea0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.484+0000 7f2d9ea0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e3d36d3760 con 0x55e3d36d2750 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.484+0000 7f2d9a85a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.484+0000 7f2d9a85a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56252/0 (socket says 172.21.15.165:56252) 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.484+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 learned_addr learned my addr 172.21.15.165:0/3644116107 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.484+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3d36da300 con 0x55e3d36d2750 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.485+0000 7f2d9a85a640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d9da0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2d94054970 tx=0x7f2d94007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.485+0000 7f2c6bfff640 1 -- 172.21.15.165:0/3644116107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d94045470 con 0x55e3d36d2750 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.485+0000 7f2c6bfff640 1 -- 172.21.15.165:0/3644116107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d94031070 con 0x55e3d36d2750 2024-09-22T08:12:02.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.485+0000 7f2c6bfff640 1 -- 172.21.15.165:0/3644116107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d940173b0 con 0x55e3d36d2750 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.485+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3d36da590 con 0x55e3d36d2750 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.485+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3d36daf10 con 0x55e3d36d2750 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.485+0000 7f2c6bfff640 1 -- 172.21.15.165:0/3644116107 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2d94017550 con 0x55e3d36d2750 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.486+0000 7f2c6bfff640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c6403cfb0 0x7f2c6403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.486+0000 7f2c6bfff640 1 -- 172.21.15.165:0/3644116107 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2d9402dae0 con 0x55e3d36d2750 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.486+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.486+0000 7f2d9a059640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c6403cfb0 0x7f2c6403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.486+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d36e5630 0x55e3d36e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.486+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36e8210 con 0x55e3d36e5630 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.486+0000 7f2d99858640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d36e5630 0x55e3d36e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.486+0000 7f2d9a059640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c6403cfb0 0x7f2c6403f470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c01db50 tx=0x7f2d8c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.486+0000 7f2d99858640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d36e5630 0x55e3d36e7ac0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 20 realm 2024-09-22T08:12:02.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36e8640 con 0x55e3d36e5630 2024-09-22T08:12:02.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:02.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36e8f10 con 0x55e3d36e5630 2024-09-22T08:12:02.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36e92b0 con 0x55e3d36e5630 2024-09-22T08:12:02.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36ea010 0x55e3d36ec400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.487+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36ec940 con 0x55e3d36ea010 2024-09-22T08:12:02.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.488+0000 7f2d9a85a640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36ea010 0x55e3d36ec400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.488+0000 7f2d9a85a640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36ea010 0x55e3d36ec400 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.488+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2d940083e0 con 0x55e3d36ea010 2024-09-22T08:12:02.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.488+0000 7f2d9ea0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:02.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.488+0000 7f2d9ea0e800 20 searching for the correct realm 2024-09-22T08:12:02.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.488+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e3d36ee980 0x55e3d36f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.488+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f1510 con 0x55e3d36ee980 2024-09-22T08:12:02.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.488+0000 7f2d9a059640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e3d36ee980 0x55e3d36f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.488+0000 7f2d9a059640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e3d36ee980 0x55e3d36f0e40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.489+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.489+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f1510 con 0x55e3d36ea010 2024-09-22T08:12:02.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.489+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2d940083e0 con 0x55e3d36ea010 2024-09-22T08:12:02.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.489+0000 7f2d9a85a640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d94019040 0x7f2d9402d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.489+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x7f2d94019040 2024-09-22T08:12:02.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.489+0000 7f2d99858640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d94019040 0x7f2d9402d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.490+0000 7f2d99858640 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d94019040 0x7f2d9402d030 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.490+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x7f2d94019040 2024-09-22T08:12:02.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.490+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36e5630 2024-09-22T08:12:02.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.490+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.490+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36e5630 2024-09-22T08:12:02.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.490+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.490+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x7f2d94019040 2024-09-22T08:12:02.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.491+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x7f2d94019040 2024-09-22T08:12:02.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.491+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ea010 2024-09-22T08:12:02.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.491+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d940083e0 con 0x55e3d36ea010 2024-09-22T08:12:02.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.491+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ea010 2024-09-22T08:12:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.491+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.491+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ee980 2024-09-22T08:12:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.491+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.491+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36e5630 2024-09-22T08:12:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.492+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.492+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x7f2d94019040 2024-09-22T08:12:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.492+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x7f2d94019040 2024-09-22T08:12:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.492+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36e5630 2024-09-22T08:12:02.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.492+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.492+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ea010 2024-09-22T08:12:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.493+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.493+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ee980 2024-09-22T08:12:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.493+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.493+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ee980 2024-09-22T08:12:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.493+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.493+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x7f2d94019040 2024-09-22T08:12:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.494+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x7f2d94019040 2024-09-22T08:12:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.494+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ee980 2024-09-22T08:12:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.494+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.494+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ee980 2024-09-22T08:12:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.494+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.494+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36e5630 2024-09-22T08:12:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.494+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.494+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36e5630 2024-09-22T08:12:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.494+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.494+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x7f2d94019040 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.495+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x7f2d94019040 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.495+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ee980 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.495+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.495+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ea010 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.495+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.495+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36e5630 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.495+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.495+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x7f2d94019040 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.496+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x7f2d94019040 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.496+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ee980 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.496+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.496+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x7f2d94019040 2024-09-22T08:12:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.496+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x7f2d94019040 2024-09-22T08:12:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.496+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ea010 2024-09-22T08:12:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.497+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.497+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ee980 2024-09-22T08:12:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.497+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.497+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x7f2d94019040 2024-09-22T08:12:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.497+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d84057030 con 0x7f2d94019040 2024-09-22T08:12:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.497+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36e5630 2024-09-22T08:12:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.497+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.497+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2d940413f0 con 0x55e3d36ea010 2024-09-22T08:12:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36ed280 con 0x55e3d36e5630 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36ed670 con 0x55e3d36e5630 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d84057030 con 0x55e3d36e5630 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36eda90 con 0x55e3d36e5630 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 zone default found 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 4 Realm: () 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 zonegroup default 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.498+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f1990 con 0x7f2d94019040 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f3510 con 0x55e3d36ee980 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f39e0 con 0x55e3d36ee980 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9ea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9ea0e800 20 started sync module instance, tier type = 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9ea0e800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.499+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f2820 con 0x55e3d36ea010 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.500+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.500+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94436993215808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f2820 con 0x55e3d36ea010 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.500+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f4520 con 0x55e3d36e5630 2024-09-22T08:12:02.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.501+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94436993215808] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.502+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.502+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94436993220624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f44e0 con 0x55e3d36e5630 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.502+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f4fe0 con 0x55e3d36ee980 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.503+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94436993220624] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.503+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.503+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94436993223376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f53d0 con 0x55e3d36ee980 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.503+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f5df0 con 0x55e3d36ea010 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.504+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94436993223376] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.504+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.504+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94436993226976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f6210 con 0x55e3d36ea010 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.504+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f6c30 con 0x55e3d36e5630 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.505+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94436993226976] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.505+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.505+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94436993230624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f6bf0 con 0x55e3d36e5630 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.506+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f7640 con 0x7f2d94019040 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.507+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.507+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94436993233296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f75b0 con 0x7f2d94019040 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.507+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94436993230624] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.507+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f23b0 con 0x7f2d94019040 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.508+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94436993233296] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.508+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.508+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94436993235552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f8080 con 0x7f2d94019040 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.508+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f8a40 con 0x7f2d94019040 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.509+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.509+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94436993238416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f8ea0 con 0x7f2d94019040 2024-09-22T08:12:02.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.509+0000 7f2d9ea0e800 20 add_watcher() i=0 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.509+0000 7f2d9ea0e800 20 add_watcher() i=1 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.509+0000 7f2d9ea0e800 20 add_watcher() i=2 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.509+0000 7f2d9ea0e800 20 add_watcher() i=3 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.509+0000 7f2d9ea0e800 20 add_watcher() i=4 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.509+0000 7f2d9ea0e800 20 add_watcher() i=5 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.509+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94436993235552] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.509+0000 7f2d9ea0e800 20 add_watcher() i=6 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.510+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94436993238416] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.510+0000 7f2d9ea0e800 20 add_watcher() i=7 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.510+0000 7f2d9ea0e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.510+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f2420 con 0x55e3d36e5630 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.510+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.510+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94436993239472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f9800 con 0x55e3d36e5630 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.511+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94436993239472] v34'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.511+0000 7f2c50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.511+0000 7f2d9ea0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.511+0000 7f2d9ea0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.512+0000 7f2d9ea0e800 5 note: GC not initialized 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.512+0000 7f2bcb7fe640 20 reqs_thread_entry: start 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.512+0000 7f2d9ea0e800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.512+0000 7f2d9ea0e800 20 Filter name: none 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.512+0000 7f2bc97fa640 20 reqs_thread_entry: start 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.512+0000 7f2d9ea0e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.512+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d372ee30 con 0x55e3d36e5630 2024-09-22T08:12:02.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.512+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.512+0000 7f2d9ea0e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.512+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e3d37303b0 con 0x7f2d94019040 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.513+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.514+0000 7f2c50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.514+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94436993239472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d372e750 con 0x55e3d36e5630 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.515+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94436993239472] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.515+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94436993215808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f89b0 con 0x55e3d36ea010 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.516+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94436993215808] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.516+0000 7f2d9ea0e800 20 remove_watcher() i=0 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.516+0000 7f2d9ea0e800 2 removed watcher, disabling cache 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.516+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94436993220624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f2d20 con 0x55e3d36e5630 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.517+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94436993220624] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.517+0000 7f2d9ea0e800 20 remove_watcher() i=1 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.517+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94436993223376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f4010 con 0x55e3d36ee980 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.518+0000 7f2d9a059640 1 -- 172.21.15.165:0/3644116107 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94436993223376] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d8c00f030 con 0x55e3d36ee980 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.518+0000 7f2d9ea0e800 20 remove_watcher() i=2 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.518+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94436993226976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f4ad0 con 0x55e3d36ea010 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.519+0000 7f2d9a85a640 1 -- 172.21.15.165:0/3644116107 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94436993226976] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d94060040 con 0x55e3d36ea010 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.519+0000 7f2d9ea0e800 20 remove_watcher() i=3 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.519+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94436993230624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f4ad0 con 0x55e3d36e5630 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.520+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94436993230624] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x55e3d36e5630 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.520+0000 7f2d9ea0e800 20 remove_watcher() i=4 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.520+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94436993233296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f6720 con 0x7f2d94019040 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.521+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94436993233296] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.521+0000 7f2d9ea0e800 20 remove_watcher() i=5 2024-09-22T08:12:02.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.521+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94436993235552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f4ad0 con 0x7f2d94019040 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.523+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94436993235552] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.523+0000 7f2d9ea0e800 20 remove_watcher() i=6 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.523+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94436993238416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e3d36f7190 con 0x7f2d94019040 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94436993238416] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d840881c0 con 0x7f2d94019040 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 20 remove_watcher() i=7 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d94019040 msgr2=0x7f2d9402d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f2d94019040 0x7f2d9402d030 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d36e5630 msgr2=0x55e3d36e7ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d36e5630 0x55e3d36e7ac0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36ea010 msgr2=0x55e3d36ec400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36ea010 0x55e3d36ec400 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e3d36ee980 msgr2=0x55e3d36f0e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e3d36ee980 0x55e3d36f0e40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c6403cfb0 msgr2=0x7f2c6403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c6403cfb0 0x7f2c6403f470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c01db50 tx=0x7f2d8c04f000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d99858640 1 -- 172.21.15.165:0/3644116107 reap_dead start 2024-09-22T08:12:02.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 msgr2=0x55e3d36d9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d9da0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2d94054970 tx=0x7f2d94007f60 comp rx=0 tx=0).stop 2024-09-22T08:12:02.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 shutdown_connections 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3644116107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d36d2750 0x55e3d36d9da0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 >> 172.21.15.165:0/3644116107 conn(0x55e3d36ceb50 msgr2=0x55e3d36ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 shutdown_connections 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3644116107 wait complete. 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3456300868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c7403cfb0 msgr2=0x7f2c7403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3456300868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c7403cfb0 0x7f2c7403f470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c052b90 tx=0x7f2d8c052800 comp rx=0 tx=0).stop 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3456300868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35272e0 msgr2=0x55e3d3525b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3456300868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35272e0 0x55e3d3525b50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2d94005fd0 tx=0x7f2d9400af40 comp rx=0 tx=0).stop 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3456300868 shutdown_connections 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3456300868 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c7403cfb0 0x7f2c7403f470 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/3456300868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35272e0 0x55e3d3525b50 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.524+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3456300868 >> 172.21.15.165:0/3456300868 conn(0x55e3d36b7e30 msgr2=0x55e3d36b8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3456300868 shutdown_connections 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/3456300868 wait complete. 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d35b2cb0 msgr2=0x55e3d36b00d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d35b2cb0 0x55e3d36b00d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36b24b0 msgr2=0x55e3d36b4950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36b24b0 0x55e3d36b4950 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c8003cfb0 msgr2=0x7f2c8003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c8003cfb0 0x7f2c8003f470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2d84057000 tx=0x7f2d84052000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 msgr2=0x55e3d36a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a8a80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c000f80 tx=0x7f2d8c001250 comp rx=0 tx=0).stop 2024-09-22T08:12:02.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 shutdown_connections 2024-09-22T08:12:02.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e3d36b24b0 0x55e3d36b4950 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e3d35b2cb0 0x55e3d36b00d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f2c8003cfb0 0x7f2c8003f470 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 --2- 172.21.15.165:0/852977673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3d35b19e0 0x55e3d36a8a80 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 >> 172.21.15.165:0/852977673 conn(0x55e3d35acdb0 msgr2=0x55e3d36a2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 shutdown_connections 2024-09-22T08:12:02.541 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.525+0000 7f2d9ea0e800 1 -- 172.21.15.165:0/852977673 wait complete. 2024-09-22T08:12:02.542 INFO:teuthology.orchestra.run.smithi165.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:12:02.542 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:12:02.543 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-22T08:12:02.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-22T08:12:02.543 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-22T08:12:02.590 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:02.590 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.590+0000 7fd52bbaf800 1 Processor -- start 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.590+0000 7fd52bbaf800 1 -- start start 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.590+0000 7fd52bbaf800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563f01dab510 0x563f01e3c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.590+0000 7fd52bbaf800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563f01cc2a20 con 0x563f01e3ca10 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.590+0000 7fd52bbaf800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563f01cc27d0 con 0x563f01dab510 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.590+0000 7fd529699640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563f01dab510 0x563f01e3c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.591+0000 7fd529699640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563f01dab510 0x563f01e3c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56254/0 (socket says 172.21.15.165:56254) 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.591+0000 7fd529699640 1 -- 172.21.15.165:0/1864530209 learned_addr learned my addr 172.21.15.165:0/1864530209 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.591+0000 7fd528e98640 1 --1- 172.21.15.165:0/1864530209 >> v1:172.21.15.53:6789/0 conn(0x563f01e3ca10 0x563f01e3eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49464/0 (socket says 172.21.15.165:49464) 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.591+0000 7fd529699640 1 -- 172.21.15.165:0/1864530209 >> v1:172.21.15.53:6789/0 conn(0x563f01e3ca10 legacy=0x563f01e3eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.591+0000 7fd529699640 1 -- 172.21.15.165:0/1864530209 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f01e41790 con 0x563f01dab510 2024-09-22T08:12:02.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd529699640 1 --2- 172.21.15.165:0/1864530209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01e3c4d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00a520 tx=0x7fd51c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de996b6b5a548465 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd51bfff640 1 -- 172.21.15.165:0/1864530209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd51c055070 con 0x563f01dab510 2024-09-22T08:12:02.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd51bfff640 1 -- 172.21.15.165:0/1864530209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51c0515b0 con 0x563f01dab510 2024-09-22T08:12:02.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd51bfff640 1 -- 172.21.15.165:0/1864530209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd51c0518d0 con 0x563f01dab510 2024-09-22T08:12:02.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1864530209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 msgr2=0x563f01e3c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/1864530209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01e3c4d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00a520 tx=0x7fd51c045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1864530209 shutdown_connections 2024-09-22T08:12:02.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/1864530209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01e3c4d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1864530209 >> 172.21.15.165:0/1864530209 conn(0x563f01e31be0 msgr2=0x563f01e34020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1864530209 shutdown_connections 2024-09-22T08:12:02.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.593+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1864530209 wait complete. 2024-09-22T08:12:02.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.607+0000 7fd52bbaf800 1 Processor -- start 2024-09-22T08:12:02.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.607+0000 7fd52bbaf800 1 -- start start 2024-09-22T08:12:02.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.607+0000 7fd52bbaf800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f29230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.607+0000 7fd52bbaf800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563f01ccfdd0 con 0x563f01dab510 2024-09-22T08:12:02.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.608+0000 7fd529699640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f29230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.608+0000 7fd529699640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f29230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56260/0 (socket says 172.21.15.165:56260) 2024-09-22T08:12:02.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.608+0000 7fd529699640 1 -- 172.21.15.165:0/1579137360 learned_addr learned my addr 172.21.15.165:0/1579137360 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.608+0000 7fd529699640 1 -- 172.21.15.165:0/1579137360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f01f29820 con 0x563f01dab510 2024-09-22T08:12:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.608+0000 7fd529699640 1 --2- 172.21.15.165:0/1579137360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f29230 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0460d0 tx=0x7fd51c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ba380aa083f288 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.609+0000 7fd417606640 1 -- 172.21.15.165:0/1579137360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd51c0519d0 con 0x563f01dab510 2024-09-22T08:12:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.609+0000 7fd417606640 1 -- 172.21.15.165:0/1579137360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51c051b70 con 0x563f01dab510 2024-09-22T08:12:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.609+0000 7fd417606640 1 -- 172.21.15.165:0/1579137360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd51c051e50 con 0x563f01dab510 2024-09-22T08:12:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.609+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1579137360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 msgr2=0x563f01f29230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.609+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/1579137360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f29230 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0460d0 tx=0x7fd51c051000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.609+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1579137360 shutdown_connections 2024-09-22T08:12:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.609+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/1579137360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f29230 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.609+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1579137360 >> 172.21.15.165:0/1579137360 conn(0x563f01e31be0 msgr2=0x563f01f24bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.609+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1579137360 shutdown_connections 2024-09-22T08:12:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.609+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1579137360 wait complete. 2024-09-22T08:12:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.610+0000 7fd52bbaf800 1 Processor -- start 2024-09-22T08:12:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.610+0000 7fd52bbaf800 1 -- start start 2024-09-22T08:12:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.610+0000 7fd52bbaf800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f30c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.610+0000 7fd52bbaf800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563f01e40a30 con 0x563f01dab510 2024-09-22T08:12:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.610+0000 7fd529699640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f30c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.610+0000 7fd529699640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f30c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56274/0 (socket says 172.21.15.165:56274) 2024-09-22T08:12:02.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.610+0000 7fd529699640 1 -- 172.21.15.165:0/2966438636 learned_addr learned my addr 172.21.15.165:0/2966438636 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.610+0000 7fd529699640 1 -- 172.21.15.165:0/2966438636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f01f31170 con 0x563f01dab510 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.611+0000 7fd529699640 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f30c10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0460d0 tx=0x7fd51c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.611+0000 7fd415e03640 1 -- 172.21.15.165:0/2966438636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd51c073020 con 0x563f01dab510 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.611+0000 7fd415e03640 1 -- 172.21.15.165:0/2966438636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51c06f580 con 0x563f01dab510 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.611+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f01f31400 con 0x563f01dab510 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.611+0000 7fd415e03640 1 -- 172.21.15.165:0/2966438636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd51c06f8a0 con 0x563f01dab510 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.611+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f01f32010 con 0x563f01dab510 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.612+0000 7fd415e03640 1 -- 172.21.15.165:0/2966438636 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd51c076020 con 0x563f01dab510 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.612+0000 7fd415e03640 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd41003cfb0 0x7fd41003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.612+0000 7fd415e03640 1 -- 172.21.15.165:0/2966438636 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd51c06b040 con 0x563f01dab510 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.612+0000 7fd528e98640 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd41003cfb0 0x7fd41003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.612+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01e3ca10 0x563f01f38260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.612+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f387a0 con 0x563f01e3ca10 2024-09-22T08:12:02.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.612+0000 7fd529e9a640 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01e3ca10 0x563f01f38260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.612+0000 7fd528e98640 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd41003cfb0 0x7fd41003f470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd520001e30 tx=0x7fd520001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.613+0000 7fd529e9a640 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01e3ca10 0x563f01f38260 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.613+0000 7fd529e9a640 1 -- 172.21.15.165:0/2966438636 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd52400a4d0 con 0x563f01e3ca10 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.613+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f38b40 con 0x563f01e3ca10 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.613+0000 7fd529e9a640 1 -- 172.21.15.165:0/2966438636 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd52400a4d0 con 0x563f01e3ca10 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.613+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f3a640 0x563f01f3cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.613+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f3d270 con 0x563f01f3a640 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.613+0000 7fd529699640 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f3a640 0x563f01f3cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.613+0000 7fd529699640 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f3a640 0x563f01f3cae0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.614+0000 7fd529699640 1 -- 172.21.15.165:0/2966438636 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f3a640 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.614+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f39390 con 0x563f01e3ca10 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.614+0000 7fd529e9a640 1 -- 172.21.15.165:0/2966438636 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd52400a4d0 con 0x563f01e3ca10 2024-09-22T08:12:02.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.614+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f397b0 con 0x563f01e3ca10 2024-09-22T08:12:02.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.614+0000 7fd529e9a640 1 -- 172.21.15.165:0/2966438636 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd52400a4d0 con 0x563f01e3ca10 2024-09-22T08:12:02.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.615+0000 7fd52bbaf800 1 Processor -- start 2024-09-22T08:12:02.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.615+0000 7fd52bbaf800 1 -- start start 2024-09-22T08:12:02.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.615+0000 7fd52bbaf800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f4bce0 0x563f01f4c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.615+0000 7fd52bbaf800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563f01d2ed50 con 0x563f01f4bce0 2024-09-22T08:12:02.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.615+0000 7fd529e9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f4bce0 0x563f01f4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.615+0000 7fd529e9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f4bce0 0x563f01f4c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56290/0 (socket says 172.21.15.165:56290) 2024-09-22T08:12:02.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.615+0000 7fd529e9a640 1 -- 172.21.15.165:0/2227665619 learned_addr learned my addr 172.21.15.165:0/2227665619 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.616+0000 7fd529e9a640 1 -- 172.21.15.165:0/2227665619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f01f4c740 con 0x563f01f4bce0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.616+0000 7fd529e9a640 1 --2- 172.21.15.165:0/2227665619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f4bce0 0x563f01f4c100 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x563f01f31c10 tx=0x7fd524018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.616+0000 7fd40effd640 1 -- 172.21.15.165:0/2227665619 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524014450 con 0x563f01f4bce0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.616+0000 7fd40effd640 1 -- 172.21.15.165:0/2227665619 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd524014610 con 0x563f01f4bce0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.616+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2227665619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f01f4cf70 con 0x563f01f4bce0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.616+0000 7fd40effd640 1 -- 172.21.15.165:0/2227665619 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524014930 con 0x563f01f4bce0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.616+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2227665619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f01f4d510 con 0x563f01f4bce0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.617+0000 7fd40effd640 1 -- 172.21.15.165:0/2227665619 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd524011040 con 0x563f01f4bce0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.617+0000 7fd40effd640 1 --2- 172.21.15.165:0/2227665619 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd40003d000 0x7fd40003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.617+0000 7fd40effd640 1 -- 172.21.15.165:0/2227665619 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd52401e070 con 0x563f01f4bce0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.617+0000 7fd529699640 1 --2- 172.21.15.165:0/2227665619 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd40003d000 0x7fd40003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.617+0000 7fd52bbaf800 1 Processor -- start 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.617+0000 7fd52bbaf800 1 -- start start 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.617+0000 7fd529699640 1 --2- 172.21.15.165:0/2227665619 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd40003d000 0x7fd40003f4c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd51c077ff0 tx=0x7fd51c0968e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.617+0000 7fd52bbaf800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f58b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.617+0000 7fd52bbaf800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563f01f29b90 con 0x563f01f58740 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.618+0000 7fd529e9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f58b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.618+0000 7fd529e9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f58b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56306/0 (socket says 172.21.15.165:56306) 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.618+0000 7fd529e9a640 1 -- 172.21.15.165:0/1069566862 learned_addr learned my addr 172.21.15.165:0/1069566862 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.618+0000 7fd529e9a640 1 -- 172.21.15.165:0/1069566862 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f01f59130 con 0x563f01f58740 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.618+0000 7fd529e9a640 1 --2- 172.21.15.165:0/1069566862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f58b40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd5240546e0 tx=0x7fd52402b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9afb7b3f80b765 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.618+0000 7fd40cff9640 1 -- 172.21.15.165:0/1069566862 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524011da0 con 0x563f01f58740 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.618+0000 7fd40cff9640 1 -- 172.21.15.165:0/1069566862 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd524053280 con 0x563f01f58740 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.618+0000 7fd40cff9640 1 -- 172.21.15.165:0/1069566862 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524016930 con 0x563f01f58740 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1069566862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 msgr2=0x563f01f58b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/1069566862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f58b40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd5240546e0 tx=0x7fd52402b4c0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1069566862 shutdown_connections 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/1069566862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f58b40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1069566862 >> 172.21.15.165:0/1069566862 conn(0x563f01f54b40 msgr2=0x563f01f52d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1069566862 shutdown_connections 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 -- 172.21.15.165:0/1069566862 wait complete. 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 Processor -- start 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 -- start start 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f5fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd52bbaf800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563f01f59750 con 0x563f01f58740 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd529e9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f5fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd529e9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f5fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56312/0 (socket says 172.21.15.165:56312) 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.619+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 learned_addr learned my addr 172.21.15.165:0/4225540150 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.620+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f01f602b0 con 0x563f01f58740 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.620+0000 7fd529e9a640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f5fd50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd52402b500 tx=0x7fd524054670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.620+0000 7fd3feffd640 1 -- 172.21.15.165:0/4225540150 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524014c00 con 0x563f01f58740 2024-09-22T08:12:02.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.620+0000 7fd3feffd640 1 -- 172.21.15.165:0/4225540150 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd524054a30 con 0x563f01f58740 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.620+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f01f60540 con 0x563f01f58740 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.620+0000 7fd3feffd640 1 -- 172.21.15.165:0/4225540150 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524054d10 con 0x563f01f58740 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.620+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f01f60ec0 con 0x563f01f58740 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.621+0000 7fd3feffd640 1 -- 172.21.15.165:0/4225540150 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd524034030 con 0x563f01f58740 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.621+0000 7fd3feffd640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd3f403d000 0x7fd3f403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.621+0000 7fd3feffd640 1 -- 172.21.15.165:0/4225540150 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd524032070 con 0x563f01f58740 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.621+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.621+0000 7fd529699640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd3f403d000 0x7fd3f403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01f6b830 0x563f01f6dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f6e3d0 con 0x563f01f6b830 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd528e98640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01f6b830 0x563f01f6dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd529699640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd3f403d000 0x7fd3f403f4c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd51c05a7d0 tx=0x7fd51c085000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd528e98640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01f6b830 0x563f01f6dc80 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd52000f610 con 0x563f01f6b830 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd52bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd52bbaf800 20 realm 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f6ac40 con 0x563f01f6b830 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd52000f610 con 0x563f01f6b830 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd52bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd52bbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.622+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f6eeb0 con 0x563f01f6b830 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd52000f610 con 0x563f01f6b830 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd52bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f6f780 con 0x563f01f6b830 2024-09-22T08:12:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd52000f610 con 0x563f01f6b830 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd52bbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f700c0 0x563f01f724b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f72bf0 con 0x563f01f700c0 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd529e9a640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f700c0 0x563f01f724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.623+0000 7fd529e9a640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f700c0 0x563f01f724b0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd52402a070 con 0x563f01f700c0 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd52bbaf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd52bbaf800 20 searching for the correct realm 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563f01f74c70 0x563f01f77130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f74c70 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd529699640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563f01f74c70 0x563f01f77130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd529699640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563f01f74c70 0x563f01f77130 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f700c0 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd52402a070 con 0x563f01f700c0 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.624+0000 7fd529e9a640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd524014070 0x7fd52404d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.625+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x7fd524014070 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.625+0000 7fd528e98640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd524014070 0x7fd52404d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.625+0000 7fd528e98640 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd524014070 0x7fd52404d6e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.625+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52000f610 con 0x7fd524014070 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.625+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f6b830 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.626+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52000f610 con 0x563f01f6b830 2024-09-22T08:12:02.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.626+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f6b830 2024-09-22T08:12:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.626+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.626+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x7fd524014070 2024-09-22T08:12:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.626+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.626+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f700c0 2024-09-22T08:12:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.626+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52402a070 con 0x563f01f700c0 2024-09-22T08:12:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.626+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f700c0 2024-09-22T08:12:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.627+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.627+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f74c70 2024-09-22T08:12:02.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.627+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.627+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f6b830 2024-09-22T08:12:02.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.627+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.627+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x7fd524014070 2024-09-22T08:12:02.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.627+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.627+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f6b830 2024-09-22T08:12:02.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.628+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.628+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f700c0 2024-09-22T08:12:02.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.628+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.628+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f74c70 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.628+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.628+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f74c70 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.628+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.628+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x7fd524014070 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.629+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.629+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f74c70 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.629+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.629+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f74c70 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.629+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.629+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f6b830 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.629+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.629+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f6b830 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.629+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.629+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x7fd524014070 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.630+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.630+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f74c70 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.630+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.630+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f700c0 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.630+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.630+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f6b830 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.630+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.630+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x7fd524014070 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.631+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.631+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f74c70 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.631+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.631+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x7fd524014070 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.631+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.631+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f700c0 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.632+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.632+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f74c70 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.632+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.632+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x7fd524014070 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.632+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.632+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f6b830 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f01f77800 con 0x563f01f700c0 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:02.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:02.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:02.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:02.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:02.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:02.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f73670 con 0x563f01f6b830 2024-09-22T08:12:02.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f73280 con 0x563f01f6b830 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.633+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f74020 con 0x563f01f6b830 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 zone default found 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 4 Realm: () 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:02.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:02.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:02.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 zonegroup default 2024-09-22T08:12:02.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f73b40 con 0x7fd524014070 2024-09-22T08:12:02.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f79ba0 con 0x563f01f74c70 2024-09-22T08:12:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7a080 con 0x563f01f74c70 2024-09-22T08:12:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 started sync module instance, tier type = 2024-09-22T08:12:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.634+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f79040 con 0x563f01f700c0 2024-09-22T08:12:02.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.635+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.635+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94828615930928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7a990 con 0x563f01f700c0 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.636+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7b1e0 con 0x563f01f6b830 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.636+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94828615930928] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.637+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.637+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94828615935200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7ae70 con 0x563f01f6b830 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.637+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7b990 con 0x563f01f74c70 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.638+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94828615935200] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.638+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.638+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94828615939168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7bd80 con 0x563f01f74c70 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.638+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7c7b0 con 0x563f01f700c0 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.639+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.639+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94828615942848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7d080 con 0x563f01f700c0 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.639+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7db70 con 0x563f01f6b830 2024-09-22T08:12:02.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.639+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94828615939168] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.640+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.640+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94828615942848] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.640+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94828615947840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7db30 con 0x563f01f6b830 2024-09-22T08:12:02.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.640+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7e410 con 0x7fd524014070 2024-09-22T08:12:02.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.641+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.641+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94828615950096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7e7e0 con 0x7fd524014070 2024-09-22T08:12:02.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.642+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94828615947840] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.642+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7f030 con 0x7fd524014070 2024-09-22T08:12:02.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.643+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94828615950096] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.643+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.643+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94828615951152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7ec00 con 0x7fd524014070 2024-09-22T08:12:02.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.643+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7f450 con 0x7fd524014070 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94828615953888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7f830 con 0x7fd524014070 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd52bbaf800 20 add_watcher() i=0 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd52bbaf800 20 add_watcher() i=1 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd52bbaf800 20 add_watcher() i=2 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd52bbaf800 20 add_watcher() i=3 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd52bbaf800 20 add_watcher() i=4 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd52bbaf800 20 add_watcher() i=5 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94828615951152] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd52bbaf800 20 add_watcher() i=6 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94828615953888] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd52bbaf800 20 add_watcher() i=7 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.644+0000 7fd52bbaf800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:02.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.645+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7e7d0 con 0x563f01f6b830 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.645+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.645+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94828615955136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f80220 con 0x563f01f6b830 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.646+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94828615955136] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.646+0000 7fd3df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.646+0000 7fd52bbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.646+0000 7fd52bbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.646+0000 7fd52bbaf800 5 note: GC not initialized 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.646+0000 7fd3de7e4640 20 reqs_thread_entry: start 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.646+0000 7fd52bbaf800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.646+0000 7fd52bbaf800 20 Filter name: none 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.646+0000 7fd34ffff640 20 reqs_thread_entry: start 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.647+0000 7fd52bbaf800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.647+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01fb5940 con 0x563f01f6b830 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.647+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.647+0000 7fd52bbaf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.647+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f01fb6ec0 con 0x7fd524014070 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.647+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.648+0000 7fd3df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.648+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94828615955136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01fb5260 con 0x563f01f6b830 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.649+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94828615955136] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.649+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94828615930928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7f280 con 0x563f01f700c0 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.650+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94828615930928] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.650+0000 7fd52bbaf800 20 remove_watcher() i=0 2024-09-22T08:12:02.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.650+0000 7fd52bbaf800 2 removed watcher, disabling cache 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.650+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94828615935200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f79430 con 0x563f01f6b830 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.651+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94828615935200] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.651+0000 7fd52bbaf800 20 remove_watcher() i=1 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.651+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94828615939168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f79430 con 0x563f01f74c70 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.652+0000 7fd529699640 1 -- 172.21.15.165:0/4225540150 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94828615939168] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd51c057030 con 0x563f01f74c70 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.652+0000 7fd52bbaf800 20 remove_watcher() i=2 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.652+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94828615942848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7b460 con 0x563f01f700c0 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.653+0000 7fd529e9a640 1 -- 172.21.15.165:0/4225540150 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94828615942848] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd524065040 con 0x563f01f700c0 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.653+0000 7fd52bbaf800 20 remove_watcher() i=3 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.653+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94828615947840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7b460 con 0x563f01f6b830 2024-09-22T08:12:02.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.654+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94828615947840] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x563f01f6b830 2024-09-22T08:12:02.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.654+0000 7fd52bbaf800 20 remove_watcher() i=4 2024-09-22T08:12:02.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.654+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94828615950096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7d640 con 0x7fd524014070 2024-09-22T08:12:02.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.656+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94828615950096] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.656+0000 7fd52bbaf800 20 remove_watcher() i=5 2024-09-22T08:12:02.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.656+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94828615951152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7b460 con 0x7fd524014070 2024-09-22T08:12:02.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.657+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94828615951152] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.657+0000 7fd52bbaf800 20 remove_watcher() i=6 2024-09-22T08:12:02.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.657+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94828615953888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f01f7e3c0 con 0x7fd524014070 2024-09-22T08:12:02.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94828615953888] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52002b040 con 0x7fd524014070 2024-09-22T08:12:02.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 20 remove_watcher() i=7 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd524014070 msgr2=0x7fd52404d6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd524014070 0x7fd52404d6e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01f6b830 msgr2=0x563f01f6dc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01f6b830 0x563f01f6dc80 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f700c0 msgr2=0x563f01f724b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f700c0 0x563f01f724b0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563f01f74c70 msgr2=0x563f01f77130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563f01f74c70 0x563f01f77130 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd3f403d000 msgr2=0x7fd3f403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd3f403d000 0x7fd3f403f4c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd51c05a7d0 tx=0x7fd51c085000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 msgr2=0x563f01f5fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd528e98640 1 -- 172.21.15.165:0/4225540150 reap_dead start 2024-09-22T08:12:02.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f5fd50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd52402b500 tx=0x7fd524054670 comp rx=0 tx=0).stop 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 shutdown_connections 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/4225540150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f58740 0x563f01f5fd50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 >> 172.21.15.165:0/4225540150 conn(0x563f01f54b40 msgr2=0x563f01f52d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 shutdown_connections 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.658+0000 7fd52bbaf800 1 -- 172.21.15.165:0/4225540150 wait complete. 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2227665619 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd40003d000 msgr2=0x7fd40003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2227665619 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd40003d000 0x7fd40003f4c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd51c077ff0 tx=0x7fd51c0968e0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2227665619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f4bce0 msgr2=0x563f01f4c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2227665619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f4bce0 0x563f01f4c100 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x563f01f31c10 tx=0x7fd524018830 comp rx=0 tx=0).stop 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2227665619 shutdown_connections 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2227665619 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd40003d000 0x7fd40003f4c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2227665619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01f4bce0 0x563f01f4c100 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2227665619 >> 172.21.15.165:0/2227665619 conn(0x563f01f40090 msgr2=0x563f01f40470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2227665619 shutdown_connections 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2227665619 wait complete. 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01e3ca10 msgr2=0x563f01f38260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01e3ca10 0x563f01f38260 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f3a640 msgr2=0x563f01f3cae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f3a640 0x563f01f3cae0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd41003cfb0 msgr2=0x7fd41003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd41003cfb0 0x7fd41003f470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd520001e30 tx=0x7fd520001390 comp rx=0 tx=0).stop 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 msgr2=0x563f01f30c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f30c10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0460d0 tx=0x7fd51c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 shutdown_connections 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563f01f3a640 0x563f01f3cae0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563f01e3ca10 0x563f01f38260 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd41003cfb0 0x7fd41003f470 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 --2- 172.21.15.165:0/2966438636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563f01dab510 0x563f01f30c10 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 >> 172.21.15.165:0/2966438636 conn(0x563f01e31be0 msgr2=0x563f01f2a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.659+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 shutdown_connections 2024-09-22T08:12:02.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.660+0000 7fd52bbaf800 1 -- 172.21.15.165:0/2966438636 wait complete. 2024-09-22T08:12:02.669 INFO:teuthology.orchestra.run.smithi165.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:12:02.670 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:12:02.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-22T08:12:02.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-22T08:12:02.670 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-22T08:12:02.717 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:02.717 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:02.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f809a739800 1 Processor -- start 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f809a739800 1 -- start start 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f809a739800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5626d3fac080 0x5626d3fae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f809a739800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626d3e36a20 con 0x5626d3fae9b0 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f809a739800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5626d3e367d0 con 0x5626d3fac080 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f8096481640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5626d3fac080 0x5626d3fae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f8096481640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5626d3fac080 0x5626d3fae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56316/0 (socket says 172.21.15.165:56316) 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f8095c80640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5626d3fae9b0 0x5626d3fb0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49466/0 (socket says 172.21.15.165:49466) 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f8096481640 1 -- 172.21.15.165:0/2784025618 learned_addr learned my addr 172.21.15.165:0/2784025618 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f8096481640 1 -- 172.21.15.165:0/2784025618 >> v1:172.21.15.53:6789/0 conn(0x5626d3fae9b0 legacy=0x5626d3fb0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f809547f640 1 -- 172.21.15.165:0/2784025618 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365621970 0 0) 0x5626d3e36a20 con 0x5626d3fae9b0 2024-09-22T08:12:02.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.717+0000 7f8096481640 1 -- 172.21.15.165:0/2784025618 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d3fb3560 con 0x5626d3fac080 2024-09-22T08:12:02.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.719+0000 7f8096481640 1 --2- 172.21.15.165:0/2784025618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d3fae470 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f808800a520 tx=0x7f8088045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ba9d2b1a5f2be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.719+0000 7f809547f640 1 -- 172.21.15.165:0/2784025618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8088055070 con 0x5626d3fac080 2024-09-22T08:12:02.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.719+0000 7f809547f640 1 -- 172.21.15.165:0/2784025618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80880515b0 con 0x5626d3fac080 2024-09-22T08:12:02.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.719+0000 7f809547f640 1 -- 172.21.15.165:0/2784025618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80880518d0 con 0x5626d3fac080 2024-09-22T08:12:02.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.720+0000 7f809a739800 1 -- 172.21.15.165:0/2784025618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 msgr2=0x5626d3fae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.720+0000 7f809a739800 1 --2- 172.21.15.165:0/2784025618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d3fae470 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f808800a520 tx=0x7f8088045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.720+0000 7f809a739800 1 -- 172.21.15.165:0/2784025618 shutdown_connections 2024-09-22T08:12:02.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.720+0000 7f809a739800 1 --2- 172.21.15.165:0/2784025618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d3fae470 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.720+0000 7f809a739800 1 -- 172.21.15.165:0/2784025618 >> 172.21.15.165:0/2784025618 conn(0x5626d3fa5be0 msgr2=0x5626d3fa8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.720+0000 7f809a739800 1 -- 172.21.15.165:0/2784025618 shutdown_connections 2024-09-22T08:12:02.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.720+0000 7f809a739800 1 -- 172.21.15.165:0/2784025618 wait complete. 2024-09-22T08:12:02.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.733+0000 7f809a739800 1 Processor -- start 2024-09-22T08:12:02.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.734+0000 7f809a739800 1 -- start start 2024-09-22T08:12:02.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.734+0000 7f809a739800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d3fab810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.734+0000 7f809a739800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626d3e43dd0 con 0x5626d3fac080 2024-09-22T08:12:02.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.734+0000 7f8096481640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d3fab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.734+0000 7f8096481640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d3fab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56324/0 (socket says 172.21.15.165:56324) 2024-09-22T08:12:02.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.734+0000 7f8096481640 1 -- 172.21.15.165:0/1238895897 learned_addr learned my addr 172.21.15.165:0/1238895897 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.734+0000 7f8096481640 1 -- 172.21.15.165:0/1238895897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d3fabe00 con 0x5626d3fac080 2024-09-22T08:12:02.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.735+0000 7f8096481640 1 --2- 172.21.15.165:0/1238895897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d3fab810 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8088025da0 tx=0x7f8088051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ede10be4ec41cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.735+0000 7f7f84608640 1 -- 172.21.15.165:0/1238895897 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8088051950 con 0x5626d3fac080 2024-09-22T08:12:02.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.735+0000 7f7f84608640 1 -- 172.21.15.165:0/1238895897 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8088051af0 con 0x5626d3fac080 2024-09-22T08:12:02.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.735+0000 7f7f84608640 1 -- 172.21.15.165:0/1238895897 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8088051dd0 con 0x5626d3fac080 2024-09-22T08:12:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.735+0000 7f809a739800 1 -- 172.21.15.165:0/1238895897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 msgr2=0x5626d3fab810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.735+0000 7f809a739800 1 --2- 172.21.15.165:0/1238895897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d3fab810 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8088025da0 tx=0x7f8088051000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f809a739800 1 -- 172.21.15.165:0/1238895897 shutdown_connections 2024-09-22T08:12:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f809a739800 1 --2- 172.21.15.165:0/1238895897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d3fab810 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f809a739800 1 -- 172.21.15.165:0/1238895897 >> 172.21.15.165:0/1238895897 conn(0x5626d3fa5be0 msgr2=0x5626d4096810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f809a739800 1 -- 172.21.15.165:0/1238895897 shutdown_connections 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f809a739800 1 -- 172.21.15.165:0/1238895897 wait complete. 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f809a739800 1 Processor -- start 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f809a739800 1 -- start start 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f809a739800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d40a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f809a739800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626d3fb2850 con 0x5626d3fac080 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f8096481640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d40a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f8096481640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d40a4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56336/0 (socket says 172.21.15.165:56336) 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.736+0000 7f8096481640 1 -- 172.21.15.165:0/1279729553 learned_addr learned my addr 172.21.15.165:0/1279729553 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.737+0000 7f8096481640 1 -- 172.21.15.165:0/1279729553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d40a4f60 con 0x5626d3fac080 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.737+0000 7f8096481640 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d40a4a00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8088025da0 tx=0x7f8088002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.737+0000 7f7f82e05640 1 -- 172.21.15.165:0/1279729553 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f808805a600 con 0x5626d3fac080 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.737+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626d40a51f0 con 0x5626d3fac080 2024-09-22T08:12:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.737+0000 7f7f82e05640 1 -- 172.21.15.165:0/1279729553 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8088073070 con 0x5626d3fac080 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.737+0000 7f7f82e05640 1 -- 172.21.15.165:0/1279729553 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f808805a8d0 con 0x5626d3fac080 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.737+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d40a5e00 con 0x5626d3fac080 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.738+0000 7f7f82e05640 1 -- 172.21.15.165:0/1279729553 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8088058070 con 0x5626d3fac080 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.738+0000 7f7f82e05640 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7c03d000 0x7f7f7c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.738+0000 7f7f82e05640 1 -- 172.21.15.165:0/1279729553 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f808806b040 con 0x5626d3fac080 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.738+0000 7f8095c80640 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7c03d000 0x7f7f7c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.738+0000 7f809a739800 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d3fae9b0 0x5626d40ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.738+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ac590 con 0x5626d3fae9b0 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.738+0000 7f8096c82640 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d3fae9b0 0x5626d40ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.739+0000 7f8095c80640 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7c03d000 0x7f7f7c03f4c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f808c000c00 tx=0x7f808c0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.739+0000 7f8096c82640 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d3fae9b0 0x5626d40ac050 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.739+0000 7f8096c82640 1 -- 172.21.15.165:0/1279729553 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f809000a4d0 con 0x5626d3fae9b0 2024-09-22T08:12:02.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.739+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ac930 con 0x5626d3fae9b0 2024-09-22T08:12:02.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.739+0000 7f8096c82640 1 -- 172.21.15.165:0/1279729553 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f809000a4d0 con 0x5626d3fae9b0 2024-09-22T08:12:02.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.739+0000 7f809a739800 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40ae430 0x5626d40b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.739+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40b1060 con 0x5626d40ae430 2024-09-22T08:12:02.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.739+0000 7f8096481640 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40ae430 0x5626d40b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.740+0000 7f8096481640 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40ae430 0x5626d40b08d0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.740+0000 7f8096481640 1 -- 172.21.15.165:0/1279729553 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8088057030 con 0x5626d40ae430 2024-09-22T08:12:02.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.740+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ad180 con 0x5626d3fae9b0 2024-09-22T08:12:02.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.740+0000 7f8096c82640 1 -- 172.21.15.165:0/1279729553 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f809000a4d0 con 0x5626d3fae9b0 2024-09-22T08:12:02.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.740+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ad5d0 con 0x5626d3fae9b0 2024-09-22T08:12:02.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.741+0000 7f8096c82640 1 -- 172.21.15.165:0/1279729553 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f809000a4d0 con 0x5626d3fae9b0 2024-09-22T08:12:02.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.741+0000 7f809a739800 1 Processor -- start 2024-09-22T08:12:02.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.741+0000 7f809a739800 1 -- start start 2024-09-22T08:12:02.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.741+0000 7f809a739800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40bf9e0 0x5626d40bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.741+0000 7f809a739800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626d3ea2d50 con 0x5626d40bf9e0 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.741+0000 7f8096c82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40bf9e0 0x5626d40bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.741+0000 7f8096c82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40bf9e0 0x5626d40bfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56350/0 (socket says 172.21.15.165:56350) 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.741+0000 7f8096c82640 1 -- 172.21.15.165:0/1515823253 learned_addr learned my addr 172.21.15.165:0/1515823253 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.742+0000 7f8096c82640 1 -- 172.21.15.165:0/1515823253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d40c0440 con 0x5626d40bf9e0 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.742+0000 7f8096c82640 1 --2- 172.21.15.165:0/1515823253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40bf9e0 0x5626d40bfe00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f809000a2a0 tx=0x7f8090018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.742+0000 7f7f7bfff640 1 -- 172.21.15.165:0/1515823253 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8090014450 con 0x5626d40bf9e0 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.742+0000 7f7f7bfff640 1 -- 172.21.15.165:0/1515823253 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80900145f0 con 0x5626d40bf9e0 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.742+0000 7f809a739800 1 -- 172.21.15.165:0/1515823253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626d40c0c70 con 0x5626d40bf9e0 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.742+0000 7f7f7bfff640 1 -- 172.21.15.165:0/1515823253 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8090014910 con 0x5626d40bf9e0 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.742+0000 7f809a739800 1 -- 172.21.15.165:0/1515823253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d40c1210 con 0x5626d40bf9e0 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.743+0000 7f7f7bfff640 1 -- 172.21.15.165:0/1515823253 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8090011040 con 0x5626d40bf9e0 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.743+0000 7f7f7bfff640 1 --2- 172.21.15.165:0/1515823253 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7003cfb0 0x7f7f7003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.743+0000 7f7f7bfff640 1 -- 172.21.15.165:0/1515823253 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f809001e070 con 0x5626d40bf9e0 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.743+0000 7f8096481640 1 --2- 172.21.15.165:0/1515823253 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7003cfb0 0x7f7f7003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f809a739800 1 Processor -- start 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f8096481640 1 --2- 172.21.15.165:0/1515823253 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7003cfb0 0x7f7f7003f470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5626d40a6b10 tx=0x7f80880508a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f809a739800 1 -- start start 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f809a739800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f809a739800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626d3faa1a0 con 0x5626d40cc480 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f8096c82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f8096c82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56356/0 (socket says 172.21.15.165:56356) 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f8096c82640 1 -- 172.21.15.165:0/2591953495 learned_addr learned my addr 172.21.15.165:0/2591953495 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f8096c82640 1 -- 172.21.15.165:0/2591953495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d40cce70 con 0x5626d40cc480 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f8096c82640 1 --2- 172.21.15.165:0/2591953495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40cc880 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8090016fd0 tx=0x7f8090011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fe8ba2f50c2e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.744+0000 7f7f79ffb640 1 -- 172.21.15.165:0/2591953495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f809004b070 con 0x5626d40cc480 2024-09-22T08:12:02.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f7f79ffb640 1 -- 172.21.15.165:0/2591953495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8090051070 con 0x5626d40cc480 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f7f79ffb640 1 -- 172.21.15.165:0/2591953495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8090053320 con 0x5626d40cc480 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f809a739800 1 -- 172.21.15.165:0/2591953495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 msgr2=0x5626d40cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f809a739800 1 --2- 172.21.15.165:0/2591953495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40cc880 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8090016fd0 tx=0x7f8090011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f809a739800 1 -- 172.21.15.165:0/2591953495 shutdown_connections 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f809a739800 1 --2- 172.21.15.165:0/2591953495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40cc880 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f809a739800 1 -- 172.21.15.165:0/2591953495 >> 172.21.15.165:0/2591953495 conn(0x5626d40c8880 msgr2=0x5626d40c6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f809a739800 1 -- 172.21.15.165:0/2591953495 shutdown_connections 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f809a739800 1 -- 172.21.15.165:0/2591953495 wait complete. 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f809a739800 1 Processor -- start 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.745+0000 7f809a739800 1 -- start start 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f809a739800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40d3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f809a739800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626d40cd490 con 0x5626d40cc480 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f8096c82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40d3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f8096c82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40d3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56370/0 (socket says 172.21.15.165:56370) 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 learned_addr learned my addr 172.21.15.165:0/3086366682 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d40d3fd0 con 0x5626d40cc480 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f8096c82640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40d3a70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8090011fd0 tx=0x7f80900547b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f7f67fff640 1 -- 172.21.15.165:0/3086366682 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f809004b030 con 0x5626d40cc480 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f7f67fff640 1 -- 172.21.15.165:0/3086366682 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809004de50 con 0x5626d40cc480 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626d40d4260 con 0x5626d40cc480 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.746+0000 7f7f67fff640 1 -- 172.21.15.165:0/3086366682 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8090011330 con 0x5626d40cc480 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.747+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d40d4be0 con 0x5626d40cc480 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.747+0000 7f7f67fff640 1 -- 172.21.15.165:0/3086366682 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f80900459f0 con 0x5626d40cc480 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.747+0000 7f7f67fff640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f6003cfb0 0x7f7f6003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.747+0000 7f7f67fff640 1 -- 172.21.15.165:0/3086366682 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f809004c070 con 0x5626d40cc480 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f8096481640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f6003cfb0 0x7f7f6003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.768 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f809a739800 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d40df4f0 0x5626d40e19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40e2100 con 0x5626d40df4f0 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f8095c80640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d40df4f0 0x5626d40e19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f8096481640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f6003cfb0 0x7f7f6003f470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8088077790 tx=0x7f8088088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f8095c80640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d40df4f0 0x5626d40e19b0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f808c00f5f0 con 0x5626d40df4f0 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f809a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f809a739800 20 realm 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.748+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40de840 con 0x5626d40df4f0 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f808c00f5f0 con 0x5626d40df4f0 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:02.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40e2be0 con 0x5626d40df4f0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f808c00f5f0 con 0x5626d40df4f0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40e34b0 con 0x5626d40df4f0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f808c00f5f0 con 0x5626d40df4f0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40e3db0 0x5626d40e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40e6920 con 0x5626d40e3db0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.749+0000 7f8096c82640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40e3db0 0x5626d40e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.750+0000 7f8096c82640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40e3db0 0x5626d40e61c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.750+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f809002a070 con 0x5626d40e3db0 2024-09-22T08:12:02.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.750+0000 7f809a739800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.750+0000 7f809a739800 20 searching for the correct realm 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.750+0000 7f809a739800 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5626d40e89d0 0x5626d40eae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.750+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e89d0 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.750+0000 7f8096481640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5626d40e89d0 0x5626d40eae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.750+0000 7f8096481640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5626d40e89d0 0x5626d40eae90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.750+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.750+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e3db0 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.751+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f809002a070 con 0x5626d40e3db0 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.751+0000 7f8096c82640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8090014070 0x7f809003f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.751+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x7f8090014070 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.751+0000 7f8095c80640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8090014070 0x7f809003f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.751+0000 7f8095c80640 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8090014070 0x7f809003f3f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.752+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c00f5f0 con 0x7f8090014070 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.752+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40df4f0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.752+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c00f5f0 con 0x5626d40df4f0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.752+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40df4f0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.752+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.752+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x7f8090014070 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.753+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.753+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e3db0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.753+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809002a070 con 0x5626d40e3db0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.753+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e3db0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.753+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809002a070 con 0x5626d40e3db0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.753+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e89d0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.753+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.753+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40df4f0 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.753+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.753+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x7f8090014070 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.754+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.754+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40df4f0 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.754+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.754+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e3db0 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.754+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8090064060 con 0x5626d40e3db0 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.754+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e89d0 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.755+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.755+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e89d0 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.755+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.755+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x7f8090014070 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.755+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.755+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e89d0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.755+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.755+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e89d0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.756+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.756+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40df4f0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.756+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.756+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40df4f0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.756+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.756+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x7f8090014070 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.756+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.756+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e89d0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.756+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.756+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e3db0 2024-09-22T08:12:02.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.757+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8090064060 con 0x5626d40e3db0 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.757+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40df4f0 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.757+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.757+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x7f8090014070 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.757+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.757+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e89d0 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.758+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.758+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x7f8090014070 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.758+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.758+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e3db0 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.758+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8090064060 con 0x5626d40e3db0 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.758+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e89d0 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.758+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.758+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x7f8090014070 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40df4f0 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eb560 con 0x5626d40e3db0 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8090064060 con 0x5626d40e3db0 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40e73d0 con 0x5626d40df4f0 2024-09-22T08:12:02.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.759+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40e6fe0 con 0x5626d40df4f0 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40e7d80 con 0x5626d40df4f0 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 20 zone default found 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 4 Realm: () 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:02.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 20 zonegroup default 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40e7870 con 0x7f8090014070 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.760+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ed8d0 con 0x5626d40e89d0 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.761+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.761+0000 7f809a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.761+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.761+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40edd30 con 0x5626d40e89d0 2024-09-22T08:12:02.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.761+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.761+0000 7f809a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.761+0000 7f809a739800 20 started sync module instance, tier type = 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.761+0000 7f809a739800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.761+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ecd70 con 0x5626d40e3db0 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.762+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090064060 con 0x5626d40e3db0 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.762+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94724766486880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ec9d0 con 0x5626d40e3db0 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.762+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eec60 con 0x5626d40df4f0 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.763+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94724766486880] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090064060 con 0x5626d40e3db0 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.763+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.763+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94724766491024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eec60 con 0x5626d40df4f0 2024-09-22T08:12:02.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.763+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ef690 con 0x5626d40e89d0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.764+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94724766491024] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.764+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.764+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94724766492592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40eebd0 con 0x5626d40e89d0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.764+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f0580 con 0x5626d40e3db0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.765+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94724766492592] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.766+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090064060 con 0x5626d40e3db0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.766+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94724766499024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f09a0 con 0x5626d40e3db0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.766+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f1360 con 0x5626d40df4f0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.766+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94724766499024] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090064060 con 0x5626d40e3db0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.767+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.767+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94724766500560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f1360 con 0x5626d40df4f0 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.767+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f1d60 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.768+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94724766500560] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.768+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.768+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94724766505072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f1360 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.768+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f2770 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.769+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94724766505072] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.769+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.769+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94724766502576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f2950 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.769+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f31a0 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.770+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.770+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94724766502576] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.770+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94724766509872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f3540 con 0x7f8090014070 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.770+0000 7f809a739800 20 add_watcher() i=0 2024-09-22T08:12:02.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.770+0000 7f809a739800 20 add_watcher() i=1 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.770+0000 7f809a739800 20 add_watcher() i=2 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.770+0000 7f809a739800 20 add_watcher() i=3 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.770+0000 7f809a739800 20 add_watcher() i=4 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.770+0000 7f809a739800 20 add_watcher() i=5 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.770+0000 7f809a739800 20 add_watcher() i=6 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.771+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94724766509872] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.771+0000 7f809a739800 20 add_watcher() i=7 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.771+0000 7f809a739800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.771+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f6990 con 0x5626d40df4f0 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.771+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.771+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94724766511056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f3e10 con 0x5626d40df4f0 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.772+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94724766511056] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.772+0000 7f7f4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.772+0000 7f809a739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.772+0000 7f809a739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.772+0000 7f809a739800 5 note: GC not initialized 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.773+0000 7f7ec77fe640 20 reqs_thread_entry: start 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.773+0000 7f809a739800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.773+0000 7f809a739800 20 Filter name: none 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.773+0000 7f7ec57fa640 20 reqs_thread_entry: start 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.773+0000 7f809a739800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.773+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d4129650 con 0x5626d40df4f0 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.773+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.773+0000 7f809a739800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.773+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626d412abd0 con 0x7f8090014070 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.774+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.774+0000 7f7f4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.774+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94724766511056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d4128f70 con 0x5626d40df4f0 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.775+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94724766511056] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.775+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94724766486880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f2f90 con 0x5626d40e3db0 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.776+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94724766486880] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090064060 con 0x5626d40e3db0 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.776+0000 7f809a739800 20 remove_watcher() i=0 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.776+0000 7f809a739800 2 removed watcher, disabling cache 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.777+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94724766491024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ed160 con 0x5626d40df4f0 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.778+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94724766491024] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.778+0000 7f809a739800 20 remove_watcher() i=1 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.778+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94724766492592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ed160 con 0x5626d40e89d0 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.779+0000 7f8096481640 1 -- 172.21.15.165:0/3086366682 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94724766492592] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8088057030 con 0x5626d40e89d0 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.779+0000 7f809a739800 20 remove_watcher() i=2 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.779+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94724766499024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ee7b0 con 0x5626d40e3db0 2024-09-22T08:12:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.780+0000 7f8096c82640 1 -- 172.21.15.165:0/3086366682 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94724766499024] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090064060 con 0x5626d40e3db0 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.780+0000 7f809a739800 20 remove_watcher() i=3 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.780+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94724766500560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f00d0 con 0x5626d40df4f0 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.781+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94724766500560] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x5626d40df4f0 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.781+0000 7f809a739800 20 remove_watcher() i=4 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.781+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94724766505072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ee7b0 con 0x7f8090014070 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.782+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94724766505072] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.782+0000 7f809a739800 20 remove_watcher() i=5 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.782+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94724766502576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40f00d0 con 0x7f8090014070 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.783+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94724766502576] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.783+0000 7f809a739800 20 remove_watcher() i=6 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.783+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94724766509872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626d40ee7b0 con 0x7f8090014070 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94724766509872] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f808c02b040 con 0x7f8090014070 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 20 remove_watcher() i=7 2024-09-22T08:12:02.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8090014070 msgr2=0x7f809003f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8090014070 0x7f809003f3f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d40df4f0 msgr2=0x5626d40e19b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d40df4f0 0x5626d40e19b0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40e3db0 msgr2=0x5626d40e61c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40e3db0 0x5626d40e61c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5626d40e89d0 msgr2=0x5626d40eae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5626d40e89d0 0x5626d40eae90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f6003cfb0 msgr2=0x7f7f6003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f6003cfb0 0x7f7f6003f470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8088077790 tx=0x7f8088088000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 msgr2=0x5626d40d3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f8095c80640 1 -- 172.21.15.165:0/3086366682 reap_dead start 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40d3a70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8090011fd0 tx=0x7f80900547b0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 shutdown_connections 2024-09-22T08:12:02.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 --2- 172.21.15.165:0/3086366682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40cc480 0x5626d40d3a70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 >> 172.21.15.165:0/3086366682 conn(0x5626d40c8880 msgr2=0x5626d40c6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 shutdown_connections 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/3086366682 wait complete. 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/1515823253 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7003cfb0 msgr2=0x7f7f7003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 --2- 172.21.15.165:0/1515823253 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7003cfb0 0x7f7f7003f470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5626d40a6b10 tx=0x7f80880508a0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 -- 172.21.15.165:0/1515823253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40bf9e0 msgr2=0x5626d40bfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.784+0000 7f809a739800 1 --2- 172.21.15.165:0/1515823253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40bf9e0 0x5626d40bfe00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f809000a2a0 tx=0x7f8090018830 comp rx=0 tx=0).stop 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1515823253 shutdown_connections 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 --2- 172.21.15.165:0/1515823253 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7003cfb0 0x7f7f7003f470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 --2- 172.21.15.165:0/1515823253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d40bf9e0 0x5626d40bfe00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1515823253 >> 172.21.15.165:0/1515823253 conn(0x5626d40b3d90 msgr2=0x5626d40b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1515823253 shutdown_connections 2024-09-22T08:12:02.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1515823253 wait complete. 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d3fae9b0 msgr2=0x5626d40ac050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d3fae9b0 0x5626d40ac050 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40ae430 msgr2=0x5626d40b08d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40ae430 0x5626d40b08d0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7c03d000 msgr2=0x7f7f7c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7c03d000 0x7f7f7c03f4c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f808c000c00 tx=0x7f808c0013b0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 msgr2=0x5626d40a4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d40a4a00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8088025da0 tx=0x7f8088002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 shutdown_connections 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5626d40ae430 0x5626d40b08d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5626d3fae9b0 0x5626d40ac050 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f7c03d000 0x7f7f7c03f4c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 --2- 172.21.15.165:0/1279729553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d3fac080 0x5626d40a4a00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 >> 172.21.15.165:0/1279729553 conn(0x5626d3fa5be0 msgr2=0x5626d4096360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 shutdown_connections 2024-09-22T08:12:02.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.785+0000 7f809a739800 1 -- 172.21.15.165:0/1279729553 wait complete. 2024-09-22T08:12:02.798 INFO:teuthology.orchestra.run.smithi165.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:12:02.798 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:12:02.798 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-22T08:12:02.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-22T08:12:02.798 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-22T08:12:02.845 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:02.845 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:02.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.845+0000 7feeaae16800 1 Processor -- start 2024-09-22T08:12:02.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.845+0000 7feeaae16800 1 -- start start 2024-09-22T08:12:02.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.845+0000 7feeaae16800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e80f86abe0 0x55e80f86cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.845+0000 7feeaae16800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e80f6f7a20 con 0x55e80f871c50 2024-09-22T08:12:02.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.845+0000 7feeaae16800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e80f6f77d0 con 0x55e80f86abe0 2024-09-22T08:12:02.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.845+0000 7feea65e7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e80f86abe0 0x55e80f86cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.845+0000 7fee9ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e80f871c50 0x55e80f874040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49472/0 (socket says 172.21.15.165:49472) 2024-09-22T08:12:02.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.845+0000 7fee9ffff640 1 -- 172.21.15.165:0/2223953708 learned_addr learned my addr 172.21.15.165:0/2223953708 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:02.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.846+0000 7feea5de6640 1 -- 172.21.15.165:0/2223953708 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1516414726 0 0) 0x55e80f6f7a20 con 0x55e80f871c50 2024-09-22T08:12:02.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.846+0000 7feea5de6640 1 -- 172.21.15.165:0/2223953708 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee94001e10 con 0x55e80f871c50 2024-09-22T08:12:02.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.846+0000 7feea65e7640 1 -- 172.21.15.165:0/2223953708 >> v1:172.21.15.53:6789/0 conn(0x55e80f871c50 legacy=0x55e80f874040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.846+0000 7feea65e7640 1 -- 172.21.15.165:0/2223953708 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e80f8767a0 con 0x55e80f86abe0 2024-09-22T08:12:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.847+0000 7feea65e7640 1 --2- 172.21.15.165:0/2223953708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f86cff0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fee9800a470 tx=0x7fee98045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413d048d94f902eb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.848+0000 7feea5de6640 1 -- 172.21.15.165:0/2223953708 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee98059070 con 0x55e80f86abe0 2024-09-22T08:12:02.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.848+0000 7feea5de6640 1 -- 172.21.15.165:0/2223953708 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee98054570 con 0x55e80f86abe0 2024-09-22T08:12:02.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.848+0000 7feea5de6640 1 -- 172.21.15.165:0/2223953708 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee98054850 con 0x55e80f86abe0 2024-09-22T08:12:02.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.848+0000 7feeaae16800 1 -- 172.21.15.165:0/2223953708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 msgr2=0x55e80f86cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.848+0000 7feeaae16800 1 --2- 172.21.15.165:0/2223953708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f86cff0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fee9800a470 tx=0x7fee98045920 comp rx=0 tx=0).stop 2024-09-22T08:12:02.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.848+0000 7feeaae16800 1 -- 172.21.15.165:0/2223953708 shutdown_connections 2024-09-22T08:12:02.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.848+0000 7feeaae16800 1 --2- 172.21.15.165:0/2223953708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f86cff0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.848+0000 7feeaae16800 1 -- 172.21.15.165:0/2223953708 >> 172.21.15.165:0/2223953708 conn(0x55e80f866310 msgr2=0x55e80f868790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.848+0000 7feeaae16800 1 -- 172.21.15.165:0/2223953708 shutdown_connections 2024-09-22T08:12:02.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.848+0000 7feeaae16800 1 -- 172.21.15.165:0/2223953708 wait complete. 2024-09-22T08:12:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.862+0000 7feeaae16800 1 Processor -- start 2024-09-22T08:12:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.862+0000 7feeaae16800 1 -- start start 2024-09-22T08:12:02.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.862+0000 7feeaae16800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f95e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.862+0000 7feeaae16800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e80f704dd0 con 0x55e80f86abe0 2024-09-22T08:12:02.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.863+0000 7feea65e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f95e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.863+0000 7feea65e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f95e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56402/0 (socket says 172.21.15.165:56402) 2024-09-22T08:12:02.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.863+0000 7feea65e7640 1 -- 172.21.15.165:0/1746683495 learned_addr learned my addr 172.21.15.165:0/1746683495 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.863+0000 7feea65e7640 1 -- 172.21.15.165:0/1746683495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e80f95e6b0 con 0x55e80f86abe0 2024-09-22T08:12:02.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.863+0000 7feea65e7640 1 --2- 172.21.15.165:0/1746683495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f95e0c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fee98025b20 tx=0x7fee9804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89339a7510f6dd19 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.863+0000 7fed94608640 1 -- 172.21.15.165:0/1746683495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee98059070 con 0x55e80f86abe0 2024-09-22T08:12:02.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.863+0000 7fed94608640 1 -- 172.21.15.165:0/1746683495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee98065070 con 0x55e80f86abe0 2024-09-22T08:12:02.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.863+0000 7fed94608640 1 -- 172.21.15.165:0/1746683495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee98054ac0 con 0x55e80f86abe0 2024-09-22T08:12:02.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.864+0000 7feeaae16800 1 -- 172.21.15.165:0/1746683495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 msgr2=0x55e80f95e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.864+0000 7feeaae16800 1 --2- 172.21.15.165:0/1746683495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f95e0c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fee98025b20 tx=0x7fee9804e000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.864+0000 7feeaae16800 1 -- 172.21.15.165:0/1746683495 shutdown_connections 2024-09-22T08:12:02.866 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.864+0000 7feeaae16800 1 --2- 172.21.15.165:0/1746683495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f95e0c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.864+0000 7feeaae16800 1 -- 172.21.15.165:0/1746683495 >> 172.21.15.165:0/1746683495 conn(0x55e80f866310 msgr2=0x55e80f959a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.864+0000 7feeaae16800 1 -- 172.21.15.165:0/1746683495 shutdown_connections 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.864+0000 7feeaae16800 1 -- 172.21.15.165:0/1746683495 wait complete. 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.864+0000 7feeaae16800 1 Processor -- start 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7feeaae16800 1 -- start start 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7feeaae16800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f965b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7feeaae16800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e80f875a60 con 0x55e80f86abe0 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7feea65e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f965b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7feea65e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f965b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56406/0 (socket says 172.21.15.165:56406) 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7feea65e7640 1 -- 172.21.15.165:0/1456298596 learned_addr learned my addr 172.21.15.165:0/1456298596 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7feea65e7640 1 -- 172.21.15.165:0/1456298596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e80f966070 con 0x55e80f86abe0 2024-09-22T08:12:02.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7feea65e7640 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f965b10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fee98025b20 tx=0x7fee98002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7fed92e05640 1 -- 172.21.15.165:0/1456298596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee98054c40 con 0x55e80f86abe0 2024-09-22T08:12:02.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7fed92e05640 1 -- 172.21.15.165:0/1456298596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9805a040 con 0x55e80f86abe0 2024-09-22T08:12:02.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e80f966300 con 0x55e80f86abe0 2024-09-22T08:12:02.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.865+0000 7fed92e05640 1 -- 172.21.15.165:0/1456298596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee98060480 con 0x55e80f86abe0 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.866+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e80f966d00 con 0x55e80f86abe0 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.866+0000 7fed92e05640 1 -- 172.21.15.165:0/1456298596 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fee98060620 con 0x55e80f86abe0 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.867+0000 7fed92e05640 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8c03cfb0 0x7fed8c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.867+0000 7fed92e05640 1 -- 172.21.15.165:0/1456298596 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fee98097bc0 con 0x55e80f86abe0 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.867+0000 7fee9ffff640 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8c03cfb0 0x7fed8c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.867+0000 7feeaae16800 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f871c50 0x55e80f96d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.867+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9678e0 con 0x55e80f871c50 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.867+0000 7feea6de8640 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f871c50 0x55e80f96d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.867+0000 7fee9ffff640 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8c03cfb0 0x7fed8c03f470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fee90001db0 tx=0x7fee90001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.867+0000 7feea6de8640 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f871c50 0x55e80f96d160 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.867+0000 7feea6de8640 1 -- 172.21.15.165:0/1456298596 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feea000a4d0 con 0x55e80f871c50 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.868+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9671b0 con 0x55e80f871c50 2024-09-22T08:12:02.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.868+0000 7feea6de8640 1 -- 172.21.15.165:0/1456298596 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feea000a4d0 con 0x55e80f871c50 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.868+0000 7feeaae16800 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f96f630 0x55e80f971a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.868+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9720f0 con 0x55e80f96f630 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.868+0000 7feea65e7640 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f96f630 0x55e80f971a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.868+0000 7feea65e7640 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f96f630 0x55e80f971a20 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.869+0000 7feea65e7640 1 -- 172.21.15.165:0/1456298596 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee98097040 con 0x55e80f96f630 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.869+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f96e4d0 con 0x55e80f871c50 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.869+0000 7feea6de8640 1 -- 172.21.15.165:0/1456298596 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feea000a4d0 con 0x55e80f871c50 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.869+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f96e970 con 0x55e80f871c50 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.869+0000 7feea6de8640 1 -- 172.21.15.165:0/1456298596 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feea000a4d0 con 0x55e80f871c50 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.869+0000 7feeaae16800 1 Processor -- start 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.869+0000 7feeaae16800 1 -- start start 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7feeaae16800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f980a70 0x55e80f980e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7feeaae16800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e80f763d50 con 0x55e80f980a70 2024-09-22T08:12:02.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7feea6de8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f980a70 0x55e80f980e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7feea6de8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f980a70 0x55e80f980e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56410/0 (socket says 172.21.15.165:56410) 2024-09-22T08:12:02.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7feea6de8640 1 -- 172.21.15.165:0/3336152951 learned_addr learned my addr 172.21.15.165:0/3336152951 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7feea6de8640 1 -- 172.21.15.165:0/3336152951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e80f9814d0 con 0x55e80f980a70 2024-09-22T08:12:02.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7feea6de8640 1 --2- 172.21.15.165:0/3336152951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f980a70 0x55e80f980e90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55e80f96d6e0 tx=0x7feea0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7fed8bfff640 1 -- 172.21.15.165:0/3336152951 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea00180d0 con 0x55e80f980a70 2024-09-22T08:12:02.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7fed8bfff640 1 -- 172.21.15.165:0/3336152951 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea0018270 con 0x55e80f980a70 2024-09-22T08:12:02.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7fed8bfff640 1 -- 172.21.15.165:0/3336152951 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea0014450 con 0x55e80f980a70 2024-09-22T08:12:02.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.870+0000 7feeaae16800 1 -- 172.21.15.165:0/3336152951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e80f981d00 con 0x55e80f980a70 2024-09-22T08:12:02.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.871+0000 7feeaae16800 1 -- 172.21.15.165:0/3336152951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e80f9822a0 con 0x55e80f980a70 2024-09-22T08:12:02.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.871+0000 7fed8bfff640 1 -- 172.21.15.165:0/3336152951 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feea0011040 con 0x55e80f980a70 2024-09-22T08:12:02.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7fed8bfff640 1 --2- 172.21.15.165:0/3336152951 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8003d000 0x7fed8003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7fed8bfff640 1 -- 172.21.15.165:0/3336152951 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feea001e070 con 0x55e80f980a70 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7feea65e7640 1 --2- 172.21.15.165:0/3336152951 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8003d000 0x7fed8003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7feeaae16800 1 Processor -- start 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7feea65e7640 1 --2- 172.21.15.165:0/3336152951 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8003d000 0x7fed8003f4c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55e80f96d780 tx=0x7fee98068f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7feeaae16800 1 -- start start 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7feeaae16800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f98d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7feeaae16800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e80f95ea20 con 0x55e80f98d510 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7feea6de8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f98d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7feea6de8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f98d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56416/0 (socket says 172.21.15.165:56416) 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.872+0000 7feea6de8640 1 -- 172.21.15.165:0/210852979 learned_addr learned my addr 172.21.15.165:0/210852979 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7feea6de8640 1 -- 172.21.15.165:0/210852979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e80f98dee0 con 0x55e80f98d510 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7feea6de8640 1 --2- 172.21.15.165:0/210852979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f98d8f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7feea0054350 tx=0x7feea00545f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef65ba8a4217f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7fed89ffb640 1 -- 172.21.15.165:0/210852979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea0016500 con 0x55e80f98d510 2024-09-22T08:12:02.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7fed89ffb640 1 -- 172.21.15.165:0/210852979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea004b070 con 0x55e80f98d510 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7fed89ffb640 1 -- 172.21.15.165:0/210852979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea002bb90 con 0x55e80f98d510 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7feeaae16800 1 -- 172.21.15.165:0/210852979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 msgr2=0x55e80f98d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7feeaae16800 1 --2- 172.21.15.165:0/210852979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f98d8f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7feea0054350 tx=0x7feea00545f0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7feeaae16800 1 -- 172.21.15.165:0/210852979 shutdown_connections 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7feeaae16800 1 --2- 172.21.15.165:0/210852979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f98d8f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7feeaae16800 1 -- 172.21.15.165:0/210852979 >> 172.21.15.165:0/210852979 conn(0x55e80f989910 msgr2=0x55e80f987b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7feeaae16800 1 -- 172.21.15.165:0/210852979 shutdown_connections 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.873+0000 7feeaae16800 1 -- 172.21.15.165:0/210852979 wait complete. 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.874+0000 7feeaae16800 1 Processor -- start 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.874+0000 7feeaae16800 1 -- start start 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.874+0000 7feeaae16800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f994ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.874+0000 7feeaae16800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e80f98e520 con 0x55e80f98d510 2024-09-22T08:12:02.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.874+0000 7feea6de8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f994ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.874+0000 7feea6de8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f994ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56426/0 (socket says 172.21.15.165:56426) 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.874+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 learned_addr learned my addr 172.21.15.165:0/2861800442 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.874+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e80f995040 con 0x55e80f98d510 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.874+0000 7feea6de8640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f994ae0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feea0022710 tx=0x7feea00542b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.875+0000 7fed77fff640 1 -- 172.21.15.165:0/2861800442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea003b070 con 0x55e80f98d510 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.875+0000 7fed77fff640 1 -- 172.21.15.165:0/2861800442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea00145f0 con 0x55e80f98d510 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.875+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e80f9952d0 con 0x55e80f98d510 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.875+0000 7fed77fff640 1 -- 172.21.15.165:0/2861800442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea00148d0 con 0x55e80f98d510 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.875+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e80f995e60 con 0x55e80f98d510 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.875+0000 7fed77fff640 1 -- 172.21.15.165:0/2861800442 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feea003e070 con 0x55e80f98d510 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.876+0000 7fed77fff640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7003d000 0x7fed7003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.876+0000 7fed77fff640 1 -- 172.21.15.165:0/2861800442 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feea0033070 con 0x55e80f98d510 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.876+0000 7feea65e7640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7003d000 0x7fed7003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.876+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.876+0000 7feeaae16800 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f9a0560 0x55e80f9a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.876+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9a3170 con 0x55e80f9a0560 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.876+0000 7fee9ffff640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f9a0560 0x55e80f9a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.876+0000 7feea65e7640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7003d000 0x7fed7003f4c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fee98096170 tx=0x7fee98084000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.876+0000 7fee9ffff640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f9a0560 0x55e80f9a2a20 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee90009050 con 0x55e80f9a0560 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 20 realm 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f99f8b0 con 0x55e80f9a0560 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee90009050 con 0x55e80f9a0560 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9a3c50 con 0x55e80f9a0560 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee90009050 con 0x55e80f9a0560 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9a4520 con 0x55e80f9a0560 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee90009050 con 0x55e80f9a0560 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f9a4e60 0x55e80f9a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9a7990 con 0x55e80f9a4e60 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.877+0000 7feea6de8640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f9a4e60 0x55e80f9a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.878+0000 7feea6de8640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f9a4e60 0x55e80f9a7250 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.878+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.878+0000 7feeaae16800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.878+0000 7feeaae16800 20 searching for the correct realm 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.878+0000 7feeaae16800 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e80f9a9a40 0x55e80f9abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.878+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a9a40 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.878+0000 7feea65e7640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e80f9a9a40 0x55e80f9abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.878+0000 7feea65e7640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e80f9a9a40 0x55e80f9abf00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.879+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.879+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a4e60 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.879+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.879+0000 7feea6de8640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7feea0040060 0x7feea002d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.879+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x7feea0040060 2024-09-22T08:12:02.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.879+0000 7fee9ffff640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7feea0040060 0x7feea002d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.880+0000 7fee9ffff640 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7feea0040060 0x7feea002d900 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.880+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90009050 con 0x7feea0040060 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.880+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a0560 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.880+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90009050 con 0x55e80f9a0560 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.880+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a0560 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.880+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.880+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x7feea0040060 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.881+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.881+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a4e60 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.881+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.881+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a4e60 2024-09-22T08:12:02.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.881+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.881+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a9a40 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.881+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.881+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a0560 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.881+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.881+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x7feea0040060 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.882+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.882+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a0560 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.882+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.882+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a4e60 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.882+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.882+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a9a40 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.882+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.882+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a9a40 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.883+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.883+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x7feea0040060 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.883+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.883+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a9a40 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.883+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.883+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a9a40 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.883+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.883+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a0560 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.884+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.884+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a0560 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.884+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.884+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x7feea0040060 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.884+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.884+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a9a40 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.884+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.884+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a4e60 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.884+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.884+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a0560 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.885+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.885+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x7feea0040060 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.885+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.885+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a9a40 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.885+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.885+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x7feea0040060 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.885+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.885+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a4e60 2024-09-22T08:12:02.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.886+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.886+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a9a40 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.886+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.886+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x7feea0040060 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.886+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.886+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a0560 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.886+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.886+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ac5d0 con 0x55e80f9a4e60 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:02.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9a8440 con 0x55e80f9a0560 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9a8890 con 0x55e80f9a0560 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9a8d70 con 0x55e80f9a0560 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 zone default found 2024-09-22T08:12:02.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 4 Realm: () 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 zonegroup default 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.887+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9a7fe0 con 0x7feea0040060 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feeaae16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ae920 con 0x55e80f9a9a40 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feeaae16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9aedd0 con 0x55e80f9a9a40 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feeaae16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feeaae16800 20 started sync module instance, tier type = 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feeaae16800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.888+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9add80 con 0x55e80f9a4e60 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.889+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.889+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94455182582128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9af6e0 con 0x55e80f9a4e60 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.889+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9aff30 con 0x55e80f9a0560 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.890+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94455182582128] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.891+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.891+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94455182586688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9afc90 con 0x55e80f9a0560 2024-09-22T08:12:02.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.891+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b07b0 con 0x55e80f9a9a40 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.892+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94455182586688] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.892+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.892+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94455182590592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b0ba0 con 0x55e80f9a9a40 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.892+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b15a0 con 0x55e80f9a4e60 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.893+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.893+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94455182590592] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.893+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94455182594224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b1e70 con 0x55e80f9a4e60 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.893+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9af780 con 0x55e80f9a0560 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.894+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.894+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94455182599216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9af780 con 0x55e80f9a0560 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.894+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b3360 con 0x7feea0040060 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.894+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94455182594224] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.895+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.895+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94455182596544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b3320 con 0x7feea0040060 2024-09-22T08:12:02.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.895+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b3d70 con 0x7feea0040060 2024-09-22T08:12:02.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.895+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94455182599216] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.896+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94455182596544] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.896+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.896+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94455182601840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b38c0 con 0x7feea0040060 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.896+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b4280 con 0x7feea0040060 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.897+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94455182601840] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.897+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.897+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94455182602896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b4280 con 0x7feea0040060 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.897+0000 7feeaae16800 20 add_watcher() i=0 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.897+0000 7feeaae16800 20 add_watcher() i=1 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.897+0000 7feeaae16800 20 add_watcher() i=2 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.897+0000 7feeaae16800 20 add_watcher() i=3 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.897+0000 7feeaae16800 20 add_watcher() i=4 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.897+0000 7feeaae16800 20 add_watcher() i=5 2024-09-22T08:12:02.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.897+0000 7feeaae16800 20 add_watcher() i=6 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.898+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94455182602896] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.898+0000 7feeaae16800 20 add_watcher() i=7 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.898+0000 7feeaae16800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.898+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b76e0 con 0x55e80f9a0560 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.899+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.899+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94455182618832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b43f0 con 0x55e80f9a0560 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94455182618832] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7fed5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7feeaae16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7feeaae16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7feeaae16800 5 note: GC not initialized 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7fecd77fe640 20 reqs_thread_entry: start 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7feeaae16800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:02.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7feeaae16800 20 Filter name: none 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7fecd57fa640 20 reqs_thread_entry: start 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7feeaae16800 20 rados->read ofs=0 len=0 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.900+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ea600 con 0x55e80f9a0560 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.901+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.901+0000 7feeaae16800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.901+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ebb80 con 0x7feea0040060 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.901+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.902+0000 7fed5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.902+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94455182618832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9e9f20 con 0x55e80f9a0560 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.903+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94455182618832] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.903+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94455182582128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b70d0 con 0x55e80f9a4e60 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.904+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94455182582128] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.904+0000 7feeaae16800 20 remove_watcher() i=0 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.904+0000 7feeaae16800 2 removed watcher, disabling cache 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.904+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94455182586688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ae170 con 0x55e80f9a0560 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.905+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94455182586688] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.905+0000 7feeaae16800 20 remove_watcher() i=1 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.905+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94455182590592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9ae170 con 0x55e80f9a9a40 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.906+0000 7feea65e7640 1 -- 172.21.15.165:0/2861800442 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94455182590592] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee98097040 con 0x55e80f9a9a40 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.906+0000 7feeaae16800 20 remove_watcher() i=2 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.906+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94455182594224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b0280 con 0x55e80f9a4e60 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.907+0000 7feea6de8640 1 -- 172.21.15.165:0/2861800442 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94455182594224] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea003d030 con 0x55e80f9a4e60 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.907+0000 7feeaae16800 20 remove_watcher() i=3 2024-09-22T08:12:02.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.907+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94455182599216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b0280 con 0x55e80f9a0560 2024-09-22T08:12:02.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.908+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94455182599216] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x55e80f9a0560 2024-09-22T08:12:02.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.908+0000 7feeaae16800 20 remove_watcher() i=4 2024-09-22T08:12:02.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.908+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94455182596544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b2430 con 0x7feea0040060 2024-09-22T08:12:02.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.909+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94455182596544] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.909+0000 7feeaae16800 20 remove_watcher() i=5 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.909+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94455182601840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b0280 con 0x7feea0040060 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.910+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94455182601840] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.910+0000 7feeaae16800 20 remove_watcher() i=6 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.910+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94455182602896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e80f9b2430 con 0x7feea0040060 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94455182602896] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee90029040 con 0x7feea0040060 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 20 remove_watcher() i=7 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7feea0040060 msgr2=0x7feea002d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7feea0040060 0x7feea002d900 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f9a0560 msgr2=0x55e80f9a2a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f9a0560 0x55e80f9a2a20 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f9a4e60 msgr2=0x55e80f9a7250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f9a4e60 0x55e80f9a7250 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e80f9a9a40 msgr2=0x55e80f9abf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e80f9a9a40 0x55e80f9abf00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7003d000 msgr2=0x7fed7003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed7003d000 0x7fed7003f4c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fee98096170 tx=0x7fee98084000 comp rx=0 tx=0).stop 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 msgr2=0x55e80f994ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7fee9ffff640 1 -- 172.21.15.165:0/2861800442 reap_dead start 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.911+0000 7feeaae16800 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f994ae0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feea0022710 tx=0x7feea00542b0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 shutdown_connections 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/2861800442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f98d510 0x55e80f994ae0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 >> 172.21.15.165:0/2861800442 conn(0x55e80f989910 msgr2=0x55e80f987b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 shutdown_connections 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/2861800442 wait complete. 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/3336152951 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8003d000 msgr2=0x7fed8003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/3336152951 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8003d000 0x7fed8003f4c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55e80f96d780 tx=0x7fee98068f40 comp rx=0 tx=0).stop 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/3336152951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f980a70 msgr2=0x55e80f980e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/3336152951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f980a70 0x55e80f980e90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55e80f96d6e0 tx=0x7feea0018830 comp rx=0 tx=0).stop 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/3336152951 shutdown_connections 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/3336152951 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8003d000 0x7fed8003f4c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/3336152951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f980a70 0x55e80f980e90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/3336152951 >> 172.21.15.165:0/3336152951 conn(0x55e80f974e20 msgr2=0x55e80f975200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/3336152951 shutdown_connections 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/3336152951 wait complete. 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f871c50 msgr2=0x55e80f96d160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f871c50 0x55e80f96d160 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f96f630 msgr2=0x55e80f971a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f96f630 0x55e80f971a20 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8c03cfb0 msgr2=0x7fed8c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8c03cfb0 0x7fed8c03f470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fee90001db0 tx=0x7fee90001310 comp rx=0 tx=0).stop 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 msgr2=0x55e80f965b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f965b10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fee98025b20 tx=0x7fee98002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 shutdown_connections 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e80f96f630 0x55e80f971a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e80f871c50 0x55e80f96d160 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fed8c03cfb0 0x7fed8c03f470 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 --2- 172.21.15.165:0/1456298596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e80f86abe0 0x55e80f965b10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.912+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 >> 172.21.15.165:0/1456298596 conn(0x55e80f866310 msgr2=0x55e80f95f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.913+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 shutdown_connections 2024-09-22T08:12:02.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.913+0000 7feeaae16800 1 -- 172.21.15.165:0/1456298596 wait complete. 2024-09-22T08:12:02.922 INFO:teuthology.orchestra.run.smithi165.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:12:02.922 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:12:02.922 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-22T08:12:02.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-22T08:12:02.922 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-22T08:12:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:02.968 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.968+0000 7fdb22123800 1 Processor -- start 2024-09-22T08:12:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.968+0000 7fdb22123800 1 -- start start 2024-09-22T08:12:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.968+0000 7fdb22123800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5570c5b038e0 0x5570c5b05da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.968+0000 7fdb22123800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5570c598ba20 con 0x5570c5affc60 2024-09-22T08:12:02.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.968+0000 7fdb22123800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5570c598b7d0 con 0x5570c5b038e0 2024-09-22T08:12:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.969+0000 7fdb1d60b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5570c5b038e0 0x5570c5b05da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.969+0000 7fdb1de0c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5570c5affc60 0x5570c5b02050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49482/0 (socket says 172.21.15.165:49482) 2024-09-22T08:12:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.969+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3411337943 learned_addr learned my addr 172.21.15.165:0/3411337943 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.969+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3411337943 >> v1:172.21.15.53:6789/0 conn(0x5570c5affc60 legacy=0x5570c5b02050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.969+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3411337943 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570c5b07480 con 0x5570c5b038e0 2024-09-22T08:12:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.971+0000 7fdb1d60b640 1 --2- 172.21.15.165:0/3411337943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5b038e0 0x5570c5b05da0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400a470 tx=0x7fdb14045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7ab6b964fa2010 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.971+0000 7fdb1ce0a640 1 -- 172.21.15.165:0/3411337943 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb14053570 con 0x5570c5b038e0 2024-09-22T08:12:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.971+0000 7fdb1ce0a640 1 -- 172.21.15.165:0/3411337943 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb14058070 con 0x5570c5b038e0 2024-09-22T08:12:02.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.971+0000 7fdb1ce0a640 1 -- 172.21.15.165:0/3411337943 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb14053880 con 0x5570c5b038e0 2024-09-22T08:12:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.972+0000 7fdb22123800 1 -- 172.21.15.165:0/3411337943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5b038e0 msgr2=0x5570c5b05da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.972+0000 7fdb22123800 1 --2- 172.21.15.165:0/3411337943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5b038e0 0x5570c5b05da0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400a470 tx=0x7fdb14045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.972+0000 7fdb22123800 1 -- 172.21.15.165:0/3411337943 shutdown_connections 2024-09-22T08:12:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.972+0000 7fdb22123800 1 --2- 172.21.15.165:0/3411337943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5b038e0 0x5570c5b05da0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.972+0000 7fdb22123800 1 -- 172.21.15.165:0/3411337943 >> 172.21.15.165:0/3411337943 conn(0x5570c5afa310 msgr2=0x5570c5afc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.972+0000 7fdb22123800 1 -- 172.21.15.165:0/3411337943 shutdown_connections 2024-09-22T08:12:02.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.972+0000 7fdb22123800 1 -- 172.21.15.165:0/3411337943 wait complete. 2024-09-22T08:12:02.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.986+0000 7fdb22123800 1 Processor -- start 2024-09-22T08:12:02.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.986+0000 7fdb22123800 1 -- start start 2024-09-22T08:12:02.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.986+0000 7fdb22123800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5beefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.986+0000 7fdb22123800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5570c5998dd0 con 0x5570c5affc60 2024-09-22T08:12:02.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.986+0000 7fdb1de0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5beefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.986+0000 7fdb1de0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5beefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56442/0 (socket says 172.21.15.165:56442) 2024-09-22T08:12:02.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.986+0000 7fdb1de0c640 1 -- 172.21.15.165:0/2582514576 learned_addr learned my addr 172.21.15.165:0/2582514576 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.986+0000 7fdb1de0c640 1 -- 172.21.15.165:0/2582514576 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570c5bef5a0 con 0x5570c5affc60 2024-09-22T08:12:02.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.987+0000 7fdb1de0c640 1 --2- 172.21.15.165:0/2582514576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5beefb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdb10001e10 tx=0x7fdb1000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8311f21912151837 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.987+0000 7fda0be07640 1 -- 172.21.15.165:0/2582514576 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb10012020 con 0x5570c5affc60 2024-09-22T08:12:02.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.987+0000 7fda0be07640 1 -- 172.21.15.165:0/2582514576 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1000e5a0 con 0x5570c5affc60 2024-09-22T08:12:02.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.987+0000 7fda0be07640 1 -- 172.21.15.165:0/2582514576 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1000e8a0 con 0x5570c5affc60 2024-09-22T08:12:02.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 -- 172.21.15.165:0/2582514576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 msgr2=0x5570c5beefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:02.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 --2- 172.21.15.165:0/2582514576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5beefb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdb10001e10 tx=0x7fdb1000b780 comp rx=0 tx=0).stop 2024-09-22T08:12:02.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 -- 172.21.15.165:0/2582514576 shutdown_connections 2024-09-22T08:12:02.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 --2- 172.21.15.165:0/2582514576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5beefb0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:02.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 -- 172.21.15.165:0/2582514576 >> 172.21.15.165:0/2582514576 conn(0x5570c5afa310 msgr2=0x5570c5bea930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:02.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 -- 172.21.15.165:0/2582514576 shutdown_connections 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 -- 172.21.15.165:0/2582514576 wait complete. 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 Processor -- start 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 -- start start 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5bf6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.988+0000 7fdb22123800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5570c5b06720 con 0x5570c5affc60 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.989+0000 7fdb1de0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5bf6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.989+0000 7fdb1de0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5bf6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56446/0 (socket says 172.21.15.165:56446) 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.989+0000 7fdb1de0c640 1 -- 172.21.15.165:0/10809707 learned_addr learned my addr 172.21.15.165:0/10809707 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.989+0000 7fdb1de0c640 1 -- 172.21.15.165:0/10809707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570c5bf7040 con 0x5570c5affc60 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.989+0000 7fdb1de0c640 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5bf6ae0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x5570c5beff40 tx=0x7fdb10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.989+0000 7fda0a604640 1 -- 172.21.15.165:0/10809707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb10012030 con 0x5570c5affc60 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.989+0000 7fda0a604640 1 -- 172.21.15.165:0/10809707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb10001470 con 0x5570c5affc60 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.989+0000 7fda0a604640 1 -- 172.21.15.165:0/10809707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1001c490 con 0x5570c5affc60 2024-09-22T08:12:02.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.989+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570c5bf72d0 con 0x5570c5affc60 2024-09-22T08:12:02.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.989+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570c5bf7cd0 con 0x5570c5affc60 2024-09-22T08:12:02.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.990+0000 7fda0a604640 1 -- 172.21.15.165:0/10809707 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdb10015020 con 0x5570c5affc60 2024-09-22T08:12:02.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.990+0000 7fda0a604640 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fda0403d000 0x7fda0403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.990+0000 7fda0a604640 1 -- 172.21.15.165:0/10809707 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdb10022030 con 0x5570c5affc60 2024-09-22T08:12:02.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.990+0000 7fdb1d60b640 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fda0403d000 0x7fda0403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.991+0000 7fdb22123800 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5b038e0 0x5570c5bfcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.991+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5bfd220 con 0x5570c5b038e0 2024-09-22T08:12:02.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.991+0000 7fdb1e60d640 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5b038e0 0x5570c5bfcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.991+0000 7fdb1d60b640 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fda0403d000 0x7fda0403f4c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdb14057000 tx=0x7fdb14052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.991+0000 7fdb1e60d640 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5b038e0 0x5570c5bfcce0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.991+0000 7fdb1e60d640 1 -- 172.21.15.165:0/10809707 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb1800a4d0 con 0x5570c5b038e0 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.991+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5bf8010 con 0x5570c5b038e0 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.992+0000 7fdb1e60d640 1 -- 172.21.15.165:0/10809707 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb1800a4d0 con 0x5570c5b038e0 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.992+0000 7fdb22123800 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5bff550 0x5570c5c01940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.992+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c02010 con 0x5570c5bff550 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.992+0000 7fdb1de0c640 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5bff550 0x5570c5c01940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.992+0000 7fdb1de0c640 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5bff550 0x5570c5c01940 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.992+0000 7fdb1de0c640 1 -- 172.21.15.165:0/10809707 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5bff550 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.992+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5bfe3f0 con 0x5570c5b038e0 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.992+0000 7fdb1e60d640 1 -- 172.21.15.165:0/10809707 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb1800a4d0 con 0x5570c5b038e0 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.993+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5bfe890 con 0x5570c5b038e0 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.993+0000 7fdb1e60d640 1 -- 172.21.15.165:0/10809707 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb1800a4d0 con 0x5570c5b038e0 2024-09-22T08:12:02.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.993+0000 7fdb22123800 1 Processor -- start 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.993+0000 7fdb22123800 1 -- start start 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.993+0000 7fdb22123800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c10990 0x5570c5c10db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.993+0000 7fdb22123800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5570c59f7d50 con 0x5570c5c10990 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.993+0000 7fdb1e60d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c10990 0x5570c5c10db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.994+0000 7fdb1e60d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c10990 0x5570c5c10db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56450/0 (socket says 172.21.15.165:56450) 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.994+0000 7fdb1e60d640 1 -- 172.21.15.165:0/1255237875 learned_addr learned my addr 172.21.15.165:0/1255237875 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.994+0000 7fdb1e60d640 1 -- 172.21.15.165:0/1255237875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570c5c113f0 con 0x5570c5c10990 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.994+0000 7fdb1e60d640 1 --2- 172.21.15.165:0/1255237875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c10990 0x5570c5c10db0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x5570c5bfd600 tx=0x7fdb18018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.994+0000 7fda037fe640 1 -- 172.21.15.165:0/1255237875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb18014450 con 0x5570c5c10990 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.994+0000 7fda037fe640 1 -- 172.21.15.165:0/1255237875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb180145f0 con 0x5570c5c10990 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.994+0000 7fda037fe640 1 -- 172.21.15.165:0/1255237875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb18014910 con 0x5570c5c10990 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.994+0000 7fdb22123800 1 -- 172.21.15.165:0/1255237875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570c5c11c20 con 0x5570c5c10990 2024-09-22T08:12:02.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.994+0000 7fdb22123800 1 -- 172.21.15.165:0/1255237875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570c5c121c0 con 0x5570c5c10990 2024-09-22T08:12:03.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.995+0000 7fda037fe640 1 -- 172.21.15.165:0/1255237875 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdb18011040 con 0x5570c5c10990 2024-09-22T08:12:03.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.995+0000 7fda037fe640 1 --2- 172.21.15.165:0/1255237875 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9f803d000 0x7fd9f803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.995+0000 7fda037fe640 1 -- 172.21.15.165:0/1255237875 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdb1801e070 con 0x5570c5c10990 2024-09-22T08:12:03.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.995+0000 7fdb1de0c640 1 --2- 172.21.15.165:0/1255237875 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9f803d000 0x7fd9f803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.995+0000 7fdb22123800 1 Processor -- start 2024-09-22T08:12:03.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.996+0000 7fdb22123800 1 -- start start 2024-09-22T08:12:03.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.996+0000 7fdb1de0c640 1 --2- 172.21.15.165:0/1255237875 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9f803d000 0x7fd9f803f4c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5570c5bfd6a0 tx=0x7fdb10054b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.996+0000 7fdb22123800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c21be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.004 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.996+0000 7fdb22123800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5570c5bef9d0 con 0x5570c5c217e0 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.996+0000 7fdb1e60d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c21be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.996+0000 7fdb1e60d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c21be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56454/0 (socket says 172.21.15.165:56454) 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.996+0000 7fdb1e60d640 1 -- 172.21.15.165:0/4280306174 learned_addr learned my addr 172.21.15.165:0/4280306174 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.996+0000 7fdb1e60d640 1 -- 172.21.15.165:0/4280306174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570c5c221d0 con 0x5570c5c217e0 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.997+0000 7fdb1e60d640 1 --2- 172.21.15.165:0/4280306174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c21be0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdb18016620 tx=0x7fdb18011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd4cfee05ee58d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.997+0000 7fda017fa640 1 -- 172.21.15.165:0/4280306174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb18051020 con 0x5570c5c217e0 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.997+0000 7fda017fa640 1 -- 172.21.15.165:0/4280306174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb18022de0 con 0x5570c5c217e0 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.997+0000 7fda017fa640 1 -- 172.21.15.165:0/4280306174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb18028070 con 0x5570c5c217e0 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.997+0000 7fdb22123800 1 -- 172.21.15.165:0/4280306174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 msgr2=0x5570c5c21be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.997+0000 7fdb22123800 1 --2- 172.21.15.165:0/4280306174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c21be0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdb18016620 tx=0x7fdb18011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.997+0000 7fdb22123800 1 -- 172.21.15.165:0/4280306174 shutdown_connections 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.997+0000 7fdb22123800 1 --2- 172.21.15.165:0/4280306174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c21be0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.997+0000 7fdb22123800 1 -- 172.21.15.165:0/4280306174 >> 172.21.15.165:0/4280306174 conn(0x5570c5c197d0 msgr2=0x5570c5c17a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.997+0000 7fdb22123800 1 -- 172.21.15.165:0/4280306174 shutdown_connections 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.998+0000 7fdb22123800 1 -- 172.21.15.165:0/4280306174 wait complete. 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.998+0000 7fdb22123800 1 Processor -- start 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.998+0000 7fdb22123800 1 -- start start 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.998+0000 7fdb22123800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c28df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.998+0000 7fdb22123800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5570c5c227f0 con 0x5570c5c217e0 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.998+0000 7fdb1e60d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c28df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.998+0000 7fdb1e60d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c28df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56470/0 (socket says 172.21.15.165:56470) 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.998+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 learned_addr learned my addr 172.21.15.165:0/3455247077 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.998+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570c5c29350 con 0x5570c5c217e0 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.999+0000 7fdb1e60d640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c28df0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdb18022f90 tx=0x7fdb18011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.999+0000 7fd9ef7fe640 1 -- 172.21.15.165:0/3455247077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb18054b70 con 0x5570c5c217e0 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.999+0000 7fd9ef7fe640 1 -- 172.21.15.165:0/3455247077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb18054d10 con 0x5570c5c217e0 2024-09-22T08:12:03.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.999+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570c5c295e0 con 0x5570c5c217e0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.999+0000 7fd9ef7fe640 1 -- 172.21.15.165:0/3455247077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb18045930 con 0x5570c5c217e0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.999+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570c5c29f60 con 0x5570c5c217e0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:02.999+0000 7fd9ef7fe640 1 -- 172.21.15.165:0/3455247077 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdb18034030 con 0x5570c5c217e0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.000+0000 7fd9ef7fe640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9e803cfb0 0x7fd9e803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.000+0000 7fd9ef7fe640 1 -- 172.21.15.165:0/3455247077 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdb18032070 con 0x5570c5c217e0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.000+0000 7fdb1de0c640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9e803cfb0 0x7fd9e803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.000+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.000+0000 7fdb22123800 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5c348a0 0x5570c5c36d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.000+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c374b0 con 0x5570c5c348a0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.000+0000 7fdb1de0c640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9e803cfb0 0x7fd9e803f470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdb100175a0 tx=0x7fdb10049000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.000+0000 7fdb1d60b640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5c348a0 0x5570c5c36d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb1d60b640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5c348a0 0x5570c5c36d60 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 20 realm 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c378e0 con 0x5570c5c348a0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c381b0 con 0x5570c5c348a0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c38550 con 0x5570c5c348a0 2024-09-22T08:12:03.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5c392b0 0x5570c5c3b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.001+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c3bbe0 con 0x5570c5c392b0 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.002+0000 7fdb1e60d640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5c392b0 0x5570c5c3b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.002+0000 7fdb1e60d640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5c392b0 0x5570c5c3b6a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.002+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.002+0000 7fdb22123800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.002+0000 7fdb22123800 20 searching for the correct realm 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.002+0000 7fdb22123800 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5570c5c3dc20 0x5570c5c400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.002+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c3dc20 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.002+0000 7fdb1de0c640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5570c5c3dc20 0x5570c5c400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.002+0000 7fdb1de0c640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5570c5c3dc20 0x5570c5c400e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.003+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.003+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c392b0 2024-09-22T08:12:03.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.003+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.003+0000 7fdb1e60d640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fdb18014070 0x7fdb1804d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.003+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x7fdb18014070 2024-09-22T08:12:03.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.003+0000 7fdb1d60b640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fdb18014070 0x7fdb1804d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.004+0000 7fdb1d60b640 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fdb18014070 0x7fdb1804d5d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.004+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x7fdb18014070 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.004+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c348a0 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.004+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.004+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c348a0 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.004+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.004+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x7fdb18014070 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.005+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x7fdb18014070 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.005+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c392b0 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.005+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.005+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c392b0 2024-09-22T08:12:03.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.005+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.005+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c3dc20 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.005+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.005+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c348a0 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.006+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.006+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x7fdb18014070 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.006+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x7fdb18014070 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.006+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c348a0 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.006+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.006+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c392b0 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.006+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.006+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c3dc20 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.006+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.006+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c3dc20 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.007+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.007+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x7fdb18014070 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.007+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x7fdb18014070 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.007+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c3dc20 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.007+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.007+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c3dc20 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.007+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.007+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c348a0 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.008+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.008+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c348a0 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.008+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.008+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x7fdb18014070 2024-09-22T08:12:03.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.008+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x7fdb18014070 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.008+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c3dc20 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.008+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.008+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c392b0 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.009+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.009+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c348a0 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.009+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.009+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x7fdb18014070 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.009+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x7fdb18014070 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.009+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c3dc20 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.009+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.009+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x7fdb18014070 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.009+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x7fdb18014070 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.009+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c392b0 2024-09-22T08:12:03.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.010+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.010+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c3dc20 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.010+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.010+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x7fdb18014070 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.010+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb14051070 con 0x7fdb18014070 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.010+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c348a0 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.010+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.010+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c407b0 con 0x5570c5c392b0 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:03.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c3c620 con 0x5570c5c348a0 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c3caa0 con 0x5570c5c348a0 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb14051070 con 0x5570c5c348a0 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c3cf40 con 0x5570c5c348a0 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.011+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 zone default found 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 4 Realm: () 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 zonegroup default 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c3c1d0 con 0x7fdb18014070 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c42b00 con 0x5570c5c3dc20 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c430b0 con 0x5570c5c3dc20 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 started sync module instance, tier type = 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.012+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c41f60 con 0x5570c5c392b0 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.013+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.013+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93942842661552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c43510 con 0x5570c5c392b0 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.014+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c43ed0 con 0x5570c5c348a0 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.014+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93942842661552] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.015+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.015+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93942842663984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c43ed0 con 0x5570c5c348a0 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.015+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c44930 con 0x5570c5c3dc20 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.016+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93942842663984] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.016+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.016+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93942842669600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c43e40 con 0x5570c5c3dc20 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.016+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c457f0 con 0x5570c5c392b0 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.017+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93942842669600] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.017+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.017+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93942842676032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c45760 con 0x5570c5c392b0 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.017+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c466b0 con 0x5570c5c348a0 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.018+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93942842676032] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.018+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.018+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93942842678240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c466b0 con 0x5570c5c348a0 2024-09-22T08:12:03.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.018+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c47100 con 0x7fdb18014070 2024-09-22T08:12:03.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.019+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93942842678240] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.019+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.019+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93942842682384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c466b0 con 0x7fdb18014070 2024-09-22T08:12:03.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.019+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c47b10 con 0x7fdb18014070 2024-09-22T08:12:03.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.020+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93942842682384] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.020+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.020+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93942842685504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c466b0 con 0x7fdb18014070 2024-09-22T08:12:03.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.020+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c48520 con 0x7fdb18014070 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.021+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93942842685504] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.021+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.021+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93942842680288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c48520 con 0x7fdb18014070 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.021+0000 7fdb22123800 20 add_watcher() i=0 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.021+0000 7fdb22123800 20 add_watcher() i=1 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.021+0000 7fdb22123800 20 add_watcher() i=2 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.021+0000 7fdb22123800 20 add_watcher() i=3 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.021+0000 7fdb22123800 20 add_watcher() i=4 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.021+0000 7fdb22123800 20 add_watcher() i=5 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.021+0000 7fdb22123800 20 add_watcher() i=6 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.022+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93942842680288] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.022+0000 7fdb22123800 20 add_watcher() i=7 2024-09-22T08:12:03.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.022+0000 7fdb22123800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.022+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c4b990 con 0x5570c5c348a0 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.023+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.023+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93942842700656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c48690 con 0x5570c5c348a0 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93942842700656] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fd9cffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fdb22123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fdb22123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fdb22123800 5 note: GC not initialized 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fd9ceffd640 20 reqs_thread_entry: start 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fdb22123800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fdb22123800 20 Filter name: none 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fd9ccff9640 20 reqs_thread_entry: start 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fdb22123800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.024+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c7e860 con 0x5570c5c348a0 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.025+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.025+0000 7fdb22123800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.025+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c7fde0 con 0x7fdb18014070 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.025+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.026+0000 7fd9cffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.026+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93942842700656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c7e180 con 0x5570c5c348a0 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.027+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93942842700656] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.027+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93942842661552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c4b370 con 0x5570c5c392b0 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.028+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93942842661552] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.028+0000 7fdb22123800 20 remove_watcher() i=0 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.028+0000 7fdb22123800 2 removed watcher, disabling cache 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.028+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93942842663984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c4b370 con 0x5570c5c348a0 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.029+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93942842663984] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.029+0000 7fdb22123800 20 remove_watcher() i=1 2024-09-22T08:12:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.029+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93942842669600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c4b370 con 0x5570c5c3dc20 2024-09-22T08:12:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.030+0000 7fdb1de0c640 1 -- 172.21.15.165:0/3455247077 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93942842669600] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1000db20 con 0x5570c5c3dc20 2024-09-22T08:12:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.030+0000 7fdb22123800 20 remove_watcher() i=2 2024-09-22T08:12:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.030+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93942842676032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c43a20 con 0x5570c5c392b0 2024-09-22T08:12:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.031+0000 7fdb1e60d640 1 -- 172.21.15.165:0/3455247077 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93942842676032] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1802a070 con 0x5570c5c392b0 2024-09-22T08:12:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.031+0000 7fdb22123800 20 remove_watcher() i=3 2024-09-22T08:12:03.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.031+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93942842678240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c45340 con 0x5570c5c348a0 2024-09-22T08:12:03.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.032+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93942842678240] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x5570c5c348a0 2024-09-22T08:12:03.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.032+0000 7fdb22123800 20 remove_watcher() i=4 2024-09-22T08:12:03.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.032+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93942842682384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c43a20 con 0x7fdb18014070 2024-09-22T08:12:03.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.033+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93942842682384] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.033+0000 7fdb22123800 20 remove_watcher() i=5 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.033+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93942842685504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c45340 con 0x7fdb18014070 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.034+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93942842685504] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.034+0000 7fdb22123800 20 remove_watcher() i=6 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.034+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93942842680288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5570c5c46c10 con 0x7fdb18014070 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93942842680288] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb140891c0 con 0x7fdb18014070 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 20 remove_watcher() i=7 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fdb18014070 msgr2=0x7fdb1804d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fdb18014070 0x7fdb1804d5d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5c348a0 msgr2=0x5570c5c36d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5c348a0 0x5570c5c36d60 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5c392b0 msgr2=0x5570c5c3b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5c392b0 0x5570c5c3b6a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5570c5c3dc20 msgr2=0x5570c5c400e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5570c5c3dc20 0x5570c5c400e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9e803cfb0 msgr2=0x7fd9e803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9e803cfb0 0x7fd9e803f470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdb100175a0 tx=0x7fdb10049000 comp rx=0 tx=0).stop 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 msgr2=0x5570c5c28df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb1d60b640 1 -- 172.21.15.165:0/3455247077 reap_dead start 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.035+0000 7fdb22123800 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c28df0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdb18022f90 tx=0x7fdb18011f60 comp rx=0 tx=0).stop 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 shutdown_connections 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 --2- 172.21.15.165:0/3455247077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c217e0 0x5570c5c28df0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 >> 172.21.15.165:0/3455247077 conn(0x5570c5c197d0 msgr2=0x5570c5c179e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 shutdown_connections 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/3455247077 wait complete. 2024-09-22T08:12:03.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/1255237875 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9f803d000 msgr2=0x7fd9f803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 --2- 172.21.15.165:0/1255237875 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9f803d000 0x7fd9f803f4c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5570c5bfd6a0 tx=0x7fdb10054b80 comp rx=0 tx=0).stop 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/1255237875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c10990 msgr2=0x5570c5c10db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 --2- 172.21.15.165:0/1255237875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c10990 0x5570c5c10db0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x5570c5bfd600 tx=0x7fdb18018830 comp rx=0 tx=0).stop 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/1255237875 shutdown_connections 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 --2- 172.21.15.165:0/1255237875 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd9f803d000 0x7fd9f803f4c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 --2- 172.21.15.165:0/1255237875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5c10990 0x5570c5c10db0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/1255237875 >> 172.21.15.165:0/1255237875 conn(0x5570c5c04d40 msgr2=0x5570c5c05120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/1255237875 shutdown_connections 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/1255237875 wait complete. 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5b038e0 msgr2=0x5570c5bfcce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5b038e0 0x5570c5bfcce0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5bff550 msgr2=0x5570c5c01940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5bff550 0x5570c5c01940 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fda0403d000 msgr2=0x7fda0403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fda0403d000 0x7fda0403f4c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdb14057000 tx=0x7fdb14052000 comp rx=0 tx=0).stop 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 msgr2=0x5570c5bf6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.036+0000 7fdb22123800 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5bf6ae0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x5570c5beff40 tx=0x7fdb10000ed0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.037+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 shutdown_connections 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.037+0000 7fdb22123800 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5570c5bff550 0x5570c5c01940 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.037+0000 7fdb22123800 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5570c5b038e0 0x5570c5bfcce0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.037+0000 7fdb22123800 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fda0403d000 0x7fda0403f4c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.037+0000 7fdb22123800 1 --2- 172.21.15.165:0/10809707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5570c5affc60 0x5570c5bf6ae0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.037+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 >> 172.21.15.165:0/10809707 conn(0x5570c5afa310 msgr2=0x5570c5bf04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.037+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 shutdown_connections 2024-09-22T08:12:03.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.037+0000 7fdb22123800 1 -- 172.21.15.165:0/10809707 wait complete. 2024-09-22T08:12:03.045 INFO:teuthology.orchestra.run.smithi165.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-22T08:00:00.000000Z","epoch":1726992000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-22T08:12:03.046 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:12:03.046 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-22T08:12:03.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-22T08:12:03.046 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-22T08:12:03.098 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:03.098 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:03.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.098+0000 7fb670d23800 1 Processor -- start 2024-09-22T08:12:03.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.098+0000 7fb670d23800 1 -- start start 2024-09-22T08:12:03.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.098+0000 7fb670d23800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5627810ac5b0 0x5627810aab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.098+0000 7fb670d23800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562780fc1a20 con 0x5627810ab0d0 2024-09-22T08:12:03.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.098+0000 7fb670d23800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562780fc17d0 con 0x5627810ac5b0 2024-09-22T08:12:03.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.099+0000 7fb66c933640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5627810ac5b0 0x5627810aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.099+0000 7fb664132640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5627810ab0d0 0x56278113e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49486/0 (socket says 172.21.15.165:49486) 2024-09-22T08:12:03.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.099+0000 7fb664132640 1 -- 172.21.15.165:0/2431762178 learned_addr learned my addr 172.21.15.165:0/2431762178 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:03.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.099+0000 7fb66c933640 1 -- 172.21.15.165:0/2431762178 >> v1:172.21.15.53:6789/0 conn(0x5627810ab0d0 legacy=0x56278113e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.099+0000 7fb66c933640 1 -- 172.21.15.165:0/2431762178 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627810ab6c0 con 0x5627810ac5b0 2024-09-22T08:12:03.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.099+0000 7fb667fff640 1 -- 172.21.15.165:0/2431762178 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091289957 0 0) 0x562780fc1a20 con 0x5627810ab0d0 2024-09-22T08:12:03.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb66c933640 1 --2- 172.21.15.165:0/2431762178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ac5b0 0x5627810aab90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00a470 tx=0x7fb65c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef79d2ee902acc38 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb667fff640 1 -- 172.21.15.165:0/2431762178 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb65c053570 con 0x5627810ac5b0 2024-09-22T08:12:03.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb667fff640 1 -- 172.21.15.165:0/2431762178 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65c058070 con 0x5627810ac5b0 2024-09-22T08:12:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb667fff640 1 -- 172.21.15.165:0/2431762178 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb65c053880 con 0x5627810ac5b0 2024-09-22T08:12:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb670d23800 1 -- 172.21.15.165:0/2431762178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ac5b0 msgr2=0x5627810aab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb670d23800 1 --2- 172.21.15.165:0/2431762178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ac5b0 0x5627810aab90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00a470 tx=0x7fb65c045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb670d23800 1 -- 172.21.15.165:0/2431762178 shutdown_connections 2024-09-22T08:12:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb670d23800 1 --2- 172.21.15.165:0/2431762178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ac5b0 0x5627810aab90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb670d23800 1 -- 172.21.15.165:0/2431762178 >> 172.21.15.165:0/2431762178 conn(0x562781131df0 msgr2=0x562781134250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb670d23800 1 -- 172.21.15.165:0/2431762178 shutdown_connections 2024-09-22T08:12:03.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.101+0000 7fb670d23800 1 -- 172.21.15.165:0/2431762178 wait complete. 2024-09-22T08:12:03.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.115+0000 7fb670d23800 1 Processor -- start 2024-09-22T08:12:03.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.115+0000 7fb670d23800 1 -- start start 2024-09-22T08:12:03.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.115+0000 7fb670d23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x562781228110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.115+0000 7fb670d23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562780fcedd0 con 0x5627810ab0d0 2024-09-22T08:12:03.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.115+0000 7fb66c933640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x562781228110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.115+0000 7fb66c933640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x562781228110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56476/0 (socket says 172.21.15.165:56476) 2024-09-22T08:12:03.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.115+0000 7fb66c933640 1 -- 172.21.15.165:0/3169157186 learned_addr learned my addr 172.21.15.165:0/3169157186 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.115+0000 7fb66c933640 1 -- 172.21.15.165:0/3169157186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562781228700 con 0x5627810ab0d0 2024-09-22T08:12:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.116+0000 7fb66c933640 1 --2- 172.21.15.165:0/3169157186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x562781228110 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb65c005870 tx=0x7fb65c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf80fc7dbcaa460 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.116+0000 7fb55ae0d640 1 -- 172.21.15.165:0/3169157186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb65c053aa0 con 0x5627810ab0d0 2024-09-22T08:12:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.116+0000 7fb55ae0d640 1 -- 172.21.15.165:0/3169157186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65c063070 con 0x5627810ab0d0 2024-09-22T08:12:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.116+0000 7fb55ae0d640 1 -- 172.21.15.165:0/3169157186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb65c053d70 con 0x5627810ab0d0 2024-09-22T08:12:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.116+0000 7fb670d23800 1 -- 172.21.15.165:0/3169157186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 msgr2=0x562781228110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.116+0000 7fb670d23800 1 --2- 172.21.15.165:0/3169157186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x562781228110 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb65c005870 tx=0x7fb65c051000 comp rx=0 tx=0).stop 2024-09-22T08:12:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.116+0000 7fb670d23800 1 -- 172.21.15.165:0/3169157186 shutdown_connections 2024-09-22T08:12:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.116+0000 7fb670d23800 1 --2- 172.21.15.165:0/3169157186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x562781228110 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.116+0000 7fb670d23800 1 -- 172.21.15.165:0/3169157186 >> 172.21.15.165:0/3169157186 conn(0x562781131df0 msgr2=0x562781223a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.117+0000 7fb670d23800 1 -- 172.21.15.165:0/3169157186 shutdown_connections 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.117+0000 7fb670d23800 1 -- 172.21.15.165:0/3169157186 wait complete. 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.117+0000 7fb670d23800 1 Processor -- start 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.117+0000 7fb670d23800 1 -- start start 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.117+0000 7fb670d23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x56278122fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.117+0000 7fb670d23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56278113fe60 con 0x5627810ab0d0 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.117+0000 7fb66c933640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x56278122fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.117+0000 7fb66c933640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x56278122fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56484/0 (socket says 172.21.15.165:56484) 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.117+0000 7fb66c933640 1 -- 172.21.15.165:0/1126461897 learned_addr learned my addr 172.21.15.165:0/1126461897 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.118+0000 7fb66c933640 1 -- 172.21.15.165:0/1126461897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627812300e0 con 0x5627810ab0d0 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.118+0000 7fb66c933640 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x56278122fb80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb65c025c20 tx=0x7fb65c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.118+0000 7fb55960a640 1 -- 172.21.15.165:0/1126461897 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb65c068660 con 0x5627810ab0d0 2024-09-22T08:12:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.118+0000 7fb55960a640 1 -- 172.21.15.165:0/1126461897 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65c068800 con 0x5627810ab0d0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.118+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562781230370 con 0x5627810ab0d0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.118+0000 7fb55960a640 1 -- 172.21.15.165:0/1126461897 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb65c068ae0 con 0x5627810ab0d0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.118+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562781230d70 con 0x5627810ab0d0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.119+0000 7fb55960a640 1 -- 172.21.15.165:0/1126461897 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb65c068c80 con 0x5627810ab0d0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.119+0000 7fb55960a640 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb55403d000 0x7fb55403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.119+0000 7fb55960a640 1 -- 172.21.15.165:0/1126461897 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb65c06f030 con 0x5627810ab0d0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.119+0000 7fb664132640 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb55403d000 0x7fb55403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.119+0000 7fb670d23800 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627810ac5b0 0x5627812371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.119+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562781237710 con 0x5627810ac5b0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.120+0000 7fb66d134640 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627810ac5b0 0x5627812371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.120+0000 7fb664132640 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb55403d000 0x7fb55403f4c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb654000c00 tx=0x7fb6540013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.120+0000 7fb66d134640 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627810ac5b0 0x5627812371d0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.120+0000 7fb66d134640 1 -- 172.21.15.165:0/1126461897 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb66800a4d0 con 0x5627810ac5b0 2024-09-22T08:12:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.120+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562781237ab0 con 0x5627810ac5b0 2024-09-22T08:12:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.120+0000 7fb66d134640 1 -- 172.21.15.165:0/1126461897 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb66800a4d0 con 0x5627810ac5b0 2024-09-22T08:12:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.120+0000 7fb670d23800 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562781239530 0x56278123b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.120+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56278123c130 con 0x562781239530 2024-09-22T08:12:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.121+0000 7fb66c933640 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562781239530 0x56278123b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.121+0000 7fb66c933640 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562781239530 0x56278123b9a0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.121+0000 7fb66c933640 1 -- 172.21.15.165:0/1126461897 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb65c051070 con 0x562781239530 2024-09-22T08:12:03.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.121+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562781238300 con 0x5627810ac5b0 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.121+0000 7fb66d134640 1 -- 172.21.15.165:0/1126461897 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb66800a4d0 con 0x5627810ac5b0 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.121+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627812386a0 con 0x5627810ac5b0 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.122+0000 7fb66d134640 1 -- 172.21.15.165:0/1126461897 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb66800a4d0 con 0x5627810ac5b0 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.122+0000 7fb670d23800 1 Processor -- start 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.122+0000 7fb670d23800 1 -- start start 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.122+0000 7fb670d23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56278124aac0 0x56278124aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.122+0000 7fb670d23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56278102dd50 con 0x56278124aac0 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.122+0000 7fb66d134640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56278124aac0 0x56278124aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.122+0000 7fb66d134640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56278124aac0 0x56278124aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56490/0 (socket says 172.21.15.165:56490) 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.122+0000 7fb66d134640 1 -- 172.21.15.165:0/2768178373 learned_addr learned my addr 172.21.15.165:0/2768178373 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.123+0000 7fb66d134640 1 -- 172.21.15.165:0/2768178373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278124b520 con 0x56278124aac0 2024-09-22T08:12:03.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.123+0000 7fb66d134640 1 --2- 172.21.15.165:0/2768178373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56278124aac0 0x56278124aee0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x562781230b80 tx=0x7fb668018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.123+0000 7fb5527fc640 1 -- 172.21.15.165:0/2768178373 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668014450 con 0x56278124aac0 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.123+0000 7fb5527fc640 1 -- 172.21.15.165:0/2768178373 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668014610 con 0x56278124aac0 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.123+0000 7fb670d23800 1 -- 172.21.15.165:0/2768178373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56278124bd50 con 0x56278124aac0 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.123+0000 7fb5527fc640 1 -- 172.21.15.165:0/2768178373 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668014930 con 0x56278124aac0 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.123+0000 7fb670d23800 1 -- 172.21.15.165:0/2768178373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56278124c2f0 con 0x56278124aac0 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.124+0000 7fb5527fc640 1 -- 172.21.15.165:0/2768178373 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb668011040 con 0x56278124aac0 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.124+0000 7fb5527fc640 1 --2- 172.21.15.165:0/2768178373 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb54403d000 0x7fb54403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.124+0000 7fb5527fc640 1 -- 172.21.15.165:0/2768178373 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb66801e070 con 0x56278124aac0 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.124+0000 7fb66c933640 1 --2- 172.21.15.165:0/2768178373 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb54403d000 0x7fb54403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.124+0000 7fb670d23800 1 Processor -- start 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb66c933640 1 --2- 172.21.15.165:0/2768178373 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb54403d000 0x7fb54403f4c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb65c096e40 tx=0x7fb65c07ba00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb670d23800 1 -- start start 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb670d23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x562781257900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb670d23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562781228ad0 con 0x562781257500 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb66d134640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x562781257900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb66d134640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x562781257900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56494/0 (socket says 172.21.15.165:56494) 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb66d134640 1 -- 172.21.15.165:0/3407806828 learned_addr learned my addr 172.21.15.165:0/3407806828 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb66d134640 1 -- 172.21.15.165:0/3407806828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562781257ef0 con 0x562781257500 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb66d134640 1 --2- 172.21.15.165:0/3407806828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x562781257900 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb668054740 tx=0x7fb66802b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ba133f5fa41b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb543fff640 1 -- 172.21.15.165:0/3407806828 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb66804b070 con 0x562781257500 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb543fff640 1 -- 172.21.15.165:0/3407806828 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668051070 con 0x562781257500 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.125+0000 7fb543fff640 1 -- 172.21.15.165:0/3407806828 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668011da0 con 0x562781257500 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 -- 172.21.15.165:0/3407806828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 msgr2=0x562781257900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 --2- 172.21.15.165:0/3407806828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x562781257900 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb668054740 tx=0x7fb66802b4c0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 -- 172.21.15.165:0/3407806828 shutdown_connections 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 --2- 172.21.15.165:0/3407806828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x562781257900 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 -- 172.21.15.165:0/3407806828 >> 172.21.15.165:0/3407806828 conn(0x562781253920 msgr2=0x562781251b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 -- 172.21.15.165:0/3407806828 shutdown_connections 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 -- 172.21.15.165:0/3407806828 wait complete. 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 Processor -- start 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 -- start start 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x56278125eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.126+0000 7fb670d23800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562781258510 con 0x562781257500 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.127+0000 7fb66d134640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x56278125eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.127+0000 7fb66d134640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x56278125eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56500/0 (socket says 172.21.15.165:56500) 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.127+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 learned_addr learned my addr 172.21.15.165:0/3561637417 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.127+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278125f0b0 con 0x562781257500 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.127+0000 7fb66d134640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x56278125eb50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb668049040 tx=0x7fb6680546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.127+0000 7fb5427fc640 1 -- 172.21.15.165:0/3561637417 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb66804b040 con 0x562781257500 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.127+0000 7fb5427fc640 1 -- 172.21.15.165:0/3561637417 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668011460 con 0x562781257500 2024-09-22T08:12:03.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.127+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56278125f340 con 0x562781257500 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.127+0000 7fb5427fc640 1 -- 172.21.15.165:0/3561637417 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668054bb0 con 0x562781257500 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.127+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56278125fcc0 con 0x562781257500 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.128+0000 7fb5427fc640 1 -- 172.21.15.165:0/3561637417 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb6680458e0 con 0x562781257500 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.128+0000 7fb5427fc640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb53803d000 0x7fb53803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.128+0000 7fb5427fc640 1 -- 172.21.15.165:0/3561637417 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb66800e040 con 0x562781257500 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.128+0000 7fb66c933640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb53803d000 0x7fb53803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb66c933640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb53803d000 0x7fb53803f4c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb65c07bd00 tx=0x7fb65c080000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb670d23800 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56278126a650 0x56278126cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56278126d260 con 0x56278126a650 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb664132640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56278126a650 0x56278126cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb664132640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56278126a650 0x56278126cb10 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb65400f5f0 con 0x56278126a650 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb670d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb670d23800 20 realm 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.129+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627812699a0 con 0x56278126a650 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb65400f5f0 con 0x56278126a650 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56278126dd50 con 0x56278126a650 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb65400f5f0 con 0x56278126a650 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56278126e620 con 0x56278126a650 2024-09-22T08:12:03.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb65400f5f0 con 0x56278126a650 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56278126f040 0x562781271430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562781271ba0 con 0x56278126f040 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb66d134640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56278126f040 0x562781271430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.130+0000 7fb66d134640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56278126f040 0x562781271430 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.131+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.131+0000 7fb670d23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.131+0000 7fb670d23800 20 searching for the correct realm 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.131+0000 7fb670d23800 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562781273b50 0x562781276010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.131+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x562781273b50 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.131+0000 7fb66c933640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562781273b50 0x562781276010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.131+0000 7fb66c933640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562781273b50 0x562781276010 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.131+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.131+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126f040 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.132+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.132+0000 7fb66d134640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb668037070 0x7fb66802d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.132+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x7fb668037070 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.132+0000 7fb664132640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb668037070 0x7fb66802d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.132+0000 7fb664132640 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb668037070 0x7fb66802d480 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.132+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65400f5f0 con 0x7fb668037070 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.132+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126a650 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.133+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65400f5f0 con 0x56278126a650 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.133+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126a650 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.133+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.133+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x7fb668037070 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.133+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.133+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126f040 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.133+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.133+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126f040 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.134+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.134+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x562781273b50 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.134+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.134+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126a650 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.134+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.134+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x7fb668037070 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.134+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.134+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126a650 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.135+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.135+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126f040 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.135+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.135+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x562781273b50 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.135+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.135+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x562781273b50 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.135+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.135+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x7fb668037070 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.135+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.135+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x562781273b50 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.136+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.136+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x562781273b50 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.136+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.136+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126a650 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.136+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.136+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126a650 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.136+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.136+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x7fb668037070 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.137+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.137+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x562781273b50 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.137+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.137+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126f040 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.137+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.137+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126a650 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.137+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.137+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x7fb668037070 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.137+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.137+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x562781273b50 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.138+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.138+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x7fb668037070 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.138+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.138+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126f040 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.138+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.138+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x562781273b50 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.138+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.138+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x7fb668037070 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126a650 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627812766e0 con 0x56278126f040 2024-09-22T08:12:03.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562781272560 con 0x56278126a650 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.139+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562781272e00 con 0x56278126a650 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:03.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562781276b60 con 0x56278126a650 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 20 zone default found 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 4 Realm: () 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 20 zonegroup default 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562781276f00 con 0x7fb668037070 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.140+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562781278ce0 con 0x562781273b50 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.141+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.141+0000 7fb670d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.141+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.141+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627812791f0 con 0x562781273b50 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.141+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.141+0000 7fb670d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.141+0000 7fb670d23800 20 started sync module instance, tier type = 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.141+0000 7fb670d23800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.141+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562781278180 con 0x56278126f040 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.142+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.142+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94727670564208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562781279b00 con 0x56278126f040 2024-09-22T08:12:03.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.142+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127a350 con 0x56278126a650 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.143+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94727670564208] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.143+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.143+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94727670568528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562781279f20 con 0x56278126a650 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.143+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127aa20 con 0x562781273b50 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.144+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94727670568528] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.144+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.144+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94727670569584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562781279e90 con 0x562781273b50 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.144+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127b8e0 con 0x56278126f040 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.145+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94727670569584] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.145+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.145+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94727670576176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127bd00 con 0x56278126f040 2024-09-22T08:12:03.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.145+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127c6c0 con 0x56278126a650 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.146+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.146+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94727670579728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127c630 con 0x56278126a650 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.146+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127d690 con 0x7fb668037070 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.147+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94727670576176] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.147+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94727670579728] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.147+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.148+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94727670583680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127d650 con 0x7fb668037070 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.148+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127df60 con 0x7fb668037070 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.148+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94727670583680] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.151+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.151+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94727670577232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127d650 con 0x7fb668037070 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.151+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127e530 con 0x7fb668037070 2024-09-22T08:12:03.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.152+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94727670577232] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.152+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94727670585952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127e530 con 0x7fb668037070 2024-09-22T08:12:03.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 20 add_watcher() i=0 2024-09-22T08:12:03.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 20 add_watcher() i=1 2024-09-22T08:12:03.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 20 add_watcher() i=2 2024-09-22T08:12:03.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 20 add_watcher() i=3 2024-09-22T08:12:03.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 20 add_watcher() i=4 2024-09-22T08:12:03.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 20 add_watcher() i=5 2024-09-22T08:12:03.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 20 add_watcher() i=6 2024-09-22T08:12:03.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94727670585952] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 20 add_watcher() i=7 2024-09-22T08:12:03.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:03.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.153+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562781281a50 con 0x56278126a650 2024-09-22T08:12:03.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.154+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.154+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94727670588448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56278127ede0 con 0x56278126a650 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94727670588448] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb522fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb670d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb670d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb670d23800 5 note: GC not initialized 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb521fe3640 20 reqs_thread_entry: start 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb670d23800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb670d23800 20 Filter name: none 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb4937fe640 20 reqs_thread_entry: start 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb670d23800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.155+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627812b4e90 con 0x7fb668037070 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627812b33f0 con 0x56278126a650 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.156+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b3cc0 con 0x7fb668037070 2024-09-22T08:12:03.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.157+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.157+0000 7fb670d23800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.157+0000 7fb670d23800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.157+0000 7fb670d23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.157+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94727670806544 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627812b8930 con 0x7fb668037070 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.158+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== watch-notify(notify (1) cookie 94727670585952 notify 146028888095 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5627812b4060 con 0x7fb668037070 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.158+0000 7fb543fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94727670585952 notifier 4724 bl.length()=556 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.158+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(65 notify.7 [notify cookie 94727670806544 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.158+0000 7fb543fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.158+0000 7fb543fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.158+0000 7fb543fff640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb530003ea0 con 0x7fb668037070 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.158+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.158+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== watch-notify(notify_complete (2) cookie 94727670806544 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5627812b47e0 con 0x7fb668037070 2024-09-22T08:12:03.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.158+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b37c0 con 0x56278126a650 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb670d23800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb670d23800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb670d23800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94727670806464 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627812b8930 con 0x7fb668037070 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== watch-notify(notify (1) cookie 94727670583680 notify 146028888096 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5627812b47e0 con 0x7fb668037070 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb543fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888096 cookie 94727670583680 notifier 4724 bl.length()=177 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb543fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb543fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb543fff640 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb530003ea0 con 0x7fb668037070 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.159+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(68 notify.5 [notify cookie 94727670806464 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.160+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.160+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== watch-notify(notify_complete (2) cookie 94727670806464 notify 146028888096 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb654018040 con 0x7fb668037070 2024-09-22T08:12:03.170 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-22T08:12:03.157457Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:03.157445Z","tags":[],"group_ids":[]} 2024-09-22T08:12:03.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.161+0000 7fb522fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.161+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94727670588448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b2b60 con 0x56278126a650 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.161+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94727670588448] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.161+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94727670564208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b2b60 con 0x56278126f040 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.162+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94727670564208] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.163+0000 7fb670d23800 20 remove_watcher() i=0 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.163+0000 7fb670d23800 2 removed watcher, disabling cache 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.163+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94727670568528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b2b60 con 0x56278126a650 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.164+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94727670568528] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.164+0000 7fb670d23800 20 remove_watcher() i=1 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.164+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94727670569584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b2b60 con 0x562781273b50 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.165+0000 7fb66c933640 1 -- 172.21.15.165:0/3561637417 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94727670569584] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65c051070 con 0x562781273b50 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.165+0000 7fb670d23800 20 remove_watcher() i=2 2024-09-22T08:12:03.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.165+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94727670576176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b2b60 con 0x56278126f040 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.166+0000 7fb66d134640 1 -- 172.21.15.165:0/3561637417 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94727670576176] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66802a070 con 0x56278126f040 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.166+0000 7fb670d23800 20 remove_watcher() i=3 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.166+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94727670579728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b2b60 con 0x56278126a650 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.167+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94727670579728] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x56278126a650 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.167+0000 7fb670d23800 20 remove_watcher() i=4 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.167+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94727670583680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b2b60 con 0x7fb668037070 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.168+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94727670583680] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.168+0000 7fb670d23800 20 remove_watcher() i=5 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.168+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94727670577232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b2b60 con 0x7fb668037070 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.169+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94727670577232] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.169+0000 7fb670d23800 20 remove_watcher() i=6 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.169+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94727670585952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627812b2b60 con 0x7fb668037070 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94727670585952] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb65402b040 con 0x7fb668037070 2024-09-22T08:12:03.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 20 remove_watcher() i=7 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb668037070 msgr2=0x7fb66802d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb668037070 0x7fb66802d480 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56278126a650 msgr2=0x56278126cb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x56278126a650 0x56278126cb10 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56278126f040 msgr2=0x562781271430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x56278126f040 0x562781271430 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562781273b50 msgr2=0x562781276010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x562781273b50 0x562781276010 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb53803d000 msgr2=0x7fb53803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb53803d000 0x7fb53803f4c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb65c07bd00 tx=0x7fb65c080000 comp rx=0 tx=0).stop 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 msgr2=0x56278125eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb664132640 1 -- 172.21.15.165:0/3561637417 reap_dead start 2024-09-22T08:12:03.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x56278125eb50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb668049040 tx=0x7fb6680546a0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 shutdown_connections 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/3561637417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562781257500 0x56278125eb50 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 >> 172.21.15.165:0/3561637417 conn(0x562781253920 msgr2=0x562781251b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 shutdown_connections 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/3561637417 wait complete. 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/2768178373 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb54403d000 msgr2=0x7fb54403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/2768178373 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb54403d000 0x7fb54403f4c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb65c096e40 tx=0x7fb65c07ba00 comp rx=0 tx=0).stop 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/2768178373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56278124aac0 msgr2=0x56278124aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/2768178373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56278124aac0 0x56278124aee0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x562781230b80 tx=0x7fb668018830 comp rx=0 tx=0).stop 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/2768178373 shutdown_connections 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/2768178373 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb54403d000 0x7fb54403f4c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 --2- 172.21.15.165:0/2768178373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56278124aac0 0x56278124aee0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/2768178373 >> 172.21.15.165:0/2768178373 conn(0x56278123ee70 msgr2=0x56278123f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/2768178373 shutdown_connections 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.170+0000 7fb670d23800 1 -- 172.21.15.165:0/2768178373 wait complete. 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627810ac5b0 msgr2=0x5627812371d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627810ac5b0 0x5627812371d0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562781239530 msgr2=0x56278123b9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562781239530 0x56278123b9a0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb55403d000 msgr2=0x7fb55403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb55403d000 0x7fb55403f4c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb654000c00 tx=0x7fb6540013b0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 msgr2=0x56278122fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x56278122fb80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb65c025c20 tx=0x7fb65c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 shutdown_connections 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x562781239530 0x56278123b9a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5627810ac5b0 0x5627812371d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb55403d000 0x7fb55403f4c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 --2- 172.21.15.165:0/1126461897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627810ab0d0 0x56278122fb80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 >> 172.21.15.165:0/1126461897 conn(0x562781131df0 msgr2=0x562781222280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 shutdown_connections 2024-09-22T08:12:03.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.171+0000 7fb670d23800 1 -- 172.21.15.165:0/1126461897 wait complete. 2024-09-22T08:12:03.181 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-22T08:12:03.157457Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:03.157445Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:03.194 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:12:03.200 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-22T08:12:03.200 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-22T08:12:03.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-22T08:12:03.201 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-22T08:12:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:03.247 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:03.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.247+0000 7f68f2728800 1 Processor -- start 2024-09-22T08:12:03.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.247+0000 7f68f2728800 1 -- start start 2024-09-22T08:12:03.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.247+0000 7f68f2728800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d728d5bbf0 0x55d728d61580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.247+0000 7f68f2728800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d728be6a20 con 0x55d728d5a7e0 2024-09-22T08:12:03.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.247+0000 7f68f2728800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d728be67d0 con 0x55d728d5bbf0 2024-09-22T08:12:03.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.248+0000 7f68edc4a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d728d5bbf0 0x55d728d61580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.248+0000 7f68ee44b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d728d5a7e0 0x55d728d5b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49494/0 (socket says 172.21.15.165:49494) 2024-09-22T08:12:03.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.248+0000 7f68edc4a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d728d5bbf0 0x55d728d61580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56506/0 (socket says 172.21.15.165:56506) 2024-09-22T08:12:03.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.248+0000 7f68ee44b640 1 -- 172.21.15.165:0/3719859231 learned_addr learned my addr 172.21.15.165:0/3719859231 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:03.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.248+0000 7f68edc4a640 1 -- 172.21.15.165:0/3719859231 >> v1:172.21.15.53:6789/0 conn(0x55d728d5a7e0 legacy=0x55d728d5b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.248+0000 7f68ed449640 1 -- 172.21.15.165:0/3719859231 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3642755692 0 0) 0x55d728be6a20 con 0x55d728d5a7e0 2024-09-22T08:12:03.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.248+0000 7f68edc4a640 1 -- 172.21.15.165:0/3719859231 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d728d5aee0 con 0x55d728d5bbf0 2024-09-22T08:12:03.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.250+0000 7f68edc4a640 1 --2- 172.21.15.165:0/3719859231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5bbf0 0x55d728d61580 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f68d800a470 tx=0x7f68d8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4ad46678533e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.250+0000 7f68ed449640 1 -- 172.21.15.165:0/3719859231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68d8053570 con 0x55d728d5bbf0 2024-09-22T08:12:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.250+0000 7f68ed449640 1 -- 172.21.15.165:0/3719859231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d8058070 con 0x55d728d5bbf0 2024-09-22T08:12:03.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.250+0000 7f68ed449640 1 -- 172.21.15.165:0/3719859231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68d8053880 con 0x55d728d5bbf0 2024-09-22T08:12:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.250+0000 7f68f2728800 1 -- 172.21.15.165:0/3719859231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5bbf0 msgr2=0x55d728d61580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.250+0000 7f68f2728800 1 --2- 172.21.15.165:0/3719859231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5bbf0 0x55d728d61580 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f68d800a470 tx=0x7f68d8045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.250+0000 7f68f2728800 1 -- 172.21.15.165:0/3719859231 shutdown_connections 2024-09-22T08:12:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.250+0000 7f68f2728800 1 --2- 172.21.15.165:0/3719859231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5bbf0 0x55d728d61580 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.250+0000 7f68f2728800 1 -- 172.21.15.165:0/3719859231 >> 172.21.15.165:0/3719859231 conn(0x55d728d55bb0 msgr2=0x55d728d58010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.250+0000 7f68f2728800 1 -- 172.21.15.165:0/3719859231 shutdown_connections 2024-09-22T08:12:03.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.251+0000 7f68f2728800 1 -- 172.21.15.165:0/3719859231 wait complete. 2024-09-22T08:12:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.264+0000 7f68f2728800 1 Processor -- start 2024-09-22T08:12:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.264+0000 7f68f2728800 1 -- start start 2024-09-22T08:12:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.265+0000 7f68f2728800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e49d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.265+0000 7f68f2728800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d728bf3dd0 con 0x55d728d5a7e0 2024-09-22T08:12:03.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.265+0000 7f68ee44b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e49d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.265+0000 7f68ee44b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e49d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56520/0 (socket says 172.21.15.165:56520) 2024-09-22T08:12:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.265+0000 7f68ee44b640 1 -- 172.21.15.165:0/1058940448 learned_addr learned my addr 172.21.15.165:0/1058940448 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.265+0000 7f68ee44b640 1 -- 172.21.15.165:0/1058940448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d728e4a360 con 0x55d728d5a7e0 2024-09-22T08:12:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.265+0000 7f68ee44b640 1 --2- 172.21.15.165:0/1058940448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e49d70 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f68e0006fa0 tx=0x7f68e0001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9f4f513fa5be40 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.265+0000 7f67dc608640 1 -- 172.21.15.165:0/1058940448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e0003450 con 0x55d728d5a7e0 2024-09-22T08:12:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.265+0000 7f67dc608640 1 -- 172.21.15.165:0/1058940448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e0003610 con 0x55d728d5a7e0 2024-09-22T08:12:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.266+0000 7f67dc608640 1 -- 172.21.15.165:0/1058940448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e0003970 con 0x55d728d5a7e0 2024-09-22T08:12:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.266+0000 7f68f2728800 1 -- 172.21.15.165:0/1058940448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 msgr2=0x55d728e49d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.266+0000 7f68f2728800 1 --2- 172.21.15.165:0/1058940448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e49d70 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f68e0006fa0 tx=0x7f68e0001b00 comp rx=0 tx=0).stop 2024-09-22T08:12:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.266+0000 7f68f2728800 1 -- 172.21.15.165:0/1058940448 shutdown_connections 2024-09-22T08:12:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.266+0000 7f68f2728800 1 --2- 172.21.15.165:0/1058940448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e49d70 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.266+0000 7f68f2728800 1 -- 172.21.15.165:0/1058940448 >> 172.21.15.165:0/1058940448 conn(0x55d728d55bb0 msgr2=0x55d728e456f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.266+0000 7f68f2728800 1 -- 172.21.15.165:0/1058940448 shutdown_connections 2024-09-22T08:12:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.266+0000 7f68f2728800 1 -- 172.21.15.165:0/1058940448 wait complete. 2024-09-22T08:12:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.267+0000 7f68f2728800 1 Processor -- start 2024-09-22T08:12:03.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.267+0000 7f68f2728800 1 -- start start 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.267+0000 7f68f2728800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e51870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.267+0000 7f68f2728800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d728d61ac0 con 0x55d728d5a7e0 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.267+0000 7f68ee44b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e51870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.267+0000 7f68ee44b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e51870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56528/0 (socket says 172.21.15.165:56528) 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.267+0000 7f68ee44b640 1 -- 172.21.15.165:0/3903949864 learned_addr learned my addr 172.21.15.165:0/3903949864 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.267+0000 7f68ee44b640 1 -- 172.21.15.165:0/3903949864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d728e51dd0 con 0x55d728d5a7e0 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.267+0000 7f68ee44b640 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e51870 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f68e0001330 tx=0x7f68e0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.268+0000 7f67dae05640 1 -- 172.21.15.165:0/3903949864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e0014a10 con 0x55d728d5a7e0 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.268+0000 7f67dae05640 1 -- 172.21.15.165:0/3903949864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e0014bb0 con 0x55d728d5a7e0 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.268+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d728e52060 con 0x55d728d5a7e0 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.268+0000 7f67dae05640 1 -- 172.21.15.165:0/3903949864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e001e3f0 con 0x55d728d5a7e0 2024-09-22T08:12:03.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.268+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d728e52a60 con 0x55d728d5a7e0 2024-09-22T08:12:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.269+0000 7f67dae05640 1 -- 172.21.15.165:0/3903949864 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f68e0010070 con 0x55d728d5a7e0 2024-09-22T08:12:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.269+0000 7f67dae05640 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67d403d000 0x7f67d403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.269+0000 7f67dae05640 1 -- 172.21.15.165:0/3903949864 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f68e0018070 con 0x55d728d5a7e0 2024-09-22T08:12:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.269+0000 7f68edc4a640 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67d403d000 0x7f67d403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.269+0000 7f68f2728800 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728d5bbf0 0x55d728e58ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.269+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e59400 con 0x55d728d5bbf0 2024-09-22T08:12:03.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.269+0000 7f68eec4c640 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728d5bbf0 0x55d728e58ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.269+0000 7f68edc4a640 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67d403d000 0x7f67d403f4c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f68d8057000 tx=0x7f68d8052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.269+0000 7f68eec4c640 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728d5bbf0 0x55d728e58ec0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.270+0000 7f68eec4c640 1 -- 172.21.15.165:0/3903949864 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68e80083e0 con 0x55d728d5bbf0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.270+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e597a0 con 0x55d728d5bbf0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.270+0000 7f68eec4c640 1 -- 172.21.15.165:0/3903949864 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68e80083e0 con 0x55d728d5bbf0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.270+0000 7f68f2728800 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e5b2a0 0x55d728e5d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.270+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e5deb0 con 0x55d728e5b2a0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.270+0000 7f68ee44b640 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e5b2a0 0x55d728e5d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.270+0000 7f68ee44b640 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e5b2a0 0x55d728e5d720 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.271+0000 7f68ee44b640 1 -- 172.21.15.165:0/3903949864 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e5b2a0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.271+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e59ff0 con 0x55d728d5bbf0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.271+0000 7f68eec4c640 1 -- 172.21.15.165:0/3903949864 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68e80083e0 con 0x55d728d5bbf0 2024-09-22T08:12:03.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.271+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e5a440 con 0x55d728d5bbf0 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.271+0000 7f68eec4c640 1 -- 172.21.15.165:0/3903949864 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68e80083e0 con 0x55d728d5bbf0 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.271+0000 7f68f2728800 1 Processor -- start 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.271+0000 7f68f2728800 1 -- start start 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.272+0000 7f68f2728800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e6c890 0x55d728e6ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.272+0000 7f68f2728800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d728c52d50 con 0x55d728e6c890 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.272+0000 7f68eec4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e6c890 0x55d728e6ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.272+0000 7f68eec4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e6c890 0x55d728e6ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56534/0 (socket says 172.21.15.165:56534) 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.272+0000 7f68eec4c640 1 -- 172.21.15.165:0/4097022551 learned_addr learned my addr 172.21.15.165:0/4097022551 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.272+0000 7f68eec4c640 1 -- 172.21.15.165:0/4097022551 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d728e6d2f0 con 0x55d728e6c890 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.272+0000 7f68eec4c640 1 --2- 172.21.15.165:0/4097022551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e6c890 0x55d728e6ccb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x55d728e537a0 tx=0x7f68e800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.272+0000 7f67d3fff640 1 -- 172.21.15.165:0/4097022551 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e8017b60 con 0x55d728e6c890 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.272+0000 7f67d3fff640 1 -- 172.21.15.165:0/4097022551 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e8017d00 con 0x55d728e6c890 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.272+0000 7f68f2728800 1 -- 172.21.15.165:0/4097022551 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d728e6db20 con 0x55d728e6c890 2024-09-22T08:12:03.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.273+0000 7f67d3fff640 1 -- 172.21.15.165:0/4097022551 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e80154b0 con 0x55d728e6c890 2024-09-22T08:12:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.273+0000 7f68f2728800 1 -- 172.21.15.165:0/4097022551 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d728e6e0c0 con 0x55d728e6c890 2024-09-22T08:12:03.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.273+0000 7f67d3fff640 1 -- 172.21.15.165:0/4097022551 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f68e8015650 con 0x55d728e6c890 2024-09-22T08:12:03.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f67d3fff640 1 --2- 172.21.15.165:0/4097022551 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67c803cfb0 0x7f67c803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f67d3fff640 1 -- 172.21.15.165:0/4097022551 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f68e801d070 con 0x55d728e6c890 2024-09-22T08:12:03.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f68ee44b640 1 --2- 172.21.15.165:0/4097022551 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67c803cfb0 0x7f67c803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f68f2728800 1 Processor -- start 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f68ee44b640 1 --2- 172.21.15.165:0/4097022551 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67c803cfb0 0x7f67c803f470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55d728e53960 tx=0x7f68e0052a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f68f2728800 1 -- start start 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f68f2728800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e78640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f68f2728800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d728e4a790 con 0x55d728e78260 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f68eec4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e78640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f68eec4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e78640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56540/0 (socket says 172.21.15.165:56540) 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.274+0000 7f68eec4c640 1 -- 172.21.15.165:0/2957113789 learned_addr learned my addr 172.21.15.165:0/2957113789 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f68eec4c640 1 -- 172.21.15.165:0/2957113789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d728e78c30 con 0x55d728e78260 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f68eec4c640 1 --2- 172.21.15.165:0/2957113789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e78640 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f68e80299c0 tx=0x7f68e8055de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72e5d540d2baef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f67d1ffb640 1 -- 172.21.15.165:0/2957113789 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e8027030 con 0x55d728e78260 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f67d1ffb640 1 -- 172.21.15.165:0/2957113789 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e8029e40 con 0x55d728e78260 2024-09-22T08:12:03.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f67d1ffb640 1 -- 172.21.15.165:0/2957113789 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e8021550 con 0x55d728e78260 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f68f2728800 1 -- 172.21.15.165:0/2957113789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 msgr2=0x55d728e78640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f68f2728800 1 --2- 172.21.15.165:0/2957113789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e78640 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f68e80299c0 tx=0x7f68e8055de0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f68f2728800 1 -- 172.21.15.165:0/2957113789 shutdown_connections 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f68f2728800 1 --2- 172.21.15.165:0/2957113789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e78640 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f68f2728800 1 -- 172.21.15.165:0/2957113789 >> 172.21.15.165:0/2957113789 conn(0x55d728e74660 msgr2=0x55d728e728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f68f2728800 1 -- 172.21.15.165:0/2957113789 shutdown_connections 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.275+0000 7f68f2728800 1 -- 172.21.15.165:0/2957113789 wait complete. 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.276+0000 7f68f2728800 1 Processor -- start 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.276+0000 7f68f2728800 1 -- start start 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.276+0000 7f68f2728800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e7f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.276+0000 7f68f2728800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d728e79270 con 0x55d728e78260 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.276+0000 7f68eec4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e7f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.276+0000 7f68eec4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e7f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56554/0 (socket says 172.21.15.165:56554) 2024-09-22T08:12:03.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.276+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 learned_addr learned my addr 172.21.15.165:0/1331914372 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.276+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d728e7fd90 con 0x55d728e78260 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.276+0000 7f68eec4c640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e7f830 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f68e8029a70 tx=0x7f68e8055b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.277+0000 7f67bffff640 1 -- 172.21.15.165:0/1331914372 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e8030020 con 0x55d728e78260 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.277+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d728e80020 con 0x55d728e78260 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.277+0000 7f67bffff640 1 -- 172.21.15.165:0/1331914372 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e80079b0 con 0x55d728e78260 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.277+0000 7f67bffff640 1 -- 172.21.15.165:0/1331914372 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68e804c040 con 0x55d728e78260 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.277+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d728e809a0 con 0x55d728e78260 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.277+0000 7f67bffff640 1 -- 172.21.15.165:0/1331914372 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f68e8033020 con 0x55d728e78260 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.278+0000 7f67bffff640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67b803d000 0x7f67b803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.278+0000 7f67bffff640 1 -- 172.21.15.165:0/1331914372 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f68e8047e00 con 0x55d728e78260 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.278+0000 7f68ee44b640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67b803d000 0x7f67b803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.278+0000 7f68ee44b640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67b803d000 0x7f67b803f4c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f68e00035e0 tx=0x7f68e0036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.278+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.278+0000 7f68f2728800 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728e8b1d0 0x55d728e8d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.278+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e8dde0 con 0x55d728e8b1d0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.278+0000 7f68edc4a640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728e8b1d0 0x55d728e8d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68edc4a640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728e8b1d0 0x55d728e8d690 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 20 realm 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e8e210 con 0x55d728e8b1d0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e8eae0 con 0x55d728e8b1d0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.279+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e8ee80 con 0x55d728e8b1d0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68f2728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68f2728800 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e8fbe0 0x55d728e91fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e925e0 con 0x55d728e8fbe0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68eec4c640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e8fbe0 0x55d728e91fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68eec4c640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e8fbe0 0x55d728e91fd0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68f2728800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68f2728800 20 searching for the correct realm 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68f2728800 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d728e94590 0x55d728e96a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e94590 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.280+0000 7f68ee44b640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d728e94590 0x55d728e96a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.281+0000 7f68ee44b640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d728e94590 0x55d728e96a50 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.281+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.281+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8fbe0 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.281+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.281+0000 7f68eec4c640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f68e8035020 0x7f68e8057a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.281+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x7f68e8035020 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.281+0000 7f68edc4a640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f68e8035020 0x7f68e8057a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.282+0000 7f68edc4a640 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f68e8035020 0x7f68e8057a70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.282+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.282+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8b1d0 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.282+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.282+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8b1d0 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.282+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.282+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x7f68e8035020 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.283+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.283+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8fbe0 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.283+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.283+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8fbe0 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.283+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.283+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e94590 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.283+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.283+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8b1d0 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.284+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.284+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x7f68e8035020 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.284+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.284+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8b1d0 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.284+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.284+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8fbe0 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.284+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.284+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e94590 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.285+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.285+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e94590 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.285+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.285+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x7f68e8035020 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.285+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.285+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e94590 2024-09-22T08:12:03.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.285+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.285+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e94590 2024-09-22T08:12:03.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.286+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.286+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8b1d0 2024-09-22T08:12:03.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.286+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.286+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8b1d0 2024-09-22T08:12:03.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.286+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.286+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x7f68e8035020 2024-09-22T08:12:03.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.286+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.286+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e94590 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.286+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.287+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8fbe0 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.287+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.287+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8b1d0 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.287+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.287+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x7f68e8035020 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.287+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.287+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e94590 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.287+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.288+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x7f68e8035020 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.288+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.288+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8fbe0 2024-09-22T08:12:03.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.288+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.288+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e94590 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.288+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.288+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x7f68e8035020 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.288+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.288+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8b1d0 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d728e970d0 con 0x55d728e8fbe0 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:03.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e92ea0 con 0x55d728e8b1d0 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e93290 con 0x55d728e8b1d0 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.289+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e936b0 con 0x55d728e8b1d0 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:03.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 20 zone default found 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 4 Realm: () 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 20 zonegroup default 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e97570 con 0x7f68e8035020 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e993a0 con 0x55d728e94590 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.290+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728e99800 con 0x55d728e94590 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.291+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.291+0000 7f68f2728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.291+0000 7f68f2728800 20 started sync module instance, tier type = 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.291+0000 7f68f2728800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.291+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e98840 con 0x55d728e8fbe0 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.292+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.292+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94382592724288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e98840 con 0x55d728e8fbe0 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.292+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9a320 con 0x55d728e8b1d0 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.293+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94382592724288] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.293+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.293+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94382592728576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e98840 con 0x55d728e8b1d0 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.293+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9ad90 con 0x55d728e94590 2024-09-22T08:12:03.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.294+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94382592728576] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.294+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.294+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94382592721808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e987b0 con 0x55d728e94590 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.294+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9bc50 con 0x55d728e8fbe0 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.295+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94382592721808] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.295+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.295+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94382592735136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9bbc0 con 0x55d728e8fbe0 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.295+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9cb10 con 0x55d728e8b1d0 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.296+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.296+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94382592738912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9cf30 con 0x55d728e8b1d0 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.296+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94382592735136] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.296+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9c080 con 0x7f68e8035020 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.297+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94382592738912] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.298+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.298+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94382592739968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9cea0 con 0x7f68e8035020 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.298+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9dff0 con 0x7f68e8035020 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.298+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94382592739968] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.299+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.299+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94382592742688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9dff0 con 0x7f68e8035020 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.299+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9e880 con 0x7f68e8035020 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.300+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.300+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94382592745456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9ef10 con 0x7f68e8035020 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.300+0000 7f68f2728800 20 add_watcher() i=0 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.300+0000 7f68f2728800 20 add_watcher() i=1 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.300+0000 7f68f2728800 20 add_watcher() i=2 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.300+0000 7f68f2728800 20 add_watcher() i=3 2024-09-22T08:12:03.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.300+0000 7f68f2728800 20 add_watcher() i=4 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.300+0000 7f68f2728800 20 add_watcher() i=5 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.300+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94382592742688] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.300+0000 7f68f2728800 20 add_watcher() i=6 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.301+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94382592745456] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.301+0000 7f68f2728800 20 add_watcher() i=7 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.301+0000 7f68f2728800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.301+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ea1e30 con 0x55d728e8b1d0 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.301+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.301+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94382592747856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728e9f290 con 0x55d728e8b1d0 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.302+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94382592747856] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.302+0000 7f67a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.302+0000 7f68f2728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.302+0000 7f68f2728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.302+0000 7f68f2728800 5 note: GC not initialized 2024-09-22T08:12:03.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.302+0000 7f671f7fe640 20 reqs_thread_entry: start 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.302+0000 7f68f2728800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f68f2728800 20 Filter name: none 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f671d7fa640 20 reqs_thread_entry: start 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f68f2728800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed5060 con 0x7f68e8035020 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f68f2728800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f68f2728800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f68f2728800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f68f2728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:03.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.303+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed9330 con 0x55d728e8fbe0 2024-09-22T08:12:03.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.304+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.304+0000 7f68f2728800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.304+0000 7f68f2728800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.304+0000 7f68f2728800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.304+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94382592982368 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed9fc0 con 0x7f68e8035020 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== watch-notify(notify (1) cookie 94382592739968 notify 146028888097 ret 0) ==== 424+0+0 (crc 0 0 0) 0x55d728d5aee0 con 0x7f68e8035020 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f67d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94382592739968 notifier 4731 bl.length()=382 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f67d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f67d1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(64 notify.5 [notify cookie 94382592982368 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f67d1ffb640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f67b4003ea0 con 0x7f68e8035020 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== watch-notify(notify_complete (2) cookie 94382592982368 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f68d805f9d0 con 0x7f68e8035020 2024-09-22T08:12:03.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed9e60 con 0x55d728e8b1d0 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f68f2728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 : miss 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f68f2728800 20 rados->read ofs=0 len=0 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.305+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 8.19 8:9879c807:root::.bucket.meta.myfoo6%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed7590 con 0x55d728e8b1d0 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.306+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(67 .bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.306+0000 7f68f2728800 20 rados_obj.operate() r=0 bl.length=388 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.306+0000 7f68f2728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 info.flags=0x17 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.306+0000 7f68f2728800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 to cache LRU end 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.306+0000 7f68f2728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.306+0000 7f68f2728800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.306+0000 7f68f2728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.306+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 8.19 8:9879c807:root::.bucket.meta.myfoo6%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0ff0 con 0x55d728e8b1d0 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 .bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v34'4 uv4 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f68f2728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 info.flags=0x17 2024-09-22T08:12:03.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f68f2728800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 to cache LRU end 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f68f2728800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f68f2728800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9, ofs0, ns] 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify cookie 94382592981984 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728edfd70 con 0x55d728e8b1d0 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify (1) cookie 94382592728576 notify 146028888089 ret 0) ==== 798+0+0 (crc 0 0 0) 0x55d728ed7980 con 0x55d728e8b1d0 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f67d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94382592728576 notifier 4731 bl.length()=756 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f67d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 info.flags=0x17 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f67d17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 to cache LRU end 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f67d17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(69 notify.1 [notify cookie 94382592981984 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.307+0000 7f67d17fa640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6724003530 con 0x55d728e8b1d0 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.308+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(70 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.308+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== watch-notify(notify_complete (2) cookie 94382592981984 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d728ed6d50 con 0x55d728e8b1d0 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.308+0000 7f68f2728800 20 handle_bi_update(): bucket=:myfoo6[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9]): orig_sources= new_sources= 2024-09-22T08:12:03.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.308+0000 7f68f2728800 20 handle_bi_update(): bucket=:myfoo6[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9]): potential sources added=[] removed=[] 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.308+0000 7f68f2728800 20 handle_bi_update(): bucket=:myfoo6[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9]): orig_dests= new_dests= 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.308+0000 7f68f2728800 20 handle_bi_update(): bucket=:myfoo6[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9]): potential dests added=[] removed=[] 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.308+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed7be0 con 0x55d728e8b1d0 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.309+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(71 bud.buckets [call] v34'5 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.309+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728edf8c0 con 0x55d728e8b1d0 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.310+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(72 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.310+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed7be0 con 0x55d728e8b1d0 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68f2728800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68f2728800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68f2728800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94382592981984 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728eda5f0 con 0x55d728e8fbe0 2024-09-22T08:12:03.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== watch-notify(notify (1) cookie 94382592735136 notify 146028888079 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55d728e7fd90 con 0x55d728e8fbe0 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f67d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94382592735136 notifier 4731 bl.length()=316 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f67d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f67d1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f67d1ffb640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f67b4003ea0 con 0x55d728e8fbe0 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(74 notify.3 [notify cookie 94382592981984 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== watch-notify(notify_complete (2) cookie 94382592981984 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d728e78c30 con 0x55d728e8fbe0 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68f2728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 : hit (requested=0x17, cached=0x17) 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68f2728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.311+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 8.19 8:9879c807:root::.bucket.meta.myfoo6%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed8600 con 0x55d728e8b1d0 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(76 .bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v34'7 uv7 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68f2728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 info.flags=0x17 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68f2728800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 to cache LRU end 2024-09-22T08:12:03.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68f2728800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68f2728800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9, ofs0, ns] 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94382593018064 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed80c0 con 0x55d728e8b1d0 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== watch-notify(notify (1) cookie 94382592728576 notify 146028888090 ret 0) ==== 798+0+0 (crc 0 0 0) 0x55d728eda3f0 con 0x55d728e8b1d0 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f67d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94382592728576 notifier 4731 bl.length()=756 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f67d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 info.flags=0x17 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f67d17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 to cache LRU end 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f67d17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(77 notify.1 [notify cookie 94382593018064 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f67d17fa640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6724003510 con 0x55d728e8b1d0 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 35 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 36 ==== watch-notify(notify_complete (2) cookie 94382593018064 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d728ede430 con 0x55d728e8b1d0 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68f2728800 20 handle_bi_update(): bucket=:myfoo6[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9]): orig_sources= new_sources= 2024-09-22T08:12:03.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68f2728800 20 handle_bi_update(): bucket=:myfoo6[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9]): potential sources added=[] removed=[] 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68f2728800 20 handle_bi_update(): bucket=:myfoo6[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9]): orig_dests= new_dests= 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68f2728800 20 handle_bi_update(): bucket=:myfoo6[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9]): potential dests added=[] removed=[] 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.313+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:79 4.3f 4:feee772d:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0910 con 0x55d728e8fbe0 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.314+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(79 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.314+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:80 4.8 4:124ef282:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0910 con 0x55d728e94590 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.314+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(80 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.314+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:81 4.30 4:0fc75699:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0910 con 0x55d728e94590 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.314+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(81 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.314+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:82 4.2b 4:d5c3c293:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0910 con 0x55d728e8b1d0 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.315+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 37 ==== osd_op_reply(82 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.315+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:83 4.6 4:63c88326:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0910 con 0x55d728e94590 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.315+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(83 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.315+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:84 4.3c 4:3f98d39b:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0910 con 0x55d728e8b1d0 2024-09-22T08:12:03.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.315+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 38 ==== osd_op_reply(84 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.315+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:85 4.4 4:22deaf00:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0910 con 0x7f68e8035020 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.316+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(85 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.6 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.316+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:86 4.1 4:815e77c2:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0910 con 0x55d728e8fbe0 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.316+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(86 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.7 [call out=89b] v0'0 uv12 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.316+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 4.5 4:a3efa100:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0930 con 0x55d728e94590 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.317+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(87 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.317+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 4.1c 4:3ac61c6a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0930 con 0x7f68e8035020 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.317+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(88 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 [call out=382b] v0'0 uv9 ondisk = 0) ==== 194+0+382 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.317+0000 7f68f2728800 10 cls_bucket_list_unordered: got thirteen 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.317+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:89 4.1e 4:78e3914f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0930 con 0x7f68e8035020 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.317+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(89 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.317+0000 7f68f2728800 20 get_obj_state: octx=0x55d728ed7900 obj=myfoo6:thirteen state=0x55d728edfaa8 s->prefetch_data=0 2024-09-22T08:12:03.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.317+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:90 3.34s0 3:2cbb8514:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9_thirteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee0930 con 0x55d728e8b1d0 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 39 ==== osd_op_reply(90 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9_thirteen [call out=24b,getxattrs out=865b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 280+0+905 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 10 manifest: total_size = 8 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 get_obj_state: setting s->obj_tag to cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.13462434116869647224 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 get_obj_state: octx=0x55d728ed7900 obj=myfoo6:thirteen state=0x55d728edfaa8 s->prefetch_data=0 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 : hit (requested=0x17, cached=0x17) 2024-09-22T08:12:03.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 20 bucket index object: :.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.318+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:91 4.1c 4:3ac61c6a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee4740 con 0x7f68e8035020 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.319+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(91 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.319+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:92 3.34s0 3:2cbb8514:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee4740 con 0x55d728e8b1d0 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.320+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 40 ==== osd_op_reply(92 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v34'6 uv6 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.320+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:93 4.1c 4:3ac61c6a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ee3b60 con 0x7f68e8035020 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:1 objects processed in :myfoo6[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9]). Next marker thirteen 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.320+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x7f68d808f000 con 0x55d728e8fbe0 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(93 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 [stat,call,call] v34'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f67d17fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68f2728800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68f2728800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:12:03.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68f2728800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94382592989520 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728edf8c0 con 0x7f68e8035020 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== watch-notify(notify (1) cookie 94382592739968 notify 146028888098 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55d728ede430 con 0x7f68e8035020 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f67d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94382592739968 notifier 4731 bl.length()=556 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f67d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f67d1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(95 notify.5 [notify cookie 94382592989520 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f67d1ffb640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f67b4003ea0 con 0x7f68e8035020 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== watch-notify(notify_complete (2) cookie 94382592989520 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d728ed6d50 con 0x7f68e8035020 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.322+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed82d0 con 0x55d728e8b1d0 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 41 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68f2728800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68f2728800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:12:03.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68f2728800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94382592989520 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728edf8c0 con 0x7f68e8035020 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== watch-notify(notify (1) cookie 94382592739968 notify 146028888099 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55d728ed6d50 con 0x7f68e8035020 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f67d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94382592739968 notifier 4731 bl.length()=177 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f67d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(98 notify.5 [notify cookie 94382592989520 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f67d17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f67d17fa640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6724003510 con 0x7f68e8035020 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== watch-notify(notify_complete (2) cookie 94382592989520 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f68d805f9d0 con 0x7f68e8035020 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68f2728800 10 removing user index: bar 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.324+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed82d0 con 0x7f68e8035020 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.325+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(100 bar [delete] v34'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.325+0000 7f68f2728800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-22T08:12:03.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.325+0000 7f68f2728800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-22T08:12:03.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.325+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94382592989520 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d728edf8c0 con 0x7f68e8035020 2024-09-22T08:12:03.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.326+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 35 ==== watch-notify(notify (1) cookie 94382592745456 notify 146028888100 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f68d805f9d0 con 0x7f68e8035020 2024-09-22T08:12:03.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.326+0000 7f67d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 94382592745456 notifier 4731 bl.length()=152 2024-09-22T08:12:03.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.326+0000 7f67d17fa640 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6724003510 con 0x7f68e8035020 2024-09-22T08:12:03.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.326+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 36 ==== osd_op_reply(101 notify.7 [notify cookie 94382592989520 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.326+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 37 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.326+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 38 ==== watch-notify(notify_complete (2) cookie 94382592989520 notify 146028888100 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f68d8089df0 con 0x7f68e8035020 2024-09-22T08:12:03.339 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-22T08:12:03.157457Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:03.157445Z","tags":[],"group_ids":[]} 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.327+0000 7f67a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.327+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94382592747856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed2da0 con 0x55d728e8b1d0 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.328+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 42 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94382592747856] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.328+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94382592724288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed2da0 con 0x55d728e8fbe0 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.329+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94382592724288] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.329+0000 7f68f2728800 20 remove_watcher() i=0 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.329+0000 7f68f2728800 2 removed watcher, disabling cache 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.329+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94382592728576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed2da0 con 0x55d728e8b1d0 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.330+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 43 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94382592728576] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.330+0000 7f68f2728800 20 remove_watcher() i=1 2024-09-22T08:12:03.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.330+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94382592721808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed2da0 con 0x55d728e94590 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.331+0000 7f68ee44b640 1 -- 172.21.15.165:0/1331914372 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94382592721808] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e001b070 con 0x55d728e94590 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.331+0000 7f68f2728800 20 remove_watcher() i=2 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.331+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94382592735136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed2da0 con 0x55d728e8fbe0 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.332+0000 7f68eec4c640 1 -- 172.21.15.165:0/1331914372 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94382592735136] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68e8029070 con 0x55d728e8fbe0 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.332+0000 7f68f2728800 20 remove_watcher() i=3 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.332+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94382592738912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed2da0 con 0x55d728e8b1d0 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.333+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.1 v2:172.21.15.165:6816/2347568643 44 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94382592738912] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x55d728e8b1d0 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.333+0000 7f68f2728800 20 remove_watcher() i=4 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.333+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94382592739968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed2da0 con 0x7f68e8035020 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.334+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 39 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94382592739968] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.334+0000 7f68f2728800 20 remove_watcher() i=5 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.334+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94382592742688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed2da0 con 0x7f68e8035020 2024-09-22T08:12:03.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.335+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 40 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94382592742688] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.335+0000 7f68f2728800 20 remove_watcher() i=6 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.335+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94382592745456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d728ed2da0 con 0x7f68e8035020 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 <== osd.0 v2:172.21.15.53:6800/2902972477 41 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94382592745456] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d8051070 con 0x7f68e8035020 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 20 remove_watcher() i=7 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f68e8035020 msgr2=0x7f68e8057a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f68e8035020 0x7f68e8057a70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728e8b1d0 msgr2=0x55d728e8d690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728e8b1d0 0x55d728e8d690 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e8fbe0 msgr2=0x55d728e91fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e8fbe0 0x55d728e91fd0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d728e94590 msgr2=0x55d728e96a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d728e94590 0x55d728e96a50 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67b803d000 msgr2=0x7f67b803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67b803d000 0x7f67b803f4c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f68e00035e0 tx=0x7f68e0036000 comp rx=0 tx=0).stop 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 msgr2=0x55d728e7f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68edc4a640 1 -- 172.21.15.165:0/1331914372 reap_dead start 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e7f830 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f68e8029a70 tx=0x7f68e8055b70 comp rx=0 tx=0).stop 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 shutdown_connections 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 --2- 172.21.15.165:0/1331914372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e78260 0x55d728e7f830 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 >> 172.21.15.165:0/1331914372 conn(0x55d728e74660 msgr2=0x55d728e72870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 shutdown_connections 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/1331914372 wait complete. 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/4097022551 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67c803cfb0 msgr2=0x7f67c803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 --2- 172.21.15.165:0/4097022551 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67c803cfb0 0x7f67c803f470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55d728e53960 tx=0x7f68e0052a80 comp rx=0 tx=0).stop 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 -- 172.21.15.165:0/4097022551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e6c890 msgr2=0x55d728e6ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.336+0000 7f68f2728800 1 --2- 172.21.15.165:0/4097022551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e6c890 0x55d728e6ccb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x55d728e537a0 tx=0x7f68e800af40 comp rx=0 tx=0).stop 2024-09-22T08:12:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/4097022551 shutdown_connections 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 --2- 172.21.15.165:0/4097022551 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67c803cfb0 0x7f67c803f470 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 --2- 172.21.15.165:0/4097022551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728e6c890 0x55d728e6ccb0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/4097022551 >> 172.21.15.165:0/4097022551 conn(0x55d728e60c40 msgr2=0x55d728e61020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/4097022551 shutdown_connections 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/4097022551 wait complete. 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728d5bbf0 msgr2=0x55d728e58ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728d5bbf0 0x55d728e58ec0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e5b2a0 msgr2=0x55d728e5d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e5b2a0 0x55d728e5d720 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67d403d000 msgr2=0x7f67d403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67d403d000 0x7f67d403f4c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f68d8057000 tx=0x7f68d8052000 comp rx=0 tx=0).stop 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 msgr2=0x55d728e51870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e51870 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f68e0001330 tx=0x7f68e0001250 comp rx=0 tx=0).stop 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 shutdown_connections 2024-09-22T08:12:03.348 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d728e5b2a0 0x55d728e5d720 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d728d5bbf0 0x55d728e58ec0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f67d403d000 0x7f67d403f4c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 --2- 172.21.15.165:0/3903949864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d728d5a7e0 0x55d728e51870 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:03.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 >> 172.21.15.165:0/3903949864 conn(0x55d728d55bb0 msgr2=0x55d728e4b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:03.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 shutdown_connections 2024-09-22T08:12:03.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:03.337+0000 7f68f2728800 1 -- 172.21.15.165:0/3903949864 wait complete. 2024-09-22T08:12:03.350 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-22T08:12:03.157457Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:03.157445Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:08.358 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:12:08.359 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-22T08:12:08.359 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-22T08:12:08.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-22T08:12:08.359 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-22T08:12:08.419 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:08.419 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:08.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.419+0000 7f588fb31800 1 Processor -- start 2024-09-22T08:12:08.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.419+0000 7f588fb31800 1 -- start start 2024-09-22T08:12:08.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.419+0000 7f588fb31800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d85c24ac30 0x55d85c2505c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.419+0000 7f588fb31800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d85c0d5a20 con 0x55d85c249820 2024-09-22T08:12:08.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.419+0000 7f588fb31800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d85c0d57d0 con 0x55d85c24ac30 2024-09-22T08:12:08.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.420+0000 7f5882f98640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d85c24ac30 0x55d85c2505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.420+0000 7f5882f98640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d85c24ac30 0x55d85c2505c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56560/0 (socket says 172.21.15.165:56560) 2024-09-22T08:12:08.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.420+0000 7f5882f98640 1 -- 172.21.15.165:0/3906746661 learned_addr learned my addr 172.21.15.165:0/3906746661 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.420+0000 7f5882f98640 1 -- 172.21.15.165:0/3906746661 >> v1:172.21.15.53:6789/0 conn(0x55d85c249820 legacy=0x55d85c24a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.420+0000 7f5882f98640 1 -- 172.21.15.165:0/3906746661 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85c249f20 con 0x55d85c24ac30 2024-09-22T08:12:08.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f5882f98640 1 --2- 172.21.15.165:0/3906746661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c24ac30 0x55d85c2505c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f587400a6b0 tx=0x7f5874047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0b9bb3420b4d90 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f588af98640 1 -- 172.21.15.165:0/3906746661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587400a200 con 0x55d85c24ac30 2024-09-22T08:12:08.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f588af98640 1 -- 172.21.15.165:0/3906746661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587400a3a0 con 0x55d85c24ac30 2024-09-22T08:12:08.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f588af98640 1 -- 172.21.15.165:0/3906746661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5874008700 con 0x55d85c24ac30 2024-09-22T08:12:08.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f588fb31800 1 -- 172.21.15.165:0/3906746661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c24ac30 msgr2=0x55d85c2505c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f588fb31800 1 --2- 172.21.15.165:0/3906746661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c24ac30 0x55d85c2505c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f587400a6b0 tx=0x7f5874047e30 comp rx=0 tx=0).stop 2024-09-22T08:12:08.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f588fb31800 1 -- 172.21.15.165:0/3906746661 shutdown_connections 2024-09-22T08:12:08.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f588fb31800 1 --2- 172.21.15.165:0/3906746661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c24ac30 0x55d85c2505c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f588fb31800 1 -- 172.21.15.165:0/3906746661 >> 172.21.15.165:0/3906746661 conn(0x55d85c244bf0 msgr2=0x55d85c247050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f588fb31800 1 -- 172.21.15.165:0/3906746661 shutdown_connections 2024-09-22T08:12:08.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.422+0000 7f588fb31800 1 -- 172.21.15.165:0/3906746661 wait complete. 2024-09-22T08:12:08.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.438+0000 7f588fb31800 1 Processor -- start 2024-09-22T08:12:08.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.438+0000 7f588fb31800 1 -- start start 2024-09-22T08:12:08.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.438+0000 7f588fb31800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c337e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.438+0000 7f588fb31800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d85c0e2dd0 con 0x55d85c249820 2024-09-22T08:12:08.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.438+0000 7f588b799640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c337e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.438+0000 7f588b799640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c337e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56566/0 (socket says 172.21.15.165:56566) 2024-09-22T08:12:08.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.438+0000 7f588b799640 1 -- 172.21.15.165:0/445853497 learned_addr learned my addr 172.21.15.165:0/445853497 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.439+0000 7f588b799640 1 -- 172.21.15.165:0/445853497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85c338480 con 0x55d85c249820 2024-09-22T08:12:08.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.439+0000 7f588b799640 1 --2- 172.21.15.165:0/445853497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c337e90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f587c001d40 tx=0x7f587c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc872530e72db60 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.439+0000 7f577960a640 1 -- 172.21.15.165:0/445853497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587c00f400 con 0x55d85c249820 2024-09-22T08:12:08.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.439+0000 7f577960a640 1 -- 172.21.15.165:0/445853497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587c00f5a0 con 0x55d85c249820 2024-09-22T08:12:08.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.439+0000 7f577960a640 1 -- 172.21.15.165:0/445853497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587c00f900 con 0x55d85c249820 2024-09-22T08:12:08.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.440+0000 7f588fb31800 1 -- 172.21.15.165:0/445853497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 msgr2=0x55d85c337e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.440+0000 7f588fb31800 1 --2- 172.21.15.165:0/445853497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c337e90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f587c001d40 tx=0x7f587c00b5b0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.440+0000 7f588fb31800 1 -- 172.21.15.165:0/445853497 shutdown_connections 2024-09-22T08:12:08.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.440+0000 7f588fb31800 1 --2- 172.21.15.165:0/445853497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c337e90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.440+0000 7f588fb31800 1 -- 172.21.15.165:0/445853497 >> 172.21.15.165:0/445853497 conn(0x55d85c244bf0 msgr2=0x55d85c333810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.440+0000 7f588fb31800 1 -- 172.21.15.165:0/445853497 shutdown_connections 2024-09-22T08:12:08.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.440+0000 7f588fb31800 1 -- 172.21.15.165:0/445853497 wait complete. 2024-09-22T08:12:08.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.440+0000 7f588fb31800 1 Processor -- start 2024-09-22T08:12:08.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.440+0000 7f588fb31800 1 -- start start 2024-09-22T08:12:08.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.441+0000 7f588fb31800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c33f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.441+0000 7f588fb31800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d85c1bd040 con 0x55d85c249820 2024-09-22T08:12:08.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.441+0000 7f588b799640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c33f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.441+0000 7f588b799640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c33f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56582/0 (socket says 172.21.15.165:56582) 2024-09-22T08:12:08.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.441+0000 7f588b799640 1 -- 172.21.15.165:0/3594872113 learned_addr learned my addr 172.21.15.165:0/3594872113 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.441+0000 7f588b799640 1 -- 172.21.15.165:0/3594872113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85c33ff10 con 0x55d85c249820 2024-09-22T08:12:08.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.442+0000 7f588b799640 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c33f9b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x55d85c338e20 tx=0x7f587c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.442+0000 7f5777e07640 1 -- 172.21.15.165:0/3594872113 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587c01a7c0 con 0x55d85c249820 2024-09-22T08:12:08.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.442+0000 7f5777e07640 1 -- 172.21.15.165:0/3594872113 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587c01a980 con 0x55d85c249820 2024-09-22T08:12:08.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.442+0000 7f5777e07640 1 -- 172.21.15.165:0/3594872113 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587c01aca0 con 0x55d85c249820 2024-09-22T08:12:08.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.442+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d85c3401a0 con 0x55d85c249820 2024-09-22T08:12:08.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.442+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d85c340db0 con 0x55d85c249820 2024-09-22T08:12:08.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.443+0000 7f5777e07640 1 -- 172.21.15.165:0/3594872113 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f587c017070 con 0x55d85c249820 2024-09-22T08:12:08.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.443+0000 7f5777e07640 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f577003cfb0 0x7f577003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.443+0000 7f5777e07640 1 -- 172.21.15.165:0/3594872113 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f587c015020 con 0x55d85c249820 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.443+0000 7f5882f98640 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f577003cfb0 0x7f577003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.443+0000 7f588fb31800 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c24ac30 0x55d85c347000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.443+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c347540 con 0x55d85c24ac30 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.443+0000 7f588bf9a640 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c24ac30 0x55d85c347000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.443+0000 7f5882f98640 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f577003cfb0 0x7f577003f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5874058000 tx=0x7f5874053000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.444+0000 7f588bf9a640 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c24ac30 0x55d85c347000 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.444+0000 7f588bf9a640 1 -- 172.21.15.165:0/3594872113 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f588400a4d0 con 0x55d85c24ac30 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.444+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3478e0 con 0x55d85c24ac30 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.444+0000 7f588bf9a640 1 -- 172.21.15.165:0/3594872113 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f588400a4d0 con 0x55d85c24ac30 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.444+0000 7f588fb31800 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c3493e0 0x55d85c34b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.444+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c34c010 con 0x55d85c3493e0 2024-09-22T08:12:08.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.444+0000 7f588b799640 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c3493e0 0x55d85c34b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.445+0000 7f588b799640 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c3493e0 0x55d85c34b880 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.445+0000 7f588b799640 1 -- 172.21.15.165:0/3594872113 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c3493e0 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.445+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c348130 con 0x55d85c24ac30 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.445+0000 7f588bf9a640 1 -- 172.21.15.165:0/3594872113 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f588400a4d0 con 0x55d85c24ac30 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.445+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c348590 con 0x55d85c24ac30 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.446+0000 7f588bf9a640 1 -- 172.21.15.165:0/3594872113 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f588400a4d0 con 0x55d85c24ac30 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.446+0000 7f588fb31800 1 Processor -- start 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.446+0000 7f588fb31800 1 -- start start 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.446+0000 7f588fb31800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c35ee30 0x55d85c35f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.446+0000 7f588fb31800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d85c141d50 con 0x55d85c35ee30 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.446+0000 7f588bf9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c35ee30 0x55d85c35f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.447+0000 7f588bf9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c35ee30 0x55d85c35f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56586/0 (socket says 172.21.15.165:56586) 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.447+0000 7f588bf9a640 1 -- 172.21.15.165:0/3992655425 learned_addr learned my addr 172.21.15.165:0/3992655425 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.447+0000 7f588bf9a640 1 -- 172.21.15.165:0/3992655425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85c35f890 con 0x55d85c35ee30 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.447+0000 7f588bf9a640 1 --2- 172.21.15.165:0/3992655425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c35ee30 0x55d85c35f250 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55d85c3409b0 tx=0x7f5884018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.447+0000 7f5775602640 1 -- 172.21.15.165:0/3992655425 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5884014450 con 0x55d85c35ee30 2024-09-22T08:12:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.447+0000 7f5775602640 1 -- 172.21.15.165:0/3992655425 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884014610 con 0x55d85c35ee30 2024-09-22T08:12:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.447+0000 7f5775602640 1 -- 172.21.15.165:0/3992655425 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5884014930 con 0x55d85c35ee30 2024-09-22T08:12:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.447+0000 7f588fb31800 1 -- 172.21.15.165:0/3992655425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d85c3600c0 con 0x55d85c35ee30 2024-09-22T08:12:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.447+0000 7f588fb31800 1 -- 172.21.15.165:0/3992655425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d85c360660 con 0x55d85c35ee30 2024-09-22T08:12:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.448+0000 7f5775602640 1 -- 172.21.15.165:0/3992655425 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5884011040 con 0x55d85c35ee30 2024-09-22T08:12:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.448+0000 7f5775602640 1 --2- 172.21.15.165:0/3992655425 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f576403d000 0x7f576403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.448+0000 7f5775602640 1 -- 172.21.15.165:0/3992655425 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f588401e070 con 0x55d85c35ee30 2024-09-22T08:12:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.449+0000 7f588b799640 1 --2- 172.21.15.165:0/3992655425 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f576403d000 0x7f576403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.449+0000 7f588fb31800 1 Processor -- start 2024-09-22T08:12:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.449+0000 7f588fb31800 1 -- start start 2024-09-22T08:12:08.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.449+0000 7f588b799640 1 --2- 172.21.15.165:0/3992655425 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f576403d000 0x7f576403f4c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55d85c341ab0 tx=0x7f587c00ff10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.449+0000 7f588fb31800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c36bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.449+0000 7f588fb31800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d85c3388b0 con 0x55d85c36b890 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.449+0000 7f588bf9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c36bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.449+0000 7f588bf9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c36bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56594/0 (socket says 172.21.15.165:56594) 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.449+0000 7f588bf9a640 1 -- 172.21.15.165:0/1141677618 learned_addr learned my addr 172.21.15.165:0/1141677618 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f588bf9a640 1 -- 172.21.15.165:0/1141677618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85c36c280 con 0x55d85c36b890 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f588bf9a640 1 --2- 172.21.15.165:0/1141677618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c36bc90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5884018430 tx=0x7f5884014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6faacae4ad33d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f576effd640 1 -- 172.21.15.165:0/1141677618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f588404b070 con 0x55d85c36b890 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f576effd640 1 -- 172.21.15.165:0/1141677618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884051070 con 0x55d85c36b890 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f576effd640 1 -- 172.21.15.165:0/1141677618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5884011da0 con 0x55d85c36b890 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f588fb31800 1 -- 172.21.15.165:0/1141677618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 msgr2=0x55d85c36bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f588fb31800 1 --2- 172.21.15.165:0/1141677618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c36bc90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5884018430 tx=0x7f5884014ea0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f588fb31800 1 -- 172.21.15.165:0/1141677618 shutdown_connections 2024-09-22T08:12:08.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f588fb31800 1 --2- 172.21.15.165:0/1141677618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c36bc90 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f588fb31800 1 -- 172.21.15.165:0/1141677618 >> 172.21.15.165:0/1141677618 conn(0x55d85c367c90 msgr2=0x55d85c365ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f588fb31800 1 -- 172.21.15.165:0/1141677618 shutdown_connections 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.450+0000 7f588fb31800 1 -- 172.21.15.165:0/1141677618 wait complete. 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.451+0000 7f588fb31800 1 Processor -- start 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.451+0000 7f588fb31800 1 -- start start 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.451+0000 7f588fb31800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c372ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.451+0000 7f588fb31800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d85c36c8a0 con 0x55d85c36b890 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.451+0000 7f588bf9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c372ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.451+0000 7f588bf9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c372ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56600/0 (socket says 172.21.15.165:56600) 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.451+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 learned_addr learned my addr 172.21.15.165:0/2437442596 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.451+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85c373440 con 0x55d85c36b890 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.452+0000 7f588bf9a640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c372ee0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5884018430 tx=0x7f58840546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.452+0000 7f576d7fa640 1 -- 172.21.15.165:0/2437442596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f588404b040 con 0x55d85c36b890 2024-09-22T08:12:08.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.452+0000 7f576d7fa640 1 -- 172.21.15.165:0/2437442596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884011330 con 0x55d85c36b890 2024-09-22T08:12:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.452+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d85c3736d0 con 0x55d85c36b890 2024-09-22T08:12:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.452+0000 7f576d7fa640 1 -- 172.21.15.165:0/2437442596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5884054ae0 con 0x55d85c36b890 2024-09-22T08:12:08.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.452+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d85c374050 con 0x55d85c36b890 2024-09-22T08:12:08.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.453+0000 7f576d7fa640 1 -- 172.21.15.165:0/2437442596 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5884054c80 con 0x55d85c36b890 2024-09-22T08:12:08.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.453+0000 7f576d7fa640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f575403cfb0 0x7f575403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.453+0000 7f576d7fa640 1 -- 172.21.15.165:0/2437442596 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f588400e040 con 0x55d85c36b890 2024-09-22T08:12:08.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.453+0000 7f588b799640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f575403cfb0 0x7f575403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.453+0000 7f588b799640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f575403cfb0 0x7f575403f470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f587c00ea80 tx=0x7f587c04d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.453+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.453+0000 7f588fb31800 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c37e940 0x55d85c380e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c381550 con 0x55d85c37e940 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f5882f98640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c37e940 0x55d85c380e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f5882f98640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c37e940 0x55d85c380e00 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5874008600 con 0x55d85c37e940 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f588fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f588fb31800 20 realm 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c381980 con 0x55d85c37e940 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f588fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f588fb31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:08.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.454+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c382250 con 0x55d85c37e940 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f588fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3825f0 con 0x55d85c37e940 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f588fb31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f588fb31800 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c383350 0x55d85c385740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c385d50 con 0x55d85c383350 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f588bf9a640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c383350 0x55d85c385740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.455+0000 7f588bf9a640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c383350 0x55d85c385740 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.456+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f588402a070 con 0x55d85c383350 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.456+0000 7f588fb31800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.456+0000 7f588fb31800 20 searching for the correct realm 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.456+0000 7f588fb31800 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d85c387d20 0x55d85c38a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.456+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c387d20 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.456+0000 7f588b799640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d85c387d20 0x55d85c38a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.456+0000 7f588b799640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d85c387d20 0x55d85c38a1e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.456+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.456+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c383350 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.457+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f588402a070 con 0x55d85c383350 2024-09-22T08:12:08.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.457+0000 7f588bf9a640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5884037070 0x7f5884015800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.457+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x7f5884037070 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.457+0000 7f5882f98640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5884037070 0x7f5884015800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.457+0000 7f5882f98640 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5884037070 0x7f5884015800 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.458+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x7f5884037070 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.458+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c37e940 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.458+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.458+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c37e940 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.458+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.458+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x7f5884037070 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.459+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x7f5884037070 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.459+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c383350 2024-09-22T08:12:08.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.459+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588402a070 con 0x55d85c383350 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.459+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c383350 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.459+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.459+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c387d20 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.459+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.460+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c37e940 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.460+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.460+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x7f5884037070 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.460+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x7f5884037070 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.460+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c37e940 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.460+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.460+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c383350 2024-09-22T08:12:08.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.461+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.461+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c387d20 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.461+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.461+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c387d20 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.461+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.461+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x7f5884037070 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.461+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x7f5884037070 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.461+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c387d20 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.462+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.462+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c387d20 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.462+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.462+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c37e940 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.462+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.462+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c37e940 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.462+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.462+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x7f5884037070 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.463+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x7f5884037070 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.463+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c387d20 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.463+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.463+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c383350 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.463+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.463+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c37e940 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.464+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.464+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x7f5884037070 2024-09-22T08:12:08.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.464+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x7f5884037070 2024-09-22T08:12:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.464+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c387d20 2024-09-22T08:12:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.464+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.464+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x7f5884037070 2024-09-22T08:12:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.465+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x7f5884037070 2024-09-22T08:12:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.465+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c383350 2024-09-22T08:12:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.465+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.465+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c387d20 2024-09-22T08:12:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.465+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.465+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x7f5884037070 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.465+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58740088f0 con 0x7f5884037070 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.465+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c37e940 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38a860 con 0x55d85c383350 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:08.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c386710 con 0x55d85c37e940 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c386350 con 0x55d85c37e940 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58740088f0 con 0x55d85c37e940 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.466+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c387130 con 0x55d85c37e940 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f58740801c0 con 0x55d85c37e940 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 20 zone default found 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 4 Realm: () 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 20 zonegroup default 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38b190 con 0x7f5884037070 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38ce60 con 0x55d85c387d20 2024-09-22T08:12:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.467+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38d370 con 0x55d85c387d20 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.468+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.468+0000 7f588fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.468+0000 7f588fb31800 20 started sync module instance, tier type = 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.468+0000 7f588fb31800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.468+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38bc30 con 0x55d85c383350 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.469+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.469+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94387748519968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38b890 con 0x55d85c383350 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.469+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38e2a0 con 0x55d85c37e940 2024-09-22T08:12:08.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.470+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94387748519968] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.470+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x55d85c37e940 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.470+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94387748526032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38e2a0 con 0x55d85c37e940 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.470+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38eca0 con 0x55d85c387d20 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.471+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94387748526032] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x55d85c37e940 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.472+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.472+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94387748527600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38e210 con 0x55d85c387d20 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.472+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38fb60 con 0x55d85c383350 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.473+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.473+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94387748534416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c390300 con 0x55d85c383350 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.473+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c390df0 con 0x55d85c37e940 2024-09-22T08:12:08.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.473+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94387748527600] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.474+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94387748534416] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.474+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x55d85c37e940 2024-09-22T08:12:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.474+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94387748538560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c38fd50 con 0x55d85c37e940 2024-09-22T08:12:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.474+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3913d0 con 0x7f5884037070 2024-09-22T08:12:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.475+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94387748538560] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x55d85c37e940 2024-09-22T08:12:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.475+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.475+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94387748532368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3913d0 con 0x7f5884037070 2024-09-22T08:12:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.475+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c391d90 con 0x7f5884037070 2024-09-22T08:12:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.476+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.477+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94387748542688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3921b0 con 0x7f5884037070 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.477+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c392be0 con 0x7f5884037070 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.477+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94387748532368] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.478+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94387748542688] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.478+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.478+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94387748546288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c391d00 con 0x7f5884037070 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.478+0000 7f588fb31800 20 add_watcher() i=0 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.478+0000 7f588fb31800 20 add_watcher() i=1 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.478+0000 7f588fb31800 20 add_watcher() i=2 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.478+0000 7f588fb31800 20 add_watcher() i=3 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.478+0000 7f588fb31800 20 add_watcher() i=4 2024-09-22T08:12:08.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.478+0000 7f588fb31800 20 add_watcher() i=5 2024-09-22T08:12:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.478+0000 7f588fb31800 20 add_watcher() i=6 2024-09-22T08:12:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.479+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94387748546288] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.479+0000 7f588fb31800 20 add_watcher() i=7 2024-09-22T08:12:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.479+0000 7f588fb31800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.479+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c391d00 con 0x55d85c37e940 2024-09-22T08:12:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.479+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f58740801c0 con 0x55d85c37e940 2024-09-22T08:12:08.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.479+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94387748540192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c393460 con 0x55d85c37e940 2024-09-22T08:12:08.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.480+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94387748540192] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x55d85c37e940 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f57427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f588fb31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f588fb31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f588fb31800 5 note: GC not initialized 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f57417e2640 20 reqs_thread_entry: start 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f588fb31800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f588fb31800 20 Filter name: none 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f573a7fc640 20 reqs_thread_entry: start 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f588fb31800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.481+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c8fe0 con 0x7f5884037070 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c7520 con 0x7f5884037070 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-22T08:12:08.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.482+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c7df0 con 0x7f5884037070 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.483+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.483+0000 7f588fb31800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.483+0000 7f588fb31800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.483+0000 7f588fb31800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.483+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94387748763968 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3cca80 con 0x7f5884037070 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.484+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== watch-notify(notify (1) cookie 94387748532368 notify 146028888101 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55d85c3c8190 con 0x7f5884037070 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.484+0000 7f576effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94387748532368 notifier 4738 bl.length()=556 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.484+0000 7f576effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-22T08:12:08.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.484+0000 7f576effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.484+0000 7f576effd640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5750003ea0 con 0x7f5884037070 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.484+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(65 notify.5 [notify cookie 94387748763968 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.484+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.484+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== watch-notify(notify_complete (2) cookie 94387748763968 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d85c3c8930 con 0x7f5884037070 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.484+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c78f0 con 0x7f5884037070 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f588fb31800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f588fb31800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f588fb31800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94387748779456 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c78f0 con 0x55d85c387d20 2024-09-22T08:12:08.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== watch-notify(notify (1) cookie 94387748527600 notify 146028888070 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f587c037040 con 0x55d85c387d20 2024-09-22T08:12:08.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f576e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 94387748527600 notifier 4738 bl.length()=177 2024-09-22T08:12:08.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f576e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-22T08:12:08.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f576e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-22T08:12:08.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f576e7fc640 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f56b4003400 con 0x55d85c387d20 2024-09-22T08:12:08.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(68 notify.2 [notify cookie 94387748779456 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.486+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== watch-notify(notify_complete (2) cookie 94387748779456 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d85c340db0 con 0x55d85c387d20 2024-09-22T08:12:08.497 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-22T08:12:08.483309Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:08.483294Z","tags":[],"group_ids":[]} 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.487+0000 7f57427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.487+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94387748540192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c6c90 con 0x55d85c37e940 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.488+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94387748540192] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x55d85c37e940 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.488+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94387748519968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c6c90 con 0x55d85c383350 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.489+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94387748519968] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.489+0000 7f588fb31800 20 remove_watcher() i=0 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.489+0000 7f588fb31800 2 removed watcher, disabling cache 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.489+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94387748526032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c6c90 con 0x55d85c37e940 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.490+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94387748526032] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x55d85c37e940 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.490+0000 7f588fb31800 20 remove_watcher() i=1 2024-09-22T08:12:08.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.490+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94387748527600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c6c90 con 0x55d85c387d20 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.491+0000 7f588b799640 1 -- 172.21.15.165:0/2437442596 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94387748527600] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587c02e070 con 0x55d85c387d20 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.491+0000 7f588fb31800 20 remove_watcher() i=2 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.491+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94387748534416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c6c90 con 0x55d85c383350 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.492+0000 7f588bf9a640 1 -- 172.21.15.165:0/2437442596 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94387748534416] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5884064040 con 0x55d85c383350 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.492+0000 7f588fb31800 20 remove_watcher() i=3 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.492+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94387748538560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c6c90 con 0x55d85c37e940 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.494+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94387748538560] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x55d85c37e940 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.494+0000 7f588fb31800 20 remove_watcher() i=4 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.494+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94387748532368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c6c90 con 0x7f5884037070 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.495+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94387748532368] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.496+0000 7f588fb31800 20 remove_watcher() i=5 2024-09-22T08:12:08.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.496+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94387748542688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c6c90 con 0x7f5884037070 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.497+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94387748542688] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.497+0000 7f588fb31800 20 remove_watcher() i=6 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.497+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94387748546288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d85c3c6c90 con 0x7f5884037070 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94387748546288] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58740801c0 con 0x7f5884037070 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 20 remove_watcher() i=7 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5884037070 msgr2=0x7f5884015800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5884037070 0x7f5884015800 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c37e940 msgr2=0x55d85c380e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c37e940 0x55d85c380e00 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c383350 msgr2=0x55d85c385740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c383350 0x55d85c385740 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d85c387d20 msgr2=0x55d85c38a1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d85c387d20 0x55d85c38a1e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f575403cfb0 msgr2=0x7f575403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f575403cfb0 0x7f575403f470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f587c00ea80 tx=0x7f587c04d000 comp rx=0 tx=0).stop 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 msgr2=0x55d85c372ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f5882f98640 1 -- 172.21.15.165:0/2437442596 reap_dead start 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c372ee0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5884018430 tx=0x7f58840546a0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 shutdown_connections 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 --2- 172.21.15.165:0/2437442596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c36b890 0x55d85c372ee0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 >> 172.21.15.165:0/2437442596 conn(0x55d85c367c90 msgr2=0x55d85c365ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 shutdown_connections 2024-09-22T08:12:08.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.498+0000 7f588fb31800 1 -- 172.21.15.165:0/2437442596 wait complete. 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3992655425 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f576403d000 msgr2=0x7f576403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3992655425 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f576403d000 0x7f576403f4c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55d85c341ab0 tx=0x7f587c00ff10 comp rx=0 tx=0).stop 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3992655425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c35ee30 msgr2=0x55d85c35f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3992655425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c35ee30 0x55d85c35f250 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55d85c3409b0 tx=0x7f5884018830 comp rx=0 tx=0).stop 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3992655425 shutdown_connections 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3992655425 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f576403d000 0x7f576403f4c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3992655425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c35ee30 0x55d85c35f250 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3992655425 >> 172.21.15.165:0/3992655425 conn(0x55d85c34edd0 msgr2=0x55d85c34f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3992655425 shutdown_connections 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3992655425 wait complete. 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c24ac30 msgr2=0x55d85c347000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c24ac30 0x55d85c347000 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c3493e0 msgr2=0x55d85c34b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c3493e0 0x55d85c34b880 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f577003cfb0 msgr2=0x7f577003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f577003cfb0 0x7f577003f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5874058000 tx=0x7f5874053000 comp rx=0 tx=0).stop 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 msgr2=0x55d85c33f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c33f9b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x55d85c338e20 tx=0x7f587c000bc0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 shutdown_connections 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d85c3493e0 0x55d85c34b880 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d85c24ac30 0x55d85c347000 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f577003cfb0 0x7f577003f470 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 --2- 172.21.15.165:0/3594872113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d85c249820 0x55d85c33f9b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 >> 172.21.15.165:0/3594872113 conn(0x55d85c244bf0 msgr2=0x55d85c339380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 shutdown_connections 2024-09-22T08:12:08.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.499+0000 7f588fb31800 1 -- 172.21.15.165:0/3594872113 wait complete. 2024-09-22T08:12:08.509 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-22T08:12:08.483309Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:08.483294Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:08.525 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:12:08.530 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-22T08:12:08.530 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-22T08:12:08.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-22T08:12:08.531 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-22T08:12:08.577 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:08.578 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:08.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.577+0000 7fd11ac2f800 1 Processor -- start 2024-09-22T08:12:08.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.577+0000 7fd11ac2f800 1 -- start start 2024-09-22T08:12:08.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.577+0000 7fd11ac2f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b0cd35a7e0 0x55b0cd35b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.577+0000 7fd11ac2f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b0cd1e6a20 con 0x55b0cd35ba20 2024-09-22T08:12:08.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.577+0000 7fd11ac2f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b0cd1e67d0 con 0x55b0cd35a7e0 2024-09-22T08:12:08.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.578+0000 7fd118719640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b0cd35a7e0 0x55b0cd35b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.578+0000 7fd118719640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b0cd35a7e0 0x55b0cd35b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56612/0 (socket says 172.21.15.165:56612) 2024-09-22T08:12:08.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.578+0000 7fd10ff18640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b0cd35ba20 0x55b0cd360570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49516/0 (socket says 172.21.15.165:49516) 2024-09-22T08:12:08.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.578+0000 7fd118719640 1 -- 172.21.15.165:0/3739730649 learned_addr learned my addr 172.21.15.165:0/3739730649 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.578+0000 7fd118719640 1 -- 172.21.15.165:0/3739730649 >> v1:172.21.15.53:6789/0 conn(0x55b0cd35ba20 legacy=0x55b0cd360570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.578+0000 7fd118719640 1 -- 172.21.15.165:0/3739730649 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0cd35aee0 con 0x55b0cd35a7e0 2024-09-22T08:12:08.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.580+0000 7fd118719640 1 --2- 172.21.15.165:0/3739730649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd35b4e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd10800a520 tx=0x7fd108045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dffc7984f2885b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.580+0000 7fd117f18640 1 -- 172.21.15.165:0/3739730649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd108055070 con 0x55b0cd35a7e0 2024-09-22T08:12:08.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.580+0000 7fd117f18640 1 -- 172.21.15.165:0/3739730649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1080515b0 con 0x55b0cd35a7e0 2024-09-22T08:12:08.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.580+0000 7fd117f18640 1 -- 172.21.15.165:0/3739730649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1080518d0 con 0x55b0cd35a7e0 2024-09-22T08:12:08.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.581+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3739730649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 msgr2=0x55b0cd35b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.581+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3739730649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd35b4e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd10800a520 tx=0x7fd108045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.581+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3739730649 shutdown_connections 2024-09-22T08:12:08.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.581+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3739730649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd35b4e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.581+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3739730649 >> 172.21.15.165:0/3739730649 conn(0x55b0cd355bb0 msgr2=0x55b0cd358010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.581+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3739730649 shutdown_connections 2024-09-22T08:12:08.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.581+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3739730649 wait complete. 2024-09-22T08:12:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.594+0000 7fd11ac2f800 1 Processor -- start 2024-09-22T08:12:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.595+0000 7fd11ac2f800 1 -- start start 2024-09-22T08:12:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.595+0000 7fd11ac2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd2ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.595+0000 7fd11ac2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b0cd1f3dd0 con 0x55b0cd35a7e0 2024-09-22T08:12:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.595+0000 7fd118719640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd2ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.595+0000 7fd118719640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd2ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56626/0 (socket says 172.21.15.165:56626) 2024-09-22T08:12:08.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.595+0000 7fd118719640 1 -- 172.21.15.165:0/1392916258 learned_addr learned my addr 172.21.15.165:0/1392916258 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.595+0000 7fd118719640 1 -- 172.21.15.165:0/1392916258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0cd44dbd0 con 0x55b0cd35a7e0 2024-09-22T08:12:08.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.596+0000 7fd118719640 1 --2- 172.21.15.165:0/1392916258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd2ce9b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd1080460d0 tx=0x7fd108051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64211f66e4a63614 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.596+0000 7fd00660c640 1 -- 172.21.15.165:0/1392916258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1080519d0 con 0x55b0cd35a7e0 2024-09-22T08:12:08.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.596+0000 7fd00660c640 1 -- 172.21.15.165:0/1392916258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd108051b70 con 0x55b0cd35a7e0 2024-09-22T08:12:08.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.596+0000 7fd00660c640 1 -- 172.21.15.165:0/1392916258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd108051e50 con 0x55b0cd35a7e0 2024-09-22T08:12:08.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 -- 172.21.15.165:0/1392916258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 msgr2=0x55b0cd2ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/1392916258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd2ce9b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd1080460d0 tx=0x7fd108051000 comp rx=0 tx=0).stop 2024-09-22T08:12:08.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 -- 172.21.15.165:0/1392916258 shutdown_connections 2024-09-22T08:12:08.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/1392916258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd2ce9b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 -- 172.21.15.165:0/1392916258 >> 172.21.15.165:0/1392916258 conn(0x55b0cd355bb0 msgr2=0x55b0cd445890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 -- 172.21.15.165:0/1392916258 shutdown_connections 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 -- 172.21.15.165:0/1392916258 wait complete. 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 Processor -- start 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 -- start start 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd44b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd11ac2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b0cd35c290 con 0x55b0cd35a7e0 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd118719640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd44b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd118719640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd44b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56628/0 (socket says 172.21.15.165:56628) 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.597+0000 7fd118719640 1 -- 172.21.15.165:0/3398844275 learned_addr learned my addr 172.21.15.165:0/3398844275 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.598+0000 7fd118719640 1 -- 172.21.15.165:0/3398844275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0cd44b840 con 0x55b0cd35a7e0 2024-09-22T08:12:08.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.598+0000 7fd118719640 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd44b2e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd1080460d0 tx=0x7fd108002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.598+0000 7fd004e09640 1 -- 172.21.15.165:0/3398844275 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd108073020 con 0x55b0cd35a7e0 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.598+0000 7fd004e09640 1 -- 172.21.15.165:0/3398844275 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10806f580 con 0x55b0cd35a7e0 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.598+0000 7fd004e09640 1 -- 172.21.15.165:0/3398844275 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd10806f8a0 con 0x55b0cd35a7e0 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.598+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0cd449bf0 con 0x55b0cd35a7e0 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.598+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0cd44a210 con 0x55b0cd35a7e0 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.599+0000 7fd004e09640 1 -- 172.21.15.165:0/3398844275 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd108076020 con 0x55b0cd35a7e0 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.599+0000 7fd004e09640 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd00003d000 0x7fd00003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.599+0000 7fd004e09640 1 -- 172.21.15.165:0/3398844275 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd10806b040 con 0x55b0cd35a7e0 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.599+0000 7fd10ff18640 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd00003d000 0x7fd00003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.599+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd35ba20 0x55b0cd45bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.599+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd45c470 con 0x55b0cd35ba20 2024-09-22T08:12:08.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.600+0000 7fd118f1a640 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd35ba20 0x55b0cd45bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.600+0000 7fd118f1a640 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd35ba20 0x55b0cd45bf30 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.600+0000 7fd10ff18640 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd00003d000 0x7fd00003f4c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd100001e30 tx=0x7fd100001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.600+0000 7fd118f1a640 1 -- 172.21.15.165:0/3398844275 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd11000a4d0 con 0x55b0cd35ba20 2024-09-22T08:12:08.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.600+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd45cd50 con 0x55b0cd35ba20 2024-09-22T08:12:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.600+0000 7fd118f1a640 1 -- 172.21.15.165:0/3398844275 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd11000a4d0 con 0x55b0cd35ba20 2024-09-22T08:12:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.600+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd45e660 0x55b0cd460b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.600+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd461290 con 0x55b0cd45e660 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.601+0000 7fd118719640 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd45e660 0x55b0cd460b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.601+0000 7fd118719640 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd45e660 0x55b0cd460b00 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.601+0000 7fd118719640 1 -- 172.21.15.165:0/3398844275 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd45e660 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.601+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd45d5a0 con 0x55b0cd35ba20 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.601+0000 7fd118f1a640 1 -- 172.21.15.165:0/3398844275 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd11000a4d0 con 0x55b0cd35ba20 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.601+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd45d9c0 con 0x55b0cd35ba20 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.602+0000 7fd118f1a640 1 -- 172.21.15.165:0/3398844275 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd11000a4d0 con 0x55b0cd35ba20 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.602+0000 7fd11ac2f800 1 Processor -- start 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.602+0000 7fd11ac2f800 1 -- start start 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.602+0000 7fd11ac2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd46fc60 0x55b0cd470080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.602+0000 7fd11ac2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b0cd252d50 con 0x55b0cd46fc60 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.603+0000 7fd118f1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd46fc60 0x55b0cd470080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.603+0000 7fd118f1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd46fc60 0x55b0cd470080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56630/0 (socket says 172.21.15.165:56630) 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.603+0000 7fd118f1a640 1 -- 172.21.15.165:0/2556494625 learned_addr learned my addr 172.21.15.165:0/2556494625 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.603+0000 7fd118f1a640 1 -- 172.21.15.165:0/2556494625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0cd4706c0 con 0x55b0cd46fc60 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.603+0000 7fd118f1a640 1 --2- 172.21.15.165:0/2556494625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd46fc60 0x55b0cd470080 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x55b0cd45c870 tx=0x7fd110018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.603+0000 7fcffdffb640 1 -- 172.21.15.165:0/2556494625 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd110014450 con 0x55b0cd46fc60 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.603+0000 7fcffdffb640 1 -- 172.21.15.165:0/2556494625 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1100145f0 con 0x55b0cd46fc60 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.603+0000 7fcffdffb640 1 -- 172.21.15.165:0/2556494625 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd110014910 con 0x55b0cd46fc60 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.603+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2556494625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0cd470ef0 con 0x55b0cd46fc60 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.603+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2556494625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0cd471490 con 0x55b0cd46fc60 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.604+0000 7fcffdffb640 1 -- 172.21.15.165:0/2556494625 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd110011040 con 0x55b0cd46fc60 2024-09-22T08:12:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.604+0000 7fcffdffb640 1 --2- 172.21.15.165:0/2556494625 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff003cfb0 0x7fcff003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.604+0000 7fcffdffb640 1 -- 172.21.15.165:0/2556494625 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd11001e070 con 0x55b0cd46fc60 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.604+0000 7fd118719640 1 --2- 172.21.15.165:0/2556494625 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff003cfb0 0x7fcff003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.605+0000 7fd11ac2f800 1 Processor -- start 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.605+0000 7fd11ac2f800 1 -- start start 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.605+0000 7fd118719640 1 --2- 172.21.15.165:0/2556494625 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff003cfb0 0x7fcff003f470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55b0cd44a840 tx=0x7fd108077f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.605+0000 7fd11ac2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd47caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.605+0000 7fd11ac2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b0cd44ddd0 con 0x55b0cd47c6a0 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.605+0000 7fd118f1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd47caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.605+0000 7fd118f1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd47caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56638/0 (socket says 172.21.15.165:56638) 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.605+0000 7fd118f1a640 1 -- 172.21.15.165:0/4230609041 learned_addr learned my addr 172.21.15.165:0/4230609041 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.605+0000 7fd118f1a640 1 -- 172.21.15.165:0/4230609041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0cd47d090 con 0x55b0cd47c6a0 2024-09-22T08:12:08.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.605+0000 7fd118f1a640 1 --2- 172.21.15.165:0/4230609041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd47caa0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd110016620 tx=0x7fd110011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c272f2c30a881 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fcfef7fe640 1 -- 172.21.15.165:0/4230609041 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd110051020 con 0x55b0cd47c6a0 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fcfef7fe640 1 -- 172.21.15.165:0/4230609041 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd110022de0 con 0x55b0cd47c6a0 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fcfef7fe640 1 -- 172.21.15.165:0/4230609041 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd110028070 con 0x55b0cd47c6a0 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fd11ac2f800 1 -- 172.21.15.165:0/4230609041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 msgr2=0x55b0cd47caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/4230609041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd47caa0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd110016620 tx=0x7fd110011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fd11ac2f800 1 -- 172.21.15.165:0/4230609041 shutdown_connections 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/4230609041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd47caa0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fd11ac2f800 1 -- 172.21.15.165:0/4230609041 >> 172.21.15.165:0/4230609041 conn(0x55b0cd478aa0 msgr2=0x55b0cd476ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fd11ac2f800 1 -- 172.21.15.165:0/4230609041 shutdown_connections 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fd11ac2f800 1 -- 172.21.15.165:0/4230609041 wait complete. 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fd11ac2f800 1 Processor -- start 2024-09-22T08:12:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.606+0000 7fd11ac2f800 1 -- start start 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.607+0000 7fd11ac2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd483cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.607+0000 7fd11ac2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b0cd47d6b0 con 0x55b0cd47c6a0 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.607+0000 7fd118f1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd483cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.607+0000 7fd118f1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd483cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56652/0 (socket says 172.21.15.165:56652) 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.607+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 learned_addr learned my addr 172.21.15.165:0/2613032949 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.607+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0cd484210 con 0x55b0cd47c6a0 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.607+0000 7fd118f1a640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd483cb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd110022f90 tx=0x7fd1100546f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.607+0000 7fcfedffb640 1 -- 172.21.15.165:0/2613032949 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd110031020 con 0x55b0cd47c6a0 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.607+0000 7fcfedffb640 1 -- 172.21.15.165:0/2613032949 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd110054b70 con 0x55b0cd47c6a0 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.607+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0cd4844a0 con 0x55b0cd47c6a0 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.608+0000 7fcfedffb640 1 -- 172.21.15.165:0/2613032949 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd110045930 con 0x55b0cd47c6a0 2024-09-22T08:12:08.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.608+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0cd484e20 con 0x55b0cd47c6a0 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.608+0000 7fcfedffb640 1 -- 172.21.15.165:0/2613032949 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd110034020 con 0x55b0cd47c6a0 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.609+0000 7fcfedffb640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe003cfb0 0x7fcfe003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.609+0000 7fcfedffb640 1 -- 172.21.15.165:0/2613032949 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd11000e040 con 0x55b0cd47c6a0 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.609+0000 7fd118719640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe003cfb0 0x7fcfe003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.609+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.609+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd48f7a0 0x55b0cd491c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.609+0000 7fd118719640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe003cfb0 0x7fcfe003f470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd1080507a0 tx=0x7fd108086000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.609+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4923b0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.609+0000 7fd10ff18640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd48f7a0 0x55b0cd491c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd10ff18640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd48f7a0 0x55b0cd491c60 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd10000f610 con 0x55b0cd48f7a0 2024-09-22T08:12:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 20 realm 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd48eaf0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd10000f610 con 0x55b0cd48f7a0 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd492ea0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd10000f610 con 0x55b0cd48f7a0 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.610+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd493770 con 0x55b0cd48f7a0 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd10000f610 con 0x55b0cd48f7a0 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd11ac2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd494190 0x55b0cd496580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd496cc0 con 0x55b0cd494190 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd118f1a640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd494190 0x55b0cd496580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd118f1a640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd494190 0x55b0cd496580 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd11ac2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd11ac2f800 20 searching for the correct realm 2024-09-22T08:12:08.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b0cd498c70 0x55b0cd49b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd498c70 2024-09-22T08:12:08.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.611+0000 7fd118719640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b0cd498c70 0x55b0cd49b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.612+0000 7fd118719640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b0cd498c70 0x55b0cd49b130 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.612+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.612+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd494190 2024-09-22T08:12:08.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.612+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.612+0000 7fd118f1a640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd110036020 0x7fd110044a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.612+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x7fd110036020 2024-09-22T08:12:08.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.612+0000 7fd10ff18640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd110036020 0x7fd110044a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.613+0000 7fd10ff18640 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd110036020 0x7fd110044a20 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.613+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10000f610 con 0x7fd110036020 2024-09-22T08:12:08.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.613+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.613+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10000f610 con 0x55b0cd48f7a0 2024-09-22T08:12:08.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.613+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.613+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.613+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x7fd110036020 2024-09-22T08:12:08.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.614+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.614+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd494190 2024-09-22T08:12:08.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.614+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.614+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd494190 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.614+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.614+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd498c70 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.614+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.614+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.615+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.615+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x7fd110036020 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.615+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.615+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.615+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.615+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd494190 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.615+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.615+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd498c70 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.616+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.616+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd498c70 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.616+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.616+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x7fd110036020 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.616+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.616+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd498c70 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.617+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.617+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd498c70 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.617+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.617+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.617+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.617+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.617+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.617+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x7fd110036020 2024-09-22T08:12:08.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.617+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.617+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd498c70 2024-09-22T08:12:08.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.618+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.618+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd494190 2024-09-22T08:12:08.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.618+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.618+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.618+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.618+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x7fd110036020 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.618+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.618+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd498c70 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.619+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.619+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x7fd110036020 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.619+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.619+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd494190 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.619+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.619+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd498c70 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.619+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.619+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x7fd110036020 2024-09-22T08:12:08.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49b7b0 con 0x55b0cd494190 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd497680 con 0x55b0cd48f7a0 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.620+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd497f20 con 0x55b0cd48f7a0 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4972c0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 20 zone default found 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 4 Realm: () 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 20 zonegroup default 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49c0e0 con 0x7fd110036020 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49dde0 con 0x55b0cd498c70 2024-09-22T08:12:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.621+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.622+0000 7fd11ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.622+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.622+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49e290 con 0x55b0cd498c70 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.622+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.622+0000 7fd11ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.622+0000 7fd11ac2f800 20 started sync module instance, tier type = 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.622+0000 7fd11ac2f800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.622+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49cbb0 con 0x55b0cd494190 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.623+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.623+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94217846771616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49c810 con 0x55b0cd494190 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.623+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49f1c0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.624+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94217846771616] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.624+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.624+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94217846777584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49f1c0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.624+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49fbc0 con 0x55b0cd498c70 2024-09-22T08:12:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.625+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94217846777584] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.626+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.626+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94217846779152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49f130 con 0x55b0cd498c70 2024-09-22T08:12:08.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.626+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a0a80 con 0x55b0cd494190 2024-09-22T08:12:08.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.627+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.627+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94217846785968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a1240 con 0x55b0cd494190 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.627+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94217846779152] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.627+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a1d60 con 0x55b0cd48f7a0 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.628+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.628+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94217846790192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a1d20 con 0x55b0cd48f7a0 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.628+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a2790 con 0x7fd110036020 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.628+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94217846785968] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.629+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.629+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94217846790192] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.629+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94217846792896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a2790 con 0x7fd110036020 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.629+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a3030 con 0x7fd110036020 2024-09-22T08:12:08.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.630+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94217846792896] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.630+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.630+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94217846787216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a2790 con 0x7fd110036020 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.630+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a3650 con 0x7fd110036020 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.631+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94217846787216] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.631+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.631+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94217846794608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a3650 con 0x7fd110036020 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.631+0000 7fd11ac2f800 20 add_watcher() i=0 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.631+0000 7fd11ac2f800 20 add_watcher() i=1 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.631+0000 7fd11ac2f800 20 add_watcher() i=2 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.631+0000 7fd11ac2f800 20 add_watcher() i=3 2024-09-22T08:12:08.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.631+0000 7fd11ac2f800 20 add_watcher() i=4 2024-09-22T08:12:08.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.631+0000 7fd11ac2f800 20 add_watcher() i=5 2024-09-22T08:12:08.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.631+0000 7fd11ac2f800 20 add_watcher() i=6 2024-09-22T08:12:08.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.632+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94217846794608] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.632+0000 7fd11ac2f800 20 add_watcher() i=7 2024-09-22T08:12:08.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.632+0000 7fd11ac2f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:08.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.632+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a6ac0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.633+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.633+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94217846809760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a37c0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94217846809760] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fcfce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:08.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fd11ac2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:08.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fd11ac2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:08.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fd11ac2f800 5 note: GC not initialized 2024-09-22T08:12:08.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fcfcd7e2640 20 reqs_thread_entry: start 2024-09-22T08:12:08.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fd11ac2f800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:08.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fd11ac2f800 20 Filter name: none 2024-09-22T08:12:08.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fcf3effd640 20 reqs_thread_entry: start 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fd11ac2f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fd11ac2f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.634+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4d9e90 con 0x55b0cd494190 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.635+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.635+0000 7fd11ac2f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.635+0000 7fd11ac2f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.635+0000 7fd11ac2f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.635+0000 7fd11ac2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.635+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4de180 con 0x7fd110036020 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.636+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.656 INFO:teuthology.orchestra.run.smithi165.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.637+0000 7fcfce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.637+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94217846809760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4d7bd0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.638+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94217846809760] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.638+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94217846771616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4d7bd0 con 0x55b0cd494190 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.639+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94217846771616] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.639+0000 7fd11ac2f800 20 remove_watcher() i=0 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.639+0000 7fd11ac2f800 2 removed watcher, disabling cache 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.639+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94217846777584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4d7bd0 con 0x55b0cd48f7a0 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.640+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94217846777584] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.640+0000 7fd11ac2f800 20 remove_watcher() i=1 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.640+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94217846779152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4d7bd0 con 0x55b0cd498c70 2024-09-22T08:12:08.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.641+0000 7fd118719640 1 -- 172.21.15.165:0/2613032949 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94217846779152] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd108057030 con 0x55b0cd498c70 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.641+0000 7fd11ac2f800 20 remove_watcher() i=2 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.641+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94217846785968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49cfa0 con 0x55b0cd494190 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.642+0000 7fd118f1a640 1 -- 172.21.15.165:0/2613032949 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94217846785968] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd11002a070 con 0x55b0cd494190 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.642+0000 7fd11ac2f800 20 remove_watcher() i=3 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.642+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94217846790192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49ed10 con 0x55b0cd48f7a0 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.643+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94217846790192] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x55b0cd48f7a0 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.643+0000 7fd11ac2f800 20 remove_watcher() i=4 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.643+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94217846792896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd4a07b0 con 0x7fd110036020 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.644+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94217846792896] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.644+0000 7fd11ac2f800 20 remove_watcher() i=5 2024-09-22T08:12:08.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.644+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94217846787216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49cfa0 con 0x7fd110036020 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.645+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94217846787216] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.645+0000 7fd11ac2f800 20 remove_watcher() i=6 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.645+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94217846794608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0cd49ed10 con 0x7fd110036020 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.646+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94217846794608] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd10002b040 con 0x7fd110036020 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.646+0000 7fd11ac2f800 20 remove_watcher() i=7 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.646+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd110036020 msgr2=0x7fd110044a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.646+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fd110036020 0x7fd110044a20 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.646+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd48f7a0 msgr2=0x55b0cd491c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.646+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd48f7a0 0x55b0cd491c60 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.646+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd494190 msgr2=0x55b0cd496580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.646+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd494190 0x55b0cd496580 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.646+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b0cd498c70 msgr2=0x55b0cd49b130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.646+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b0cd498c70 0x55b0cd49b130 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe003cfb0 msgr2=0x7fcfe003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcfe003cfb0 0x7fcfe003f470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd1080507a0 tx=0x7fd108086000 comp rx=0 tx=0).stop 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 msgr2=0x55b0cd483cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd10ff18640 1 -- 172.21.15.165:0/2613032949 reap_dead start 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd483cb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd110022f90 tx=0x7fd1100546f0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 shutdown_connections 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2613032949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd47c6a0 0x55b0cd483cb0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 >> 172.21.15.165:0/2613032949 conn(0x55b0cd478aa0 msgr2=0x55b0cd476cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 shutdown_connections 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2613032949 wait complete. 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2556494625 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff003cfb0 msgr2=0x7fcff003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2556494625 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff003cfb0 0x7fcff003f470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55b0cd44a840 tx=0x7fd108077f10 comp rx=0 tx=0).stop 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2556494625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd46fc60 msgr2=0x55b0cd470080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2556494625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd46fc60 0x55b0cd470080 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x55b0cd45c870 tx=0x7fd110018830 comp rx=0 tx=0).stop 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2556494625 shutdown_connections 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2556494625 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcff003cfb0 0x7fcff003f470 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/2556494625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd46fc60 0x55b0cd470080 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2556494625 >> 172.21.15.165:0/2556494625 conn(0x55b0cd464010 msgr2=0x55b0cd4643f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2556494625 shutdown_connections 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/2556494625 wait complete. 2024-09-22T08:12:08.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd35ba20 msgr2=0x55b0cd45bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.647+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd35ba20 0x55b0cd45bf30 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd45e660 msgr2=0x55b0cd460b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd45e660 0x55b0cd460b00 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd00003d000 msgr2=0x7fd00003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd00003d000 0x7fd00003f4c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd100001e30 tx=0x7fd100001390 comp rx=0 tx=0).stop 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 msgr2=0x55b0cd44b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd44b2e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd1080460d0 tx=0x7fd108002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 shutdown_connections 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b0cd45e660 0x55b0cd460b00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b0cd35ba20 0x55b0cd45bf30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fd00003d000 0x7fd00003f4c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 --2- 172.21.15.165:0/3398844275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0cd35a7e0 0x55b0cd44b2e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 >> 172.21.15.165:0/3398844275 conn(0x55b0cd355bb0 msgr2=0x55b0cd444080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 shutdown_connections 2024-09-22T08:12:08.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.648+0000 7fd11ac2f800 1 -- 172.21.15.165:0/3398844275 wait complete. 2024-09-22T08:12:08.663 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-22T08:12:08.668 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:12:08.668 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-22T08:12:08.673 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-22T08:12:08.674 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-22T08:12:08.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-22T08:12:08.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-22T08:12:08.674 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-22T08:12:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05b1725800 1 Processor -- start 2024-09-22T08:12:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05b1725800 1 -- start start 2024-09-22T08:12:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05b1725800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563209ad6d10 0x563209b684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05b1725800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632099eea20 con 0x563209b68a10 2024-09-22T08:12:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05b1725800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5632099ee7d0 con 0x563209ad6d10 2024-09-22T08:12:08.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05ad3ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563209ad6d10 0x563209b684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05ad3ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563209ad6d10 0x563209b684a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56662/0 (socket says 172.21.15.165:56662) 2024-09-22T08:12:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05ad3ae640 1 -- 172.21.15.165:0/1809733876 learned_addr learned my addr 172.21.15.165:0/1809733876 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05acbad640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563209b68a10 0x563209b6aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:49518/0 (socket says 172.21.15.165:49518) 2024-09-22T08:12:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05ad3ae640 1 -- 172.21.15.165:0/1809733876 >> v1:172.21.15.53:6789/0 conn(0x563209b68a10 legacy=0x563209b6aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.720+0000 7f05ad3ae640 1 -- 172.21.15.165:0/1809733876 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563209b6d7c0 con 0x563209ad6d10 2024-09-22T08:12:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.722+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/1809733876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209b684a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f05a000a520 tx=0x7f05a0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea859c8229d0590 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.722+0000 7f059ffff640 1 -- 172.21.15.165:0/1809733876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0055070 con 0x563209ad6d10 2024-09-22T08:12:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.722+0000 7f059ffff640 1 -- 172.21.15.165:0/1809733876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a00515b0 con 0x563209ad6d10 2024-09-22T08:12:08.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.722+0000 7f059ffff640 1 -- 172.21.15.165:0/1809733876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a00518d0 con 0x563209ad6d10 2024-09-22T08:12:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.723+0000 7f05b1725800 1 -- 172.21.15.165:0/1809733876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 msgr2=0x563209b684a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.723+0000 7f05b1725800 1 --2- 172.21.15.165:0/1809733876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209b684a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f05a000a520 tx=0x7f05a0045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.723+0000 7f05b1725800 1 -- 172.21.15.165:0/1809733876 shutdown_connections 2024-09-22T08:12:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.723+0000 7f05b1725800 1 --2- 172.21.15.165:0/1809733876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209b684a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.723+0000 7f05b1725800 1 -- 172.21.15.165:0/1809733876 >> 172.21.15.165:0/1809733876 conn(0x563209b5dbb0 msgr2=0x563209b60010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.723+0000 7f05b1725800 1 -- 172.21.15.165:0/1809733876 shutdown_connections 2024-09-22T08:12:08.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.723+0000 7f05b1725800 1 -- 172.21.15.165:0/1809733876 wait complete. 2024-09-22T08:12:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.736+0000 7f05b1725800 1 Processor -- start 2024-09-22T08:12:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.736+0000 7f05b1725800 1 -- start start 2024-09-22T08:12:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.737+0000 7f05b1725800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c55230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.737+0000 7f05b1725800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5632099fbdd0 con 0x563209ad6d10 2024-09-22T08:12:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.737+0000 7f05ad3ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c55230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.737+0000 7f05ad3ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c55230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56670/0 (socket says 172.21.15.165:56670) 2024-09-22T08:12:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.737+0000 7f05ad3ae640 1 -- 172.21.15.165:0/371534117 learned_addr learned my addr 172.21.15.165:0/371534117 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.737+0000 7f05ad3ae640 1 -- 172.21.15.165:0/371534117 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563209c55820 con 0x563209ad6d10 2024-09-22T08:12:08.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.737+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/371534117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c55230 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f05a0025da0 tx=0x7f05a0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a74d392ee09be48 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.738+0000 7f049b606640 1 -- 172.21.15.165:0/371534117 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0051ac0 con 0x563209ad6d10 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.738+0000 7f049b606640 1 -- 172.21.15.165:0/371534117 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a0051c60 con 0x563209ad6d10 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.738+0000 7f049b606640 1 -- 172.21.15.165:0/371534117 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a005a450 con 0x563209ad6d10 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.738+0000 7f05b1725800 1 -- 172.21.15.165:0/371534117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 msgr2=0x563209c55230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.738+0000 7f05b1725800 1 --2- 172.21.15.165:0/371534117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c55230 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f05a0025da0 tx=0x7f05a0051000 comp rx=0 tx=0).stop 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.738+0000 7f05b1725800 1 -- 172.21.15.165:0/371534117 shutdown_connections 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.738+0000 7f05b1725800 1 --2- 172.21.15.165:0/371534117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c55230 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.738+0000 7f05b1725800 1 -- 172.21.15.165:0/371534117 >> 172.21.15.165:0/371534117 conn(0x563209b5dbb0 msgr2=0x563209c50bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.738+0000 7f05b1725800 1 -- 172.21.15.165:0/371534117 shutdown_connections 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.738+0000 7f05b1725800 1 -- 172.21.15.165:0/371534117 wait complete. 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.739+0000 7f05b1725800 1 Processor -- start 2024-09-22T08:12:08.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.739+0000 7f05b1725800 1 -- start start 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.739+0000 7f05b1725800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c5cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.739+0000 7f05b1725800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563209b6ca60 con 0x563209ad6d10 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.739+0000 7f05ad3ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c5cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.739+0000 7f05ad3ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c5cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56672/0 (socket says 172.21.15.165:56672) 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.739+0000 7f05ad3ae640 1 -- 172.21.15.165:0/3063657845 learned_addr learned my addr 172.21.15.165:0/3063657845 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.739+0000 7f05ad3ae640 1 -- 172.21.15.165:0/3063657845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563209c5d130 con 0x563209ad6d10 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.740+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c5cbd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f05a0067040 tx=0x7f05a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.740+0000 7f0499e03640 1 -- 172.21.15.165:0/3063657845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a0073070 con 0x563209ad6d10 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.740+0000 7f0499e03640 1 -- 172.21.15.165:0/3063657845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a005a600 con 0x563209ad6d10 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.740+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563209c5d3c0 con 0x563209ad6d10 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.740+0000 7f0499e03640 1 -- 172.21.15.165:0/3063657845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a005a8e0 con 0x563209ad6d10 2024-09-22T08:12:08.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.740+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563209c5dfd0 con 0x563209ad6d10 2024-09-22T08:12:08.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.741+0000 7f0499e03640 1 -- 172.21.15.165:0/3063657845 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f05a0076070 con 0x563209ad6d10 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.741+0000 7f0499e03640 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f049403cfb0 0x7f049403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.741+0000 7f0499e03640 1 -- 172.21.15.165:0/3063657845 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f05a0062070 con 0x563209ad6d10 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.741+0000 7f05acbad640 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f049403cfb0 0x7f049403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.741+0000 7f05b1725800 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209b68a10 0x563209c64220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.741+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c64760 con 0x563209b68a10 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.741+0000 7f05adbaf640 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209b68a10 0x563209c64220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.741+0000 7f05acbad640 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f049403cfb0 0x7f049403f470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f05a4001e30 tx=0x7f05a4001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.741+0000 7f05adbaf640 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209b68a10 0x563209c64220 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.742+0000 7f05adbaf640 1 -- 172.21.15.165:0/3063657845 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05a800a4d0 con 0x563209b68a10 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.742+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c64b00 con 0x563209b68a10 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.742+0000 7f05adbaf640 1 -- 172.21.15.165:0/3063657845 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05a800a4d0 con 0x563209b68a10 2024-09-22T08:12:08.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.742+0000 7f05b1725800 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c66640 0x563209c68ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.742+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c69270 con 0x563209c66640 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.742+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c66640 0x563209c68ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.742+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c66640 0x563209c68ae0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.743+0000 7f05ad3ae640 1 -- 172.21.15.165:0/3063657845 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05a007f070 con 0x563209c66640 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.743+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c65350 con 0x563209b68a10 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.743+0000 7f05adbaf640 1 -- 172.21.15.165:0/3063657845 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05a800a4d0 con 0x563209b68a10 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.743+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c657b0 con 0x563209b68a10 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.743+0000 7f05adbaf640 1 -- 172.21.15.165:0/3063657845 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05a800a4d0 con 0x563209b68a10 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.743+0000 7f05b1725800 1 Processor -- start 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.744+0000 7f05b1725800 1 -- start start 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.744+0000 7f05b1725800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c77c20 0x563209c78040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.744+0000 7f05b1725800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563209a5ad50 con 0x563209c77c20 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.744+0000 7f05adbaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c77c20 0x563209c78040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.744+0000 7f05adbaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c77c20 0x563209c78040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56688/0 (socket says 172.21.15.165:56688) 2024-09-22T08:12:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.744+0000 7f05adbaf640 1 -- 172.21.15.165:0/3720486077 learned_addr learned my addr 172.21.15.165:0/3720486077 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.744+0000 7f05adbaf640 1 -- 172.21.15.165:0/3720486077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563209c78680 con 0x563209c77c20 2024-09-22T08:12:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.744+0000 7f05adbaf640 1 --2- 172.21.15.165:0/3720486077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c77c20 0x563209c78040 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x563209c5dbd0 tx=0x7f05a8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.745+0000 7f0492ffd640 1 -- 172.21.15.165:0/3720486077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a8014450 con 0x563209c77c20 2024-09-22T08:12:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.745+0000 7f0492ffd640 1 -- 172.21.15.165:0/3720486077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a8014610 con 0x563209c77c20 2024-09-22T08:12:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.745+0000 7f05b1725800 1 -- 172.21.15.165:0/3720486077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563209c78eb0 con 0x563209c77c20 2024-09-22T08:12:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.745+0000 7f0492ffd640 1 -- 172.21.15.165:0/3720486077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a8014930 con 0x563209c77c20 2024-09-22T08:12:08.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.745+0000 7f05b1725800 1 -- 172.21.15.165:0/3720486077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563209c79450 con 0x563209c77c20 2024-09-22T08:12:08.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.745+0000 7f0492ffd640 1 -- 172.21.15.165:0/3720486077 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f05a8011040 con 0x563209c77c20 2024-09-22T08:12:08.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f0492ffd640 1 --2- 172.21.15.165:0/3720486077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f048403d000 0x7f048403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f0492ffd640 1 -- 172.21.15.165:0/3720486077 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f05a801e070 con 0x563209c77c20 2024-09-22T08:12:08.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/3720486077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f048403d000 0x7f048403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f05b1725800 1 Processor -- start 2024-09-22T08:12:08.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f05b1725800 1 -- start start 2024-09-22T08:12:08.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/3720486077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f048403d000 0x7f048403f4c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x563209c5ed20 tx=0x7f05a0080610 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f05b1725800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c84a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f05b1725800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563209c55b90 con 0x563209c84680 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f05adbaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c84a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f05adbaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c84a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56700/0 (socket says 172.21.15.165:56700) 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.746+0000 7f05adbaf640 1 -- 172.21.15.165:0/1384016600 learned_addr learned my addr 172.21.15.165:0/1384016600 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f05adbaf640 1 -- 172.21.15.165:0/1384016600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563209c85070 con 0x563209c84680 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f05adbaf640 1 --2- 172.21.15.165:0/1384016600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c84a80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f05a8018430 tx=0x7f05a8014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a248adfc1a12138 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f0490ff9640 1 -- 172.21.15.165:0/1384016600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a804b070 con 0x563209c84680 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f0490ff9640 1 -- 172.21.15.165:0/1384016600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a8051070 con 0x563209c84680 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f0490ff9640 1 -- 172.21.15.165:0/1384016600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a8011da0 con 0x563209c84680 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f05b1725800 1 -- 172.21.15.165:0/1384016600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 msgr2=0x563209c84a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f05b1725800 1 --2- 172.21.15.165:0/1384016600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c84a80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f05a8018430 tx=0x7f05a8014ea0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f05b1725800 1 -- 172.21.15.165:0/1384016600 shutdown_connections 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f05b1725800 1 --2- 172.21.15.165:0/1384016600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c84a80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f05b1725800 1 -- 172.21.15.165:0/1384016600 >> 172.21.15.165:0/1384016600 conn(0x563209c80a80 msgr2=0x563209c7ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f05b1725800 1 -- 172.21.15.165:0/1384016600 shutdown_connections 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.747+0000 7f05b1725800 1 -- 172.21.15.165:0/1384016600 wait complete. 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.748+0000 7f05b1725800 1 Processor -- start 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.748+0000 7f05b1725800 1 -- start start 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.748+0000 7f05b1725800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c8bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.748+0000 7f05b1725800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563209c85690 con 0x563209c84680 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.748+0000 7f05adbaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c8bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.748+0000 7f05adbaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c8bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56702/0 (socket says 172.21.15.165:56702) 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.748+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 learned_addr learned my addr 172.21.15.165:0/2310281634 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.748+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563209c8c230 con 0x563209c84680 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.748+0000 7f05adbaf640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c8bcd0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f05a802bfd0 tx=0x7f05a80546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.749+0000 7f0482ffd640 1 -- 172.21.15.165:0/2310281634 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a804b040 con 0x563209c84680 2024-09-22T08:12:08.757 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.749+0000 7f0482ffd640 1 -- 172.21.15.165:0/2310281634 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a8011330 con 0x563209c84680 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.749+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563209c8c4c0 con 0x563209c84680 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.749+0000 7f0482ffd640 1 -- 172.21.15.165:0/2310281634 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05a8054a60 con 0x563209c84680 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.749+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563209c8ce40 con 0x563209c84680 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.749+0000 7f0482ffd640 1 -- 172.21.15.165:0/2310281634 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f05a8054c00 con 0x563209c84680 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.750+0000 7f0482ffd640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f047803cfb0 0x7f047803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.750+0000 7f0482ffd640 1 -- 172.21.15.165:0/2310281634 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f05a800e040 con 0x563209c84680 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.750+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f047803cfb0 0x7f047803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.750+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f047803cfb0 0x7f047803f470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f05a0080710 tx=0x7f05a008f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.750+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05b1725800 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209c977c0 0x563209c99c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c9a3d0 con 0x563209c977c0 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05acbad640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209c977c0 0x563209c99c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05acbad640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209c977c0 0x563209c99c80 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05a400f610 con 0x563209c977c0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05b1725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05b1725800 20 realm 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c96b10 con 0x563209c977c0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05a400f610 con 0x563209c977c0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05b1725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05b1725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.751+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c9aec0 con 0x563209c977c0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05a400f610 con 0x563209c977c0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05b1725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c9b790 con 0x563209c977c0 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05a400f610 con 0x563209c977c0 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05b1725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05b1725800 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c9c1b0 0x563209c9e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c9ece0 con 0x563209c9c1b0 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05adbaf640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c9c1b0 0x563209c9e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05adbaf640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c9c1b0 0x563209c9e5a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.752+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05b1725800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05b1725800 20 searching for the correct realm 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05b1725800 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563209ca0c90 0x563209ca3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209ca0c90 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563209ca0c90 0x563209ca3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05ad3ae640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563209ca0c90 0x563209ca3150 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c9c1b0 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05adbaf640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f05a8037070 0x7f05a80458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.753+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x7f05a8037070 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.754+0000 7f05acbad640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f05a8037070 0x7f05a80458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.754+0000 7f05acbad640 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f05a8037070 0x7f05a80458e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.754+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a400f610 con 0x7f05a8037070 2024-09-22T08:12:08.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.754+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c977c0 2024-09-22T08:12:08.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.755+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a400f610 con 0x563209c977c0 2024-09-22T08:12:08.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.755+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c977c0 2024-09-22T08:12:08.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.755+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.755+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x7f05a8037070 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.755+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.755+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c9c1b0 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.755+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.755+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c9c1b0 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.756+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.756+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209ca0c90 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.756+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.756+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c977c0 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.756+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.756+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x7f05a8037070 2024-09-22T08:12:08.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.757+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.757+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c977c0 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.757+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.757+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c9c1b0 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.757+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.757+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209ca0c90 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.757+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.757+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209ca0c90 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.758+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.758+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x7f05a8037070 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.758+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.758+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209ca0c90 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.758+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.758+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209ca0c90 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.758+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.758+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c977c0 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.758+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.758+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c977c0 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.759+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.759+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x7f05a8037070 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.759+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.759+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209ca0c90 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.759+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.759+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c9c1b0 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.759+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.760+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c977c0 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.760+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.760+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x7f05a8037070 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.760+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.760+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209ca0c90 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.760+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.760+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x7f05a8037070 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.761+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.761+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c9c1b0 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.761+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.761+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209ca0c90 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.761+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.761+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x7f05a8037070 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.761+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.761+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c977c0 2024-09-22T08:12:08.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563209ca37d0 con 0x563209c9c1b0 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c9f6a0 con 0x563209c977c0 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c9ff40 con 0x563209c977c0 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.762+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209c9f2e0 con 0x563209c977c0 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 zone default found 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 4 Realm: () 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:08.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 zonegroup default 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209ca4100 con 0x7f05a8037070 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209ca5e30 con 0x563209ca0c90 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209ca62c0 con 0x563209ca0c90 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 started sync module instance, tier type = 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.763+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca4c00 con 0x563209c9c1b0 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.765+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.765+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94772912607216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca4860 con 0x563209c9c1b0 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.765+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca71f0 con 0x563209c977c0 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.766+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94772912607216] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.766+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.766+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94772912613152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca71f0 con 0x563209c977c0 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.766+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca7c10 con 0x563209ca0c90 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.767+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.767+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94772912617216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca84b0 con 0x563209ca0c90 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.767+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca8f90 con 0x563209c9c1b0 2024-09-22T08:12:08.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.767+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94772912613152] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.768+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94772912617216] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.768+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.768+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94772912619520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca6d40 con 0x563209c9c1b0 2024-09-22T08:12:08.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.768+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca9870 con 0x563209c977c0 2024-09-22T08:12:08.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.769+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94772912619520] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.769+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.769+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94772912622240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca9830 con 0x563209c977c0 2024-09-22T08:12:08.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.769+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209caa2c0 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.770+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.770+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94772912622240] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.770+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94772912627152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209caa1f0 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.770+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ca93a0 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.771+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94772912627152] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.771+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.771+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94772912624544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209caad00 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.771+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cab6c0 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.772+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94772912624544] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.772+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.772+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94772912629392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cab6c0 con 0x7f05a8037070 2024-09-22T08:12:08.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.772+0000 7f05b1725800 20 add_watcher() i=0 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.772+0000 7f05b1725800 20 add_watcher() i=1 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.772+0000 7f05b1725800 20 add_watcher() i=2 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.772+0000 7f05b1725800 20 add_watcher() i=3 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.772+0000 7f05b1725800 20 add_watcher() i=4 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.772+0000 7f05b1725800 20 add_watcher() i=5 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.772+0000 7f05b1725800 20 add_watcher() i=6 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.773+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94772912629392] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.773+0000 7f05b1725800 20 add_watcher() i=7 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.773+0000 7f05b1725800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.773+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209caeb80 con 0x563209c977c0 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.774+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.774+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94772912645504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cab830 con 0x563209c977c0 2024-09-22T08:12:08.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.775+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94772912645504] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.775+0000 7f0463fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.775+0000 7f05b1725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.775+0000 7f05b1725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.775+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb76d0 con 0x563209c977c0 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.776+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.776+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb7d20 con 0x7f05a8037070 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.777+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.777+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb8180 con 0x563209ca0c90 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.778+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.778+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb8ba0 con 0x563209c977c0 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.779+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.779+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb8ba0 con 0x563209c9c1b0 2024-09-22T08:12:08.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.780+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.780+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb8ba0 con 0x563209ca0c90 2024-09-22T08:12:08.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.781+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.781+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb8720 con 0x563209c977c0 2024-09-22T08:12:08.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.782+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.782+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb86f0 con 0x7f05a8037070 2024-09-22T08:12:08.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.783+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'46 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.783+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb8720 con 0x563209c9c1b0 2024-09-22T08:12:08.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.784+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.784+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb86f0 con 0x563209ca0c90 2024-09-22T08:12:08.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.785+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.785+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9660 con 0x563209c9c1b0 2024-09-22T08:12:08.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.786+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.786+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x7f05a8037070 2024-09-22T08:12:08.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.787+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.787+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x563209c9c1b0 2024-09-22T08:12:08.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.788+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.788+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x7f05a8037070 2024-09-22T08:12:08.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.789+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.789+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x563209c977c0 2024-09-22T08:12:08.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.790+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.790+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x563209ca0c90 2024-09-22T08:12:08.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.792+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.792+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x563209c9c1b0 2024-09-22T08:12:08.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.793+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.793+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x563209ca0c90 2024-09-22T08:12:08.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.794+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.794+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x563209c977c0 2024-09-22T08:12:08.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.795+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.795+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x563209c977c0 2024-09-22T08:12:08.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.796+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.796+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x563209ca0c90 2024-09-22T08:12:08.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.797+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.797+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb93f0 con 0x563209c9c1b0 2024-09-22T08:12:08.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.798+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.798+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9520 con 0x563209ca0c90 2024-09-22T08:12:08.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.799+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.799+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9520 con 0x563209ca0c90 2024-09-22T08:12:08.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.800+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.800+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9520 con 0x563209ca0c90 2024-09-22T08:12:08.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.800+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.800+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9520 con 0x563209ca0c90 2024-09-22T08:12:08.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.801+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.801+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9520 con 0x7f05a8037070 2024-09-22T08:12:08.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.802+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.802+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9520 con 0x563209ca0c90 2024-09-22T08:12:08.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.803+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.803+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9520 con 0x7f05a8037070 2024-09-22T08:12:08.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.804+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.804+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9520 con 0x563209ca0c90 2024-09-22T08:12:08.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.806+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.806+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9520 con 0x7f05a8037070 2024-09-22T08:12:08.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.807+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.807+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb9520 con 0x563209c9c1b0 2024-09-22T08:12:08.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.808+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.808+0000 7f0462fe5640 20 reqs_thread_entry: start 2024-09-22T08:12:08.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.808+0000 7f05b1725800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:08.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.808+0000 7f05b1725800 20 Filter name: none 2024-09-22T08:12:08.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f0460fe1640 20 reqs_thread_entry: start 2024-09-22T08:12:08.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-22T08:12:08.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209ce4420 con 0x563209c9c1b0 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209ce6b00 con 0x563209c977c0 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv6 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 : miss 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.809+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:96 8.19 8:9879c807:root::.bucket.meta.myfoo6%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209ce51e0 con 0x563209c977c0 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.810+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(96 .bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv7 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.810+0000 7f05b1725800 20 rados_obj.operate() r=0 bl.length=388 2024-09-22T08:12:08.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.810+0000 7f05b1725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 info.flags=0x17 2024-09-22T08:12:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.810+0000 7f05b1725800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 to cache LRU end 2024-09-22T08:12:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.810+0000 7f05b1725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.810+0000 7f05b1725800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-22T08:12:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.810+0000 7f05b1725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 2024-09-22T08:12:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.810+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:97 4.3f 4:feee772d:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d643d0 con 0x563209c9c1b0 2024-09-22T08:12:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.810+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(97 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.810+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:98 4.8 4:124ef282:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d643d0 con 0x563209ca0c90 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.811+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(98 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.811+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:99 4.30 4:0fc75699:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d643d0 con 0x563209ca0c90 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.811+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(99 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.811+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:100 4.2b 4:d5c3c293:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d64410 con 0x563209c977c0 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.811+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(100 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.811+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:101 4.6 4:63c88326:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d64410 con 0x563209ca0c90 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.812+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(101 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.812+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:102 4.3c 4:3f98d39b:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d64410 con 0x563209c977c0 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.812+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(102 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.812+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:103 4.4 4:22deaf00:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d64410 con 0x7f05a8037070 2024-09-22T08:12:08.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.812+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(103 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.6 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.812+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:104 4.1 4:815e77c2:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d64410 con 0x563209c9c1b0 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.813+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(104 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.7 [call out=89b] v0'0 uv12 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.813+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:105 4.5 4:a3efa100:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d64410 con 0x563209ca0c90 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.813+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== osd_op_reply(105 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.813+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:106 4.1c 4:3ac61c6a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d64390 con 0x7f05a8037070 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.813+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(106 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 [call out=349b] v0'0 uv11 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.813+0000 7f05b1725800 10 cls_bucket_list_unordered: got thirteen 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.813+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:107 4.1e 4:78e3914f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209d64410 con 0x7f05a8037070 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.814+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(107 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.814+0000 7f05b1725800 20 get_obj_state: octx=0x7f05a8001770 obj=myfoo6:thirteen state=0x563209ce7e08 s->prefetch_data=0 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.814+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:108 3.34s0 3:2cbb8514:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9_thirteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209ce9c50 con 0x563209c977c0 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.814+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(108 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9_thirteen [call out=24b,getxattrs out=829b,stat out=16b] v0'0 uv6 ondisk = 0) ==== 280+0+869 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.814+0000 7f05b1725800 10 manifest: total_size = 8 2024-09-22T08:12:08.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.814+0000 7f05b1725800 20 get_obj_state: setting s->obj_tag to _ioJqLlStSpTWY6xfKABx8RmbjpQm0_L 2024-09-22T08:12:08.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.814+0000 7f05b1725800 20 get_obj_state: octx=0x7f05a8001770 obj=myfoo6:thirteen state=0x563209ce7e08 s->prefetch_data=0 2024-09-22T08:12:08.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.814+0000 7f05b1725800 20 prepare_atomic_modification: state is not atomic. state=0x563209ce7e08 2024-09-22T08:12:08.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.814+0000 7f05b1725800 20 bucket index object: :.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 2024-09-22T08:12:08.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.814+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:109 4.1c 4:3ac61c6a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ced850 con 0x7f05a8037070 2024-09-22T08:12:08.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.815+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(109 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.815+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:110 3.34s0 3:2cbb8514:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ced850 con 0x563209c977c0 2024-09-22T08:12:08.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.818+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(110 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9_thirteen [call] v34'7 uv7 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.818+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:111 4.1c 4:3ac61c6a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cee2e0 con 0x7f05a8037070 2024-09-22T08:12:08.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.818+0000 7f05b1725800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.818+0000 7f05b1725800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.818+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:112 4.3f 4:feee772d:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cefc60 con 0x563209c9c1b0 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.818+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:113 4.8 4:124ef282:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cf2520 con 0x563209ca0c90 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.818+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:114 4.30 4:0fc75699:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cefc60 con 0x563209ca0c90 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.818+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:115 4.2b 4:d5c3c293:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cf2520 con 0x563209c977c0 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.818+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== osd_op_reply(112 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(113 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:116 4.6 4:63c88326:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cefc60 con 0x563209ca0c90 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:117 4.3c 4:3f98d39b:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cf7a60 con 0x563209c977c0 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:118 4.4 4:22deaf00:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfa860 con 0x7f05a8037070 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:119 4.1 4:815e77c2:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd680 con 0x563209c9c1b0 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 31 ==== osd_op_reply(114 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:120 4.5 4:a3efa100:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd6c0 con 0x563209ca0c90 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(115 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:121 4.1c 4:3ac61c6a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfa860 con 0x7f05a8037070 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:122 4.1e 4:78e3914f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd6c0 con 0x7f05a8037070 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 32 ==== osd_op_reply(116 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 33 ==== osd_op_reply(120 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 35 ==== osd_op_reply(117 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 24 ==== osd_op_reply(119 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.7 [call out=89b] v0'0 uv12 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.819+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(118 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.6 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(122 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(111 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f0490ff9640 20 handle_completion(): completion ok for obj=thirteen 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(121 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 [call out=128b] v0'0 uv13 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9])"; uploads.size()=0; is_truncated=0 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:123 4.3f 4:feee772d:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd6c0 con 0x563209c9c1b0 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:124 4.8 4:124ef282:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd090 con 0x563209ca0c90 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:125 4.30 4:0fc75699:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cea190 con 0x563209ca0c90 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:126 4.2b 4:d5c3c293:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cebac0 con 0x563209c977c0 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:127 4.6 4:63c88326:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd090 con 0x563209ca0c90 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:128 4.3c 4:3f98d39b:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd6c0 con 0x563209c977c0 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:129 4.4 4:22deaf00:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cea190 con 0x7f05a8037070 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:130 4.1 4:815e77c2:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd090 con 0x563209c9c1b0 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 36 ==== osd_op_reply(126 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 25 ==== osd_op_reply(123 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 34 ==== osd_op_reply(124 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 37 ==== osd_op_reply(128 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:131 4.5 4:a3efa100:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cebac0 con 0x563209ca0c90 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:132 4.1c 4:3ac61c6a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd090 con 0x7f05a8037070 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 35 ==== osd_op_reply(125 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:133 4.1e 4:78e3914f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd6c0 con 0x7f05a8037070 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.820+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 36 ==== osd_op_reply(127 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.821+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(129 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.6 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.821+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 26 ==== osd_op_reply(130 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.7 [call out=89b] v0'0 uv12 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.821+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 37 ==== osd_op_reply(131 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.821+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(132 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 [call out=128b] v0'0 uv13 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.821+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== osd_op_reply(133 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.821+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd030 con 0x563209c977c0 2024-09-22T08:12:08.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.822+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 38 ==== osd_op_reply(134 bud.buckets [call] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.822+0000 7f05b1725800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-22T08:12:08.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.822+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.822+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd030 con 0x563209c977c0 2024-09-22T08:12:08.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.822+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 39 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.822+0000 7f05b1725800 20 rados_obj.operate() r=0 bl.length=166 2024-09-22T08:12:08.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.822+0000 7f05b1725800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-22T08:12:08.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.822+0000 7f05b1725800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-22T08:12:08.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.822+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd030 con 0x563209c977c0 2024-09-22T08:12:08.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.823+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 40 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.823+0000 7f05b1725800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-22T08:12:08.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.823+0000 7f05b1725800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-22T08:12:08.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.823+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94772912905168 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd030 con 0x563209c9c1b0 2024-09-22T08:12:08.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.823+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 27 ==== watch-notify(notify (1) cookie 94772912619520 notify 146028888081 ret 0) ==== 192+0+0 (crc 0 0 0) 0x563209cb86f0 con 0x563209c9c1b0 2024-09-22T08:12:08.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.823+0000 7f0490ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94772912619520 notifier 4752 bl.length()=150 2024-09-22T08:12:08.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.823+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 28 ==== osd_op_reply(137 notify.3 [notify cookie 94772912905168 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.823+0000 7f0490ff9640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0470003d60 con 0x563209c9c1b0 2024-09-22T08:12:08.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.824+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 29 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.824+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 30 ==== watch-notify(notify_complete (2) cookie 94772912905168 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563209c8c4c0 con 0x563209c9c1b0 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.824+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:139 8.19 8:9879c807:root::.bucket.meta.myfoo6%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd030 con 0x563209c977c0 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 41 ==== osd_op_reply(139 .bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 [call,call,delete] v34'9 uv9 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 from cache 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9, ofs0, ns] 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94772912905168 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd030 con 0x563209c977c0 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 42 ==== watch-notify(notify (1) cookie 94772912613152 notify 146028888092 ret 0) ==== 249+0+0 (crc 0 0 0) 0x563209ce65e0 con 0x563209c977c0 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f0483fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94772912613152 notifier 4752 bl.length()=207 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f0483fff640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f03d40032c0 con 0x563209c977c0 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 43 ==== osd_op_reply(140 notify.1 [notify cookie 94772912905168 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 44 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 45 ==== watch-notify(notify_complete (2) cookie 94772912905168 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563209cb7690 con 0x563209c977c0 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:142 4.3f 4:feee772d:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd030 con 0x563209c9c1b0 2024-09-22T08:12:08.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:143 4.8 4:124ef282:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd6c0 con 0x563209ca0c90 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:144 4.30 4:0fc75699:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ce5f30 con 0x563209ca0c90 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:145 4.2b 4:d5c3c293:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cef100 con 0x563209c977c0 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:146 4.6 4:63c88326:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cec350 con 0x563209ca0c90 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:147 4.3c 4:3f98d39b:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd030 con 0x563209c977c0 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:148 4.4 4:22deaf00:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd6c0 con 0x7f05a8037070 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:149 4.1 4:815e77c2:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ce5f30 con 0x563209c9c1b0 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:150 4.5 4:a3efa100:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cef100 con 0x563209ca0c90 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:151 4.1c 4:3ac61c6a:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cec350 con 0x7f05a8037070 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.825+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:152 4.1e 4:78e3914f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cfd030 con 0x7f05a8037070 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.827+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(148 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.6 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.827+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 35 ==== osd_op_reply(152 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.10 [delete] v34'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.827+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 36 ==== osd_op_reply(151 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.9 [delete] v34'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.827+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 46 ==== osd_op_reply(147 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.5 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.827+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 38 ==== osd_op_reply(146 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.4 [delete] v34'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 39 ==== osd_op_reply(143 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.1 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 40 ==== osd_op_reply(150 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.8 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 41 ==== osd_op_reply(144 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.2 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 31 ==== osd_op_reply(142 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.0 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 32 ==== osd_op_reply(149 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.7 [delete] v34'13 uv13 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 47 ==== osd_op_reply(145 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9.3 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05b1725800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 : miss 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05b1725800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:153 6.5 6:a3209014:::pubsub..bucket.myfoo6%2fcc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cec350 con 0x563209c9c1b0 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 33 ==== osd_op_reply(153 pubsub..bucket.myfoo6/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05b1725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05b1725800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 info.flags=0x0 2024-09-22T08:12:08.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05b1725800 10 adding default.rgw.log++pubsub..bucket.myfoo6/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 to cache LRU end 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.828+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:154 6.5 6:a3209014:::pubsub..bucket.myfoo6%2fcc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209ce5f30 con 0x563209c9c1b0 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.829+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 34 ==== osd_op_reply(154 pubsub..bucket.myfoo6/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.9 [delete] v34'17 uv15 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.829+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cec350 con 0x563209c977c0 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.830+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 48 ==== osd_op_reply(155 bud.buckets [call] v34'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.830+0000 7f05b1725800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.830+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cec350 con 0x563209c977c0 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.831+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 49 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.831+0000 7f05b1725800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.831+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94772912905104 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cec350 con 0x7f05a8037070 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.831+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 37 ==== watch-notify(notify (1) cookie 94772912627152 notify 146028888102 ret 0) ==== 212+0+0 (crc 0 0 0) 0x563209cb7690 con 0x7f05a8037070 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.831+0000 7f0483fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94772912627152 notifier 4752 bl.length()=170 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.831+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 38 ==== osd_op_reply(157 notify.5 [notify cookie 94772912905104 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.831+0000 7f0483fff640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f03d40032a0 con 0x7f05a8037070 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.832+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 39 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.832+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 40 ==== watch-notify(notify_complete (2) cookie 94772912905104 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563209cb7a70 con 0x7f05a8037070 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.832+0000 7f05b1725800 10 removing email index: 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.832+0000 7f05b1725800 10 removing user buckets index 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.832+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cec350 con 0x563209c977c0 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 50 ==== osd_op_reply(159 bud.buckets [delete] v34'11 uv11 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f05b1725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94772912905104 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cec350 con 0x7f05a8037070 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 41 ==== watch-notify(notify (1) cookie 94772912624544 notify 146028888103 ret 0) ==== 202+0+0 (crc 0 0 0) 0x563209cb7a70 con 0x7f05a8037070 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f0490ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94772912624544 notifier 4752 bl.length()=160 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f0490ff9640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0470003d60 con 0x7f05a8037070 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 42 ==== osd_op_reply(160 notify.6 [notify cookie 94772912905104 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 43 ==== watch-notify(notify_complete (2) cookie 94772912905104 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563209cb5d80 con 0x7f05a8037070 2024-09-22T08:12:08.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 44 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f05b1725800 10 removing user index: bud 2024-09-22T08:12:08.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.833+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cec350 con 0x563209c9c1b0 2024-09-22T08:12:08.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.834+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 35 ==== osd_op_reply(162 bud [call,call,delete] v34'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.834+0000 7f05b1725800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-22T08:12:08.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.834+0000 7f05b1725800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-22T08:12:08.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.834+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94772912905104 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563209cec350 con 0x7f05a8037070 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.835+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 45 ==== watch-notify(notify (1) cookie 94772912627152 notify 146028888104 ret 0) ==== 194+0+0 (crc 0 0 0) 0x563209cb5d80 con 0x7f05a8037070 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.835+0000 7f0483fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94772912627152 notifier 4752 bl.length()=152 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.835+0000 7f0483fff640 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f03d40032a0 con 0x7f05a8037070 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.835+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 46 ==== osd_op_reply(163 notify.5 [notify cookie 94772912905104 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.835+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.835+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 48 ==== watch-notify(notify_complete (2) cookie 94772912905104 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f05a4018040 con 0x7f05a8037070 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.836+0000 7f0463fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.836+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94772912645504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb4f00 con 0x563209c977c0 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.837+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 51 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94772912645504] v34'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.837+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94772912607216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb4f00 con 0x563209c9c1b0 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.838+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 36 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94772912607216] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.838+0000 7f05b1725800 20 remove_watcher() i=0 2024-09-22T08:12:08.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.838+0000 7f05b1725800 2 removed watcher, disabling cache 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.838+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94772912613152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb4f00 con 0x563209c977c0 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.839+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 52 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94772912613152] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.839+0000 7f05b1725800 20 remove_watcher() i=1 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.839+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94772912617216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb4f00 con 0x563209ca0c90 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.840+0000 7f05ad3ae640 1 -- 172.21.15.165:0/2310281634 <== osd.3 v2:172.21.15.165:6800/215521179 42 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94772912617216] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a007f070 con 0x563209ca0c90 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.840+0000 7f05b1725800 20 remove_watcher() i=2 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.840+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94772912619520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb4f00 con 0x563209c9c1b0 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.841+0000 7f05adbaf640 1 -- 172.21.15.165:0/2310281634 <== osd.2 v2:172.21.15.165:6808/3197121696 37 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94772912619520] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a802a070 con 0x563209c9c1b0 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.841+0000 7f05b1725800 20 remove_watcher() i=3 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.841+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94772912622240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb4f00 con 0x563209c977c0 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.842+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.1 v2:172.21.15.165:6816/2347568643 53 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94772912622240] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x563209c977c0 2024-09-22T08:12:08.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.842+0000 7f05b1725800 20 remove_watcher() i=4 2024-09-22T08:12:08.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.842+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94772912627152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb4f00 con 0x7f05a8037070 2024-09-22T08:12:08.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.843+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 49 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94772912627152] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.843+0000 7f05b1725800 20 remove_watcher() i=5 2024-09-22T08:12:08.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.843+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94772912624544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb4f00 con 0x7f05a8037070 2024-09-22T08:12:08.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.844+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 50 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94772912624544] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.844+0000 7f05b1725800 20 remove_watcher() i=6 2024-09-22T08:12:08.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.844+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94772912629392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563209cb4f00 con 0x7f05a8037070 2024-09-22T08:12:08.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.845+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 <== osd.0 v2:172.21.15.53:6800/2902972477 51 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94772912629392] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05a402b040 con 0x7f05a8037070 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.845+0000 7f05b1725800 20 remove_watcher() i=7 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f05a8037070 msgr2=0x7f05a80458e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f05a8037070 0x7f05a80458e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209c977c0 msgr2=0x563209c99c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209c977c0 0x563209c99c80 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c9c1b0 msgr2=0x563209c9e5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c9c1b0 0x563209c9e5a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563209ca0c90 msgr2=0x563209ca3150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x563209ca0c90 0x563209ca3150 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f047803cfb0 msgr2=0x7f047803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f047803cfb0 0x7f047803f470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f05a0080710 tx=0x7f05a008f000 comp rx=0 tx=0).stop 2024-09-22T08:12:08.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 msgr2=0x563209c8bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05acbad640 1 -- 172.21.15.165:0/2310281634 reap_dead start 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c8bcd0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f05a802bfd0 tx=0x7f05a80546a0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 shutdown_connections 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/2310281634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c84680 0x563209c8bcd0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 >> 172.21.15.165:0/2310281634 conn(0x563209c80a80 msgr2=0x563209c7ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 shutdown_connections 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/2310281634 wait complete. 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/3720486077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f048403d000 msgr2=0x7f048403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/3720486077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f048403d000 0x7f048403f4c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x563209c5ed20 tx=0x7f05a0080610 comp rx=0 tx=0).stop 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/3720486077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c77c20 msgr2=0x563209c78040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/3720486077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c77c20 0x563209c78040 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x563209c5dbd0 tx=0x7f05a8018830 comp rx=0 tx=0).stop 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/3720486077 shutdown_connections 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/3720486077 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f048403d000 0x7f048403f4c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 --2- 172.21.15.165:0/3720486077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209c77c20 0x563209c78040 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/3720486077 >> 172.21.15.165:0/3720486077 conn(0x563209c6bfd0 msgr2=0x563209c6c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/3720486077 shutdown_connections 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.846+0000 7f05b1725800 1 -- 172.21.15.165:0/3720486077 wait complete. 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209b68a10 msgr2=0x563209c64220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209b68a10 0x563209c64220 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c66640 msgr2=0x563209c68ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c66640 0x563209c68ae0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f049403cfb0 msgr2=0x7f049403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f049403cfb0 0x7f049403f470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f05a4001e30 tx=0x7f05a4001390 comp rx=0 tx=0).stop 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 msgr2=0x563209c5cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c5cbd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f05a0067040 tx=0x7f05a0002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 shutdown_connections 2024-09-22T08:12:08.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x563209c66640 0x563209c68ae0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x563209b68a10 0x563209c64220 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f049403cfb0 0x7f049403f470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 --2- 172.21.15.165:0/3063657845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563209ad6d10 0x563209c5cbd0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 >> 172.21.15.165:0/3063657845 conn(0x563209b5dbb0 msgr2=0x563209c4f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 shutdown_connections 2024-09-22T08:12:08.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.847+0000 7f05b1725800 1 -- 172.21.15.165:0/3063657845 wait complete. 2024-09-22T08:12:08.856 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-22T08:12:08.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-22T08:12:08.856 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-22T08:12:08.902 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:08.902 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:08.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.902+0000 7f1f0d020800 1 Processor -- start 2024-09-22T08:12:08.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.902+0000 7f1f0d020800 1 -- start start 2024-09-22T08:12:08.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.902+0000 7f1f0d020800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5602e41c49d0 0x5602e41c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.902+0000 7f1f0d020800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5602e404ba20 con 0x5602e4133d30 2024-09-22T08:12:08.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.902+0000 7f1f0d020800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5602e404b7d0 con 0x5602e41c49d0 2024-09-22T08:12:08.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.902+0000 7f1f0a310640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5602e41c49d0 0x5602e41c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.902+0000 7f1f0a310640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5602e41c49d0 0x5602e41c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56716/0 (socket says 172.21.15.165:56716) 2024-09-22T08:12:08.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.902+0000 7f1f0a310640 1 -- 172.21.15.165:0/814905425 learned_addr learned my addr 172.21.15.165:0/814905425 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.903+0000 7f1f0a310640 1 -- 172.21.15.165:0/814905425 >> v1:172.21.15.53:6789/0 conn(0x5602e4133d30 legacy=0x5602e41c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.903+0000 7f1f0a310640 1 -- 172.21.15.165:0/814905425 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e41c8570 con 0x5602e41c49d0 2024-09-22T08:12:08.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f0a310640 1 --2- 172.21.15.165:0/814905425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e41c49d0 0x5602e41c6e90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000a520 tx=0x7f1f00045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bc818cd2cc078a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f09b0f640 1 -- 172.21.15.165:0/814905425 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f00055070 con 0x5602e41c49d0 2024-09-22T08:12:08.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f09b0f640 1 -- 172.21.15.165:0/814905425 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f000515b0 con 0x5602e41c49d0 2024-09-22T08:12:08.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f09b0f640 1 -- 172.21.15.165:0/814905425 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f000518d0 con 0x5602e41c49d0 2024-09-22T08:12:08.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f0d020800 1 -- 172.21.15.165:0/814905425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e41c49d0 msgr2=0x5602e41c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f0d020800 1 --2- 172.21.15.165:0/814905425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e41c49d0 0x5602e41c6e90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000a520 tx=0x7f1f00045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f0d020800 1 -- 172.21.15.165:0/814905425 shutdown_connections 2024-09-22T08:12:08.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f0d020800 1 --2- 172.21.15.165:0/814905425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e41c49d0 0x5602e41c6e90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f0d020800 1 -- 172.21.15.165:0/814905425 >> 172.21.15.165:0/814905425 conn(0x5602e41babb0 msgr2=0x5602e41bd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f0d020800 1 -- 172.21.15.165:0/814905425 shutdown_connections 2024-09-22T08:12:08.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.905+0000 7f1f0d020800 1 -- 172.21.15.165:0/814905425 wait complete. 2024-09-22T08:12:08.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.919+0000 7f1f0d020800 1 Processor -- start 2024-09-22T08:12:08.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.919+0000 7f1f0d020800 1 -- start start 2024-09-22T08:12:08.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.919+0000 7f1f0d020800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e41c0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.919+0000 7f1f0d020800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5602e4058dd0 con 0x5602e4133d30 2024-09-22T08:12:08.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.919+0000 7f1f0ab11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e41c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.919+0000 7f1f0ab11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e41c0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56718/0 (socket says 172.21.15.165:56718) 2024-09-22T08:12:08.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.919+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3660160060 learned_addr learned my addr 172.21.15.165:0/3660160060 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.920+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3660160060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e41c0e70 con 0x5602e4133d30 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.920+0000 7f1f0ab11640 1 --2- 172.21.15.165:0/3660160060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e41c0880 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1efc001da0 tx=0x7f1efc00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0531fb0215ab03 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.920+0000 7f1df8e09640 1 -- 172.21.15.165:0/3660160060 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1efc00f400 con 0x5602e4133d30 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.920+0000 7f1df8e09640 1 -- 172.21.15.165:0/3660160060 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1efc00f5a0 con 0x5602e4133d30 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.920+0000 7f1df8e09640 1 -- 172.21.15.165:0/3660160060 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1efc00f8c0 con 0x5602e4133d30 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 -- 172.21.15.165:0/3660160060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 msgr2=0x5602e41c0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3660160060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e41c0880 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1efc001da0 tx=0x7f1efc00b5b0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 -- 172.21.15.165:0/3660160060 shutdown_connections 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3660160060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e41c0880 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 -- 172.21.15.165:0/3660160060 >> 172.21.15.165:0/3660160060 conn(0x5602e41babb0 msgr2=0x5602e42ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 -- 172.21.15.165:0/3660160060 shutdown_connections 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 -- 172.21.15.165:0/3660160060 wait complete. 2024-09-22T08:12:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 Processor -- start 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 -- start start 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e42b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.921+0000 7f1f0d020800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5602e41c7810 con 0x5602e4133d30 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.922+0000 7f1f0ab11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e42b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.922+0000 7f1f0ab11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e42b9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56720/0 (socket says 172.21.15.165:56720) 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.922+0000 7f1f0ab11640 1 -- 172.21.15.165:0/2908612598 learned_addr learned my addr 172.21.15.165:0/2908612598 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.922+0000 7f1f0ab11640 1 -- 172.21.15.165:0/2908612598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e42ba230 con 0x5602e4133d30 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.922+0000 7f1f0ab11640 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e42b9cd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1efc000c00 tx=0x7f1efc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.922+0000 7f1df7606640 1 -- 172.21.15.165:0/2908612598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1efc01a7c0 con 0x5602e4133d30 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.922+0000 7f1df7606640 1 -- 172.21.15.165:0/2908612598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1efc01a960 con 0x5602e4133d30 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.922+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602e42ba4c0 con 0x5602e4133d30 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.922+0000 7f1df7606640 1 -- 172.21.15.165:0/2908612598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1efc01ac40 con 0x5602e4133d30 2024-09-22T08:12:08.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.922+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e42bb0d0 con 0x5602e4133d30 2024-09-22T08:12:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.923+0000 7f1df7606640 1 -- 172.21.15.165:0/2908612598 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1efc017070 con 0x5602e4133d30 2024-09-22T08:12:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.924+0000 7f1df7606640 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1df003cfb0 0x7f1df003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.924+0000 7f1df7606640 1 -- 172.21.15.165:0/2908612598 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1efc015020 con 0x5602e4133d30 2024-09-22T08:12:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.924+0000 7f1f0a310640 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1df003cfb0 0x7f1df003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.924+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e41c49d0 0x5602e42c1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.924+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42c1860 con 0x5602e41c49d0 2024-09-22T08:12:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.924+0000 7f1f0b312640 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e41c49d0 0x5602e42c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.924+0000 7f1f0a310640 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1df003cfb0 0x7f1df003f470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1f00057000 tx=0x7f1f00052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.924+0000 7f1f0b312640 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e41c49d0 0x5602e42c1320 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.924+0000 7f1f0b312640 1 -- 172.21.15.165:0/2908612598 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f0400a4d0 con 0x5602e41c49d0 2024-09-22T08:12:08.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.924+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42c1c00 con 0x5602e41c49d0 2024-09-22T08:12:08.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.925+0000 7f1f0b312640 1 -- 172.21.15.165:0/2908612598 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f0400a4d0 con 0x5602e41c49d0 2024-09-22T08:12:08.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.925+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42c3740 0x5602e42c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.925+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42c6370 con 0x5602e42c3740 2024-09-22T08:12:08.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.925+0000 7f1f0ab11640 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42c3740 0x5602e42c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.925+0000 7f1f0ab11640 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42c3740 0x5602e42c5be0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.925+0000 7f1f0ab11640 1 -- 172.21.15.165:0/2908612598 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42c3740 2024-09-22T08:12:08.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.925+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42c2450 con 0x5602e41c49d0 2024-09-22T08:12:08.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.926+0000 7f1f0b312640 1 -- 172.21.15.165:0/2908612598 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f0400a4d0 con 0x5602e41c49d0 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.926+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42c28b0 con 0x5602e41c49d0 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.926+0000 7f1f0b312640 1 -- 172.21.15.165:0/2908612598 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1f0400a4d0 con 0x5602e41c49d0 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.926+0000 7f1f0d020800 1 Processor -- start 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.926+0000 7f1f0d020800 1 -- start start 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.926+0000 7f1f0d020800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42d4d20 0x5602e42d5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.926+0000 7f1f0d020800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5602e40b7d50 con 0x5602e42d4d20 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.927+0000 7f1f0b312640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42d4d20 0x5602e42d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.927+0000 7f1f0b312640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42d4d20 0x5602e42d5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56722/0 (socket says 172.21.15.165:56722) 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.927+0000 7f1f0b312640 1 -- 172.21.15.165:0/4167544464 learned_addr learned my addr 172.21.15.165:0/4167544464 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.927+0000 7f1f0b312640 1 -- 172.21.15.165:0/4167544464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e42d5780 con 0x5602e42d4d20 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.927+0000 7f1f0b312640 1 --2- 172.21.15.165:0/4167544464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42d4d20 0x5602e42d5140 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x5602e42bacd0 tx=0x7f1f04018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.927+0000 7f1df4e01640 1 -- 172.21.15.165:0/4167544464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f04014450 con 0x5602e42d4d20 2024-09-22T08:12:08.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.927+0000 7f1df4e01640 1 -- 172.21.15.165:0/4167544464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f04014610 con 0x5602e42d4d20 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.927+0000 7f1df4e01640 1 -- 172.21.15.165:0/4167544464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f04014930 con 0x5602e42d4d20 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.927+0000 7f1f0d020800 1 -- 172.21.15.165:0/4167544464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602e42d5fb0 con 0x5602e42d4d20 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.928+0000 7f1f0d020800 1 -- 172.21.15.165:0/4167544464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e42d6550 con 0x5602e42d4d20 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.928+0000 7f1df4e01640 1 -- 172.21.15.165:0/4167544464 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1f04011040 con 0x5602e42d4d20 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.928+0000 7f1df4e01640 1 --2- 172.21.15.165:0/4167544464 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1de403cfb0 0x7f1de403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.928+0000 7f1df4e01640 1 -- 172.21.15.165:0/4167544464 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1f0401e070 con 0x5602e42d4d20 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.928+0000 7f1f0ab11640 1 --2- 172.21.15.165:0/4167544464 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1de403cfb0 0x7f1de403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.929+0000 7f1f0d020800 1 Processor -- start 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.929+0000 7f1f0d020800 1 -- start start 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.929+0000 7f1f0ab11640 1 --2- 172.21.15.165:0/4167544464 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1de403cfb0 0x7f1de403f470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x5602e42bbe20 tx=0x7f1efc01d6e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.929+0000 7f1f0d020800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.929+0000 7f1f0d020800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5602e41bf2c0 con 0x5602e42e17c0 2024-09-22T08:12:08.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.929+0000 7f1f0b312640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.929+0000 7f1f0b312640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56730/0 (socket says 172.21.15.165:56730) 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.929+0000 7f1f0b312640 1 -- 172.21.15.165:0/2991792410 learned_addr learned my addr 172.21.15.165:0/2991792410 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.929+0000 7f1f0b312640 1 -- 172.21.15.165:0/2991792410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e42e21b0 con 0x5602e42e17c0 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.929+0000 7f1f0b312640 1 --2- 172.21.15.165:0/2991792410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e1bc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1f04016fd0 tx=0x7f1f04011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c10198039f0b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1dee7fc640 1 -- 172.21.15.165:0/2991792410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f040532d0 con 0x5602e42e17c0 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1dee7fc640 1 -- 172.21.15.165:0/2991792410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f040167c0 con 0x5602e42e17c0 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1dee7fc640 1 -- 172.21.15.165:0/2991792410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f04011330 con 0x5602e42e17c0 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1f0d020800 1 -- 172.21.15.165:0/2991792410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 msgr2=0x5602e42e1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2991792410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e1bc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1f04016fd0 tx=0x7f1f04011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1f0d020800 1 -- 172.21.15.165:0/2991792410 shutdown_connections 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2991792410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e1bc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1f0d020800 1 -- 172.21.15.165:0/2991792410 >> 172.21.15.165:0/2991792410 conn(0x5602e42ddbc0 msgr2=0x5602e42dbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:08.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1f0d020800 1 -- 172.21.15.165:0/2991792410 shutdown_connections 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1f0d020800 1 -- 172.21.15.165:0/2991792410 wait complete. 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1f0d020800 1 Processor -- start 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.930+0000 7f1f0d020800 1 -- start start 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1f0d020800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1f0d020800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5602e42e27d0 con 0x5602e42e17c0 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1f0b312640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1f0b312640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:56738/0 (socket says 172.21.15.165:56738) 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 learned_addr learned my addr 172.21.15.165:0/3710110000 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e42e9300 con 0x5602e42e17c0 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1f0b312640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e8da0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1f04011fd0 tx=0x7f1f04054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1decff9640 1 -- 172.21.15.165:0/3710110000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f04031020 con 0x5602e42e17c0 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1decff9640 1 -- 172.21.15.165:0/3710110000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f04045960 con 0x5602e42e17c0 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602e42e9590 con 0x5602e42e17c0 2024-09-22T08:12:08.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1decff9640 1 -- 172.21.15.165:0/3710110000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f04045c60 con 0x5602e42e17c0 2024-09-22T08:12:08.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.931+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e42e9f10 con 0x5602e42e17c0 2024-09-22T08:12:08.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.932+0000 7f1decff9640 1 -- 172.21.15.165:0/3710110000 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1f040548d0 con 0x5602e42e17c0 2024-09-22T08:12:08.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.933+0000 7f1decff9640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1dd403d000 0x7f1dd403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.933+0000 7f1decff9640 1 -- 172.21.15.165:0/3710110000 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1f04045e00 con 0x5602e42e17c0 2024-09-22T08:12:08.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.933+0000 7f1f0ab11640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1dd403d000 0x7f1dd403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.933+0000 7f1f0ab11640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1dd403d000 0x7f1dd403f4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1efc01d7b0 tx=0x7f1efc049000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.933+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.933+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e42f4890 0x5602e42f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.933+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42f74a0 con 0x5602e42f4890 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.933+0000 7f1f0a310640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e42f4890 0x5602e42f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0a310640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e42f4890 0x5602e42f6d50 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 20 realm 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42f78d0 con 0x5602e42f4890 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42f81a0 con 0x5602e42f4890 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.934+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42f8540 con 0x5602e42f4890 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0d020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42f92a0 0x5602e42fb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42fbca0 con 0x5602e42f92a0 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0b312640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42f92a0 0x5602e42fb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0b312640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42f92a0 0x5602e42fb690 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0d020800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:08.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0d020800 20 searching for the correct realm 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5602e42fdc50 0x5602e4300110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42fdc50 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.935+0000 7f1f0ab11640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5602e42fdc50 0x5602e4300110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.936+0000 7f1f0ab11640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5602e42fdc50 0x5602e4300110 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.936+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.936+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f92a0 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.936+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.936+0000 7f1f0b312640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1f04036020 0x7f1f04036400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.936+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x7f1f04036020 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.937+0000 7f1f0a310640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1f04036020 0x7f1f04036400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.937+0000 7f1f0a310640 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1f04036020 0x7f1f04036400 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.937+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x7f1f04036020 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.937+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f4890 2024-09-22T08:12:08.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.937+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.937+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f4890 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.938+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.938+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x7f1f04036020 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.938+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x7f1f04036020 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.938+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f92a0 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.938+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.938+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f92a0 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.938+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.938+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42fdc50 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.939+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.939+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f4890 2024-09-22T08:12:08.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.939+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.939+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x7f1f04036020 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.939+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x7f1f04036020 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.939+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f4890 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.939+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.939+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f92a0 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.940+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.940+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42fdc50 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.940+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.940+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42fdc50 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.940+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.940+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x7f1f04036020 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.940+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x7f1f04036020 2024-09-22T08:12:08.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.940+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42fdc50 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.941+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.941+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42fdc50 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.941+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.941+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f4890 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.941+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.941+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f4890 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.941+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.941+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x7f1f04036020 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.941+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x7f1f04036020 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.941+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42fdc50 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.942+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.942+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f92a0 2024-09-22T08:12:08.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.942+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.942+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f4890 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.942+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.942+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x7f1f04036020 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.942+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x7f1f04036020 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.942+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42fdc50 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.943+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.943+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x7f1f04036020 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.943+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x7f1f04036020 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.943+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f92a0 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.943+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.943+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42fdc50 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.943+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.943+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x7f1f04036020 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f00057030 con 0x7f1f04036020 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f4890 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300790 con 0x5602e42f92a0 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:08.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42fc660 con 0x5602e42f4890 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.944+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e42fcf00 con 0x5602e42f4890 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f00057030 con 0x5602e42f4890 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300c10 con 0x5602e42f4890 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 20 zone default found 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 4 Realm: () 2024-09-22T08:12:08.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 20 zonegroup default 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4300fb0 con 0x7f1f04036020 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4302de0 con 0x5602e42fdc50 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.945+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43032c0 con 0x5602e42fdc50 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.946+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.946+0000 7f1f0d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.946+0000 7f1f0d020800 20 started sync module instance, tier type = 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.946+0000 7f1f0d020800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.946+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4302280 con 0x5602e42f92a0 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.947+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.947+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94570418284144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4303bd0 con 0x5602e42f92a0 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.947+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4304420 con 0x5602e42f4890 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.948+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94570418284144] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.948+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.948+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94570418288416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4304090 con 0x5602e42f4890 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.948+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4304bb0 con 0x5602e42fdc50 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.949+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.949+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94570418292352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4305450 con 0x5602e42fdc50 2024-09-22T08:12:08.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.949+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4305f40 con 0x5602e42f92a0 2024-09-22T08:12:08.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.950+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94570418288416] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.950+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94570418292352] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.950+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.950+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94570418294688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4303b40 con 0x5602e42f92a0 2024-09-22T08:12:08.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.950+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4306820 con 0x5602e42f4890 2024-09-22T08:12:08.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.952+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.952+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94570418299696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4306790 con 0x5602e42f4890 2024-09-22T08:12:08.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.952+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4307810 con 0x7f1f04036020 2024-09-22T08:12:08.966 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.952+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94570418294688] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.953+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.953+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94570418303712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e43077d0 con 0x7f1f04036020 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.953+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94570418299696] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.953+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4308220 con 0x7f1f04036020 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.954+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94570418303712] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.954+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.954+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94570418297360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4307d70 con 0x7f1f04036020 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.954+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4308ac0 con 0x7f1f04036020 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.955+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94570418297360] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.955+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.955+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94570418301968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4307d70 con 0x7f1f04036020 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.955+0000 7f1f0d020800 20 add_watcher() i=0 2024-09-22T08:12:08.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.955+0000 7f1f0d020800 20 add_watcher() i=1 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.955+0000 7f1f0d020800 20 add_watcher() i=2 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.955+0000 7f1f0d020800 20 add_watcher() i=3 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.955+0000 7f1f0d020800 20 add_watcher() i=4 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.955+0000 7f1f0d020800 20 add_watcher() i=5 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.955+0000 7f1f0d020800 20 add_watcher() i=6 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.956+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94570418301968] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.956+0000 7f1f0d020800 20 add_watcher() i=7 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.956+0000 7f1f0d020800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.956+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e430bb50 con 0x5602e42f4890 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.956+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.956+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94570418308624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4308ee0 con 0x5602e42f4890 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.957+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94570418308624] v34'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.957+0000 7f1dc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.957+0000 7f1f0d020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.957+0000 7f1f0d020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.958+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e43146e0 con 0x5602e42f4890 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.959+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.959+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4314d90 con 0x7f1f04036020 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.960+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.960+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e43151d0 con 0x5602e42fdc50 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.961+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.961+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4315a20 con 0x5602e42f4890 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.962+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.962+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4312520 con 0x5602e42f92a0 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.963+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.963+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4312520 con 0x5602e42fdc50 2024-09-22T08:12:08.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.964+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.964+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316580 con 0x5602e42f4890 2024-09-22T08:12:08.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.965+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.965+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316580 con 0x7f1f04036020 2024-09-22T08:12:08.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.966+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'48 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.966+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316580 con 0x5602e42f92a0 2024-09-22T08:12:08.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.967+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.967+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316580 con 0x5602e42fdc50 2024-09-22T08:12:08.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.968+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.968+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42f92a0 2024-09-22T08:12:08.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.969+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.969+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x7f1f04036020 2024-09-22T08:12:08.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.970+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.970+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42f92a0 2024-09-22T08:12:08.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.971+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.971+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x7f1f04036020 2024-09-22T08:12:08.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.972+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.972+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42f4890 2024-09-22T08:12:08.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.973+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.973+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42fdc50 2024-09-22T08:12:08.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.974+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.975+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42f92a0 2024-09-22T08:12:08.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.975+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.976+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42fdc50 2024-09-22T08:12:08.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.976+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.976+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42f4890 2024-09-22T08:12:08.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.978+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.978+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42f4890 2024-09-22T08:12:08.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.979+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.979+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42fdc50 2024-09-22T08:12:08.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.979+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.979+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42f92a0 2024-09-22T08:12:08.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.980+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.980+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42fdc50 2024-09-22T08:12:08.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.981+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.981+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42fdc50 2024-09-22T08:12:08.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.982+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.982+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42fdc50 2024-09-22T08:12:08.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.983+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.983+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42fdc50 2024-09-22T08:12:08.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.984+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.984+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x7f1f04036020 2024-09-22T08:12:08.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.985+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.985+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42fdc50 2024-09-22T08:12:08.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.986+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.986+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x7f1f04036020 2024-09-22T08:12:08.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.987+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'49 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.987+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42fdc50 2024-09-22T08:12:08.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.989+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.989+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x7f1f04036020 2024-09-22T08:12:08.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.990+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.990+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4316a30 con 0x5602e42f92a0 2024-09-22T08:12:08.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.991+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.991+0000 7f1d3bfff640 20 reqs_thread_entry: start 2024-09-22T08:12:08.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.991+0000 7f1f0d020800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:08.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.991+0000 7f1f0d020800 20 Filter name: none 2024-09-22T08:12:08.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.991+0000 7f1d39ffb640 20 reqs_thread_entry: start 2024-09-22T08:12:08.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.991+0000 7f1f0d020800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-22T08:12:08.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.991+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.991+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4341960 con 0x7f1f04036020 2024-09-22T08:12:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.992+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.992+0000 7f1f0d020800 20 rados_obj.operate() r=0 bl.length=380 2024-09-22T08:12:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.992+0000 7f1f0d020800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-22T08:12:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.992+0000 7f1f0d020800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-22T08:12:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.992+0000 7f1f0d020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.992+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4343f90 con 0x7f1f04036020 2024-09-22T08:12:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.992+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.992+0000 7f1f0d020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 : miss 2024-09-22T08:12:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.992+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:08.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.992+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:96 8.1d 8:bcc991f3:root::.bucket.meta.myfoo7%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4342610 con 0x7f1f04036020 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.993+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(96 .bucket.meta.myfoo7:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.993+0000 7f1f0d020800 20 rados_obj.operate() r=0 bl.length=390 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.993+0000 7f1f0d020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 info.flags=0x17 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.993+0000 7f1f0d020800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 to cache LRU end 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.993+0000 7f1f0d020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.993+0000 7f1f0d020800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.993+0000 7f1f0d020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.993+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:97 4.20 4:041562b6:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x5602e42f4890 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.993+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(97 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.993+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:98 4.36 4:6fecbe74:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x5602e42f4890 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.994+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(98 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.994+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:99 4.2e 4:75779896:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x5602e42fdc50 2024-09-22T08:12:08.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.994+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(99 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.994+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:100 4.c 4:33e40d0f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x5602e42f4890 2024-09-22T08:12:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.994+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(100 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.3 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.994+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:101 4.32 4:4e67b055:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x5602e42f4890 2024-09-22T08:12:08.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.995+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(101 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.995+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:102 4.27 4:e6036971:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x5602e42f4890 2024-09-22T08:12:08.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.995+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(102 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5 [call out=382b] v0'0 uv4 ondisk = 0) ==== 195+0+382 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:08.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.995+0000 7f1f0d020800 10 cls_bucket_list_unordered: got fourteen 2024-09-22T08:12:08.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.995+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:103 4.13 4:c848cdde:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x5602e42f92a0 2024-09-22T08:12:08.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.995+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(103 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.995+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:104 4.3e 4:7c0ac02e:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x5602e42f92a0 2024-09-22T08:12:08.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.996+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(104 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:08.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.996+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:105 4.33 4:cf2f8dab:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x7f1f04036020 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.996+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(105 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.996+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:106 4.15 4:aafe5eda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x5602e42fdc50 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(106 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:107 4.17 4:e9c11774:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43c17b0 con 0x7f1f04036020 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(107 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0d020800 20 get_obj_state: octx=0x7f1f00051ce0 obj=myfoo7:fourteen state=0x5602e43bfba8 s->prefetch_data=0 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:108 3.3ds0 3:bc6f4019:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10_fourteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4344c10 con 0x5602e42fdc50 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(108 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10_fourteen [call out=24b,getxattrs out=867b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 281+0+907 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0d020800 10 manifest: total_size = 8 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0d020800 20 get_obj_state: setting s->obj_tag to cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.13513643468510039724 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0d020800 20 get_obj_state: octx=0x7f1f00051ce0 obj=myfoo7:fourteen state=0x5602e43bfba8 s->prefetch_data=0 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0d020800 20 prepare_atomic_modification: state is not atomic. state=0x5602e43bfba8 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0d020800 20 bucket index object: :.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5 2024-09-22T08:12:09.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.997+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:109 4.27 4:e6036971:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4348840 con 0x5602e42f4890 2024-09-22T08:12:09.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.999+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(109 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:08.999+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:110 3.3ds0 3:bc6f4019:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4348840 con 0x5602e42fdc50 2024-09-22T08:12:09.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== osd_op_reply(110 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10_fourteen [call] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:111 4.27 4:e6036971:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e43492d0 con 0x5602e42f4890 2024-09-22T08:12:09.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:12:09.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:12:09.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:112 4.20 4:041562b6:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1efc028000 con 0x5602e42f4890 2024-09-22T08:12:09.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:113 4.36 4:6fecbe74:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e43492d0 con 0x5602e42f4890 2024-09-22T08:12:09.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:114 4.2e 4:75779896:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4344bd0 con 0x5602e42fdc50 2024-09-22T08:12:09.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:115 4.c 4:33e40d0f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4351ef0 con 0x5602e42f4890 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:116 4.32 4:4e67b055:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d00 con 0x5602e42f4890 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:117 4.27 4:e6036971:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4357b30 con 0x5602e42f4890 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:118 4.13 4:c848cdde:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e435a960 con 0x5602e42f92a0 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:119 4.3e 4:7c0ac02e:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e435d2e0 con 0x5602e42f92a0 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:120 4.33 4:cf2f8dab:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e435fcb0 con 0x7f1f04036020 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.000+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:121 4.15 4:aafe5eda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4362b30 con 0x5602e42fdc50 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:122 4.17 4:e9c11774:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4351ef0 con 0x7f1f04036020 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(114 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 31 ==== osd_op_reply(121 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(122 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(120 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(118 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== osd_op_reply(119 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(112 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 35 ==== osd_op_reply(113 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 36 ==== osd_op_reply(116 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.001+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 37 ==== osd_op_reply(115 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.3 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 38 ==== osd_op_reply(111 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1dedffb640 20 handle_completion(): completion ok for obj=fourteen 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 39 ==== osd_op_reply(117 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5 [call out=128b] v0'0 uv6 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10])"; uploads.size()=0; is_truncated=0 2024-09-22T08:12:09.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:123 4.20 4:041562b6:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4344c30 con 0x5602e42f4890 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:124 4.36 4:6fecbe74:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4362b30 con 0x5602e42f4890 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:125 4.2e 4:75779896:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42fdc50 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:126 4.c 4:33e40d0f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4344c30 con 0x5602e42f4890 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:127 4.32 4:4e67b055:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4362b30 con 0x5602e42f4890 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:128 4.27 4:e6036971:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f4890 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:129 4.13 4:c848cdde:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4344c30 con 0x5602e42f92a0 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:130 4.3e 4:7c0ac02e:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4362b30 con 0x5602e42f92a0 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:131 4.33 4:cf2f8dab:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:132 4.15 4:aafe5eda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4362b30 con 0x5602e42fdc50 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:133 4.17 4:e9c11774:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(133 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(131 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.002+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 32 ==== osd_op_reply(125 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.003+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 24 ==== osd_op_reply(129 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.003+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 25 ==== osd_op_reply(130 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.003+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 33 ==== osd_op_reply(132 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.003+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 40 ==== osd_op_reply(123 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.003+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 41 ==== osd_op_reply(124 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.003+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 42 ==== osd_op_reply(126 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.3 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.003+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 43 ==== osd_op_reply(127 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.003+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 44 ==== osd_op_reply(128 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5 [call out=128b] v0'0 uv6 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.003+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.004+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(134 fud.buckets [call] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.004+0000 7f1f0d020800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-22T08:12:09.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.004+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.004+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4362b30 con 0x5602e42f92a0 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.004+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 26 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.004+0000 7f1f0d020800 20 rados_obj.operate() r=0 bl.length=168 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.004+0000 7f1f0d020800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.004+0000 7f1f0d020800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.004+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f92a0 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.005+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 27 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.005+0000 7f1f0d020800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.005+0000 7f1f0d020800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.006+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94570418633520 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f92a0 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.006+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 28 ==== watch-notify(notify (1) cookie 94570418294688 notify 146028888082 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5602e4312070 con 0x5602e42f92a0 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.006+0000 7f1dedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94570418294688 notifier 4759 bl.length()=150 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.006+0000 7f1dedffb640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1d40003320 con 0x5602e42f92a0 2024-09-22T08:12:09.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.006+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 29 ==== osd_op_reply(137 notify.3 [notify cookie 94570418633520 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.006+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.006+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 31 ==== watch-notify(notify_complete (2) cookie 94570418633520 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602e42e9590 con 0x5602e42f92a0 2024-09-22T08:12:09.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.006+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:139 8.1d 8:bcc991f3:root::.bucket.meta.myfoo7%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.007+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== osd_op_reply(139 .bucket.meta.myfoo7:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.007+0000 7f1f0d020800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 from cache 2024-09-22T08:12:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.007+0000 7f1f0d020800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10, ofs0, ns] 2024-09-22T08:12:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.007+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94570418633520 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f4890 2024-09-22T08:12:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 45 ==== watch-notify(notify (1) cookie 94570418299696 notify 146028888093 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5602e4343a70 con 0x5602e42f4890 2024-09-22T08:12:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1dee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94570418299696 notifier 4759 bl.length()=208 2024-09-22T08:12:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1dee7fc640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1dd0003d60 con 0x5602e42f4890 2024-09-22T08:12:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 46 ==== osd_op_reply(140 notify.4 [notify cookie 94570418633520 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 47 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 48 ==== watch-notify(notify_complete (2) cookie 94570418633520 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602e4314090 con 0x5602e42f4890 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:142 4.20 4:041562b6:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f4890 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:143 4.36 4:6fecbe74:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4362b30 con 0x5602e42f4890 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:144 4.2e 4:75779896:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4357b30 con 0x5602e42fdc50 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:145 4.c 4:33e40d0f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4347340 con 0x5602e42f4890 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:146 4.32 4:4e67b055:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4347c10 con 0x5602e42f4890 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:147 4.27 4:e6036971:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4342f10 con 0x5602e42f4890 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:148 4.13 4:c848cdde:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f92a0 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:149 4.3e 4:7c0ac02e:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4355680 con 0x5602e42f92a0 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:150 4.33 4:cf2f8dab:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4362b30 con 0x7f1f04036020 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:151 4.15 4:aafe5eda:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4347340 con 0x5602e42fdc50 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.008+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:152 4.17 4:e9c11774:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4347c10 con 0x7f1f04036020 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.010+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 49 ==== osd_op_reply(142 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.0 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.010+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(150 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.8 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.010+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 32 ==== osd_op_reply(148 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.6 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.010+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 50 ==== osd_op_reply(143 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.1 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.010+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 51 ==== osd_op_reply(146 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.4 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.010+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 35 ==== osd_op_reply(152 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.10 [delete] v34'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.010+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 33 ==== osd_op_reply(149 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.7 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 34 ==== osd_op_reply(151 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.9 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 52 ==== osd_op_reply(147 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.5 [delete] v34'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 53 ==== osd_op_reply(145 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.3 [delete] v34'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 35 ==== osd_op_reply(144 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10.2 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0d020800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 : miss 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0d020800 20 rados->read ofs=0 len=0 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:153 6.b 6:d1f6b33f:::pubsub..bucket.myfoo7%2fcc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4342f10 con 0x5602e42fdc50 2024-09-22T08:12:09.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 36 ==== osd_op_reply(153 pubsub..bucket.myfoo7/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0d020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0d020800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 info.flags=0x0 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0d020800 10 adding default.rgw.log++pubsub..bucket.myfoo7/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 to cache LRU end 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.011+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:154 6.b 6:d1f6b33f:::pubsub..bucket.myfoo7%2fcc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42fdc50 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.012+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 37 ==== osd_op_reply(154 pubsub..bucket.myfoo7/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.10 [delete] v34'28 uv21 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.012+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4362b30 con 0x7f1f04036020 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.013+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 36 ==== osd_op_reply(155 fud.buckets [call] v34'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.013+0000 7f1f0d020800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.013+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.014+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 37 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.014+0000 7f1f0d020800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.014+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94570418633456 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4362b30 con 0x5602e42fdc50 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.014+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 38 ==== watch-notify(notify (1) cookie 94570418292352 notify 146028888071 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5602e4311ea0 con 0x5602e42fdc50 2024-09-22T08:12:09.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.014+0000 7f1dedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94570418292352 notifier 4759 bl.length()=170 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.014+0000 7f1dedffb640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1d40003320 con 0x5602e42fdc50 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.014+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 39 ==== osd_op_reply(157 notify.2 [notify cookie 94570418633456 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.015+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 40 ==== watch-notify(notify_complete (2) cookie 94570418633456 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602e42bb0d0 con 0x5602e42fdc50 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.015+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 41 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.015+0000 7f1f0d020800 10 removing email index: 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.015+0000 7f1f0d020800 10 removing user buckets index 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.015+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.016+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 38 ==== osd_op_reply(159 fud.buckets [delete] v34'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.016+0000 7f1f0d020800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.016+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94570418678576 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.016+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 39 ==== watch-notify(notify (1) cookie 94570418297360 notify 146028888105 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5602e4314090 con 0x7f1f04036020 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.016+0000 7f1dee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94570418297360 notifier 4759 bl.length()=160 2024-09-22T08:12:09.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.016+0000 7f1dee7fc640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1dd0003d60 con 0x7f1f04036020 2024-09-22T08:12:09.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.016+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 40 ==== osd_op_reply(160 notify.6 [notify cookie 94570418678576 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.017+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 41 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.017+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 42 ==== watch-notify(notify_complete (2) cookie 94570418678576 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602e43148b0 con 0x7f1f04036020 2024-09-22T08:12:09.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.017+0000 7f1f0d020800 10 removing user index: fud 2024-09-22T08:12:09.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.017+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.018+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 43 ==== osd_op_reply(162 fud [call,call,delete] v34'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.018+0000 7f1f0d020800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-22T08:12:09.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.018+0000 7f1f0d020800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-22T08:12:09.025 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.018+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94570418678576 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.018+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 44 ==== watch-notify(notify (1) cookie 94570418303712 notify 146028888106 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5602e43148b0 con 0x7f1f04036020 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.018+0000 7f1dedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94570418303712 notifier 4759 bl.length()=152 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.018+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 45 ==== osd_op_reply(163 notify.5 [notify cookie 94570418678576 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.018+0000 7f1dedffb640 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1d40003320 con 0x7f1f04036020 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.018+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 46 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.019+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 47 ==== watch-notify(notify_complete (2) cookie 94570418678576 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602e43146a0 con 0x7f1f04036020 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.020+0000 7f1dc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.020+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94570418308624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f4890 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.021+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 54 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94570418308624] v34'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.021+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94570418284144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f92a0 2024-09-22T08:12:09.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.022+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 34 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94570418284144] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.022+0000 7f1f0d020800 20 remove_watcher() i=0 2024-09-22T08:12:09.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.022+0000 7f1f0d020800 2 removed watcher, disabling cache 2024-09-22T08:12:09.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.022+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94570418288416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f4890 2024-09-22T08:12:09.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.023+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 55 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94570418288416] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.023+0000 7f1f0d020800 20 remove_watcher() i=1 2024-09-22T08:12:09.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.023+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94570418292352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42fdc50 2024-09-22T08:12:09.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.024+0000 7f1f0ab11640 1 -- 172.21.15.165:0/3710110000 <== osd.3 v2:172.21.15.165:6800/215521179 42 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94570418292352] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1efc02e070 con 0x5602e42fdc50 2024-09-22T08:12:09.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.024+0000 7f1f0d020800 20 remove_watcher() i=2 2024-09-22T08:12:09.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.024+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94570418294688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f92a0 2024-09-22T08:12:09.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.025+0000 7f1f0b312640 1 -- 172.21.15.165:0/3710110000 <== osd.2 v2:172.21.15.165:6808/3197121696 35 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94570418294688] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f04033020 con 0x5602e42f92a0 2024-09-22T08:12:09.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.025+0000 7f1f0d020800 20 remove_watcher() i=3 2024-09-22T08:12:09.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.025+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94570418299696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x5602e42f4890 2024-09-22T08:12:09.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.026+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.1 v2:172.21.15.165:6816/2347568643 56 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94570418299696] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x5602e42f4890 2024-09-22T08:12:09.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.026+0000 7f1f0d020800 20 remove_watcher() i=4 2024-09-22T08:12:09.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.026+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94570418303712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.027+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 48 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94570418303712] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.027+0000 7f1f0d020800 20 remove_watcher() i=5 2024-09-22T08:12:09.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.027+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94570418297360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.028+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 49 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94570418297360] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.028+0000 7f1f0d020800 20 remove_watcher() i=6 2024-09-22T08:12:09.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.028+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94570418301968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602e4354d70 con 0x7f1f04036020 2024-09-22T08:12:09.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 <== osd.0 v2:172.21.15.53:6800/2902972477 50 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94570418301968] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f000881c0 con 0x7f1f04036020 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 20 remove_watcher() i=7 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1f04036020 msgr2=0x7f1f04036400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1f04036020 0x7f1f04036400 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e42f4890 msgr2=0x5602e42f6d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e42f4890 0x5602e42f6d50 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42f92a0 msgr2=0x5602e42fb690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42f92a0 0x5602e42fb690 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5602e42fdc50 msgr2=0x5602e4300110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5602e42fdc50 0x5602e4300110 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1dd403d000 msgr2=0x7f1dd403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1dd403d000 0x7f1dd403f4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1efc01d7b0 tx=0x7f1efc049000 comp rx=0 tx=0).stop 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 msgr2=0x5602e42e8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 --2- 172.21.15.165:0/3710110000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42e17c0 0x5602e42e8da0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1f04011fd0 tx=0x7f1f04054720 comp rx=0 tx=0).stop 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 reap_dead start 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0a310640 1 -- 172.21.15.165:0/3710110000 reap_dead start 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 shutdown_connections 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 >> 172.21.15.165:0/3710110000 conn(0x5602e42ddbc0 msgr2=0x5602e42dbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 shutdown_connections 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/3710110000 wait complete. 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/4167544464 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1de403cfb0 msgr2=0x7f1de403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 --2- 172.21.15.165:0/4167544464 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1de403cfb0 0x7f1de403f470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x5602e42bbe20 tx=0x7f1efc01d6e0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/4167544464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42d4d20 msgr2=0x5602e42d5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 --2- 172.21.15.165:0/4167544464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42d4d20 0x5602e42d5140 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x5602e42bacd0 tx=0x7f1f04018830 comp rx=0 tx=0).stop 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/4167544464 shutdown_connections 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 --2- 172.21.15.165:0/4167544464 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1de403cfb0 0x7f1de403f470 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 --2- 172.21.15.165:0/4167544464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e42d4d20 0x5602e42d5140 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/4167544464 >> 172.21.15.165:0/4167544464 conn(0x5602e42c90d0 msgr2=0x5602e42c94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/4167544464 shutdown_connections 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.030+0000 7f1f0d020800 1 -- 172.21.15.165:0/4167544464 wait complete. 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e41c49d0 msgr2=0x5602e42c1320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e41c49d0 0x5602e42c1320 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42c3740 msgr2=0x5602e42c5be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42c3740 0x5602e42c5be0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1df003cfb0 msgr2=0x7f1df003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1df003cfb0 0x7f1df003f470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1f00057000 tx=0x7f1f00052000 comp rx=0 tx=0).stop 2024-09-22T08:12:09.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 msgr2=0x5602e42b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e42b9cd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1efc000c00 tx=0x7f1efc000ed0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 shutdown_connections 2024-09-22T08:12:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5602e42c3740 0x5602e42c5be0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5602e41c49d0 0x5602e42c1320 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1df003cfb0 0x7f1df003f470 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 --2- 172.21.15.165:0/2908612598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602e4133d30 0x5602e42b9cd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 >> 172.21.15.165:0/2908612598 conn(0x5602e41babb0 msgr2=0x5602e42ab510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 shutdown_connections 2024-09-22T08:12:09.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:09.031+0000 7f1f0d020800 1 -- 172.21.15.165:0/2908612598 wait complete. 2024-09-22T08:12:49.042 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-22T08:12:49.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-22T08:12:49.042 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-22T08:12:49.094 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:49.095 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:49.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.094+0000 7fb2eaf75800 1 Processor -- start 2024-09-22T08:12:49.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.094+0000 7fb2eaf75800 1 -- start start 2024-09-22T08:12:49.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.095+0000 7fb2eaf75800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557297d0f530 0x557297da0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.095+0000 7fb2eaf75800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557297c26a20 con 0x557297da0a00 2024-09-22T08:12:49.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.095+0000 7fb2eaf75800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x557297c267d0 con 0x557297d0f530 2024-09-22T08:12:49.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.095+0000 7fb2e8a5f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557297d0f530 0x557297da0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.095+0000 7fb2e8a5f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557297d0f530 0x557297da0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33630/0 (socket says 172.21.15.165:33630) 2024-09-22T08:12:49.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.095+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/3843198990 learned_addr learned my addr 172.21.15.165:0/3843198990 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.095+0000 7fb2e3fff640 1 --1- 172.21.15.165:0/3843198990 >> v1:172.21.15.53:6789/0 conn(0x557297da0a00 0x557297da2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57714/0 (socket says 172.21.15.165:57714) 2024-09-22T08:12:49.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.095+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/3843198990 >> v1:172.21.15.53:6789/0 conn(0x557297da0a00 legacy=0x557297da2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.096+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/3843198990 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557297da57b0 con 0x557297d0f530 2024-09-22T08:12:49.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.097+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/3843198990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297da0490 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00a520 tx=0x7fb2dc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8265f3d5dd7d0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.098+0000 7fb2e37fe640 1 -- 172.21.15.165:0/3843198990 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc055070 con 0x557297d0f530 2024-09-22T08:12:49.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.098+0000 7fb2e37fe640 1 -- 172.21.15.165:0/3843198990 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2dc0515b0 con 0x557297d0f530 2024-09-22T08:12:49.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.098+0000 7fb2e37fe640 1 -- 172.21.15.165:0/3843198990 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc0518d0 con 0x557297d0f530 2024-09-22T08:12:49.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.098+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3843198990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 msgr2=0x557297da0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.098+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/3843198990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297da0490 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00a520 tx=0x7fb2dc045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.099+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3843198990 shutdown_connections 2024-09-22T08:12:49.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.099+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/3843198990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297da0490 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.099+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3843198990 >> 172.21.15.165:0/3843198990 conn(0x557297d95ba0 msgr2=0x557297d98000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.099+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3843198990 shutdown_connections 2024-09-22T08:12:49.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.099+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3843198990 wait complete. 2024-09-22T08:12:49.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.114+0000 7fb2eaf75800 1 Processor -- start 2024-09-22T08:12:49.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.114+0000 7fb2eaf75800 1 -- start start 2024-09-22T08:12:49.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.115+0000 7fb2eaf75800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e8d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.115+0000 7fb2eaf75800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557297c33dd0 con 0x557297d0f530 2024-09-22T08:12:49.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.115+0000 7fb2e8a5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e8d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.115+0000 7fb2e8a5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e8d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33632/0 (socket says 172.21.15.165:33632) 2024-09-22T08:12:49.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.115+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/3312543049 learned_addr learned my addr 172.21.15.165:0/3312543049 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.115+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/3312543049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557297e8d830 con 0x557297d0f530 2024-09-22T08:12:49.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.116+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/3312543049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e8d240 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0460d0 tx=0x7fb2dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d0af7c6622320c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.116+0000 7fb1d6e05640 1 -- 172.21.15.165:0/3312543049 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc0519d0 con 0x557297d0f530 2024-09-22T08:12:49.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.116+0000 7fb1d6e05640 1 -- 172.21.15.165:0/3312543049 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2dc051b70 con 0x557297d0f530 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.116+0000 7fb1d6e05640 1 -- 172.21.15.165:0/3312543049 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc051e50 con 0x557297d0f530 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.116+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3312543049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 msgr2=0x557297e8d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.116+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/3312543049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e8d240 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0460d0 tx=0x7fb2dc051000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3312543049 shutdown_connections 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/3312543049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e8d240 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3312543049 >> 172.21.15.165:0/3312543049 conn(0x557297d95ba0 msgr2=0x557297e88bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3312543049 shutdown_connections 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3312543049 wait complete. 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2eaf75800 1 Processor -- start 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2eaf75800 1 -- start start 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2eaf75800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e94c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2eaf75800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557297da4a50 con 0x557297d0f530 2024-09-22T08:12:49.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2e8a5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e94c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2e8a5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e94c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33646/0 (socket says 172.21.15.165:33646) 2024-09-22T08:12:49.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.117+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1197752083 learned_addr learned my addr 172.21.15.165:0/1197752083 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.118+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1197752083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557297e95170 con 0x557297d0f530 2024-09-22T08:12:49.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.118+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e94c10 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0460d0 tx=0x7fb2dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.118+0000 7fb1d5602640 1 -- 172.21.15.165:0/1197752083 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc073020 con 0x557297d0f530 2024-09-22T08:12:49.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.118+0000 7fb1d5602640 1 -- 172.21.15.165:0/1197752083 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2dc06f580 con 0x557297d0f530 2024-09-22T08:12:49.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.118+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557297e95400 con 0x557297d0f530 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.118+0000 7fb1d5602640 1 -- 172.21.15.165:0/1197752083 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc06f8a0 con 0x557297d0f530 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.118+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557297e96010 con 0x557297d0f530 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.119+0000 7fb1d5602640 1 -- 172.21.15.165:0/1197752083 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb2dc076020 con 0x557297d0f530 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.119+0000 7fb1d5602640 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1d003cfb0 0x7fb1d003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.119+0000 7fb1d5602640 1 -- 172.21.15.165:0/1197752083 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb2dc06b040 con 0x557297d0f530 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.120+0000 7fb2e3fff640 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1d003cfb0 0x7fb1d003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.120+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297da0a00 0x557297e9c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.120+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297e9c7a0 con 0x557297da0a00 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.120+0000 7fb2e9260640 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297da0a00 0x557297e9c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.120+0000 7fb2e3fff640 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1d003cfb0 0x7fb1d003f470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4001e30 tx=0x7fb2d4001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.120+0000 7fb2e9260640 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297da0a00 0x557297e9c260 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.120+0000 7fb2e9260640 1 -- 172.21.15.165:0/1197752083 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2e400a4d0 con 0x557297da0a00 2024-09-22T08:12:49.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.120+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297e9cb40 con 0x557297da0a00 2024-09-22T08:12:49.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.121+0000 7fb2e9260640 1 -- 172.21.15.165:0/1197752083 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2e400a4d0 con 0x557297da0a00 2024-09-22T08:12:49.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.121+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297e9e640 0x557297ea0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.121+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ea1270 con 0x557297e9e640 2024-09-22T08:12:49.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.121+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297e9e640 0x557297ea0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.121+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297e9e640 0x557297ea0ae0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.122+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1197752083 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb2dc057030 con 0x557297e9e640 2024-09-22T08:12:49.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.122+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297e9d390 con 0x557297da0a00 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.122+0000 7fb2e9260640 1 -- 172.21.15.165:0/1197752083 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2e400a4d0 con 0x557297da0a00 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.122+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297e9d7e0 con 0x557297da0a00 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.122+0000 7fb2e9260640 1 -- 172.21.15.165:0/1197752083 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb2e400a4d0 con 0x557297da0a00 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.123+0000 7fb2eaf75800 1 Processor -- start 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.123+0000 7fb2eaf75800 1 -- start start 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.123+0000 7fb2eaf75800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297eafbb0 0x557297eaffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.123+0000 7fb2eaf75800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557297c92d50 con 0x557297eafbb0 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.123+0000 7fb2e9260640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297eafbb0 0x557297eaffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.123+0000 7fb2e9260640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297eafbb0 0x557297eaffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33656/0 (socket says 172.21.15.165:33656) 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.123+0000 7fb2e9260640 1 -- 172.21.15.165:0/2226744791 learned_addr learned my addr 172.21.15.165:0/2226744791 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.124+0000 7fb2e9260640 1 -- 172.21.15.165:0/2226744791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557297eb0610 con 0x557297eafbb0 2024-09-22T08:12:49.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.124+0000 7fb2e9260640 1 --2- 172.21.15.165:0/2226744791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297eafbb0 0x557297eaffd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400a2a0 tx=0x7fb2e4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.124+0000 7fb1ce7fc640 1 -- 172.21.15.165:0/2226744791 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4014450 con 0x557297eafbb0 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.124+0000 7fb1ce7fc640 1 -- 172.21.15.165:0/2226744791 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2e40145f0 con 0x557297eafbb0 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.124+0000 7fb2eaf75800 1 -- 172.21.15.165:0/2226744791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557297eb0e40 con 0x557297eafbb0 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.124+0000 7fb1ce7fc640 1 -- 172.21.15.165:0/2226744791 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4014910 con 0x557297eafbb0 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.124+0000 7fb2eaf75800 1 -- 172.21.15.165:0/2226744791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557297eb13e0 con 0x557297eafbb0 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.125+0000 7fb1ce7fc640 1 -- 172.21.15.165:0/2226744791 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb2e4011040 con 0x557297eafbb0 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.125+0000 7fb1ce7fc640 1 --2- 172.21.15.165:0/2226744791 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1c003d000 0x7fb1c003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.125+0000 7fb1ce7fc640 1 -- 172.21.15.165:0/2226744791 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb2e401e070 con 0x557297eafbb0 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.126+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/2226744791 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1c003d000 0x7fb1c003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.126+0000 7fb2eaf75800 1 Processor -- start 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.126+0000 7fb2eaf75800 1 -- start start 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.126+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/2226744791 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1c003d000 0x7fb1c003f4c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc077ff0 tx=0x7fb2dc0968e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.126+0000 7fb2eaf75800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ebc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.126+0000 7fb2eaf75800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557297e8dba0 con 0x557297ebc5f0 2024-09-22T08:12:49.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.126+0000 7fb2e9260640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ebc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.126+0000 7fb2e9260640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ebc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33666/0 (socket says 172.21.15.165:33666) 2024-09-22T08:12:49.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.126+0000 7fb2e9260640 1 -- 172.21.15.165:0/3718367029 learned_addr learned my addr 172.21.15.165:0/3718367029 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb2e9260640 1 -- 172.21.15.165:0/3718367029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557297ebcfe0 con 0x557297ebc5f0 2024-09-22T08:12:49.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb2e9260640 1 --2- 172.21.15.165:0/3718367029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ebc9f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4016fd0 tx=0x7fb2e4011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf059e3337973895 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb1bffff640 1 -- 172.21.15.165:0/3718367029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4051020 con 0x557297ebc5f0 2024-09-22T08:12:49.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb1bffff640 1 -- 172.21.15.165:0/3718367029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2e4022dc0 con 0x557297ebc5f0 2024-09-22T08:12:49.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb1bffff640 1 -- 172.21.15.165:0/3718367029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4028070 con 0x557297ebc5f0 2024-09-22T08:12:49.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3718367029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 msgr2=0x557297ebc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/3718367029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ebc9f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4016fd0 tx=0x7fb2e4011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3718367029 shutdown_connections 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/3718367029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ebc9f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3718367029 >> 172.21.15.165:0/3718367029 conn(0x557297eb89f0 msgr2=0x557297eb6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.127+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3718367029 shutdown_connections 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.128+0000 7fb2eaf75800 1 -- 172.21.15.165:0/3718367029 wait complete. 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.128+0000 7fb2eaf75800 1 Processor -- start 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.128+0000 7fb2eaf75800 1 -- start start 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.128+0000 7fb2eaf75800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ec3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.128+0000 7fb2eaf75800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557297ebd600 con 0x557297ebc5f0 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.128+0000 7fb2e9260640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ec3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.128+0000 7fb2e9260640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ec3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33670/0 (socket says 172.21.15.165:33670) 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.128+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 learned_addr learned my addr 172.21.15.165:0/1926826067 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.129+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557297ec41a0 con 0x557297ebc5f0 2024-09-22T08:12:49.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.129+0000 7fb2e9260640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ec3c40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4011b50 tx=0x7fb2e40546c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.129+0000 7fb1be7fc640 1 -- 172.21.15.165:0/1926826067 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4054c70 con 0x557297ebc5f0 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.129+0000 7fb1be7fc640 1 -- 172.21.15.165:0/1926826067 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2e4032070 con 0x557297ebc5f0 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.129+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557297ec4430 con 0x557297ebc5f0 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.129+0000 7fb1be7fc640 1 -- 172.21.15.165:0/1926826067 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e4045900 con 0x557297ebc5f0 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.129+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557297ec4db0 con 0x557297ebc5f0 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.130+0000 7fb1be7fc640 1 -- 172.21.15.165:0/1926826067 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb2e4045ac0 con 0x557297ebc5f0 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.130+0000 7fb1be7fc640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1b403cfb0 0x7fb1b403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.130+0000 7fb1be7fc640 1 -- 172.21.15.165:0/1926826067 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb2e400e040 con 0x557297ebc5f0 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.130+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1b403cfb0 0x7fb1b403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.131+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.131+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297ecf700 0x557297ed1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.131+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ed2310 con 0x557297ecf700 2024-09-22T08:12:49.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.131+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1b403cfb0 0x7fb1b403f470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc05a7d0 tx=0x7fb2dc085000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.131+0000 7fb2e3fff640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297ecf700 0x557297ed1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.131+0000 7fb2e3fff640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297ecf700 0x557297ed1bc0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.131+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2d400f610 con 0x557297ecf700 2024-09-22T08:12:49.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.131+0000 7fb2eaf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 20 realm 2024-09-22T08:12:49.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ecea50 con 0x557297ecf700 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2d400f610 con 0x557297ecf700 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ed2e00 con 0x557297ecf700 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2d400f610 con 0x557297ecf700 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ed36d0 con 0x557297ecf700 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2d400f610 con 0x557297ecf700 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:49.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297ed40f0 0x557297ed64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.132+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ed6c20 con 0x557297ed40f0 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.133+0000 7fb2e9260640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297ed40f0 0x557297ed64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.133+0000 7fb2e9260640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297ed40f0 0x557297ed64e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.133+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.133+0000 7fb2eaf75800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.133+0000 7fb2eaf75800 20 searching for the correct realm 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.133+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557297ed8bd0 0x557297edb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.133+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed8bd0 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.133+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557297ed8bd0 0x557297edb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.134+0000 7fb2e8a5f640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557297ed8bd0 0x557297edb090 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.134+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.134+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed40f0 2024-09-22T08:12:49.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.134+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.134+0000 7fb2e9260640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb2e4014070 0x7fb2e4041780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.134+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x7fb2e4014070 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.134+0000 7fb2e3fff640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb2e4014070 0x7fb2e4041780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.135+0000 7fb2e3fff640 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb2e4014070 0x7fb2e4041780 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.135+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d400f610 con 0x7fb2e4014070 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.135+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ecf700 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.135+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d400f610 con 0x557297ecf700 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.135+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ecf700 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.136+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.136+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x7fb2e4014070 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.136+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.136+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed40f0 2024-09-22T08:12:49.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.136+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.136+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed40f0 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.137+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.137+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed8bd0 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.137+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.137+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ecf700 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.137+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.137+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x7fb2e4014070 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.137+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.137+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ecf700 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.138+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.138+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed40f0 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.138+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.138+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed8bd0 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.138+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.138+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed8bd0 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.138+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.138+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x7fb2e4014070 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.139+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.139+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed8bd0 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.139+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.139+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed8bd0 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.139+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.139+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ecf700 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.140+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.140+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ecf700 2024-09-22T08:12:49.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.140+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.140+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x7fb2e4014070 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.140+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.140+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed8bd0 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.140+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.140+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed40f0 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.141+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.141+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ecf700 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.141+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.141+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x7fb2e4014070 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.141+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.141+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed8bd0 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.142+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.142+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x7fb2e4014070 2024-09-22T08:12:49.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.142+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.142+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed40f0 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.142+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.142+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed8bd0 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.142+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.142+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x7fb2e4014070 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ecf700 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557297edb710 con 0x557297ed40f0 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2eaf75800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2eaf75800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:49.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2eaf75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2eaf75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2eaf75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2eaf75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.143+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ed75e0 con 0x557297ecf700 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ed7e80 con 0x557297ecf700 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ed7220 con 0x557297ecf700 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 20 zone default found 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 4 Realm: () 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 20 zonegroup default 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.144+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297edc040 con 0x7fb2e4014070 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2eaf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297eddd70 con 0x557297ed8bd0 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2eaf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ede200 con 0x557297ed8bd0 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2eaf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2eaf75800 20 started sync module instance, tier type = 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2eaf75800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.145+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297edcb40 con 0x557297ed40f0 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.146+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.146+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93950663577664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297edcb40 con 0x557297ed40f0 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.146+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297edece0 con 0x557297ecf700 2024-09-22T08:12:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.148+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93950663577664] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.148+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.148+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93950663583696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297edcb40 con 0x557297ecf700 2024-09-22T08:12:49.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.148+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297edf7a0 con 0x557297ed8bd0 2024-09-22T08:12:49.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.149+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93950663583696] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.149+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.150+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93950663575184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297edcab0 con 0x557297ed8bd0 2024-09-22T08:12:49.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.150+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee0660 con 0x557297ed40f0 2024-09-22T08:12:49.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.151+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.151+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93950663590800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee0f00 con 0x557297ed40f0 2024-09-22T08:12:49.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.151+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee19d0 con 0x557297ecf700 2024-09-22T08:12:49.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.151+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93950663575184] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.152+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93950663590800] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.152+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.152+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93950663595200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee0a50 con 0x557297ecf700 2024-09-22T08:12:49.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.152+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee2270 con 0x7fb2e4014070 2024-09-22T08:12:49.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.153+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93950663595200] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.153+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.153+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93950663588752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee0a50 con 0x7fb2e4014070 2024-09-22T08:12:49.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.153+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee28f0 con 0x7fb2e4014070 2024-09-22T08:12:49.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.154+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93950663588752] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.155+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.155+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93950663599040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee28b0 con 0x7fb2e4014070 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.155+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee32f0 con 0x7fb2e4014070 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.156+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.156+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93950663601600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee3760 con 0x7fb2e4014070 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.156+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93950663599040] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.156+0000 7fb2eaf75800 20 add_watcher() i=0 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.156+0000 7fb2eaf75800 20 add_watcher() i=1 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.156+0000 7fb2eaf75800 20 add_watcher() i=2 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.156+0000 7fb2eaf75800 20 add_watcher() i=3 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.156+0000 7fb2eaf75800 20 add_watcher() i=4 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.156+0000 7fb2eaf75800 20 add_watcher() i=5 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.156+0000 7fb2eaf75800 20 add_watcher() i=6 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.157+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93950663601600] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.157+0000 7fb2eaf75800 20 add_watcher() i=7 2024-09-22T08:12:49.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.157+0000 7fb2eaf75800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.157+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297ee6be0 con 0x557297ecf700 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.157+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.157+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93950663602864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee4060 con 0x557297ecf700 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.158+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93950663602864] v34'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.158+0000 7fb19f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.158+0000 7fb2eaf75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.158+0000 7fb2eaf75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.158+0000 7fb2eaf75800 5 note: GC not initialized 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb19e7e4640 20 reqs_thread_entry: start 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2eaf75800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2eaf75800 20 Filter name: none 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb197fff640 20 reqs_thread_entry: start 2024-09-22T08:12:49.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2eaf75800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2eaf75800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557297f19ba0 con 0x557297ecf700 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2eaf75800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2eaf75800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2eaf75800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2eaf75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.159+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297f1c630 con 0x7fb2e4014070 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.161+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 usage.10 [call] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.161+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297f1c630 con 0x7fb2e4014070 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.162+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(64 usage.10 [call] v34'34 uv33 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.163+0000 7fb19f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:49.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.163+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93950663602864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ecc550 con 0x557297ecf700 2024-09-22T08:12:49.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.164+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93950663602864] v34'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.164+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93950663577664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee32b0 con 0x557297ed40f0 2024-09-22T08:12:49.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.165+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93950663577664] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.165+0000 7fb2eaf75800 20 remove_watcher() i=0 2024-09-22T08:12:49.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.165+0000 7fb2eaf75800 2 removed watcher, disabling cache 2024-09-22T08:12:49.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.165+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93950663583696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee32b0 con 0x557297ecf700 2024-09-22T08:12:49.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.167+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93950663583696] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.167+0000 7fb2eaf75800 20 remove_watcher() i=1 2024-09-22T08:12:49.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.167+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93950663575184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ede7d0 con 0x557297ed8bd0 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.168+0000 7fb2e8a5f640 1 -- 172.21.15.165:0/1926826067 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93950663575184] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2dc057030 con 0x557297ed8bd0 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.168+0000 7fb2eaf75800 20 remove_watcher() i=2 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.168+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93950663590800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee32b0 con 0x557297ed40f0 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.169+0000 7fb2e9260640 1 -- 172.21.15.165:0/1926826067 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93950663590800] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2e402a070 con 0x557297ed40f0 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.169+0000 7fb2eaf75800 20 remove_watcher() i=3 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.169+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93950663595200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297edc690 con 0x557297ecf700 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.170+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93950663595200] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x557297ecf700 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.170+0000 7fb2eaf75800 20 remove_watcher() i=4 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.170+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93950663588752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee32b0 con 0x7fb2e4014070 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.171+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93950663588752] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.171+0000 7fb2eaf75800 20 remove_watcher() i=5 2024-09-22T08:12:49.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.171+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93950663599040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297ee14c0 con 0x7fb2e4014070 2024-09-22T08:12:49.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.173+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93950663599040] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.173+0000 7fb2eaf75800 20 remove_watcher() i=6 2024-09-22T08:12:49.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.173+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93950663601600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557297edc690 con 0x7fb2e4014070 2024-09-22T08:12:49.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93950663601600] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2d402b040 con 0x7fb2e4014070 2024-09-22T08:12:49.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 20 remove_watcher() i=7 2024-09-22T08:12:49.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb2e4014070 msgr2=0x7fb2e4041780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb2e4014070 0x7fb2e4041780 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297ecf700 msgr2=0x557297ed1bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297ecf700 0x557297ed1bc0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297ed40f0 msgr2=0x557297ed64e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297ed40f0 0x557297ed64e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557297ed8bd0 msgr2=0x557297edb090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557297ed8bd0 0x557297edb090 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1b403cfb0 msgr2=0x7fb1b403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1b403cfb0 0x7fb1b403f470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc05a7d0 tx=0x7fb2dc085000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 msgr2=0x557297ec3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2e3fff640 1 -- 172.21.15.165:0/1926826067 reap_dead start 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ec3c40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4011b50 tx=0x7fb2e40546c0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 shutdown_connections 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1926826067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297ebc5f0 0x557297ec3c40 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 >> 172.21.15.165:0/1926826067 conn(0x557297eb89f0 msgr2=0x557297eb6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 shutdown_connections 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1926826067 wait complete. 2024-09-22T08:12:49.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/2226744791 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1c003d000 msgr2=0x7fb1c003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/2226744791 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1c003d000 0x7fb1c003f4c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc077ff0 tx=0x7fb2dc0968e0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 -- 172.21.15.165:0/2226744791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297eafbb0 msgr2=0x557297eaffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.174+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/2226744791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297eafbb0 0x557297eaffd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400a2a0 tx=0x7fb2e4018830 comp rx=0 tx=0).stop 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/2226744791 shutdown_connections 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/2226744791 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1c003d000 0x7fb1c003f4c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/2226744791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297eafbb0 0x557297eaffd0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/2226744791 >> 172.21.15.165:0/2226744791 conn(0x557297ea3f60 msgr2=0x557297ea4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/2226744791 shutdown_connections 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/2226744791 wait complete. 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297da0a00 msgr2=0x557297e9c260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297da0a00 0x557297e9c260 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297e9e640 msgr2=0x557297ea0ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297e9e640 0x557297ea0ae0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1d003cfb0 msgr2=0x7fb1d003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1d003cfb0 0x7fb1d003f470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4001e30 tx=0x7fb2d4001390 comp rx=0 tx=0).stop 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 msgr2=0x557297e94c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e94c10 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0460d0 tx=0x7fb2dc002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 shutdown_connections 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557297e9e640 0x557297ea0ae0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557297da0a00 0x557297e9c260 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb1d003cfb0 0x7fb1d003f470 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 --2- 172.21.15.165:0/1197752083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557297d0f530 0x557297e94c10 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 >> 172.21.15.165:0/1197752083 conn(0x557297d95ba0 msgr2=0x557297e8e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 shutdown_connections 2024-09-22T08:12:49.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.175+0000 7fb2eaf75800 1 -- 172.21.15.165:0/1197752083 wait complete. 2024-09-22T08:12:49.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-22T08:12:49.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-22T08:12:49.185 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-22T08:12:49.230 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:49.230 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:49.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.230+0000 7f0d36532800 1 Processor -- start 2024-09-22T08:12:49.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.230+0000 7f0d36532800 1 -- start start 2024-09-22T08:12:49.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.230+0000 7f0d36532800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5650a2540b80 0x5650a2542f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.230+0000 7f0d36532800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5650a23c7a20 con 0x5650a253d070 2024-09-22T08:12:49.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.230+0000 7f0d36532800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5650a23c77d0 con 0x5650a2540b80 2024-09-22T08:12:49.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.230+0000 7f0d2bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5650a2540b80 0x5650a2542f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.230+0000 7f0d2bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5650a2540b80 0x5650a2542f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33678/0 (socket says 172.21.15.165:33678) 2024-09-22T08:12:49.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.230+0000 7f0d321bc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5650a253d070 0x5650a253f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57722/0 (socket says 172.21.15.165:57722) 2024-09-22T08:12:49.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.230+0000 7f0d2bfff640 1 -- 172.21.15.165:0/821076979 learned_addr learned my addr 172.21.15.165:0/821076979 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.231+0000 7f0d2bfff640 1 -- 172.21.15.165:0/821076979 >> v1:172.21.15.53:6789/0 conn(0x5650a253d070 legacy=0x5650a253f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.231+0000 7f0d2bfff640 1 -- 172.21.15.165:0/821076979 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a2544550 con 0x5650a2540b80 2024-09-22T08:12:49.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d2bfff640 1 --2- 172.21.15.165:0/821076979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a2540b80 0x5650a2542f70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00a520 tx=0x7f0d1c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc73f901d1fbfd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d319bb640 1 -- 172.21.15.165:0/821076979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d1c055070 con 0x5650a2540b80 2024-09-22T08:12:49.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d319bb640 1 -- 172.21.15.165:0/821076979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1c0515b0 con 0x5650a2540b80 2024-09-22T08:12:49.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d319bb640 1 -- 172.21.15.165:0/821076979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d1c0518d0 con 0x5650a2540b80 2024-09-22T08:12:49.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d36532800 1 -- 172.21.15.165:0/821076979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a2540b80 msgr2=0x5650a2542f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d36532800 1 --2- 172.21.15.165:0/821076979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a2540b80 0x5650a2542f70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00a520 tx=0x7f0d1c045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d36532800 1 -- 172.21.15.165:0/821076979 shutdown_connections 2024-09-22T08:12:49.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d36532800 1 --2- 172.21.15.165:0/821076979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a2540b80 0x5650a2542f70 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d36532800 1 -- 172.21.15.165:0/821076979 >> 172.21.15.165:0/821076979 conn(0x5650a2536bb0 msgr2=0x5650a2539010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d36532800 1 -- 172.21.15.165:0/821076979 shutdown_connections 2024-09-22T08:12:49.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.233+0000 7f0d36532800 1 -- 172.21.15.165:0/821076979 wait complete. 2024-09-22T08:12:49.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.247+0000 7f0d36532800 1 Processor -- start 2024-09-22T08:12:49.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.247+0000 7f0d36532800 1 -- start start 2024-09-22T08:12:49.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.247+0000 7f0d36532800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a262c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.247+0000 7f0d36532800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5650a23d4dd0 con 0x5650a253d070 2024-09-22T08:12:49.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.247+0000 7f0d321bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a262c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.247+0000 7f0d321bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a262c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33688/0 (socket says 172.21.15.165:33688) 2024-09-22T08:12:49.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.247+0000 7f0d321bc640 1 -- 172.21.15.165:0/3764557925 learned_addr learned my addr 172.21.15.165:0/3764557925 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.248+0000 7f0d321bc640 1 -- 172.21.15.165:0/3764557925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a262c620 con 0x5650a253d070 2024-09-22T08:12:49.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.248+0000 7f0d321bc640 1 --2- 172.21.15.165:0/3764557925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a262c030 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400b260 tx=0x7f0d2400b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b18d8b08c12588f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.248+0000 7f0c20608640 1 -- 172.21.15.165:0/3764557925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2400be60 con 0x5650a253d070 2024-09-22T08:12:49.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.248+0000 7f0c20608640 1 -- 172.21.15.165:0/3764557925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d24006070 con 0x5650a253d070 2024-09-22T08:12:49.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.248+0000 7f0c20608640 1 -- 172.21.15.165:0/3764557925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2400e710 con 0x5650a253d070 2024-09-22T08:12:49.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.249+0000 7f0d36532800 1 -- 172.21.15.165:0/3764557925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 msgr2=0x5650a262c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.249+0000 7f0d36532800 1 --2- 172.21.15.165:0/3764557925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a262c030 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400b260 tx=0x7f0d2400b660 comp rx=0 tx=0).stop 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.249+0000 7f0d36532800 1 -- 172.21.15.165:0/3764557925 shutdown_connections 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.249+0000 7f0d36532800 1 --2- 172.21.15.165:0/3764557925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a262c030 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.249+0000 7f0d36532800 1 -- 172.21.15.165:0/3764557925 >> 172.21.15.165:0/3764557925 conn(0x5650a2536bb0 msgr2=0x5650a26279b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.249+0000 7f0d36532800 1 -- 172.21.15.165:0/3764557925 shutdown_connections 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.249+0000 7f0d36532800 1 -- 172.21.15.165:0/3764557925 wait complete. 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.249+0000 7f0d36532800 1 Processor -- start 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.249+0000 7f0d36532800 1 -- start start 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0d36532800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a2633ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0d36532800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5650a2543840 con 0x5650a253d070 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0d321bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a2633ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0d321bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a2633ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33704/0 (socket says 172.21.15.165:33704) 2024-09-22T08:12:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0d321bc640 1 -- 172.21.15.165:0/1112826533 learned_addr learned my addr 172.21.15.165:0/1112826533 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0d321bc640 1 -- 172.21.15.165:0/1112826533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a2634100 con 0x5650a253d070 2024-09-22T08:12:49.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0d321bc640 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a2633ba0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x5650a262cfc0 tx=0x7f0d24000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0c1ee05640 1 -- 172.21.15.165:0/1112826533 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2400ee10 con 0x5650a253d070 2024-09-22T08:12:49.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0c1ee05640 1 -- 172.21.15.165:0/1112826533 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2400fa30 con 0x5650a253d070 2024-09-22T08:12:49.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650a2634390 con 0x5650a253d070 2024-09-22T08:12:49.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.250+0000 7f0c1ee05640 1 -- 172.21.15.165:0/1112826533 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2400fd30 con 0x5650a253d070 2024-09-22T08:12:49.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.251+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650a2634d90 con 0x5650a253d070 2024-09-22T08:12:49.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.251+0000 7f0c1ee05640 1 -- 172.21.15.165:0/1112826533 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0d24017070 con 0x5650a253d070 2024-09-22T08:12:49.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.252+0000 7f0c1ee05640 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c1803d000 0x7f0c1803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.252+0000 7f0c1ee05640 1 -- 172.21.15.165:0/1112826533 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0d24015020 con 0x5650a253d070 2024-09-22T08:12:49.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.252+0000 7f0d2bfff640 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c1803d000 0x7f0c1803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.252+0000 7f0d36532800 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2540b80 0x5650a263b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.252+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a263b730 con 0x5650a2540b80 2024-09-22T08:12:49.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.252+0000 7f0d329bd640 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2540b80 0x5650a263b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.252+0000 7f0d2bfff640 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c1803d000 0x7f0c1803f4c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c057000 tx=0x7f0d1c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.252+0000 7f0d329bd640 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2540b80 0x5650a263b1f0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.253+0000 7f0d329bd640 1 -- 172.21.15.165:0/1112826533 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d2c00a4d0 con 0x5650a2540b80 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.253+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a263bad0 con 0x5650a2540b80 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.253+0000 7f0d329bd640 1 -- 172.21.15.165:0/1112826533 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d2c00a4d0 con 0x5650a2540b80 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.253+0000 7f0d36532800 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a263d5d0 0x5650a263fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.253+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a26401e0 con 0x5650a263d5d0 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.253+0000 7f0d321bc640 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a263d5d0 0x5650a263fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.253+0000 7f0d321bc640 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a263d5d0 0x5650a263fa50 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.253+0000 7f0d321bc640 1 -- 172.21.15.165:0/1112826533 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a263d5d0 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.254+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a263c320 con 0x5650a2540b80 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.254+0000 7f0d329bd640 1 -- 172.21.15.165:0/1112826533 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d2c00a4d0 con 0x5650a2540b80 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.254+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a263c770 con 0x5650a2540b80 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.254+0000 7f0d329bd640 1 -- 172.21.15.165:0/1112826533 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0d2c00a4d0 con 0x5650a2540b80 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.254+0000 7f0d36532800 1 Processor -- start 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.254+0000 7f0d36532800 1 -- start start 2024-09-22T08:12:49.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.255+0000 7f0d36532800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253c830 0x5650a253b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.255+0000 7f0d36532800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5650a2433d50 con 0x5650a253c830 2024-09-22T08:12:49.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.255+0000 7f0d329bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253c830 0x5650a253b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.255+0000 7f0d329bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253c830 0x5650a253b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33720/0 (socket says 172.21.15.165:33720) 2024-09-22T08:12:49.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.255+0000 7f0d329bd640 1 -- 172.21.15.165:0/984822173 learned_addr learned my addr 172.21.15.165:0/984822173 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.255+0000 7f0d329bd640 1 -- 172.21.15.165:0/984822173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a253cd50 con 0x5650a253c830 2024-09-22T08:12:49.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.255+0000 7f0d329bd640 1 --2- 172.21.15.165:0/984822173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253c830 0x5650a253b0a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00a2a0 tx=0x7f0d2c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.256+0000 7f0c17fff640 1 -- 172.21.15.165:0/984822173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2c014450 con 0x5650a253c830 2024-09-22T08:12:49.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.256+0000 7f0c17fff640 1 -- 172.21.15.165:0/984822173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0145f0 con 0x5650a253c830 2024-09-22T08:12:49.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.256+0000 7f0d36532800 1 -- 172.21.15.165:0/984822173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650a253b5e0 con 0x5650a253c830 2024-09-22T08:12:49.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.256+0000 7f0c17fff640 1 -- 172.21.15.165:0/984822173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2c014910 con 0x5650a253c830 2024-09-22T08:12:49.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.256+0000 7f0d36532800 1 -- 172.21.15.165:0/984822173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650a253bb80 con 0x5650a253c830 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.257+0000 7f0c17fff640 1 -- 172.21.15.165:0/984822173 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0d2c011040 con 0x5650a253c830 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.257+0000 7f0c17fff640 1 --2- 172.21.15.165:0/984822173 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c0c03d000 0x7f0c0c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.257+0000 7f0c17fff640 1 -- 172.21.15.165:0/984822173 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0d2c01e070 con 0x5650a253c830 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.257+0000 7f0d321bc640 1 --2- 172.21.15.165:0/984822173 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c0c03d000 0x7f0c0c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.257+0000 7f0d36532800 1 Processor -- start 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.257+0000 7f0d321bc640 1 --2- 172.21.15.165:0/984822173 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c0c03d000 0x7f0c0c03f4c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5650a2635c90 tx=0x7f0d2401c790 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.257+0000 7f0d36532800 1 -- start start 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.257+0000 7f0d36532800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a265dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.257+0000 7f0d36532800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5650a262ca50 con 0x5650a265d7c0 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.258+0000 7f0d329bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a265dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.258+0000 7f0d329bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a265dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33726/0 (socket says 172.21.15.165:33726) 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.258+0000 7f0d329bd640 1 -- 172.21.15.165:0/987736895 learned_addr learned my addr 172.21.15.165:0/987736895 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.258+0000 7f0d329bd640 1 -- 172.21.15.165:0/987736895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a265e1b0 con 0x5650a265d7c0 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.258+0000 7f0d329bd640 1 --2- 172.21.15.165:0/987736895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a265dbc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c016fd0 tx=0x7f0d2c02b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4395ebdec10a55bd server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.258+0000 7f0c15ffb640 1 -- 172.21.15.165:0/987736895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2c04b070 con 0x5650a265d7c0 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.258+0000 7f0c15ffb640 1 -- 172.21.15.165:0/987736895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c051070 con 0x5650a265d7c0 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.258+0000 7f0c15ffb640 1 -- 172.21.15.165:0/987736895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2c011da0 con 0x5650a265d7c0 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 -- 172.21.15.165:0/987736895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 msgr2=0x5650a265dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 --2- 172.21.15.165:0/987736895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a265dbc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c016fd0 tx=0x7f0d2c02b4c0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 -- 172.21.15.165:0/987736895 shutdown_connections 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 --2- 172.21.15.165:0/987736895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a265dbc0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 -- 172.21.15.165:0/987736895 >> 172.21.15.165:0/987736895 conn(0x5650a2659bc0 msgr2=0x5650a2657e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 -- 172.21.15.165:0/987736895 shutdown_connections 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 -- 172.21.15.165:0/987736895 wait complete. 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 Processor -- start 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 -- start start 2024-09-22T08:12:49.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a2664d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d36532800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5650a265e7d0 con 0x5650a265d7c0 2024-09-22T08:12:49.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d329bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a2664d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d329bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a2664d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33734/0 (socket says 172.21.15.165:33734) 2024-09-22T08:12:49.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.259+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 learned_addr learned my addr 172.21.15.165:0/3127416674 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.260+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650a26652b0 con 0x5650a265d7c0 2024-09-22T08:12:49.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.260+0000 7f0d329bd640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a2664d50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c049040 tx=0x7f0d2c054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.261+0000 7f0c03fff640 1 -- 172.21.15.165:0/3127416674 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2c04b040 con 0x5650a265d7c0 2024-09-22T08:12:49.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.261+0000 7f0c03fff640 1 -- 172.21.15.165:0/3127416674 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0168f0 con 0x5650a265d7c0 2024-09-22T08:12:49.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.261+0000 7f0c03fff640 1 -- 172.21.15.165:0/3127416674 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2c011460 con 0x5650a265d7c0 2024-09-22T08:12:49.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.261+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650a2665540 con 0x5650a265d7c0 2024-09-22T08:12:49.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.261+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650a2665ec0 con 0x5650a265d7c0 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.262+0000 7f0c03fff640 1 -- 172.21.15.165:0/3127416674 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0d2c056070 con 0x5650a265d7c0 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.262+0000 7f0c03fff640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0bfc03cfb0 0x7f0bfc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.262+0000 7f0c03fff640 1 -- 172.21.15.165:0/3127416674 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0d2c00e040 con 0x5650a265d7c0 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.262+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.262+0000 7f0d321bc640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0bfc03cfb0 0x7f0bfc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.262+0000 7f0d36532800 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2670870 0x5650a2672ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.262+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a2673430 con 0x5650a2670870 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d2bfff640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2670870 0x5650a2672ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d321bc640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0bfc03cfb0 0x7f0bfc03f470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5650a26405e0 tx=0x7f0d24033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d2bfff640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2670870 0x5650a2672ce0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d36532800 20 realm 2024-09-22T08:12:49.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a2673860 con 0x5650a2670870 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d36532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a2674130 con 0x5650a2670870 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.263+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a26744d0 con 0x5650a2670870 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a2675230 0x5650a2677620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a2677b60 con 0x5650a2675230 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d329bd640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a2675230 0x5650a2677620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d329bd640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a2675230 0x5650a2677620 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 20 searching for the correct realm 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5650a2679bd0 0x5650a267c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.264+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2679bd0 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.265+0000 7f0d321bc640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5650a2679bd0 0x5650a267c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.265+0000 7f0d321bc640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5650a2679bd0 0x5650a267c090 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.265+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.265+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2675230 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.265+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.265+0000 7f0d329bd640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0d2c037070 0x7f0d2c040850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.265+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x7f0d2c037070 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.266+0000 7f0d2bfff640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0d2c037070 0x7f0d2c040850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.266+0000 7f0d2bfff640 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0d2c037070 0x7f0d2c040850 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.266+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x7f0d2c037070 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.266+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2670870 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.267+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.267+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2670870 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.267+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.267+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x7f0d2c037070 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.267+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x7f0d2c037070 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.267+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2675230 2024-09-22T08:12:49.275 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.267+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.268+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2675230 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.268+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.268+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2679bd0 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.268+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.268+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2670870 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.268+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.268+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x7f0d2c037070 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.268+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x7f0d2c037070 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.268+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2670870 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.269+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.269+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2675230 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.269+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.269+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2679bd0 2024-09-22T08:12:49.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.269+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.269+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2679bd0 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.269+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.269+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x7f0d2c037070 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.270+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x7f0d2c037070 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.270+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2679bd0 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.270+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.270+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2679bd0 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.270+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.270+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2670870 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.270+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.270+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2670870 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.271+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.271+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x7f0d2c037070 2024-09-22T08:12:49.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.271+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x7f0d2c037070 2024-09-22T08:12:49.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.271+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2679bd0 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.271+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.271+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2675230 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.271+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.271+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2670870 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.272+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.272+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x7f0d2c037070 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.272+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x7f0d2c037070 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.272+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2679bd0 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.272+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.272+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x7f0d2c037070 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.273+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x7f0d2c037070 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.273+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2675230 2024-09-22T08:12:49.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.273+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.273+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2679bd0 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.273+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.273+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x7f0d2c037070 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d1c057030 con 0x7f0d2c037070 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2670870 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650a267c760 con 0x5650a2675230 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:49.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a2678600 con 0x5650a2670870 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.274+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a2678240 con 0x5650a2670870 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d1c057030 con 0x5650a2670870 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a2678f20 con 0x5650a2670870 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 20 zone default found 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 4 Realm: () 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 20 zonegroup default 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a267cc20 con 0x7f0d2c037070 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a267eaa0 con 0x5650a2679bd0 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.275+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a267ef80 con 0x5650a2679bd0 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.276+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.276+0000 7f0d36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.276+0000 7f0d36532800 20 started sync module instance, tier type = 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.276+0000 7f0d36532800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.276+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a267def0 con 0x5650a2675230 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.277+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.277+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94904322089696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a267f890 con 0x5650a2675230 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.277+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a26800e0 con 0x5650a2670870 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.278+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94904322089696] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.278+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.278+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94904322094048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a267fdd0 con 0x5650a2670870 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.278+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a26808d0 con 0x5650a2679bd0 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.280+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94904322094048] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.280+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.280+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94904322098112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2680cf0 con 0x5650a2679bd0 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.280+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a26816f0 con 0x5650a2675230 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.281+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.281+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94904322101760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2681fc0 con 0x5650a2675230 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.281+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94904322098112] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.281+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2682580 con 0x5650a2670870 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.282+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94904322101760] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.282+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.282+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94904322095168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2681fc0 con 0x5650a2670870 2024-09-22T08:12:49.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.282+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2682f90 con 0x7f0d2c037070 2024-09-22T08:12:49.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.283+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94904322095168] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.283+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.284+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94904322108608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2681fc0 con 0x7f0d2c037070 2024-09-22T08:12:49.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.284+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a26839a0 con 0x7f0d2c037070 2024-09-22T08:12:49.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.285+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94904322108608] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.285+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.285+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94904322104560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a26839a0 con 0x7f0d2c037070 2024-09-22T08:12:49.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.285+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2684360 con 0x7f0d2c037070 2024-09-22T08:12:49.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.286+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94904322104560] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.286+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.286+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94904322113680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a26839a0 con 0x7f0d2c037070 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.286+0000 7f0d36532800 20 add_watcher() i=0 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.286+0000 7f0d36532800 20 add_watcher() i=1 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.286+0000 7f0d36532800 20 add_watcher() i=2 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.286+0000 7f0d36532800 20 add_watcher() i=3 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.286+0000 7f0d36532800 20 add_watcher() i=4 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.286+0000 7f0d36532800 20 add_watcher() i=5 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.286+0000 7f0d36532800 20 add_watcher() i=6 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.287+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94904322113680] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.287+0000 7f0d36532800 20 add_watcher() i=7 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.287+0000 7f0d36532800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.287+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a2687880 con 0x5650a2670870 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.287+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.287+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94904322111632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2684bb0 con 0x5650a2670870 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.288+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94904322111632] v34'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.288+0000 7f0be97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0d36532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0d36532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0d36532800 5 note: GC not initialized 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0be37fe640 20 reqs_thread_entry: start 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0d36532800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0d36532800 20 Filter name: none 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0be17fa640 20 reqs_thread_entry: start 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0d36532800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a26ba7e0 con 0x5650a2670870 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.289+0000 7f0d36532800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:12:49.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.290+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650a26bbd60 con 0x7f0d2c037070 2024-09-22T08:12:49.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.290+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.291+0000 7f0be97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:49.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.291+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94904322111632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a26860f0 con 0x5650a2670870 2024-09-22T08:12:49.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.292+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94904322111632] v34'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.292+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94904322089696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2683890 con 0x5650a2675230 2024-09-22T08:12:49.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.293+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94904322089696] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.293+0000 7f0d36532800 20 remove_watcher() i=0 2024-09-22T08:12:49.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.293+0000 7f0d36532800 2 removed watcher, disabling cache 2024-09-22T08:12:49.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.293+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94904322094048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2683890 con 0x5650a2670870 2024-09-22T08:12:49.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.294+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94904322094048] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.294+0000 7f0d36532800 20 remove_watcher() i=1 2024-09-22T08:12:49.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.294+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94904322098112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a267f3e0 con 0x5650a2679bd0 2024-09-22T08:12:49.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.295+0000 7f0d321bc640 1 -- 172.21.15.165:0/3127416674 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94904322098112] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2402e070 con 0x5650a2679bd0 2024-09-22T08:12:49.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.295+0000 7f0d36532800 20 remove_watcher() i=2 2024-09-22T08:12:49.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.295+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94904322101760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2683890 con 0x5650a2675230 2024-09-22T08:12:49.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.296+0000 7f0d329bd640 1 -- 172.21.15.165:0/3127416674 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94904322101760] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2c02a070 con 0x5650a2675230 2024-09-22T08:12:49.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.296+0000 7f0d36532800 20 remove_watcher() i=3 2024-09-22T08:12:49.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.296+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94904322095168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a26803c0 con 0x5650a2670870 2024-09-22T08:12:49.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.297+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94904322095168] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x5650a2670870 2024-09-22T08:12:49.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.297+0000 7f0d36532800 20 remove_watcher() i=4 2024-09-22T08:12:49.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.297+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94904322108608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2683890 con 0x7f0d2c037070 2024-09-22T08:12:49.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.298+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94904322108608] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.298+0000 7f0d36532800 20 remove_watcher() i=5 2024-09-22T08:12:49.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.298+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94904322104560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a26803c0 con 0x7f0d2c037070 2024-09-22T08:12:49.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.299+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94904322104560] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.299+0000 7f0d36532800 20 remove_watcher() i=6 2024-09-22T08:12:49.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.299+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94904322113680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650a2682cc0 con 0x7f0d2c037070 2024-09-22T08:12:49.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.300+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94904322113680] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d1c0881c0 con 0x7f0d2c037070 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.300+0000 7f0d36532800 20 remove_watcher() i=7 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0d2c037070 msgr2=0x7f0d2c040850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f0d2c037070 0x7f0d2c040850 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2670870 msgr2=0x5650a2672ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2670870 0x5650a2672ce0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a2675230 msgr2=0x5650a2677620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a2675230 0x5650a2677620 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5650a2679bd0 msgr2=0x5650a267c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5650a2679bd0 0x5650a267c090 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0bfc03cfb0 msgr2=0x7f0bfc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0bfc03cfb0 0x7f0bfc03f470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5650a26405e0 tx=0x7f0d24033000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 msgr2=0x5650a2664d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d2bfff640 1 -- 172.21.15.165:0/3127416674 reap_dead start 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a2664d50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c049040 tx=0x7f0d2c054720 comp rx=0 tx=0).stop 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 shutdown_connections 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/3127416674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a265d7c0 0x5650a2664d50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 >> 172.21.15.165:0/3127416674 conn(0x5650a2659bc0 msgr2=0x5650a2657dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 shutdown_connections 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/3127416674 wait complete. 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/984822173 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c0c03d000 msgr2=0x7f0c0c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/984822173 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c0c03d000 0x7f0c0c03f4c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5650a2635c90 tx=0x7f0d2401c790 comp rx=0 tx=0).stop 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/984822173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253c830 msgr2=0x5650a253b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/984822173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253c830 0x5650a253b0a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00a2a0 tx=0x7f0d2c018830 comp rx=0 tx=0).stop 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/984822173 shutdown_connections 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/984822173 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c0c03d000 0x7f0c0c03f4c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 --2- 172.21.15.165:0/984822173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253c830 0x5650a253b0a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/984822173 >> 172.21.15.165:0/984822173 conn(0x5650a2642f10 msgr2=0x5650a26432f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/984822173 shutdown_connections 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.301+0000 7f0d36532800 1 -- 172.21.15.165:0/984822173 wait complete. 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2540b80 msgr2=0x5650a263b1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2540b80 0x5650a263b1f0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a263d5d0 msgr2=0x5650a263fa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a263d5d0 0x5650a263fa50 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c1803d000 msgr2=0x7f0c1803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c1803d000 0x7f0c1803f4c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c057000 tx=0x7f0d1c052000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 msgr2=0x5650a2633ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a2633ba0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x5650a262cfc0 tx=0x7f0d24000ed0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 shutdown_connections 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5650a263d5d0 0x5650a263fa50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5650a2540b80 0x5650a263b1f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f0c1803d000 0x7f0c1803f4c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 --2- 172.21.15.165:0/1112826533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5650a253d070 0x5650a2633ba0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 >> 172.21.15.165:0/1112826533 conn(0x5650a2536bb0 msgr2=0x5650a262d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 shutdown_connections 2024-09-22T08:12:49.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.302+0000 7f0d36532800 1 -- 172.21.15.165:0/1112826533 wait complete. 2024-09-22T08:12:49.311 INFO:teuthology.orchestra.run.smithi165.stdout:{"entries":[],"summary":[]} 2024-09-22T08:12:49.311 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-22T08:12:49.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-22T08:12:49.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-22T08:12:49.311 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-22T08:12:49.357 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:49.357 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:49.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.357+0000 7fcc5b71f800 1 Processor -- start 2024-09-22T08:12:49.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.357+0000 7fcc5b71f800 1 -- start start 2024-09-22T08:12:49.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.357+0000 7fcc5b71f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e11f6a2bd0 0x55e11f6a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.357+0000 7fcc5b71f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e11f527a20 con 0x55e11f610510 2024-09-22T08:12:49.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.357+0000 7fcc5b71f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e11f5277d0 con 0x55e11f6a2bd0 2024-09-22T08:12:49.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.358+0000 7fcc56ca1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e11f6a2bd0 0x55e11f6a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.358+0000 7fcc56ca1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e11f6a2bd0 0x55e11f6a5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33746/0 (socket says 172.21.15.165:33746) 2024-09-22T08:12:49.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.358+0000 7fcc574a2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e11f610510 0x55e11f6a14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57728/0 (socket says 172.21.15.165:57728) 2024-09-22T08:12:49.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.358+0000 7fcc56ca1640 1 -- 172.21.15.165:0/4235518477 learned_addr learned my addr 172.21.15.165:0/4235518477 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.358+0000 7fcc56ca1640 1 -- 172.21.15.165:0/4235518477 >> v1:172.21.15.53:6789/0 conn(0x55e11f610510 legacy=0x55e11f6a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.358+0000 7fcc56ca1640 1 -- 172.21.15.165:0/4235518477 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e11f6a6770 con 0x55e11f6a2bd0 2024-09-22T08:12:49.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.360+0000 7fcc56ca1640 1 --2- 172.21.15.165:0/4235518477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f6a2bd0 0x55e11f6a5090 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00a520 tx=0x7fcc4c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b9e5962839e05c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.361 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.360+0000 7fcc564a0640 1 -- 172.21.15.165:0/4235518477 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc4c055070 con 0x55e11f6a2bd0 2024-09-22T08:12:49.361 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.360+0000 7fcc564a0640 1 -- 172.21.15.165:0/4235518477 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4c0515b0 con 0x55e11f6a2bd0 2024-09-22T08:12:49.361 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.360+0000 7fcc564a0640 1 -- 172.21.15.165:0/4235518477 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc4c0518d0 con 0x55e11f6a2bd0 2024-09-22T08:12:49.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.361+0000 7fcc5b71f800 1 -- 172.21.15.165:0/4235518477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f6a2bd0 msgr2=0x55e11f6a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.361+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/4235518477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f6a2bd0 0x55e11f6a5090 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00a520 tx=0x7fcc4c045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.361+0000 7fcc5b71f800 1 -- 172.21.15.165:0/4235518477 shutdown_connections 2024-09-22T08:12:49.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.361+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/4235518477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f6a2bd0 0x55e11f6a5090 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.361+0000 7fcc5b71f800 1 -- 172.21.15.165:0/4235518477 >> 172.21.15.165:0/4235518477 conn(0x55e11f696ba0 msgr2=0x55e11f699000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.361+0000 7fcc5b71f800 1 -- 172.21.15.165:0/4235518477 shutdown_connections 2024-09-22T08:12:49.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.361+0000 7fcc5b71f800 1 -- 172.21.15.165:0/4235518477 wait complete. 2024-09-22T08:12:49.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.374+0000 7fcc5b71f800 1 Processor -- start 2024-09-22T08:12:49.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.374+0000 7fcc5b71f800 1 -- start start 2024-09-22T08:12:49.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.375+0000 7fcc5b71f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f78e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.375+0000 7fcc5b71f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e11f534dd0 con 0x55e11f610510 2024-09-22T08:12:49.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.375+0000 7fcc574a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f78e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.375+0000 7fcc574a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f78e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33762/0 (socket says 172.21.15.165:33762) 2024-09-22T08:12:49.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.375+0000 7fcc574a2640 1 -- 172.21.15.165:0/306062811 learned_addr learned my addr 172.21.15.165:0/306062811 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.375+0000 7fcc574a2640 1 -- 172.21.15.165:0/306062811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e11f78e830 con 0x55e11f610510 2024-09-22T08:12:49.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.375+0000 7fcc574a2640 1 --2- 172.21.15.165:0/306062811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f78e240 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcc480016e0 tx=0x7fcc48001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad60683a73609d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.376+0000 7fcb4560a640 1 -- 172.21.15.165:0/306062811 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc48013420 con 0x55e11f610510 2024-09-22T08:12:49.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.376+0000 7fcb4560a640 1 -- 172.21.15.165:0/306062811 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc480135e0 con 0x55e11f610510 2024-09-22T08:12:49.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.376+0000 7fcb4560a640 1 -- 172.21.15.165:0/306062811 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc48013900 con 0x55e11f610510 2024-09-22T08:12:49.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.376+0000 7fcc5b71f800 1 -- 172.21.15.165:0/306062811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 msgr2=0x55e11f78e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.376+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/306062811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f78e240 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcc480016e0 tx=0x7fcc48001ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.376+0000 7fcc5b71f800 1 -- 172.21.15.165:0/306062811 shutdown_connections 2024-09-22T08:12:49.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.376+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/306062811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f78e240 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.376+0000 7fcc5b71f800 1 -- 172.21.15.165:0/306062811 >> 172.21.15.165:0/306062811 conn(0x55e11f696ba0 msgr2=0x55e11f789bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.376+0000 7fcc5b71f800 1 -- 172.21.15.165:0/306062811 shutdown_connections 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.376+0000 7fcc5b71f800 1 -- 172.21.15.165:0/306062811 wait complete. 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.377+0000 7fcc5b71f800 1 Processor -- start 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.377+0000 7fcc5b71f800 1 -- start start 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.377+0000 7fcc5b71f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f795d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.377+0000 7fcc5b71f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e11f6a5a10 con 0x55e11f610510 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.377+0000 7fcc574a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f795d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.377+0000 7fcc574a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f795d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33766/0 (socket says 172.21.15.165:33766) 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.377+0000 7fcc574a2640 1 -- 172.21.15.165:0/3212995767 learned_addr learned my addr 172.21.15.165:0/3212995767 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.377+0000 7fcc574a2640 1 -- 172.21.15.165:0/3212995767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e11f7962b0 con 0x55e11f610510 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.378+0000 7fcc574a2640 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f795d50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fcc48000f80 tx=0x7fcc48001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.378+0000 7fcb43e07640 1 -- 172.21.15.165:0/3212995767 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc48022020 con 0x55e11f610510 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.378+0000 7fcb43e07640 1 -- 172.21.15.165:0/3212995767 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc48019040 con 0x55e11f610510 2024-09-22T08:12:49.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.378+0000 7fcb43e07640 1 -- 172.21.15.165:0/3212995767 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc48004a40 con 0x55e11f610510 2024-09-22T08:12:49.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.378+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e11f796540 con 0x55e11f610510 2024-09-22T08:12:49.381 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.378+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e11f796f40 con 0x55e11f610510 2024-09-22T08:12:49.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.379+0000 7fcb43e07640 1 -- 172.21.15.165:0/3212995767 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcc48025020 con 0x55e11f610510 2024-09-22T08:12:49.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.379+0000 7fcb43e07640 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cf60 0x7fcb3c03f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.379+0000 7fcb43e07640 1 -- 172.21.15.165:0/3212995767 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcc480545f0 con 0x55e11f610510 2024-09-22T08:12:49.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.379+0000 7fcc56ca1640 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cf60 0x7fcb3c03f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.379+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f6a2bd0 0x55e11f79d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.379+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f79d8e0 con 0x55e11f6a2bd0 2024-09-22T08:12:49.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.379+0000 7fcc57ca3640 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f6a2bd0 0x55e11f79d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.380+0000 7fcc56ca1640 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cf60 0x7fcb3c03f420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c057000 tx=0x7fcc4c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.380+0000 7fcc57ca3640 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f6a2bd0 0x55e11f79d3a0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.380+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3212995767 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f6a2bd0 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.380+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f79dc80 con 0x55e11f6a2bd0 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.380+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3212995767 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f6a2bd0 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.380+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f79f780 0x55e11f7a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.380+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7a23b0 con 0x55e11f79f780 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.380+0000 7fcc574a2640 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f79f780 0x55e11f7a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.381+0000 7fcc574a2640 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f79f780 0x55e11f7a1c20 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.381+0000 7fcc574a2640 1 -- 172.21.15.165:0/3212995767 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f79f780 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.381+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f79e4d0 con 0x55e11f6a2bd0 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.381+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3212995767 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f6a2bd0 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.381+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f79e920 con 0x55e11f6a2bd0 2024-09-22T08:12:49.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.382+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3212995767 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f6a2bd0 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.382+0000 7fcc5b71f800 1 Processor -- start 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.382+0000 7fcc5b71f800 1 -- start start 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.382+0000 7fcc5b71f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7b0d90 0x55e11f7b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.382+0000 7fcc5b71f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e11f593d50 con 0x55e11f7b0d90 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.382+0000 7fcc57ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7b0d90 0x55e11f7b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.382+0000 7fcc57ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7b0d90 0x55e11f7b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33772/0 (socket says 172.21.15.165:33772) 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.382+0000 7fcc57ca3640 1 -- 172.21.15.165:0/514950929 learned_addr learned my addr 172.21.15.165:0/514950929 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.383+0000 7fcc57ca3640 1 -- 172.21.15.165:0/514950929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e11f7b17f0 con 0x55e11f7b0d90 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.383+0000 7fcc57ca3640 1 --2- 172.21.15.165:0/514950929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7b0d90 0x55e11f7b11b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x55e11f797ca0 tx=0x7fcc5000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.383+0000 7fcb41602640 1 -- 172.21.15.165:0/514950929 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc50007dc0 con 0x55e11f7b0d90 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.383+0000 7fcb41602640 1 -- 172.21.15.165:0/514950929 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5001e020 con 0x55e11f7b0d90 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.383+0000 7fcc5b71f800 1 -- 172.21.15.165:0/514950929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e11f7b2020 con 0x55e11f7b0d90 2024-09-22T08:12:49.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.383+0000 7fcb41602640 1 -- 172.21.15.165:0/514950929 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc50019570 con 0x55e11f7b0d90 2024-09-22T08:12:49.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.383+0000 7fcc5b71f800 1 -- 172.21.15.165:0/514950929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e11f7b25c0 con 0x55e11f7b0d90 2024-09-22T08:12:49.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.384+0000 7fcb41602640 1 -- 172.21.15.165:0/514950929 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcc50016040 con 0x55e11f7b0d90 2024-09-22T08:12:49.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.384+0000 7fcb41602640 1 --2- 172.21.15.165:0/514950929 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3003cfb0 0x7fcb3003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.384+0000 7fcb41602640 1 -- 172.21.15.165:0/514950929 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcc5001f030 con 0x55e11f7b0d90 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.384+0000 7fcc574a2640 1 --2- 172.21.15.165:0/514950929 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3003cfb0 0x7fcb3003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.384+0000 7fcc5b71f800 1 Processor -- start 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcc5b71f800 1 -- start start 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcc574a2640 1 --2- 172.21.15.165:0/514950929 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3003cfb0 0x7fcb3003f470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55e11f797e60 tx=0x7fcc48052850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcc5b71f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcc5b71f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e11f78ec60 con 0x55e11f7bd8b0 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcc57ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcc57ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7bdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33782/0 (socket says 172.21.15.165:33782) 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcc57ca3640 1 -- 172.21.15.165:0/1763575389 learned_addr learned my addr 172.21.15.165:0/1763575389 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcc57ca3640 1 -- 172.21.15.165:0/1763575389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e11f7be2a0 con 0x55e11f7bd8b0 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcc57ca3640 1 --2- 172.21.15.165:0/1763575389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7bdcb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fcc50014d90 tx=0x7fcc50014340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316e2877288d4d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcb3affd640 1 -- 172.21.15.165:0/1763575389 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc50051020 con 0x55e11f7bd8b0 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcb3affd640 1 -- 172.21.15.165:0/1763575389 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc500560d0 con 0x55e11f7bd8b0 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.385+0000 7fcb3affd640 1 -- 172.21.15.165:0/1763575389 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc5001d070 con 0x55e11f7bd8b0 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 -- 172.21.15.165:0/1763575389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 msgr2=0x55e11f7bdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/1763575389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7bdcb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fcc50014d90 tx=0x7fcc50014340 comp rx=0 tx=0).stop 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 -- 172.21.15.165:0/1763575389 shutdown_connections 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/1763575389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7bdcb0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 -- 172.21.15.165:0/1763575389 >> 172.21.15.165:0/1763575389 conn(0x55e11f7b9cb0 msgr2=0x55e11f7b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 -- 172.21.15.165:0/1763575389 shutdown_connections 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 -- 172.21.15.165:0/1763575389 wait complete. 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 Processor -- start 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 -- start start 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.386+0000 7fcc5b71f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e11f7be8c0 con 0x55e11f7bd8b0 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.387+0000 7fcc57ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.387+0000 7fcc57ca3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33788/0 (socket says 172.21.15.165:33788) 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.387+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 learned_addr learned my addr 172.21.15.165:0/3096889496 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.387+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e11f7c5380 con 0x55e11f7bd8b0 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.387+0000 7fcc57ca3640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7c4e20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fcc50014d40 tx=0x7fcc500545f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.387+0000 7fcb397fa640 1 -- 172.21.15.165:0/3096889496 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc50045340 con 0x55e11f7bd8b0 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.387+0000 7fcb397fa640 1 -- 172.21.15.165:0/3096889496 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc500454e0 con 0x55e11f7bd8b0 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.387+0000 7fcb397fa640 1 -- 172.21.15.165:0/3096889496 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc500173b0 con 0x55e11f7bd8b0 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.387+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e11f7c5610 con 0x55e11f7bd8b0 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.387+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e11f7c5f90 con 0x55e11f7bd8b0 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.388+0000 7fcb397fa640 1 -- 172.21.15.165:0/3096889496 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcc50033030 con 0x55e11f7bd8b0 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.388+0000 7fcb397fa640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2003cfb0 0x7fcb2003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.388+0000 7fcb397fa640 1 -- 172.21.15.165:0/3096889496 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcc50031070 con 0x55e11f7bd8b0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.388+0000 7fcc574a2640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2003cfb0 0x7fcb2003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc574a2640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2003cfb0 0x7fcb2003f470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcc480108d0 tx=0x7fcc4804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f7d07f0 0x55e11f7d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7d3400 con 0x55e11f7d07f0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc56ca1640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f7d07f0 0x55e11f7d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc56ca1640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f7d07f0 0x55e11f7d2cb0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc5b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc5b71f800 20 realm 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.389+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7d3830 con 0x55e11f7d07f0 2024-09-22T08:12:49.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7d4100 con 0x55e11f7d07f0 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7d44a0 con 0x55e11f7d07f0 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f7d5200 0x55e11f7d75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7d7c00 con 0x55e11f7d5200 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.390+0000 7fcc57ca3640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f7d5200 0x55e11f7d75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.391+0000 7fcc57ca3640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f7d5200 0x55e11f7d75f0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.391+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.391+0000 7fcc5b71f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.391+0000 7fcc5b71f800 20 searching for the correct realm 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.391+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e11f7d9bb0 0x55e11f7dc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.391+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.391+0000 7fcc574a2640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e11f7d9bb0 0x55e11f7dc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.391+0000 7fcc574a2640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e11f7d9bb0 0x55e11f7dc070 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.391+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.391+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d5200 2024-09-22T08:12:49.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.392+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.392+0000 7fcc57ca3640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcc50019040 0x7fcc500164f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.392+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x7fcc50019040 2024-09-22T08:12:49.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.392+0000 7fcc56ca1640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcc50019040 0x7fcc500164f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.393+0000 7fcc56ca1640 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcc50019040 0x7fcc500164f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.393+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x7fcc50019040 2024-09-22T08:12:49.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.393+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d07f0 2024-09-22T08:12:49.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.393+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.393+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d07f0 2024-09-22T08:12:49.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.393+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.393+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x7fcc50019040 2024-09-22T08:12:49.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.394+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x7fcc50019040 2024-09-22T08:12:49.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.394+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d5200 2024-09-22T08:12:49.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.394+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.394+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d5200 2024-09-22T08:12:49.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.394+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.394+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.394+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.394+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d07f0 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.394+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.394+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x7fcc50019040 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.395+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x7fcc50019040 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.395+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d07f0 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.395+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.395+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d5200 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.395+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.395+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.396+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.396+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.396+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.396+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x7fcc50019040 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.396+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x7fcc50019040 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.396+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.396+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.396+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.397+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.397+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d07f0 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.397+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.397+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d07f0 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.397+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.397+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x7fcc50019040 2024-09-22T08:12:49.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.397+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x7fcc50019040 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.397+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.398+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.398+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d5200 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.398+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.398+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d07f0 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.398+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.398+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x7fcc50019040 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.398+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x7fcc50019040 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.398+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.399+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.399+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x7fcc50019040 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.399+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x7fcc50019040 2024-09-22T08:12:49.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.399+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d5200 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.399+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.399+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.399+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.399+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x7fcc50019040 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4c057030 con 0x7fcc50019040 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d07f0 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dc6f0 con 0x55e11f7d5200 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:49.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7d85c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.400+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7d8e60 con 0x55e11f7d07f0 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcc4c057030 con 0x55e11f7d07f0 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dcb70 con 0x55e11f7d07f0 2024-09-22T08:12:49.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 20 zone default found 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 4 Realm: () 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 20 zonegroup default 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dcf30 con 0x7fcc50019040 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7ded60 con 0x55e11f7d9bb0 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.401+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7df1b0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.402+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.402+0000 7fcc5b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.402+0000 7fcc5b71f800 20 started sync module instance, tier type = 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.402+0000 7fcc5b71f800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.402+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7de200 con 0x55e11f7d5200 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.403+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.403+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94425384347472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7de200 con 0x55e11f7d5200 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.403+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dfc70 con 0x55e11f7d07f0 2024-09-22T08:12:49.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.404+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94425384347472] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.404+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.404+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94425384344912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7dfc30 con 0x55e11f7d07f0 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.404+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e0750 con 0x55e11f7d9bb0 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.405+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.405+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94425384354336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e0ff0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.405+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e1ac0 con 0x55e11f7d5200 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.406+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94425384344912] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.406+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.406+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94425384359344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e1eb0 con 0x55e11f7d5200 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.406+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94425384354336] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.406+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e2910 con 0x55e11f7d07f0 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.408+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94425384359344] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.408+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.408+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94425384351616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e2910 con 0x55e11f7d07f0 2024-09-22T08:12:49.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.408+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e31b0 con 0x7fcc50019040 2024-09-22T08:12:49.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.409+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94425384351616] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.409+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.409+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94425384356672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e2dc0 con 0x7fcc50019040 2024-09-22T08:12:49.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.409+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e37c0 con 0x7fcc50019040 2024-09-22T08:12:49.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.410+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94425384356672] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.410+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.410+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94425384366800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e39a0 con 0x7fcc50019040 2024-09-22T08:12:49.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.410+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e41f0 con 0x7fcc50019040 2024-09-22T08:12:49.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.411+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.411+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94425384369024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e45d0 con 0x7fcc50019040 2024-09-22T08:12:49.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.411+0000 7fcc5b71f800 20 add_watcher() i=0 2024-09-22T08:12:49.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.411+0000 7fcc5b71f800 20 add_watcher() i=1 2024-09-22T08:12:49.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.411+0000 7fcc5b71f800 20 add_watcher() i=2 2024-09-22T08:12:49.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.411+0000 7fcc5b71f800 20 add_watcher() i=3 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.411+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94425384366800] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.411+0000 7fcc5b71f800 20 add_watcher() i=4 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.411+0000 7fcc5b71f800 20 add_watcher() i=5 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.411+0000 7fcc5b71f800 20 add_watcher() i=6 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.412+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94425384369024] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.412+0000 7fcc5b71f800 20 add_watcher() i=7 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.412+0000 7fcc5b71f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.412+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e29c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.413+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.413+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94425384370272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7e4fc0 con 0x55e11f7d07f0 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.414+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94425384370272] v34'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.414+0000 7fcb0e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:49.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.414+0000 7fcc5b71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.414+0000 7fcc5b71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.414+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f02c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.415+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.415+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f08d0 con 0x7fcc50019040 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.416+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.416+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f0e40 con 0x55e11f7d9bb0 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.417+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.418+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f11e0 con 0x55e11f7d07f0 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.418+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.419+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f17d0 con 0x55e11f7d5200 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.420+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.420+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f17b0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.421+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.421+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f1de0 con 0x55e11f7d07f0 2024-09-22T08:12:49.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.422+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.422+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f1ac0 con 0x7fcc50019040 2024-09-22T08:12:49.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.423+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'50 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.423+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f1b50 con 0x55e11f7d5200 2024-09-22T08:12:49.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.424+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.424+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f1b50 con 0x55e11f7d9bb0 2024-09-22T08:12:49.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.425+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.425+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d5200 2024-09-22T08:12:49.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.426+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.426+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x7fcc50019040 2024-09-22T08:12:49.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.427+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.427+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d5200 2024-09-22T08:12:49.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.428+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.428+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x7fcc50019040 2024-09-22T08:12:49.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.429+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.429+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d07f0 2024-09-22T08:12:49.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.430+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.430+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d9bb0 2024-09-22T08:12:49.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.432+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'68 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.432+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d5200 2024-09-22T08:12:49.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.433+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.433+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d9bb0 2024-09-22T08:12:49.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.434+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.434+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d07f0 2024-09-22T08:12:49.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.435+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.435+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d07f0 2024-09-22T08:12:49.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.436+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.436+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d9bb0 2024-09-22T08:12:49.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.437+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'69 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.437+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d5200 2024-09-22T08:12:49.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.438+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.438+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d9bb0 2024-09-22T08:12:49.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.438+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.438+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d9bb0 2024-09-22T08:12:49.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.439+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.439+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2000 con 0x55e11f7d9bb0 2024-09-22T08:12:49.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.440+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.440+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.441+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.441+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2030 con 0x7fcc50019040 2024-09-22T08:12:49.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.443+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.443+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2060 con 0x55e11f7d9bb0 2024-09-22T08:12:49.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.444+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.444+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2050 con 0x7fcc50019040 2024-09-22T08:12:49.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.445+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'51 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.445+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2050 con 0x55e11f7d9bb0 2024-09-22T08:12:49.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.446+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'70 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.446+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2060 con 0x7fcc50019040 2024-09-22T08:12:49.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.447+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.447+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f7f2090 con 0x55e11f7d5200 2024-09-22T08:12:49.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.448+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.448+0000 7fcb0d7e2640 20 reqs_thread_entry: start 2024-09-22T08:12:49.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.448+0000 7fcc5b71f800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:49.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.448+0000 7fcc5b71f800 20 Filter name: none 2024-09-22T08:12:49.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.448+0000 7fcb067fc640 20 reqs_thread_entry: start 2024-09-22T08:12:49.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f81cfb0 con 0x55e11f7d07f0 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f81f480 con 0x55e11f7d5200 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 : miss 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.451 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.449+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:96 8.11 8:8ed47661:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f81db80 con 0x55e11f7d9bb0 2024-09-22T08:12:49.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.450+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(96 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.450+0000 7fcc5b71f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-22T08:12:49.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.450+0000 7fcc5b71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 info.flags=0x17 2024-09-22T08:12:49.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.450+0000 7fcc5b71f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 to cache LRU end 2024-09-22T08:12:49.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.450+0000 7fcc5b71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.450+0000 7fcc5b71f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.450+0000 7fcc5b71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.450+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:97 4.27 4:e6876c18:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x55e11f7d07f0 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.450+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(97 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.450+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:98 4.3d 4:bc0f8261:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x55e11f7d9bb0 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.451+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(98 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.451+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:99 4.2 4:403b5d1c:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x55e11f7d07f0 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.451+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(99 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.451+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:100 4.c 4:32dfddd3:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x55e11f7d07f0 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.451+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(100 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.451+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:101 4.3d 4:bf3a4775:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x55e11f7d9bb0 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.452+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(101 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4 [call out=429b] v0'0 uv4 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.452+0000 7fcc5b71f800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.452+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:102 4.19 4:9bb82eea:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x55e11f7d9bb0 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.452+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== osd_op_reply(102 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.452+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:103 4.1 4:81d5fb7f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x55e11f7d5200 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.452+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(103 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.6 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.452+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:104 4.19 4:9948e2d8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x55e11f7d9bb0 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.452+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(104 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.452+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:105 4.11 4:8b576d36:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x7fcc50019040 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.453+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(105 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.453+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:106 4.1e 4:7b0b53ac:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x7fcc50019040 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(106 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:107 4.6 4:602667f5:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89cd00 con 0x55e11f7d9bb0 2024-09-22T08:12:49.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 31 ==== osd_op_reply(107 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc5b71f800 20 get_obj_state: octx=0x7fcc50014ec0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55e11f89b0f8 s->prefetch_data=0 2024-09-22T08:12:49.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:108 3.25s0 3:a64397e4:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7_15f6f8dc036519d7fe15b39338f6e5db:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8201a0 con 0x55e11f7d07f0 2024-09-22T08:12:49.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(108 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7_15f6f8dc036519d7fe15b39338f6e5db [call out=24b,getxattrs out=886b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+926 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc5b71f800 10 manifest: total_size = 6 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc5b71f800 20 get_obj_state: setting s->obj_tag to cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.3315173546912913245 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc5b71f800 20 get_obj_state: octx=0x7fcc50014ec0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55e11f89b0f8 s->prefetch_data=0 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc5b71f800 20 prepare_atomic_modification: state is not atomic. state=0x55e11f89b0f8 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc5b71f800 20 bucket index object: :.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.454+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:109 4.3d 4:bf3a4775:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89c730 con 0x55e11f7d9bb0 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.455+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 32 ==== osd_op_reply(109 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcc4800f030 con 0x55e11f7d9bb0 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.455+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:110 3.25s0 3:a64397e4:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89c730 con 0x55e11f7d07f0 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.456+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(110 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.456+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:111 4.3d 4:bf3a4775:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8247b0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 20 list_objects_ordered: starting attempt 1 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-22T08:12:49.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:112 4.27 4:e6876c18:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8247b0 con 0x55e11f7d07f0 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:113 4.3d 4:bc0f8261:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f828b00 con 0x55e11f7d9bb0 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:114 4.2 4:403b5d1c:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f82b440 con 0x55e11f7d07f0 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:115 4.c 4:32dfddd3:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f82e050 con 0x55e11f7d07f0 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:116 4.3d 4:bf3a4775:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f830df0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:117 4.19 4:9bb82eea:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f833780 con 0x55e11f7d9bb0 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:118 4.1 4:81d5fb7f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f836600 con 0x55e11f7d5200 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:119 4.19 4:9948e2d8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8247b0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:120 4.11 4:8b576d36:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8247f0 con 0x7fcc50019040 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:121 4.1e 4:7b0b53ac:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f83d610 con 0x7fcc50019040 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:122 4.6 4:602667f5:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f840460 con 0x55e11f7d9bb0 2024-09-22T08:12:49.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(118 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.6 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.457+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(112 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.458+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 35 ==== osd_op_reply(114 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.458+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 33 ==== osd_op_reply(122 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.458+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 34 ==== osd_op_reply(117 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.458+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(120 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.458+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(121 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.458+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 35 ==== osd_op_reply(113 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.458+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 36 ==== osd_op_reply(115 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.458+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 36 ==== osd_op_reply(119 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.458+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 37 ==== osd_op_reply(111 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.458+0000 7fcb3a7fc640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 38 ==== osd_op_reply(116 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7])"; uploads.size()=0; is_truncated=0 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:123 4.27 4:e6876c18:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8247f0 con 0x55e11f7d07f0 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:124 4.3d 4:bc0f8261:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89c120 con 0x55e11f7d9bb0 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:125 4.2 4:403b5d1c:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8247f0 con 0x55e11f7d07f0 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:126 4.c 4:32dfddd3:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8321e0 con 0x55e11f7d07f0 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:127 4.3d 4:bf3a4775:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8404c0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:128 4.19 4:9bb82eea:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8247f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:129 4.1 4:81d5fb7f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8404c0 con 0x55e11f7d5200 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:130 4.19 4:9948e2d8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89c120 con 0x55e11f7d9bb0 2024-09-22T08:12:49.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:131 4.11 4:8b576d36:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8321e0 con 0x7fcc50019040 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:132 4.1e 4:7b0b53ac:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8240e0 con 0x7fcc50019040 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:133 4.6 4:602667f5:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8247f0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 37 ==== osd_op_reply(123 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 38 ==== osd_op_reply(125 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 39 ==== osd_op_reply(126 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 39 ==== osd_op_reply(124 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 40 ==== osd_op_reply(128 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 41 ==== osd_op_reply(133 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 42 ==== osd_op_reply(130 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== osd_op_reply(129 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.6 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 43 ==== osd_op_reply(127 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.459+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(131 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.460+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(132 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.460+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8404c0 con 0x55e11f7d5200 2024-09-22T08:12:49.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.461+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 24 ==== osd_op_reply(134 foo.buckets [call] v34'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.461+0000 7fcc5b71f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-22T08:12:49.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.461+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.461+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8404c0 con 0x55e11f7d5200 2024-09-22T08:12:49.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.461+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 25 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fcc500083e0 con 0x55e11f7d5200 2024-09-22T08:12:49.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.461+0000 7fcc5b71f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-22T08:12:49.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.461+0000 7fcc5b71f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-22T08:12:49.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.461+0000 7fcc5b71f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-22T08:12:49.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.461+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8404c0 con 0x55e11f7d5200 2024-09-22T08:12:49.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.462+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 26 ==== osd_op_reply(136 myfoo [call,call,delete] v34'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fcc5006e040 con 0x55e11f7d5200 2024-09-22T08:12:49.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.462+0000 7fcc5b71f800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.462+0000 7fcc5b71f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.462+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94425384634128 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8404c0 con 0x7fcc50019040 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.462+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== watch-notify(notify (1) cookie 94425384366800 notify 146028888107 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55e11f7e9a70 con 0x7fcc50019040 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.462+0000 7fcb3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94425384366800 notifier 4780 bl.length()=149 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.462+0000 7fcb3affd640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcb1c003d60 con 0x7fcc50019040 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.462+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(137 notify.6 [notify cookie 94425384634128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.463+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.463+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== watch-notify(notify_complete (2) cookie 94425384634128 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e11f7f0aa0 con 0x7fcc50019040 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.463+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:139 8.11 8:8ed47661:root::.bucket.meta.myfoo%3acc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8404c0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.464+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 44 ==== osd_op_reply(139 .bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.464+0000 7fcc5b71f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 from cache 2024-09-22T08:12:49.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.464+0000 7fcc5b71f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7, ofs0, ns] 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.464+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94425384634128 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8404c0 con 0x7fcc50019040 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.464+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== watch-notify(notify (1) cookie 94425384366800 notify 146028888108 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55e11f7f0aa0 con 0x7fcc50019040 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.464+0000 7fcb3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 94425384366800 notifier 4780 bl.length()=206 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.464+0000 7fcb3a7fc640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fca800032c0 con 0x7fcc50019040 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.464+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(140 notify.6 [notify cookie 94425384634128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 35 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 36 ==== watch-notify(notify_complete (2) cookie 94425384634128 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e11f7f0c70 con 0x7fcc50019040 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:142 4.27 4:e6876c18:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8404c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:143 4.3d 4:bc0f8261:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89c120 con 0x55e11f7d9bb0 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:144 4.2 4:403b5d1c:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d07f0 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:145 4.c 4:32dfddd3:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89b360 con 0x55e11f7d07f0 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:146 4.3d 4:bf3a4775:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8404c0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:147 4.19 4:9bb82eea:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89c120 con 0x55e11f7d9bb0 2024-09-22T08:12:49.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:148 4.1 4:81d5fb7f:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89b360 con 0x55e11f7d5200 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:149 4.19 4:9948e2d8:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f89b360 con 0x55e11f7d9bb0 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:150 4.11 4:8b576d36:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x7fcc50019040 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:151 4.1e 4:7b0b53ac:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f833ca0 con 0x7fcc50019040 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.465+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:152 4.6 4:602667f5:::.dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f8346c0 con 0x55e11f7d9bb0 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 40 ==== osd_op_reply(142 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.0 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 45 ==== osd_op_reply(152 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.10 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 41 ==== osd_op_reply(144 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.2 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 42 ==== osd_op_reply(145 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.3 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 37 ==== osd_op_reply(150 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.8 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 46 ==== osd_op_reply(143 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.1 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 47 ==== osd_op_reply(147 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.5 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 48 ==== osd_op_reply(149 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.7 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 27 ==== osd_op_reply(148 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.6 [delete] v34'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc5006e040 con 0x55e11f7d5200 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 49 ==== osd_op_reply(146 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.4 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 38 ==== osd_op_reply(151 .dir.cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7.9 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc5b71f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 : miss 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc5b71f800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.467+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:153 6.18 6:1ce357f4:::pubsub..bucket.myfoo%2fcc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x7fcc50019040 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.468+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 39 ==== osd_op_reply(153 pubsub..bucket.myfoo/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.468+0000 7fcc5b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.468+0000 7fcc5b71f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 info.flags=0x0 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.468+0000 7fcc5b71f800 10 adding default.rgw.log++pubsub..bucket.myfoo/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 to cache LRU end 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.468+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:154 6.18 6:1ce357f4:::pubsub..bucket.myfoo%2fcc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x7fcc50019040 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.469+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 40 ==== osd_op_reply(154 pubsub..bucket.myfoo/cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.7 [delete] v34'29 uv21 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.469+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d5200 2024-09-22T08:12:49.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.470+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 28 ==== osd_op_reply(155 foo.buckets [call] v34'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcc5006e040 con 0x55e11f7d5200 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.470+0000 7fcc5b71f800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.470+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x7fcc50019040 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 41 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcc5b71f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94425385124128 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d5200 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 29 ==== watch-notify(notify (1) cookie 94425384359344 notify 146028888083 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55e11f7f1520 con 0x55e11f7d5200 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcb3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94425384359344 notifier 4780 bl.length()=170 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcb3affd640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcb1c003d60 con 0x55e11f7d5200 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 30 ==== osd_op_reply(157 notify.3 [notify cookie 94425385124128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc5006e040 con 0x55e11f7d5200 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 31 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc5006e040 con 0x55e11f7d5200 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 32 ==== watch-notify(notify_complete (2) cookie 94425385124128 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e11f7c5380 con 0x55e11f7d5200 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcc5b71f800 10 removing email index: foo@foo.com 2024-09-22T08:12:49.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.471+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d07f0 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 43 ==== osd_op_reply(159 foo@foo.com [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcc5b71f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94425385124128 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d5200 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 33 ==== watch-notify(notify (1) cookie 94425384359344 notify 146028888084 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55e11f7c5380 con 0x55e11f7d5200 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcb3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94425384359344 notifier 4780 bl.length()=162 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 34 ==== osd_op_reply(160 notify.3 [notify cookie 94425385124128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc5006e040 con 0x55e11f7d5200 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcb3a7fc640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fca800032c0 con 0x55e11f7d5200 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 35 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc5006e040 con 0x55e11f7d5200 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 36 ==== watch-notify(notify_complete (2) cookie 94425385124128 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e11f7be2a0 con 0x55e11f7d5200 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcc5b71f800 10 removing user buckets index 2024-09-22T08:12:49.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.473+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d5200 2024-09-22T08:12:49.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.474+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 37 ==== osd_op_reply(162 foo.buckets [delete] v34'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcc5006e040 con 0x55e11f7d5200 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.474+0000 7fcc5b71f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.474+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94425385124128 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x7fcc50019040 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.475+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 42 ==== watch-notify(notify (1) cookie 94425384356672 notify 146028888109 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55e11f7f0c70 con 0x7fcc50019040 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.475+0000 7fcb3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888109 cookie 94425384356672 notifier 4780 bl.length()=160 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.475+0000 7fcb3affd640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcb1c003d60 con 0x7fcc50019040 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.475+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 43 ==== osd_op_reply(163 notify.5 [notify cookie 94425385124128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.475+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.475+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 45 ==== watch-notify(notify_complete (2) cookie 94425385124128 notify 146028888109 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e11f7f02c0 con 0x7fcc50019040 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.475+0000 7fcc5b71f800 10 removing user index: foo 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.475+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d07f0 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.476+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 44 ==== osd_op_reply(165 foo [call,call,delete] v34'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.476+0000 7fcc5b71f800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-22T08:12:49.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.476+0000 7fcc5b71f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.476+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94425385124128 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d07f0 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.476+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 45 ==== watch-notify(notify (1) cookie 94425384351616 notify 146028888094 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55e11f7f02c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.476+0000 7fcb3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 94425384351616 notifier 4780 bl.length()=152 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.476+0000 7fcb3a7fc640 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fca800032c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.476+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 46 ==== osd_op_reply(166 notify.4 [notify cookie 94425385124128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.476+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 47 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.477+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 48 ==== watch-notify(notify_complete (2) cookie 94425385124128 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e11f7f0660 con 0x55e11f7d07f0 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.477+0000 7fcb0e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.477+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94425384370272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d07f0 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.478+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 49 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94425384370272] v34'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.478+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94425384347472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d5200 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.479+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 38 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94425384347472] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc5006e040 con 0x55e11f7d5200 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.479+0000 7fcc5b71f800 20 remove_watcher() i=0 2024-09-22T08:12:49.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.479+0000 7fcc5b71f800 2 removed watcher, disabling cache 2024-09-22T08:12:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.479+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94425384344912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d07f0 2024-09-22T08:12:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.481+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 50 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94425384344912] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.481+0000 7fcc5b71f800 20 remove_watcher() i=1 2024-09-22T08:12:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.481+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94425384354336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d9bb0 2024-09-22T08:12:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.482+0000 7fcc574a2640 1 -- 172.21.15.165:0/3096889496 <== osd.3 v2:172.21.15.165:6800/215521179 50 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94425384354336] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4805f040 con 0x55e11f7d9bb0 2024-09-22T08:12:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.482+0000 7fcc5b71f800 20 remove_watcher() i=2 2024-09-22T08:12:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.482+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94425384359344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d5200 2024-09-22T08:12:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.483+0000 7fcc57ca3640 1 -- 172.21.15.165:0/3096889496 <== osd.2 v2:172.21.15.165:6808/3197121696 39 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94425384359344] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc5006e040 con 0x55e11f7d5200 2024-09-22T08:12:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.483+0000 7fcc5b71f800 20 remove_watcher() i=3 2024-09-22T08:12:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.483+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94425384351616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x55e11f7d07f0 2024-09-22T08:12:49.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.484+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.1 v2:172.21.15.165:6816/2347568643 51 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94425384351616] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x55e11f7d07f0 2024-09-22T08:12:49.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.484+0000 7fcc5b71f800 20 remove_watcher() i=4 2024-09-22T08:12:49.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.484+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94425384356672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x7fcc50019040 2024-09-22T08:12:49.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.485+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 46 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94425384356672] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.485+0000 7fcc5b71f800 20 remove_watcher() i=5 2024-09-22T08:12:49.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.485+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94425384366800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x7fcc50019040 2024-09-22T08:12:49.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.486+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 47 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94425384366800] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.486+0000 7fcc5b71f800 20 remove_watcher() i=6 2024-09-22T08:12:49.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.486+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94425384369024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e11f824710 con 0x7fcc50019040 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 <== osd.0 v2:172.21.15.53:6800/2902972477 48 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94425384369024] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc4c0881c0 con 0x7fcc50019040 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 20 remove_watcher() i=7 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcc50019040 msgr2=0x7fcc500164f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fcc50019040 0x7fcc500164f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f7d07f0 msgr2=0x55e11f7d2cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f7d07f0 0x55e11f7d2cb0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f7d5200 msgr2=0x55e11f7d75f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f7d5200 0x55e11f7d75f0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e11f7d9bb0 msgr2=0x55e11f7dc070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e11f7d9bb0 0x55e11f7dc070 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2003cfb0 msgr2=0x7fcb2003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.487+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2003cfb0 0x7fcb2003f470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcc480108d0 tx=0x7fcc4804f000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc56ca1640 1 -- 172.21.15.165:0/3096889496 reap_dead start 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 msgr2=0x55e11f7c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7c4e20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fcc50014d40 tx=0x7fcc500545f0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 shutdown_connections 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3096889496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7bd8b0 0x55e11f7c4e20 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 >> 172.21.15.165:0/3096889496 conn(0x55e11f7b9cb0 msgr2=0x55e11f7b7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 shutdown_connections 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3096889496 wait complete. 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/514950929 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3003cfb0 msgr2=0x7fcb3003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/514950929 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3003cfb0 0x7fcb3003f470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55e11f797e60 tx=0x7fcc48052850 comp rx=0 tx=0).stop 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/514950929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7b0d90 msgr2=0x55e11f7b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/514950929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7b0d90 0x55e11f7b11b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x55e11f797ca0 tx=0x7fcc5000af40 comp rx=0 tx=0).stop 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/514950929 shutdown_connections 2024-09-22T08:12:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/514950929 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3003cfb0 0x7fcb3003f470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/514950929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f7b0d90 0x55e11f7b11b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/514950929 >> 172.21.15.165:0/514950929 conn(0x55e11f7a5140 msgr2=0x55e11f7a5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/514950929 shutdown_connections 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/514950929 wait complete. 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f6a2bd0 msgr2=0x55e11f79d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f6a2bd0 0x55e11f79d3a0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f79f780 msgr2=0x55e11f7a1c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.488+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f79f780 0x55e11f7a1c20 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cf60 msgr2=0x7fcb3c03f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cf60 0x7fcb3c03f420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c057000 tx=0x7fcc4c052000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 msgr2=0x55e11f795d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f795d50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fcc48000f80 tx=0x7fcc48001250 comp rx=0 tx=0).stop 2024-09-22T08:12:49.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 shutdown_connections 2024-09-22T08:12:49.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e11f79f780 0x55e11f7a1c20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e11f6a2bd0 0x55e11f79d3a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cf60 0x7fcb3c03f420 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 --2- 172.21.15.165:0/3212995767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e11f610510 0x55e11f795d50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 >> 172.21.15.165:0/3212995767 conn(0x55e11f696ba0 msgr2=0x55e11f78f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 shutdown_connections 2024-09-22T08:12:49.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.489+0000 7fcc5b71f800 1 -- 172.21.15.165:0/3212995767 wait complete. 2024-09-22T08:12:49.498 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-22T08:12:49.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-22T08:12:49.498 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-22T08:12:49.543 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:49.543 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:49.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.543+0000 7f8945346800 1 Processor -- start 2024-09-22T08:12:49.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.543+0000 7f8945346800 1 -- start start 2024-09-22T08:12:49.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.543+0000 7f8945346800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557b3720e530 0x557b3729f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.543+0000 7f8945346800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b37125a20 con 0x557b3729fa00 2024-09-22T08:12:49.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.543+0000 7f8945346800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x557b371257d0 con 0x557b3720e530 2024-09-22T08:12:49.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.543+0000 7f8942e30640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557b3720e530 0x557b3729f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.543+0000 7f894262f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x557b3729fa00 0x557b372a1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57732/0 (socket says 172.21.15.165:57732) 2024-09-22T08:12:49.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.543+0000 7f8942e30640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557b3720e530 0x557b3729f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33802/0 (socket says 172.21.15.165:33802) 2024-09-22T08:12:49.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.543+0000 7f894262f640 1 -- 172.21.15.165:0/1224975274 learned_addr learned my addr 172.21.15.165:0/1224975274 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:49.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.544+0000 7f8942e30640 1 -- 172.21.15.165:0/1224975274 >> v1:172.21.15.53:6789/0 conn(0x557b3729fa00 legacy=0x557b372a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.544+0000 7f8942e30640 1 -- 172.21.15.165:0/1224975274 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b372a47b0 con 0x557b3720e530 2024-09-22T08:12:49.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8942e30640 1 --2- 172.21.15.165:0/1224975274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b3729f490 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f893400a470 tx=0x7f8934045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1362397ede9104 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8941e2e640 1 -- 172.21.15.165:0/1224975274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8934053570 con 0x557b3720e530 2024-09-22T08:12:49.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8941e2e640 1 -- 172.21.15.165:0/1224975274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8934058070 con 0x557b3720e530 2024-09-22T08:12:49.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8941e2e640 1 -- 172.21.15.165:0/1224975274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8934053880 con 0x557b3720e530 2024-09-22T08:12:49.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8945346800 1 -- 172.21.15.165:0/1224975274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 msgr2=0x557b3729f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8945346800 1 --2- 172.21.15.165:0/1224975274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b3729f490 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f893400a470 tx=0x7f8934045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:49.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8945346800 1 -- 172.21.15.165:0/1224975274 shutdown_connections 2024-09-22T08:12:49.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8945346800 1 --2- 172.21.15.165:0/1224975274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b3729f490 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8945346800 1 -- 172.21.15.165:0/1224975274 >> 172.21.15.165:0/1224975274 conn(0x557b37294ba0 msgr2=0x557b37297000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8945346800 1 -- 172.21.15.165:0/1224975274 shutdown_connections 2024-09-22T08:12:49.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.546+0000 7f8945346800 1 -- 172.21.15.165:0/1224975274 wait complete. 2024-09-22T08:12:49.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.560+0000 7f8945346800 1 Processor -- start 2024-09-22T08:12:49.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.560+0000 7f8945346800 1 -- start start 2024-09-22T08:12:49.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.560+0000 7f8945346800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b3738c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.560+0000 7f8945346800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557b37132dd0 con 0x557b3720e530 2024-09-22T08:12:49.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.561+0000 7f8942e30640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b3738c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.561+0000 7f8942e30640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b3738c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33816/0 (socket says 172.21.15.165:33816) 2024-09-22T08:12:49.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.561+0000 7f8942e30640 1 -- 172.21.15.165:0/601425486 learned_addr learned my addr 172.21.15.165:0/601425486 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.561+0000 7f8942e30640 1 -- 172.21.15.165:0/601425486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3738c830 con 0x557b3720e530 2024-09-22T08:12:49.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.561+0000 7f8942e30640 1 --2- 172.21.15.165:0/601425486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b3738c240 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8934025c20 tx=0x7f8934051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6918f60fa722c307 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.562+0000 7f8830e09640 1 -- 172.21.15.165:0/601425486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8934053570 con 0x557b3720e530 2024-09-22T08:12:49.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.562+0000 7f8830e09640 1 -- 172.21.15.165:0/601425486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8934063070 con 0x557b3720e530 2024-09-22T08:12:49.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.562+0000 7f8830e09640 1 -- 172.21.15.165:0/601425486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8934053840 con 0x557b3720e530 2024-09-22T08:12:49.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.562+0000 7f8945346800 1 -- 172.21.15.165:0/601425486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 msgr2=0x557b3738c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.562+0000 7f8945346800 1 --2- 172.21.15.165:0/601425486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b3738c240 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8934025c20 tx=0x7f8934051000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.562+0000 7f8945346800 1 -- 172.21.15.165:0/601425486 shutdown_connections 2024-09-22T08:12:49.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.562+0000 7f8945346800 1 --2- 172.21.15.165:0/601425486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b3738c240 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.562+0000 7f8945346800 1 -- 172.21.15.165:0/601425486 >> 172.21.15.165:0/601425486 conn(0x557b37294ba0 msgr2=0x557b37387bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.562+0000 7f8945346800 1 -- 172.21.15.165:0/601425486 shutdown_connections 2024-09-22T08:12:49.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.562+0000 7f8945346800 1 -- 172.21.15.165:0/601425486 wait complete. 2024-09-22T08:12:49.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.563+0000 7f8945346800 1 Processor -- start 2024-09-22T08:12:49.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.563+0000 7f8945346800 1 -- start start 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.563+0000 7f8945346800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b37393cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.563+0000 7f8945346800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557b372a3a50 con 0x557b3720e530 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.563+0000 7f8942e30640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b37393cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.563+0000 7f8942e30640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b37393cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33824/0 (socket says 172.21.15.165:33824) 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.563+0000 7f8942e30640 1 -- 172.21.15.165:0/3991138048 learned_addr learned my addr 172.21.15.165:0/3991138048 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.563+0000 7f8942e30640 1 -- 172.21.15.165:0/3991138048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b37394250 con 0x557b3720e530 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.564+0000 7f8942e30640 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b37393cf0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8934025c20 tx=0x7f8934002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.564+0000 7f882f606640 1 -- 172.21.15.165:0/3991138048 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8934074480 con 0x557b3720e530 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.564+0000 7f882f606640 1 -- 172.21.15.165:0/3991138048 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8934074620 con 0x557b3720e530 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.564+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b373944e0 con 0x557b3720e530 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.564+0000 7f882f606640 1 -- 172.21.15.165:0/3991138048 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8934074900 con 0x557b3720e530 2024-09-22T08:12:49.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.564+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b373950f0 con 0x557b3720e530 2024-09-22T08:12:49.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.565+0000 7f882f606640 1 -- 172.21.15.165:0/3991138048 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8934074aa0 con 0x557b3720e530 2024-09-22T08:12:49.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.565+0000 7f882f606640 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f882803cfb0 0x7f882803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.565+0000 7f882f606640 1 -- 172.21.15.165:0/3991138048 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8934098c70 con 0x557b3720e530 2024-09-22T08:12:49.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.565+0000 7f894262f640 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f882803cfb0 0x7f882803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.565+0000 7f8945346800 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b3729fa00 0x557b3739b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.565+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b3739b880 con 0x557b3729fa00 2024-09-22T08:12:49.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.565+0000 7f8943631640 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b3729fa00 0x557b3739b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.566+0000 7f894262f640 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f882803cfb0 0x7f882803f470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8938001d70 tx=0x7f89380012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.566+0000 7f8943631640 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b3729fa00 0x557b3739b340 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.566+0000 7f8943631640 1 -- 172.21.15.165:0/3991138048 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f893c00a4d0 con 0x557b3729fa00 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.566+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b3739bc20 con 0x557b3729fa00 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.566+0000 7f8943631640 1 -- 172.21.15.165:0/3991138048 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f893c00a4d0 con 0x557b3729fa00 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.566+0000 7f8945346800 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b3739d6e0 0x557b3739fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.566+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373a0310 con 0x557b3739d6e0 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.566+0000 7f8942e30640 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b3739d6e0 0x557b3739fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.567+0000 7f8942e30640 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b3739d6e0 0x557b3739fb80 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.567+0000 7f8942e30640 1 -- 172.21.15.165:0/3991138048 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8934051070 con 0x557b3739d6e0 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.567+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b3739c470 con 0x557b3729fa00 2024-09-22T08:12:49.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.567+0000 7f8943631640 1 -- 172.21.15.165:0/3991138048 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f893c00a4d0 con 0x557b3729fa00 2024-09-22T08:12:49.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.567+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b3739c810 con 0x557b3729fa00 2024-09-22T08:12:49.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.568+0000 7f8943631640 1 -- 172.21.15.165:0/3991138048 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f893c00a4d0 con 0x557b3729fa00 2024-09-22T08:12:49.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.568+0000 7f8945346800 1 Processor -- start 2024-09-22T08:12:49.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.568+0000 7f8945346800 1 -- start start 2024-09-22T08:12:49.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.568+0000 7f8945346800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373aebe0 0x557b373af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.568+0000 7f8945346800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557b37191d50 con 0x557b373aebe0 2024-09-22T08:12:49.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.568+0000 7f8943631640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373aebe0 0x557b373af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.568+0000 7f8943631640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373aebe0 0x557b373af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33828/0 (socket says 172.21.15.165:33828) 2024-09-22T08:12:49.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.568+0000 7f8943631640 1 -- 172.21.15.165:0/2650396352 learned_addr learned my addr 172.21.15.165:0/2650396352 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.569+0000 7f8943631640 1 -- 172.21.15.165:0/2650396352 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b373af640 con 0x557b373aebe0 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.569+0000 7f8943631640 1 --2- 172.21.15.165:0/2650396352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373aebe0 0x557b373af000 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x557b37394cf0 tx=0x7f893c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.569+0000 7f882ce01640 1 -- 172.21.15.165:0/2650396352 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f893c014450 con 0x557b373aebe0 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.569+0000 7f882ce01640 1 -- 172.21.15.165:0/2650396352 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f893c014610 con 0x557b373aebe0 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.569+0000 7f8945346800 1 -- 172.21.15.165:0/2650396352 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b373afe70 con 0x557b373aebe0 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.569+0000 7f882ce01640 1 -- 172.21.15.165:0/2650396352 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f893c014930 con 0x557b373aebe0 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.569+0000 7f8945346800 1 -- 172.21.15.165:0/2650396352 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b373b0410 con 0x557b373aebe0 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.570+0000 7f882ce01640 1 -- 172.21.15.165:0/2650396352 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f893c011040 con 0x557b373aebe0 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.570+0000 7f882ce01640 1 --2- 172.21.15.165:0/2650396352 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f881c03d000 0x7f881c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.570+0000 7f882ce01640 1 -- 172.21.15.165:0/2650396352 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f893c01e070 con 0x557b373aebe0 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.570+0000 7f8942e30640 1 --2- 172.21.15.165:0/2650396352 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f881c03d000 0x7f881c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.570+0000 7f8945346800 1 Processor -- start 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f8945346800 1 -- start start 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f8942e30640 1 --2- 172.21.15.165:0/2650396352 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f881c03d000 0x7f881c03f4c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8934074fd0 tx=0x7f893405d4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f8945346800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373bba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f8945346800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557b3738cc00 con 0x557b373bb620 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f8943631640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373bba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f8943631640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373bba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33830/0 (socket says 172.21.15.165:33830) 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f8943631640 1 -- 172.21.15.165:0/1038969680 learned_addr learned my addr 172.21.15.165:0/1038969680 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f8943631640 1 -- 172.21.15.165:0/1038969680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b373bc010 con 0x557b373bb620 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f8943631640 1 --2- 172.21.15.165:0/1038969680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373bba20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f893c054740 tx=0x7f893c02b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8119d66a0a32889c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f88267fc640 1 -- 172.21.15.165:0/1038969680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f893c04b070 con 0x557b373bb620 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f88267fc640 1 -- 172.21.15.165:0/1038969680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f893c051070 con 0x557b373bb620 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.571+0000 7f88267fc640 1 -- 172.21.15.165:0/1038969680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f893c056070 con 0x557b373bb620 2024-09-22T08:12:49.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 -- 172.21.15.165:0/1038969680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 msgr2=0x557b373bba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 --2- 172.21.15.165:0/1038969680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373bba20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f893c054740 tx=0x7f893c02b4c0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 -- 172.21.15.165:0/1038969680 shutdown_connections 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 --2- 172.21.15.165:0/1038969680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373bba20 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 -- 172.21.15.165:0/1038969680 >> 172.21.15.165:0/1038969680 conn(0x557b373b7a40 msgr2=0x557b373b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 -- 172.21.15.165:0/1038969680 shutdown_connections 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 -- 172.21.15.165:0/1038969680 wait complete. 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 Processor -- start 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 -- start start 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.572+0000 7f8945346800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557b373bc630 con 0x557b373bb620 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.573+0000 7f8943631640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.573+0000 7f8943631640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373c2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33834/0 (socket says 172.21.15.165:33834) 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.573+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 learned_addr learned my addr 172.21.15.165:0/2113985879 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.573+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b373c31b0 con 0x557b373bb620 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.573+0000 7f8943631640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373c2c50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f893c049040 tx=0x7f893c0546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.573+0000 7f8824ff9640 1 -- 172.21.15.165:0/2113985879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f893c04b040 con 0x557b373bb620 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.573+0000 7f8824ff9640 1 -- 172.21.15.165:0/2113985879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f893c0167c0 con 0x557b373bb620 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.573+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b373c3440 con 0x557b373bb620 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.573+0000 7f8824ff9640 1 -- 172.21.15.165:0/2113985879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f893c011330 con 0x557b373bb620 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.573+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b373c3dc0 con 0x557b373bb620 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.574+0000 7f8824ff9640 1 -- 172.21.15.165:0/2113985879 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f893c054850 con 0x557b373bb620 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.574+0000 7f8824ff9640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f880c03d000 0x7f880c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.574+0000 7f8824ff9640 1 -- 172.21.15.165:0/2113985879 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f893c00e040 con 0x557b373bb620 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.574+0000 7f8942e30640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f880c03d000 0x7f880c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.574+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8945346800 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b373ce700 0x557b373d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373d1310 con 0x557b373ce700 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f894262f640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b373ce700 0x557b373d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8942e30640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f880c03d000 0x7f880c03f4c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8934053db0 tx=0x7f8934098f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f894262f640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b373ce700 0x557b373d0bc0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8938009050 con 0x557b373ce700 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8945346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8945346800 20 realm 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373cda50 con 0x557b373ce700 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8938009050 con 0x557b373ce700 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8945346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8945346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:49.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.575+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373d1df0 con 0x557b373ce700 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8938009050 con 0x557b373ce700 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f8945346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373d26c0 con 0x557b373ce700 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8938009050 con 0x557b373ce700 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f8945346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f8945346800 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b373d3000 0x557b373d53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373d5b30 con 0x557b373d3000 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f8943631640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b373d3000 0x557b373d53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.576+0000 7f8943631640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b373d3000 0x557b373d53f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.577+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f893c02a070 con 0x557b373d3000 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.577+0000 7f8945346800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.577+0000 7f8945346800 20 searching for the correct realm 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.577+0000 7f8945346800 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557b373d7bb0 0x557b373da070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.577+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d7bb0 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.577+0000 7f8942e30640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557b373d7bb0 0x557b373da070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.577+0000 7f8942e30640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557b373d7bb0 0x557b373da070 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.577+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.577+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d3000 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.578+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f893c02a070 con 0x557b373d3000 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.578+0000 7f8943631640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f893c014070 0x7f893c03f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.578+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x7f893c014070 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.578+0000 7f894262f640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f893c014070 0x7f893c03f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.578+0000 7f894262f640 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f893c014070 0x7f893c03f850 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.578+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938009050 con 0x7f893c014070 2024-09-22T08:12:49.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.579+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373ce700 2024-09-22T08:12:49.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.579+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938009050 con 0x557b373ce700 2024-09-22T08:12:49.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.579+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373ce700 2024-09-22T08:12:49.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.579+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.579+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x7f893c014070 2024-09-22T08:12:49.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.579+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.579+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d3000 2024-09-22T08:12:49.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.579+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f893c02a070 con 0x557b373d3000 2024-09-22T08:12:49.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.579+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d3000 2024-09-22T08:12:49.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.580+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.580+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d7bb0 2024-09-22T08:12:49.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.580+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.580+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373ce700 2024-09-22T08:12:49.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.580+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.580+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x7f893c014070 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.580+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.580+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373ce700 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.581+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.581+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d3000 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.581+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.581+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d7bb0 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.581+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.581+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d7bb0 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.581+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.581+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x7f893c014070 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.582+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.582+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d7bb0 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.582+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.582+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d7bb0 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.582+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.582+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373ce700 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.582+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.582+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373ce700 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.583+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.583+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x7f893c014070 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.583+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.583+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d7bb0 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.583+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.583+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d3000 2024-09-22T08:12:49.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.583+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.583+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373ce700 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.584+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.584+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x7f893c014070 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.584+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.584+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d7bb0 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.584+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.584+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x7f893c014070 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.584+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.584+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d3000 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.585+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.585+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d7bb0 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.585+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.585+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x7f893c014070 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.585+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.585+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373ce700 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.585+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.585+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b373da740 con 0x557b373d3000 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373d65b0 con 0x557b373ce700 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373d61c0 con 0x557b373ce700 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373d6f60 con 0x557b373ce700 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 zone default found 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 4 Realm: () 2024-09-22T08:12:49.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 zonegroup default 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.586+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373d6a80 con 0x7f893c014070 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8945346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373dcb10 con 0x557b373d7bb0 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8945346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373dcfa0 con 0x557b373d7bb0 2024-09-22T08:12:49.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8945346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8945346800 20 started sync module instance, tier type = 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8945346800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.587+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373dbf80 con 0x557b373d3000 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.588+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.588+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93987696132976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373dd8b0 con 0x557b373d3000 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.588+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373de100 con 0x557b373ce700 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.589+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93987696132976] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.590+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.590+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93987696137216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373dddf0 con 0x557b373ce700 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.590+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373de910 con 0x557b373d7bb0 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.591+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93987696137216] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.591+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.591+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93987696141280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373ded00 con 0x557b373d7bb0 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.591+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373df700 con 0x557b373d3000 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.592+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93987696141280] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.592+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.592+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93987696138336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373dfaf0 con 0x557b373d3000 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.592+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373e0530 con 0x557b373ce700 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.593+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.593+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93987696148480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373e04f0 con 0x557b373ce700 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.593+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93987696138336] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.593+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373e14d0 con 0x7f893c014070 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.594+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.594+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93987696144912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373e14d0 con 0x7f893c014070 2024-09-22T08:12:49.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.594+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93987696148480] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.606 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.594+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373e1f10 con 0x7f893c014070 2024-09-22T08:12:49.606 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.596+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93987696144912] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.606 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.596+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.606 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.596+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93987696152608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373e1440 con 0x7f893c014070 2024-09-22T08:12:49.606 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.596+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373e23c0 con 0x7f893c014070 2024-09-22T08:12:49.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.597+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.597+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93987696152608] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.597+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93987696156432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373e2330 con 0x7f893c014070 2024-09-22T08:12:49.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.597+0000 7f8945346800 20 add_watcher() i=0 2024-09-22T08:12:49.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.597+0000 7f8945346800 20 add_watcher() i=1 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.597+0000 7f8945346800 20 add_watcher() i=2 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.597+0000 7f8945346800 20 add_watcher() i=3 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.597+0000 7f8945346800 20 add_watcher() i=4 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.597+0000 7f8945346800 20 add_watcher() i=5 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.597+0000 7f8945346800 20 add_watcher() i=6 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.598+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93987696156432] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.598+0000 7f8945346800 20 add_watcher() i=7 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.598+0000 7f8945346800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.598+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b373e5850 con 0x557b373ce700 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.598+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.598+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93987696155232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b373e2be0 con 0x557b373ce700 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.599+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93987696155232] v34'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.599+0000 7f87f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.600+0000 7f8945346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.600+0000 7f8945346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.600+0000 7f8945346800 5 note: GC not initialized 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.600+0000 7f8773fff640 20 reqs_thread_entry: start 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.600+0000 7f8945346800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.600+0000 7f8945346800 20 Filter name: none 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.600+0000 7f8771ffb640 20 reqs_thread_entry: start 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.600+0000 7f8945346800 20 rados->read ofs=0 len=0 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.600+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b37418850 con 0x557b373ce700 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.601+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.601+0000 7f8945346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:could not fetch user info: no user info saved 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.601+0000 7f87f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:49.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.601+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93987696155232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b37418810 con 0x557b373ce700 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.602+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93987696155232] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.602+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93987696132976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b37418810 con 0x557b373d3000 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.603+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93987696132976] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.603+0000 7f8945346800 20 remove_watcher() i=0 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.603+0000 7f8945346800 2 removed watcher, disabling cache 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.603+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93987696137216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b37418810 con 0x557b373ce700 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.605+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93987696137216] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.605+0000 7f8945346800 20 remove_watcher() i=1 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.605+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93987696141280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b37418810 con 0x557b373d7bb0 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.606+0000 7f8942e30640 1 -- 172.21.15.165:0/2113985879 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93987696141280] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8934051070 con 0x557b373d7bb0 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.606+0000 7f8945346800 20 remove_watcher() i=2 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.606+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93987696138336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b37418810 con 0x557b373d3000 2024-09-22T08:12:49.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.607+0000 7f8943631640 1 -- 172.21.15.165:0/2113985879 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93987696138336] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f893c063040 con 0x557b373d3000 2024-09-22T08:12:49.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.607+0000 7f8945346800 20 remove_watcher() i=3 2024-09-22T08:12:49.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.607+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93987696148480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b37418810 con 0x557b373ce700 2024-09-22T08:12:49.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.608+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93987696148480] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x557b373ce700 2024-09-22T08:12:49.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.608+0000 7f8945346800 20 remove_watcher() i=4 2024-09-22T08:12:49.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.608+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93987696144912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b37418810 con 0x7f893c014070 2024-09-22T08:12:49.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.609+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93987696144912] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.609+0000 7f8945346800 20 remove_watcher() i=5 2024-09-22T08:12:49.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.609+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93987696152608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b37418810 con 0x7f893c014070 2024-09-22T08:12:49.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.610+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93987696152608] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.610+0000 7f8945346800 20 remove_watcher() i=6 2024-09-22T08:12:49.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.610+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93987696156432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b37418810 con 0x7f893c014070 2024-09-22T08:12:49.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.611+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93987696156432] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8938029040 con 0x7f893c014070 2024-09-22T08:12:49.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.611+0000 7f8945346800 20 remove_watcher() i=7 2024-09-22T08:12:49.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f893c014070 msgr2=0x7f893c03f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f893c014070 0x7f893c03f850 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b373ce700 msgr2=0x557b373d0bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b373ce700 0x557b373d0bc0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b373d3000 msgr2=0x557b373d53f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b373d3000 0x557b373d53f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557b373d7bb0 msgr2=0x557b373da070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x557b373d7bb0 0x557b373da070 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f880c03d000 msgr2=0x7f880c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f880c03d000 0x7f880c03f4c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8934053db0 tx=0x7f8934098f90 comp rx=0 tx=0).stop 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 msgr2=0x557b373c2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 --2- 172.21.15.165:0/2113985879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373bb620 0x557b373c2c50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f893c049040 tx=0x7f893c0546a0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 reap_dead start 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f894262f640 1 -- 172.21.15.165:0/2113985879 reap_dead start 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 shutdown_connections 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 >> 172.21.15.165:0/2113985879 conn(0x557b373b7a40 msgr2=0x557b373b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 shutdown_connections 2024-09-22T08:12:49.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2113985879 wait complete. 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2650396352 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f881c03d000 msgr2=0x7f881c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 --2- 172.21.15.165:0/2650396352 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f881c03d000 0x7f881c03f4c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8934074fd0 tx=0x7f893405d4a0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2650396352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373aebe0 msgr2=0x557b373af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 --2- 172.21.15.165:0/2650396352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373aebe0 0x557b373af000 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x557b37394cf0 tx=0x7f893c018830 comp rx=0 tx=0).stop 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2650396352 shutdown_connections 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 --2- 172.21.15.165:0/2650396352 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f881c03d000 0x7f881c03f4c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 --2- 172.21.15.165:0/2650396352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b373aebe0 0x557b373af000 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2650396352 >> 172.21.15.165:0/2650396352 conn(0x557b373a2f90 msgr2=0x557b373a3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2650396352 shutdown_connections 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.612+0000 7f8945346800 1 -- 172.21.15.165:0/2650396352 wait complete. 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b3729fa00 msgr2=0x557b3739b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b3729fa00 0x557b3739b340 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b3739d6e0 msgr2=0x557b3739fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b3739d6e0 0x557b3739fb80 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f882803cfb0 msgr2=0x7f882803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f882803cfb0 0x7f882803f470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8938001d70 tx=0x7f89380012d0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 msgr2=0x557b37393cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b37393cf0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8934025c20 tx=0x7f8934002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 shutdown_connections 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x557b3739d6e0 0x557b3739fb80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x557b3729fa00 0x557b3739b340 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f882803cfb0 0x7f882803f470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 --2- 172.21.15.165:0/3991138048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b3720e530 0x557b37393cf0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 >> 172.21.15.165:0/3991138048 conn(0x557b37294ba0 msgr2=0x557b373863b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 shutdown_connections 2024-09-22T08:12:49.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.613+0000 7f8945346800 1 -- 172.21.15.165:0/3991138048 wait complete. 2024-09-22T08:12:49.622 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T08:12:49.622 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-22T08:12:49.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-22T08:12:49.623 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-22T08:12:49.666 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:49.667 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:49.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.666+0000 7f24c7f28800 1 Processor -- start 2024-09-22T08:12:49.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.666+0000 7f24c7f28800 1 -- start start 2024-09-22T08:12:49.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.667+0000 7f24c7f28800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5654ac141cc0 0x5654ac147650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.667+0000 7f24c7f28800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5654abfcca20 con 0x5654ac1408b0 2024-09-22T08:12:49.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.667+0000 7f24c7f28800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5654abfcc7d0 con 0x5654ac141cc0 2024-09-22T08:12:49.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.667+0000 7f24c34d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5654ac141cc0 0x5654ac147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.667+0000 7f24c3cd6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5654ac1408b0 0x5654ac1415b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57740/0 (socket says 172.21.15.165:57740) 2024-09-22T08:12:49.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.667+0000 7f24c34d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5654ac141cc0 0x5654ac147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33848/0 (socket says 172.21.15.165:33848) 2024-09-22T08:12:49.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.667+0000 7f24c3cd6640 1 -- 172.21.15.165:0/2456174647 learned_addr learned my addr 172.21.15.165:0/2456174647 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:49.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.667+0000 7f24c34d5640 1 -- 172.21.15.165:0/2456174647 >> v1:172.21.15.53:6789/0 conn(0x5654ac1408b0 legacy=0x5654ac1415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.667+0000 7f24c34d5640 1 -- 172.21.15.165:0/2456174647 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654ac140fb0 con 0x5654ac141cc0 2024-09-22T08:12:49.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.669+0000 7f24c34d5640 1 --2- 172.21.15.165:0/2456174647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac141cc0 0x5654ac147650 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00a470 tx=0x7f24ac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b73bf8b6ab8d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.669+0000 7f24c2cd4640 1 -- 172.21.15.165:0/2456174647 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ac053570 con 0x5654ac141cc0 2024-09-22T08:12:49.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.669+0000 7f24c2cd4640 1 -- 172.21.15.165:0/2456174647 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ac058070 con 0x5654ac141cc0 2024-09-22T08:12:49.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.669+0000 7f24c2cd4640 1 -- 172.21.15.165:0/2456174647 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ac053880 con 0x5654ac141cc0 2024-09-22T08:12:49.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.670+0000 7f24c7f28800 1 -- 172.21.15.165:0/2456174647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac141cc0 msgr2=0x5654ac147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.670+0000 7f24c7f28800 1 --2- 172.21.15.165:0/2456174647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac141cc0 0x5654ac147650 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00a470 tx=0x7f24ac045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:49.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.670+0000 7f24c7f28800 1 -- 172.21.15.165:0/2456174647 shutdown_connections 2024-09-22T08:12:49.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.670+0000 7f24c7f28800 1 --2- 172.21.15.165:0/2456174647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac141cc0 0x5654ac147650 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.670+0000 7f24c7f28800 1 -- 172.21.15.165:0/2456174647 >> 172.21.15.165:0/2456174647 conn(0x5654ac13bcc0 msgr2=0x5654ac13e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.670+0000 7f24c7f28800 1 -- 172.21.15.165:0/2456174647 shutdown_connections 2024-09-22T08:12:49.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.670+0000 7f24c7f28800 1 -- 172.21.15.165:0/2456174647 wait complete. 2024-09-22T08:12:49.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.683+0000 7f24c7f28800 1 Processor -- start 2024-09-22T08:12:49.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.684+0000 7f24c7f28800 1 -- start start 2024-09-22T08:12:49.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.684+0000 7f24c7f28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.684+0000 7f24c7f28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654abfd9dd0 con 0x5654ac1408b0 2024-09-22T08:12:49.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.684+0000 7f24c3cd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.684+0000 7f24c3cd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac0b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33856/0 (socket says 172.21.15.165:33856) 2024-09-22T08:12:49.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.684+0000 7f24c3cd6640 1 -- 172.21.15.165:0/482045120 learned_addr learned my addr 172.21.15.165:0/482045120 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.684+0000 7f24c3cd6640 1 -- 172.21.15.165:0/482045120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654ac233c50 con 0x5654ac1408b0 2024-09-22T08:12:49.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.685+0000 7f24c3cd6640 1 --2- 172.21.15.165:0/482045120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac0b52c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f24b40017a0 tx=0x7f24b4001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494cd8c78329677 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.685+0000 7f23b1e0b640 1 -- 172.21.15.165:0/482045120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40044e0 con 0x5654ac1408b0 2024-09-22T08:12:49.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.685+0000 7f23b1e0b640 1 -- 172.21.15.165:0/482045120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b40046a0 con 0x5654ac1408b0 2024-09-22T08:12:49.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.685+0000 7f23b1e0b640 1 -- 172.21.15.165:0/482045120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b4004a00 con 0x5654ac1408b0 2024-09-22T08:12:49.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 -- 172.21.15.165:0/482045120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 msgr2=0x5654ac0b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 --2- 172.21.15.165:0/482045120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac0b52c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f24b40017a0 tx=0x7f24b4001c60 comp rx=0 tx=0).stop 2024-09-22T08:12:49.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 -- 172.21.15.165:0/482045120 shutdown_connections 2024-09-22T08:12:49.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 --2- 172.21.15.165:0/482045120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac0b52c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 -- 172.21.15.165:0/482045120 >> 172.21.15.165:0/482045120 conn(0x5654ac13bcc0 msgr2=0x5654ac22b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 -- 172.21.15.165:0/482045120 shutdown_connections 2024-09-22T08:12:49.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 -- 172.21.15.165:0/482045120 wait complete. 2024-09-22T08:12:49.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 Processor -- start 2024-09-22T08:12:49.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 -- start start 2024-09-22T08:12:49.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac238bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c7f28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654ac147b90 con 0x5654ac1408b0 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c3cd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac238bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c3cd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac238bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33868/0 (socket says 172.21.15.165:33868) 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.686+0000 7f24c3cd6640 1 -- 172.21.15.165:0/1404648083 learned_addr learned my addr 172.21.15.165:0/1404648083 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.687+0000 7f24c3cd6640 1 -- 172.21.15.165:0/1404648083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654ac239110 con 0x5654ac1408b0 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.687+0000 7f24c3cd6640 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac238bb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x5654ac0b4df0 tx=0x7f24b4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.687+0000 7f23abfff640 1 -- 172.21.15.165:0/1404648083 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b4022020 con 0x5654ac1408b0 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.687+0000 7f23abfff640 1 -- 172.21.15.165:0/1404648083 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b4019040 con 0x5654ac1408b0 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.687+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654ac2393a0 con 0x5654ac1408b0 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.687+0000 7f23abfff640 1 -- 172.21.15.165:0/1404648083 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b40149e0 con 0x5654ac1408b0 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.687+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654ac239da0 con 0x5654ac1408b0 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f24c7f28800 1 Processor -- start 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f24c7f28800 1 -- start start 2024-09-22T08:12:49.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f24c7f28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac230040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f24c7f28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654ac038d50 con 0x5654ac22fc40 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f23abfff640 1 -- 172.21.15.165:0/1404648083 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f24b4025020 con 0x5654ac1408b0 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f24c44d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac230040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f24c44d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac230040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33880/0 (socket says 172.21.15.165:33880) 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f24c44d7640 1 -- 172.21.15.165:0/2274259935 learned_addr learned my addr 172.21.15.165:0/2274259935 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f23abfff640 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f23ac03cfb0 0x7f23ac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f23abfff640 1 -- 172.21.15.165:0/1404648083 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f24b4054600 con 0x5654ac1408b0 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f24c3cd6640 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f23ac03cfb0 0x7f23ac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.688+0000 7f24c44d7640 1 -- 172.21.15.165:0/2274259935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654ac230580 con 0x5654ac22fc40 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f24c44d7640 1 --2- 172.21.15.165:0/2274259935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac230040 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00a430 tx=0x7f24bc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb92864ad31cbb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f24c3cd6640 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f23ac03cfb0 0x7f23ac03f470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f24b40108d0 tx=0x7f24b4011fb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f23a9ffb640 1 -- 172.21.15.165:0/2274259935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24bc008840 con 0x5654ac22fc40 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f23a9ffb640 1 -- 172.21.15.165:0/2274259935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24bc008a00 con 0x5654ac22fc40 2024-09-22T08:12:49.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f23a9ffb640 1 -- 172.21.15.165:0/2274259935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24bc008d20 con 0x5654ac22fc40 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f24c7f28800 1 -- 172.21.15.165:0/2274259935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 msgr2=0x5654ac230040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f24c7f28800 1 --2- 172.21.15.165:0/2274259935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac230040 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00a430 tx=0x7f24bc00a8f0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f24c7f28800 1 -- 172.21.15.165:0/2274259935 shutdown_connections 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f24c7f28800 1 --2- 172.21.15.165:0/2274259935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac230040 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f24c7f28800 1 -- 172.21.15.165:0/2274259935 >> 172.21.15.165:0/2274259935 conn(0x5654ac141cc0 msgr2=0x5654ac240b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f24c7f28800 1 -- 172.21.15.165:0/2274259935 shutdown_connections 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.689+0000 7f24c7f28800 1 -- 172.21.15.165:0/2274259935 wait complete. 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.690+0000 7f24c7f28800 1 Processor -- start 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.690+0000 7f24c7f28800 1 -- start start 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.690+0000 7f24c7f28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac24f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.690+0000 7f24c7f28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654ac230900 con 0x5654ac22fc40 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.690+0000 7f24c44d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac24f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.690+0000 7f24c44d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac24f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33890/0 (socket says 172.21.15.165:33890) 2024-09-22T08:12:49.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.690+0000 7f24c44d7640 1 -- 172.21.15.165:0/3595133217 learned_addr learned my addr 172.21.15.165:0/3595133217 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.691+0000 7f24c44d7640 1 -- 172.21.15.165:0/3595133217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654ac24f940 con 0x5654ac22fc40 2024-09-22T08:12:49.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.691+0000 7f24c44d7640 1 --2- 172.21.15.165:0/3595133217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac24f3e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00adf0 tx=0x7f24bc002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.691+0000 7f23a3fff640 1 -- 172.21.15.165:0/3595133217 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24bc022030 con 0x5654ac22fc40 2024-09-22T08:12:49.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.691+0000 7f23a3fff640 1 -- 172.21.15.165:0/3595133217 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24bc019040 con 0x5654ac22fc40 2024-09-22T08:12:49.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.691+0000 7f23a3fff640 1 -- 172.21.15.165:0/3595133217 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24bc013970 con 0x5654ac22fc40 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.691+0000 7f24c7f28800 1 -- 172.21.15.165:0/3595133217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654ac24fbd0 con 0x5654ac22fc40 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.691+0000 7f24c7f28800 1 -- 172.21.15.165:0/3595133217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654ac250550 con 0x5654ac22fc40 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.692+0000 7f23a3fff640 1 -- 172.21.15.165:0/3595133217 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f24bc025070 con 0x5654ac22fc40 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.692+0000 7f23a3fff640 1 --2- 172.21.15.165:0/3595133217 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f239c03cfb0 0x7f239c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.692+0000 7f23a3fff640 1 -- 172.21.15.165:0/3595133217 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f24bc023070 con 0x5654ac22fc40 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.692+0000 7f24c34d5640 1 --2- 172.21.15.165:0/3595133217 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f239c03cfb0 0x7f239c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.692+0000 7f24c7f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.692+0000 7f24c7f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.693+0000 7f24c7f28800 1 Processor -- start 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.693+0000 7f24c34d5640 1 --2- 172.21.15.165:0/3595133217 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f239c03cfb0 0x7f239c03f470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f24ac057000 tx=0x7f24ac052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.693+0000 7f24c7f28800 1 -- start start 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.693+0000 7f24c7f28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac269180 0x5654ac2695a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.693+0000 7f24c7f28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654ac233f30 con 0x5654ac269180 2024-09-22T08:12:49.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.693+0000 7f24c3cd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac269180 0x5654ac2695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.693+0000 7f24c3cd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac269180 0x5654ac2695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33906/0 (socket says 172.21.15.165:33906) 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.693+0000 7f24c3cd6640 1 -- 172.21.15.165:0/449464227 learned_addr learned my addr 172.21.15.165:0/449464227 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.693+0000 7f24c3cd6640 1 -- 172.21.15.165:0/449464227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654ac269be0 con 0x5654ac269180 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.694+0000 7f24c3cd6640 1 --2- 172.21.15.165:0/449464227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac269180 0x5654ac2695a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f24b40528d0 tx=0x7f24b401ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.694+0000 7f232bfff640 1 -- 172.21.15.165:0/449464227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b4010b70 con 0x5654ac269180 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.694+0000 7f232bfff640 1 -- 172.21.15.165:0/449464227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b4010d10 con 0x5654ac269180 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.694+0000 7f24c7f28800 1 -- 172.21.15.165:0/449464227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654ac26a410 con 0x5654ac269180 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.694+0000 7f232bfff640 1 -- 172.21.15.165:0/449464227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b401dad0 con 0x5654ac269180 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.694+0000 7f24c7f28800 1 -- 172.21.15.165:0/449464227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654ac26a9b0 con 0x5654ac269180 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.695+0000 7f232bfff640 1 -- 172.21.15.165:0/449464227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f24b4010070 con 0x5654ac269180 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.695+0000 7f232bfff640 1 --2- 172.21.15.165:0/449464227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f22fc03d000 0x7f22fc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.695+0000 7f232bfff640 1 -- 172.21.15.165:0/449464227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f24b40518e0 con 0x5654ac269180 2024-09-22T08:12:49.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.695+0000 7f24c34d5640 1 --2- 172.21.15.165:0/449464227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f22fc03d000 0x7f22fc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.695+0000 7f2329ffb640 20 reqs_thread_entry: start 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.695+0000 7f24c7f28800 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5654ac276b30 0x5654ac278ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.695+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654ac2796c0 con 0x5654ac276b30 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.695+0000 7f24c34d5640 1 --2- 172.21.15.165:0/449464227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f22fc03d000 0x7f22fc03f4c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f24ac045a60 tx=0x7f24ac005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.695+0000 7f24c44d7640 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5654ac276b30 0x5654ac278ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.696+0000 7f24c44d7640 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5654ac276b30 0x5654ac278ff0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.696+0000 7f24c44d7640 1 -- 172.21.15.165:0/1404648083 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24bc01e8f0 con 0x5654ac276b30 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.696+0000 7f24c7f28800 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5654ac27b490 0x5654ac27d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.696+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:2 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654ac27dfc0 con 0x5654ac27b490 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.696+0000 7f24c3cd6640 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5654ac27b490 0x5654ac27d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.696+0000 7f24c3cd6640 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5654ac27b490 0x5654ac27d880 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.697+0000 7f24c3cd6640 1 -- 172.21.15.165:0/1404648083 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(2 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f24b400f030 con 0x5654ac27b490 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.697+0000 7f24c7f28800 1 -- 172.21.15.165:0/3595133217 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f239c03cfb0 msgr2=0x7f239c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.697+0000 7f24c7f28800 1 --2- 172.21.15.165:0/3595133217 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f239c03cfb0 0x7f239c03f470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f24ac057000 tx=0x7f24ac052000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.697+0000 7f24c7f28800 1 -- 172.21.15.165:0/3595133217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 msgr2=0x5654ac24f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.697+0000 7f24c7f28800 1 --2- 172.21.15.165:0/3595133217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac24f3e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00adf0 tx=0x7f24bc002ff0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.697+0000 7f24c7f28800 1 -- 172.21.15.165:0/3595133217 shutdown_connections 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.697+0000 7f24c7f28800 1 --2- 172.21.15.165:0/3595133217 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f239c03cfb0 0x7f239c03f470 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.697+0000 7f24c7f28800 1 --2- 172.21.15.165:0/3595133217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac22fc40 0x5654ac24f3e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.697+0000 7f24c7f28800 1 -- 172.21.15.165:0/3595133217 >> 172.21.15.165:0/3595133217 conn(0x5654ac141cc0 msgr2=0x5654ac240ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.697+0000 7f24c7f28800 1 -- 172.21.15.165:0/3595133217 shutdown_connections 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/3595133217 wait complete. 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/449464227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f22fc03d000 msgr2=0x7f22fc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/449464227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f22fc03d000 0x7f22fc03f4c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f24ac045a60 tx=0x7f24ac005a00 comp rx=0 tx=0).stop 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/449464227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac269180 msgr2=0x5654ac2695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/449464227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac269180 0x5654ac2695a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f24b40528d0 tx=0x7f24b401ef50 comp rx=0 tx=0).stop 2024-09-22T08:12:49.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/449464227 shutdown_connections 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/449464227 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f22fc03d000 0x7f22fc03f4c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/449464227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac269180 0x5654ac2695a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/449464227 >> 172.21.15.165:0/449464227 conn(0x5654ac25e6e0 msgr2=0x5654ac25eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/449464227 shutdown_connections 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/449464227 wait complete. 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5654ac276b30 msgr2=0x5654ac278ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5654ac276b30 0x5654ac278ff0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5654ac27b490 msgr2=0x5654ac27d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5654ac27b490 0x5654ac27d880 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f23ac03cfb0 msgr2=0x7f23ac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f23ac03cfb0 0x7f23ac03f470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f24b40108d0 tx=0x7f24b4011fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 msgr2=0x5654ac238bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac238bb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x5654ac0b4df0 tx=0x7f24b4000f40 comp rx=0 tx=0).stop 2024-09-22T08:12:49.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 shutdown_connections 2024-09-22T08:12:49.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5654ac27b490 0x5654ac27d880 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5654ac276b30 0x5654ac278ff0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f23ac03cfb0 0x7f23ac03f470 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 --2- 172.21.15.165:0/1404648083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654ac1408b0 0x5654ac238bb0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 >> 172.21.15.165:0/1404648083 conn(0x5654ac13bcc0 msgr2=0x5654ac22a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 shutdown_connections 2024-09-22T08:12:49.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.698+0000 7f24c7f28800 1 -- 172.21.15.165:0/1404648083 wait complete. 2024-09-22T08:12:49.708 INFO:teuthology.orchestra.run.smithi165.stdout:{"id":"cc1223c2-11fd-49fe-8726-a14b177df4cc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:12:49.709 DEBUG:tasks.util.rgw: json result: {'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:12:49.709 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-22T08:12:49.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-22T08:12:49.709 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-22T08:12:49.751 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:49.752 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:49.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.751+0000 7f6337fa2800 1 Processor -- start 2024-09-22T08:12:49.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.751+0000 7f6337fa2800 1 -- start start 2024-09-22T08:12:49.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.752+0000 7f6337fa2800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a70f2a5d30 0x55a70f2a8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.752+0000 7f6337fa2800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a70f131a20 con 0x55a70f2a86f0 2024-09-22T08:12:49.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.752+0000 7f6337fa2800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a70f1317d0 con 0x55a70f2a5d30 2024-09-22T08:12:49.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.752+0000 7f6335a8c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a70f2a5d30 0x55a70f2a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.752+0000 7f632d28b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55a70f2a86f0 0x55a70f2aabb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57750/0 (socket says 172.21.15.165:57750) 2024-09-22T08:12:49.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.752+0000 7f632d28b640 1 -- 172.21.15.165:0/1715360710 learned_addr learned my addr 172.21.15.165:0/1715360710 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:49.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.752+0000 7f6335a8c640 1 -- 172.21.15.165:0/1715360710 >> v1:172.21.15.53:6789/0 conn(0x55a70f2a86f0 legacy=0x55a70f2aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.752+0000 7f6335a8c640 1 -- 172.21.15.165:0/1715360710 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70f2ad4a0 con 0x55a70f2a5d30 2024-09-22T08:12:49.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.754+0000 7f6335a8c640 1 --2- 172.21.15.165:0/1715360710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f2a8120 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f632800a470 tx=0x7f6328045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862b0b52cf3ed283 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.754+0000 7f633528b640 1 -- 172.21.15.165:0/1715360710 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6328053570 con 0x55a70f2a5d30 2024-09-22T08:12:49.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.754+0000 7f633528b640 1 -- 172.21.15.165:0/1715360710 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6328058070 con 0x55a70f2a5d30 2024-09-22T08:12:49.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.754+0000 7f633528b640 1 -- 172.21.15.165:0/1715360710 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6328053880 con 0x55a70f2a5d30 2024-09-22T08:12:49.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.755+0000 7f6337fa2800 1 -- 172.21.15.165:0/1715360710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 msgr2=0x55a70f2a8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.755+0000 7f6337fa2800 1 --2- 172.21.15.165:0/1715360710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f2a8120 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f632800a470 tx=0x7f6328045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:49.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.755+0000 7f6337fa2800 1 -- 172.21.15.165:0/1715360710 shutdown_connections 2024-09-22T08:12:49.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.755+0000 7f6337fa2800 1 --2- 172.21.15.165:0/1715360710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f2a8120 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.755+0000 7f6337fa2800 1 -- 172.21.15.165:0/1715360710 >> 172.21.15.165:0/1715360710 conn(0x55a70f2a0300 msgr2=0x55a70f2a2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.755+0000 7f6337fa2800 1 -- 172.21.15.165:0/1715360710 shutdown_connections 2024-09-22T08:12:49.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.755+0000 7f6337fa2800 1 -- 172.21.15.165:0/1715360710 wait complete. 2024-09-22T08:12:49.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.769+0000 7f6337fa2800 1 Processor -- start 2024-09-22T08:12:49.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.769+0000 7f6337fa2800 1 -- start start 2024-09-22T08:12:49.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.769+0000 7f6337fa2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f396060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.769+0000 7f6337fa2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a70f13edd0 con 0x55a70f2a5d30 2024-09-22T08:12:49.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.770+0000 7f6335a8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f396060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.770+0000 7f6335a8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f396060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33936/0 (socket says 172.21.15.165:33936) 2024-09-22T08:12:49.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.770+0000 7f6335a8c640 1 -- 172.21.15.165:0/964306731 learned_addr learned my addr 172.21.15.165:0/964306731 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.770+0000 7f6335a8c640 1 -- 172.21.15.165:0/964306731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70f396650 con 0x55a70f2a5d30 2024-09-22T08:12:49.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.770+0000 7f6335a8c640 1 --2- 172.21.15.165:0/964306731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f396060 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6328025c20 tx=0x7f6328051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451e446b77c41712 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.770+0000 7f6223e07640 1 -- 172.21.15.165:0/964306731 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6328053a20 con 0x55a70f2a5d30 2024-09-22T08:12:49.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.770+0000 7f6223e07640 1 -- 172.21.15.165:0/964306731 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6328063070 con 0x55a70f2a5d30 2024-09-22T08:12:49.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.771+0000 7f6223e07640 1 -- 172.21.15.165:0/964306731 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6328053cf0 con 0x55a70f2a5d30 2024-09-22T08:12:49.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.771+0000 7f6337fa2800 1 -- 172.21.15.165:0/964306731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 msgr2=0x55a70f396060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.771+0000 7f6337fa2800 1 --2- 172.21.15.165:0/964306731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f396060 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6328025c20 tx=0x7f6328051000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.771+0000 7f6337fa2800 1 -- 172.21.15.165:0/964306731 shutdown_connections 2024-09-22T08:12:49.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.771+0000 7f6337fa2800 1 --2- 172.21.15.165:0/964306731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f396060 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.771+0000 7f6337fa2800 1 -- 172.21.15.165:0/964306731 >> 172.21.15.165:0/964306731 conn(0x55a70f2a0300 msgr2=0x55a70f394400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.771+0000 7f6337fa2800 1 -- 172.21.15.165:0/964306731 shutdown_connections 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.771+0000 7f6337fa2800 1 -- 172.21.15.165:0/964306731 wait complete. 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.772+0000 7f6337fa2800 1 Processor -- start 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.772+0000 7f6337fa2800 1 -- start start 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.772+0000 7f6337fa2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f39da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.772+0000 7f6337fa2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a70f2ac740 con 0x55a70f2a5d30 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.772+0000 7f6335a8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f39da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.772+0000 7f6335a8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f39da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33940/0 (socket says 172.21.15.165:33940) 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.772+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 learned_addr learned my addr 172.21.15.165:0/780522563 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.772+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70f39dfe0 con 0x55a70f2a5d30 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.772+0000 7f6335a8c640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f39da80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6328025c20 tx=0x7f6328002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.773+0000 7f6222604640 1 -- 172.21.15.165:0/780522563 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632806c030 con 0x55a70f2a5d30 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.773+0000 7f6222604640 1 -- 172.21.15.165:0/780522563 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6328068660 con 0x55a70f2a5d30 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.773+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a70f39e270 con 0x55a70f2a5d30 2024-09-22T08:12:49.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.773+0000 7f6222604640 1 -- 172.21.15.165:0/780522563 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6328068940 con 0x55a70f2a5d30 2024-09-22T08:12:49.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.773+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a70f39ec70 con 0x55a70f2a5d30 2024-09-22T08:12:49.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.773+0000 7f6337fa2800 1 Processor -- start 2024-09-22T08:12:49.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.773+0000 7f6337fa2800 1 -- start start 2024-09-22T08:12:49.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.773+0000 7f6337fa2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f6222604640 1 -- 172.21.15.165:0/780522563 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6328068ae0 con 0x55a70f2a5d30 2024-09-22T08:12:49.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f6337fa2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a70f19dd50 con 0x55a70f3ab070 2024-09-22T08:12:49.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f6222604640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621c03cfb0 0x7f621c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f6222604640 1 -- 172.21.15.165:0/780522563 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6328098b50 con 0x55a70f2a5d30 2024-09-22T08:12:49.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f633628d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f633628d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33954/0 (socket says 172.21.15.165:33954) 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f633628d640 1 -- 172.21.15.165:0/2496398608 learned_addr learned my addr 172.21.15.165:0/2496398608 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f6335a8c640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621c03cfb0 0x7f621c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f633628d640 1 -- 172.21.15.165:0/2496398608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70f3ada30 con 0x55a70f3ab070 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f6335a8c640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621c03cfb0 0x7f621c03f470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6328070ff0 tx=0x7f6328070f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f633628d640 1 --2- 172.21.15.165:0/2496398608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3ad460 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f633000a3e0 tx=0x7f633000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7683d849beb27 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f621bfff640 1 -- 172.21.15.165:0/2496398608 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6330015070 con 0x55a70f3ab070 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.774+0000 7f621bfff640 1 -- 172.21.15.165:0/2496398608 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6330001670 con 0x55a70f3ab070 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f621bfff640 1 -- 172.21.15.165:0/2496398608 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6330001990 con 0x55a70f3ab070 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 -- 172.21.15.165:0/2496398608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 msgr2=0x55a70f3ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 --2- 172.21.15.165:0/2496398608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3ad460 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f633000a3e0 tx=0x7f633000a8a0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 -- 172.21.15.165:0/2496398608 shutdown_connections 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 --2- 172.21.15.165:0/2496398608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3ad460 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 -- 172.21.15.165:0/2496398608 >> 172.21.15.165:0/2496398608 conn(0x55a70f2a86f0 msgr2=0x55a70f3a5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 -- 172.21.15.165:0/2496398608 shutdown_connections 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 -- 172.21.15.165:0/2496398608 wait complete. 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 Processor -- start 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 -- start start 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.775+0000 7f6337fa2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a70f3add80 con 0x55a70f3ab070 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.776+0000 7f633628d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.776+0000 7f633628d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33958/0 (socket says 172.21.15.165:33958) 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.776+0000 7f633628d640 1 -- 172.21.15.165:0/2129102318 learned_addr learned my addr 172.21.15.165:0/2129102318 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.776+0000 7f633628d640 1 -- 172.21.15.165:0/2129102318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70f3b25d0 con 0x55a70f3ab070 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.776+0000 7f633628d640 1 --2- 172.21.15.165:0/2129102318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3b2070 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6330013040 tx=0x7f6330003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.776+0000 7f621a7fc640 1 -- 172.21.15.165:0/2129102318 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6330020020 con 0x55a70f3ab070 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.776+0000 7f621a7fc640 1 -- 172.21.15.165:0/2129102318 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6330010780 con 0x55a70f3ab070 2024-09-22T08:12:49.782 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.776+0000 7f6337fa2800 1 -- 172.21.15.165:0/2129102318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a70f3b2860 con 0x55a70f3ab070 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.776+0000 7f621a7fc640 1 -- 172.21.15.165:0/2129102318 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6330015040 con 0x55a70f3ab070 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.776+0000 7f6337fa2800 1 -- 172.21.15.165:0/2129102318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a70f3b31e0 con 0x55a70f3ab070 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.777+0000 7f621a7fc640 1 -- 172.21.15.165:0/2129102318 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6330023020 con 0x55a70f3ab070 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.778+0000 7f621a7fc640 1 --2- 172.21.15.165:0/2129102318 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621003d000 0x7f621003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.778+0000 7f621a7fc640 1 -- 172.21.15.165:0/2129102318 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6330053df0 con 0x55a70f3ab070 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.778+0000 7f6337fa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.778+0000 7f6337fa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.778+0000 7f632d28b640 1 --2- 172.21.15.165:0/2129102318 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621003d000 0x7f621003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.778+0000 7f6337fa2800 1 Processor -- start 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.778+0000 7f632d28b640 1 --2- 172.21.15.165:0/2129102318 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621003d000 0x7f621003f4c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6320001cf0 tx=0x7f6320001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.778+0000 7f6337fa2800 1 -- start start 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.778+0000 7f6337fa2800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3cbe70 0x55a70f3cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.778+0000 7f6337fa2800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a70f396a20 con 0x55a70f3cbe70 2024-09-22T08:12:49.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.779+0000 7f6335a8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3cbe70 0x55a70f3cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.779+0000 7f6335a8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3cbe70 0x55a70f3cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33964/0 (socket says 172.21.15.165:33964) 2024-09-22T08:12:49.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.779+0000 7f6335a8c640 1 -- 172.21.15.165:0/1384058063 learned_addr learned my addr 172.21.15.165:0/1384058063 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.779+0000 7f6335a8c640 1 -- 172.21.15.165:0/1384058063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a70f3cc8d0 con 0x55a70f3cbe70 2024-09-22T08:12:49.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.779+0000 7f6335a8c640 1 --2- 172.21.15.165:0/1384058063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3cbe70 0x55a70f3cc290 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6328096ed0 tx=0x7f632805e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.779+0000 7f61fa7e4640 1 -- 172.21.15.165:0/1384058063 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632805ee50 con 0x55a70f3cbe70 2024-09-22T08:12:49.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.779+0000 7f61fa7e4640 1 -- 172.21.15.165:0/1384058063 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632805fc70 con 0x55a70f3cbe70 2024-09-22T08:12:49.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.779+0000 7f6337fa2800 1 -- 172.21.15.165:0/1384058063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a70f3cd100 con 0x55a70f3cbe70 2024-09-22T08:12:49.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.779+0000 7f61fa7e4640 1 -- 172.21.15.165:0/1384058063 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632807a4f0 con 0x55a70f3cbe70 2024-09-22T08:12:49.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.779+0000 7f6337fa2800 1 -- 172.21.15.165:0/1384058063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a70f3cd6a0 con 0x55a70f3cbe70 2024-09-22T08:12:49.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.780+0000 7f61fa7e4640 1 -- 172.21.15.165:0/1384058063 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6328070b00 con 0x55a70f3cbe70 2024-09-22T08:12:49.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.780+0000 7f61fa7e4640 1 --2- 172.21.15.165:0/1384058063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f617803cfb0 0x7f617803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.780+0000 7f61fa7e4640 1 -- 172.21.15.165:0/1384058063 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6328083040 con 0x55a70f3cbe70 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.780+0000 7f632d28b640 1 --2- 172.21.15.165:0/1384058063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f617803cfb0 0x7f617803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.781+0000 7f632d28b640 1 --2- 172.21.15.165:0/1384058063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f617803cfb0 0x7f617803f470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6320000f60 tx=0x7f632000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.781+0000 7f616bfff640 20 reqs_thread_entry: start 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.781+0000 7f6337fa2800 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a70f3d9790 0x55a70f3dbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.781+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3dc240 con 0x55a70f3d9790 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.781+0000 7f633628d640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a70f3d9790 0x55a70f3dbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.781+0000 7f633628d640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a70f3d9790 0x55a70f3dbc00 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.781+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.781+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3dcb20 con 0x55a70f3d9790 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.781+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.782+0000 7f6337fa2800 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a70f3de430 0x55a70f3e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.782+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e1030 con 0x55a70f3de430 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.782+0000 7f6335a8c640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a70f3de430 0x55a70f3e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.782+0000 7f6335a8c640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a70f3de430 0x55a70f3e08a0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.782+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6328090070 con 0x55a70f3de430 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.782+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3ee170 con 0x55a70f3d9790 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.783+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:NOTICE: set zone's realm_id= 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.783+0000 7f6337fa2800 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55a70f3e5530 0x55a70f3e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.783+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3e5530 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.783+0000 7f632d28b640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55a70f3e5530 0x55a70f3e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.783+0000 7f632d28b640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55a70f3e5530 0x55a70f3e8460 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.783+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6320009050 con 0x55a70f3e5530 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.783+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3de430 2024-09-22T08:12:49.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.784+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6328090070 con 0x55a70f3de430 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.784+0000 7f6335a8c640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f632805f040 0x7f63280704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.784+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x7f632805f040 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.784+0000 7f633628d640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f632805f040 0x7f63280704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.784+0000 7f633628d640 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f632805f040 0x7f63280704f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.784+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x7f632805f040 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.784+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3d9790 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.785+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.785+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3d9790 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.785+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.785+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x7f632805f040 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.785+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x7f632805f040 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.785+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3de430 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.785+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328090070 con 0x55a70f3de430 2024-09-22T08:12:49.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.785+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3de430 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.785+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328090070 con 0x55a70f3de430 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.785+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3e5530 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.786+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6320009050 con 0x55a70f3e5530 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.786+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3d9790 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.786+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.786+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x7f632805f040 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.786+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x7f632805f040 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.786+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3d9790 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.787+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.787+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3de430 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.787+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6328090070 con 0x55a70f3de430 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.787+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3e5530 2024-09-22T08:12:49.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.787+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6320009050 con 0x55a70f3e5530 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.787+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3e5530 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.787+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6320009050 con 0x55a70f3e5530 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.787+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x7f632805f040 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.788+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x7f632805f040 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.788+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3e5530 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.788+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6320009050 con 0x55a70f3e5530 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.788+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3e5530 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.788+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6320009050 con 0x55a70f3e5530 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.788+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3d9790 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.788+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.788+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x55a70f3d9790 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.788+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.788+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7fe0 con 0x7f632805f040 2024-09-22T08:12:49.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.789+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x7f632805f040 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.789+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x55a70f3e5530 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.789+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6320009050 con 0x55a70f3e5530 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.789+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x55a70f3de430 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.789+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328090070 con 0x55a70f3de430 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.789+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x55a70f3d9790 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.789+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.789+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x7f632805f040 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.790+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x7f632805f040 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.790+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x55a70f3e5530 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.790+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6320009050 con 0x55a70f3e5530 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.790+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x7f632805f040 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.790+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x7f632805f040 2024-09-22T08:12:49.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.790+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x55a70f3de430 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.790+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328090070 con 0x55a70f3de430 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.790+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x55a70f3e5530 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.790+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6320009050 con 0x55a70f3e5530 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.790+0000 7f632d28b640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x7f632805f040 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.791+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633000e070 con 0x7f632805f040 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.791+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x55a70f3d9790 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.791+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.791+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f633003a040 con 0x55a70f3de430 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.791+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328090070 con 0x55a70f3de430 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.791+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3ec040 con 0x55a70f3d9790 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.791+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.791+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:38 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3dd740 con 0x55a70f3de430 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.792+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(38 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6328090070 con 0x55a70f3de430 2024-09-22T08:12:49.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.792+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:39 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e7870 con 0x55a70f3de430 2024-09-22T08:12:49.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.793+0000 7f6335a8c640 1 -- 172.21.15.165:0/780522563 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(39 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [create,call,writefull 0~1155] v34'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f6328090070 con 0x55a70f3de430 2024-09-22T08:12:49.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.793+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e9610 con 0x55a70f3d9790 2024-09-22T08:12:49.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.794+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.794+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a70f3e6b30 con 0x55a70f3d9790 2024-09-22T08:12:49.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.795+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f633000e070 con 0x55a70f3d9790 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/2129102318 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621003d000 msgr2=0x7f621003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 --2- 172.21.15.165:0/2129102318 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621003d000 0x7f621003f4c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6320001cf0 tx=0x7f6320001250 comp rx=0 tx=0).stop 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/2129102318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 msgr2=0x55a70f3b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 --2- 172.21.15.165:0/2129102318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3b2070 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6330013040 tx=0x7f6330003370 comp rx=0 tx=0).stop 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/2129102318 shutdown_connections 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 --2- 172.21.15.165:0/2129102318 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621003d000 0x7f621003f4c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 --2- 172.21.15.165:0/2129102318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3ab070 0x55a70f3b2070 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/2129102318 >> 172.21.15.165:0/2129102318 conn(0x55a70f2a86f0 msgr2=0x55a70f3a5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/2129102318 shutdown_connections 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/2129102318 wait complete. 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/1384058063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f617803cfb0 msgr2=0x7f617803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 --2- 172.21.15.165:0/1384058063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f617803cfb0 0x7f617803f470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6320000f60 tx=0x7f632000f000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/1384058063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3cbe70 msgr2=0x55a70f3cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 --2- 172.21.15.165:0/1384058063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3cbe70 0x55a70f3cc290 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6328096ed0 tx=0x7f632805e7d0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/1384058063 shutdown_connections 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 --2- 172.21.15.165:0/1384058063 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f617803cfb0 0x7f617803f470 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 --2- 172.21.15.165:0/1384058063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f3cbe70 0x55a70f3cc290 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/1384058063 >> 172.21.15.165:0/1384058063 conn(0x55a70f3c13f0 msgr2=0x55a70f3c17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/1384058063 shutdown_connections 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.796+0000 7f6337fa2800 1 -- 172.21.15.165:0/1384058063 wait complete. 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f632805f040 msgr2=0x7f63280704f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f632805f040 0x7f63280704f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a70f3d9790 msgr2=0x55a70f3dbc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55a70f3d9790 0x55a70f3dbc00 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a70f3de430 msgr2=0x55a70f3e08a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55a70f3de430 0x55a70f3e08a0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55a70f3e5530 msgr2=0x55a70f3e8460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55a70f3e5530 0x55a70f3e8460 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621c03cfb0 msgr2=0x7f621c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f621c03cfb0 0x7f621c03f470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6328070ff0 tx=0x7f6328070f20 comp rx=0 tx=0).stop 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 msgr2=0x55a70f39da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f633628d640 1 -- 172.21.15.165:0/780522563 reap_dead start 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f39da80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6328025c20 tx=0x7f6328002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 shutdown_connections 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 --2- 172.21.15.165:0/780522563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a70f2a5d30 0x55a70f39da80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 >> 172.21.15.165:0/780522563 conn(0x55a70f2a0300 msgr2=0x55a70f38f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 shutdown_connections 2024-09-22T08:12:49.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.797+0000 7f6337fa2800 1 -- 172.21.15.165:0/780522563 wait complete. 2024-09-22T08:12:49.806 INFO:teuthology.orchestra.run.smithi165.stdout:{"id":"cc1223c2-11fd-49fe-8726-a14b177df4cc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-22T08:12:49.806 DEBUG:tasks.util.rgw: json result: {'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-22T08:12:49.807 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-22T08:12:49.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-22T08:12:49.807 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-22T08:12:49.889 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:49.889 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:49.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.889+0000 7f9dbcb28800 1 Processor -- start 2024-09-22T08:12:49.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.889+0000 7f9dbcb28800 1 -- start start 2024-09-22T08:12:49.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.889+0000 7f9dbcb28800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e89a548ca0 0x55e89a54e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.889+0000 7f9dbcb28800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e89a3d2a20 con 0x55e89a5479d0 2024-09-22T08:12:49.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.889+0000 7f9dbcb28800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e89a3d27d0 con 0x55e89a548ca0 2024-09-22T08:12:49.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.890+0000 7f9db004a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e89a548ca0 0x55e89a54e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.890+0000 7f9db004a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e89a548ca0 0x55e89a54e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33980/0 (socket says 172.21.15.165:33980) 2024-09-22T08:12:49.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.890+0000 7f9db004a640 1 -- 172.21.15.165:0/3482080172 learned_addr learned my addr 172.21.15.165:0/3482080172 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.890+0000 7f9db884b640 1 --1- 172.21.15.165:0/3482080172 >> v1:172.21.15.53:6789/0 conn(0x55e89a5479d0 0x55e89a548590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57764/0 (socket says 172.21.15.165:57764) 2024-09-22T08:12:49.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.890+0000 7f9db004a640 1 -- 172.21.15.165:0/3482080172 >> v1:172.21.15.53:6789/0 conn(0x55e89a5479d0 legacy=0x55e89a548590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.890+0000 7f9db004a640 1 -- 172.21.15.165:0/3482080172 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89a5480d0 con 0x55e89a548ca0 2024-09-22T08:12:49.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.892+0000 7f9db004a640 1 --2- 172.21.15.165:0/3482080172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a548ca0 0x55e89a54e630 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9da000a520 tx=0x7f9da0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbe7af8fdff6246 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.892+0000 7f9db3fff640 1 -- 172.21.15.165:0/3482080172 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da0055070 con 0x55e89a548ca0 2024-09-22T08:12:49.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.892+0000 7f9db3fff640 1 -- 172.21.15.165:0/3482080172 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da00515b0 con 0x55e89a548ca0 2024-09-22T08:12:49.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.892+0000 7f9db3fff640 1 -- 172.21.15.165:0/3482080172 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da00518d0 con 0x55e89a548ca0 2024-09-22T08:12:49.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.893+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3482080172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a548ca0 msgr2=0x55e89a54e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.893+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/3482080172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a548ca0 0x55e89a54e630 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9da000a520 tx=0x7f9da0045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.893+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3482080172 shutdown_connections 2024-09-22T08:12:49.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.893+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/3482080172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a548ca0 0x55e89a54e630 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.893+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3482080172 >> 172.21.15.165:0/3482080172 conn(0x55e89a542da0 msgr2=0x55e89a545200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.893+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3482080172 shutdown_connections 2024-09-22T08:12:49.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.893+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3482080172 wait complete. 2024-09-22T08:12:49.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.906+0000 7f9dbcb28800 1 Processor -- start 2024-09-22T08:12:49.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.907+0000 7f9dbcb28800 1 -- start start 2024-09-22T08:12:49.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.907+0000 7f9dbcb28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a636f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.907+0000 7f9dbcb28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e89a3dfdd0 con 0x55e89a5479d0 2024-09-22T08:12:49.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.907+0000 7f9db884b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a636f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.907+0000 7f9db884b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a636f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33986/0 (socket says 172.21.15.165:33986) 2024-09-22T08:12:49.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.907+0000 7f9db884b640 1 -- 172.21.15.165:0/2064458016 learned_addr learned my addr 172.21.15.165:0/2064458016 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.907+0000 7f9db884b640 1 -- 172.21.15.165:0/2064458016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89a637560 con 0x55e89a5479d0 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.907+0000 7f9db884b640 1 --2- 172.21.15.165:0/2064458016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a636f70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9da8001eb0 tx=0x7f9da800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83b1bf160656210 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.908+0000 7f9ca6e0d640 1 -- 172.21.15.165:0/2064458016 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da800e5c0 con 0x55e89a5479d0 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.908+0000 7f9ca6e0d640 1 -- 172.21.15.165:0/2064458016 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da8006070 con 0x55e89a5479d0 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.908+0000 7f9ca6e0d640 1 -- 172.21.15.165:0/2064458016 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da800e8b0 con 0x55e89a5479d0 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.908+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2064458016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 msgr2=0x55e89a636f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.908+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/2064458016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a636f70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9da8001eb0 tx=0x7f9da800b6c0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.908+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2064458016 shutdown_connections 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.908+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/2064458016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a636f70 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.908+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2064458016 >> 172.21.15.165:0/2064458016 conn(0x55e89a542da0 msgr2=0x55e89a6328f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.908+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2064458016 shutdown_connections 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.908+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2064458016 wait complete. 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.909+0000 7f9dbcb28800 1 Processor -- start 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.909+0000 7f9dbcb28800 1 -- start start 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.909+0000 7f9dbcb28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a63ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.909+0000 7f9dbcb28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e89a54eb70 con 0x55e89a5479d0 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.909+0000 7f9db884b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a63ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.909+0000 7f9db884b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a63ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33988/0 (socket says 172.21.15.165:33988) 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.909+0000 7f9db884b640 1 -- 172.21.15.165:0/1310084158 learned_addr learned my addr 172.21.15.165:0/1310084158 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.909+0000 7f9db884b640 1 -- 172.21.15.165:0/1310084158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89a63efd0 con 0x55e89a5479d0 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.910+0000 7f9db884b640 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a63ea70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55e89a637f00 tx=0x7f9da8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.910+0000 7f9ca560a640 1 -- 172.21.15.165:0/1310084158 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da801a7c0 con 0x55e89a5479d0 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.910+0000 7f9ca560a640 1 -- 172.21.15.165:0/1310084158 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da801a960 con 0x55e89a5479d0 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.910+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e89a63f260 con 0x55e89a5479d0 2024-09-22T08:12:49.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.910+0000 7f9ca560a640 1 -- 172.21.15.165:0/1310084158 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da801ac40 con 0x55e89a5479d0 2024-09-22T08:12:49.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.910+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89a63fc60 con 0x55e89a5479d0 2024-09-22T08:12:49.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.910+0000 7f9dbcb28800 1 Processor -- start 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9dbcb28800 1 -- start start 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9dbcb28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a64e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9dbcb28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e89a43ed50 con 0x55e89a64c0a0 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9ca560a640 1 -- 172.21.15.165:0/1310084158 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9da8017070 con 0x55e89a5479d0 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9db904c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a64e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9db904c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a64e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:33994/0 (socket says 172.21.15.165:33994) 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9db904c640 1 -- 172.21.15.165:0/3714554670 learned_addr learned my addr 172.21.15.165:0/3714554670 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9ca560a640 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9ca003cfb0 0x7f9ca003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9ca560a640 1 -- 172.21.15.165:0/1310084158 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9da8015020 con 0x55e89a5479d0 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9db884b640 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9ca003cfb0 0x7f9ca003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9db904c640 1 -- 172.21.15.165:0/3714554670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89a64ea60 con 0x55e89a64c0a0 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.911+0000 7f9db904c640 1 --2- 172.21.15.165:0/3714554670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a64e490 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9db400a3e0 tx=0x7f9db400a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cd271a3c52f8f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9db884b640 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9ca003cfb0 0x7f9ca003f470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9da80017f0 tx=0x7f9da8035040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9c9effd640 1 -- 172.21.15.165:0/3714554670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db4015070 con 0x55e89a64c0a0 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9c9effd640 1 -- 172.21.15.165:0/3714554670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db4001670 con 0x55e89a64c0a0 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9c9effd640 1 -- 172.21.15.165:0/3714554670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db4001990 con 0x55e89a64c0a0 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3714554670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 msgr2=0x55e89a64e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/3714554670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a64e490 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9db400a3e0 tx=0x7f9db400a8a0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3714554670 shutdown_connections 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/3714554670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a64e490 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3714554670 >> 172.21.15.165:0/3714554670 conn(0x55e89a548ca0 msgr2=0x55e89a6469c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3714554670 shutdown_connections 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3714554670 wait complete. 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9dbcb28800 1 Processor -- start 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.912+0000 7f9dbcb28800 1 -- start start 2024-09-22T08:12:49.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9dbcb28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a4bd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9dbcb28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e89a64edb0 con 0x55e89a64c0a0 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9db904c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a4bd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9db904c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a4bd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34000/0 (socket says 172.21.15.165:34000) 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9db904c640 1 -- 172.21.15.165:0/3200253134 learned_addr learned my addr 172.21.15.165:0/3200253134 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9db904c640 1 -- 172.21.15.165:0/3200253134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89a4bd7b0 con 0x55e89a64c0a0 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9db904c640 1 --2- 172.21.15.165:0/3200253134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a4bd250 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9db4013040 tx=0x7f9db4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9c9d7fa640 1 -- 172.21.15.165:0/3200253134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db4020020 con 0x55e89a64c0a0 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9c9d7fa640 1 -- 172.21.15.165:0/3200253134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db4010780 con 0x55e89a64c0a0 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3200253134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e89a4bbb60 con 0x55e89a64c0a0 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.913+0000 7f9c9d7fa640 1 -- 172.21.15.165:0/3200253134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db4015040 con 0x55e89a64c0a0 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.914+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3200253134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89a4bc0a0 con 0x55e89a64c0a0 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.914+0000 7f9c9d7fa640 1 -- 172.21.15.165:0/3200253134 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9db4023020 con 0x55e89a64c0a0 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.915+0000 7f9c9d7fa640 1 --2- 172.21.15.165:0/3200253134 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9c9003cfb0 0x7f9c9003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.915+0000 7f9c9d7fa640 1 -- 172.21.15.165:0/3200253134 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9db4053e80 con 0x55e89a64c0a0 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.915+0000 7f9db004a640 1 --2- 172.21.15.165:0/3200253134 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9c9003cfb0 0x7f9c9003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.915+0000 7f9dbcb28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.915+0000 7f9dbcb28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.915+0000 7f9dbcb28800 1 Processor -- start 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.915+0000 7f9db004a640 1 --2- 172.21.15.165:0/3200253134 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9c9003cfb0 0x7f9c9003f470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9da0057000 tx=0x7f9da0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.915+0000 7f9dbcb28800 1 -- start start 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.915+0000 7f9dbcb28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a66f080 0x55e89a66f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.915+0000 7f9dbcb28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e89a637990 con 0x55e89a66f080 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.916+0000 7f9db884b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a66f080 0x55e89a66f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.916+0000 7f9db884b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a66f080 0x55e89a66f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34002/0 (socket says 172.21.15.165:34002) 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.916+0000 7f9db884b640 1 -- 172.21.15.165:0/2480949474 learned_addr learned my addr 172.21.15.165:0/2480949474 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.916+0000 7f9db884b640 1 -- 172.21.15.165:0/2480949474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89a66fae0 con 0x55e89a66f080 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.916+0000 7f9db884b640 1 --2- 172.21.15.165:0/2480949474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a66f080 0x55e89a66f4a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9da801b570 tx=0x7f9da801dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.916+0000 7f9c7d7e2640 1 -- 172.21.15.165:0/2480949474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da80544b0 con 0x55e89a66f080 2024-09-22T08:12:49.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.916+0000 7f9c7d7e2640 1 -- 172.21.15.165:0/2480949474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da8054650 con 0x55e89a66f080 2024-09-22T08:12:49.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.916+0000 7f9c7d7e2640 1 -- 172.21.15.165:0/2480949474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da8054930 con 0x55e89a66f080 2024-09-22T08:12:49.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.916+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2480949474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e89a670310 con 0x55e89a66f080 2024-09-22T08:12:49.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.916+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2480949474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89a6708b0 con 0x55e89a66f080 2024-09-22T08:12:49.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.917+0000 7f9c7d7e2640 1 -- 172.21.15.165:0/2480949474 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9da8054ad0 con 0x55e89a66f080 2024-09-22T08:12:49.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.917+0000 7f9c7d7e2640 1 --2- 172.21.15.165:0/2480949474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9bf003d000 0x7f9bf003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.917+0000 7f9c7d7e2640 1 -- 172.21.15.165:0/2480949474 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9da804bd60 con 0x55e89a66f080 2024-09-22T08:12:49.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.917+0000 7f9db004a640 1 --2- 172.21.15.165:0/2480949474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9bf003d000 0x7f9bf003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.918+0000 7f9c16ffd640 20 reqs_thread_entry: start 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.918+0000 7f9db004a640 1 --2- 172.21.15.165:0/2480949474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9bf003d000 0x7f9bf003f4c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9da0051580 tx=0x7f9da0005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.918+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e89a67c9a0 0x55e89a67edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.918+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e89a67f450 con 0x55e89a67c9a0 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.918+0000 7f9db904c640 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e89a67c9a0 0x55e89a67edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.918+0000 7f9db904c640 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e89a67c9a0 0x55e89a67edd0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.918+0000 7f9db904c640 1 -- 172.21.15.165:0/1310084158 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9db400e070 con 0x55e89a67c9a0 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.918+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e89a67fd30 con 0x55e89a67c9a0 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.919+0000 7f9db904c640 1 -- 172.21.15.165:0/1310084158 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9db400e070 con 0x55e89a67c9a0 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.919+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e89a681640 0x55e89a683ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.919+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e89a684240 con 0x55e89a681640 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.919+0000 7f9db884b640 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e89a681640 0x55e89a683ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:49.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.919+0000 7f9db884b640 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e89a681640 0x55e89a683ab0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.919+0000 7f9db884b640 1 -- 172.21.15.165:0/1310084158 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f9da8051070 con 0x55e89a681640 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3200253134 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9c9003cfb0 msgr2=0x7f9c9003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/3200253134 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9c9003cfb0 0x7f9c9003f470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9da0057000 tx=0x7f9da0052000 comp rx=0 tx=0).stop 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3200253134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 msgr2=0x55e89a4bd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/3200253134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a4bd250 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9db4013040 tx=0x7f9db4003370 comp rx=0 tx=0).stop 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3200253134 shutdown_connections 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/3200253134 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9c9003cfb0 0x7f9c9003f470 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/3200253134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a64c0a0 0x55e89a4bd250 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3200253134 >> 172.21.15.165:0/3200253134 conn(0x55e89a548ca0 msgr2=0x55e89a646990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3200253134 shutdown_connections 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 -- 172.21.15.165:0/3200253134 wait complete. 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2480949474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9bf003d000 msgr2=0x7f9bf003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/2480949474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9bf003d000 0x7f9bf003f4c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9da0051580 tx=0x7f9da0005ac0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2480949474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a66f080 msgr2=0x55e89a66f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/2480949474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a66f080 0x55e89a66f4a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9da801b570 tx=0x7f9da801dce0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2480949474 shutdown_connections 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/2480949474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9bf003d000 0x7f9bf003f4c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/2480949474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a66f080 0x55e89a66f4a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.920+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2480949474 >> 172.21.15.165:0/2480949474 conn(0x55e89a6645e0 msgr2=0x55e89a6649c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2480949474 shutdown_connections 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 -- 172.21.15.165:0/2480949474 wait complete. 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e89a67c9a0 msgr2=0x55e89a67edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e89a67c9a0 0x55e89a67edd0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e89a681640 msgr2=0x55e89a683ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e89a681640 0x55e89a683ab0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9ca003cfb0 msgr2=0x7f9ca003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9ca003cfb0 0x7f9ca003f470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9da80017f0 tx=0x7f9da8035040 comp rx=0 tx=0).stop 2024-09-22T08:12:49.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 msgr2=0x55e89a63ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:49.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a63ea70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55e89a637f00 tx=0x7f9da8000bc0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 shutdown_connections 2024-09-22T08:12:49.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e89a681640 0x55e89a683ab0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e89a67c9a0 0x55e89a67edd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9ca003cfb0 0x7f9ca003f470 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 --2- 172.21.15.165:0/1310084158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e89a5479d0 0x55e89a63ea70 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:49.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 >> 172.21.15.165:0/1310084158 conn(0x55e89a542da0 msgr2=0x55e89a638460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:49.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 shutdown_connections 2024-09-22T08:12:49.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:49.921+0000 7f9dbcb28800 1 -- 172.21.15.165:0/1310084158 wait complete. 2024-09-22T08:12:49.931 INFO:teuthology.orchestra.run.smithi165.stdout:{"id":"cc1223c2-11fd-49fe-8726-a14b177df4cc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-22T08:12:49.931 DEBUG:tasks.util.rgw: json result: {'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-22T08:12:49.931 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-22T08:12:49.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-22T08:12:49.931 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-22T08:12:50.018 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:50.019 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:50.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.018+0000 7fcc5a014800 1 Processor -- start 2024-09-22T08:12:50.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.018+0000 7fcc5a014800 1 -- start start 2024-09-22T08:12:50.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.018+0000 7fcc5a014800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ab429cdc40 0x55ab429d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.018+0000 7fcc5a014800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab42854a20 con 0x55ab429ca130 2024-09-22T08:12:50.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.018+0000 7fcc5a014800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ab428547d0 con 0x55ab429cdc40 2024-09-22T08:12:50.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.019+0000 7fcc54fdf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ab429cdc40 0x55ab429d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.019+0000 7fcc54fdf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ab429cdc40 0x55ab429d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34012/0 (socket says 172.21.15.165:34012) 2024-09-22T08:12:50.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.019+0000 7fcc557e0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55ab429ca130 0x55ab429cc520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57774/0 (socket says 172.21.15.165:57774) 2024-09-22T08:12:50.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.019+0000 7fcc54fdf640 1 -- 172.21.15.165:0/1483777978 learned_addr learned my addr 172.21.15.165:0/1483777978 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.019+0000 7fcc54fdf640 1 -- 172.21.15.165:0/1483777978 >> v1:172.21.15.53:6789/0 conn(0x55ab429ca130 legacy=0x55ab429cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.019+0000 7fcc54fdf640 1 -- 172.21.15.165:0/1483777978 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab429d16c0 con 0x55ab429cdc40 2024-09-22T08:12:50.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.021+0000 7fcc54fdf640 1 --2- 172.21.15.165:0/1483777978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429cdc40 0x55ab429d0030 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00a520 tx=0x7fcc4c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf7a95ad143f76d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.022+0000 7fcc47fff640 1 -- 172.21.15.165:0/1483777978 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc4c055070 con 0x55ab429cdc40 2024-09-22T08:12:50.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.022+0000 7fcc47fff640 1 -- 172.21.15.165:0/1483777978 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4c0515b0 con 0x55ab429cdc40 2024-09-22T08:12:50.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.022+0000 7fcc47fff640 1 -- 172.21.15.165:0/1483777978 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc4c0518d0 con 0x55ab429cdc40 2024-09-22T08:12:50.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.022+0000 7fcc5a014800 1 -- 172.21.15.165:0/1483777978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429cdc40 msgr2=0x55ab429d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.022+0000 7fcc5a014800 1 --2- 172.21.15.165:0/1483777978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429cdc40 0x55ab429d0030 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00a520 tx=0x7fcc4c045ba0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.022+0000 7fcc5a014800 1 -- 172.21.15.165:0/1483777978 shutdown_connections 2024-09-22T08:12:50.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.022+0000 7fcc5a014800 1 --2- 172.21.15.165:0/1483777978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429cdc40 0x55ab429d0030 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.022+0000 7fcc5a014800 1 -- 172.21.15.165:0/1483777978 >> 172.21.15.165:0/1483777978 conn(0x55ab429c3d10 msgr2=0x55ab429c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.022+0000 7fcc5a014800 1 -- 172.21.15.165:0/1483777978 shutdown_connections 2024-09-22T08:12:50.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.022+0000 7fcc5a014800 1 -- 172.21.15.165:0/1483777978 wait complete. 2024-09-22T08:12:50.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.036+0000 7fcc5a014800 1 Processor -- start 2024-09-22T08:12:50.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.036+0000 7fcc5a014800 1 -- start start 2024-09-22T08:12:50.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.036+0000 7fcc5a014800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ab9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.036+0000 7fcc5a014800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ab42861dd0 con 0x55ab429ca130 2024-09-22T08:12:50.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.036+0000 7fcc557e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ab9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.036+0000 7fcc557e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ab9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34014/0 (socket says 172.21.15.165:34014) 2024-09-22T08:12:50.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.036+0000 7fcc557e0640 1 -- 172.21.15.165:0/2908891831 learned_addr learned my addr 172.21.15.165:0/2908891831 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.037+0000 7fcc557e0640 1 -- 172.21.15.165:0/2908891831 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab42ab9700 con 0x55ab429ca130 2024-09-22T08:12:50.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.037+0000 7fcc557e0640 1 --2- 172.21.15.165:0/2908891831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ab9110 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcc48001eb0 tx=0x7fcc4800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a85d98f293b891 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.037+0000 7fcb43606640 1 -- 172.21.15.165:0/2908891831 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc4800e5c0 con 0x55ab429ca130 2024-09-22T08:12:50.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.037+0000 7fcb43606640 1 -- 172.21.15.165:0/2908891831 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc48006070 con 0x55ab429ca130 2024-09-22T08:12:50.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.037+0000 7fcb43606640 1 -- 172.21.15.165:0/2908891831 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc4800e8b0 con 0x55ab429ca130 2024-09-22T08:12:50.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.038+0000 7fcc5a014800 1 -- 172.21.15.165:0/2908891831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 msgr2=0x55ab42ab9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.038+0000 7fcc5a014800 1 --2- 172.21.15.165:0/2908891831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ab9110 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcc48001eb0 tx=0x7fcc4800b6c0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.038+0000 7fcc5a014800 1 -- 172.21.15.165:0/2908891831 shutdown_connections 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.038+0000 7fcc5a014800 1 --2- 172.21.15.165:0/2908891831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ab9110 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.038+0000 7fcc5a014800 1 -- 172.21.15.165:0/2908891831 >> 172.21.15.165:0/2908891831 conn(0x55ab429c3d10 msgr2=0x55ab42ab4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.038+0000 7fcc5a014800 1 -- 172.21.15.165:0/2908891831 shutdown_connections 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.038+0000 7fcc5a014800 1 -- 172.21.15.165:0/2908891831 wait complete. 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.038+0000 7fcc5a014800 1 Processor -- start 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.039+0000 7fcc5a014800 1 -- start start 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.039+0000 7fcc5a014800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ac0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.039+0000 7fcc5a014800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ab429d0960 con 0x55ab429ca130 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.039+0000 7fcc557e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ac0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.039+0000 7fcc557e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ac0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34030/0 (socket says 172.21.15.165:34030) 2024-09-22T08:12:50.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.039+0000 7fcc557e0640 1 -- 172.21.15.165:0/3298735033 learned_addr learned my addr 172.21.15.165:0/3298735033 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.039+0000 7fcc557e0640 1 -- 172.21.15.165:0/3298735033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab42ac11d0 con 0x55ab429ca130 2024-09-22T08:12:50.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.039+0000 7fcc557e0640 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ac0c70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800b700 tx=0x7fcc48000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.040+0000 7fcb41e03640 1 -- 172.21.15.165:0/3298735033 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc4801a7c0 con 0x55ab429ca130 2024-09-22T08:12:50.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.040+0000 7fcb41e03640 1 -- 172.21.15.165:0/3298735033 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4801a960 con 0x55ab429ca130 2024-09-22T08:12:50.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.040+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab42ac1460 con 0x55ab429ca130 2024-09-22T08:12:50.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.040+0000 7fcb41e03640 1 -- 172.21.15.165:0/3298735033 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc4801acc0 con 0x55ab429ca130 2024-09-22T08:12:50.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.040+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab42ac1e60 con 0x55ab429ca130 2024-09-22T08:12:50.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.040+0000 7fcc5a014800 1 Processor -- start 2024-09-22T08:12:50.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.040+0000 7fcc5a014800 1 -- start start 2024-09-22T08:12:50.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcc5a014800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab429c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcc5a014800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ab428c0d50 con 0x55ab429c8130 2024-09-22T08:12:50.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcb41e03640 1 -- 172.21.15.165:0/3298735033 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcc48017070 con 0x55ab429ca130 2024-09-22T08:12:50.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcc55fe1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab429c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcc55fe1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab429c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34046/0 (socket says 172.21.15.165:34046) 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcc55fe1640 1 -- 172.21.15.165:0/4054125195 learned_addr learned my addr 172.21.15.165:0/4054125195 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcb41e03640 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cfb0 0x7fcb3c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcb41e03640 1 -- 172.21.15.165:0/3298735033 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcc48015020 con 0x55ab429ca130 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcc557e0640 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cfb0 0x7fcb3c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcc55fe1640 1 -- 172.21.15.165:0/4054125195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab429c8a70 con 0x55ab429c8130 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcc55fe1640 1 --2- 172.21.15.165:0/4054125195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab429c8530 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000a3e0 tx=0x7fcc5000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e2ab20331bead server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcc557e0640 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cfb0 0x7fcb3c03f470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcc4801afd0 tx=0x7fcc48035040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcb3b7fe640 1 -- 172.21.15.165:0/4054125195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc50015070 con 0x55ab429c8130 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcb3b7fe640 1 -- 172.21.15.165:0/4054125195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc50001670 con 0x55ab429c8130 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.041+0000 7fcb3b7fe640 1 -- 172.21.15.165:0/4054125195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc50001990 con 0x55ab429c8130 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 -- 172.21.15.165:0/4054125195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 msgr2=0x55ab429c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 --2- 172.21.15.165:0/4054125195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab429c8530 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000a3e0 tx=0x7fcc5000a8a0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 -- 172.21.15.165:0/4054125195 shutdown_connections 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 --2- 172.21.15.165:0/4054125195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab429c8530 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 -- 172.21.15.165:0/4054125195 >> 172.21.15.165:0/4054125195 conn(0x55ab429cdc40 msgr2=0x55ab42ac8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 -- 172.21.15.165:0/4054125195 shutdown_connections 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 -- 172.21.15.165:0/4054125195 wait complete. 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 Processor -- start 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 -- start start 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab42ad73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.042+0000 7fcc5a014800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ab429c8df0 con 0x55ab429c8130 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.043+0000 7fcc55fe1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab42ad73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.043+0000 7fcc55fe1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab42ad73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34050/0 (socket says 172.21.15.165:34050) 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.043+0000 7fcc55fe1640 1 -- 172.21.15.165:0/2500864156 learned_addr learned my addr 172.21.15.165:0/2500864156 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.043+0000 7fcc55fe1640 1 -- 172.21.15.165:0/2500864156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab42ad7910 con 0x55ab429c8130 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.043+0000 7fcc55fe1640 1 --2- 172.21.15.165:0/2500864156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab42ad73b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x55ab42ac9580 tx=0x7fcc50003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.043+0000 7fcb39ffb640 1 -- 172.21.15.165:0/2500864156 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc50020020 con 0x55ab429c8130 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.043+0000 7fcb39ffb640 1 -- 172.21.15.165:0/2500864156 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc50010780 con 0x55ab429c8130 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.043+0000 7fcc5a014800 1 -- 172.21.15.165:0/2500864156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab42ad7ba0 con 0x55ab429c8130 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.043+0000 7fcb39ffb640 1 -- 172.21.15.165:0/2500864156 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc50015040 con 0x55ab429c8130 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.043+0000 7fcc5a014800 1 -- 172.21.15.165:0/2500864156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab42ad8520 con 0x55ab429c8130 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.044+0000 7fcb39ffb640 1 -- 172.21.15.165:0/2500864156 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcc50023020 con 0x55ab429c8130 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.044+0000 7fcb39ffb640 1 --2- 172.21.15.165:0/2500864156 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2c03cfb0 0x7fcb2c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.044+0000 7fcb39ffb640 1 -- 172.21.15.165:0/2500864156 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcc50053fa0 con 0x55ab429c8130 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.044+0000 7fcc54fdf640 1 --2- 172.21.15.165:0/2500864156 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2c03cfb0 0x7fcb2c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.045+0000 7fcc5a014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.045+0000 7fcc5a014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.045+0000 7fcc54fdf640 1 --2- 172.21.15.165:0/2500864156 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2c03cfb0 0x7fcb2c03f470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c057000 tx=0x7fcc4c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.045+0000 7fcc5a014800 1 Processor -- start 2024-09-22T08:12:50.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.045+0000 7fcc5a014800 1 -- start start 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.045+0000 7fcc5a014800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab42af11f0 0x55ab42af1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.045+0000 7fcc5a014800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ab42ab9b30 con 0x55ab42af11f0 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.046+0000 7fcc557e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab42af11f0 0x55ab42af1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.046+0000 7fcc557e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab42af11f0 0x55ab42af1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34060/0 (socket says 172.21.15.165:34060) 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.046+0000 7fcc557e0640 1 -- 172.21.15.165:0/2348432010 learned_addr learned my addr 172.21.15.165:0/2348432010 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.046+0000 7fcc557e0640 1 -- 172.21.15.165:0/2348432010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab42af1c50 con 0x55ab42af11f0 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.046+0000 7fcc557e0640 1 --2- 172.21.15.165:0/2348432010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab42af11f0 0x55ab42af1610 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800efd0 tx=0x7fcc48017770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.046+0000 7fcb19fe3640 1 -- 172.21.15.165:0/2348432010 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc48054660 con 0x55ab42af11f0 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.046+0000 7fcb19fe3640 1 -- 172.21.15.165:0/2348432010 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc48054800 con 0x55ab42af11f0 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.046+0000 7fcc5a014800 1 -- 172.21.15.165:0/2348432010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab42af2480 con 0x55ab42af11f0 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.046+0000 7fcb19fe3640 1 -- 172.21.15.165:0/2348432010 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc48054ae0 con 0x55ab42af11f0 2024-09-22T08:12:50.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.046+0000 7fcc5a014800 1 -- 172.21.15.165:0/2348432010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab42af2a20 con 0x55ab42af11f0 2024-09-22T08:12:50.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.047+0000 7fcb19fe3640 1 -- 172.21.15.165:0/2348432010 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fcc48032460 con 0x55ab42af11f0 2024-09-22T08:12:50.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.047+0000 7fcb19fe3640 1 --2- 172.21.15.165:0/2348432010 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca9803cfb0 0x7fca9803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.047+0000 7fcb19fe3640 1 -- 172.21.15.165:0/2348432010 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcc4804cd50 con 0x55ab42af11f0 2024-09-22T08:12:50.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.047+0000 7fcc54fdf640 1 --2- 172.21.15.165:0/2348432010 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca9803cfb0 0x7fca9803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.048+0000 7fca937fe640 20 reqs_thread_entry: start 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.048+0000 7fcc54fdf640 1 --2- 172.21.15.165:0/2348432010 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca9803cfb0 0x7fca9803f470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c005930 tx=0x7fcc4c005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.048+0000 7fcc5a014800 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ab42afeb60 0x55ab42b01020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.048+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab42b016f0 con 0x55ab42afeb60 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.048+0000 7fcc55fe1640 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ab42afeb60 0x55ab42b01020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.048+0000 7fcc55fe1640 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ab42afeb60 0x55ab42b01020 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.048+0000 7fcc55fe1640 1 -- 172.21.15.165:0/3298735033 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc5000e070 con 0x55ab42afeb60 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.048+0000 7fcc5a014800 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ab42b034c0 0x55ab42b058b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.048+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:2 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab42b05fa0 con 0x55ab42b034c0 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.049+0000 7fcc557e0640 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ab42b034c0 0x55ab42b058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.049+0000 7fcc557e0640 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ab42b034c0 0x55ab42b058b0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.049+0000 7fcc557e0640 1 -- 172.21.15.165:0/3298735033 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(2 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fcc48052070 con 0x55ab42b034c0 2024-09-22T08:12:50.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.049+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab42b0b440 con 0x55ab42b034c0 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.050+0000 7fcc557e0640 1 -- 172.21.15.165:0/3298735033 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fcc48052070 con 0x55ab42b034c0 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.051+0000 7fcc5a014800 1 -- 172.21.15.165:0/2500864156 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2c03cfb0 msgr2=0x7fcb2c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.051+0000 7fcc5a014800 1 --2- 172.21.15.165:0/2500864156 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2c03cfb0 0x7fcb2c03f470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c057000 tx=0x7fcc4c052000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.051+0000 7fcc5a014800 1 -- 172.21.15.165:0/2500864156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 msgr2=0x55ab42ad73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.051+0000 7fcc5a014800 1 --2- 172.21.15.165:0/2500864156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab42ad73b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x55ab42ac9580 tx=0x7fcc50003370 comp rx=0 tx=0).stop 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.051+0000 7fcc5a014800 1 -- 172.21.15.165:0/2500864156 shutdown_connections 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.051+0000 7fcc5a014800 1 --2- 172.21.15.165:0/2500864156 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb2c03cfb0 0x7fcb2c03f470 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.051+0000 7fcc5a014800 1 --2- 172.21.15.165:0/2500864156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429c8130 0x55ab42ad73b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.051+0000 7fcc5a014800 1 -- 172.21.15.165:0/2500864156 >> 172.21.15.165:0/2500864156 conn(0x55ab429cdc40 msgr2=0x55ab42ac8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.051+0000 7fcc5a014800 1 -- 172.21.15.165:0/2500864156 shutdown_connections 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.051+0000 7fcc5a014800 1 -- 172.21.15.165:0/2500864156 wait complete. 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/2348432010 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca9803cfb0 msgr2=0x7fca9803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/2348432010 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca9803cfb0 0x7fca9803f470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c005930 tx=0x7fcc4c005ac0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/2348432010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab42af11f0 msgr2=0x55ab42af1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/2348432010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab42af11f0 0x55ab42af1610 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800efd0 tx=0x7fcc48017770 comp rx=0 tx=0).stop 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/2348432010 shutdown_connections 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/2348432010 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fca9803cfb0 0x7fca9803f470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/2348432010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab42af11f0 0x55ab42af1610 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/2348432010 >> 172.21.15.165:0/2348432010 conn(0x55ab42ae6740 msgr2=0x55ab42ae6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/2348432010 shutdown_connections 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/2348432010 wait complete. 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ab42afeb60 msgr2=0x55ab42b01020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ab42afeb60 0x55ab42b01020 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ab42b034c0 msgr2=0x55ab42b058b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ab42b034c0 0x55ab42b058b0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cfb0 msgr2=0x7fcb3c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cfb0 0x7fcb3c03f470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcc4801afd0 tx=0x7fcc48035040 comp rx=0 tx=0).stop 2024-09-22T08:12:50.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 msgr2=0x55ab42ac0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ac0c70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800b700 tx=0x7fcc48000bc0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 shutdown_connections 2024-09-22T08:12:50.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ab42b034c0 0x55ab42b058b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ab42afeb60 0x55ab42b01020 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fcb3c03cfb0 0x7fcb3c03f470 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 --2- 172.21.15.165:0/3298735033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab429ca130 0x55ab42ac0c70 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 >> 172.21.15.165:0/3298735033 conn(0x55ab429c3d10 msgr2=0x55ab42aba600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 shutdown_connections 2024-09-22T08:12:50.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.052+0000 7fcc5a014800 1 -- 172.21.15.165:0/3298735033 wait complete. 2024-09-22T08:12:50.061 INFO:teuthology.orchestra.run.smithi165.stdout:{"id":"cc1223c2-11fd-49fe-8726-a14b177df4cc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:12:50.062 DEBUG:tasks.util.rgw: json result: {'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:12:50.062 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-22T08:12:50.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-22T08:12:50.062 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-22T08:12:50.104 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:50.104 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:50.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.104+0000 7ffa19d2e800 1 Processor -- start 2024-09-22T08:12:50.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.104+0000 7ffa19d2e800 1 -- start start 2024-09-22T08:12:50.105 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.104+0000 7ffa19d2e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556547350070 0x556547352460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.104+0000 7ffa19d2e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5565471daa20 con 0x5565473529a0 2024-09-22T08:12:50.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.104+0000 7ffa19d2e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5565471da7d0 con 0x556547350070 2024-09-22T08:12:50.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.104+0000 7ffa15964640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556547350070 0x556547352460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.104+0000 7ffa15163640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5565473529a0 0x556547354d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57782/0 (socket says 172.21.15.165:57782) 2024-09-22T08:12:50.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.104+0000 7ffa15163640 1 -- 172.21.15.165:0/518602125 learned_addr learned my addr 172.21.15.165:0/518602125 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:50.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.105+0000 7ffa15964640 1 -- 172.21.15.165:0/518602125 >> v1:172.21.15.53:6789/0 conn(0x5565473529a0 legacy=0x556547354d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.105+0000 7ffa14962640 1 -- 172.21.15.165:0/518602125 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011706066 0 0) 0x5565471daa20 con 0x5565473529a0 2024-09-22T08:12:50.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.105+0000 7ffa15964640 1 -- 172.21.15.165:0/518602125 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556547357550 con 0x556547350070 2024-09-22T08:12:50.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.106+0000 7ffa15964640 1 --2- 172.21.15.165:0/518602125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x556547352460 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800a470 tx=0x7ffa08045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d52ef8f2abb438 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.107+0000 7ffa14962640 1 -- 172.21.15.165:0/518602125 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa08053570 con 0x556547350070 2024-09-22T08:12:50.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.107+0000 7ffa14962640 1 -- 172.21.15.165:0/518602125 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa08058070 con 0x556547350070 2024-09-22T08:12:50.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.107+0000 7ffa14962640 1 -- 172.21.15.165:0/518602125 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa08053880 con 0x556547350070 2024-09-22T08:12:50.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.107+0000 7ffa19d2e800 1 -- 172.21.15.165:0/518602125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 msgr2=0x556547352460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.107+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/518602125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x556547352460 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800a470 tx=0x7ffa08045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:50.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.107+0000 7ffa19d2e800 1 -- 172.21.15.165:0/518602125 shutdown_connections 2024-09-22T08:12:50.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.107+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/518602125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x556547352460 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.107+0000 7ffa19d2e800 1 -- 172.21.15.165:0/518602125 >> 172.21.15.165:0/518602125 conn(0x556547349bd0 msgr2=0x55654734c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.107+0000 7ffa19d2e800 1 -- 172.21.15.165:0/518602125 shutdown_connections 2024-09-22T08:12:50.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.107+0000 7ffa19d2e800 1 -- 172.21.15.165:0/518602125 wait complete. 2024-09-22T08:12:50.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.121+0000 7ffa19d2e800 1 Processor -- start 2024-09-22T08:12:50.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.121+0000 7ffa19d2e800 1 -- start start 2024-09-22T08:12:50.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.121+0000 7ffa19d2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654743ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.121+0000 7ffa19d2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5565471e7dd0 con 0x556547350070 2024-09-22T08:12:50.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.122+0000 7ffa15964640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654743ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.122+0000 7ffa15964640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654743ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34074/0 (socket says 172.21.15.165:34074) 2024-09-22T08:12:50.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.122+0000 7ffa15964640 1 -- 172.21.15.165:0/516347952 learned_addr learned my addr 172.21.15.165:0/516347952 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.122+0000 7ffa15964640 1 -- 172.21.15.165:0/516347952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654743f420 con 0x556547350070 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.122+0000 7ffa15964640 1 --2- 172.21.15.165:0/516347952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654743ee30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ffa08025c20 tx=0x7ffa08051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a11366d77d4729a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.122+0000 7ff903e07640 1 -- 172.21.15.165:0/516347952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa08053a20 con 0x556547350070 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.122+0000 7ff903e07640 1 -- 172.21.15.165:0/516347952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa08063070 con 0x556547350070 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.122+0000 7ff903e07640 1 -- 172.21.15.165:0/516347952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa08053d30 con 0x556547350070 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.123+0000 7ffa19d2e800 1 -- 172.21.15.165:0/516347952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 msgr2=0x55654743ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.123+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/516347952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654743ee30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ffa08025c20 tx=0x7ffa08051000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.123+0000 7ffa19d2e800 1 -- 172.21.15.165:0/516347952 shutdown_connections 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.123+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/516347952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654743ee30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.123+0000 7ffa19d2e800 1 -- 172.21.15.165:0/516347952 >> 172.21.15.165:0/516347952 conn(0x556547349bd0 msgr2=0x55654743a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.123+0000 7ffa19d2e800 1 -- 172.21.15.165:0/516347952 shutdown_connections 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.123+0000 7ffa19d2e800 1 -- 172.21.15.165:0/516347952 wait complete. 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.123+0000 7ffa19d2e800 1 Processor -- start 2024-09-22T08:12:50.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.123+0000 7ffa19d2e800 1 -- start start 2024-09-22T08:12:50.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ffa19d2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654734f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ffa19d2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556547356840 con 0x556547350070 2024-09-22T08:12:50.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ffa15964640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654734f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ffa15964640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654734f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34088/0 (socket says 172.21.15.165:34088) 2024-09-22T08:12:50.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ffa15964640 1 -- 172.21.15.165:0/4037484501 learned_addr learned my addr 172.21.15.165:0/4037484501 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ffa15964640 1 -- 172.21.15.165:0/4037484501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654734fca0 con 0x556547350070 2024-09-22T08:12:50.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ffa15964640 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654734f740 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ffa08025c20 tx=0x7ffa08002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ff902604640 1 -- 172.21.15.165:0/4037484501 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa08078070 con 0x556547350070 2024-09-22T08:12:50.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ff902604640 1 -- 172.21.15.165:0/4037484501 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa08073470 con 0x556547350070 2024-09-22T08:12:50.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55654734e0a0 con 0x556547350070 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.124+0000 7ff902604640 1 -- 172.21.15.165:0/4037484501 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa08073750 con 0x556547350070 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.125+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654734e6c0 con 0x556547350070 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.125+0000 7ffa19d2e800 1 Processor -- start 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.125+0000 7ffa19d2e800 1 -- start start 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.125+0000 7ffa19d2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x5565474584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.125+0000 7ffa19d2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556547246d50 con 0x5565474560d0 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.125+0000 7ff902604640 1 -- 172.21.15.165:0/4037484501 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ffa0807b070 con 0x556547350070 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ffa16165640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x5565474584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ffa16165640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x5565474584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34100/0 (socket says 172.21.15.165:34100) 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ffa16165640 1 -- 172.21.15.165:0/1205063953 learned_addr learned my addr 172.21.15.165:0/1205063953 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ff902604640 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8fc03cfb0 0x7ff8fc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ff902604640 1 -- 172.21.15.165:0/4037484501 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffa080986e0 con 0x556547350070 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ffa16165640 1 -- 172.21.15.165:0/1205063953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556547458a90 con 0x5565474560d0 2024-09-22T08:12:50.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ffa15964640 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8fc03cfb0 0x7ff8fc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ffa16165640 1 --2- 172.21.15.165:0/1205063953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x5565474584c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000a3e0 tx=0x7ffa1000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb16062799c09ec server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ffa15964640 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8fc03cfb0 0x7ff8fc03f470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffa0805f590 tx=0x7ffa0805f4a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ff8fbfff640 1 -- 172.21.15.165:0/1205063953 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa10015070 con 0x5565474560d0 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ff8fbfff640 1 -- 172.21.15.165:0/1205063953 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa10001670 con 0x5565474560d0 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.126+0000 7ff8fbfff640 1 -- 172.21.15.165:0/1205063953 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa10001990 con 0x5565474560d0 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1205063953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 msgr2=0x5565474584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/1205063953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x5565474584c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000a3e0 tx=0x7ffa1000a8a0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1205063953 shutdown_connections 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/1205063953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x5565474584c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1205063953 >> 172.21.15.165:0/1205063953 conn(0x5565473529a0 msgr2=0x5565474509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1205063953 shutdown_connections 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1205063953 wait complete. 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 Processor -- start 2024-09-22T08:12:50.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 -- start start 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x55654745ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa19d2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556547458d20 con 0x5565474560d0 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa16165640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x55654745ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa16165640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x55654745ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34102/0 (socket says 172.21.15.165:34102) 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.127+0000 7ffa16165640 1 -- 172.21.15.165:0/1967378834 learned_addr learned my addr 172.21.15.165:0/1967378834 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.128+0000 7ffa16165640 1 -- 172.21.15.165:0/1967378834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654745d3f0 con 0x5565474560d0 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.128+0000 7ffa16165640 1 --2- 172.21.15.165:0/1967378834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x55654745ce90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x5565474513d0 tx=0x7ffa10003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.128+0000 7ff8fa7fc640 1 -- 172.21.15.165:0/1967378834 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa10020020 con 0x5565474560d0 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.128+0000 7ff8fa7fc640 1 -- 172.21.15.165:0/1967378834 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa10010780 con 0x5565474560d0 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.128+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1967378834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55654745d680 con 0x5565474560d0 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.128+0000 7ff8fa7fc640 1 -- 172.21.15.165:0/1967378834 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa10015040 con 0x5565474560d0 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.128+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1967378834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654745e000 con 0x5565474560d0 2024-09-22T08:12:50.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.129+0000 7ff8fa7fc640 1 -- 172.21.15.165:0/1967378834 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ffa10023020 con 0x5565474560d0 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.129+0000 7ff8fa7fc640 1 --2- 172.21.15.165:0/1967378834 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8f003cfb0 0x7ff8f003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.129+0000 7ff8fa7fc640 1 -- 172.21.15.165:0/1967378834 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffa10053fe0 con 0x5565474560d0 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.129+0000 7ffa19d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.129+0000 7ffa19d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.130+0000 7ffa15163640 1 --2- 172.21.15.165:0/1967378834 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8f003cfb0 0x7ff8f003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.130+0000 7ffa19d2e800 1 Processor -- start 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.130+0000 7ffa15163640 1 --2- 172.21.15.165:0/1967378834 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8f003cfb0 0x7ff8f003f470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c000c00 tx=0x7ffa0c001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.130+0000 7ffa19d2e800 1 -- start start 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.130+0000 7ffa19d2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547476ce0 0x556547477100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.130+0000 7ffa19d2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55654743f7f0 con 0x556547476ce0 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.130+0000 7ffa15964640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547476ce0 0x556547477100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.130+0000 7ffa15964640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547476ce0 0x556547477100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34106/0 (socket says 172.21.15.165:34106) 2024-09-22T08:12:50.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.130+0000 7ffa15964640 1 -- 172.21.15.165:0/3076485605 learned_addr learned my addr 172.21.15.165:0/3076485605 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.131+0000 7ffa15964640 1 -- 172.21.15.165:0/3076485605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556547477740 con 0x556547476ce0 2024-09-22T08:12:50.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.131+0000 7ffa15964640 1 --2- 172.21.15.165:0/3076485605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547476ce0 0x556547477100 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ffa0805db10 tx=0x7ffa0805df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.131+0000 7ff8da7e4640 1 -- 172.21.15.165:0/3076485605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa0805e720 con 0x556547476ce0 2024-09-22T08:12:50.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.131+0000 7ff8da7e4640 1 -- 172.21.15.165:0/3076485605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0807c570 con 0x556547476ce0 2024-09-22T08:12:50.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.131+0000 7ff8da7e4640 1 -- 172.21.15.165:0/3076485605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa0807c850 con 0x556547476ce0 2024-09-22T08:12:50.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.131+0000 7ffa19d2e800 1 -- 172.21.15.165:0/3076485605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556547477f70 con 0x556547476ce0 2024-09-22T08:12:50.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.131+0000 7ffa19d2e800 1 -- 172.21.15.165:0/3076485605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556547478510 con 0x556547476ce0 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.132+0000 7ff8da7e4640 1 -- 172.21.15.165:0/3076485605 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ffa08098a30 con 0x556547476ce0 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.132+0000 7ff8da7e4640 1 --2- 172.21.15.165:0/3076485605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff85803cfb0 0x7ff85803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.132+0000 7ff8da7e4640 1 -- 172.21.15.165:0/3076485605 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffa080a2d10 con 0x556547476ce0 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.132+0000 7ffa15163640 1 --2- 172.21.15.165:0/3076485605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff85803cfb0 0x7ff85803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.133+0000 7ff84bfff640 20 reqs_thread_entry: start 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.133+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556547484600 0x556547486a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.133+0000 7ffa15163640 1 --2- 172.21.15.165:0/3076485605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff85803cfb0 0x7ff85803f470 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c000f60 tx=0x7ffa0c006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.133+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565474870b0 con 0x556547484600 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.133+0000 7ffa16165640 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556547484600 0x556547486a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.133+0000 7ffa16165640 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556547484600 0x556547486a30 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.133+0000 7ffa16165640 1 -- 172.21.15.165:0/4037484501 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa1000e070 con 0x556547484600 2024-09-22T08:12:50.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.133+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556547487990 con 0x556547484600 2024-09-22T08:12:50.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.133+0000 7ffa16165640 1 -- 172.21.15.165:0/4037484501 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa1000e070 con 0x556547484600 2024-09-22T08:12:50.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.134+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556547488d40 con 0x556547484600 2024-09-22T08:12:50.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.134+0000 7ffa16165640 1 -- 172.21.15.165:0/4037484501 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa1000e070 con 0x556547484600 2024-09-22T08:12:50.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.134+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1967378834 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8f003cfb0 msgr2=0x7ff8f003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.134+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/1967378834 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8f003cfb0 0x7ff8f003f470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c000c00 tx=0x7ffa0c001330 comp rx=0 tx=0).stop 2024-09-22T08:12:50.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.134+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1967378834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 msgr2=0x55654745ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.134+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/1967378834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x55654745ce90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x5565474513d0 tx=0x7ffa10003370 comp rx=0 tx=0).stop 2024-09-22T08:12:50.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.134+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1967378834 shutdown_connections 2024-09-22T08:12:50.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.134+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/1967378834 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8f003cfb0 0x7ff8f003f470 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.134+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/1967378834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565474560d0 0x55654745ce90 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.134+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1967378834 >> 172.21.15.165:0/1967378834 conn(0x5565473529a0 msgr2=0x5565474509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1967378834 shutdown_connections 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/1967378834 wait complete. 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/3076485605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff85803cfb0 msgr2=0x7ff85803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/3076485605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff85803cfb0 0x7ff85803f470 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c000f60 tx=0x7ffa0c006000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/3076485605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547476ce0 msgr2=0x556547477100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/3076485605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547476ce0 0x556547477100 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ffa0805db10 tx=0x7ffa0805df50 comp rx=0 tx=0).stop 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/3076485605 shutdown_connections 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/3076485605 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff85803cfb0 0x7ff85803f470 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/3076485605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547476ce0 0x556547477100 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/3076485605 >> 172.21.15.165:0/3076485605 conn(0x55654746c2a0 msgr2=0x55654746c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/3076485605 shutdown_connections 2024-09-22T08:12:50.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/3076485605 wait complete. 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556547484600 msgr2=0x556547486a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556547484600 0x556547486a30 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8fc03cfb0 msgr2=0x7ff8fc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8fc03cfb0 0x7ff8fc03f470 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffa0805f590 tx=0x7ffa0805f4a0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 msgr2=0x55654734f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654734f740 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ffa08025c20 tx=0x7ffa08002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 shutdown_connections 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x556547484600 0x556547486a30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7ff8fc03cfb0 0x7ff8fc03f470 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 --2- 172.21.15.165:0/4037484501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556547350070 0x55654734f740 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 >> 172.21.15.165:0/4037484501 conn(0x556547349bd0 msgr2=0x556547440220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 shutdown_connections 2024-09-22T08:12:50.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.135+0000 7ffa19d2e800 1 -- 172.21.15.165:0/4037484501 wait complete. 2024-09-22T08:12:50.145 INFO:teuthology.orchestra.run.smithi165.stdout:{"id":"083396ec-d900-46a5-a2e2-dd86e7b6cca3","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"cc1223c2-11fd-49fe-8726-a14b177df4cc","zones":[{"id":"cc1223c2-11fd-49fe-8726-a14b177df4cc","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-22T08:12:50.145 DEBUG:tasks.util.rgw: json result: {'id': '083396ec-d900-46a5-a2e2-dd86e7b6cca3', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'cc1223c2-11fd-49fe-8726-a14b177df4cc', 'zones': [{'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-22T08:12:50.148 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-22T08:12:50.167 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-22T08:12:50.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-22T08:12:50.167 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-22T08:12:50.240 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:50.240 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:50.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.240+0000 7f775b220800 1 Processor -- start 2024-09-22T08:12:50.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.240+0000 7f775b220800 1 -- start start 2024-09-22T08:12:50.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.240+0000 7f775b220800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f954c5b830 0x55f954c5c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.240+0000 7f775b220800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f954ae7a20 con 0x55f954c5ca70 2024-09-22T08:12:50.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.240+0000 7f775b220800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f954ae77d0 con 0x55f954c5b830 2024-09-22T08:12:50.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.240+0000 7f7758d0a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f954c5b830 0x55f954c5c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.241+0000 7f7753fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f954c5ca70 0x55f954c615c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57796/0 (socket says 172.21.15.165:57796) 2024-09-22T08:12:50.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.241+0000 7f7753fff640 1 -- 172.21.15.165:0/1974235495 learned_addr learned my addr 172.21.15.165:0/1974235495 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:50.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.241+0000 7f7758d0a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f954c5b830 0x55f954c5c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34118/0 (socket says 172.21.15.165:34118) 2024-09-22T08:12:50.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.241+0000 7f7758d0a640 1 -- 172.21.15.165:0/1974235495 >> v1:172.21.15.53:6789/0 conn(0x55f954c5ca70 legacy=0x55f954c615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.241+0000 7f7758d0a640 1 -- 172.21.15.165:0/1974235495 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f954c5bf30 con 0x55f954c5b830 2024-09-22T08:12:50.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.243+0000 7f7758d0a640 1 --2- 172.21.15.165:0/1974235495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954c5c530 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f774c00a600 tx=0x7f774c047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de6317d6fdde719 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.243+0000 7f77537fe640 1 -- 172.21.15.165:0/1974235495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c056070 con 0x55f954c5b830 2024-09-22T08:12:50.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.243+0000 7f77537fe640 1 -- 172.21.15.165:0/1974235495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c00a200 con 0x55f954c5b830 2024-09-22T08:12:50.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.243+0000 7f77537fe640 1 -- 172.21.15.165:0/1974235495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c008590 con 0x55f954c5b830 2024-09-22T08:12:50.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.244+0000 7f775b220800 1 -- 172.21.15.165:0/1974235495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 msgr2=0x55f954c5c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.244+0000 7f775b220800 1 --2- 172.21.15.165:0/1974235495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954c5c530 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f774c00a600 tx=0x7f774c047cb0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.244+0000 7f775b220800 1 -- 172.21.15.165:0/1974235495 shutdown_connections 2024-09-22T08:12:50.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.244+0000 7f775b220800 1 --2- 172.21.15.165:0/1974235495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954c5c530 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.244+0000 7f775b220800 1 -- 172.21.15.165:0/1974235495 >> 172.21.15.165:0/1974235495 conn(0x55f954c56c00 msgr2=0x55f954c59060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.244+0000 7f775b220800 1 -- 172.21.15.165:0/1974235495 shutdown_connections 2024-09-22T08:12:50.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.244+0000 7f775b220800 1 -- 172.21.15.165:0/1974235495 wait complete. 2024-09-22T08:12:50.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.258+0000 7f775b220800 1 Processor -- start 2024-09-22T08:12:50.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.258+0000 7f775b220800 1 -- start start 2024-09-22T08:12:50.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.258+0000 7f775b220800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d4e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.258+0000 7f775b220800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f954af4dd0 con 0x55f954c5b830 2024-09-22T08:12:50.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.258+0000 7f7758d0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d4e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.258+0000 7f7758d0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d4e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34128/0 (socket says 172.21.15.165:34128) 2024-09-22T08:12:50.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.258+0000 7f7758d0a640 1 -- 172.21.15.165:0/1021328191 learned_addr learned my addr 172.21.15.165:0/1021328191 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.259+0000 7f7758d0a640 1 -- 172.21.15.165:0/1021328191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f954d4e9d0 con 0x55f954c5b830 2024-09-22T08:12:50.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.259+0000 7f7758d0a640 1 --2- 172.21.15.165:0/1021328191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d4e3e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f774c027ae0 tx=0x7f774c053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7024b26bb1ea50d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.259+0000 7f7646e05640 1 -- 172.21.15.165:0/1021328191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c0516e0 con 0x55f954c5b830 2024-09-22T08:12:50.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.259+0000 7f7646e05640 1 -- 172.21.15.165:0/1021328191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c051880 con 0x55f954c5b830 2024-09-22T08:12:50.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.259+0000 7f7646e05640 1 -- 172.21.15.165:0/1021328191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c051b80 con 0x55f954c5b830 2024-09-22T08:12:50.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.260+0000 7f775b220800 1 -- 172.21.15.165:0/1021328191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 msgr2=0x55f954d4e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.260+0000 7f775b220800 1 --2- 172.21.15.165:0/1021328191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d4e3e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f774c027ae0 tx=0x7f774c053000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.260+0000 7f775b220800 1 -- 172.21.15.165:0/1021328191 shutdown_connections 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.260+0000 7f775b220800 1 --2- 172.21.15.165:0/1021328191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d4e3e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.260+0000 7f775b220800 1 -- 172.21.15.165:0/1021328191 >> 172.21.15.165:0/1021328191 conn(0x55f954c56c00 msgr2=0x55f954d45950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.260+0000 7f775b220800 1 -- 172.21.15.165:0/1021328191 shutdown_connections 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.260+0000 7f775b220800 1 -- 172.21.15.165:0/1021328191 wait complete. 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.260+0000 7f775b220800 1 Processor -- start 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.260+0000 7f775b220800 1 -- start start 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.261+0000 7f775b220800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d55dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.261+0000 7f775b220800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f954c5d2e0 con 0x55f954c5b830 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.261+0000 7f7758d0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d55dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.261+0000 7f7758d0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d55dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34138/0 (socket says 172.21.15.165:34138) 2024-09-22T08:12:50.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.261+0000 7f7758d0a640 1 -- 172.21.15.165:0/2730251044 learned_addr learned my addr 172.21.15.165:0/2730251044 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.261+0000 7f7758d0a640 1 -- 172.21.15.165:0/2730251044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f954d56320 con 0x55f954c5b830 2024-09-22T08:12:50.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.261+0000 7f7758d0a640 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d55dc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f774c05d040 tx=0x7f774c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.261+0000 7f7645602640 1 -- 172.21.15.165:0/2730251044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c051a30 con 0x55f954c5b830 2024-09-22T08:12:50.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.262+0000 7f7645602640 1 -- 172.21.15.165:0/2730251044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c065450 con 0x55f954c5b830 2024-09-22T08:12:50.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.262+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f954d565b0 con 0x55f954c5b830 2024-09-22T08:12:50.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.262+0000 7f7645602640 1 -- 172.21.15.165:0/2730251044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c065640 con 0x55f954c5b830 2024-09-22T08:12:50.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.262+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f954d56fb0 con 0x55f954c5b830 2024-09-22T08:12:50.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.263+0000 7f7645602640 1 -- 172.21.15.165:0/2730251044 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f774c075060 con 0x55f954c5b830 2024-09-22T08:12:50.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.263+0000 7f7645602640 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f764003cfb0 0x7f764003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.263+0000 7f7645602640 1 -- 172.21.15.165:0/2730251044 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f774c06b070 con 0x55f954c5b830 2024-09-22T08:12:50.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.263+0000 7f7753fff640 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f764003cfb0 0x7f764003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.263+0000 7f775b220800 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954c5ca70 0x55f954d5d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.263+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d5d950 con 0x55f954c5ca70 2024-09-22T08:12:50.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.263+0000 7f775950b640 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954c5ca70 0x55f954d5d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.263+0000 7f7753fff640 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f764003cfb0 0x7f764003f470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7744001d70 tx=0x7f77440012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.263+0000 7f775950b640 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954c5ca70 0x55f954d5d410 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.264+0000 7f775950b640 1 -- 172.21.15.165:0/2730251044 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f775400a4d0 con 0x55f954c5ca70 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.264+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d5dcf0 con 0x55f954c5ca70 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.264+0000 7f775950b640 1 -- 172.21.15.165:0/2730251044 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f775400a4d0 con 0x55f954c5ca70 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.264+0000 7f775b220800 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d5f7f0 0x55f954d61c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.264+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d62420 con 0x55f954d5f7f0 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.264+0000 7f7758d0a640 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d5f7f0 0x55f954d61c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.264+0000 7f7758d0a640 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d5f7f0 0x55f954d61c90 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.265+0000 7f7758d0a640 1 -- 172.21.15.165:0/2730251044 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f774c058030 con 0x55f954d5f7f0 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.265+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d5e540 con 0x55f954c5ca70 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.265+0000 7f775950b640 1 -- 172.21.15.165:0/2730251044 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f775400a4d0 con 0x55f954c5ca70 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.265+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d5e960 con 0x55f954c5ca70 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.265+0000 7f775950b640 1 -- 172.21.15.165:0/2730251044 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f775400a4d0 con 0x55f954c5ca70 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.265+0000 7f775b220800 1 Processor -- start 2024-09-22T08:12:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.266+0000 7f775b220800 1 -- start start 2024-09-22T08:12:50.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.266+0000 7f775b220800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d70d70 0x55f954d71190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.266+0000 7f775b220800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f954b53d50 con 0x55f954d70d70 2024-09-22T08:12:50.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.266+0000 7f775950b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d70d70 0x55f954d71190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.266+0000 7f775950b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d70d70 0x55f954d71190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34154/0 (socket says 172.21.15.165:34154) 2024-09-22T08:12:50.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.266+0000 7f775950b640 1 -- 172.21.15.165:0/3190534896 learned_addr learned my addr 172.21.15.165:0/3190534896 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.266+0000 7f775950b640 1 -- 172.21.15.165:0/3190534896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f954d717d0 con 0x55f954d70d70 2024-09-22T08:12:50.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.267+0000 7f775950b640 1 --2- 172.21.15.165:0/3190534896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d70d70 0x55f954d71190 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x55f954d56dc0 tx=0x7f7754018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.267+0000 7f763e7fc640 1 -- 172.21.15.165:0/3190534896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7754014450 con 0x55f954d70d70 2024-09-22T08:12:50.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.267+0000 7f763e7fc640 1 -- 172.21.15.165:0/3190534896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7754014610 con 0x55f954d70d70 2024-09-22T08:12:50.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.267+0000 7f763e7fc640 1 -- 172.21.15.165:0/3190534896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7754014930 con 0x55f954d70d70 2024-09-22T08:12:50.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.267+0000 7f775b220800 1 -- 172.21.15.165:0/3190534896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f954d72000 con 0x55f954d70d70 2024-09-22T08:12:50.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.267+0000 7f775b220800 1 -- 172.21.15.165:0/3190534896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f954d725a0 con 0x55f954d70d70 2024-09-22T08:12:50.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.268+0000 7f763e7fc640 1 -- 172.21.15.165:0/3190534896 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7754011040 con 0x55f954d70d70 2024-09-22T08:12:50.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.268+0000 7f763e7fc640 1 --2- 172.21.15.165:0/3190534896 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f763003cfb0 0x7f763003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.268+0000 7f763e7fc640 1 -- 172.21.15.165:0/3190534896 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f775401e070 con 0x55f954d70d70 2024-09-22T08:12:50.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.268+0000 7f7758d0a640 1 --2- 172.21.15.165:0/3190534896 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f763003cfb0 0x7f763003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.268+0000 7f775b220800 1 Processor -- start 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.268+0000 7f7758d0a640 1 --2- 172.21.15.165:0/3190534896 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f763003cfb0 0x7f763003f470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55f954d57ec0 tx=0x7f774c097040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.268+0000 7f775b220800 1 -- start start 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.268+0000 7f775b220800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d7dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.268+0000 7f775b220800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f954d4ed40 con 0x55f954d7d810 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.269+0000 7f775950b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d7dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.269+0000 7f775950b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d7dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34164/0 (socket says 172.21.15.165:34164) 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.269+0000 7f775950b640 1 -- 172.21.15.165:0/3291974104 learned_addr learned my addr 172.21.15.165:0/3291974104 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.269+0000 7f775950b640 1 -- 172.21.15.165:0/3291974104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f954d7e200 con 0x55f954d7d810 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.269+0000 7f775950b640 1 --2- 172.21.15.165:0/3291974104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d7dc10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7754016fd0 tx=0x7f7754011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a187cea73037b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.269+0000 7f762ffff640 1 -- 172.21.15.165:0/3291974104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77540532d0 con 0x55f954d7d810 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.269+0000 7f762ffff640 1 -- 172.21.15.165:0/3291974104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77540167c0 con 0x55f954d7d810 2024-09-22T08:12:50.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.269+0000 7f762ffff640 1 -- 172.21.15.165:0/3291974104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7754011330 con 0x55f954d7d810 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 -- 172.21.15.165:0/3291974104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 msgr2=0x55f954d7dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 --2- 172.21.15.165:0/3291974104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d7dc10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7754016fd0 tx=0x7f7754011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 -- 172.21.15.165:0/3291974104 shutdown_connections 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 --2- 172.21.15.165:0/3291974104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d7dc10 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 -- 172.21.15.165:0/3291974104 >> 172.21.15.165:0/3291974104 conn(0x55f954d79c10 msgr2=0x55f954d77e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 -- 172.21.15.165:0/3291974104 shutdown_connections 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 -- 172.21.15.165:0/3291974104 wait complete. 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 Processor -- start 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 -- start start 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d84e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775b220800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f954d7e820 con 0x55f954d7d810 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775950b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d84e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.279 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775950b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d84e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34174/0 (socket says 172.21.15.165:34174) 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.270+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 learned_addr learned my addr 172.21.15.165:0/1000261913 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.271+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f954d853b0 con 0x55f954d7d810 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.271+0000 7f775950b640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d84e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7754011fd0 tx=0x7f7754054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.271+0000 7f762e7fc640 1 -- 172.21.15.165:0/1000261913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7754014c00 con 0x55f954d7d810 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.271+0000 7f762e7fc640 1 -- 172.21.15.165:0/1000261913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7754045960 con 0x55f954d7d810 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.271+0000 7f762e7fc640 1 -- 172.21.15.165:0/1000261913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7754045c40 con 0x55f954d7d810 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.271+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f954d85640 con 0x55f954d7d810 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.271+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f954d85fc0 con 0x55f954d7d810 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.272+0000 7f762e7fc640 1 -- 172.21.15.165:0/1000261913 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7754034020 con 0x55f954d7d810 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.272+0000 7f762e7fc640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f762403cfb0 0x7f762403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.272+0000 7f762e7fc640 1 -- 172.21.15.165:0/1000261913 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7754032020 con 0x55f954d7d810 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.272+0000 7f7758d0a640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f762403cfb0 0x7f762403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.273+0000 7f7758d0a640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f762403cfb0 0x7f762403f470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f774c0647b0 tx=0x7f774c07e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.273+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.273+0000 7f775b220800 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954d908e0 0x55f954d92da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.273+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d934f0 con 0x55f954d908e0 2024-09-22T08:12:50.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.273+0000 7f7753fff640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954d908e0 0x55f954d92da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.273+0000 7f7753fff640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954d908e0 0x55f954d92da0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.273+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7744009050 con 0x55f954d908e0 2024-09-22T08:12:50.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.273+0000 7f775b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.273+0000 7f775b220800 20 realm 2024-09-22T08:12:50.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d8fc30 con 0x55f954d908e0 2024-09-22T08:12:50.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7744009050 con 0x55f954d908e0 2024-09-22T08:12:50.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:50.282 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d93fe0 con 0x55f954d908e0 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7744009050 con 0x55f954d908e0 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d948b0 con 0x55f954d908e0 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7744009050 con 0x55f954d908e0 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d952d0 0x55f954d976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d97e00 con 0x55f954d952d0 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.274+0000 7f775950b640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d952d0 0x55f954d976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.275+0000 7f775950b640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d952d0 0x55f954d976c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.275+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.275+0000 7f775b220800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.275+0000 7f775b220800 20 searching for the correct realm 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.275+0000 7f775b220800 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f954d99db0 0x55f954d9c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.275+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d99db0 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.275+0000 7f7758d0a640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f954d99db0 0x55f954d9c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.275+0000 7f7758d0a640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f954d99db0 0x55f954d9c270 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.276+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.276+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d952d0 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.276+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.276+0000 7f775950b640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7754014070 0x7f775404d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.276+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x7f7754014070 2024-09-22T08:12:50.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.276+0000 7f7753fff640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7754014070 0x7f775404d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.277+0000 7f7753fff640 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7754014070 0x7f775404d600 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.277+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744009050 con 0x7f7754014070 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.277+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d908e0 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.277+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744009050 con 0x55f954d908e0 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.277+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d908e0 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.277+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.277+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x7f7754014070 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.278+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.278+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d952d0 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.278+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.278+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d952d0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.278+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.278+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d99db0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.278+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.278+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d908e0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.279+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.279+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x7f7754014070 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.279+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.279+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d908e0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.279+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.279+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d952d0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.279+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.279+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d99db0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.280+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.280+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d99db0 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.280+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.280+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x7f7754014070 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.280+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.280+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d99db0 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.280+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.280+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d99db0 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.281+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.281+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d908e0 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.281+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.281+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d908e0 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.281+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.281+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x7f7754014070 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.281+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.281+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d99db0 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.282+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.282+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d952d0 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.282+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.282+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d908e0 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.282+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.282+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x7f7754014070 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.282+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.282+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d99db0 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.283+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.283+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x7f7754014070 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.283+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.283+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d952d0 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.283+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.283+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d99db0 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x7f7754014070 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d908e0 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9c8f0 con 0x55f954d952d0 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f775b220800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f775b220800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f775b220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f775b220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f775b220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f775b220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.284+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d987c0 con 0x55f954d908e0 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d99060 con 0x55f954d908e0 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:50.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d98400 con 0x55f954d908e0 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 20 zone default found 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 4 Realm: () 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 20 zonegroup default 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9d220 con 0x7f7754014070 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.285+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f775b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9eef0 con 0x55f954d99db0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f775b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9f3e0 con 0x55f954d99db0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f775b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f775b220800 20 started sync module instance, tier type = 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f775b220800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.286+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9dcc0 con 0x55f954d952d0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.287+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.287+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94529358782944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9dcc0 con 0x55f954d952d0 2024-09-22T08:12:50.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.287+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9fec0 con 0x55f954d908e0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.288+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94529358782944] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.288+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.288+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94529358789040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9dcc0 con 0x55f954d908e0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.288+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da0950 con 0x55f954d99db0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.289+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94529358789040] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.290+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.290+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94529358780432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954d9dc30 con 0x55f954d99db0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.290+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da1810 con 0x55f954d952d0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.291+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.291+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94529358796128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da20b0 con 0x55f954d952d0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.291+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da2b60 con 0x55f954d908e0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.291+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94529358780432] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.292+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94529358796128] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.292+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.292+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94529358794048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da1c00 con 0x55f954d908e0 2024-09-22T08:12:50.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.292+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da3400 con 0x7f7754014070 2024-09-22T08:12:50.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.293+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94529358794048] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.293+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.293+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94529358800448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da1c00 con 0x7f7754014070 2024-09-22T08:12:50.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.293+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da3a10 con 0x7f7754014070 2024-09-22T08:12:50.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.294+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94529358800448] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.294+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.294+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94529358804224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da39d0 con 0x7f7754014070 2024-09-22T08:12:50.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.295+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da43d0 con 0x7f7754014070 2024-09-22T08:12:50.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.296+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94529358804224] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.296+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.296+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94529358802656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da4390 con 0x7f7754014070 2024-09-22T08:12:50.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.296+0000 7f775b220800 20 add_watcher() i=0 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.296+0000 7f775b220800 20 add_watcher() i=1 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.296+0000 7f775b220800 20 add_watcher() i=2 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.296+0000 7f775b220800 20 add_watcher() i=3 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.296+0000 7f775b220800 20 add_watcher() i=4 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.296+0000 7f775b220800 20 add_watcher() i=5 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.296+0000 7f775b220800 20 add_watcher() i=6 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.297+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94529358802656] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.297+0000 7f775b220800 20 add_watcher() i=7 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.297+0000 7f775b220800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.297+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954da78e0 con 0x55f954d908e0 2024-09-22T08:12:50.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.297+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.297+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94529358807680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954da4c70 con 0x55f954d908e0 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.299+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94529358807680] v34'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.299+0000 7f760f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f775b220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f775b220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f775b220800 5 note: GC not initialized 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f760e7e4640 20 reqs_thread_entry: start 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f775b220800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f775b220800 20 Filter name: none 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f7607fff640 20 reqs_thread_entry: start 2024-09-22T08:12:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f775b220800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954ddae00 con 0x7f7754014070 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.300+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd9340 con 0x55f954d908e0 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-22T08:12:50.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.301+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd9d00 con 0x7f7754014070 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f775b220800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f775b220800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f775b220800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94529359026016 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954dde8a0 con 0x55f954d908e0 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== watch-notify(notify (1) cookie 94529358794048 notify 146028888095 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55f954dda0a0 con 0x55f954d908e0 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f762ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94529358794048 notifier 4829 bl.length()=649 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.4 [notify cookie 94529359026016 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f762ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:50.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f762ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.302+0000 7f762ffff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f761c003ea0 con 0x55f954d908e0 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.303+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.303+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== watch-notify(notify_complete (2) cookie 94529359026016 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f954dda920 con 0x55f954d908e0 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.303+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd96f0 con 0x55f954d908e0 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f775b220800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f775b220800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f775b220800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94529359041504 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f954dde810 con 0x55f954d99db0 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== watch-notify(notify (1) cookie 94529358780432 notify 146028888072 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f954d56fb0 con 0x55f954d99db0 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f762ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94529358780432 notifier 4829 bl.length()=177 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f762ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-22T08:12:50.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f762ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-22T08:12:50.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f762ffff640 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f761c003ea0 con 0x55f954d99db0 2024-09-22T08:12:50.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.304+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(68 notify.2 [notify cookie 94529359041504 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.305+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== watch-notify(notify_complete (2) cookie 94529359041504 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f954d565b0 con 0x55f954d99db0 2024-09-22T08:12:50.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.305+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.315 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:12:50.302079Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.302069Z","tags":[],"group_ids":[]} 2024-09-22T08:12:50.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.305+0000 7f760f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:50.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.305+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94529358807680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd8a70 con 0x55f954d908e0 2024-09-22T08:12:50.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.306+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94529358807680] v34'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.307+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94529358782944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd8a70 con 0x55f954d952d0 2024-09-22T08:12:50.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.308+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94529358782944] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.308+0000 7f775b220800 20 remove_watcher() i=0 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.308+0000 7f775b220800 2 removed watcher, disabling cache 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.308+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94529358789040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd8a70 con 0x55f954d908e0 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.309+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94529358789040] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.309+0000 7f775b220800 20 remove_watcher() i=1 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.309+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94529358780432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd8a70 con 0x55f954d99db0 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.310+0000 7f7758d0a640 1 -- 172.21.15.165:0/1000261913 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94529358780432] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f774c058030 con 0x55f954d99db0 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.310+0000 7f775b220800 20 remove_watcher() i=2 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.310+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94529358796128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd8a70 con 0x55f954d952d0 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.311+0000 7f775950b640 1 -- 172.21.15.165:0/1000261913 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94529358796128] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775402a070 con 0x55f954d952d0 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.311+0000 7f775b220800 20 remove_watcher() i=3 2024-09-22T08:12:50.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.311+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94529358794048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd8a70 con 0x55f954d908e0 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.312+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94529358794048] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x55f954d908e0 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.312+0000 7f775b220800 20 remove_watcher() i=4 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.312+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94529358800448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd8a70 con 0x7f7754014070 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.313+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94529358800448] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.313+0000 7f775b220800 20 remove_watcher() i=5 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.313+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94529358804224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd8a70 con 0x7f7754014070 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.314+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94529358804224] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.314+0000 7f775b220800 20 remove_watcher() i=6 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.314+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94529358802656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f954dd8a70 con 0x7f7754014070 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.315+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94529358802656] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7744029040 con 0x7f7754014070 2024-09-22T08:12:50.323 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.315+0000 7f775b220800 20 remove_watcher() i=7 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.315+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7754014070 msgr2=0x7f775404d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.315+0000 7f775b220800 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f7754014070 0x7f775404d600 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.315+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954d908e0 msgr2=0x55f954d92da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.315+0000 7f775b220800 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954d908e0 0x55f954d92da0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.315+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d952d0 msgr2=0x55f954d976c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.315+0000 7f775b220800 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d952d0 0x55f954d976c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.315+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f954d99db0 msgr2=0x55f954d9c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.315+0000 7f775b220800 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55f954d99db0 0x55f954d9c270 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f762403cfb0 msgr2=0x7f762403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f762403cfb0 0x7f762403f470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f774c0647b0 tx=0x7f774c07e000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 msgr2=0x55f954d84e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f7753fff640 1 -- 172.21.15.165:0/1000261913 reap_dead start 2024-09-22T08:12:50.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d84e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7754011fd0 tx=0x7f7754054720 comp rx=0 tx=0).stop 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 shutdown_connections 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 --2- 172.21.15.165:0/1000261913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d7d810 0x55f954d84e50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 >> 172.21.15.165:0/1000261913 conn(0x55f954d79c10 msgr2=0x55f954d77e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 shutdown_connections 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/1000261913 wait complete. 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/3190534896 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f763003cfb0 msgr2=0x7f763003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 --2- 172.21.15.165:0/3190534896 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f763003cfb0 0x7f763003f470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55f954d57ec0 tx=0x7f774c097040 comp rx=0 tx=0).stop 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/3190534896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d70d70 msgr2=0x55f954d71190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 --2- 172.21.15.165:0/3190534896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d70d70 0x55f954d71190 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x55f954d56dc0 tx=0x7f7754018830 comp rx=0 tx=0).stop 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/3190534896 shutdown_connections 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 --2- 172.21.15.165:0/3190534896 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f763003cfb0 0x7f763003f470 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 --2- 172.21.15.165:0/3190534896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954d70d70 0x55f954d71190 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/3190534896 >> 172.21.15.165:0/3190534896 conn(0x55f954d65120 msgr2=0x55f954d65500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/3190534896 shutdown_connections 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/3190534896 wait complete. 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954c5ca70 msgr2=0x55f954d5d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954c5ca70 0x55f954d5d410 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d5f7f0 msgr2=0x55f954d61c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.316+0000 7f775b220800 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d5f7f0 0x55f954d61c90 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f764003cfb0 msgr2=0x7f764003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f764003cfb0 0x7f764003f470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7744001d70 tx=0x7f77440012d0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 msgr2=0x55f954d55dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d55dc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f774c05d040 tx=0x7f774c002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 shutdown_connections 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55f954d5f7f0 0x55f954d61c90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55f954c5ca70 0x55f954d5d410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f764003cfb0 0x7f764003f470 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 --2- 172.21.15.165:0/2730251044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f954c5b830 0x55f954d55dc0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 >> 172.21.15.165:0/2730251044 conn(0x55f954c56c00 msgr2=0x55f954d4f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 shutdown_connections 2024-09-22T08:12:50.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.317+0000 7f775b220800 1 -- 172.21.15.165:0/2730251044 wait complete. 2024-09-22T08:12:50.328 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:50.328 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:50.328 ERROR:root:0 2024-09-22T08:12:50.329 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:50.336 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000fb31ec14a840d0de-0066efd182-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:12:50.336 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-22T08:12:50.346 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:50.346 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-22T08:12:50.358 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-22T08:12:50.358 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-22T08:12:50.372 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-22T08:12:50.373 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-22T08:12:50.381 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-22T08:12:50.381 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:50.384 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:50.385 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-22T08:12:50.391 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:50.391 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:12:50.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:12:50.392 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-22T08:12:50.439 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:50.439 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:50.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.438+0000 7f4ce5326800 1 Processor -- start 2024-09-22T08:12:50.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.438+0000 7f4ce5326800 1 -- start start 2024-09-22T08:12:50.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.439+0000 7f4ce5326800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b3f7be5b90 0x55b3f7be7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.439+0000 7f4ce5326800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b3f7a6ca20 con 0x55b3f7be2080 2024-09-22T08:12:50.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.439+0000 7f4ce5326800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b3f7a6c7d0 con 0x55b3f7be5b90 2024-09-22T08:12:50.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.439+0000 7f4cd884a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b3f7be5b90 0x55b3f7be7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.439+0000 7f4ce104b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b3f7be2080 0x55b3f7be4470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57798/0 (socket says 172.21.15.165:57798) 2024-09-22T08:12:50.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.439+0000 7f4cd884a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b3f7be5b90 0x55b3f7be7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34176/0 (socket says 172.21.15.165:34176) 2024-09-22T08:12:50.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.439+0000 7f4ce104b640 1 -- 172.21.15.165:0/1920636790 learned_addr learned my addr 172.21.15.165:0/1920636790 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:50.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.439+0000 7f4cd884a640 1 -- 172.21.15.165:0/1920636790 >> v1:172.21.15.53:6789/0 conn(0x55b3f7be2080 legacy=0x55b3f7be4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.439+0000 7f4cd884a640 1 -- 172.21.15.165:0/1920636790 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3f7be9560 con 0x55b3f7be5b90 2024-09-22T08:12:50.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.441+0000 7f4cd884a640 1 --2- 172.21.15.165:0/1920636790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be5b90 0x55b3f7be7f80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00a470 tx=0x7f4ccc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bfb57bc54bae63 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.441+0000 7f4ce084a640 1 -- 172.21.15.165:0/1920636790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc053570 con 0x55b3f7be5b90 2024-09-22T08:12:50.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.441+0000 7f4ce084a640 1 -- 172.21.15.165:0/1920636790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ccc058070 con 0x55b3f7be5b90 2024-09-22T08:12:50.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.441+0000 7f4ce084a640 1 -- 172.21.15.165:0/1920636790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc053880 con 0x55b3f7be5b90 2024-09-22T08:12:50.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.442+0000 7f4ce5326800 1 -- 172.21.15.165:0/1920636790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be5b90 msgr2=0x55b3f7be7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.442+0000 7f4ce5326800 1 --2- 172.21.15.165:0/1920636790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be5b90 0x55b3f7be7f80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00a470 tx=0x7f4ccc045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:50.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.442+0000 7f4ce5326800 1 -- 172.21.15.165:0/1920636790 shutdown_connections 2024-09-22T08:12:50.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.442+0000 7f4ce5326800 1 --2- 172.21.15.165:0/1920636790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be5b90 0x55b3f7be7f80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.442+0000 7f4ce5326800 1 -- 172.21.15.165:0/1920636790 >> 172.21.15.165:0/1920636790 conn(0x55b3f7bdbbe0 msgr2=0x55b3f7bde020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.442+0000 7f4ce5326800 1 -- 172.21.15.165:0/1920636790 shutdown_connections 2024-09-22T08:12:50.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.442+0000 7f4ce5326800 1 -- 172.21.15.165:0/1920636790 wait complete. 2024-09-22T08:12:50.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.456+0000 7f4ce5326800 1 Processor -- start 2024-09-22T08:12:50.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.456+0000 7f4ce5326800 1 -- start start 2024-09-22T08:12:50.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.456+0000 7f4ce5326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.456+0000 7f4ce5326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3f7a79dd0 con 0x55b3f7be2080 2024-09-22T08:12:50.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.456+0000 7f4ce104b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.456+0000 7f4ce104b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34190/0 (socket says 172.21.15.165:34190) 2024-09-22T08:12:50.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.456+0000 7f4ce104b640 1 -- 172.21.15.165:0/2905124958 learned_addr learned my addr 172.21.15.165:0/2905124958 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.456+0000 7f4ce104b640 1 -- 172.21.15.165:0/2905124958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3f7cd1650 con 0x55b3f7be2080 2024-09-22T08:12:50.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.457+0000 7f4ce104b640 1 --2- 172.21.15.165:0/2905124958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd1060 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4001df0 tx=0x7f4cd400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c185e09f765d7c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.457+0000 7f4bcf606640 1 -- 172.21.15.165:0/2905124958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cd4012020 con 0x55b3f7be2080 2024-09-22T08:12:50.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.457+0000 7f4bcf606640 1 -- 172.21.15.165:0/2905124958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd400e470 con 0x55b3f7be2080 2024-09-22T08:12:50.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.457+0000 7f4bcf606640 1 -- 172.21.15.165:0/2905124958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cd400e7f0 con 0x55b3f7be2080 2024-09-22T08:12:50.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 -- 172.21.15.165:0/2905124958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 msgr2=0x55b3f7cd1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 --2- 172.21.15.165:0/2905124958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd1060 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4001df0 tx=0x7f4cd400b6c0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 -- 172.21.15.165:0/2905124958 shutdown_connections 2024-09-22T08:12:50.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 --2- 172.21.15.165:0/2905124958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd1060 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 -- 172.21.15.165:0/2905124958 >> 172.21.15.165:0/2905124958 conn(0x55b3f7bdbbe0 msgr2=0x55b3f7ccc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 -- 172.21.15.165:0/2905124958 shutdown_connections 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 -- 172.21.15.165:0/2905124958 wait complete. 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 Processor -- start 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 -- start start 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce5326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3f7be8850 con 0x55b3f7be2080 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce104b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce104b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34204/0 (socket says 172.21.15.165:34204) 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.458+0000 7f4ce104b640 1 -- 172.21.15.165:0/3997712174 learned_addr learned my addr 172.21.15.165:0/3997712174 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.459+0000 7f4ce104b640 1 -- 172.21.15.165:0/3997712174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3f7cd90d0 con 0x55b3f7be2080 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.459+0000 7f4ce104b640 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd8b70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x55b3f7cd1ff0 tx=0x7f4cd4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.459+0000 7f4bcde03640 1 -- 172.21.15.165:0/3997712174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cd4012030 con 0x55b3f7be2080 2024-09-22T08:12:50.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.459+0000 7f4bcde03640 1 -- 172.21.15.165:0/3997712174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd401a6d0 con 0x55b3f7be2080 2024-09-22T08:12:50.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.459+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3f7cd9360 con 0x55b3f7be2080 2024-09-22T08:12:50.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.459+0000 7f4bcde03640 1 -- 172.21.15.165:0/3997712174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cd401a9d0 con 0x55b3f7be2080 2024-09-22T08:12:50.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.459+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3f7cd9d60 con 0x55b3f7be2080 2024-09-22T08:12:50.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.460+0000 7f4bcde03640 1 -- 172.21.15.165:0/3997712174 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4cd4015020 con 0x55b3f7be2080 2024-09-22T08:12:50.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.460+0000 7f4bcde03640 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bc803cfb0 0x7f4bc803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.460+0000 7f4bcde03640 1 -- 172.21.15.165:0/3997712174 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4cd4020030 con 0x55b3f7be2080 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.460+0000 7f4cd884a640 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bc803cfb0 0x7f4bc803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.460+0000 7f4ce5326800 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7be5b90 0x55b3f7ce01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.460+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7ce0700 con 0x55b3f7be5b90 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.461+0000 7f4ce184c640 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7be5b90 0x55b3f7ce01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.461+0000 7f4cd884a640 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bc803cfb0 0x7f4bc803f470 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc057000 tx=0x7f4ccc052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.461+0000 7f4ce184c640 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7be5b90 0x55b3f7ce01c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.461+0000 7f4ce184c640 1 -- 172.21.15.165:0/3997712174 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cdc00a4d0 con 0x55b3f7be5b90 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.461+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7ce0aa0 con 0x55b3f7be5b90 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.461+0000 7f4ce184c640 1 -- 172.21.15.165:0/3997712174 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4cdc00a4d0 con 0x55b3f7be5b90 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.461+0000 7f4ce5326800 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7ce25e0 0x55b3f7ce4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.461+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7ce51e0 con 0x55b3f7ce25e0 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.462+0000 7f4ce104b640 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7ce25e0 0x55b3f7ce4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.462+0000 7f4ce104b640 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7ce25e0 0x55b3f7ce4a50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.462+0000 7f4ce104b640 1 -- 172.21.15.165:0/3997712174 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7ce25e0 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.462+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7ce12f0 con 0x55b3f7be5b90 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.462+0000 7f4ce184c640 1 -- 172.21.15.165:0/3997712174 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4cdc00a4d0 con 0x55b3f7be5b90 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.462+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7ce1710 con 0x55b3f7be5b90 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.463+0000 7f4ce184c640 1 -- 172.21.15.165:0/3997712174 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4cdc00a4d0 con 0x55b3f7be5b90 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.463+0000 7f4ce5326800 1 Processor -- start 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.463+0000 7f4ce5326800 1 -- start start 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.463+0000 7f4ce5326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be1820 0x55b3f7be0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.463+0000 7f4ce5326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3f7ad8d50 con 0x55b3f7be1820 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.463+0000 7f4ce184c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be1820 0x55b3f7be0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.463+0000 7f4ce184c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be1820 0x55b3f7be0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34216/0 (socket says 172.21.15.165:34216) 2024-09-22T08:12:50.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.463+0000 7f4ce184c640 1 -- 172.21.15.165:0/2648779688 learned_addr learned my addr 172.21.15.165:0/2648779688 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.464+0000 7f4ce184c640 1 -- 172.21.15.165:0/2648779688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3f7be1d40 con 0x55b3f7be1820 2024-09-22T08:12:50.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.464+0000 7f4ce184c640 1 --2- 172.21.15.165:0/2648779688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be1820 0x55b3f7be0090 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x55b3f7cd9f30 tx=0x7f4cdc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.464+0000 7f4bc6ffd640 1 -- 172.21.15.165:0/2648779688 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cdc014450 con 0x55b3f7be1820 2024-09-22T08:12:50.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.464+0000 7f4bc6ffd640 1 -- 172.21.15.165:0/2648779688 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cdc014610 con 0x55b3f7be1820 2024-09-22T08:12:50.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.464+0000 7f4ce5326800 1 -- 172.21.15.165:0/2648779688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3f7be05d0 con 0x55b3f7be1820 2024-09-22T08:12:50.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.464+0000 7f4bc6ffd640 1 -- 172.21.15.165:0/2648779688 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cdc014930 con 0x55b3f7be1820 2024-09-22T08:12:50.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.464+0000 7f4ce5326800 1 -- 172.21.15.165:0/2648779688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3f7be0b20 con 0x55b3f7be1820 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.465+0000 7f4bc6ffd640 1 -- 172.21.15.165:0/2648779688 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4cdc011040 con 0x55b3f7be1820 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.465+0000 7f4bc6ffd640 1 --2- 172.21.15.165:0/2648779688 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bb803d000 0x7f4bb803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.465+0000 7f4bc6ffd640 1 -- 172.21.15.165:0/2648779688 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4cdc01e070 con 0x55b3f7be1820 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.465+0000 7f4ce104b640 1 --2- 172.21.15.165:0/2648779688 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bb803d000 0x7f4bb803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.466+0000 7f4ce5326800 1 Processor -- start 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.466+0000 7f4ce104b640 1 --2- 172.21.15.165:0/2648779688 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bb803d000 0x7f4bb803f4c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4052a50 tx=0x7f4cd40011d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.466+0000 7f4ce5326800 1 -- start start 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.466+0000 7f4ce5326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d02bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.466+0000 7f4ce5326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3f7cd1a80 con 0x55b3f7d027b0 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.466+0000 7f4ce184c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d02bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.466+0000 7f4ce184c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d02bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34230/0 (socket says 172.21.15.165:34230) 2024-09-22T08:12:50.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.466+0000 7f4ce184c640 1 -- 172.21.15.165:0/88621616 learned_addr learned my addr 172.21.15.165:0/88621616 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.466+0000 7f4ce184c640 1 -- 172.21.15.165:0/88621616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3f7d031a0 con 0x55b3f7d027b0 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4ce184c640 1 --2- 172.21.15.165:0/88621616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d02bb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc054740 tx=0x7f4cdc02b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414f71ac88236af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4bc4ff9640 1 -- 172.21.15.165:0/88621616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cdc04b070 con 0x55b3f7d027b0 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4bc4ff9640 1 -- 172.21.15.165:0/88621616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cdc051070 con 0x55b3f7d027b0 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4bc4ff9640 1 -- 172.21.15.165:0/88621616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cdc011da0 con 0x55b3f7d027b0 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4ce5326800 1 -- 172.21.15.165:0/88621616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 msgr2=0x55b3f7d02bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4ce5326800 1 --2- 172.21.15.165:0/88621616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d02bb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc054740 tx=0x7f4cdc02b4c0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4ce5326800 1 -- 172.21.15.165:0/88621616 shutdown_connections 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4ce5326800 1 --2- 172.21.15.165:0/88621616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d02bb0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4ce5326800 1 -- 172.21.15.165:0/88621616 >> 172.21.15.165:0/88621616 conn(0x55b3f7cfebb0 msgr2=0x55b3f7cfcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4ce5326800 1 -- 172.21.15.165:0/88621616 shutdown_connections 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.467+0000 7f4ce5326800 1 -- 172.21.15.165:0/88621616 wait complete. 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.468+0000 7f4ce5326800 1 Processor -- start 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.468+0000 7f4ce5326800 1 -- start start 2024-09-22T08:12:50.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.468+0000 7f4ce5326800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d09d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.468+0000 7f4ce5326800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b3f7d037c0 con 0x55b3f7d027b0 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.468+0000 7f4ce184c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d09d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.468+0000 7f4ce184c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d09d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34244/0 (socket says 172.21.15.165:34244) 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.468+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 learned_addr learned my addr 172.21.15.165:0/4010395459 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.468+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3f7d0a2e0 con 0x55b3f7d027b0 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.468+0000 7f4ce184c640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d09d80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc049040 tx=0x7f4cdc0546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.469+0000 7f4bb6ffd640 1 -- 172.21.15.165:0/4010395459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cdc04b040 con 0x55b3f7d027b0 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.469+0000 7f4bb6ffd640 1 -- 172.21.15.165:0/4010395459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cdc011330 con 0x55b3f7d027b0 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.469+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3f7d0a570 con 0x55b3f7d027b0 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.469+0000 7f4bb6ffd640 1 -- 172.21.15.165:0/4010395459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cdc054a60 con 0x55b3f7d027b0 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.469+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3f7d0aef0 con 0x55b3f7d027b0 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.469+0000 7f4bb6ffd640 1 -- 172.21.15.165:0/4010395459 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4cdc054c20 con 0x55b3f7d027b0 2024-09-22T08:12:50.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.470+0000 7f4bb6ffd640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bac03cfb0 0x7f4bac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.470+0000 7f4bb6ffd640 1 -- 172.21.15.165:0/4010395459 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4cdc00e040 con 0x55b3f7d027b0 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.470+0000 7f4ce104b640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bac03cfb0 0x7f4bac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.470+0000 7f4ce104b640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bac03cfb0 0x7f4bac03f470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4052e10 tx=0x7f4cd4051000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.470+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.470+0000 7f4ce5326800 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7d158d0 0x55b3f7d17d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.470+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d184e0 con 0x55b3f7d158d0 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.470+0000 7f4cd884a640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7d158d0 0x55b3f7d17d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4cd884a640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7d158d0 0x55b3f7d17d90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 20 realm 2024-09-22T08:12:50.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d18910 con 0x55b3f7d158d0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d191e0 con 0x55b3f7d158d0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.471+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d19580 con 0x55b3f7d158d0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce5326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce5326800 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7d1a2e0 0x55b3f7d1c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d1cce0 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce184c640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7d1a2e0 0x55b3f7d1c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce184c640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7d1a2e0 0x55b3f7d1c6d0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4cdc02a070 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce5326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:50.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce5326800 20 searching for the correct realm 2024-09-22T08:12:50.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce5326800 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3f7d1ec90 0x55b3f7d21150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1ec90 2024-09-22T08:12:50.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.472+0000 7f4ce104b640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3f7d1ec90 0x55b3f7d21150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.473+0000 7f4ce104b640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3f7d1ec90 0x55b3f7d21150 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.473+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.473+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.473+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4cdc02a070 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.473+0000 7f4ce184c640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4cdc037070 0x7f4cdc028830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.473+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x7f4cdc037070 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.473+0000 7f4cd884a640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4cdc037070 0x7f4cdc028830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.474+0000 7f4cd884a640 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4cdc037070 0x7f4cdc028830 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.474+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.474+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d158d0 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.474+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.474+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d158d0 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.475+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.475+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x7f4cdc037070 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.475+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.475+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.475+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cdc02a070 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.475+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.475+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.475+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1ec90 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.476+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.476+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d158d0 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.476+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.476+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x7f4cdc037070 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.476+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.476+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d158d0 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.476+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.476+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.477+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.477+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1ec90 2024-09-22T08:12:50.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.477+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.477+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1ec90 2024-09-22T08:12:50.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.477+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.477+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x7f4cdc037070 2024-09-22T08:12:50.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.477+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.477+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1ec90 2024-09-22T08:12:50.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.478+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.478+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1ec90 2024-09-22T08:12:50.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.478+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.478+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d158d0 2024-09-22T08:12:50.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.478+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.478+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d158d0 2024-09-22T08:12:50.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.478+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.478+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x7f4cdc037070 2024-09-22T08:12:50.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.478+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.478+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1ec90 2024-09-22T08:12:50.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.479+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.479+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.479+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.479+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d158d0 2024-09-22T08:12:50.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.479+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.479+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x7f4cdc037070 2024-09-22T08:12:50.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.480+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.480+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1ec90 2024-09-22T08:12:50.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.480+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.480+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x7f4cdc037070 2024-09-22T08:12:50.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.480+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.480+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.481+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.481+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1ec90 2024-09-22T08:12:50.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.481+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.481+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x7f4cdc037070 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.481+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.481+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d158d0 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.481+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d217d0 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d1d6a0 con 0x55b3f7d158d0 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d1df40 con 0x55b3f7d158d0 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d1d2e0 con 0x55b3f7d158d0 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 zone default found 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 4 Realm: () 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:50.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 zonegroup default 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.482+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d22100 con 0x7f4cdc037070 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d23e50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d24300 con 0x55b3f7d1ec90 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 20 started sync module instance, tier type = 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.483+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d22c20 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.484+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.485+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94231445254160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d22880 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.485+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d25230 con 0x55b3f7d158d0 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.486+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94231445254160] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.486+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.486+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94231445260128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d25230 con 0x55b3f7d158d0 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.486+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d25c30 con 0x55b3f7d1ec90 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.487+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.487+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94231445264192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d26500 con 0x55b3f7d1ec90 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.487+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94231445260128] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.487+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d24d80 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.488+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94231445264192] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.488+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.488+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94231445261696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d26fa0 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.488+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d27960 con 0x55b3f7d158d0 2024-09-22T08:12:50.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.489+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94231445261696] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.490+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.490+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94231445269712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d27960 con 0x55b3f7d158d0 2024-09-22T08:12:50.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.490+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d28320 con 0x7f4cdc037070 2024-09-22T08:12:50.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.491+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94231445269712] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.491+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.491+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94231445274704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d27960 con 0x7f4cdc037070 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.491+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d28d30 con 0x7f4cdc037070 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.492+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94231445274704] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.492+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.492+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94231445271728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d28f10 con 0x7f4cdc037070 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.492+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d29760 con 0x7f4cdc037070 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.493+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94231445271728] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.493+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.493+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94231445277760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d29570 con 0x7f4cdc037070 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.493+0000 7f4ce5326800 20 add_watcher() i=0 2024-09-22T08:12:50.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.493+0000 7f4ce5326800 20 add_watcher() i=1 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.493+0000 7f4ce5326800 20 add_watcher() i=2 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.493+0000 7f4ce5326800 20 add_watcher() i=3 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.493+0000 7f4ce5326800 20 add_watcher() i=4 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.493+0000 7f4ce5326800 20 add_watcher() i=5 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.493+0000 7f4ce5326800 20 add_watcher() i=6 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.494+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94231445277760] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.494+0000 7f4ce5326800 20 add_watcher() i=7 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.494+0000 7f4ce5326800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.494+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d2cbe0 con 0x55b3f7d158d0 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.495+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.495+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94231445278816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d29f60 con 0x55b3f7d158d0 2024-09-22T08:12:50.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94231445278816] v34'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4b97fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4ce5326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4ce5326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4ce5326800 5 note: GC not initialized 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4b96fe5640 20 reqs_thread_entry: start 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4ce5326800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4ce5326800 20 Filter name: none 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4b94fe1640 20 reqs_thread_entry: start 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4ce5326800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4ce5326800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.496+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d5ff40 con 0x7f4cdc037070 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.497+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.497+0000 7f4ce5326800 20 rados_obj.operate() r=0 bl.length=473 2024-09-22T08:12:50.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.497+0000 7f4ce5326800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.497+0000 7f4ce5326800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.497+0000 7f4ce5326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.497+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d66830 con 0x7f4cdc037070 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4ce5326800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4ce5326800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4ce5326800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94231445529136 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d61f10 con 0x55b3f7d158d0 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== watch-notify(notify (1) cookie 94231445269712 notify 146028888097 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55b3f7be9560 con 0x55b3f7d158d0 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4bc4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94231445269712 notifier 4836 bl.length()=636 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4bc4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4bc4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:50.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4bc4ff9640 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4ba4003ea0 con 0x55b3f7d158d0 2024-09-22T08:12:50.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.498+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 notify.4 [notify cookie 94231445529136 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.499+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.499+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify_complete (2) cookie 94231445529136 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4ccc05fd90 con 0x55b3f7d158d0 2024-09-22T08:12:50.511 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:12:50.302079Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.302069Z","tags":[],"group_ids":[]} 2024-09-22T08:12:50.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.499+0000 7f4b97fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:50.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.500+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94231445278816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d5dc30 con 0x55b3f7d158d0 2024-09-22T08:12:50.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.500+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94231445278816] v34'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.500+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94231445254160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d5dc30 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.502+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94231445254160] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.502+0000 7f4ce5326800 20 remove_watcher() i=0 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.502+0000 7f4ce5326800 2 removed watcher, disabling cache 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.502+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94231445260128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d5dc30 con 0x55b3f7d158d0 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.503+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94231445260128] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.503+0000 7f4ce5326800 20 remove_watcher() i=1 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.503+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94231445264192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d5dc30 con 0x55b3f7d1ec90 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.504+0000 7f4ce104b640 1 -- 172.21.15.165:0/4010395459 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94231445264192] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd401ad50 con 0x55b3f7d1ec90 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.504+0000 7f4ce5326800 20 remove_watcher() i=2 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.504+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94231445261696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d23010 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.505+0000 7f4ce184c640 1 -- 172.21.15.165:0/4010395459 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94231445261696] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cdc063040 con 0x55b3f7d1a2e0 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.505+0000 7f4ce5326800 20 remove_watcher() i=3 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.505+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94231445269712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d24d80 con 0x55b3f7d158d0 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.506+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94231445269712] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x55b3f7d158d0 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.506+0000 7f4ce5326800 20 remove_watcher() i=4 2024-09-22T08:12:50.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.506+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94231445274704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d23010 con 0x7f4cdc037070 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.507+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94231445274704] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.507+0000 7f4ce5326800 20 remove_watcher() i=5 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.507+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94231445271728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d28050 con 0x7f4cdc037070 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.508+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94231445271728] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.508+0000 7f4ce5326800 20 remove_watcher() i=6 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.508+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94231445277760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b3f7d23010 con 0x7f4cdc037070 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.509+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94231445277760] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc051070 con 0x7f4cdc037070 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.509+0000 7f4ce5326800 20 remove_watcher() i=7 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4cdc037070 msgr2=0x7f4cdc028830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f4cdc037070 0x7f4cdc028830 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7d158d0 msgr2=0x55b3f7d17d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7d158d0 0x55b3f7d17d90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7d1a2e0 msgr2=0x55b3f7d1c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7d1a2e0 0x55b3f7d1c6d0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3f7d1ec90 msgr2=0x55b3f7d21150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b3f7d1ec90 0x55b3f7d21150 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bac03cfb0 msgr2=0x7f4bac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bac03cfb0 0x7f4bac03f470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4052e10 tx=0x7f4cd4051000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 msgr2=0x55b3f7d09d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4cd884a640 1 -- 172.21.15.165:0/4010395459 reap_dead start 2024-09-22T08:12:50.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d09d80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc049040 tx=0x7f4cdc0546a0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 shutdown_connections 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/4010395459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7d027b0 0x55b3f7d09d80 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 >> 172.21.15.165:0/4010395459 conn(0x55b3f7cfebb0 msgr2=0x55b3f7cfcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 shutdown_connections 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/4010395459 wait complete. 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/2648779688 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bb803d000 msgr2=0x7f4bb803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/2648779688 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bb803d000 0x7f4bb803f4c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4052a50 tx=0x7f4cd40011d0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/2648779688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be1820 msgr2=0x55b3f7be0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/2648779688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be1820 0x55b3f7be0090 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x55b3f7cd9f30 tx=0x7f4cdc018830 comp rx=0 tx=0).stop 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/2648779688 shutdown_connections 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/2648779688 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bb803d000 0x7f4bb803f4c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 --2- 172.21.15.165:0/2648779688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be1820 0x55b3f7be0090 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/2648779688 >> 172.21.15.165:0/2648779688 conn(0x55b3f7ce7f20 msgr2=0x55b3f7ce8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/2648779688 shutdown_connections 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.510+0000 7f4ce5326800 1 -- 172.21.15.165:0/2648779688 wait complete. 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7be5b90 msgr2=0x55b3f7ce01c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7be5b90 0x55b3f7ce01c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7ce25e0 msgr2=0x55b3f7ce4a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7ce25e0 0x55b3f7ce4a50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bc803cfb0 msgr2=0x7f4bc803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bc803cfb0 0x7f4bc803f470 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc057000 tx=0x7f4ccc052000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 msgr2=0x55b3f7cd8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd8b70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x55b3f7cd1ff0 tx=0x7f4cd4000bc0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 shutdown_connections 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b3f7ce25e0 0x55b3f7ce4a50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b3f7be5b90 0x55b3f7ce01c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4bc803cfb0 0x7f4bc803f470 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 --2- 172.21.15.165:0/3997712174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b3f7be2080 0x55b3f7cd8b70 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 >> 172.21.15.165:0/3997712174 conn(0x55b3f7bdbbe0 msgr2=0x55b3f7cd2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 shutdown_connections 2024-09-22T08:12:50.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.511+0000 7f4ce5326800 1 -- 172.21.15.165:0/3997712174 wait complete. 2024-09-22T08:12:50.523 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:50.524 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:50.524 ERROR:root:0 2024-09-22T08:12:50.524 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-22T08:12:50.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-22T08:12:50.524 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-22T08:12:50.578 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:50.578 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.578+0000 7f1c54126800 1 Processor -- start 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.578+0000 7f1c54126800 1 -- start start 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.578+0000 7f1c54126800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55da4f1a1830 0x55da4f1a2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.578+0000 7f1c54126800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55da4f02da20 con 0x55da4f1a2a70 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.578+0000 7f1c54126800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55da4f02d7d0 con 0x55da4f1a1830 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.579+0000 7f1c4fd09640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55da4f1a1830 0x55da4f1a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.579+0000 7f1c4f508640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55da4f1a2a70 0x55da4f1a75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57800/0 (socket says 172.21.15.165:57800) 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.579+0000 7f1c4fd09640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55da4f1a1830 0x55da4f1a2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34256/0 (socket says 172.21.15.165:34256) 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.579+0000 7f1c4f508640 1 -- 172.21.15.165:0/1954053829 learned_addr learned my addr 172.21.15.165:0/1954053829 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.579+0000 7f1c4fd09640 1 -- 172.21.15.165:0/1954053829 >> v1:172.21.15.53:6789/0 conn(0x55da4f1a2a70 legacy=0x55da4f1a75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.579+0000 7f1c4fd09640 1 -- 172.21.15.165:0/1954053829 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4f1a1f30 con 0x55da4f1a1830 2024-09-22T08:12:50.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.581+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/1954053829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f1a2530 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000a470 tx=0x7f1c40045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451681a77cdb7e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.581+0000 7f1c4ed07640 1 -- 172.21.15.165:0/1954053829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c40053570 con 0x55da4f1a1830 2024-09-22T08:12:50.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.581+0000 7f1c4ed07640 1 -- 172.21.15.165:0/1954053829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c40058070 con 0x55da4f1a1830 2024-09-22T08:12:50.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.581+0000 7f1c4ed07640 1 -- 172.21.15.165:0/1954053829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c40053880 con 0x55da4f1a1830 2024-09-22T08:12:50.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.582+0000 7f1c54126800 1 -- 172.21.15.165:0/1954053829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 msgr2=0x55da4f1a2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.582+0000 7f1c54126800 1 --2- 172.21.15.165:0/1954053829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f1a2530 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000a470 tx=0x7f1c40045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:50.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.582+0000 7f1c54126800 1 -- 172.21.15.165:0/1954053829 shutdown_connections 2024-09-22T08:12:50.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.582+0000 7f1c54126800 1 --2- 172.21.15.165:0/1954053829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f1a2530 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.582+0000 7f1c54126800 1 -- 172.21.15.165:0/1954053829 >> 172.21.15.165:0/1954053829 conn(0x55da4f19cc00 msgr2=0x55da4f19f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.582+0000 7f1c54126800 1 -- 172.21.15.165:0/1954053829 shutdown_connections 2024-09-22T08:12:50.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.582+0000 7f1c54126800 1 -- 172.21.15.165:0/1954053829 wait complete. 2024-09-22T08:12:50.608 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.596+0000 7f1c54126800 1 Processor -- start 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.596+0000 7f1c54126800 1 -- start start 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.596+0000 7f1c54126800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f292080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.596+0000 7f1c54126800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55da4f03add0 con 0x55da4f1a1830 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.596+0000 7f1c4fd09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f292080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.596+0000 7f1c4fd09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f292080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34272/0 (socket says 172.21.15.165:34272) 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.596+0000 7f1c4fd09640 1 -- 172.21.15.165:0/3252044944 learned_addr learned my addr 172.21.15.165:0/3252044944 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.597+0000 7f1c4fd09640 1 -- 172.21.15.165:0/3252044944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4f292670 con 0x55da4f1a1830 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.597+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/3252044944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f292080 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1c40025c20 tx=0x7f1c40051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71942e6fa8ce87d server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.597+0000 7f1b3de0b640 1 -- 172.21.15.165:0/3252044944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c40053570 con 0x55da4f1a1830 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.597+0000 7f1b3de0b640 1 -- 172.21.15.165:0/3252044944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c40063070 con 0x55da4f1a1830 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.597+0000 7f1b3de0b640 1 -- 172.21.15.165:0/3252044944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c40053840 con 0x55da4f1a1830 2024-09-22T08:12:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 -- 172.21.15.165:0/3252044944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 msgr2=0x55da4f292080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 --2- 172.21.15.165:0/3252044944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f292080 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1c40025c20 tx=0x7f1c40051000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 -- 172.21.15.165:0/3252044944 shutdown_connections 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 --2- 172.21.15.165:0/3252044944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f292080 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 -- 172.21.15.165:0/3252044944 >> 172.21.15.165:0/3252044944 conn(0x55da4f19cc00 msgr2=0x55da4f290440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 -- 172.21.15.165:0/3252044944 shutdown_connections 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 -- 172.21.15.165:0/3252044944 wait complete. 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 Processor -- start 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 -- start start 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f299a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.598+0000 7f1c54126800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55da4f1a32e0 con 0x55da4f1a1830 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.599+0000 7f1c4fd09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f299a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.599+0000 7f1c4fd09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f299a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34282/0 (socket says 172.21.15.165:34282) 2024-09-22T08:12:50.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.599+0000 7f1c4fd09640 1 -- 172.21.15.165:0/269239225 learned_addr learned my addr 172.21.15.165:0/269239225 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.599+0000 7f1c4fd09640 1 -- 172.21.15.165:0/269239225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4f299fd0 con 0x55da4f1a1830 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.599+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f299a70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1c40053d60 tx=0x7f1c40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.599+0000 7f1b37fff640 1 -- 172.21.15.165:0/269239225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c40068470 con 0x55da4f1a1830 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.599+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da4f29a260 con 0x55da4f1a1830 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.600+0000 7f1b37fff640 1 -- 172.21.15.165:0/269239225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c40068610 con 0x55da4f1a1830 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.600+0000 7f1b37fff640 1 -- 172.21.15.165:0/269239225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c400688f0 con 0x55da4f1a1830 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.600+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da4f29ac60 con 0x55da4f1a1830 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.600+0000 7f1b37fff640 1 -- 172.21.15.165:0/269239225 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1c40068a90 con 0x55da4f1a1830 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.601+0000 7f1b37fff640 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b3803cfb0 0x7f1b3803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.601+0000 7f1b37fff640 1 -- 172.21.15.165:0/269239225 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1c40098ab0 con 0x55da4f1a1830 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.601+0000 7f1c4f508640 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b3803cfb0 0x7f1b3803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.601+0000 7f1c54126800 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f1a2a70 0x55da4f2a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.601+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f29b840 con 0x55da4f1a2a70 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.601+0000 7f1c5050a640 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f1a2a70 0x55da4f2a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.601+0000 7f1c4f508640 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b3803cfb0 0x7f1b3803f470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1c44004170 tx=0x7f1c44001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.601+0000 7f1c5050a640 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f1a2a70 0x55da4f2a10c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.602+0000 7f1c5050a640 1 -- 172.21.15.165:0/269239225 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c4800a4d0 con 0x55da4f1a2a70 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.602+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2a1b00 con 0x55da4f1a2a70 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.602+0000 7f1c5050a640 1 -- 172.21.15.165:0/269239225 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c4800a4d0 con 0x55da4f1a2a70 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.602+0000 7f1c54126800 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2a3410 0x55da4f2a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.602+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2a6040 con 0x55da4f2a3410 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.602+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2a3410 0x55da4f2a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.602+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2a3410 0x55da4f2a58b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.603+0000 7f1c4fd09640 1 -- 172.21.15.165:0/269239225 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c40079020 con 0x55da4f2a3410 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.603+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2a2350 con 0x55da4f1a2a70 2024-09-22T08:12:50.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.603+0000 7f1c5050a640 1 -- 172.21.15.165:0/269239225 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c4800a4d0 con 0x55da4f1a2a70 2024-09-22T08:12:50.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.603+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2a26f0 con 0x55da4f1a2a70 2024-09-22T08:12:50.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.603+0000 7f1c5050a640 1 -- 172.21.15.165:0/269239225 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c4800a4d0 con 0x55da4f1a2a70 2024-09-22T08:12:50.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.603+0000 7f1c54126800 1 Processor -- start 2024-09-22T08:12:50.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.603+0000 7f1c54126800 1 -- start start 2024-09-22T08:12:50.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.604+0000 7f1c54126800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2b4910 0x55da4f2b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.604+0000 7f1c54126800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55da4f099d50 con 0x55da4f2b4910 2024-09-22T08:12:50.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.604+0000 7f1c5050a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2b4910 0x55da4f2b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.604+0000 7f1c5050a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2b4910 0x55da4f2b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34290/0 (socket says 172.21.15.165:34290) 2024-09-22T08:12:50.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.604+0000 7f1c5050a640 1 -- 172.21.15.165:0/1664711146 learned_addr learned my addr 172.21.15.165:0/1664711146 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.604+0000 7f1c5050a640 1 -- 172.21.15.165:0/1664711146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4f2b5370 con 0x55da4f2b4910 2024-09-22T08:12:50.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.604+0000 7f1c5050a640 1 --2- 172.21.15.165:0/1664711146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2b4910 0x55da4f2b4d30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55da4f29a900 tx=0x7f1c48018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.605+0000 7f1b357fa640 1 -- 172.21.15.165:0/1664711146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c480180d0 con 0x55da4f2b4910 2024-09-22T08:12:50.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.605+0000 7f1b357fa640 1 -- 172.21.15.165:0/1664711146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c48018290 con 0x55da4f2b4910 2024-09-22T08:12:50.614 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.605+0000 7f1b357fa640 1 -- 172.21.15.165:0/1664711146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c48014450 con 0x55da4f2b4910 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.605+0000 7f1c54126800 1 -- 172.21.15.165:0/1664711146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da4f2b5ba0 con 0x55da4f2b4910 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.605+0000 7f1c54126800 1 -- 172.21.15.165:0/1664711146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da4f2b6140 con 0x55da4f2b4910 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.605+0000 7f1b357fa640 1 -- 172.21.15.165:0/1664711146 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1c48011040 con 0x55da4f2b4910 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1b357fa640 1 --2- 172.21.15.165:0/1664711146 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b2803cfb0 0x7f1b2803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1b357fa640 1 -- 172.21.15.165:0/1664711146 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1c4801e070 con 0x55da4f2b4910 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/1664711146 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b2803cfb0 0x7f1b2803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1c54126800 1 Processor -- start 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/1664711146 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b2803cfb0 0x7f1b2803f470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1c40052ad0 tx=0x7f1c40096d10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1c54126800 1 -- start start 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1c54126800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1c54126800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55da4f292a40 con 0x55da4f2c1390 2024-09-22T08:12:50.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1c5050a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1c5050a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34304/0 (socket says 172.21.15.165:34304) 2024-09-22T08:12:50.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.606+0000 7f1c5050a640 1 -- 172.21.15.165:0/3367634547 learned_addr learned my addr 172.21.15.165:0/3367634547 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1c5050a640 1 -- 172.21.15.165:0/3367634547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4f2c1d80 con 0x55da4f2c1390 2024-09-22T08:12:50.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1c5050a640 1 --2- 172.21.15.165:0/3367634547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c1790 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1c480164f0 tx=0x7f1c480165e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84a73187e6e2c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1b2effd640 1 -- 172.21.15.165:0/3367634547 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c4802ba60 con 0x55da4f2c1390 2024-09-22T08:12:50.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1b2effd640 1 -- 172.21.15.165:0/3367634547 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4804b070 con 0x55da4f2c1390 2024-09-22T08:12:50.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1b2effd640 1 -- 172.21.15.165:0/3367634547 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c4802bd30 con 0x55da4f2c1390 2024-09-22T08:12:50.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1c54126800 1 -- 172.21.15.165:0/3367634547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 msgr2=0x55da4f2c1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1c54126800 1 --2- 172.21.15.165:0/3367634547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c1790 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1c480164f0 tx=0x7f1c480165e0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1c54126800 1 -- 172.21.15.165:0/3367634547 shutdown_connections 2024-09-22T08:12:50.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1c54126800 1 --2- 172.21.15.165:0/3367634547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c1790 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1c54126800 1 -- 172.21.15.165:0/3367634547 >> 172.21.15.165:0/3367634547 conn(0x55da4f2bd7b0 msgr2=0x55da4f2bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1c54126800 1 -- 172.21.15.165:0/3367634547 shutdown_connections 2024-09-22T08:12:50.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.607+0000 7f1c54126800 1 -- 172.21.15.165:0/3367634547 wait complete. 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.608+0000 7f1c54126800 1 Processor -- start 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.608+0000 7f1c54126800 1 -- start start 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.608+0000 7f1c54126800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.608+0000 7f1c54126800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55da4f2c23a0 con 0x55da4f2c1390 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.608+0000 7f1c5050a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.608+0000 7f1c5050a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34312/0 (socket says 172.21.15.165:34312) 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.608+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 learned_addr learned my addr 172.21.15.165:0/735696238 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.608+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4f2c8f10 con 0x55da4f2c1390 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.609+0000 7f1c5050a640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c89b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1c480117d0 tx=0x7f1c48054290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.609+0000 7f1b2d7fa640 1 -- 172.21.15.165:0/735696238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c4802b480 con 0x55da4f2c1390 2024-09-22T08:12:50.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.609+0000 7f1b2d7fa640 1 -- 172.21.15.165:0/735696238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4802b620 con 0x55da4f2c1390 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.609+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da4f2c91a0 con 0x55da4f2c1390 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.609+0000 7f1b2d7fa640 1 -- 172.21.15.165:0/735696238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c48014640 con 0x55da4f2c1390 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.609+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da4f2c9b20 con 0x55da4f2c1390 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.610+0000 7f1b2d7fa640 1 -- 172.21.15.165:0/735696238 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1c480148f0 con 0x55da4f2c1390 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.610+0000 7f1b2d7fa640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b1803cfb0 0x7f1b1803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.610+0000 7f1b2d7fa640 1 -- 172.21.15.165:0/735696238 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1c48034070 con 0x55da4f2c1390 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.610+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b1803cfb0 0x7f1b1803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.610+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b1803cfb0 0x7f1b1803f470 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1c400970a0 tx=0x7f1c40088000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.610+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.610+0000 7f1c54126800 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f2d4450 0x55da4f2d6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.610+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2d7060 con 0x55da4f2d4450 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.610+0000 7f1c4f508640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f2d4450 0x55da4f2d6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c4f508640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f2d4450 0x55da4f2d6910 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c44009050 con 0x55da4f2d4450 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 20 realm 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2d37a0 con 0x55da4f2d4450 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c44009050 con 0x55da4f2d4450 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2d7b50 con 0x55da4f2d4450 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c44009050 con 0x55da4f2d4450 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.611+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2d8420 con 0x55da4f2d4450 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c44009050 con 0x55da4f2d4450 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c54126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c54126800 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2d8e40 0x55da4f2db230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2db900 con 0x55da4f2d8e40 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c5050a640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2d8e40 0x55da4f2db230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c5050a640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2d8e40 0x55da4f2db230 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c4803e020 con 0x55da4f2d8e40 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c54126800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c54126800 20 searching for the correct realm 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c54126800 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55da4f2dd8d0 0x55da4f2dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2dd8d0 2024-09-22T08:12:50.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.612+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55da4f2dd8d0 0x55da4f2dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.613+0000 7f1c4fd09640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55da4f2dd8d0 0x55da4f2dfd90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.613+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.613+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d8e40 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.613+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1c4803e020 con 0x55da4f2d8e40 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.613+0000 7f1c5050a640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1c48014070 0x7f1c4802c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.613+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x7f1c48014070 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.613+0000 7f1c4f508640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1c48014070 0x7f1c4802c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.614+0000 7f1c4f508640 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1c48014070 0x7f1c4802c3e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.614+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44009050 con 0x7f1c48014070 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.614+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d4450 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.614+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44009050 con 0x55da4f2d4450 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.614+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d4450 2024-09-22T08:12:50.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.615+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.615+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x7f1c48014070 2024-09-22T08:12:50.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.615+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.615+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d8e40 2024-09-22T08:12:50.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.615+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c4803e020 con 0x55da4f2d8e40 2024-09-22T08:12:50.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.615+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d8e40 2024-09-22T08:12:50.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.615+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c4803e020 con 0x55da4f2d8e40 2024-09-22T08:12:50.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.615+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2dd8d0 2024-09-22T08:12:50.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.616+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.616+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d4450 2024-09-22T08:12:50.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.616+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.616+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x7f1c48014070 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.616+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.616+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d4450 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.616+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.616+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d8e40 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.617+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.617+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2dd8d0 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.617+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.617+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2dd8d0 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.617+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.617+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x7f1c48014070 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.617+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.617+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2dd8d0 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.618+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.618+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2dd8d0 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.618+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.618+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d4450 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.618+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.618+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d4450 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.618+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.618+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x7f1c48014070 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.619+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.619+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2dd8d0 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.619+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.619+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d8e40 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.619+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.619+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d4450 2024-09-22T08:12:50.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.619+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.619+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x7f1c48014070 2024-09-22T08:12:50.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.620+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.620+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2dd8d0 2024-09-22T08:12:50.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.620+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.620+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x7f1c48014070 2024-09-22T08:12:50.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.620+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.620+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d8e40 2024-09-22T08:12:50.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.620+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.642 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.620+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2dd8d0 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x7f1c48014070 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d4450 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0460 con 0x55da4f2d8e40 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c54126800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c54126800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c54126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c54126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:50.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c54126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c54126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.621+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2dc2c0 con 0x55da4f2d4450 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2dcb60 con 0x55da4f2d4450 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e08e0 con 0x55da4f2d4450 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.644 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 20 zone default found 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 4 Realm: () 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 20 zonegroup default 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e0c80 con 0x7f1c48014070 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.622+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e2ab0 con 0x55da4f2dd8d0 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.623+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.623+0000 7f1c54126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.623+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.623+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e2f40 con 0x55da4f2dd8d0 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.623+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.623+0000 7f1c54126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.623+0000 7f1c54126800 20 started sync module instance, tier type = 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.623+0000 7f1c54126800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.623+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e1f20 con 0x55da4f2d8e40 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.624+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.624+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94396119655184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e3850 con 0x55da4f2d8e40 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.624+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e40a0 con 0x55da4f2d4450 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.625+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94396119655184] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.625+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.625+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94396119659424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e3d70 con 0x55da4f2d4450 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.625+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e4890 con 0x55da4f2dd8d0 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.626+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94396119659424] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.627+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.627+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94396119663456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e4c80 con 0x55da4f2dd8d0 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.627+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e56d0 con 0x55da4f2d8e40 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.628+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.628+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94396119667136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e56d0 con 0x55da4f2d8e40 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.628+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94396119663456] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.628+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e66b0 con 0x55da4f2d4450 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.629+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94396119667136] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.629+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.629+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94396119660560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e61c0 con 0x55da4f2d4450 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.629+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e6bc0 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.630+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.630+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94396119660560] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.630+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94396119672528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e6b30 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.630+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e5ae0 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.631+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.631+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94396119676544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e5ae0 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.631+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e8570 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.631+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94396119672528] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.632+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94396119676544] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.632+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.632+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94396119677600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e80c0 con 0x7f1c48014070 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.632+0000 7f1c54126800 20 add_watcher() i=0 2024-09-22T08:12:50.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.632+0000 7f1c54126800 20 add_watcher() i=1 2024-09-22T08:12:50.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.632+0000 7f1c54126800 20 add_watcher() i=2 2024-09-22T08:12:50.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.632+0000 7f1c54126800 20 add_watcher() i=3 2024-09-22T08:12:50.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.632+0000 7f1c54126800 20 add_watcher() i=4 2024-09-22T08:12:50.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.632+0000 7f1c54126800 20 add_watcher() i=5 2024-09-22T08:12:50.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.632+0000 7f1c54126800 20 add_watcher() i=6 2024-09-22T08:12:50.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.633+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94396119677600] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.633+0000 7f1c54126800 20 add_watcher() i=7 2024-09-22T08:12:50.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.633+0000 7f1c54126800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:50.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.633+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2eb5a0 con 0x55da4f2d4450 2024-09-22T08:12:50.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.634+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.634+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94396119679168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f2e8a60 con 0x55da4f2d4450 2024-09-22T08:12:50.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94396119679168] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1b05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:50.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1c54126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1c54126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1c54126800 5 note: GC not initialized 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1b04fe1640 20 reqs_thread_entry: start 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1c54126800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1c54126800 20 Filter name: none 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1a7e7fc640 20 reqs_thread_entry: start 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1c54126800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.635+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31e970 con 0x7f1c48014070 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-22T08:12:50.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31cef0 con 0x55da4f2dd8d0 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.636+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31d7c0 con 0x7f1c48014070 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.637+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'9 uv9 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.637+0000 7f1c54126800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-22T08:12:50.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.637+0000 7f1c54126800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.637+0000 7f1c54126800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.637+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94396119896848 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f322410 con 0x55da4f2d8e40 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.638+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== watch-notify(notify (1) cookie 94396119655184 notify 146028888087 ret 0) ==== 575+0+0 (crc 0 0 0) 0x55da4f2c9b20 con 0x55da4f2d8e40 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.638+0000 7f1b2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94396119655184 notifier 4843 bl.length()=533 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.638+0000 7f1b2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.638+0000 7f1b2effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.638+0000 7f1b2effd640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1b14003ea0 con 0x55da4f2d8e40 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.638+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(65 notify.0 [notify cookie 94396119896848 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.638+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.638+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== watch-notify(notify_complete (2) cookie 94396119896848 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55da4f2c91a0 con 0x55da4f2d8e40 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.638+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31d310 con 0x55da4f2dd8d0 2024-09-22T08:12:50.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.639+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.639+0000 7f1c54126800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-22T08:12:50.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.639+0000 7f1c54126800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-22T08:12:50.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.639+0000 7f1c54126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-22T08:12:50.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.639+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94396119896848 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55da4f322410 con 0x55da4f2d4450 2024-09-22T08:12:50.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.639+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== watch-notify(notify (1) cookie 94396119659424 notify 146028888098 ret 0) ==== 218+0+0 (crc 0 0 0) 0x55da4f31db60 con 0x55da4f2d4450 2024-09-22T08:12:50.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.639+0000 7f1b2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94396119659424 notifier 4843 bl.length()=176 2024-09-22T08:12:50.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.639+0000 7f1b2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-22T08:12:50.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.639+0000 7f1b2e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-22T08:12:50.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.640+0000 7f1b2e7fc640 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1a84003400 con 0x55da4f2d4450 2024-09-22T08:12:50.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.640+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(68 notify.1 [notify cookie 94396119896848 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.640+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.640+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify_complete (2) cookie 94396119896848 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55da4f31e2c0 con 0x55da4f2d4450 2024-09-22T08:12:50.661 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-22T08:12:50.637296Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.637285Z","tags":[],"group_ids":[]} 2024-09-22T08:12:50.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.641+0000 7f1b05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:50.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.641+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94396119679168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31c6a0 con 0x55da4f2d4450 2024-09-22T08:12:50.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.642+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94396119679168] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.642+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94396119655184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31c6a0 con 0x55da4f2d8e40 2024-09-22T08:12:50.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.643+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94396119655184] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.643+0000 7f1c54126800 20 remove_watcher() i=0 2024-09-22T08:12:50.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.643+0000 7f1c54126800 2 removed watcher, disabling cache 2024-09-22T08:12:50.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.643+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94396119659424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31c6a0 con 0x55da4f2d4450 2024-09-22T08:12:50.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.644+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94396119659424] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.644+0000 7f1c54126800 20 remove_watcher() i=1 2024-09-22T08:12:50.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.644+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94396119663456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31c6a0 con 0x55da4f2dd8d0 2024-09-22T08:12:50.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.645+0000 7f1c4fd09640 1 -- 172.21.15.165:0/735696238 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94396119663456] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c400a2040 con 0x55da4f2dd8d0 2024-09-22T08:12:50.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.645+0000 7f1c54126800 20 remove_watcher() i=2 2024-09-22T08:12:50.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.645+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94396119667136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31c6a0 con 0x55da4f2d8e40 2024-09-22T08:12:50.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.646+0000 7f1c5050a640 1 -- 172.21.15.165:0/735696238 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94396119667136] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48067060 con 0x55da4f2d8e40 2024-09-22T08:12:50.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.646+0000 7f1c54126800 20 remove_watcher() i=3 2024-09-22T08:12:50.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.646+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94396119660560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31c6a0 con 0x55da4f2d4450 2024-09-22T08:12:50.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.647+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94396119660560] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x55da4f2d4450 2024-09-22T08:12:50.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.647+0000 7f1c54126800 20 remove_watcher() i=4 2024-09-22T08:12:50.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.647+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94396119672528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31c6a0 con 0x7f1c48014070 2024-09-22T08:12:50.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.649+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94396119672528] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.649+0000 7f1c54126800 20 remove_watcher() i=5 2024-09-22T08:12:50.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.649+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94396119676544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31c6a0 con 0x7f1c48014070 2024-09-22T08:12:50.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.650+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94396119676544] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.650+0000 7f1c54126800 20 remove_watcher() i=6 2024-09-22T08:12:50.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.650+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94396119677600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55da4f31c6a0 con 0x7f1c48014070 2024-09-22T08:12:50.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.651+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94396119677600] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c44029040 con 0x7f1c48014070 2024-09-22T08:12:50.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.651+0000 7f1c54126800 20 remove_watcher() i=7 2024-09-22T08:12:50.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.651+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1c48014070 msgr2=0x7f1c4802c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.651+0000 7f1c54126800 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f1c48014070 0x7f1c4802c3e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.651+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f2d4450 msgr2=0x55da4f2d6910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.651+0000 7f1c54126800 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f2d4450 0x55da4f2d6910 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.651+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2d8e40 msgr2=0x55da4f2db230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.651+0000 7f1c54126800 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2d8e40 0x55da4f2db230 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.651+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55da4f2dd8d0 msgr2=0x55da4f2dfd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.651+0000 7f1c54126800 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55da4f2dd8d0 0x55da4f2dfd90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b1803cfb0 msgr2=0x7f1b1803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b1803cfb0 0x7f1b1803f470 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1c400970a0 tx=0x7f1c40088000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 msgr2=0x55da4f2c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 --2- 172.21.15.165:0/735696238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2c1390 0x55da4f2c89b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1c480117d0 tx=0x7f1c48054290 comp rx=0 tx=0).stop 2024-09-22T08:12:50.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 reap_dead start 2024-09-22T08:12:50.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c4f508640 1 -- 172.21.15.165:0/735696238 reap_dead start 2024-09-22T08:12:50.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 shutdown_connections 2024-09-22T08:12:50.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 >> 172.21.15.165:0/735696238 conn(0x55da4f2bd7b0 msgr2=0x55da4f2bb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 shutdown_connections 2024-09-22T08:12:50.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/735696238 wait complete. 2024-09-22T08:12:50.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/1664711146 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b2803cfb0 msgr2=0x7f1b2803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 --2- 172.21.15.165:0/1664711146 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b2803cfb0 0x7f1b2803f470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1c40052ad0 tx=0x7f1c40096d10 comp rx=0 tx=0).stop 2024-09-22T08:12:50.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/1664711146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2b4910 msgr2=0x55da4f2b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 --2- 172.21.15.165:0/1664711146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2b4910 0x55da4f2b4d30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55da4f29a900 tx=0x7f1c48018830 comp rx=0 tx=0).stop 2024-09-22T08:12:50.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/1664711146 shutdown_connections 2024-09-22T08:12:50.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 --2- 172.21.15.165:0/1664711146 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b2803cfb0 0x7f1b2803f470 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 --2- 172.21.15.165:0/1664711146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f2b4910 0x55da4f2b4d30 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/1664711146 >> 172.21.15.165:0/1664711146 conn(0x55da4f2a8cc0 msgr2=0x55da4f2a90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/1664711146 shutdown_connections 2024-09-22T08:12:50.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/1664711146 wait complete. 2024-09-22T08:12:50.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f1a2a70 msgr2=0x55da4f2a10c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f1a2a70 0x55da4f2a10c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2a3410 msgr2=0x55da4f2a58b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.652+0000 7f1c54126800 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2a3410 0x55da4f2a58b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b3803cfb0 msgr2=0x7f1b3803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b3803cfb0 0x7f1b3803f470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1c44004170 tx=0x7f1c44001330 comp rx=0 tx=0).stop 2024-09-22T08:12:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 msgr2=0x55da4f299a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f299a70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1c40053d60 tx=0x7f1c40002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 shutdown_connections 2024-09-22T08:12:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55da4f2a3410 0x55da4f2a58b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55da4f1a2a70 0x55da4f2a10c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1b3803cfb0 0x7f1b3803f470 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 --2- 172.21.15.165:0/269239225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da4f1a1830 0x55da4f299a70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 >> 172.21.15.165:0/269239225 conn(0x55da4f19cc00 msgr2=0x55da4f28b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 shutdown_connections 2024-09-22T08:12:50.681 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.653+0000 7f1c54126800 1 -- 172.21.15.165:0/269239225 wait complete. 2024-09-22T08:12:50.681 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-22T08:12:50.637296Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.637285Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:50.681 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-22T08:12:50.637296Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.637285Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:50.681 ERROR:root:0 2024-09-22T08:12:50.682 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:50.686 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:50.686 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-22T08:12:50.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-22T08:12:50.687 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-22T08:12:50.731 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:50.731 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:50.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.731+0000 7fe06232a800 1 Processor -- start 2024-09-22T08:12:50.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.731+0000 7fe06232a800 1 -- start start 2024-09-22T08:12:50.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.731+0000 7fe06232a800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55cf409319d0 0x55cf40933e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.731+0000 7fe06232a800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf407b8a20 con 0x55cf408a0d30 2024-09-22T08:12:50.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.731+0000 7fe06232a800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55cf407b87d0 con 0x55cf409319d0 2024-09-22T08:12:50.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.732+0000 7fe0558d9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55cf409319d0 0x55cf40933e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.732+0000 7fe05e0da640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55cf408a0d30 0x55cf40930140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57802/0 (socket says 172.21.15.165:57802) 2024-09-22T08:12:50.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.732+0000 7fe05e0da640 1 -- 172.21.15.165:0/1632323742 learned_addr learned my addr 172.21.15.165:0/1632323742 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:50.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.732+0000 7fe05d8d9640 1 -- 172.21.15.165:0/1632323742 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068476556 0 0) 0x55cf407b8a20 con 0x55cf408a0d30 2024-09-22T08:12:50.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.732+0000 7fe05d8d9640 1 -- 172.21.15.165:0/1632323742 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe04c001e10 con 0x55cf408a0d30 2024-09-22T08:12:50.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.732+0000 7fe0558d9640 1 -- 172.21.15.165:0/1632323742 >> v1:172.21.15.53:6789/0 conn(0x55cf408a0d30 legacy=0x55cf40930140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.732+0000 7fe0558d9640 1 -- 172.21.15.165:0/1632323742 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf40935570 con 0x55cf409319d0 2024-09-22T08:12:50.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.734+0000 7fe0558d9640 1 --2- 172.21.15.165:0/1632323742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf409319d0 0x55cf40933e90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe04800a470 tx=0x7fe048045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1775a4e9fb9ad8a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.734+0000 7fe05d8d9640 1 -- 172.21.15.165:0/1632323742 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe048059070 con 0x55cf409319d0 2024-09-22T08:12:50.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.734+0000 7fe05d8d9640 1 -- 172.21.15.165:0/1632323742 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe048054570 con 0x55cf409319d0 2024-09-22T08:12:50.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.734+0000 7fe05d8d9640 1 -- 172.21.15.165:0/1632323742 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe048054850 con 0x55cf409319d0 2024-09-22T08:12:50.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.735+0000 7fe06232a800 1 -- 172.21.15.165:0/1632323742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf409319d0 msgr2=0x55cf40933e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.735+0000 7fe06232a800 1 --2- 172.21.15.165:0/1632323742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf409319d0 0x55cf40933e90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe04800a470 tx=0x7fe048045920 comp rx=0 tx=0).stop 2024-09-22T08:12:50.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.735+0000 7fe06232a800 1 -- 172.21.15.165:0/1632323742 shutdown_connections 2024-09-22T08:12:50.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.735+0000 7fe06232a800 1 --2- 172.21.15.165:0/1632323742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf409319d0 0x55cf40933e90 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.735+0000 7fe06232a800 1 -- 172.21.15.165:0/1632323742 >> 172.21.15.165:0/1632323742 conn(0x55cf40927bb0 msgr2=0x55cf4092a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.735+0000 7fe06232a800 1 -- 172.21.15.165:0/1632323742 shutdown_connections 2024-09-22T08:12:50.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.735+0000 7fe06232a800 1 -- 172.21.15.165:0/1632323742 wait complete. 2024-09-22T08:12:50.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.748+0000 7fe06232a800 1 Processor -- start 2024-09-22T08:12:50.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.748+0000 7fe06232a800 1 -- start start 2024-09-22T08:12:50.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.749+0000 7fe06232a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf40a1ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.749+0000 7fe06232a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cf407c5dd0 con 0x55cf408a0d30 2024-09-22T08:12:50.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.749+0000 7fe05e0da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf40a1ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.749+0000 7fe05e0da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf40a1ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34328/0 (socket says 172.21.15.165:34328) 2024-09-22T08:12:50.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.749+0000 7fe05e0da640 1 -- 172.21.15.165:0/839732762 learned_addr learned my addr 172.21.15.165:0/839732762 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.749+0000 7fe05e0da640 1 -- 172.21.15.165:0/839732762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf40a1d470 con 0x55cf408a0d30 2024-09-22T08:12:50.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.749+0000 7fe05e0da640 1 --2- 172.21.15.165:0/839732762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf40a1ce80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe050001e30 tx=0x7fe05000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4e1b2546797f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.750+0000 7fdf4c608640 1 -- 172.21.15.165:0/839732762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe050012020 con 0x55cf408a0d30 2024-09-22T08:12:50.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.750+0000 7fdf4c608640 1 -- 172.21.15.165:0/839732762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05000e470 con 0x55cf408a0d30 2024-09-22T08:12:50.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.750+0000 7fdf4c608640 1 -- 172.21.15.165:0/839732762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe05000e790 con 0x55cf408a0d30 2024-09-22T08:12:50.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.750+0000 7fe06232a800 1 -- 172.21.15.165:0/839732762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 msgr2=0x55cf40a1ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.750+0000 7fe06232a800 1 --2- 172.21.15.165:0/839732762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf40a1ce80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe050001e30 tx=0x7fe05000b780 comp rx=0 tx=0).stop 2024-09-22T08:12:50.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.750+0000 7fe06232a800 1 -- 172.21.15.165:0/839732762 shutdown_connections 2024-09-22T08:12:50.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.750+0000 7fe06232a800 1 --2- 172.21.15.165:0/839732762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf40a1ce80 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.750+0000 7fe06232a800 1 -- 172.21.15.165:0/839732762 >> 172.21.15.165:0/839732762 conn(0x55cf40927bb0 msgr2=0x55cf40a18800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.750+0000 7fe06232a800 1 -- 172.21.15.165:0/839732762 shutdown_connections 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.750+0000 7fe06232a800 1 -- 172.21.15.165:0/839732762 wait complete. 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.751+0000 7fe06232a800 1 Processor -- start 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.751+0000 7fe06232a800 1 -- start start 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.751+0000 7fe06232a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf4092d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.751+0000 7fe06232a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cf40934810 con 0x55cf408a0d30 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.751+0000 7fe05e0da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf4092d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.751+0000 7fe05e0da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf4092d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34342/0 (socket says 172.21.15.165:34342) 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.751+0000 7fe05e0da640 1 -- 172.21.15.165:0/4030991337 learned_addr learned my addr 172.21.15.165:0/4030991337 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.751+0000 7fe05e0da640 1 -- 172.21.15.165:0/4030991337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf4092dd90 con 0x55cf408a0d30 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.752+0000 7fe05e0da640 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf4092d830 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe050000c00 tx=0x7fe0500040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.752+0000 7fdf4ae05640 1 -- 172.21.15.165:0/4030991337 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe050012030 con 0x55cf408a0d30 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.752+0000 7fdf4ae05640 1 -- 172.21.15.165:0/4030991337 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05001a4d0 con 0x55cf408a0d30 2024-09-22T08:12:50.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.752+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf4092c140 con 0x55cf408a0d30 2024-09-22T08:12:50.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.752+0000 7fdf4ae05640 1 -- 172.21.15.165:0/4030991337 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe05001a7f0 con 0x55cf408a0d30 2024-09-22T08:12:50.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.752+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf4092c700 con 0x55cf408a0d30 2024-09-22T08:12:50.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.753+0000 7fdf4ae05640 1 -- 172.21.15.165:0/4030991337 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe050015020 con 0x55cf408a0d30 2024-09-22T08:12:50.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.753+0000 7fdf4ae05640 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf4403cfb0 0x7fdf4403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.753+0000 7fdf4ae05640 1 -- 172.21.15.165:0/4030991337 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe050020070 con 0x55cf408a0d30 2024-09-22T08:12:50.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.753+0000 7fe0558d9640 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf4403cfb0 0x7fdf4403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.753+0000 7fe06232a800 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf409319d0 0x55cf40a2deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.753+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a2e3f0 con 0x55cf409319d0 2024-09-22T08:12:50.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.753+0000 7fe05e8db640 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf409319d0 0x55cf40a2deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.754+0000 7fe0558d9640 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf4403cfb0 0x7fdf4403f470 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55cf408a0020 tx=0x7fe048050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.754+0000 7fe05e8db640 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf409319d0 0x55cf40a2deb0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.754+0000 7fe05e8db640 1 -- 172.21.15.165:0/4030991337 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe05800a4d0 con 0x55cf409319d0 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.754+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf4092cc00 con 0x55cf409319d0 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.754+0000 7fe05e8db640 1 -- 172.21.15.165:0/4030991337 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe05800a4d0 con 0x55cf409319d0 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.754+0000 7fe06232a800 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a30700 0x55cf40a32af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.754+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a331c0 con 0x55cf40a30700 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.754+0000 7fe05e0da640 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a30700 0x55cf40a32af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.755+0000 7fe05e0da640 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a30700 0x55cf40a32af0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.755+0000 7fe05e0da640 1 -- 172.21.15.165:0/4030991337 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a30700 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.755+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a2f5a0 con 0x55cf409319d0 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.755+0000 7fe05e8db640 1 -- 172.21.15.165:0/4030991337 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe05800a4d0 con 0x55cf409319d0 2024-09-22T08:12:50.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.755+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a2fa40 con 0x55cf409319d0 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.756+0000 7fe05e8db640 1 -- 172.21.15.165:0/4030991337 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe05800a4d0 con 0x55cf409319d0 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.756+0000 7fe06232a800 1 Processor -- start 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.756+0000 7fe06232a800 1 -- start start 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.756+0000 7fe06232a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a41b40 0x55cf40a41f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.756+0000 7fe06232a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cf40824d50 con 0x55cf40a41b40 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.756+0000 7fe05e8db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a41b40 0x55cf40a41f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.756+0000 7fe05e8db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a41b40 0x55cf40a41f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34344/0 (socket says 172.21.15.165:34344) 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.756+0000 7fe05e8db640 1 -- 172.21.15.165:0/1915574521 learned_addr learned my addr 172.21.15.165:0/1915574521 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.757+0000 7fe05e8db640 1 -- 172.21.15.165:0/1915574521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf40a425a0 con 0x55cf40a41b40 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.757+0000 7fe05e8db640 1 --2- 172.21.15.165:0/1915574521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a41b40 0x55cf40a41f60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x55cf40a2e7b0 tx=0x7fe058018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.757+0000 7fdf43fff640 1 -- 172.21.15.165:0/1915574521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe058014450 con 0x55cf40a41b40 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.757+0000 7fdf43fff640 1 -- 172.21.15.165:0/1915574521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0580145f0 con 0x55cf40a41b40 2024-09-22T08:12:50.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.757+0000 7fe06232a800 1 -- 172.21.15.165:0/1915574521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf40a42dd0 con 0x55cf40a41b40 2024-09-22T08:12:50.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.757+0000 7fdf43fff640 1 -- 172.21.15.165:0/1915574521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe058014910 con 0x55cf40a41b40 2024-09-22T08:12:50.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.757+0000 7fe06232a800 1 -- 172.21.15.165:0/1915574521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf40a43370 con 0x55cf40a41b40 2024-09-22T08:12:50.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.758+0000 7fdf43fff640 1 -- 172.21.15.165:0/1915574521 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe058011040 con 0x55cf40a41b40 2024-09-22T08:12:50.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.758+0000 7fdf43fff640 1 --2- 172.21.15.165:0/1915574521 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf3803d000 0x7fdf3803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.758+0000 7fdf43fff640 1 -- 172.21.15.165:0/1915574521 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe05801e070 con 0x55cf40a41b40 2024-09-22T08:12:50.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.758+0000 7fe05e0da640 1 --2- 172.21.15.165:0/1915574521 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf3803d000 0x7fdf3803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.759+0000 7fe06232a800 1 Processor -- start 2024-09-22T08:12:50.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.759+0000 7fe06232a800 1 -- start start 2024-09-22T08:12:50.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.759+0000 7fe05e0da640 1 --2- 172.21.15.165:0/1915574521 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf3803d000 0x7fdf3803f4c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55cf40a2e850 tx=0x7fe050024f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.759+0000 7fe06232a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a4e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.759+0000 7fe06232a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cf40a1d8a0 con 0x55cf40a4e580 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.759+0000 7fe05e8db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a4e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.759+0000 7fe05e8db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a4e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34346/0 (socket says 172.21.15.165:34346) 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.759+0000 7fe05e8db640 1 -- 172.21.15.165:0/3473749798 learned_addr learned my addr 172.21.15.165:0/3473749798 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.759+0000 7fe05e8db640 1 -- 172.21.15.165:0/3473749798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf40a4ef70 con 0x55cf40a4e580 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fe05e8db640 1 --2- 172.21.15.165:0/3473749798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a4e980 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe058016620 tx=0x7fe058011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb58d69b1d8913b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fdf41ffb640 1 -- 172.21.15.165:0/3473749798 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe058051020 con 0x55cf40a4e580 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fdf41ffb640 1 -- 172.21.15.165:0/3473749798 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe058022de0 con 0x55cf40a4e580 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fdf41ffb640 1 -- 172.21.15.165:0/3473749798 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe058028070 con 0x55cf40a4e580 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fe06232a800 1 -- 172.21.15.165:0/3473749798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 msgr2=0x55cf40a4e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fe06232a800 1 --2- 172.21.15.165:0/3473749798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a4e980 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe058016620 tx=0x7fe058011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:50.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fe06232a800 1 -- 172.21.15.165:0/3473749798 shutdown_connections 2024-09-22T08:12:50.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fe06232a800 1 --2- 172.21.15.165:0/3473749798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a4e980 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fe06232a800 1 -- 172.21.15.165:0/3473749798 >> 172.21.15.165:0/3473749798 conn(0x55cf40a4a980 msgr2=0x55cf40a48bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fe06232a800 1 -- 172.21.15.165:0/3473749798 shutdown_connections 2024-09-22T08:12:50.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fe06232a800 1 -- 172.21.15.165:0/3473749798 wait complete. 2024-09-22T08:12:50.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.760+0000 7fe06232a800 1 Processor -- start 2024-09-22T08:12:50.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fe06232a800 1 -- start start 2024-09-22T08:12:50.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fe06232a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a55bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fe06232a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cf40a4f590 con 0x55cf40a4e580 2024-09-22T08:12:50.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fe05e8db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a55bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fe05e8db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a55bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34350/0 (socket says 172.21.15.165:34350) 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 learned_addr learned my addr 172.21.15.165:0/2214191044 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf40a56110 con 0x55cf40a4e580 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fe05e8db640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a55bb0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe058022f90 tx=0x7fe058011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fdf2ffff640 1 -- 172.21.15.165:0/2214191044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe058054b70 con 0x55cf40a4e580 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fdf2ffff640 1 -- 172.21.15.165:0/2214191044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe058054d10 con 0x55cf40a4e580 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fdf2ffff640 1 -- 172.21.15.165:0/2214191044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe058045930 con 0x55cf40a4e580 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.761+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf40a563a0 con 0x55cf40a4e580 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.762+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf40a56d20 con 0x55cf40a4e580 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.762+0000 7fdf2ffff640 1 -- 172.21.15.165:0/2214191044 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe058034030 con 0x55cf40a4e580 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.763+0000 7fdf2ffff640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf2803d000 0x7fdf2803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.763+0000 7fdf2ffff640 1 -- 172.21.15.165:0/2214191044 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe058032070 con 0x55cf40a4e580 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.763+0000 7fe05e0da640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf2803d000 0x7fdf2803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.763+0000 7fe05e0da640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf2803d000 0x7fdf2803f4c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe050024620 tx=0x7fe050047000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.763+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.763+0000 7fe06232a800 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf40a61660 0x55cf40a63b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.763+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a64270 con 0x55cf40a61660 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.763+0000 7fe0558d9640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf40a61660 0x55cf40a63b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe0558d9640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf40a61660 0x55cf40a63b20 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 20 realm 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a646a0 con 0x55cf40a61660 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:50.773 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a64f70 con 0x55cf40a61660 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.764+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a65310 con 0x55cf40a61660 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe06232a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe06232a800 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a66070 0x55cf40a68460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a68a70 con 0x55cf40a66070 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe05e8db640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a66070 0x55cf40a68460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe05e8db640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a66070 0x55cf40a68460 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe06232a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe06232a800 20 searching for the correct realm 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe06232a800 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55cf40a6aa20 0x55cf40a6cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a6aa20 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.765+0000 7fe05e0da640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55cf40a6aa20 0x55cf40a6cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.766+0000 7fe05e0da640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55cf40a6aa20 0x55cf40a6cee0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.766+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.766+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a66070 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.766+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.766+0000 7fe05e8db640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe058014070 0x7fe05804d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.766+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x7fe058014070 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.766+0000 7fe0558d9640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe058014070 0x7fe05804d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.767+0000 7fe0558d9640 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe058014070 0x7fe05804d5d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.767+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x7fe058014070 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.767+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a61660 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.767+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.767+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a61660 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.768+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.768+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x7fe058014070 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.768+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x7fe058014070 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.768+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a66070 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.768+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.768+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a66070 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.768+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.768+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a6aa20 2024-09-22T08:12:50.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.769+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.769+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a61660 2024-09-22T08:12:50.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.769+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.769+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x7fe058014070 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.769+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x7fe058014070 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.769+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a61660 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.769+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.769+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a66070 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.770+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.770+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a6aa20 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.770+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.770+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a6aa20 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.770+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.770+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x7fe058014070 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.770+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x7fe058014070 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.770+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a6aa20 2024-09-22T08:12:50.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.771+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.771+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a6aa20 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.771+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.771+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a61660 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.771+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.771+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a61660 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.771+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.771+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x7fe058014070 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.772+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x7fe058014070 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.772+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a6aa20 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.772+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.772+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a66070 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.772+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.772+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a61660 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.772+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.772+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x7fe058014070 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.773+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x7fe058014070 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.773+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a6aa20 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.773+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.773+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x7fe058014070 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.773+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x7fe058014070 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.773+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a66070 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.773+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.773+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a6aa20 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x7fe058014070 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe04805c040 con 0x7fe058014070 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a61660 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6d560 con 0x55cf40a66070 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe06232a800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe06232a800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe06232a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe06232a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe06232a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe06232a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.774+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a69460 con 0x55cf40a61660 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a690a0 con 0x55cf40a61660 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe04805c040 con 0x55cf40a61660 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a69d80 con 0x55cf40a61660 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 20 zone default found 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 4 Realm: () 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:50.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 20 zonegroup default 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a69da0 con 0x7fe058014070 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.775+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.776+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6f450 con 0x55cf40a6aa20 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.776+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.776+0000 7fe06232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.776+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.776+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6f8b0 con 0x55cf40a6aa20 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.776+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.776+0000 7fe06232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.776+0000 7fe06232a800 20 started sync module instance, tier type = 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.776+0000 7fe06232a800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.776+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6e8f0 con 0x55cf40a66070 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.777+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.777+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94348631272672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a6e550 con 0x55cf40a66070 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.777+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a707e0 con 0x55cf40a61660 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.778+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94348631272672] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.778+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.778+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94348631276816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a707e0 con 0x55cf40a61660 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.778+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a71290 con 0x55cf40a6aa20 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.780+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.780+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94348631276816] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.780+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94348631281008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a71b30 con 0x55cf40a6aa20 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.780+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a72120 con 0x55cf40a66070 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.781+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.781+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94348631278384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a729c0 con 0x55cf40a66070 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.781+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a73420 con 0x55cf40a61660 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.781+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94348631281008] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.782+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.782+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94348631278384] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.782+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94348631287056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a72f30 con 0x55cf40a61660 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.782+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a73950 con 0x7fe058014070 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.783+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94348631287056] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.783+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.783+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94348631290944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a73910 con 0x7fe058014070 2024-09-22T08:12:50.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.783+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a74360 con 0x7fe058014070 2024-09-22T08:12:50.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.784+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94348631290944] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.784+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.784+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94348631283328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a74360 con 0x7fe058014070 2024-09-22T08:12:50.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.784+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a74d70 con 0x7fe058014070 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.785+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94348631283328] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.785+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.785+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94348631294096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a74d70 con 0x7fe058014070 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.786+0000 7fe06232a800 20 add_watcher() i=0 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.786+0000 7fe06232a800 20 add_watcher() i=1 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.786+0000 7fe06232a800 20 add_watcher() i=2 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.786+0000 7fe06232a800 20 add_watcher() i=3 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.786+0000 7fe06232a800 20 add_watcher() i=4 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.786+0000 7fe06232a800 20 add_watcher() i=5 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.786+0000 7fe06232a800 20 add_watcher() i=6 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.786+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94348631294096] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.787+0000 7fe06232a800 20 add_watcher() i=7 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.787+0000 7fe06232a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.787+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a78230 con 0x55cf40a61660 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.787+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.787+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94348631309360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a74ee0 con 0x55cf40a61660 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.788+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94348631309360] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.788+0000 7fdf14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.788+0000 7fe06232a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.788+0000 7fe06232a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.788+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a80d60 con 0x55cf40a61660 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.790+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.790+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a813f0 con 0x7fe058014070 2024-09-22T08:12:50.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.791+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.791+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a81810 con 0x55cf40a6aa20 2024-09-22T08:12:50.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.792+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.792+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a81c90 con 0x55cf40a61660 2024-09-22T08:12:50.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.793+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.793+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82240 con 0x55cf40a66070 2024-09-22T08:12:50.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.794+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.794+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82220 con 0x55cf40a6aa20 2024-09-22T08:12:50.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.795+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.795+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a827d0 con 0x55cf40a61660 2024-09-22T08:12:50.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.796+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.796+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82740 con 0x7fe058014070 2024-09-22T08:12:50.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.797+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'52 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.797+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82740 con 0x55cf40a66070 2024-09-22T08:12:50.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.798+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.798+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82860 con 0x55cf40a6aa20 2024-09-22T08:12:50.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.799+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.799+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82860 con 0x55cf40a66070 2024-09-22T08:12:50.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.800+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.800+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82d30 con 0x7fe058014070 2024-09-22T08:12:50.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.801+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.801+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82c40 con 0x55cf40a66070 2024-09-22T08:12:50.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.802+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.803+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82990 con 0x7fe058014070 2024-09-22T08:12:50.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.804+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.804+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82990 con 0x55cf40a61660 2024-09-22T08:12:50.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.805+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.805+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82990 con 0x55cf40a6aa20 2024-09-22T08:12:50.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.806+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'71 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.806+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82a50 con 0x55cf40a66070 2024-09-22T08:12:50.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.807+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.807+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82a50 con 0x55cf40a6aa20 2024-09-22T08:12:50.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.808+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.808+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82a20 con 0x55cf40a61660 2024-09-22T08:12:50.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.809+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.809+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82a20 con 0x55cf40a61660 2024-09-22T08:12:50.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.810+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.810+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82a20 con 0x55cf40a6aa20 2024-09-22T08:12:50.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.811+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'72 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.811+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82a90 con 0x55cf40a66070 2024-09-22T08:12:50.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.812+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.812+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82a90 con 0x55cf40a6aa20 2024-09-22T08:12:50.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.813+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.813+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82af0 con 0x55cf40a6aa20 2024-09-22T08:12:50.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.814+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.814+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82ab0 con 0x55cf40a6aa20 2024-09-22T08:12:50.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.815+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.815+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82ab0 con 0x55cf40a6aa20 2024-09-22T08:12:50.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.816+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.816+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82af0 con 0x7fe058014070 2024-09-22T08:12:50.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.817+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.817+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82b30 con 0x55cf40a6aa20 2024-09-22T08:12:50.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.818+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.818+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82af0 con 0x7fe058014070 2024-09-22T08:12:50.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.819+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'53 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.819+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82b30 con 0x55cf40a6aa20 2024-09-22T08:12:50.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.820+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'73 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.820+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82af0 con 0x7fe058014070 2024-09-22T08:12:50.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.821+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.821+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40a82b30 con 0x55cf40a66070 2024-09-22T08:12:50.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.823+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.823+0000 7fde8f7fe640 20 reqs_thread_entry: start 2024-09-22T08:12:50.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.823+0000 7fe06232a800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.823+0000 7fe06232a800 20 Filter name: none 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.823+0000 7fde8d7fa640 20 reqs_thread_entry: start 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.823+0000 7fe06232a800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.823+0000 7fe06232a800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.823+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40aadb00 con 0x7fe058014070 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.824+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.824+0000 7fe06232a800 20 rados_obj.operate() r=0 bl.length=349 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.824+0000 7fe06232a800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.824+0000 7fe06232a800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.824+0000 7fe06232a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:50.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.824+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab03f0 con 0x7fe058014070 2024-09-22T08:12:50.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.824+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.824+0000 7fe06232a800 10 removing key index: system_akey 2024-09-22T08:12:50.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.824+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40aae3d0 con 0x55cf40a6aa20 2024-09-22T08:12:50.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.825+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(96 system_akey [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.825+0000 7fe06232a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.825+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94348631535408 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab0810 con 0x55cf40a61660 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.825+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== watch-notify(notify (1) cookie 94348631276816 notify 146028888099 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55cf40a813f0 con 0x55cf40a61660 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.826+0000 7fdf41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94348631276816 notifier 4850 bl.length()=161 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.826+0000 7fdf41ffb640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdf24003d60 con 0x55cf40a61660 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.826+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(97 notify.1 [notify cookie 94348631535408 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.826+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.826+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== watch-notify(notify_complete (2) cookie 94348631535408 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cf40a81620 con 0x55cf40a61660 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.826+0000 7fe06232a800 10 removing email index: 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.826+0000 7fe06232a800 10 removing user buckets index 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.826+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40aae240 con 0x7fe058014070 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.827+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(99 system_user.buckets [delete] v34'10 uv9 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.827+0000 7fe06232a800 10 removing user index: system_user 2024-09-22T08:12:50.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.827+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x7fe058014070 2024-09-22T08:12:50.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.828+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(100 system_user [call,call,delete] v34'11 uv11 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.828+0000 7fe06232a800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-22T08:12:50.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.829+0000 7fe06232a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-22T08:12:50.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.829+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94348631547696 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x55cf40a66070 2024-09-22T08:12:50.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.829+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== watch-notify(notify (1) cookie 94348631272672 notify 146028888088 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55cf40a56d20 con 0x55cf40a66070 2024-09-22T08:12:50.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.829+0000 7fdf417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94348631272672 notifier 4850 bl.length()=160 2024-09-22T08:12:50.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.829+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(101 notify.0 [notify cookie 94348631547696 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.829+0000 7fdf417fa640 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fde940032c0 con 0x55cf40a66070 2024-09-22T08:12:50.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.829+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.829+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== watch-notify(notify_complete (2) cookie 94348631547696 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cf40a563a0 con 0x55cf40a66070 2024-09-22T08:12:50.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.830+0000 7fdf14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:50.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.830+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94348631309360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x55cf40a61660 2024-09-22T08:12:50.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.831+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94348631309360] v34'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.831+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94348631272672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x55cf40a66070 2024-09-22T08:12:50.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.832+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94348631272672] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.832+0000 7fe06232a800 20 remove_watcher() i=0 2024-09-22T08:12:50.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.832+0000 7fe06232a800 2 removed watcher, disabling cache 2024-09-22T08:12:50.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.832+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94348631276816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x55cf40a61660 2024-09-22T08:12:50.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.833+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94348631276816] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.833+0000 7fe06232a800 20 remove_watcher() i=1 2024-09-22T08:12:50.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.833+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94348631281008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x55cf40a6aa20 2024-09-22T08:12:50.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.834+0000 7fe05e0da640 1 -- 172.21.15.165:0/2214191044 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94348631281008] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0500247e0 con 0x55cf40a6aa20 2024-09-22T08:12:50.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.834+0000 7fe06232a800 20 remove_watcher() i=2 2024-09-22T08:12:50.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.834+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94348631278384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x55cf40a66070 2024-09-22T08:12:50.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.835+0000 7fe05e8db640 1 -- 172.21.15.165:0/2214191044 <== osd.2 v2:172.21.15.165:6808/3197121696 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94348631278384] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe05802a070 con 0x55cf40a66070 2024-09-22T08:12:50.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.835+0000 7fe06232a800 20 remove_watcher() i=3 2024-09-22T08:12:50.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.835+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94348631287056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x55cf40a61660 2024-09-22T08:12:50.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.836+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94348631287056] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x55cf40a61660 2024-09-22T08:12:50.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.836+0000 7fe06232a800 20 remove_watcher() i=4 2024-09-22T08:12:50.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.836+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94348631290944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x7fe058014070 2024-09-22T08:12:50.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.837+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94348631290944] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.837+0000 7fe06232a800 20 remove_watcher() i=5 2024-09-22T08:12:50.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.837+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94348631283328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x7fe058014070 2024-09-22T08:12:50.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.839+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94348631283328] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.839+0000 7fe06232a800 20 remove_watcher() i=6 2024-09-22T08:12:50.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.839+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94348631294096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cf40ab2450 con 0x7fe058014070 2024-09-22T08:12:50.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94348631294096] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0480891c0 con 0x7fe058014070 2024-09-22T08:12:50.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 20 remove_watcher() i=7 2024-09-22T08:12:50.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe058014070 msgr2=0x7fe05804d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe058014070 0x7fe05804d5d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf40a61660 msgr2=0x55cf40a63b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf40a61660 0x55cf40a63b20 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a66070 msgr2=0x55cf40a68460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a66070 0x55cf40a68460 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55cf40a6aa20 msgr2=0x55cf40a6cee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55cf40a6aa20 0x55cf40a6cee0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf2803d000 msgr2=0x7fdf2803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf2803d000 0x7fdf2803f4c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe050024620 tx=0x7fe050047000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe0558d9640 1 -- 172.21.15.165:0/2214191044 reap_dead start 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 msgr2=0x55cf40a55bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a55bb0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe058022f90 tx=0x7fe058011f60 comp rx=0 tx=0).stop 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 shutdown_connections 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/2214191044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a4e580 0x55cf40a55bb0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 >> 172.21.15.165:0/2214191044 conn(0x55cf40a4a980 msgr2=0x55cf40a48b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 shutdown_connections 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/2214191044 wait complete. 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/1915574521 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf3803d000 msgr2=0x7fdf3803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/1915574521 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf3803d000 0x7fdf3803f4c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55cf40a2e850 tx=0x7fe050024f30 comp rx=0 tx=0).stop 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/1915574521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a41b40 msgr2=0x55cf40a41f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/1915574521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a41b40 0x55cf40a41f60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x55cf40a2e7b0 tx=0x7fe058018830 comp rx=0 tx=0).stop 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/1915574521 shutdown_connections 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/1915574521 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf3803d000 0x7fdf3803f4c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 --2- 172.21.15.165:0/1915574521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf40a41b40 0x55cf40a41f60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.840+0000 7fe06232a800 1 -- 172.21.15.165:0/1915574521 >> 172.21.15.165:0/1915574521 conn(0x55cf40a35ef0 msgr2=0x55cf40a362d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 -- 172.21.15.165:0/1915574521 shutdown_connections 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 -- 172.21.15.165:0/1915574521 wait complete. 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf409319d0 msgr2=0x55cf40a2deb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf409319d0 0x55cf40a2deb0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a30700 msgr2=0x55cf40a32af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a30700 0x55cf40a32af0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf4403cfb0 msgr2=0x7fdf4403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf4403cfb0 0x7fdf4403f470 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55cf408a0020 tx=0x7fe048050000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 msgr2=0x55cf4092d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf4092d830 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe050000c00 tx=0x7fe0500040e0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 shutdown_connections 2024-09-22T08:12:50.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55cf40a30700 0x55cf40a32af0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55cf409319d0 0x55cf40a2deb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fdf4403cfb0 0x7fdf4403f470 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 --2- 172.21.15.165:0/4030991337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cf408a0d30 0x55cf4092d830 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 >> 172.21.15.165:0/4030991337 conn(0x55cf40927bb0 msgr2=0x55cf40a1e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 shutdown_connections 2024-09-22T08:12:50.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.841+0000 7fe06232a800 1 -- 172.21.15.165:0/4030991337 wait complete. 2024-09-22T08:12:50.850 ERROR:root:None 2024-09-22T08:12:50.851 ERROR:root:0 2024-09-22T08:12:50.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-22T08:12:50.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-22T08:12:50.851 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-22T08:12:50.904 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:50.905 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:50.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.904+0000 7f6c2373e800 1 Processor -- start 2024-09-22T08:12:50.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.904+0000 7f6c2373e800 1 -- start start 2024-09-22T08:12:50.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.904+0000 7f6c2373e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fa6b76ccf0 0x55fa6b76f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.904+0000 7f6c2373e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa6b5f9a20 con 0x55fa6b773d60 2024-09-22T08:12:50.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.904+0000 7f6c2373e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55fa6b5f97d0 con 0x55fa6b76ccf0 2024-09-22T08:12:50.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.905+0000 7f6c1f486640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fa6b76ccf0 0x55fa6b76f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.905+0000 7f6c1ec85640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55fa6b773d60 0x55fa6b776150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57806/0 (socket says 172.21.15.165:57806) 2024-09-22T08:12:50.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.905+0000 7f6c1f486640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fa6b76ccf0 0x55fa6b76f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34362/0 (socket says 172.21.15.165:34362) 2024-09-22T08:12:50.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.905+0000 7f6c1ec85640 1 -- 172.21.15.165:0/957564438 learned_addr learned my addr 172.21.15.165:0/957564438 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:50.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.905+0000 7f6c1f486640 1 -- 172.21.15.165:0/957564438 >> v1:172.21.15.53:6789/0 conn(0x55fa6b773d60 legacy=0x55fa6b776150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.905+0000 7f6c1f486640 1 -- 172.21.15.165:0/957564438 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6b778880 con 0x55fa6b76ccf0 2024-09-22T08:12:50.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.907+0000 7f6c1f486640 1 --2- 172.21.15.165:0/957564438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b76f100 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800a470 tx=0x7f6c18045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fad8eff58a2c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.907+0000 7f6c1e484640 1 -- 172.21.15.165:0/957564438 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c18053570 con 0x55fa6b76ccf0 2024-09-22T08:12:50.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.907+0000 7f6c1e484640 1 -- 172.21.15.165:0/957564438 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c18058070 con 0x55fa6b76ccf0 2024-09-22T08:12:50.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.907+0000 7f6c1e484640 1 -- 172.21.15.165:0/957564438 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c18053880 con 0x55fa6b76ccf0 2024-09-22T08:12:50.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.908+0000 7f6c2373e800 1 -- 172.21.15.165:0/957564438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 msgr2=0x55fa6b76f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.908+0000 7f6c2373e800 1 --2- 172.21.15.165:0/957564438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b76f100 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800a470 tx=0x7f6c18045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:50.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.908+0000 7f6c2373e800 1 -- 172.21.15.165:0/957564438 shutdown_connections 2024-09-22T08:12:50.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.908+0000 7f6c2373e800 1 --2- 172.21.15.165:0/957564438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b76f100 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.908+0000 7f6c2373e800 1 -- 172.21.15.165:0/957564438 >> 172.21.15.165:0/957564438 conn(0x55fa6b768360 msgr2=0x55fa6b76a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.908+0000 7f6c2373e800 1 -- 172.21.15.165:0/957564438 shutdown_connections 2024-09-22T08:12:50.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.908+0000 7f6c2373e800 1 -- 172.21.15.165:0/957564438 wait complete. 2024-09-22T08:12:50.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.921+0000 7f6c2373e800 1 Processor -- start 2024-09-22T08:12:50.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.921+0000 7f6c2373e800 1 -- start start 2024-09-22T08:12:50.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.922+0000 7f6c2373e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b8602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.922+0000 7f6c2373e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa6b606dd0 con 0x55fa6b76ccf0 2024-09-22T08:12:50.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.922+0000 7f6c1f486640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b8602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.922+0000 7f6c1f486640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b8602a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34374/0 (socket says 172.21.15.165:34374) 2024-09-22T08:12:50.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.922+0000 7f6c1f486640 1 -- 172.21.15.165:0/2403080189 learned_addr learned my addr 172.21.15.165:0/2403080189 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.922+0000 7f6c1f486640 1 -- 172.21.15.165:0/2403080189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6b860890 con 0x55fa6b76ccf0 2024-09-22T08:12:50.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.922+0000 7f6c1f486640 1 --2- 172.21.15.165:0/2403080189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b8602a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6c18025c20 tx=0x7f6c18051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf48ae6b1c46910a server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.922+0000 7f6b0d60a640 1 -- 172.21.15.165:0/2403080189 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c18053a20 con 0x55fa6b76ccf0 2024-09-22T08:12:50.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.923+0000 7f6b0d60a640 1 -- 172.21.15.165:0/2403080189 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c18063070 con 0x55fa6b76ccf0 2024-09-22T08:12:50.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.923+0000 7f6b0d60a640 1 -- 172.21.15.165:0/2403080189 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c18053cf0 con 0x55fa6b76ccf0 2024-09-22T08:12:50.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.923+0000 7f6c2373e800 1 -- 172.21.15.165:0/2403080189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 msgr2=0x55fa6b8602a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.923+0000 7f6c2373e800 1 --2- 172.21.15.165:0/2403080189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b8602a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6c18025c20 tx=0x7f6c18051000 comp rx=0 tx=0).stop 2024-09-22T08:12:50.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.923+0000 7f6c2373e800 1 -- 172.21.15.165:0/2403080189 shutdown_connections 2024-09-22T08:12:50.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.923+0000 7f6c2373e800 1 --2- 172.21.15.165:0/2403080189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b8602a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.923+0000 7f6c2373e800 1 -- 172.21.15.165:0/2403080189 >> 172.21.15.165:0/2403080189 conn(0x55fa6b768360 msgr2=0x55fa6b85bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.923+0000 7f6c2373e800 1 -- 172.21.15.165:0/2403080189 shutdown_connections 2024-09-22T08:12:50.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.923+0000 7f6c2373e800 1 -- 172.21.15.165:0/2403080189 wait complete. 2024-09-22T08:12:50.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.924+0000 7f6c2373e800 1 Processor -- start 2024-09-22T08:12:50.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.924+0000 7f6c2373e800 1 -- start start 2024-09-22T08:12:50.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.924+0000 7f6c2373e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b867c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.924+0000 7f6c2373e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa6b777b70 con 0x55fa6b76ccf0 2024-09-22T08:12:50.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.924+0000 7f6c1f486640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b867c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.924+0000 7f6c1f486640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b867c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34376/0 (socket says 172.21.15.165:34376) 2024-09-22T08:12:50.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.924+0000 7f6c1f486640 1 -- 172.21.15.165:0/291556360 learned_addr learned my addr 172.21.15.165:0/291556360 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.924+0000 7f6c1f486640 1 -- 172.21.15.165:0/291556360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6b8681d0 con 0x55fa6b76ccf0 2024-09-22T08:12:50.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.924+0000 7f6c1f486640 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b867c70 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6c18025c20 tx=0x7f6c18002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.925+0000 7f6b0be07640 1 -- 172.21.15.165:0/291556360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c1806c030 con 0x55fa6b76ccf0 2024-09-22T08:12:50.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.925+0000 7f6b0be07640 1 -- 172.21.15.165:0/291556360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c18068660 con 0x55fa6b76ccf0 2024-09-22T08:12:50.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.925+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa6b868460 con 0x55fa6b76ccf0 2024-09-22T08:12:50.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.925+0000 7f6b0be07640 1 -- 172.21.15.165:0/291556360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c18068940 con 0x55fa6b76ccf0 2024-09-22T08:12:50.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.925+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6b868e60 con 0x55fa6b76ccf0 2024-09-22T08:12:50.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.926+0000 7f6b0be07640 1 -- 172.21.15.165:0/291556360 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6c18068ae0 con 0x55fa6b76ccf0 2024-09-22T08:12:50.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.926+0000 7f6b0be07640 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b0403cfb0 0x7f6b0403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.926+0000 7f6b0be07640 1 -- 172.21.15.165:0/291556360 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6c18098c10 con 0x55fa6b76ccf0 2024-09-22T08:12:50.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.926+0000 7f6c1ec85640 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b0403cfb0 0x7f6b0403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.926+0000 7f6c2373e800 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b773d60 0x55fa6b86f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.926+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b86f800 con 0x55fa6b773d60 2024-09-22T08:12:50.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.926+0000 7f6c1fc87640 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b773d60 0x55fa6b86f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.926+0000 7f6c1ec85640 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b0403cfb0 0x7f6b0403f470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6c08001d70 tx=0x7f6c080012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.926+0000 7f6c1fc87640 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b773d60 0x55fa6b86f2c0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.927+0000 7f6c1fc87640 1 -- 172.21.15.165:0/291556360 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c1000a4d0 con 0x55fa6b773d60 2024-09-22T08:12:50.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.927+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b86fba0 con 0x55fa6b773d60 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.927+0000 7f6c1fc87640 1 -- 172.21.15.165:0/291556360 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c1000a4d0 con 0x55fa6b773d60 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.927+0000 7f6c2373e800 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8716a0 0x55fa6b873b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.927+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8742b0 con 0x55fa6b8716a0 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.927+0000 7f6c1f486640 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8716a0 0x55fa6b873b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.927+0000 7f6c1f486640 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8716a0 0x55fa6b873b20 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.928+0000 7f6c1f486640 1 -- 172.21.15.165:0/291556360 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c18051070 con 0x55fa6b8716a0 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.928+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8703f0 con 0x55fa6b773d60 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.928+0000 7f6c1fc87640 1 -- 172.21.15.165:0/291556360 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c1000a4d0 con 0x55fa6b773d60 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.928+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b870840 con 0x55fa6b773d60 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.928+0000 7f6c1fc87640 1 -- 172.21.15.165:0/291556360 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c1000a4d0 con 0x55fa6b773d60 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.929+0000 7f6c2373e800 1 Processor -- start 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.929+0000 7f6c2373e800 1 -- start start 2024-09-22T08:12:50.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.929+0000 7f6c2373e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b882c30 0x55fa6b883050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.929+0000 7f6c2373e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa6b665d50 con 0x55fa6b882c30 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.929+0000 7f6c1fc87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b882c30 0x55fa6b883050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.929+0000 7f6c1fc87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b882c30 0x55fa6b883050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34392/0 (socket says 172.21.15.165:34392) 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.929+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1245982418 learned_addr learned my addr 172.21.15.165:0/1245982418 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.929+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1245982418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6b883690 con 0x55fa6b882c30 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.929+0000 7f6c1fc87640 1 --2- 172.21.15.165:0/1245982418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b882c30 0x55fa6b883050 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000a2a0 tx=0x7f6c10018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.930+0000 7f6b09602640 1 -- 172.21.15.165:0/1245982418 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c10014450 con 0x55fa6b882c30 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.930+0000 7f6b09602640 1 -- 172.21.15.165:0/1245982418 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c100145f0 con 0x55fa6b882c30 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.930+0000 7f6b09602640 1 -- 172.21.15.165:0/1245982418 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c10014910 con 0x55fa6b882c30 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.930+0000 7f6c2373e800 1 -- 172.21.15.165:0/1245982418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa6b883ec0 con 0x55fa6b882c30 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.930+0000 7f6c2373e800 1 -- 172.21.15.165:0/1245982418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6b884460 con 0x55fa6b882c30 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.931+0000 7f6b09602640 1 -- 172.21.15.165:0/1245982418 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6c10011040 con 0x55fa6b882c30 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.931+0000 7f6b09602640 1 --2- 172.21.15.165:0/1245982418 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6af803d000 0x7f6af803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.931+0000 7f6b09602640 1 -- 172.21.15.165:0/1245982418 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6c1001e070 con 0x55fa6b882c30 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.931+0000 7f6c1f486640 1 --2- 172.21.15.165:0/1245982418 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6af803d000 0x7f6af803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.931+0000 7f6c2373e800 1 Processor -- start 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.931+0000 7f6c1f486640 1 --2- 172.21.15.165:0/1245982418 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6af803d000 0x7f6af803f4c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55fa6b869d60 tx=0x7f6c1807b9a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.931+0000 7f6c2373e800 1 -- start start 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.931+0000 7f6c2373e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b88fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.931+0000 7f6c2373e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa6b860c60 con 0x55fa6b88f670 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.932+0000 7f6c1fc87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b88fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.932+0000 7f6c1fc87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b88fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34408/0 (socket says 172.21.15.165:34408) 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.932+0000 7f6c1fc87640 1 -- 172.21.15.165:0/290813536 learned_addr learned my addr 172.21.15.165:0/290813536 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.932+0000 7f6c1fc87640 1 -- 172.21.15.165:0/290813536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6b890060 con 0x55fa6b88f670 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.932+0000 7f6c1fc87640 1 --2- 172.21.15.165:0/290813536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b88fa70 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6c10016fd0 tx=0x7f6c10011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc54120c958cff31 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.932+0000 7f6b02ffd640 1 -- 172.21.15.165:0/290813536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c10051020 con 0x55fa6b88f670 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.932+0000 7f6b02ffd640 1 -- 172.21.15.165:0/290813536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c10016440 con 0x55fa6b88f670 2024-09-22T08:12:50.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.932+0000 7f6b02ffd640 1 -- 172.21.15.165:0/290813536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c10028070 con 0x55fa6b88f670 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 -- 172.21.15.165:0/290813536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 msgr2=0x55fa6b88fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 --2- 172.21.15.165:0/290813536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b88fa70 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6c10016fd0 tx=0x7f6c10011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 -- 172.21.15.165:0/290813536 shutdown_connections 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 --2- 172.21.15.165:0/290813536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b88fa70 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 -- 172.21.15.165:0/290813536 >> 172.21.15.165:0/290813536 conn(0x55fa6b88ba70 msgr2=0x55fa6b889cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 -- 172.21.15.165:0/290813536 shutdown_connections 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 -- 172.21.15.165:0/290813536 wait complete. 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 Processor -- start 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 -- start start 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b896c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c2373e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fa6b890680 con 0x55fa6b88f670 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c1fc87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b896c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c1fc87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b896c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34420/0 (socket says 172.21.15.165:34420) 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.933+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 learned_addr learned my addr 172.21.15.165:0/1648213022 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.934+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6b8971d0 con 0x55fa6b88f670 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.934+0000 7f6c1fc87640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b896c70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6c100014d0 tx=0x7f6c10011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.934+0000 7f6b017fa640 1 -- 172.21.15.165:0/1648213022 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c10054ae0 con 0x55fa6b88f670 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.934+0000 7f6b017fa640 1 -- 172.21.15.165:0/1648213022 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c10032070 con 0x55fa6b88f670 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.934+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa6b897460 con 0x55fa6b88f670 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.934+0000 7f6b017fa640 1 -- 172.21.15.165:0/1648213022 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c10054df0 con 0x55fa6b88f670 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.934+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6b897de0 con 0x55fa6b88f670 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.935+0000 7f6b017fa640 1 -- 172.21.15.165:0/1648213022 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6c10045960 con 0x55fa6b88f670 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.935+0000 7f6b017fa640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6ae803cfb0 0x7f6ae803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.935+0000 7f6b017fa640 1 -- 172.21.15.165:0/1648213022 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6c1000e040 con 0x55fa6b88f670 2024-09-22T08:12:50.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.935+0000 7f6c1f486640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6ae803cfb0 0x7f6ae803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.935+0000 7f6c1f486640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6ae803cfb0 0x7f6ae803f470 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6c1807ba50 tx=0x7f6c18080000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.935+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.935+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b8a2730 0x55fa6b8a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8a5340 con 0x55fa6b8a2730 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c1ec85640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b8a2730 0x55fa6b8a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c1ec85640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b8a2730 0x55fa6b8a4bf0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c08009050 con 0x55fa6b8a2730 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c2373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c2373e800 20 realm 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8a1a80 con 0x55fa6b8a2730 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c08009050 con 0x55fa6b8a2730 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c2373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c2373e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8a5e30 con 0x55fa6b8a2730 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c08009050 con 0x55fa6b8a2730 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.936+0000 7f6c2373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8a6700 con 0x55fa6b8a2730 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c08009050 con 0x55fa6b8a2730 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c2373e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8a7120 0x55fa6b8a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8a9c50 con 0x55fa6b8a7120 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c1fc87640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8a7120 0x55fa6b8a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c1fc87640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8a7120 0x55fa6b8a9510 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c1002a070 con 0x55fa6b8a7120 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c2373e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c2373e800 20 searching for the correct realm 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fa6b8abc00 0x55fa6b8ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.937+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8abc00 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.938+0000 7f6c1f486640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fa6b8abc00 0x55fa6b8ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.938+0000 7f6c1f486640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fa6b8abc00 0x55fa6b8ae0c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.938+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.938+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a7120 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.938+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c1002a070 con 0x55fa6b8a7120 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.938+0000 7f6c1fc87640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6c10014070 0x7f6c10051830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.938+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x7f6c10014070 2024-09-22T08:12:50.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.939+0000 7f6c1ec85640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6c10014070 0x7f6c10051830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.939+0000 7f6c1ec85640 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6c10014070 0x7f6c10051830 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.939+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08009050 con 0x7f6c10014070 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.939+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a2730 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.939+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08009050 con 0x55fa6b8a2730 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.939+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a2730 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.940+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.940+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x7f6c10014070 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.940+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.940+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a7120 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.940+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c1002a070 con 0x55fa6b8a7120 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.940+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a7120 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.940+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:50.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.940+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8abc00 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.941+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.941+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a2730 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.941+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.941+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x7f6c10014070 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.941+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.941+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a2730 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.941+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.941+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a7120 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.942+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.942+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8abc00 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.942+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.942+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8abc00 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.942+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.942+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x7f6c10014070 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.942+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.942+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8abc00 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.943+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.943+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8abc00 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.943+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.943+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a2730 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.943+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.943+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a2730 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.943+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.943+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x7f6c10014070 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.943+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.943+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8abc00 2024-09-22T08:12:50.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.944+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.944+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a7120 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.944+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.944+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a2730 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.944+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.944+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x7f6c10014070 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.944+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.944+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8abc00 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.945+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.945+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x7f6c10014070 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.945+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.945+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a7120 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.945+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:50.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.945+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8abc00 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.945+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.945+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x7f6c10014070 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.946+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.946+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a2730 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.946+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.946+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ae740 con 0x55fa6b8a7120 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:50.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8aa610 con 0x55fa6b8a2730 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8aaeb0 con 0x55fa6b8a2730 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8aebc0 con 0x55fa6b8a2730 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 zone default found 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 4 Realm: () 2024-09-22T08:12:50.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 zonegroup default 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.947+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8aef60 con 0x7f6c10014070 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c2373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b0d70 con 0x55fa6b8abc00 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c2373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b1230 con 0x55fa6b8abc00 2024-09-22T08:12:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c2373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c2373e800 20 started sync module instance, tier type = 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c2373e800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.948+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b0210 con 0x55fa6b8a7120 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.949+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.949+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94534034458112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8afe70 con 0x55fa6b8a7120 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.949+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b2160 con 0x55fa6b8a2730 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.950+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94534034458112] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.951+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.951+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94534034462352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b2160 con 0x55fa6b8a2730 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.951+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b2ba0 con 0x55fa6b8abc00 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.952+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94534034462352] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.952+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.952+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94534034463920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b20d0 con 0x55fa6b8abc00 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.952+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b3a60 con 0x55fa6b8a7120 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.953+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94534034463920] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.953+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.953+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94534034470320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b3e80 con 0x55fa6b8a7120 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.953+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b4840 con 0x55fa6b8a2730 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.954+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94534034470320] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.954+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.954+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94534034471856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b4840 con 0x55fa6b8a2730 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.954+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b5240 con 0x7f6c10014070 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.955+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94534034471856] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.955+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.955+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94534034476368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b4840 con 0x7f6c10014070 2024-09-22T08:12:50.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.956+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b5c50 con 0x7f6c10014070 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.957+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94534034476368] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.957+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.957+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94534034473872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b5e30 con 0x7f6c10014070 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.957+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b6680 con 0x7f6c10014070 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.958+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94534034473872] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.958+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.958+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94534034479968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b64b0 con 0x7f6c10014070 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.958+0000 7f6c2373e800 20 add_watcher() i=0 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.958+0000 7f6c2373e800 20 add_watcher() i=1 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.958+0000 7f6c2373e800 20 add_watcher() i=2 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.958+0000 7f6c2373e800 20 add_watcher() i=3 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.958+0000 7f6c2373e800 20 add_watcher() i=4 2024-09-22T08:12:50.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.958+0000 7f6c2373e800 20 add_watcher() i=5 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.958+0000 7f6c2373e800 20 add_watcher() i=6 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.959+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94534034479968] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.959+0000 7f6c2373e800 20 add_watcher() i=7 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.959+0000 7f6c2373e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.959+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b9b20 con 0x55fa6b8a2730 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.959+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.959+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94534034481024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8b6ea0 con 0x55fa6b8a2730 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.960+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94534034481024] v34'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.960+0000 7f6ad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.960+0000 7f6c2373e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.960+0000 7f6c2373e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.960+0000 7f6c2373e800 5 note: GC not initialized 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6ad4fe1640 20 reqs_thread_entry: start 2024-09-22T08:12:50.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 20 Filter name: none 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6a4e7fc640 20 reqs_thread_entry: start 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ecff0 con 0x55fa6b8abc00 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 20 rados->read ofs=0 len=0 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.961+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8eb550 con 0x55fa6b8abc00 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.962+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.998 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.962+0000 7f6c2373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.962+0000 7f6c2373e800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.962+0000 7f6c2373e800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.962+0000 7f6c2373e800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.962+0000 7f6c2373e800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.962+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ebdf0 con 0x55fa6b8abc00 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6c2373e800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6c2373e800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6c2373e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94534034700608 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8f0a90 con 0x55fa6b8abc00 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== watch-notify(notify (1) cookie 94534034463920 notify 146028888073 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55fa6b8ec190 con 0x55fa6b8abc00 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6b02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94534034463920 notifier 4857 bl.length()=542 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6b02ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-22T08:12:50.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6b02ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(65 notify.2 [notify cookie 94534034700608 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6b02ffd640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6ae4003ea0 con 0x55fa6b8abc00 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== watch-notify(notify_complete (2) cookie 94534034700608 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fa6b8ec940 con 0x55fa6b8abc00 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.963+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8eb940 con 0x55fa6b8abc00 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6c2373e800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6c2373e800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6c2373e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94534034700608 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8f0bf0 con 0x7f6c10014070 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== watch-notify(notify (1) cookie 94534034476368 notify 146028888110 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55fa6b5f9a20 con 0x7f6c10014070 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6b027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888110 cookie 94534034476368 notifier 4857 bl.length()=175 2024-09-22T08:12:51.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6b027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-22T08:12:51.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6b027fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-22T08:12:51.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6b027fc640 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6a54003400 con 0x7f6c10014070 2024-09-22T08:12:51.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(68 notify.5 [notify cookie 94534034700608 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:51.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:51.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.965+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== watch-notify(notify_complete (2) cookie 94534034700608 notify 146028888110 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6c0802e510 con 0x7f6c10014070 2024-09-22T08:12:51.001 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-22T08:12:50.962864Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.962855Z","tags":[],"group_ids":[]} 2024-09-22T08:12:51.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.966+0000 7f6ad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.966+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94534034481024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ead00 con 0x55fa6b8a2730 2024-09-22T08:12:51.006 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.967+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94534034481024] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.967+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94534034458112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ead00 con 0x55fa6b8a7120 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.968+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94534034458112] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.968+0000 7f6c2373e800 20 remove_watcher() i=0 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.968+0000 7f6c2373e800 2 removed watcher, disabling cache 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.968+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94534034462352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ead00 con 0x55fa6b8a2730 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.969+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94534034462352] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.969+0000 7f6c2373e800 20 remove_watcher() i=1 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.969+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94534034463920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ead00 con 0x55fa6b8abc00 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.970+0000 7f6c1f486640 1 -- 172.21.15.165:0/1648213022 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94534034463920] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c18090070 con 0x55fa6b8abc00 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.970+0000 7f6c2373e800 20 remove_watcher() i=2 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.970+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94534034470320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ead00 con 0x55fa6b8a7120 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.971+0000 7f6c1fc87640 1 -- 172.21.15.165:0/1648213022 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94534034470320] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c10064040 con 0x55fa6b8a7120 2024-09-22T08:12:51.007 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.971+0000 7f6c2373e800 20 remove_watcher() i=3 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.971+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94534034471856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ead00 con 0x55fa6b8a2730 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.972+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94534034471856] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x55fa6b8a2730 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.972+0000 7f6c2373e800 20 remove_watcher() i=4 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.972+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94534034476368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ead00 con 0x7f6c10014070 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.974+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94534034476368] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.974+0000 7f6c2373e800 20 remove_watcher() i=5 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.974+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94534034473872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ead00 con 0x7f6c10014070 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.975+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94534034473872] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.975+0000 7f6c2373e800 20 remove_watcher() i=6 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.975+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94534034479968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa6b8ead00 con 0x7f6c10014070 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94534034479968] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c08029040 con 0x7f6c10014070 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 20 remove_watcher() i=7 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6c10014070 msgr2=0x7f6c10051830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6c10014070 0x7f6c10051830 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b8a2730 msgr2=0x55fa6b8a4bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b8a2730 0x55fa6b8a4bf0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8a7120 msgr2=0x55fa6b8a9510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8a7120 0x55fa6b8a9510 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fa6b8abc00 msgr2=0x55fa6b8ae0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55fa6b8abc00 0x55fa6b8ae0c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6ae803cfb0 msgr2=0x7f6ae803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6ae803cfb0 0x7f6ae803f470 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6c1807ba50 tx=0x7f6c18080000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 msgr2=0x55fa6b896c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c1ec85640 1 -- 172.21.15.165:0/1648213022 reap_dead start 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.976+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b896c70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6c100014d0 tx=0x7f6c10011f60 comp rx=0 tx=0).stop 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 shutdown_connections 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1648213022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b88f670 0x55fa6b896c70 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.009 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 >> 172.21.15.165:0/1648213022 conn(0x55fa6b88ba70 msgr2=0x55fa6b889c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 shutdown_connections 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/1648213022 wait complete. 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/1245982418 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6af803d000 msgr2=0x7f6af803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1245982418 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6af803d000 0x7f6af803f4c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55fa6b869d60 tx=0x7f6c1807b9a0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/1245982418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b882c30 msgr2=0x55fa6b883050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1245982418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b882c30 0x55fa6b883050 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000a2a0 tx=0x7f6c10018830 comp rx=0 tx=0).stop 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/1245982418 shutdown_connections 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1245982418 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6af803d000 0x7f6af803f4c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 --2- 172.21.15.165:0/1245982418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b882c30 0x55fa6b883050 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/1245982418 >> 172.21.15.165:0/1245982418 conn(0x55fa6b876fe0 msgr2=0x55fa6b8773c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/1245982418 shutdown_connections 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/1245982418 wait complete. 2024-09-22T08:12:51.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b773d60 msgr2=0x55fa6b86f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b773d60 0x55fa6b86f2c0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8716a0 msgr2=0x55fa6b873b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8716a0 0x55fa6b873b20 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b0403cfb0 msgr2=0x7f6b0403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b0403cfb0 0x7f6b0403f470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6c08001d70 tx=0x7f6c080012d0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 msgr2=0x55fa6b867c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.977+0000 7f6c2373e800 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b867c70 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6c18025c20 tx=0x7f6c18002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.978+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 shutdown_connections 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.978+0000 7f6c2373e800 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55fa6b8716a0 0x55fa6b873b20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.978+0000 7f6c2373e800 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55fa6b773d60 0x55fa6b86f2c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.978+0000 7f6c2373e800 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f6b0403cfb0 0x7f6b0403f470 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.978+0000 7f6c2373e800 1 --2- 172.21.15.165:0/291556360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fa6b76ccf0 0x55fa6b867c70 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.978+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 >> 172.21.15.165:0/291556360 conn(0x55fa6b768360 msgr2=0x55fa6b85a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.978+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 shutdown_connections 2024-09-22T08:12:51.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:50.978+0000 7f6c2373e800 1 -- 172.21.15.165:0/291556360 wait complete. 2024-09-22T08:12:51.012 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-22T08:12:50.962864Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.962855Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.012 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-22T08:12:50.962864Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.962855Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.012 ERROR:root:0 2024-09-22T08:12:51.013 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:51.016 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:51.017 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-22T08:12:51.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-22T08:12:51.017 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-22T08:12:51.061 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:51.062 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:51.062 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.061+0000 7f5952940800 1 Processor -- start 2024-09-22T08:12:51.062 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.062+0000 7f5952940800 1 -- start start 2024-09-22T08:12:51.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.062+0000 7f5952940800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555cf80aabf0 0x555cf80b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.062+0000 7f5952940800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555cf7f35a20 con 0x555cf80a97e0 2024-09-22T08:12:51.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.062+0000 7f5952940800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555cf7f357d0 con 0x555cf80aabf0 2024-09-22T08:12:51.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.062+0000 7f5947fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555cf80aabf0 0x555cf80b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.062+0000 7f594e6c0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x555cf80a97e0 0x555cf80aa4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:57816/0 (socket says 172.21.15.165:57816) 2024-09-22T08:12:51.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.062+0000 7f594e6c0640 1 -- 172.21.15.165:0/887174238 learned_addr learned my addr 172.21.15.165:0/887174238 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:51.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.062+0000 7f5947fff640 1 --2- 172.21.15.165:0/887174238 >> v2:172.21.15.53:3300/0 conn(0x555cf80aabf0 0x555cf80b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34422/0 (socket says 172.21.15.165:34422) 2024-09-22T08:12:51.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.062+0000 7f5947fff640 1 -- 172.21.15.165:0/887174238 >> v1:172.21.15.53:6789/0 conn(0x555cf80a97e0 legacy=0x555cf80aa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.062+0000 7f5947fff640 1 -- 172.21.15.165:0/887174238 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf80a9ee0 con 0x555cf80aabf0 2024-09-22T08:12:51.065 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.064+0000 7f5947fff640 1 --2- 172.21.15.165:0/887174238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80aabf0 0x555cf80b0580 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f593800a470 tx=0x7f5938045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c848189ecd1d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.065 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.064+0000 7f594debf640 1 -- 172.21.15.165:0/887174238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5938053570 con 0x555cf80aabf0 2024-09-22T08:12:51.065 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.064+0000 7f594debf640 1 -- 172.21.15.165:0/887174238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5938058070 con 0x555cf80aabf0 2024-09-22T08:12:51.065 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.064+0000 7f594debf640 1 -- 172.21.15.165:0/887174238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5938053880 con 0x555cf80aabf0 2024-09-22T08:12:51.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.065+0000 7f5952940800 1 -- 172.21.15.165:0/887174238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80aabf0 msgr2=0x555cf80b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.065+0000 7f5952940800 1 --2- 172.21.15.165:0/887174238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80aabf0 0x555cf80b0580 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f593800a470 tx=0x7f5938045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:51.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.065+0000 7f5952940800 1 -- 172.21.15.165:0/887174238 shutdown_connections 2024-09-22T08:12:51.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.065+0000 7f5952940800 1 --2- 172.21.15.165:0/887174238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80aabf0 0x555cf80b0580 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.065+0000 7f5952940800 1 -- 172.21.15.165:0/887174238 >> 172.21.15.165:0/887174238 conn(0x555cf80a4bb0 msgr2=0x555cf80a7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.065+0000 7f5952940800 1 -- 172.21.15.165:0/887174238 shutdown_connections 2024-09-22T08:12:51.067 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.065+0000 7f5952940800 1 -- 172.21.15.165:0/887174238 wait complete. 2024-09-22T08:12:51.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.079+0000 7f5952940800 1 Processor -- start 2024-09-22T08:12:51.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.079+0000 7f5952940800 1 -- start start 2024-09-22T08:12:51.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.079+0000 7f5952940800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf8198f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.079+0000 7f5952940800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555cf7f42dd0 con 0x555cf80a97e0 2024-09-22T08:12:51.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.079+0000 7f594e6c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf8198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.079+0000 7f594e6c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf8198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34426/0 (socket says 172.21.15.165:34426) 2024-09-22T08:12:51.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.079+0000 7f594e6c0640 1 -- 172.21.15.165:0/839816158 learned_addr learned my addr 172.21.15.165:0/839816158 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.080+0000 7f594e6c0640 1 -- 172.21.15.165:0/839816158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf81994f0 con 0x555cf80a97e0 2024-09-22T08:12:51.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.080+0000 7f594e6c0640 1 --2- 172.21.15.165:0/839816158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf8198f00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5940001e40 tx=0x7f5940001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76627e521f1e3b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.080+0000 7f583c608640 1 -- 172.21.15.165:0/839816158 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5940012020 con 0x555cf80a97e0 2024-09-22T08:12:51.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.080+0000 7f583c608640 1 -- 172.21.15.165:0/839816158 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594000e5a0 con 0x555cf80a97e0 2024-09-22T08:12:51.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.080+0000 7f583c608640 1 -- 172.21.15.165:0/839816158 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f594000e8a0 con 0x555cf80a97e0 2024-09-22T08:12:51.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 -- 172.21.15.165:0/839816158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 msgr2=0x555cf8198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 --2- 172.21.15.165:0/839816158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf8198f00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5940001e40 tx=0x7f5940001e70 comp rx=0 tx=0).stop 2024-09-22T08:12:51.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 -- 172.21.15.165:0/839816158 shutdown_connections 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 --2- 172.21.15.165:0/839816158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf8198f00 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 -- 172.21.15.165:0/839816158 >> 172.21.15.165:0/839816158 conn(0x555cf80a4bb0 msgr2=0x555cf8194880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 -- 172.21.15.165:0/839816158 shutdown_connections 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 -- 172.21.15.165:0/839816158 wait complete. 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 Processor -- start 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 -- start start 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf801d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f5952940800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555cf80b0ac0 con 0x555cf80a97e0 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f594e6c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf801d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f594e6c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf801d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34440/0 (socket says 172.21.15.165:34440) 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.081+0000 7f594e6c0640 1 -- 172.21.15.165:0/202146309 learned_addr learned my addr 172.21.15.165:0/202146309 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.082+0000 7f594e6c0640 1 -- 172.21.15.165:0/202146309 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf801dec0 con 0x555cf80a97e0 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.082+0000 7f594e6c0640 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf801d960 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f594000c010 tx=0x7f5940000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.082+0000 7f583ae05640 1 -- 172.21.15.165:0/202146309 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5940012030 con 0x555cf80a97e0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.082+0000 7f583ae05640 1 -- 172.21.15.165:0/202146309 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59400014a0 con 0x555cf80a97e0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.082+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555cf81a4790 con 0x555cf80a97e0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.082+0000 7f583ae05640 1 -- 172.21.15.165:0/202146309 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f594001a7a0 con 0x555cf80a97e0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.082+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf81a4d50 con 0x555cf80a97e0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.083+0000 7f583ae05640 1 -- 172.21.15.165:0/202146309 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5940015020 con 0x555cf80a97e0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.083+0000 7f583ae05640 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f583403cfb0 0x7f583403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.083+0000 7f583ae05640 1 -- 172.21.15.165:0/202146309 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5940020030 con 0x555cf80a97e0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.083+0000 7f5947fff640 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f583403cfb0 0x7f583403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.083+0000 7f5952940800 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf80aabf0 0x555cf81a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.083+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81a9350 con 0x555cf80aabf0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.084+0000 7f594eec1640 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf80aabf0 0x555cf81a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.084+0000 7f5947fff640 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f583403cfb0 0x7f583403f470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5938057000 tx=0x7f5938052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.084+0000 7f594eec1640 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf80aabf0 0x555cf81a8ce0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.084+0000 7f594eec1640 1 -- 172.21.15.165:0/202146309 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f594800a4d0 con 0x555cf80aabf0 2024-09-22T08:12:51.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.084+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81a6190 con 0x555cf80aabf0 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.085+0000 7f594eec1640 1 -- 172.21.15.165:0/202146309 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f594800a4d0 con 0x555cf80aabf0 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.085+0000 7f5952940800 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81ab6a0 0x555cf81ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.085+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ae160 con 0x555cf81ab6a0 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.085+0000 7f594e6c0640 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81ab6a0 0x555cf81ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.085+0000 7f594e6c0640 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81ab6a0 0x555cf81ada90 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.085+0000 7f594e6c0640 1 -- 172.21.15.165:0/202146309 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81ab6a0 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.085+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81aa540 con 0x555cf80aabf0 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.085+0000 7f594eec1640 1 -- 172.21.15.165:0/202146309 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f594800a4d0 con 0x555cf80aabf0 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.085+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81aa9e0 con 0x555cf80aabf0 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.086+0000 7f594eec1640 1 -- 172.21.15.165:0/202146309 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f594800a4d0 con 0x555cf80aabf0 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.086+0000 7f5952940800 1 Processor -- start 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.086+0000 7f5952940800 1 -- start start 2024-09-22T08:12:51.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.086+0000 7f5952940800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81bcae0 0x555cf81bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.086+0000 7f5952940800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555cf7fa1d50 con 0x555cf81bcae0 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.087+0000 7f594eec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81bcae0 0x555cf81bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.087+0000 7f594eec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81bcae0 0x555cf81bcf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34454/0 (socket says 172.21.15.165:34454) 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.087+0000 7f594eec1640 1 -- 172.21.15.165:0/3073631286 learned_addr learned my addr 172.21.15.165:0/3073631286 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.087+0000 7f594eec1640 1 -- 172.21.15.165:0/3073631286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf81bd540 con 0x555cf81bcae0 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.087+0000 7f594eec1640 1 --2- 172.21.15.165:0/3073631286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81bcae0 0x555cf81bcf00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x555cf81a9750 tx=0x7f5948018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.087+0000 7f5833fff640 1 -- 172.21.15.165:0/3073631286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5948014450 con 0x555cf81bcae0 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.087+0000 7f5833fff640 1 -- 172.21.15.165:0/3073631286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59480145f0 con 0x555cf81bcae0 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.087+0000 7f5952940800 1 -- 172.21.15.165:0/3073631286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555cf81bdd70 con 0x555cf81bcae0 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.087+0000 7f5833fff640 1 -- 172.21.15.165:0/3073631286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5948014910 con 0x555cf81bcae0 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.087+0000 7f5952940800 1 -- 172.21.15.165:0/3073631286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf81be310 con 0x555cf81bcae0 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.088+0000 7f5833fff640 1 -- 172.21.15.165:0/3073631286 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5948011040 con 0x555cf81bcae0 2024-09-22T08:12:51.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.088+0000 7f5833fff640 1 --2- 172.21.15.165:0/3073631286 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f582803cfb0 0x7f582803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f5833fff640 1 -- 172.21.15.165:0/3073631286 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f594801e070 con 0x555cf81bcae0 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f594e6c0640 1 --2- 172.21.15.165:0/3073631286 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f582803cfb0 0x7f582803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f5952940800 1 Processor -- start 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f594e6c0640 1 --2- 172.21.15.165:0/3073631286 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f582803cfb0 0x7f582803f470 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x555cf81a97f0 tx=0x7f59400529c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f5952940800 1 -- start start 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f5952940800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81c9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f5952940800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555cf8199920 con 0x555cf81c95a0 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f594eec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f594eec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34456/0 (socket says 172.21.15.165:34456) 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f594eec1640 1 -- 172.21.15.165:0/1932624387 learned_addr learned my addr 172.21.15.165:0/1932624387 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.089+0000 7f594eec1640 1 -- 172.21.15.165:0/1932624387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf81c9f70 con 0x555cf81c95a0 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f594eec1640 1 --2- 172.21.15.165:0/1932624387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81c9980 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5948016fd0 tx=0x7f5948011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a5eed78932bf82 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f5831ffb640 1 -- 172.21.15.165:0/1932624387 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f594804b070 con 0x555cf81c95a0 2024-09-22T08:12:51.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f5831ffb640 1 -- 172.21.15.165:0/1932624387 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5948051070 con 0x555cf81c95a0 2024-09-22T08:12:51.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f5831ffb640 1 -- 172.21.15.165:0/1932624387 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5948022db0 con 0x555cf81c95a0 2024-09-22T08:12:51.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f5952940800 1 -- 172.21.15.165:0/1932624387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 msgr2=0x555cf81c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f5952940800 1 --2- 172.21.15.165:0/1932624387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81c9980 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5948016fd0 tx=0x7f5948011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:51.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f5952940800 1 -- 172.21.15.165:0/1932624387 shutdown_connections 2024-09-22T08:12:51.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f5952940800 1 --2- 172.21.15.165:0/1932624387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81c9980 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f5952940800 1 -- 172.21.15.165:0/1932624387 >> 172.21.15.165:0/1932624387 conn(0x555cf81c59a0 msgr2=0x555cf81c3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f5952940800 1 -- 172.21.15.165:0/1932624387 shutdown_connections 2024-09-22T08:12:51.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.090+0000 7f5952940800 1 -- 172.21.15.165:0/1932624387 wait complete. 2024-09-22T08:12:51.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.091+0000 7f5952940800 1 Processor -- start 2024-09-22T08:12:51.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.091+0000 7f5952940800 1 -- start start 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.091+0000 7f5952940800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.091+0000 7f5952940800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555cf81ca5b0 con 0x555cf81c95a0 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.091+0000 7f594eec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.091+0000 7f594eec1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81d0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:34458/0 (socket says 172.21.15.165:34458) 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.091+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 learned_addr learned my addr 172.21.15.165:0/1714216794 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.091+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf81d10b0 con 0x555cf81c95a0 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.091+0000 7f594eec1640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81d0b50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5948016fd0 tx=0x7f5948054740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.092+0000 7f581ffff640 1 -- 172.21.15.165:0/1714216794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f594804b040 con 0x555cf81c95a0 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.092+0000 7f581ffff640 1 -- 172.21.15.165:0/1714216794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5948011330 con 0x555cf81c95a0 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.092+0000 7f581ffff640 1 -- 172.21.15.165:0/1714216794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5948056070 con 0x555cf81c95a0 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.092+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555cf81d1340 con 0x555cf81c95a0 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.092+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf81d1ed0 con 0x555cf81c95a0 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.093+0000 7f581ffff640 1 -- 172.21.15.165:0/1714216794 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5948056210 con 0x555cf81c95a0 2024-09-22T08:12:51.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.093+0000 7f581ffff640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f581803cfb0 0x7f581803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.093+0000 7f581ffff640 1 -- 172.21.15.165:0/1714216794 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f594800e040 con 0x555cf81c95a0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.093+0000 7f594e6c0640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f581803cfb0 0x7f581803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.093+0000 7f594e6c0640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f581803cfb0 0x7f581803f470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5940001250 tx=0x7f5940042000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.093+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.093+0000 7f5952940800 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf81dc6b0 0x555cf81deb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.093+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81df2c0 con 0x555cf81dc6b0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5947fff640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf81dc6b0 0x555cf81deb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5947fff640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf81dc6b0 0x555cf81deb70 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5952940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5952940800 20 realm 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81df6f0 con 0x555cf81dc6b0 2024-09-22T08:12:51.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5952940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5952940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.094+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81dffc0 con 0x555cf81dc6b0 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f5952940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e0360 con 0x555cf81dc6b0 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f5952940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f5952940800 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81e10c0 0x555cf81e34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e3ac0 con 0x555cf81e10c0 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f594eec1640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81e10c0 0x555cf81e34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f594eec1640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81e10c0 0x555cf81e34b0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.095+0000 7f5952940800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.096+0000 7f5952940800 20 searching for the correct realm 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.096+0000 7f5952940800 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555cf81e5a70 0x555cf81e7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.096+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e5a70 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.096+0000 7f594e6c0640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555cf81e5a70 0x555cf81e7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.096+0000 7f594e6c0640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555cf81e5a70 0x555cf81e7f30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.096+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.096+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e10c0 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.096+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.096+0000 7f594eec1640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5948037070 0x7f594802d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.096+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x7f5948037070 2024-09-22T08:12:51.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.097+0000 7f5947fff640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5948037070 0x7f594802d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.097+0000 7f5947fff640 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5948037070 0x7f594802d990 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.098+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.098+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81dc6b0 2024-09-22T08:12:51.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.098+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.098+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81dc6b0 2024-09-22T08:12:51.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.099+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.099+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x7f5948037070 2024-09-22T08:12:51.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.099+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.099+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e10c0 2024-09-22T08:12:51.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.099+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.099+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e10c0 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.100+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.100+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e5a70 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.100+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.100+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81dc6b0 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.100+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.100+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x7f5948037070 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.101+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.101+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81dc6b0 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.101+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.101+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e10c0 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.101+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.101+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e5a70 2024-09-22T08:12:51.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.102+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.102+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e5a70 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.102+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.102+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x7f5948037070 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.102+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.102+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e5a70 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.103+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.103+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e5a70 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.103+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.103+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81dc6b0 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.103+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.103+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81dc6b0 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.103+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.103+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x7f5948037070 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.104+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.104+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e5a70 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.104+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.104+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e10c0 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.105+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.105+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81dc6b0 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.105+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.105+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x7f5948037070 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.105+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.105+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e5a70 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.105+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.105+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x7f5948037070 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.106+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.106+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e10c0 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.106+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.106+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e5a70 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.106+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.106+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x7f5948037070 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.106+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.106+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81dc6b0 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e85b0 con 0x555cf81e10c0 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:51.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e4480 con 0x555cf81dc6b0 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e4d20 con 0x555cf81dc6b0 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.107+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e8a30 con 0x555cf81dc6b0 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 20 zone default found 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 4 Realm: () 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 20 zonegroup default 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e8df0 con 0x7f5948037070 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81eac20 con 0x555cf81e5a70 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81eb0b0 con 0x555cf81e5a70 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.108+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.109+0000 7f5952940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.109+0000 7f5952940800 20 started sync module instance, tier type = 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.109+0000 7f5952940800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.109+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ea0c0 con 0x555cf81e10c0 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.110+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.110+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93857788110000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81e9d20 con 0x555cf81e10c0 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.110+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ebfe0 con 0x555cf81dc6b0 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.111+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93857788110000] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.111+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.111+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93857788114192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ebfe0 con 0x555cf81dc6b0 2024-09-22T08:12:51.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.111+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81eca90 con 0x555cf81e5a70 2024-09-22T08:12:51.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.112+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93857788114192] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.112+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.112+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93857788115760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ebf50 con 0x555cf81e5a70 2024-09-22T08:12:51.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.112+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ed950 con 0x555cf81e10c0 2024-09-22T08:12:51.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.113+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93857788115760] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.113+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.113+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93857788122272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ed8c0 con 0x555cf81e10c0 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.113+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ee810 con 0x555cf81dc6b0 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.114+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93857788122272] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.115+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.115+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93857788124480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ee810 con 0x555cf81dc6b0 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.115+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ef1d0 con 0x7f5948037070 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.116+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93857788124480] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.116+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.116+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93857788126048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ef1d0 con 0x7f5948037070 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.116+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81efbd0 con 0x7f5948037070 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.117+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93857788126048] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.117+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.117+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93857788128544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81efd70 con 0x7f5948037070 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.117+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81f05c0 con 0x7f5948037070 2024-09-22T08:12:51.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.118+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93857788128544] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.118+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.118+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93857788132000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81f0470 con 0x7f5948037070 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.118+0000 7f5952940800 20 add_watcher() i=0 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.118+0000 7f5952940800 20 add_watcher() i=1 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.118+0000 7f5952940800 20 add_watcher() i=2 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.118+0000 7f5952940800 20 add_watcher() i=3 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.118+0000 7f5952940800 20 add_watcher() i=4 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.118+0000 7f5952940800 20 add_watcher() i=5 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.118+0000 7f5952940800 20 add_watcher() i=6 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.119+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93857788132000] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.119+0000 7f5952940800 20 add_watcher() i=7 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.119+0000 7f5952940800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:51.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.119+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf81f3ab0 con 0x555cf81dc6b0 2024-09-22T08:12:51.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.120+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.120+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93857788133120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81f3ab0 con 0x555cf81dc6b0 2024-09-22T08:12:51.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.121+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93857788133120] v34'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.121+0000 7f5804fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.121+0000 7f5952940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:51.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.121+0000 7f5952940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:51.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.121+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fc5e0 con 0x555cf81dc6b0 2024-09-22T08:12:51.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.122+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.122+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fcc90 con 0x7f5948037070 2024-09-22T08:12:51.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.123+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.123+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fd0d0 con 0x555cf81e5a70 2024-09-22T08:12:51.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.124+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.124+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fdaf0 con 0x555cf81dc6b0 2024-09-22T08:12:51.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.125+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.125+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fa480 con 0x555cf81e10c0 2024-09-22T08:12:51.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.126+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.126+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fa480 con 0x555cf81e5a70 2024-09-22T08:12:51.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.127+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.127+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fa480 con 0x555cf81dc6b0 2024-09-22T08:12:51.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.128+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.128+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fa620 con 0x7f5948037070 2024-09-22T08:12:51.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.130+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'54 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.130+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fa620 con 0x555cf81e10c0 2024-09-22T08:12:51.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.131+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.131+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fa620 con 0x555cf81e5a70 2024-09-22T08:12:51.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.132+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.132+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe610 con 0x555cf81e10c0 2024-09-22T08:12:51.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.133+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.133+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe610 con 0x7f5948037070 2024-09-22T08:12:51.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.134+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'37 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.134+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe610 con 0x555cf81e10c0 2024-09-22T08:12:51.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.135+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.135+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe610 con 0x7f5948037070 2024-09-22T08:12:51.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.136+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.136+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe610 con 0x555cf81dc6b0 2024-09-22T08:12:51.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.137+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.137+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe610 con 0x555cf81e5a70 2024-09-22T08:12:51.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.138+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'74 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.138+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe6a0 con 0x555cf81e10c0 2024-09-22T08:12:51.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.139+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.139+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feb50 con 0x555cf81e5a70 2024-09-22T08:12:51.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.140+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.140+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feb50 con 0x555cf81dc6b0 2024-09-22T08:12:51.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.142+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.142+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feb50 con 0x555cf81dc6b0 2024-09-22T08:12:51.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.143+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.143+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feb50 con 0x555cf81e5a70 2024-09-22T08:12:51.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.144+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'75 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.144+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feac0 con 0x555cf81e10c0 2024-09-22T08:12:51.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.145+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.145+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feac0 con 0x555cf81e5a70 2024-09-22T08:12:51.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.146+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.146 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.146+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feac0 con 0x555cf81e5a70 2024-09-22T08:12:51.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.147+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.147+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feac0 con 0x555cf81e5a70 2024-09-22T08:12:51.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.148+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.148+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feac0 con 0x555cf81e5a70 2024-09-22T08:12:51.149 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.149+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.150 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.149+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feb30 con 0x7f5948037070 2024-09-22T08:12:51.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.150+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.150+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81feb30 con 0x555cf81e5a70 2024-09-22T08:12:51.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.151+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.152 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.151+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe640 con 0x7f5948037070 2024-09-22T08:12:51.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.152+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'55 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.152+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe640 con 0x555cf81e5a70 2024-09-22T08:12:51.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.153+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'76 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.153+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe610 con 0x7f5948037070 2024-09-22T08:12:51.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.154+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.155 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.155+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81fe650 con 0x555cf81e10c0 2024-09-22T08:12:51.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.156+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.156+0000 7f577f7fe640 20 reqs_thread_entry: start 2024-09-22T08:12:51.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.156+0000 7f5952940800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:51.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.156+0000 7f5952940800 20 Filter name: none 2024-09-22T08:12:51.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.156+0000 7f577d7fa640 20 reqs_thread_entry: start 2024-09-22T08:12:51.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.156+0000 7f5952940800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-22T08:12:51.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.156+0000 7f5952940800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.156+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf82298d0 con 0x555cf81e5a70 2024-09-22T08:12:51.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.157+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.157+0000 7f5952940800 20 rados_obj.operate() r=0 bl.length=363 2024-09-22T08:12:51.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.157+0000 7f5952940800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-22T08:12:51.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.157+0000 7f5952940800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-22T08:12:51.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.157+0000 7f5952940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:51.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.157+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf822bfb0 con 0x555cf81e5a70 2024-09-22T08:12:51.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.157+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f594001ab20 con 0x555cf81e5a70 2024-09-22T08:12:51.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.157+0000 7f5952940800 10 removing key index: true_admin_akey 2024-09-22T08:12:51.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.157+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf822bf70 con 0x555cf81e5a70 2024-09-22T08:12:51.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.158+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(96 true_admin_akey [delete] v34'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f594003c040 con 0x555cf81e5a70 2024-09-22T08:12:51.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.158+0000 7f5952940800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-22T08:12:51.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.158+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 93857788377856 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf822af40 con 0x7f5948037070 2024-09-22T08:12:51.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.158+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== watch-notify(notify (1) cookie 93857788126048 notify 146028888111 ret 0) ==== 207+0+0 (crc 0 0 0) 0x555cf81fabe0 con 0x7f5948037070 2024-09-22T08:12:51.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.158+0000 7f5831ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888111 cookie 93857788126048 notifier 4864 bl.length()=165 2024-09-22T08:12:51.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.158+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(97 notify.5 [notify cookie 93857788377856 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.158+0000 7f5831ffb640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5814003d60 con 0x7f5948037070 2024-09-22T08:12:51.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.159+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.159+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== watch-notify(notify_complete (2) cookie 93857788377856 notify 146028888111 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555cf81fbff0 con 0x7f5948037070 2024-09-22T08:12:51.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.159+0000 7f5952940800 10 removing email index: 2024-09-22T08:12:51.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.159+0000 7f5952940800 10 removing user buckets index 2024-09-22T08:12:51.161 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.159+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf822bb00 con 0x555cf81e5a70 2024-09-22T08:12:51.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.160+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== osd_op_reply(99 a_user.buckets [delete] v34'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f594003c040 con 0x555cf81e5a70 2024-09-22T08:12:51.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.160+0000 7f5952940800 10 removing user index: a_user 2024-09-22T08:12:51.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.160+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf822aa90 con 0x555cf81e5a70 2024-09-22T08:12:51.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.161+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(100 a_user [call,call,delete] v34'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f594003c040 con 0x555cf81e5a70 2024-09-22T08:12:51.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.161+0000 7f5952940800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-22T08:12:51.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.161+0000 7f5952940800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-22T08:12:51.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.161+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 93857788375856 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555cf822aa40 con 0x555cf81e5a70 2024-09-22T08:12:51.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.161+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 31 ==== watch-notify(notify (1) cookie 93857788115760 notify 146028888074 ret 0) ==== 197+0+0 (crc 0 0 0) 0x555cf81d1ed0 con 0x555cf81e5a70 2024-09-22T08:12:51.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.161+0000 7f58317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 93857788115760 notifier 4864 bl.length()=155 2024-09-22T08:12:51.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.161+0000 7f58317fa640 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f57840032c0 con 0x555cf81e5a70 2024-09-22T08:12:51.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.161+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 32 ==== osd_op_reply(101 notify.2 [notify cookie 93857788375856 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f594003c040 con 0x555cf81e5a70 2024-09-22T08:12:51.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.161+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 33 ==== watch-notify(notify_complete (2) cookie 93857788375856 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555cf81fcc90 con 0x555cf81e5a70 2024-09-22T08:12:51.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.161+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f594003c040 con 0x555cf81e5a70 2024-09-22T08:12:51.164 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.162+0000 7f5804fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.164 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.162+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93857788133120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81f2250 con 0x555cf81dc6b0 2024-09-22T08:12:51.164 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.163+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93857788133120] v34'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.164 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.163+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93857788110000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81efec0 con 0x555cf81e10c0 2024-09-22T08:12:51.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.164+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93857788110000] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.164+0000 7f5952940800 20 remove_watcher() i=0 2024-09-22T08:12:51.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.164+0000 7f5952940800 2 removed watcher, disabling cache 2024-09-22T08:12:51.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.164+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93857788114192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ea4b0 con 0x555cf81dc6b0 2024-09-22T08:12:51.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.165+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93857788114192] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.165+0000 7f5952940800 20 remove_watcher() i=1 2024-09-22T08:12:51.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.165+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93857788115760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ea4b0 con 0x555cf81e5a70 2024-09-22T08:12:51.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.166+0000 7f594e6c0640 1 -- 172.21.15.165:0/1714216794 <== osd.3 v2:172.21.15.165:6800/215521179 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93857788115760] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f594003c040 con 0x555cf81e5a70 2024-09-22T08:12:51.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.166+0000 7f5952940800 20 remove_watcher() i=2 2024-09-22T08:12:51.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.166+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93857788122272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ebb30 con 0x555cf81e10c0 2024-09-22T08:12:51.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.167+0000 7f594eec1640 1 -- 172.21.15.165:0/1714216794 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93857788122272] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f594802a070 con 0x555cf81e10c0 2024-09-22T08:12:51.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.167+0000 7f5952940800 20 remove_watcher() i=3 2024-09-22T08:12:51.168 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.167+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93857788124480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ea4b0 con 0x555cf81dc6b0 2024-09-22T08:12:51.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.169+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93857788124480] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x555cf81dc6b0 2024-09-22T08:12:51.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.169+0000 7f5952940800 20 remove_watcher() i=4 2024-09-22T08:12:51.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.169+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93857788126048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ed4a0 con 0x7f5948037070 2024-09-22T08:12:51.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.170+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93857788126048] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.170+0000 7f5952940800 20 remove_watcher() i=5 2024-09-22T08:12:51.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.170+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93857788128544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ebb30 con 0x7f5948037070 2024-09-22T08:12:51.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.171+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93857788128544] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.171+0000 7f5952940800 20 remove_watcher() i=6 2024-09-22T08:12:51.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.171+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93857788132000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555cf81ea4b0 con 0x7f5948037070 2024-09-22T08:12:51.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93857788132000] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5938051070 con 0x7f5948037070 2024-09-22T08:12:51.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 20 remove_watcher() i=7 2024-09-22T08:12:51.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5948037070 msgr2=0x7f594802d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f5948037070 0x7f594802d990 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf81dc6b0 msgr2=0x555cf81deb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf81dc6b0 0x555cf81deb70 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81e10c0 msgr2=0x555cf81e34b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81e10c0 0x555cf81e34b0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555cf81e5a70 msgr2=0x555cf81e7f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x555cf81e5a70 0x555cf81e7f30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f581803cfb0 msgr2=0x7f581803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f581803cfb0 0x7f581803f470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5940001250 tx=0x7f5940042000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 msgr2=0x555cf81d0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81d0b50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5948016fd0 tx=0x7f5948054740 comp rx=0 tx=0).stop 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5947fff640 1 -- 172.21.15.165:0/1714216794 reap_dead start 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 shutdown_connections 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 --2- 172.21.15.165:0/1714216794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81c95a0 0x555cf81d0b50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 >> 172.21.15.165:0/1714216794 conn(0x555cf81c59a0 msgr2=0x555cf81c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 shutdown_connections 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.172+0000 7f5952940800 1 -- 172.21.15.165:0/1714216794 wait complete. 2024-09-22T08:12:51.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/3073631286 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f582803cfb0 msgr2=0x7f582803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/3073631286 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f582803cfb0 0x7f582803f470 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x555cf81a97f0 tx=0x7f59400529c0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/3073631286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81bcae0 msgr2=0x555cf81bcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/3073631286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81bcae0 0x555cf81bcf00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x555cf81a9750 tx=0x7f5948018830 comp rx=0 tx=0).stop 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/3073631286 shutdown_connections 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/3073631286 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f582803cfb0 0x7f582803f470 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/3073631286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf81bcae0 0x555cf81bcf00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/3073631286 >> 172.21.15.165:0/3073631286 conn(0x555cf81b0e90 msgr2=0x555cf81b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/3073631286 shutdown_connections 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/3073631286 wait complete. 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf80aabf0 msgr2=0x555cf81a8ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf80aabf0 0x555cf81a8ce0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81ab6a0 msgr2=0x555cf81ada90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81ab6a0 0x555cf81ada90 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f583403cfb0 msgr2=0x7f583403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f583403cfb0 0x7f583403f470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5938057000 tx=0x7f5938052000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 msgr2=0x555cf801d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf801d960 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f594000c010 tx=0x7f5940000ed0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 shutdown_connections 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x555cf81ab6a0 0x555cf81ada90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x555cf80aabf0 0x555cf81a8ce0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f583403cfb0 0x7f583403f470 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 --2- 172.21.15.165:0/202146309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555cf80a97e0 0x555cf801d960 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 >> 172.21.15.165:0/202146309 conn(0x555cf80a4bb0 msgr2=0x555cf819a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 shutdown_connections 2024-09-22T08:12:51.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.173+0000 7f5952940800 1 -- 172.21.15.165:0/202146309 wait complete. 2024-09-22T08:12:51.184 ERROR:root:None 2024-09-22T08:12:51.184 ERROR:root:0 2024-09-22T08:12:51.184 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-22T08:12:51.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-22T08:12:51.184 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-22T08:12:51.233 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:51.234 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:51.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.234+0000 7fb19e519800 1 Processor -- start 2024-09-22T08:12:51.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.234+0000 7fb19e519800 1 -- start start 2024-09-22T08:12:51.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.234+0000 7fb19e519800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55788caffcb0 0x55788cb05640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.234+0000 7fb19e519800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55788c989a20 con 0x55788cafe9e0 2024-09-22T08:12:51.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.234+0000 7fb19e519800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55788c9897d0 con 0x55788caffcb0 2024-09-22T08:12:51.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.234+0000 7fb193802640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55788caffcb0 0x55788cb05640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.234+0000 7fb19c003640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55788cafe9e0 0x55788caff5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:55176/0 (socket says 172.21.15.165:55176) 2024-09-22T08:12:51.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.234+0000 7fb19c003640 1 -- 172.21.15.165:0/1639389400 learned_addr learned my addr 172.21.15.165:0/1639389400 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:51.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.235+0000 7fb193802640 1 -- 172.21.15.165:0/1639389400 >> v1:172.21.15.53:6789/0 conn(0x55788cafe9e0 legacy=0x55788caff5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.235+0000 7fb193802640 1 -- 172.21.15.165:0/1639389400 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788caff0e0 con 0x55788caffcb0 2024-09-22T08:12:51.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.236+0000 7fb193802640 1 --2- 172.21.15.165:0/1639389400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788caffcb0 0x55788cb05640 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb18400a470 tx=0x7fb184045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf7ff8e2776de98 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.237+0000 7fb19b802640 1 -- 172.21.15.165:0/1639389400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb184053570 con 0x55788caffcb0 2024-09-22T08:12:51.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.237+0000 7fb19b802640 1 -- 172.21.15.165:0/1639389400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb184058070 con 0x55788caffcb0 2024-09-22T08:12:51.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.237+0000 7fb19b802640 1 -- 172.21.15.165:0/1639389400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb184053880 con 0x55788caffcb0 2024-09-22T08:12:51.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.237+0000 7fb19e519800 1 -- 172.21.15.165:0/1639389400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788caffcb0 msgr2=0x55788cb05640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.237+0000 7fb19e519800 1 --2- 172.21.15.165:0/1639389400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788caffcb0 0x55788cb05640 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb18400a470 tx=0x7fb184045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:51.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.237+0000 7fb19e519800 1 -- 172.21.15.165:0/1639389400 shutdown_connections 2024-09-22T08:12:51.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.237+0000 7fb19e519800 1 --2- 172.21.15.165:0/1639389400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788caffcb0 0x55788cb05640 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.237+0000 7fb19e519800 1 -- 172.21.15.165:0/1639389400 >> 172.21.15.165:0/1639389400 conn(0x55788caf9db0 msgr2=0x55788cafc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.237+0000 7fb19e519800 1 -- 172.21.15.165:0/1639389400 shutdown_connections 2024-09-22T08:12:51.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.237+0000 7fb19e519800 1 -- 172.21.15.165:0/1639389400 wait complete. 2024-09-22T08:12:51.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.251+0000 7fb19e519800 1 Processor -- start 2024-09-22T08:12:51.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.251+0000 7fb19e519800 1 -- start start 2024-09-22T08:12:51.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.251+0000 7fb19e519800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788ca74290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.251+0000 7fb19e519800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55788c996dd0 con 0x55788cafe9e0 2024-09-22T08:12:51.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.251+0000 7fb19c003640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788ca74290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.252+0000 7fb19c003640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788ca74290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59608/0 (socket says 172.21.15.165:59608) 2024-09-22T08:12:51.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.252+0000 7fb19c003640 1 -- 172.21.15.165:0/2746441670 learned_addr learned my addr 172.21.15.165:0/2746441670 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.252+0000 7fb19c003640 1 -- 172.21.15.165:0/2746441670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788ca74880 con 0x55788cafe9e0 2024-09-22T08:12:51.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.252+0000 7fb19c003640 1 --2- 172.21.15.165:0/2746441670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788ca74290 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb18c001df0 tx=0x7fb18c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22120df8165e97ef server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.252+0000 7fb08960a640 1 -- 172.21.15.165:0/2746441670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18c012020 con 0x55788cafe9e0 2024-09-22T08:12:51.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.252+0000 7fb08960a640 1 -- 172.21.15.165:0/2746441670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18c00e470 con 0x55788cafe9e0 2024-09-22T08:12:51.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.252+0000 7fb08960a640 1 -- 172.21.15.165:0/2746441670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18c00e7f0 con 0x55788cafe9e0 2024-09-22T08:12:51.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 -- 172.21.15.165:0/2746441670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 msgr2=0x55788ca74290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 --2- 172.21.15.165:0/2746441670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788ca74290 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb18c001df0 tx=0x7fb18c00b6c0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 -- 172.21.15.165:0/2746441670 shutdown_connections 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 --2- 172.21.15.165:0/2746441670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788ca74290 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 -- 172.21.15.165:0/2746441670 >> 172.21.15.165:0/2746441670 conn(0x55788caf9db0 msgr2=0x55788cbe9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 -- 172.21.15.165:0/2746441670 shutdown_connections 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 -- 172.21.15.165:0/2746441670 wait complete. 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 Processor -- start 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 -- start start 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788cbf7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.253+0000 7fb19e519800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55788cb05b80 con 0x55788cafe9e0 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.254+0000 7fb19c003640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788cbf7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.254+0000 7fb19c003640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788cbf7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59612/0 (socket says 172.21.15.165:59612) 2024-09-22T08:12:51.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.254+0000 7fb19c003640 1 -- 172.21.15.165:0/3566922814 learned_addr learned my addr 172.21.15.165:0/3566922814 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.254+0000 7fb19c003640 1 -- 172.21.15.165:0/3566922814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788cbf82a0 con 0x55788cafe9e0 2024-09-22T08:12:51.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.254+0000 7fb19c003640 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788cbf7d40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55788ca73dc0 tx=0x7fb18c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.254+0000 7fb087e07640 1 -- 172.21.15.165:0/3566922814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18c012030 con 0x55788cafe9e0 2024-09-22T08:12:51.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.254+0000 7fb087e07640 1 -- 172.21.15.165:0/3566922814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18c001450 con 0x55788cafe9e0 2024-09-22T08:12:51.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.254+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55788cbf8530 con 0x55788cafe9e0 2024-09-22T08:12:51.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.254+0000 7fb087e07640 1 -- 172.21.15.165:0/3566922814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb18c01a7a0 con 0x55788cafe9e0 2024-09-22T08:12:51.257 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.255+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788cbf8f30 con 0x55788cafe9e0 2024-09-22T08:12:51.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.255+0000 7fb087e07640 1 -- 172.21.15.165:0/3566922814 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb18c015020 con 0x55788cafe9e0 2024-09-22T08:12:51.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.256+0000 7fb087e07640 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb08003d000 0x7fb08003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.256+0000 7fb087e07640 1 -- 172.21.15.165:0/3566922814 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb18c020030 con 0x55788cafe9e0 2024-09-22T08:12:51.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.256+0000 7fb193802640 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb08003d000 0x7fb08003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.256+0000 7fb19e519800 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788caffcb0 0x55788cbff390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.256+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cbff8d0 con 0x55788caffcb0 2024-09-22T08:12:51.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.256+0000 7fb19c804640 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788caffcb0 0x55788cbff390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.256+0000 7fb193802640 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb08003d000 0x7fb08003f4c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb184057000 tx=0x7fb184052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.256+0000 7fb19c804640 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788caffcb0 0x55788cbff390 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.256+0000 7fb19c804640 1 -- 172.21.15.165:0/3566922814 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb19400a4d0 con 0x55788caffcb0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.257+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cbffc70 con 0x55788caffcb0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.257+0000 7fb19c804640 1 -- 172.21.15.165:0/3566922814 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb19400a4d0 con 0x55788caffcb0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.257+0000 7fb19e519800 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc016f0 0x55788cc03b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.257+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc04320 con 0x55788cc016f0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.257+0000 7fb19c003640 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc016f0 0x55788cc03b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.257+0000 7fb19c003640 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc016f0 0x55788cc03b90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.257+0000 7fb19c003640 1 -- 172.21.15.165:0/3566922814 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc016f0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.257+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc004c0 con 0x55788caffcb0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.258+0000 7fb19c804640 1 -- 172.21.15.165:0/3566922814 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb19400a4d0 con 0x55788caffcb0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.258+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc008a0 con 0x55788caffcb0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.258+0000 7fb19c804640 1 -- 172.21.15.165:0/3566922814 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb19400a4d0 con 0x55788caffcb0 2024-09-22T08:12:51.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.258+0000 7fb19e519800 1 Processor -- start 2024-09-22T08:12:51.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.258+0000 7fb19e519800 1 -- start start 2024-09-22T08:12:51.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.259+0000 7fb19e519800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc12cd0 0x55788cc130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.259+0000 7fb19e519800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55788c9f5d50 con 0x55788cc12cd0 2024-09-22T08:12:51.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.259+0000 7fb19c804640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc12cd0 0x55788cc130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.259+0000 7fb19c804640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc12cd0 0x55788cc130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59620/0 (socket says 172.21.15.165:59620) 2024-09-22T08:12:51.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.259+0000 7fb19c804640 1 -- 172.21.15.165:0/1778218089 learned_addr learned my addr 172.21.15.165:0/1778218089 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.259+0000 7fb19c804640 1 -- 172.21.15.165:0/1778218089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788cc13730 con 0x55788cc12cd0 2024-09-22T08:12:51.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.259+0000 7fb19c804640 1 --2- 172.21.15.165:0/1778218089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc12cd0 0x55788cc130f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55788cbf9100 tx=0x7fb194018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.260+0000 7fb085602640 1 -- 172.21.15.165:0/1778218089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194014450 con 0x55788cc12cd0 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.260+0000 7fb085602640 1 -- 172.21.15.165:0/1778218089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194014610 con 0x55788cc12cd0 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.260+0000 7fb19e519800 1 -- 172.21.15.165:0/1778218089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55788cc13f60 con 0x55788cc12cd0 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.260+0000 7fb085602640 1 -- 172.21.15.165:0/1778218089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194014930 con 0x55788cc12cd0 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.260+0000 7fb19e519800 1 -- 172.21.15.165:0/1778218089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788cc14500 con 0x55788cc12cd0 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.262+0000 7fb085602640 1 -- 172.21.15.165:0/1778218089 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb194011040 con 0x55788cc12cd0 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.262+0000 7fb085602640 1 --2- 172.21.15.165:0/1778218089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb07403d000 0x7fb07403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.262+0000 7fb085602640 1 -- 172.21.15.165:0/1778218089 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb19401e070 con 0x55788cc12cd0 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.263+0000 7fb19c003640 1 --2- 172.21.15.165:0/1778218089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb07403d000 0x7fb07403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.263+0000 7fb19e519800 1 Processor -- start 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.263+0000 7fb19c003640 1 --2- 172.21.15.165:0/1778218089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb07403d000 0x7fb07403f4c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55788cbf9dd0 tx=0x7fb18c018f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.263+0000 7fb19e519800 1 -- start start 2024-09-22T08:12:51.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.263+0000 7fb19e519800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc1fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.263+0000 7fb19e519800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55788ca72ca0 con 0x55788cc1f770 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.263+0000 7fb19c804640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc1fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.263+0000 7fb19c804640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc1fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59628/0 (socket says 172.21.15.165:59628) 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.263+0000 7fb19c804640 1 -- 172.21.15.165:0/3255215948 learned_addr learned my addr 172.21.15.165:0/3255215948 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.263+0000 7fb19c804640 1 -- 172.21.15.165:0/3255215948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788cc20160 con 0x55788cc1f770 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb19c804640 1 --2- 172.21.15.165:0/3255215948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc1fb70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb194016fd0 tx=0x7fb194011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7063ac757e48138 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb07effd640 1 -- 172.21.15.165:0/3255215948 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1940532d0 con 0x55788cc1f770 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb07effd640 1 -- 172.21.15.165:0/3255215948 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1940167c0 con 0x55788cc1f770 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb07effd640 1 -- 172.21.15.165:0/3255215948 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194011330 con 0x55788cc1f770 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb19e519800 1 -- 172.21.15.165:0/3255215948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 msgr2=0x55788cc1fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb19e519800 1 --2- 172.21.15.165:0/3255215948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc1fb70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb194016fd0 tx=0x7fb194011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb19e519800 1 -- 172.21.15.165:0/3255215948 shutdown_connections 2024-09-22T08:12:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb19e519800 1 --2- 172.21.15.165:0/3255215948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc1fb70 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb19e519800 1 -- 172.21.15.165:0/3255215948 >> 172.21.15.165:0/3255215948 conn(0x55788cc1bb70 msgr2=0x55788cc19db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb19e519800 1 -- 172.21.15.165:0/3255215948 shutdown_connections 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb19e519800 1 -- 172.21.15.165:0/3255215948 wait complete. 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.264+0000 7fb19e519800 1 Processor -- start 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.265+0000 7fb19e519800 1 -- start start 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.265+0000 7fb19e519800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc26db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.265+0000 7fb19e519800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55788cc20780 con 0x55788cc1f770 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.265+0000 7fb19c804640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc26db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.265+0000 7fb19c804640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc26db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59642/0 (socket says 172.21.15.165:59642) 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.265+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 learned_addr learned my addr 172.21.15.165:0/1485500100 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.265+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788cc27310 con 0x55788cc1f770 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.265+0000 7fb19c804640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc26db0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb194011fd0 tx=0x7fb194054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.265+0000 7fb07d7fa640 1 -- 172.21.15.165:0/1485500100 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194031020 con 0x55788cc1f770 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.265+0000 7fb07d7fa640 1 -- 172.21.15.165:0/1485500100 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1940533a0 con 0x55788cc1f770 2024-09-22T08:12:51.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.266+0000 7fb07d7fa640 1 -- 172.21.15.165:0/1485500100 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb194045ab0 con 0x55788cc1f770 2024-09-22T08:12:51.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.266+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55788cc275a0 con 0x55788cc1f770 2024-09-22T08:12:51.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.266+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788cc27f20 con 0x55788cc1f770 2024-09-22T08:12:51.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.266+0000 7fb07d7fa640 1 -- 172.21.15.165:0/1485500100 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb1940548d0 con 0x55788cc1f770 2024-09-22T08:12:51.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.267+0000 7fb07d7fa640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb06403cfb0 0x7fb06403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.267+0000 7fb07d7fa640 1 -- 172.21.15.165:0/1485500100 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb19400e040 con 0x55788cc1f770 2024-09-22T08:12:51.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.267+0000 7fb19c003640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb06403cfb0 0x7fb06403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.267+0000 7fb19c003640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb06403cfb0 0x7fb06403f470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb18c01a6f0 tx=0x7fb18c025000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.267+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.267+0000 7fb19e519800 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788cc32840 0x55788cc34d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.267+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc35450 con 0x55788cc32840 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.267+0000 7fb193802640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788cc32840 0x55788cc34d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb193802640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788cc32840 0x55788cc34d00 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 20 realm 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc35880 con 0x55788cc32840 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc36150 con 0x55788cc32840 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc364f0 con 0x55788cc32840 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.268+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19e519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19e519800 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc37250 0x55788cc39640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc39c50 con 0x55788cc37250 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19c804640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc37250 0x55788cc39640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19c804640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc37250 0x55788cc39640 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19e519800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19e519800 20 searching for the correct realm 2024-09-22T08:12:51.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19e519800 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55788cc3bc00 0x55788cc3e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc3bc00 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.269+0000 7fb19c003640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55788cc3bc00 0x55788cc3e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.270+0000 7fb19c003640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55788cc3bc00 0x55788cc3e0c0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.270+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.270+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc37250 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.270+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.270+0000 7fb19c804640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb194036020 0x7fb194036a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.270+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x7fb194036020 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.270+0000 7fb193802640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb194036020 0x7fb194036a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.271+0000 7fb193802640 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb194036020 0x7fb194036a90 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.271+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.271+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc32840 2024-09-22T08:12:51.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.271+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.271+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc32840 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.271+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.271+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x7fb194036020 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.272+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.272+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc37250 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.272+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.272+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc37250 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.272+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.272+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc3bc00 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.272+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.272+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc32840 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.272+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.272+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x7fb194036020 2024-09-22T08:12:51.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.273+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.273+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc32840 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.273+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.273+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc37250 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.273+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.273+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc3bc00 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.274+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.274+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc3bc00 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.274+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.274+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x7fb194036020 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.274+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.274+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc3bc00 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.274+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.274+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc3bc00 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.274+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.274+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc32840 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.275+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.275+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc32840 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.275+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.275+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x7fb194036020 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.275+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.275+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc3bc00 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.276+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.276+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc37250 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.276+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.276+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc32840 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.276+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.276+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x7fb194036020 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.276+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.276+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc3bc00 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.277+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.277+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x7fb194036020 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.277+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.277+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc37250 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.277+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.277+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc3bc00 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.277+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.277+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x7fb194036020 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc32840 2024-09-22T08:12:51.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3e740 con 0x55788cc37250 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3a610 con 0x55788cc32840 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.291 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.278+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3aeb0 con 0x55788cc32840 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3a250 con 0x55788cc32840 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 20 zone default found 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 4 Realm: () 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 20 zonegroup default 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3f070 con 0x7fb194036020 2024-09-22T08:12:51.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc40da0 con 0x55788cc3bc00 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.279+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc41210 con 0x55788cc3bc00 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.280+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.280+0000 7fb19e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.280+0000 7fb19e519800 20 started sync module instance, tier type = 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.280+0000 7fb19e519800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.280+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3fb70 con 0x55788cc37250 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.281+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.281+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93976246091616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3f7d0 con 0x55788cc37250 2024-09-22T08:12:51.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.281+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc42120 con 0x55788cc32840 2024-09-22T08:12:51.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.282+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93976246091616] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.282+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.282+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93976246097488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc42120 con 0x55788cc32840 2024-09-22T08:12:51.294 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.282+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc427c0 con 0x55788cc3bc00 2024-09-22T08:12:51.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.283+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93976246097488] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.283+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.283+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93976246099056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc43090 con 0x55788cc3bc00 2024-09-22T08:12:51.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.283+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc43a50 con 0x55788cc37250 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.284+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.284+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93976246105984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc44250 con 0x55788cc37250 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.284+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc44d70 con 0x55788cc32840 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.284+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93976246099056] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.285+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93976246105984] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.285+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.285+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93976246110272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc44d30 con 0x55788cc32840 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.285+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc45610 con 0x7fb194036020 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.286+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93976246110272] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.287+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.287+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93976246103008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc44d30 con 0x7fb194036020 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.287+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc45c20 con 0x7fb194036020 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.288+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93976246103008] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.300 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.288+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.288+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93976246112528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc45be0 con 0x7fb194036020 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.288+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc46600 con 0x7fb194036020 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.289+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93976246112528] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.289+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.289+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93976246116592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc467e0 con 0x7fb194036020 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.289+0000 7fb19e519800 20 add_watcher() i=0 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.289+0000 7fb19e519800 20 add_watcher() i=1 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.289+0000 7fb19e519800 20 add_watcher() i=2 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.289+0000 7fb19e519800 20 add_watcher() i=3 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.289+0000 7fb19e519800 20 add_watcher() i=4 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.289+0000 7fb19e519800 20 add_watcher() i=5 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.289+0000 7fb19e519800 20 add_watcher() i=6 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.290+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93976246116592] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.301 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.290+0000 7fb19e519800 20 add_watcher() i=7 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.290+0000 7fb19e519800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.290+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc49bb0 con 0x55788cc32840 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.290+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.290+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93976246118096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc47070 con 0x55788cc32840 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.291+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93976246118096] v34'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fb051fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fb19e519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fb19e519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fb19e519800 5 note: GC not initialized 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fb050fe1640 20 reqs_thread_entry: start 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fb19e519800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fb19e519800 20 Filter name: none 2024-09-22T08:12:51.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fafca7fc640 20 reqs_thread_entry: start 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fb19e519800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fb19e519800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.292+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc7cf10 con 0x7fb194036020 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.293+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.293+0000 7fb19e519800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.293+0000 7fb19e519800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.293+0000 7fb19e519800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.293+0000 7fb19e519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.293+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc83480 con 0x7fb194036020 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb19e519800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb19e519800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb19e519800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:12:51.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93976246365760 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55788cc7eb00 con 0x55788cc32840 2024-09-22T08:12:51.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== watch-notify(notify (1) cookie 93976246110272 notify 146028888100 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55788caff0e0 con 0x55788cc32840 2024-09-22T08:12:51.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb07effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 93976246110272 notifier 4871 bl.length()=666 2024-09-22T08:12:51.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 notify.4 [notify cookie 93976246365760 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb07effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb07effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb07effd640 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb060003ea0 con 0x55788cc32840 2024-09-22T08:12:51.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.295+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify_complete (2) cookie 93976246365760 notify 146028888100 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb18405faa0 con 0x55788cc32840 2024-09-22T08:12:51.305 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:12:50.302079Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.302069Z","tags":[],"group_ids":[]} 2024-09-22T08:12:51.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.296+0000 7fb051fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.296+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93976246118096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc7ac00 con 0x55788cc32840 2024-09-22T08:12:51.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.297+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93976246118096] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.297+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93976246091616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc7ac00 con 0x55788cc37250 2024-09-22T08:12:51.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.298+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93976246091616] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.298+0000 7fb19e519800 20 remove_watcher() i=0 2024-09-22T08:12:51.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.298+0000 7fb19e519800 2 removed watcher, disabling cache 2024-09-22T08:12:51.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.298+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93976246097488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc7ac00 con 0x55788cc32840 2024-09-22T08:12:51.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.300+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93976246097488] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.300+0000 7fb19e519800 20 remove_watcher() i=1 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.300+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93976246099056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc7ac00 con 0x55788cc3bc00 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.301+0000 7fb19c003640 1 -- 172.21.15.165:0/1485500100 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93976246099056] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb18c0187b0 con 0x55788cc3bc00 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.301+0000 7fb19e519800 20 remove_watcher() i=2 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.301+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93976246105984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3ff60 con 0x55788cc37250 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.302+0000 7fb19c804640 1 -- 172.21.15.165:0/1485500100 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93976246105984] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb194033020 con 0x55788cc37250 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.302+0000 7fb19e519800 20 remove_watcher() i=3 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.302+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93976246110272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc41650 con 0x55788cc32840 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.303+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93976246110272] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x55788cc32840 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.303+0000 7fb19e519800 20 remove_watcher() i=4 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.303+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93976246103008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc41c70 con 0x7fb194036020 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.304+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93976246103008] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.304+0000 7fb19e519800 20 remove_watcher() i=5 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.304+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93976246112528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc3ff60 con 0x7fb194036020 2024-09-22T08:12:51.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.305+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93976246112528] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.305+0000 7fb19e519800 20 remove_watcher() i=6 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.305+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93976246116592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55788cc41650 con 0x7fb194036020 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93976246116592] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb184051070 con 0x7fb194036020 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 20 remove_watcher() i=7 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb194036020 msgr2=0x7fb194036a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb194036020 0x7fb194036a90 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788cc32840 msgr2=0x55788cc34d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788cc32840 0x55788cc34d00 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc37250 msgr2=0x55788cc39640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc37250 0x55788cc39640 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55788cc3bc00 msgr2=0x55788cc3e0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55788cc3bc00 0x55788cc3e0c0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb06403cfb0 msgr2=0x7fb06403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb06403cfb0 0x7fb06403f470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb18c01a6f0 tx=0x7fb18c025000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 msgr2=0x55788cc26db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb193802640 1 -- 172.21.15.165:0/1485500100 reap_dead start 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc26db0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb194011fd0 tx=0x7fb194054720 comp rx=0 tx=0).stop 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 shutdown_connections 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1485500100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc1f770 0x55788cc26db0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 >> 172.21.15.165:0/1485500100 conn(0x55788cc1bb70 msgr2=0x55788cc19d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 shutdown_connections 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1485500100 wait complete. 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1778218089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb07403d000 msgr2=0x7fb07403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1778218089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb07403d000 0x7fb07403f4c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55788cbf9dd0 tx=0x7fb18c018f00 comp rx=0 tx=0).stop 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1778218089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc12cd0 msgr2=0x55788cc130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1778218089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc12cd0 0x55788cc130f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55788cbf9100 tx=0x7fb194018830 comp rx=0 tx=0).stop 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 -- 172.21.15.165:0/1778218089 shutdown_connections 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1778218089 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb07403d000 0x7fb07403f4c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.306+0000 7fb19e519800 1 --2- 172.21.15.165:0/1778218089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cc12cd0 0x55788cc130f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/1778218089 >> 172.21.15.165:0/1778218089 conn(0x55788cc07080 msgr2=0x55788cc07460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/1778218089 shutdown_connections 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/1778218089 wait complete. 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788caffcb0 msgr2=0x55788cbff390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788caffcb0 0x55788cbff390 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc016f0 msgr2=0x55788cc03b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc016f0 0x55788cc03b90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb08003d000 msgr2=0x7fb08003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb08003d000 0x7fb08003f4c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb184057000 tx=0x7fb184052000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 msgr2=0x55788cbf7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788cbf7d40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55788ca73dc0 tx=0x7fb18c000bc0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 shutdown_connections 2024-09-22T08:12:51.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55788cc016f0 0x55788cc03b90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55788caffcb0 0x55788cbff390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb08003d000 0x7fb08003f4c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 --2- 172.21.15.165:0/3566922814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55788cafe9e0 0x55788cbf7d40 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 >> 172.21.15.165:0/3566922814 conn(0x55788caf9db0 msgr2=0x55788cbe94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 shutdown_connections 2024-09-22T08:12:51.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.307+0000 7fb19e519800 1 -- 172.21.15.165:0/3566922814 wait complete. 2024-09-22T08:12:51.316 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.316 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.317 ERROR:root:0 2024-09-22T08:12:51.317 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:51.321 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:51.321 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-22T08:12:51.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-22T08:12:51.321 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-22T08:12:51.368 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:51.368 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:51.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f3a08128800 1 Processor -- start 2024-09-22T08:12:51.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f3a08128800 1 -- start start 2024-09-22T08:12:51.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f3a08128800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561fd9546da0 0x561fd9549190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f3a08128800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561fd93d2a20 con 0x561fd9549700 2024-09-22T08:12:51.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f3a08128800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561fd93d27d0 con 0x561fd9546da0 2024-09-22T08:12:51.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f3a03e6f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561fd9546da0 0x561fd9549190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f3a03e6f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561fd9546da0 0x561fd9549190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59646/0 (socket says 172.21.15.165:59646) 2024-09-22T08:12:51.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f3a03e6f640 1 -- 172.21.15.165:0/230578235 learned_addr learned my addr 172.21.15.165:0/230578235 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f39fbfff640 1 --1- 172.21.15.165:0/230578235 >> v1:172.21.15.53:6789/0 conn(0x561fd9549700 0x561fd954bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:55184/0 (socket says 172.21.15.165:55184) 2024-09-22T08:12:51.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f3a03e6f640 1 -- 172.21.15.165:0/230578235 >> v1:172.21.15.53:6789/0 conn(0x561fd9549700 legacy=0x561fd954bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.368+0000 7f3a03e6f640 1 -- 172.21.15.165:0/230578235 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd954e4b0 con 0x561fd9546da0 2024-09-22T08:12:51.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.370+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/230578235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd9549190 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f39f400a6b0 tx=0x7f39f4047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115122d486472257 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.370+0000 7f3a0366e640 1 -- 172.21.15.165:0/230578235 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f400a200 con 0x561fd9546da0 2024-09-22T08:12:51.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.370+0000 7f3a0366e640 1 -- 172.21.15.165:0/230578235 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f400a3a0 con 0x561fd9546da0 2024-09-22T08:12:51.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.370+0000 7f3a0366e640 1 -- 172.21.15.165:0/230578235 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f4008700 con 0x561fd9546da0 2024-09-22T08:12:51.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.371+0000 7f3a08128800 1 -- 172.21.15.165:0/230578235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 msgr2=0x561fd9549190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.371+0000 7f3a08128800 1 --2- 172.21.15.165:0/230578235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd9549190 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f39f400a6b0 tx=0x7f39f4047e30 comp rx=0 tx=0).stop 2024-09-22T08:12:51.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.371+0000 7f3a08128800 1 -- 172.21.15.165:0/230578235 shutdown_connections 2024-09-22T08:12:51.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.371+0000 7f3a08128800 1 --2- 172.21.15.165:0/230578235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd9549190 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.371+0000 7f3a08128800 1 -- 172.21.15.165:0/230578235 >> 172.21.15.165:0/230578235 conn(0x561fd9541310 msgr2=0x561fd9543790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.371+0000 7f3a08128800 1 -- 172.21.15.165:0/230578235 shutdown_connections 2024-09-22T08:12:51.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.371+0000 7f3a08128800 1 -- 172.21.15.165:0/230578235 wait complete. 2024-09-22T08:12:51.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.385+0000 7f3a08128800 1 Processor -- start 2024-09-22T08:12:51.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.385+0000 7f3a08128800 1 -- start start 2024-09-22T08:12:51.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.385+0000 7f3a08128800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd9634e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.385+0000 7f3a08128800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561fd93dfdd0 con 0x561fd9546da0 2024-09-22T08:12:51.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.385+0000 7f3a03e6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd9634e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.385+0000 7f3a03e6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd9634e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59650/0 (socket says 172.21.15.165:59650) 2024-09-22T08:12:51.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.385+0000 7f3a03e6f640 1 -- 172.21.15.165:0/4230247678 learned_addr learned my addr 172.21.15.165:0/4230247678 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.386+0000 7f3a03e6f640 1 -- 172.21.15.165:0/4230247678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd9635420 con 0x561fd9546da0 2024-09-22T08:12:51.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.386+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/4230247678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd9634e30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f39f4027c60 tx=0x7f39f4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd54569962d1a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.386+0000 7f38f1e0b640 1 -- 172.21.15.165:0/4230247678 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f40086c0 con 0x561fd9546da0 2024-09-22T08:12:51.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.386+0000 7f38f1e0b640 1 -- 172.21.15.165:0/4230247678 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f4008880 con 0x561fd9546da0 2024-09-22T08:12:51.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.386+0000 7f38f1e0b640 1 -- 172.21.15.165:0/4230247678 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f4008ba0 con 0x561fd9546da0 2024-09-22T08:12:51.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 -- 172.21.15.165:0/4230247678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 msgr2=0x561fd9634e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 --2- 172.21.15.165:0/4230247678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd9634e30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f39f4027c60 tx=0x7f39f4051000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 -- 172.21.15.165:0/4230247678 shutdown_connections 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 --2- 172.21.15.165:0/4230247678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd9634e30 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 -- 172.21.15.165:0/4230247678 >> 172.21.15.165:0/4230247678 conn(0x561fd9541310 msgr2=0x561fd96307b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 -- 172.21.15.165:0/4230247678 shutdown_connections 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 -- 172.21.15.165:0/4230247678 wait complete. 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 Processor -- start 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 -- start start 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd963c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a08128800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561fd954d6f0 con 0x561fd9546da0 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a03e6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd963c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a03e6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd963c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59664/0 (socket says 172.21.15.165:59664) 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.387+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3554383068 learned_addr learned my addr 172.21.15.165:0/3554383068 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.388+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3554383068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd963cde0 con 0x561fd9546da0 2024-09-22T08:12:51.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.388+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd963c880 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f39f4062040 tx=0x7f39f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.388+0000 7f38ebfff640 1 -- 172.21.15.165:0/3554383068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f404f4c0 con 0x561fd9546da0 2024-09-22T08:12:51.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.388+0000 7f38ebfff640 1 -- 172.21.15.165:0/3554383068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f404f660 con 0x561fd9546da0 2024-09-22T08:12:51.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.388+0000 7f38ebfff640 1 -- 172.21.15.165:0/3554383068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f404f940 con 0x561fd9546da0 2024-09-22T08:12:51.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.388+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fd963d070 con 0x561fd9546da0 2024-09-22T08:12:51.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.388+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd963dc80 con 0x561fd9546da0 2024-09-22T08:12:51.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.389+0000 7f38ebfff640 1 -- 172.21.15.165:0/3554383068 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f39f4067030 con 0x561fd9546da0 2024-09-22T08:12:51.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.389+0000 7f38ebfff640 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38ec03cfb0 0x7f38ec03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.389+0000 7f38ebfff640 1 -- 172.21.15.165:0/3554383068 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39f4065020 con 0x561fd9546da0 2024-09-22T08:12:51.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.389+0000 7f39fbfff640 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38ec03cfb0 0x7f38ec03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.389+0000 7f3a08128800 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd9549700 0x561fd9643ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.389+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd9644410 con 0x561fd9549700 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.390+0000 7f3a04670640 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd9549700 0x561fd9643ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.390+0000 7f39fbfff640 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38ec03cfb0 0x7f38ec03f470 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f39ec001e30 tx=0x7f39ec001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.390+0000 7f3a04670640 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd9549700 0x561fd9643ed0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.390+0000 7f3a04670640 1 -- 172.21.15.165:0/3554383068 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39fc00a4d0 con 0x561fd9549700 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.390+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd96447b0 con 0x561fd9549700 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.390+0000 7f3a04670640 1 -- 172.21.15.165:0/3554383068 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39fc00a4d0 con 0x561fd9549700 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.391+0000 7f3a08128800 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9646270 0x561fd9648710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.391+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd9648ea0 con 0x561fd9646270 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.391+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9646270 0x561fd9648710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.391+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9646270 0x561fd9648710 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.391+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3554383068 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9646270 2024-09-22T08:12:51.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.391+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd9645000 con 0x561fd9549700 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.391+0000 7f3a04670640 1 -- 172.21.15.165:0/3554383068 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39fc00a4d0 con 0x561fd9549700 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.391+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd96453e0 con 0x561fd9549700 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.392+0000 7f3a04670640 1 -- 172.21.15.165:0/3554383068 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f39fc00a4d0 con 0x561fd9549700 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.392+0000 7f3a08128800 1 Processor -- start 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.392+0000 7f3a08128800 1 -- start start 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.392+0000 7f3a08128800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd965bca0 0x561fd965c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.392+0000 7f3a08128800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561fd943ed50 con 0x561fd965bca0 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.392+0000 7f3a04670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd965bca0 0x561fd965c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.392+0000 7f3a04670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd965bca0 0x561fd965c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59674/0 (socket says 172.21.15.165:59674) 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.392+0000 7f3a04670640 1 -- 172.21.15.165:0/3842922105 learned_addr learned my addr 172.21.15.165:0/3842922105 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.393+0000 7f3a04670640 1 -- 172.21.15.165:0/3842922105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd965c700 con 0x561fd965bca0 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.393+0000 7f3a04670640 1 --2- 172.21.15.165:0/3842922105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd965bca0 0x561fd965c0c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x561fd963d710 tx=0x7f39fc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.393+0000 7f38e97fa640 1 -- 172.21.15.165:0/3842922105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39fc014450 con 0x561fd965bca0 2024-09-22T08:12:51.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.393+0000 7f38e97fa640 1 -- 172.21.15.165:0/3842922105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39fc014610 con 0x561fd965bca0 2024-09-22T08:12:51.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.393+0000 7f3a08128800 1 -- 172.21.15.165:0/3842922105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fd965cf30 con 0x561fd965bca0 2024-09-22T08:12:51.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.393+0000 7f38e97fa640 1 -- 172.21.15.165:0/3842922105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39fc014930 con 0x561fd965bca0 2024-09-22T08:12:51.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.393+0000 7f3a08128800 1 -- 172.21.15.165:0/3842922105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd965d4d0 con 0x561fd965bca0 2024-09-22T08:12:51.405 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.394+0000 7f38e97fa640 1 -- 172.21.15.165:0/3842922105 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f39fc011040 con 0x561fd965bca0 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.394+0000 7f38e97fa640 1 --2- 172.21.15.165:0/3842922105 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38dc03d000 0x7f38dc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.394+0000 7f38e97fa640 1 -- 172.21.15.165:0/3842922105 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39fc01e070 con 0x561fd965bca0 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.394+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/3842922105 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38dc03d000 0x7f38dc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.394+0000 7f3a08128800 1 Processor -- start 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f3a08128800 1 -- start start 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/3842922105 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38dc03d000 0x7f38dc03f4c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x561fd963e950 tx=0x7f39f407e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f3a08128800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd9668ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f3a08128800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561fd9635790 con 0x561fd96686d0 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f3a04670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd9668ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f3a04670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd9668ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59684/0 (socket says 172.21.15.165:59684) 2024-09-22T08:12:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f3a04670640 1 -- 172.21.15.165:0/2211270482 learned_addr learned my addr 172.21.15.165:0/2211270482 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f3a04670640 1 -- 172.21.15.165:0/2211270482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd96690a0 con 0x561fd96686d0 2024-09-22T08:12:51.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f3a04670640 1 --2- 172.21.15.165:0/2211270482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd9668ab0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0546a0 tx=0x7f39fc011460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5289b2e052b716 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f38e2ffd640 1 -- 172.21.15.165:0/2211270482 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39fc04b070 con 0x561fd96686d0 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f38e2ffd640 1 -- 172.21.15.165:0/2211270482 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39fc051070 con 0x561fd96686d0 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.395+0000 7f38e2ffd640 1 -- 172.21.15.165:0/2211270482 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39fc0168f0 con 0x561fd96686d0 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 -- 172.21.15.165:0/2211270482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 msgr2=0x561fd9668ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 --2- 172.21.15.165:0/2211270482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd9668ab0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0546a0 tx=0x7f39fc011460 comp rx=0 tx=0).stop 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 -- 172.21.15.165:0/2211270482 shutdown_connections 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 --2- 172.21.15.165:0/2211270482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd9668ab0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 -- 172.21.15.165:0/2211270482 >> 172.21.15.165:0/2211270482 conn(0x561fd9664ad0 msgr2=0x561fd9662d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 -- 172.21.15.165:0/2211270482 shutdown_connections 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 -- 172.21.15.165:0/2211270482 wait complete. 2024-09-22T08:12:51.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 Processor -- start 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 -- start start 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd966fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a08128800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561fd96696e0 con 0x561fd96686d0 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a04670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd966fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a04670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd966fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59692/0 (socket says 172.21.15.165:59692) 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.396+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 learned_addr learned my addr 172.21.15.165:0/3651404853 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.397+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd9670260 con 0x561fd96686d0 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.397+0000 7f3a04670640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd966fd00 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f39fc049040 tx=0x7f39fc054630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.397+0000 7f38e17fa640 1 -- 172.21.15.165:0/3651404853 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39fc04b040 con 0x561fd96686d0 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.397+0000 7f38e17fa640 1 -- 172.21.15.165:0/3651404853 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39fc045870 con 0x561fd96686d0 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.397+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fd96704f0 con 0x561fd96686d0 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.397+0000 7f38e17fa640 1 -- 172.21.15.165:0/3651404853 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39fc045b50 con 0x561fd96686d0 2024-09-22T08:12:51.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.397+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd9670e70 con 0x561fd96686d0 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.398+0000 7f38e17fa640 1 -- 172.21.15.165:0/3651404853 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f39fc045cf0 con 0x561fd96686d0 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.398+0000 7f38e17fa640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38cc03cfb0 0x7f38cc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.398+0000 7f38e17fa640 1 -- 172.21.15.165:0/3651404853 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39fc00e040 con 0x561fd96686d0 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.398+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38cc03cfb0 0x7f38cc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.398+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38cc03cfb0 0x7f38cc03f470 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f39f4048290 tx=0x7f39f4081040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.399+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.399+0000 7f3a08128800 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd967b820 0x561fd967dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.399+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd967e430 con 0x561fd967b820 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.399+0000 7f39fbfff640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd967b820 0x561fd967dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.399+0000 7f39fbfff640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd967b820 0x561fd967dce0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39ec00f610 con 0x561fd967b820 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 20 realm 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd967ab70 con 0x561fd967b820 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39ec00f610 con 0x561fd967b820 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd967ef20 con 0x561fd967b820 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39ec00f610 con 0x561fd967b820 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd967f7f0 con 0x561fd967b820 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39ec00f610 con 0x561fd967b820 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.400+0000 7f3a08128800 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9680210 0x561fd9682600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.401+0000 7f3a04670640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9680210 0x561fd9682600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.401+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd9682d40 con 0x561fd9680210 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.401+0000 7f3a04670640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9680210 0x561fd9682600 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.401+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.401+0000 7f3a08128800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.401+0000 7f3a08128800 20 searching for the correct realm 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.401+0000 7f3a08128800 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x561fd9684cf0 0x561fd96871b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.401+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9684cf0 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.401+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x561fd9684cf0 0x561fd96871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.401+0000 7f3a03e6f640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x561fd9684cf0 0x561fd96871b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.402+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.402+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9680210 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.402+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.402+0000 7f3a04670640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f39fc037070 0x7f39fc04d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.402+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x7f39fc037070 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.402+0000 7f39fbfff640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f39fc037070 0x7f39fc04d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.403+0000 7f39fbfff640 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f39fc037070 0x7f39fc04d260 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.403+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec00f610 con 0x7f39fc037070 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.403+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd967b820 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.403+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec00f610 con 0x561fd967b820 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.403+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd967b820 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.403+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.403+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x7f39fc037070 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.404+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.404+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9680210 2024-09-22T08:12:51.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.404+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.404+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9680210 2024-09-22T08:12:51.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.404+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.404+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9684cf0 2024-09-22T08:12:51.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.404+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.404+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd967b820 2024-09-22T08:12:51.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.405+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.405+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x7f39fc037070 2024-09-22T08:12:51.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.405+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.405+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd967b820 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.405+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.405+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9680210 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.405+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.405+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9684cf0 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.406+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.406+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9684cf0 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.406+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.406+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x7f39fc037070 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.406+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.406+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9684cf0 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.406+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.406+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9684cf0 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.407+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.407+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd967b820 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.407+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.407+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd967b820 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.407+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.407+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x7f39fc037070 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.407+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.407+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9684cf0 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.408+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.408+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9680210 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.408+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.408+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd967b820 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.408+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.408+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x7f39fc037070 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.408+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.408+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9684cf0 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.409+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.409+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x7f39fc037070 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.409+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.409+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9680210 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.409+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.409+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9684cf0 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.409+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.409+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x7f39fc037070 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd967b820 2024-09-22T08:12:51.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561fd9687830 con 0x561fd9680210 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd9683700 con 0x561fd967b820 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.410+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd9683fa0 con 0x561fd967b820 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd9683340 con 0x561fd967b820 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 20 zone default found 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 4 Realm: () 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 20 zonegroup default 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd9688160 con 0x7f39fc037070 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd9689e90 con 0x561fd9684cf0 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.411+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.412+0000 7f3a08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.412+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.412+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd968a320 con 0x561fd9684cf0 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.412+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.412+0000 7f3a08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.412+0000 7f3a08128800 20 started sync module instance, tier type = 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.412+0000 7f3a08128800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:51.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.412+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd9688c60 con 0x561fd9680210 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.413+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.413+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94694791483472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd96888c0 con 0x561fd9680210 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.413+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968b250 con 0x561fd967b820 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.414+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94694791483472] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.414+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.414+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94694791489408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968b250 con 0x561fd967b820 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.414+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968bc70 con 0x561fd9684cf0 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.415+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.415+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94694791493472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968c510 con 0x561fd9684cf0 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.415+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968cff0 con 0x561fd9680210 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.415+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94694791489408] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.416+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.416+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94694791498496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968d3e0 con 0x561fd9680210 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.416+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94694791493472] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.416+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968d8f0 con 0x561fd967b820 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.417+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.417+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94694791495776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968d8f0 con 0x561fd967b820 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.417+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968e830 con 0x7f39fc037070 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.418+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94694791498496] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.418+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94694791495776] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.418+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.418+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94694791504640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968dad0 con 0x7f39fc037070 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.419+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968f0d0 con 0x7f39fc037070 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.419+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94694791504640] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.435 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.420+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.420+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94694791490976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968dad0 con 0x7f39fc037070 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.420+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968f6f0 con 0x7f39fc037070 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.421+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94694791490976] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.421+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.421+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94694791506768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968f6f0 con 0x7f39fc037070 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.421+0000 7f3a08128800 20 add_watcher() i=0 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.421+0000 7f3a08128800 20 add_watcher() i=1 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.421+0000 7f3a08128800 20 add_watcher() i=2 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.421+0000 7f3a08128800 20 add_watcher() i=3 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.421+0000 7f3a08128800 20 add_watcher() i=4 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.421+0000 7f3a08128800 20 add_watcher() i=5 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.421+0000 7f3a08128800 20 add_watcher() i=6 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.422+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94694791506768] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.422+0000 7f3a08128800 20 add_watcher() i=7 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.422+0000 7f3a08128800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.422+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd9692bc0 con 0x561fd967b820 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.422+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.422+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94694791521712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968f860 con 0x561fd967b820 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.423+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94694791521712] v34'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.423+0000 7f38b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.423+0000 7f3a08128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.423+0000 7f3a08128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.423+0000 7f3a08128800 5 note: GC not initialized 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.423+0000 7f38b8fe1640 20 reqs_thread_entry: start 2024-09-22T08:12:51.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.424+0000 7f3a08128800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.424+0000 7f3a08128800 20 Filter name: none 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.424+0000 7f38327fc640 20 reqs_thread_entry: start 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.424+0000 7f3a08128800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.424+0000 7f3a08128800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.424+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd96c5f60 con 0x7f39fc037070 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.424+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.424+0000 7f3a08128800 20 rados_obj.operate() r=0 bl.length=490 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.424+0000 7f3a08128800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.425+0000 7f3a08128800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.425+0000 7f3a08128800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.425+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd96cc640 con 0x7f39fc037070 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f3a08128800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f3a08128800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f3a08128800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94694791757824 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561fd96c7c60 con 0x561fd967b820 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== watch-notify(notify (1) cookie 94694791495776 notify 146028888101 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f39ec018040 con 0x561fd967b820 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f38e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94694791495776 notifier 4878 bl.length()=666 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f38e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f38e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f38e2ffd640 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f38c8003ea0 con 0x561fd967b820 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 notify.4 [notify cookie 94694791757824 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.426+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify_complete (2) cookie 94694791757824 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f39ec009050 con 0x561fd967b820 2024-09-22T08:12:51.440 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:12:50.302079Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.302069Z","tags":[],"group_ids":[]} 2024-09-22T08:12:51.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.427+0000 7f38b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.427+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94694791521712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd96c3c70 con 0x561fd967b820 2024-09-22T08:12:51.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.428+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94694791521712] v34'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.428+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94694791483472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd96c3c70 con 0x561fd9680210 2024-09-22T08:12:51.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.429+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94694791483472] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.429+0000 7f3a08128800 20 remove_watcher() i=0 2024-09-22T08:12:51.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.429+0000 7f3a08128800 2 removed watcher, disabling cache 2024-09-22T08:12:51.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.429+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94694791489408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd96c3c70 con 0x561fd967b820 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.430+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94694791489408] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.431+0000 7f3a08128800 20 remove_watcher() i=1 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.431+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94694791493472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd96c3c70 con 0x561fd9684cf0 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.431+0000 7f3a03e6f640 1 -- 172.21.15.165:0/3651404853 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94694791493472] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f406b970 con 0x561fd9684cf0 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.432+0000 7f3a08128800 20 remove_watcher() i=2 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.432+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94694791498496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd9689050 con 0x561fd9680210 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.432+0000 7f3a04670640 1 -- 172.21.15.165:0/3651404853 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94694791498496] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc02a070 con 0x561fd9680210 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.433+0000 7f3a08128800 20 remove_watcher() i=3 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.433+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94694791495776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968a780 con 0x561fd967b820 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.434+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94694791495776] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x561fd967b820 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.434+0000 7f3a08128800 20 remove_watcher() i=4 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.434+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94694791504640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd9689050 con 0x7f39fc037070 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.435+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94694791504640] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.435+0000 7f3a08128800 20 remove_watcher() i=5 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.435+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94694791490976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968c060 con 0x7f39fc037070 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.435+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94694791490976] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.435+0000 7f3a08128800 20 remove_watcher() i=6 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.435+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94694791506768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561fd968a780 con 0x7f39fc037070 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.436+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94694791506768] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec02b040 con 0x7f39fc037070 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.436+0000 7f3a08128800 20 remove_watcher() i=7 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f39fc037070 msgr2=0x7f39fc04d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f39fc037070 0x7f39fc04d260 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd967b820 msgr2=0x561fd967dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd967b820 0x561fd967dce0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9680210 msgr2=0x561fd9682600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9680210 0x561fd9682600 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x561fd9684cf0 msgr2=0x561fd96871b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x561fd9684cf0 0x561fd96871b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38cc03cfb0 msgr2=0x7f38cc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38cc03cfb0 0x7f38cc03f470 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f39f4048290 tx=0x7f39f4081040 comp rx=0 tx=0).stop 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 msgr2=0x561fd966fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f39fbfff640 1 -- 172.21.15.165:0/3651404853 reap_dead start 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd966fd00 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f39fc049040 tx=0x7f39fc054630 comp rx=0 tx=0).stop 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 shutdown_connections 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3651404853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd96686d0 0x561fd966fd00 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 >> 172.21.15.165:0/3651404853 conn(0x561fd9664ad0 msgr2=0x561fd9662ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 shutdown_connections 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3651404853 wait complete. 2024-09-22T08:12:51.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3842922105 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38dc03d000 msgr2=0x7f38dc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3842922105 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38dc03d000 0x7f38dc03f4c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x561fd963e950 tx=0x7f39f407e040 comp rx=0 tx=0).stop 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3842922105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd965bca0 msgr2=0x561fd965c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3842922105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd965bca0 0x561fd965c0c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x561fd963d710 tx=0x7f39fc018830 comp rx=0 tx=0).stop 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3842922105 shutdown_connections 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3842922105 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38dc03d000 0x7f38dc03f4c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 --2- 172.21.15.165:0/3842922105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd965bca0 0x561fd965c0c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3842922105 >> 172.21.15.165:0/3842922105 conn(0x561fd964bc40 msgr2=0x561fd964c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3842922105 shutdown_connections 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.437+0000 7f3a08128800 1 -- 172.21.15.165:0/3842922105 wait complete. 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd9549700 msgr2=0x561fd9643ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd9549700 0x561fd9643ed0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9646270 msgr2=0x561fd9648710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9646270 0x561fd9648710 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38ec03cfb0 msgr2=0x7f38ec03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38ec03cfb0 0x7f38ec03f470 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f39ec001e30 tx=0x7f39ec001390 comp rx=0 tx=0).stop 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 msgr2=0x561fd963c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd963c880 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f39f4062040 tx=0x7f39f4002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 shutdown_connections 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x561fd9646270 0x561fd9648710 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x561fd9549700 0x561fd9643ed0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f38ec03cfb0 0x7f38ec03f470 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 --2- 172.21.15.165:0/3554383068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fd9546da0 0x561fd963c880 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 >> 172.21.15.165:0/3554383068 conn(0x561fd9541310 msgr2=0x561fd9636220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 shutdown_connections 2024-09-22T08:12:51.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.438+0000 7f3a08128800 1 -- 172.21.15.165:0/3554383068 wait complete. 2024-09-22T08:12:51.451 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.451 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.452 ERROR:root:0 2024-09-22T08:12:51.452 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:51.456 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:51.456 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:12:51.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:12:51.457 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-22T08:12:51.503 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:51.503 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:51.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.503+0000 7fe96ae98800 1 Processor -- start 2024-09-22T08:12:51.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.503+0000 7fe96ae98800 1 -- start start 2024-09-22T08:12:51.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.503+0000 7fe96ae98800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5583b618ac00 0x5583b618d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.503+0000 7fe96ae98800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583b600fa20 con 0x5583b60f8530 2024-09-22T08:12:51.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.503+0000 7fe96ae98800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5583b600f7d0 con 0x5583b618ac00 2024-09-22T08:12:51.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.503+0000 7fe963fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5583b618ac00 0x5583b618d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.503+0000 7fe968982640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5583b60f8530 0x5583b61894b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:55190/0 (socket says 172.21.15.165:55190) 2024-09-22T08:12:51.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.503+0000 7fe968982640 1 -- 172.21.15.165:0/3188738623 learned_addr learned my addr 172.21.15.165:0/3188738623 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:51.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.503+0000 7fe963fff640 1 --2- 172.21.15.165:0/3188738623 >> v2:172.21.15.53:3300/0 conn(0x5583b618ac00 0x5583b618d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59696/0 (socket says 172.21.15.165:59696) 2024-09-22T08:12:51.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.504+0000 7fe963fff640 1 -- 172.21.15.165:0/3188738623 >> v1:172.21.15.53:6789/0 conn(0x5583b60f8530 legacy=0x5583b61894b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.504+0000 7fe963fff640 1 -- 172.21.15.165:0/3188738623 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b618e7d0 con 0x5583b618ac00 2024-09-22T08:12:51.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.505+0000 7fe963fff640 1 --2- 172.21.15.165:0/3188738623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b618ac00 0x5583b618d0c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00a470 tx=0x7fe95c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0f89280dafde52 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.506+0000 7fe9637fe640 1 -- 172.21.15.165:0/3188738623 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95c053570 con 0x5583b618ac00 2024-09-22T08:12:51.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.506+0000 7fe9637fe640 1 -- 172.21.15.165:0/3188738623 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95c058070 con 0x5583b618ac00 2024-09-22T08:12:51.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.506+0000 7fe9637fe640 1 -- 172.21.15.165:0/3188738623 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95c053880 con 0x5583b618ac00 2024-09-22T08:12:51.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.506+0000 7fe96ae98800 1 -- 172.21.15.165:0/3188738623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b618ac00 msgr2=0x5583b618d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.506+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3188738623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b618ac00 0x5583b618d0c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00a470 tx=0x7fe95c045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:51.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.506+0000 7fe96ae98800 1 -- 172.21.15.165:0/3188738623 shutdown_connections 2024-09-22T08:12:51.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.506+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3188738623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b618ac00 0x5583b618d0c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.506+0000 7fe96ae98800 1 -- 172.21.15.165:0/3188738623 >> 172.21.15.165:0/3188738623 conn(0x5583b617ebe0 msgr2=0x5583b6181020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.506+0000 7fe96ae98800 1 -- 172.21.15.165:0/3188738623 shutdown_connections 2024-09-22T08:12:51.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.506+0000 7fe96ae98800 1 -- 172.21.15.165:0/3188738623 wait complete. 2024-09-22T08:12:51.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.520+0000 7fe96ae98800 1 Processor -- start 2024-09-22T08:12:51.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.520+0000 7fe96ae98800 1 -- start start 2024-09-22T08:12:51.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.520+0000 7fe96ae98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b6276230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.520+0000 7fe96ae98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5583b601cdd0 con 0x5583b60f8530 2024-09-22T08:12:51.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.520+0000 7fe968982640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b6276230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.520+0000 7fe968982640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b6276230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59702/0 (socket says 172.21.15.165:59702) 2024-09-22T08:12:51.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.520+0000 7fe968982640 1 -- 172.21.15.165:0/873795750 learned_addr learned my addr 172.21.15.165:0/873795750 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.521+0000 7fe968982640 1 -- 172.21.15.165:0/873795750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b6276820 con 0x5583b60f8530 2024-09-22T08:12:51.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.521+0000 7fe968982640 1 --2- 172.21.15.165:0/873795750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b6276230 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe954001e40 tx=0x7fe954001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e7cfe41267955b server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.521+0000 7fe855e13640 1 -- 172.21.15.165:0/873795750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe954012020 con 0x5583b60f8530 2024-09-22T08:12:51.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.521+0000 7fe855e13640 1 -- 172.21.15.165:0/873795750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95400e5a0 con 0x5583b60f8530 2024-09-22T08:12:51.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.521+0000 7fe855e13640 1 -- 172.21.15.165:0/873795750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95400e8a0 con 0x5583b60f8530 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.522+0000 7fe96ae98800 1 -- 172.21.15.165:0/873795750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 msgr2=0x5583b6276230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.522+0000 7fe96ae98800 1 --2- 172.21.15.165:0/873795750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b6276230 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe954001e40 tx=0x7fe954001e70 comp rx=0 tx=0).stop 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.522+0000 7fe96ae98800 1 -- 172.21.15.165:0/873795750 shutdown_connections 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.522+0000 7fe96ae98800 1 --2- 172.21.15.165:0/873795750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b6276230 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.522+0000 7fe96ae98800 1 -- 172.21.15.165:0/873795750 >> 172.21.15.165:0/873795750 conn(0x5583b617ebe0 msgr2=0x5583b6271bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.522+0000 7fe96ae98800 1 -- 172.21.15.165:0/873795750 shutdown_connections 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.522+0000 7fe96ae98800 1 -- 172.21.15.165:0/873795750 wait complete. 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.522+0000 7fe96ae98800 1 Processor -- start 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.522+0000 7fe96ae98800 1 -- start start 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe96ae98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b627dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe96ae98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5583b618da70 con 0x5583b60f8530 2024-09-22T08:12:51.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe968982640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b627dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe968982640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b627dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59716/0 (socket says 172.21.15.165:59716) 2024-09-22T08:12:51.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe968982640 1 -- 172.21.15.165:0/3078147438 learned_addr learned my addr 172.21.15.165:0/3078147438 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe968982640 1 -- 172.21.15.165:0/3078147438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b627e2b0 con 0x5583b60f8530 2024-09-22T08:12:51.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe968982640 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b627dd50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c010 tx=0x7fe954000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe84ffff640 1 -- 172.21.15.165:0/3078147438 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe954012030 con 0x5583b60f8530 2024-09-22T08:12:51.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe84ffff640 1 -- 172.21.15.165:0/3078147438 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9540014a0 con 0x5583b60f8530 2024-09-22T08:12:51.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe84ffff640 1 -- 172.21.15.165:0/3078147438 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95401a7a0 con 0x5583b60f8530 2024-09-22T08:12:51.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.523+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583b627e540 con 0x5583b60f8530 2024-09-22T08:12:51.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.524+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b627ef40 con 0x5583b60f8530 2024-09-22T08:12:51.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.524+0000 7fe84ffff640 1 -- 172.21.15.165:0/3078147438 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe954015020 con 0x5583b60f8530 2024-09-22T08:12:51.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.525+0000 7fe84ffff640 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe85003cfb0 0x7fe85003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.525+0000 7fe84ffff640 1 -- 172.21.15.165:0/3078147438 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe954020030 con 0x5583b60f8530 2024-09-22T08:12:51.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.525+0000 7fe963fff640 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe85003cfb0 0x7fe85003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.525+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b618ac00 0x5583b62853a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.525+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62858e0 con 0x5583b618ac00 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.525+0000 7fe969183640 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b618ac00 0x5583b62853a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.525+0000 7fe963fff640 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe85003cfb0 0x7fe85003f470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe95c057000 tx=0x7fe95c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.525+0000 7fe969183640 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b618ac00 0x5583b62853a0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.525+0000 7fe969183640 1 -- 172.21.15.165:0/3078147438 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe96400a4d0 con 0x5583b618ac00 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.526+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b6285c80 con 0x5583b618ac00 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.526+0000 7fe969183640 1 -- 172.21.15.165:0/3078147438 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe96400a4d0 con 0x5583b618ac00 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.526+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b6287740 0x5583b6289be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.526+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b628a370 con 0x5583b6287740 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.526+0000 7fe968982640 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b6287740 0x5583b6289be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.526+0000 7fe968982640 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b6287740 0x5583b6289be0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.527+0000 7fe968982640 1 -- 172.21.15.165:0/3078147438 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b6287740 2024-09-22T08:12:51.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.527+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62864d0 con 0x5583b618ac00 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.527+0000 7fe969183640 1 -- 172.21.15.165:0/3078147438 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe96400a4d0 con 0x5583b618ac00 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.527+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62868b0 con 0x5583b618ac00 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.527+0000 7fe969183640 1 -- 172.21.15.165:0/3078147438 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe96400a4d0 con 0x5583b618ac00 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.528+0000 7fe96ae98800 1 Processor -- start 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.528+0000 7fe96ae98800 1 -- start start 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.528+0000 7fe96ae98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b6298d20 0x5583b6299140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.528+0000 7fe96ae98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5583b607bd50 con 0x5583b6298d20 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.528+0000 7fe969183640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b6298d20 0x5583b6299140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.528+0000 7fe969183640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b6298d20 0x5583b6299140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59722/0 (socket says 172.21.15.165:59722) 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.528+0000 7fe969183640 1 -- 172.21.15.165:0/2212266413 learned_addr learned my addr 172.21.15.165:0/2212266413 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.529+0000 7fe969183640 1 -- 172.21.15.165:0/2212266413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b6299780 con 0x5583b6298d20 2024-09-22T08:12:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.529+0000 7fe969183640 1 --2- 172.21.15.165:0/2212266413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b6298d20 0x5583b6299140 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x5583b627ebe0 tx=0x7fe964018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.529+0000 7fe84d7fa640 1 -- 172.21.15.165:0/2212266413 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe964014450 con 0x5583b6298d20 2024-09-22T08:12:51.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.529+0000 7fe84d7fa640 1 -- 172.21.15.165:0/2212266413 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe964014610 con 0x5583b6298d20 2024-09-22T08:12:51.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.529+0000 7fe96ae98800 1 -- 172.21.15.165:0/2212266413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583b6299fb0 con 0x5583b6298d20 2024-09-22T08:12:51.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.529+0000 7fe84d7fa640 1 -- 172.21.15.165:0/2212266413 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe964014930 con 0x5583b6298d20 2024-09-22T08:12:51.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.529+0000 7fe96ae98800 1 -- 172.21.15.165:0/2212266413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b629a550 con 0x5583b6298d20 2024-09-22T08:12:51.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.530+0000 7fe84d7fa640 1 -- 172.21.15.165:0/2212266413 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe964011040 con 0x5583b6298d20 2024-09-22T08:12:51.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.530+0000 7fe84d7fa640 1 --2- 172.21.15.165:0/2212266413 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 0x7fe84003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.530+0000 7fe84d7fa640 1 -- 172.21.15.165:0/2212266413 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe96401e070 con 0x5583b6298d20 2024-09-22T08:12:51.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.530+0000 7fe968982640 1 --2- 172.21.15.165:0/2212266413 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 0x7fe84003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.530+0000 7fe96ae98800 1 Processor -- start 2024-09-22T08:12:51.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.530+0000 7fe96ae98800 1 -- start start 2024-09-22T08:12:51.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.530+0000 7fe968982640 1 --2- 172.21.15.165:0/2212266413 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 0x7fe84003f4c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5583b627fe20 tx=0x7fe9540529c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.530+0000 7fe96ae98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.530+0000 7fe96ae98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5583b6276c50 con 0x5583b62a57a0 2024-09-22T08:12:51.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.531+0000 7fe969183640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.531+0000 7fe969183640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62a5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59732/0 (socket says 172.21.15.165:59732) 2024-09-22T08:12:51.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.531+0000 7fe969183640 1 -- 172.21.15.165:0/3241195954 learned_addr learned my addr 172.21.15.165:0/3241195954 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.531+0000 7fe969183640 1 -- 172.21.15.165:0/3241195954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b62a6170 con 0x5583b62a57a0 2024-09-22T08:12:51.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.531+0000 7fe969183640 1 --2- 172.21.15.165:0/3241195954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62a5b80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe964018430 tx=0x7fe964014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba80d42155cd42ae server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.531+0000 7fe846ffd640 1 -- 172.21.15.165:0/3241195954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe964051020 con 0x5583b62a57a0 2024-09-22T08:12:51.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.531+0000 7fe846ffd640 1 -- 172.21.15.165:0/3241195954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe964022df0 con 0x5583b62a57a0 2024-09-22T08:12:51.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.531+0000 7fe846ffd640 1 -- 172.21.15.165:0/3241195954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe964044020 con 0x5583b62a57a0 2024-09-22T08:12:51.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 -- 172.21.15.165:0/3241195954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 msgr2=0x5583b62a5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3241195954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62a5b80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe964018430 tx=0x7fe964014ea0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 -- 172.21.15.165:0/3241195954 shutdown_connections 2024-09-22T08:12:51.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3241195954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62a5b80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 -- 172.21.15.165:0/3241195954 >> 172.21.15.165:0/3241195954 conn(0x5583b62a1ba0 msgr2=0x5583b629fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 -- 172.21.15.165:0/3241195954 shutdown_connections 2024-09-22T08:12:51.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 -- 172.21.15.165:0/3241195954 wait complete. 2024-09-22T08:12:51.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 Processor -- start 2024-09-22T08:12:51.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 -- start start 2024-09-22T08:12:51.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe96ae98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5583b62a67b0 con 0x5583b62a57a0 2024-09-22T08:12:51.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe969183640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe969183640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59744/0 (socket says 172.21.15.165:59744) 2024-09-22T08:12:51.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.532+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 learned_addr learned my addr 172.21.15.165:0/133020315 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.533+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b62ad290 con 0x5583b62a57a0 2024-09-22T08:12:51.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.533+0000 7fe969183640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62acd30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe964018430 tx=0x7fe9640546a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.533+0000 7fe8457fa640 1 -- 172.21.15.165:0/133020315 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe964051040 con 0x5583b62a57a0 2024-09-22T08:12:51.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.533+0000 7fe8457fa640 1 -- 172.21.15.165:0/133020315 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe964054d30 con 0x5583b62a57a0 2024-09-22T08:12:51.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.533+0000 7fe8457fa640 1 -- 172.21.15.165:0/133020315 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe964028070 con 0x5583b62a57a0 2024-09-22T08:12:51.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.533+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583b62ad520 con 0x5583b62a57a0 2024-09-22T08:12:51.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.533+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b62adea0 con 0x5583b62a57a0 2024-09-22T08:12:51.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.534+0000 7fe8457fa640 1 -- 172.21.15.165:0/133020315 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe964034060 con 0x5583b62a57a0 2024-09-22T08:12:51.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.534+0000 7fe8457fa640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 0x7fe83003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.534+0000 7fe8457fa640 1 -- 172.21.15.165:0/133020315 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe96404d050 con 0x5583b62a57a0 2024-09-22T08:12:51.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.534+0000 7fe968982640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 0x7fe83003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.534+0000 7fe968982640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 0x7fe83003f470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe954052990 tx=0x7fe954042000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.535+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.535+0000 7fe96ae98800 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b62b88c0 0x5583b62bad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.535+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62bb4d0 con 0x5583b62b88c0 2024-09-22T08:12:51.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.535+0000 7fe963fff640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b62b88c0 0x5583b62bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.535+0000 7fe963fff640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b62b88c0 0x5583b62bad80 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.535+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.535+0000 7fe96ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.535+0000 7fe96ae98800 20 realm 2024-09-22T08:12:51.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.535+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.535+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62bb900 con 0x5583b62b88c0 2024-09-22T08:12:51.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:51.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62bc1d0 con 0x5583b62b88c0 2024-09-22T08:12:51.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62bc570 con 0x5583b62b88c0 2024-09-22T08:12:51.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b62bd2d0 0x5583b62bf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62bfcd0 con 0x5583b62bd2d0 2024-09-22T08:12:51.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe969183640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b62bd2d0 0x5583b62bf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.536+0000 7fe969183640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b62bd2d0 0x5583b62bf6c0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.537+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe96402a070 con 0x5583b62bd2d0 2024-09-22T08:12:51.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.537+0000 7fe96ae98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:51.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.537+0000 7fe96ae98800 20 searching for the correct realm 2024-09-22T08:12:51.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.537+0000 7fe96ae98800 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5583b62c1c80 0x5583b62c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.537+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62c1c80 2024-09-22T08:12:51.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.537+0000 7fe968982640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5583b62c1c80 0x5583b62c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.537+0000 7fe968982640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5583b62c1c80 0x5583b62c4140 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.537+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.537+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62bd2d0 2024-09-22T08:12:51.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.538+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe96402a070 con 0x5583b62bd2d0 2024-09-22T08:12:51.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.538+0000 7fe969183640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe964036070 0x7fe96404d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.538+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x7fe964036070 2024-09-22T08:12:51.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.538+0000 7fe963fff640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe964036070 0x7fe96404d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.538+0000 7fe963fff640 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe964036070 0x7fe96404d780 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.539+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.539+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62b88c0 2024-09-22T08:12:51.564 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.539+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.539+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62b88c0 2024-09-22T08:12:51.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.539+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.539+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x7fe964036070 2024-09-22T08:12:51.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.539+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.539+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62bd2d0 2024-09-22T08:12:51.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.539+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96402a070 con 0x5583b62bd2d0 2024-09-22T08:12:51.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.540+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62bd2d0 2024-09-22T08:12:51.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.540+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96402a070 con 0x5583b62bd2d0 2024-09-22T08:12:51.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.540+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62c1c80 2024-09-22T08:12:51.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.540+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.540+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62b88c0 2024-09-22T08:12:51.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.540+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.540+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x7fe964036070 2024-09-22T08:12:51.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.540+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.540+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62b88c0 2024-09-22T08:12:51.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.541+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.541+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62bd2d0 2024-09-22T08:12:51.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.541+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe96405f060 con 0x5583b62bd2d0 2024-09-22T08:12:51.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.541+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62c1c80 2024-09-22T08:12:51.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.541+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.541+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62c1c80 2024-09-22T08:12:51.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.541+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.567 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.541+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x7fe964036070 2024-09-22T08:12:51.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.542+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.542+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62c1c80 2024-09-22T08:12:51.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.542+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.542+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62c1c80 2024-09-22T08:12:51.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.542+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.542+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62b88c0 2024-09-22T08:12:51.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.542+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.542+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62b88c0 2024-09-22T08:12:51.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.542+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.542+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x7fe964036070 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.543+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.543+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62c1c80 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.543+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.543+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62bd2d0 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.543+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96405f060 con 0x5583b62bd2d0 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.543+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62b88c0 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.543+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.543+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x7fe964036070 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.544+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.544+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62c1c80 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.544+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.544+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x7fe964036070 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.544+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.544+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62bd2d0 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.544+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96405f060 con 0x5583b62bd2d0 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.545+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62c1c80 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.545+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.545+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x7fe964036070 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.545+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.545+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62b88c0 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.545+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.545+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c47c0 con 0x5583b62bd2d0 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.545+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96405f060 con 0x5583b62bd2d0 2024-09-22T08:12:51.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c06c0 con 0x5583b62b88c0 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c0f60 con 0x5583b62b88c0 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c4c40 con 0x5583b62b88c0 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 zone default found 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 4 Realm: () 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 zonegroup default 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.546+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c5040 con 0x7fe964036070 2024-09-22T08:12:51.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe96ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c6ea0 con 0x5583b62c1c80 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe96ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c7380 con 0x5583b62c1c80 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe96ae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe96ae98800 20 started sync module instance, tier type = 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe96ae98800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.547+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c6310 con 0x5583b62bd2d0 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.548+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96405f060 con 0x5583b62bd2d0 2024-09-22T08:12:51.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.548+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94024185440000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c7c90 con 0x5583b62bd2d0 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.548+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c84e0 con 0x5583b62b88c0 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.549+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94024185440000] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96405f060 con 0x5583b62bd2d0 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.550+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.550+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94024185444320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c8110 con 0x5583b62b88c0 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.550+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c8c20 con 0x5583b62c1c80 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.551+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94024185444320] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.551+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.551+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94024185448144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c9010 con 0x5583b62c1c80 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.551+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c9a70 con 0x5583b62bd2d0 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.552+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94024185448144] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.552+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96405f060 con 0x5583b62bd2d0 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.552+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94024185445376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c9e60 con 0x5583b62bd2d0 2024-09-22T08:12:51.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.552+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62ca8a0 con 0x5583b62b88c0 2024-09-22T08:12:51.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.553+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.553+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94024185455520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62ca8a0 con 0x5583b62b88c0 2024-09-22T08:12:51.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.553+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62cb840 con 0x7fe964036070 2024-09-22T08:12:51.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.553+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94024185445376] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96405f060 con 0x5583b62bd2d0 2024-09-22T08:12:51.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.554+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94024185455520] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.554+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.554+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94024185459472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62caa80 con 0x7fe964036070 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.554+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62cc0e0 con 0x7fe964036070 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.555+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94024185459472] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.555+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.555+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94024185451856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62cbef0 con 0x7fe964036070 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.555+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62cc740 con 0x7fe964036070 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.556+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94024185451856] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.556+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.556+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94024185461792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62cc570 con 0x7fe964036070 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.556+0000 7fe96ae98800 20 add_watcher() i=0 2024-09-22T08:12:51.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.556+0000 7fe96ae98800 20 add_watcher() i=1 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.556+0000 7fe96ae98800 20 add_watcher() i=2 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.556+0000 7fe96ae98800 20 add_watcher() i=3 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.556+0000 7fe96ae98800 20 add_watcher() i=4 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.556+0000 7fe96ae98800 20 add_watcher() i=5 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.556+0000 7fe96ae98800 20 add_watcher() i=6 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.557+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94024185461792] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.558+0000 7fe96ae98800 20 add_watcher() i=7 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.558+0000 7fe96ae98800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.558+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b62cfba0 con 0x5583b62b88c0 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.558+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.558+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94024185462848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62ccf30 con 0x5583b62b88c0 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.559+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94024185462848] v34'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.559+0000 7fe81dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.559+0000 7fe96ae98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.559+0000 7fe96ae98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.559+0000 7fe96ae98800 5 note: GC not initialized 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.559+0000 7fe81cfe1640 20 reqs_thread_entry: start 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.559+0000 7fe96ae98800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe96ae98800 20 Filter name: none 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe7967fc640 20 reqs_thread_entry: start 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe96ae98800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe96ae98800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b6302ee0 con 0x7fe964036070 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe96ae98800 20 rados_obj.operate() r=0 bl.length=490 2024-09-22T08:12:51.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe96ae98800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe96ae98800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe96ae98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.560+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b63095b0 con 0x7fe964036070 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.561+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe96ae98800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe96ae98800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe96ae98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94024185712560 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583b6304c30 con 0x5583b62b88c0 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== watch-notify(notify (1) cookie 94024185455520 notify 146028888102 ret 0) ==== 721+0+0 (crc 0 0 0) 0x5583b618e7d0 con 0x5583b62b88c0 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe846ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94024185455520 notifier 4885 bl.length()=679 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 notify.4 [notify cookie 94024185712560 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe846ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe846ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe846ffd640 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe82c003ea0 con 0x5583b62b88c0 2024-09-22T08:12:51.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.562+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify_complete (2) cookie 94024185712560 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe95c05fb70 con 0x5583b62b88c0 2024-09-22T08:12:51.584 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:12:50.302079Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.302069Z","tags":[],"group_ids":[]} 2024-09-22T08:12:51.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.563+0000 7fe81dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.563+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94024185462848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b6300bf0 con 0x5583b62b88c0 2024-09-22T08:12:51.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.564+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94024185462848] v34'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.564+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94024185440000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b6300bf0 con 0x5583b62bd2d0 2024-09-22T08:12:51.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.565+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94024185440000] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96405f060 con 0x5583b62bd2d0 2024-09-22T08:12:51.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.565+0000 7fe96ae98800 20 remove_watcher() i=0 2024-09-22T08:12:51.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.565+0000 7fe96ae98800 2 removed watcher, disabling cache 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.565+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94024185444320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b6300bf0 con 0x5583b62b88c0 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.566+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94024185444320] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.566+0000 7fe96ae98800 20 remove_watcher() i=1 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.566+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94024185448144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b6300bf0 con 0x5583b62c1c80 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.567+0000 7fe968982640 1 -- 172.21.15.165:0/133020315 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94024185448144] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95401ab20 con 0x5583b62c1c80 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.567+0000 7fe96ae98800 20 remove_watcher() i=2 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.567+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94024185445376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c86d0 con 0x5583b62bd2d0 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.568+0000 7fe969183640 1 -- 172.21.15.165:0/133020315 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94024185445376] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96405f060 con 0x5583b62bd2d0 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.568+0000 7fe96ae98800 20 remove_watcher() i=3 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.568+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94024185455520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c86d0 con 0x5583b62b88c0 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.569+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94024185455520] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x5583b62b88c0 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.570+0000 7fe96ae98800 20 remove_watcher() i=4 2024-09-22T08:12:51.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.570+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94024185459472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c86d0 con 0x7fe964036070 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.570+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94024185459472] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.571+0000 7fe96ae98800 20 remove_watcher() i=5 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.571+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94024185451856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c86d0 con 0x7fe964036070 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.571+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94024185451856] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.571+0000 7fe96ae98800 20 remove_watcher() i=6 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.571+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94024185461792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583b62c9550 con 0x7fe964036070 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.572+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94024185461792] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe95c051070 con 0x7fe964036070 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 20 remove_watcher() i=7 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe964036070 msgr2=0x7fe96404d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fe964036070 0x7fe96404d780 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b62b88c0 msgr2=0x5583b62bad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b62b88c0 0x5583b62bad80 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b62bd2d0 msgr2=0x5583b62bf6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b62bd2d0 0x5583b62bf6c0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5583b62c1c80 msgr2=0x5583b62c4140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x5583b62c1c80 0x5583b62c4140 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 msgr2=0x7fe83003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe83003cfb0 0x7fe83003f470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe954052990 tx=0x7fe954042000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 msgr2=0x5583b62acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe963fff640 1 -- 172.21.15.165:0/133020315 reap_dead start 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62acd30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe964018430 tx=0x7fe9640546a0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 shutdown_connections 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/133020315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b62a57a0 0x5583b62acd30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 >> 172.21.15.165:0/133020315 conn(0x5583b62a1ba0 msgr2=0x5583b629fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 shutdown_connections 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/133020315 wait complete. 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/2212266413 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 msgr2=0x7fe84003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/2212266413 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 0x7fe84003f4c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5583b627fe20 tx=0x7fe9540529c0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/2212266413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b6298d20 msgr2=0x5583b6299140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/2212266413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b6298d20 0x5583b6299140 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x5583b627ebe0 tx=0x7fe964018830 comp rx=0 tx=0).stop 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/2212266413 shutdown_connections 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/2212266413 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe84003d000 0x7fe84003f4c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 --2- 172.21.15.165:0/2212266413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b6298d20 0x5583b6299140 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/2212266413 >> 172.21.15.165:0/2212266413 conn(0x5583b628d0d0 msgr2=0x5583b628d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/2212266413 shutdown_connections 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.573+0000 7fe96ae98800 1 -- 172.21.15.165:0/2212266413 wait complete. 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b618ac00 msgr2=0x5583b62853a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b618ac00 0x5583b62853a0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b6287740 msgr2=0x5583b6289be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b6287740 0x5583b6289be0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe85003cfb0 msgr2=0x7fe85003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe85003cfb0 0x7fe85003f470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe95c057000 tx=0x7fe95c052000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 msgr2=0x5583b627dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b627dd50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c010 tx=0x7fe954000ed0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 shutdown_connections 2024-09-22T08:12:51.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x5583b6287740 0x5583b6289be0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x5583b618ac00 0x5583b62853a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe85003cfb0 0x7fe85003f470 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 --2- 172.21.15.165:0/3078147438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5583b60f8530 0x5583b627dd50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 >> 172.21.15.165:0/3078147438 conn(0x5583b617ebe0 msgr2=0x5583b6277720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 shutdown_connections 2024-09-22T08:12:51.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.574+0000 7fe96ae98800 1 -- 172.21.15.165:0/3078147438 wait complete. 2024-09-22T08:12:51.594 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.594 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.595 ERROR:root:0 2024-09-22T08:12:51.595 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:51.599 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:51.599 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-22T08:12:51.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-22T08:12:51.600 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-22T08:12:51.646 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:51.646 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:51.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.646+0000 7f37c8719800 1 Processor -- start 2024-09-22T08:12:51.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.646+0000 7f37c8719800 1 -- start start 2024-09-22T08:12:51.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.646+0000 7f37c8719800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55824162c080 0x55824162e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.646+0000 7f37c8719800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5582414b6a20 con 0x55824162e9b0 2024-09-22T08:12:51.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.646+0000 7f37c8719800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5582414b67d0 con 0x55824162c080 2024-09-22T08:12:51.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.647+0000 7f37c6203640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55824162c080 0x55824162e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.647+0000 7f37bda02640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55824162e9b0 0x558241630da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:55202/0 (socket says 172.21.15.165:55202) 2024-09-22T08:12:51.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.647+0000 7f37c6203640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55824162c080 0x55824162e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59748/0 (socket says 172.21.15.165:59748) 2024-09-22T08:12:51.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.647+0000 7f37bda02640 1 -- 172.21.15.165:0/236982392 learned_addr learned my addr 172.21.15.165:0/236982392 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:51.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.647+0000 7f37c6203640 1 -- 172.21.15.165:0/236982392 >> v1:172.21.15.53:6789/0 conn(0x55824162e9b0 legacy=0x558241630da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.647+0000 7f37c5a02640 1 -- 172.21.15.165:0/236982392 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824778003 0 0) 0x5582414b6a20 con 0x55824162e9b0 2024-09-22T08:12:51.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.647+0000 7f37c6203640 1 -- 172.21.15.165:0/236982392 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558241633560 con 0x55824162c080 2024-09-22T08:12:51.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.649+0000 7f37c6203640 1 --2- 172.21.15.165:0/236982392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x55824162e470 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f37b800a470 tx=0x7f37b8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ce708b29470077 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.649+0000 7f37c5a02640 1 -- 172.21.15.165:0/236982392 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8053570 con 0x55824162c080 2024-09-22T08:12:51.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.649+0000 7f37c5a02640 1 -- 172.21.15.165:0/236982392 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8058070 con 0x55824162c080 2024-09-22T08:12:51.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.649+0000 7f37c5a02640 1 -- 172.21.15.165:0/236982392 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8053880 con 0x55824162c080 2024-09-22T08:12:51.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.650+0000 7f37c8719800 1 -- 172.21.15.165:0/236982392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 msgr2=0x55824162e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.650+0000 7f37c8719800 1 --2- 172.21.15.165:0/236982392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x55824162e470 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f37b800a470 tx=0x7f37b8045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:51.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.650+0000 7f37c8719800 1 -- 172.21.15.165:0/236982392 shutdown_connections 2024-09-22T08:12:51.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.650+0000 7f37c8719800 1 --2- 172.21.15.165:0/236982392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x55824162e470 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.650+0000 7f37c8719800 1 -- 172.21.15.165:0/236982392 >> 172.21.15.165:0/236982392 conn(0x558241625be0 msgr2=0x558241628020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.650+0000 7f37c8719800 1 -- 172.21.15.165:0/236982392 shutdown_connections 2024-09-22T08:12:51.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.650+0000 7f37c8719800 1 -- 172.21.15.165:0/236982392 wait complete. 2024-09-22T08:12:51.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.663+0000 7f37c8719800 1 Processor -- start 2024-09-22T08:12:51.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.664+0000 7f37c8719800 1 -- start start 2024-09-22T08:12:51.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.664+0000 7f37c8719800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x55824171ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.664+0000 7f37c8719800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5582414c3dd0 con 0x55824162c080 2024-09-22T08:12:51.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.664+0000 7f37c6203640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x55824171ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.664+0000 7f37c6203640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x55824171ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59754/0 (socket says 172.21.15.165:59754) 2024-09-22T08:12:51.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.664+0000 7f37c6203640 1 -- 172.21.15.165:0/2374379141 learned_addr learned my addr 172.21.15.165:0/2374379141 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.664+0000 7f37c6203640 1 -- 172.21.15.165:0/2374379141 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55824171b460 con 0x55824162c080 2024-09-22T08:12:51.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.665+0000 7f37c6203640 1 --2- 172.21.15.165:0/2374379141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x55824171ae70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f37b800a470 tx=0x7f37b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f21a093d517a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.665+0000 7f36b4608640 1 -- 172.21.15.165:0/2374379141 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8053570 con 0x55824162c080 2024-09-22T08:12:51.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.665+0000 7f36b4608640 1 -- 172.21.15.165:0/2374379141 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8063030 con 0x55824162c080 2024-09-22T08:12:51.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.665+0000 7f36b4608640 1 -- 172.21.15.165:0/2374379141 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8053840 con 0x55824162c080 2024-09-22T08:12:51.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.665+0000 7f37c8719800 1 -- 172.21.15.165:0/2374379141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 msgr2=0x55824171ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.665+0000 7f37c8719800 1 --2- 172.21.15.165:0/2374379141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x55824171ae70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f37b800a470 tx=0x7f37b8051000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.665+0000 7f37c8719800 1 -- 172.21.15.165:0/2374379141 shutdown_connections 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.665+0000 7f37c8719800 1 --2- 172.21.15.165:0/2374379141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x55824171ae70 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.665+0000 7f37c8719800 1 -- 172.21.15.165:0/2374379141 >> 172.21.15.165:0/2374379141 conn(0x558241625be0 msgr2=0x5582417167f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.665+0000 7f37c8719800 1 -- 172.21.15.165:0/2374379141 shutdown_connections 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.666+0000 7f37c8719800 1 -- 172.21.15.165:0/2374379141 wait complete. 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.666+0000 7f37c8719800 1 Processor -- start 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.666+0000 7f37c8719800 1 -- start start 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.666+0000 7f37c8719800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x558241722870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.666+0000 7f37c8719800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558241632850 con 0x55824162c080 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.666+0000 7f37c6203640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x558241722870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.666+0000 7f37c6203640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x558241722870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59760/0 (socket says 172.21.15.165:59760) 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.666+0000 7f37c6203640 1 -- 172.21.15.165:0/1415642291 learned_addr learned my addr 172.21.15.165:0/1415642291 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.666+0000 7f37c6203640 1 -- 172.21.15.165:0/1415642291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558241722dd0 con 0x55824162c080 2024-09-22T08:12:51.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.667+0000 7f37c6203640 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x558241722870 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f37b800a470 tx=0x7f37b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.667+0000 7f36b2e05640 1 -- 172.21.15.165:0/1415642291 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8078070 con 0x55824162c080 2024-09-22T08:12:51.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.667+0000 7f36b2e05640 1 -- 172.21.15.165:0/1415642291 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8068420 con 0x55824162c080 2024-09-22T08:12:51.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.667+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558241723060 con 0x55824162c080 2024-09-22T08:12:51.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.667+0000 7f36b2e05640 1 -- 172.21.15.165:0/1415642291 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b8068700 con 0x55824162c080 2024-09-22T08:12:51.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.667+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558241723c70 con 0x55824162c080 2024-09-22T08:12:51.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.668+0000 7f36b2e05640 1 -- 172.21.15.165:0/1415642291 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f37b807b070 con 0x55824162c080 2024-09-22T08:12:51.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.668+0000 7f36b2e05640 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36ac03cfb0 0x7f36ac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.668+0000 7f36b2e05640 1 -- 172.21.15.165:0/1415642291 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f37b80984e0 con 0x55824162c080 2024-09-22T08:12:51.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.668+0000 7f37bda02640 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36ac03cfb0 0x7f36ac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.668+0000 7f37c8719800 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824162e9b0 0x558241729ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.668+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55824172a400 con 0x55824162e9b0 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.668+0000 7f37c6a04640 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824162e9b0 0x558241729ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.668+0000 7f37bda02640 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36ac03cfb0 0x7f36ac03f470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f37b0000c00 tx=0x7f37b00013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.669+0000 7f37c6a04640 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824162e9b0 0x558241729ec0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.669+0000 7f37c6a04640 1 -- 172.21.15.165:0/1415642291 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c000a4d0 con 0x55824162e9b0 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.669+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55824172a7a0 con 0x55824162e9b0 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.669+0000 7f37c6a04640 1 -- 172.21.15.165:0/1415642291 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37c000a4d0 con 0x55824162e9b0 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.669+0000 7f37c8719800 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55824172c220 0x55824172e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.669+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55824172ee50 con 0x55824172c220 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.669+0000 7f37c6203640 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55824172c220 0x55824172e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.669+0000 7f37c6203640 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55824172c220 0x55824172e6c0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.670+0000 7f37c6203640 1 -- 172.21.15.165:0/1415642291 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37b807a030 con 0x55824172c220 2024-09-22T08:12:51.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.670+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55824172aff0 con 0x55824162e9b0 2024-09-22T08:12:51.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.670+0000 7f37c6a04640 1 -- 172.21.15.165:0/1415642291 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37c000a4d0 con 0x55824162e9b0 2024-09-22T08:12:51.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.670+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55824172b390 con 0x55824162e9b0 2024-09-22T08:12:51.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.670+0000 7f37c6a04640 1 -- 172.21.15.165:0/1415642291 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37c000a4d0 con 0x55824162e9b0 2024-09-22T08:12:51.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.671+0000 7f37c8719800 1 Processor -- start 2024-09-22T08:12:51.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.671+0000 7f37c8719800 1 -- start start 2024-09-22T08:12:51.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.671+0000 7f37c8719800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824173d760 0x55824173db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.671+0000 7f37c8719800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558241522d50 con 0x55824173d760 2024-09-22T08:12:51.683 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.671+0000 7f37c6a04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824173d760 0x55824173db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.671+0000 7f37c6a04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824173d760 0x55824173db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59774/0 (socket says 172.21.15.165:59774) 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.671+0000 7f37c6a04640 1 -- 172.21.15.165:0/3920221686 learned_addr learned my addr 172.21.15.165:0/3920221686 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.671+0000 7f37c6a04640 1 -- 172.21.15.165:0/3920221686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55824173e1c0 con 0x55824173d760 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.672+0000 7f37c6a04640 1 --2- 172.21.15.165:0/3920221686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824173d760 0x55824173db80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x558241723870 tx=0x7f37c0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.672+0000 7f36abfff640 1 -- 172.21.15.165:0/3920221686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0014450 con 0x55824173d760 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.672+0000 7f36abfff640 1 -- 172.21.15.165:0/3920221686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c0014610 con 0x55824173d760 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.672+0000 7f36abfff640 1 -- 172.21.15.165:0/3920221686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0014930 con 0x55824173d760 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.672+0000 7f37c8719800 1 -- 172.21.15.165:0/3920221686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55824173e9f0 con 0x55824173d760 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.672+0000 7f37c8719800 1 -- 172.21.15.165:0/3920221686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55824173ef90 con 0x55824173d760 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.673+0000 7f36abfff640 1 -- 172.21.15.165:0/3920221686 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f37c0011040 con 0x55824173d760 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.673+0000 7f36abfff640 1 --2- 172.21.15.165:0/3920221686 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36a003cfb0 0x7f36a003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.673+0000 7f36abfff640 1 -- 172.21.15.165:0/3920221686 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f37c001e070 con 0x55824173d760 2024-09-22T08:12:51.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.673+0000 7f37c6203640 1 --2- 172.21.15.165:0/3920221686 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36a003cfb0 0x7f36a003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.673+0000 7f37c8719800 1 Processor -- start 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.673+0000 7f37c8719800 1 -- start start 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.673+0000 7f37c6203640 1 --2- 172.21.15.165:0/3920221686 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36a003cfb0 0x7f36a003f470 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x558241724900 tx=0x7f37b8052650 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.673+0000 7f37c8719800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x55824162b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.673+0000 7f37c8719800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55824171b830 con 0x55824162b130 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.674+0000 7f37c6a04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x55824162b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.674+0000 7f37c6a04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x55824162b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59790/0 (socket says 172.21.15.165:59790) 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.674+0000 7f37c6a04640 1 -- 172.21.15.165:0/2369887994 learned_addr learned my addr 172.21.15.165:0/2369887994 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.674+0000 7f37c6a04640 1 -- 172.21.15.165:0/2369887994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55824162ba70 con 0x55824162b130 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.674+0000 7f37c6a04640 1 --2- 172.21.15.165:0/2369887994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x55824162b530 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f37c0016fd0 tx=0x7f37c0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbb5ae723ad7dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.674+0000 7f36a9ffb640 1 -- 172.21.15.165:0/2369887994 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0011da0 con 0x55824162b130 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.674+0000 7f36a9ffb640 1 -- 172.21.15.165:0/2369887994 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00532d0 con 0x55824162b130 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.674+0000 7f36a9ffb640 1 -- 172.21.15.165:0/2369887994 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c00168f0 con 0x55824162b130 2024-09-22T08:12:51.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 -- 172.21.15.165:0/2369887994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 msgr2=0x55824162b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 --2- 172.21.15.165:0/2369887994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x55824162b530 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f37c0016fd0 tx=0x7f37c0011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 -- 172.21.15.165:0/2369887994 shutdown_connections 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 --2- 172.21.15.165:0/2369887994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x55824162b530 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 -- 172.21.15.165:0/2369887994 >> 172.21.15.165:0/2369887994 conn(0x558241746600 msgr2=0x558241744840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 -- 172.21.15.165:0/2369887994 shutdown_connections 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 -- 172.21.15.165:0/2369887994 wait complete. 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 Processor -- start 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 -- start start 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x558241753980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c8719800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558241629ff0 con 0x55824162b130 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c6a04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x558241753980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c6a04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x558241753980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59792/0 (socket says 172.21.15.165:59792) 2024-09-22T08:12:51.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.675+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 learned_addr learned my addr 172.21.15.165:0/1538581314 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.676+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558241753ee0 con 0x55824162b130 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.676+0000 7f37c6a04640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x558241753980 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f37c0053610 tx=0x7f37c0054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.676+0000 7f3697fff640 1 -- 172.21.15.165:0/1538581314 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0031020 con 0x55824162b130 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.676+0000 7f3697fff640 1 -- 172.21.15.165:0/1538581314 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00168f0 con 0x55824162b130 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.676+0000 7f3697fff640 1 -- 172.21.15.165:0/1538581314 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0014c20 con 0x55824162b130 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.676+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558241754170 con 0x55824162b130 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.676+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558241754af0 con 0x55824162b130 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.677+0000 7f3697fff640 1 -- 172.21.15.165:0/1538581314 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f37c0034020 con 0x55824162b130 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.677+0000 7f3697fff640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f369003d000 0x7f369003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.677+0000 7f3697fff640 1 -- 172.21.15.165:0/1538581314 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f37c000e040 con 0x55824162b130 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.677+0000 7f37c6203640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f369003d000 0x7f369003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37c6203640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f369003d000 0x7f369003f4c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55824172f250 tx=0x7f37b8090000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37c8719800 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824175f510 0x5582417619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558241762120 con 0x55824175f510 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37bda02640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824175f510 0x5582417619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37bda02640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824175f510 0x5582417619d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b000f5f0 con 0x55824175f510 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37c8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37c8719800 20 realm 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.678+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55824175e860 con 0x55824175f510 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b000f5f0 con 0x55824175f510 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:51.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558241762c10 con 0x55824175f510 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b000f5f0 con 0x55824175f510 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5582417634e0 con 0x55824175f510 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37b000f5f0 con 0x55824175f510 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558241763f00 0x5582417662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558241766a60 con 0x558241763f00 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c6a04640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558241763f00 0x5582417662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.679+0000 7f37c6a04640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558241763f00 0x5582417662f0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.680+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.680+0000 7f37c8719800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.680+0000 7f37c8719800 20 searching for the correct realm 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.680+0000 7f37c8719800 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x558241768a10 0x55824176aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.680+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241768a10 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.680+0000 7f37c6203640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x558241768a10 0x55824176aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.680+0000 7f37c6203640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x558241768a10 0x55824176aed0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.680+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.680+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241763f00 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.681+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.681+0000 7f37c6a04640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f37c0036020 0x7f37c004d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.681+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x7f37c0036020 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.681+0000 7f37bda02640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f37c0036020 0x7f37c004d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.682+0000 7f37bda02640 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f37c0036020 0x7f37c004d810 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.682+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b000f5f0 con 0x7f37c0036020 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.682+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x55824175f510 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.682+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b000f5f0 con 0x55824175f510 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.682+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x55824175f510 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.682+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.682+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x7f37c0036020 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.682+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.682+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241763f00 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.683+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.683+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241763f00 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.683+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.683+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241768a10 2024-09-22T08:12:51.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.683+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.683+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x55824175f510 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.683+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.683+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x7f37c0036020 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.684+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.684+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x55824175f510 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.684+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.684+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241763f00 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.684+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.684+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241768a10 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.684+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.684+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241768a10 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.685+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.685+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x7f37c0036020 2024-09-22T08:12:51.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.685+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.685+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241768a10 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.685+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.685+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241768a10 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.685+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.685+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x55824175f510 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.685+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.685+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x55824175f510 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.686+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.686+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x7f37c0036020 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.686+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.686+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241768a10 2024-09-22T08:12:51.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.686+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.686+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241763f00 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.687+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.687+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x55824175f510 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.687+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.687+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x7f37c0036020 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.687+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.687+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241768a10 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.687+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.687+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x7f37c0036020 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.688+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.688+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241763f00 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.688+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.688+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241768a10 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.688+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.688+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x7f37c0036020 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.688+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.688+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x55824175f510 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55824176b5a0 con 0x558241763f00 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:51.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558241767450 con 0x55824175f510 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558241767cf0 con 0x55824175f510 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.689+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55824176ba20 con 0x55824175f510 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 20 zone default found 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 4 Realm: () 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 20 zonegroup default 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55824176bdc0 con 0x7f37c0036020 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55824176dbd0 con 0x558241768a10 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.706 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55824176e1c0 con 0x558241768a10 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.690+0000 7f37c8719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.691+0000 7f37c8719800 20 started sync module instance, tier type = 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.691+0000 7f37c8719800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.691+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55824176d040 con 0x558241763f00 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.692+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.692+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94017932413840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55824176e620 con 0x558241763f00 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.692+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55824176ee70 con 0x55824175f510 2024-09-22T08:12:51.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.693+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94017932413840] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.693+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.693+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94017932420768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55824176ef70 con 0x55824175f510 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.693+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55824176f930 con 0x558241768a10 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.694+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94017932420768] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.694+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.694+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94017932421824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55824176eee0 con 0x558241768a10 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.694+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417707f0 con 0x558241763f00 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.695+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94017932421824] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.695+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.695+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94017932428096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558241770760 con 0x558241763f00 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.695+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417716e0 con 0x55824175f510 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.696+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94017932428096] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.697+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.697+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94017932430352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417716e0 con 0x55824175f510 2024-09-22T08:12:51.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.697+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417720a0 con 0x7f37c0036020 2024-09-22T08:12:51.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.698+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94017932430352] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.698+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.698+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94017932432400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417720a0 con 0x7f37c0036020 2024-09-22T08:12:51.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.698+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558241772a60 con 0x7f37c0036020 2024-09-22T08:12:51.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.699+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94017932432400] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.699+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.699+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94017932434416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558241772c40 con 0x7f37c0036020 2024-09-22T08:12:51.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.699+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558241773490 con 0x7f37c0036020 2024-09-22T08:12:51.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.700+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94017932434416] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.700+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.700+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94017932437872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417732a0 con 0x7f37c0036020 2024-09-22T08:12:51.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.700+0000 7f37c8719800 20 add_watcher() i=0 2024-09-22T08:12:51.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.700+0000 7f37c8719800 20 add_watcher() i=1 2024-09-22T08:12:51.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.700+0000 7f37c8719800 20 add_watcher() i=2 2024-09-22T08:12:51.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.700+0000 7f37c8719800 20 add_watcher() i=3 2024-09-22T08:12:51.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.700+0000 7f37c8719800 20 add_watcher() i=4 2024-09-22T08:12:51.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.700+0000 7f37c8719800 20 add_watcher() i=5 2024-09-22T08:12:51.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.700+0000 7f37c8719800 20 add_watcher() i=6 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.701+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94017932437872] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.701+0000 7f37c8719800 20 add_watcher() i=7 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.701+0000 7f37c8719800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.701+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558241776960 con 0x55824175f510 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.702+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.702+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94017932438928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558241773ce0 con 0x55824175f510 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.703+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94017932438928] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.703+0000 7f367cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.703+0000 7f37c8719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.703+0000 7f37c8719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.703+0000 7f37c8719800 5 note: GC not initialized 2024-09-22T08:12:51.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.703+0000 7f35f77fe640 20 reqs_thread_entry: start 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.703+0000 7f37c8719800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.703+0000 7f37c8719800 20 Filter name: none 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.704+0000 7f35f57fa640 20 reqs_thread_entry: start 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.704+0000 7f37c8719800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.704+0000 7f37c8719800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.704+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5582417a9e20 con 0x7f37c0036020 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.704+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.704+0000 7f37c8719800 20 rados_obj.operate() r=0 bl.length=503 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.704+0000 7f37c8719800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.704+0000 7f37c8719800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.704+0000 7f37c8719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.704+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417b07c0 con 0x7f37c0036020 2024-09-22T08:12:51.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.705+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.705+0000 7f37c8719800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.705+0000 7f37c8719800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.705+0000 7f37c8719800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.705+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94017932689856 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5582417abec0 con 0x55824175f510 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.706+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== watch-notify(notify (1) cookie 94017932430352 notify 146028888103 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f37b0018040 con 0x55824175f510 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.706+0000 7f36a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94017932430352 notifier 4892 bl.length()=636 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.706+0000 7f36a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.706+0000 7f36a9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.706+0000 7f36a9ffb640 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f368c003ea0 con 0x55824175f510 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.706+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 notify.4 [notify cookie 94017932689856 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.706+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== watch-notify(notify_complete (2) cookie 94017932689856 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f37b00309c0 con 0x55824175f510 2024-09-22T08:12:51.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.706+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.717 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:12:50.302079Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.302069Z","tags":[],"group_ids":[]} 2024-09-22T08:12:51.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.707+0000 7f367cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.707+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94017932438928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417a7b40 con 0x55824175f510 2024-09-22T08:12:51.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.708+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94017932438928] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.708+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94017932413840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417a7b40 con 0x558241763f00 2024-09-22T08:12:51.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.709+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94017932413840] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.709+0000 7f37c8719800 20 remove_watcher() i=0 2024-09-22T08:12:51.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.709+0000 7f37c8719800 2 removed watcher, disabling cache 2024-09-22T08:12:51.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.709+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94017932420768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417a7b40 con 0x55824175f510 2024-09-22T08:12:51.722 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.710+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94017932420768] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.710+0000 7f37c8719800 20 remove_watcher() i=1 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.710+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94017932421824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5582417a7b40 con 0x558241768a10 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.711+0000 7f37c6203640 1 -- 172.21.15.165:0/1538581314 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94017932421824] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b808b040 con 0x558241768a10 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.711+0000 7f37c8719800 20 remove_watcher() i=2 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.711+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94017932428096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55824176cb90 con 0x558241763f00 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.712+0000 7f37c6a04640 1 -- 172.21.15.165:0/1538581314 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94017932428096] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c002a070 con 0x558241763f00 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.712+0000 7f37c8719800 20 remove_watcher() i=3 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.712+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94017932430352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55824176cb90 con 0x55824175f510 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.713+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94017932430352] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x55824175f510 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.713+0000 7f37c8719800 20 remove_watcher() i=4 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.713+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94017932432400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558241770c10 con 0x7f37c0036020 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.714+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94017932432400] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.714+0000 7f37c8719800 20 remove_watcher() i=5 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.714+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94017932434416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55824176cb90 con 0x7f37c0036020 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.715+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94017932434416] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.715+0000 7f37c8719800 20 remove_watcher() i=6 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.715+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94017932437872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558241771bf0 con 0x7f37c0036020 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94017932437872] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b002b040 con 0x7f37c0036020 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 20 remove_watcher() i=7 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f37c0036020 msgr2=0x7f37c004d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f37c0036020 0x7f37c004d810 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824175f510 msgr2=0x5582417619d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824175f510 0x5582417619d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558241763f00 msgr2=0x5582417662f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x558241763f00 0x5582417662f0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x558241768a10 msgr2=0x55824176aed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x558241768a10 0x55824176aed0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f369003d000 msgr2=0x7f369003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f369003d000 0x7f369003f4c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55824172f250 tx=0x7f37b8090000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 msgr2=0x558241753980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37c8719800 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x558241753980 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f37c0053610 tx=0x7f37c0054720 comp rx=0 tx=0).stop 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.716+0000 7f37bda02640 1 -- 172.21.15.165:0/1538581314 reap_dead start 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 shutdown_connections 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 --2- 172.21.15.165:0/1538581314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162b130 0x558241753980 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 >> 172.21.15.165:0/1538581314 conn(0x558241746600 msgr2=0x558241744810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 shutdown_connections 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/1538581314 wait complete. 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/3920221686 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36a003cfb0 msgr2=0x7f36a003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 --2- 172.21.15.165:0/3920221686 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36a003cfb0 0x7f36a003f470 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x558241724900 tx=0x7f37b8052650 comp rx=0 tx=0).stop 2024-09-22T08:12:51.725 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/3920221686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824173d760 msgr2=0x55824173db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 --2- 172.21.15.165:0/3920221686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824173d760 0x55824173db80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x558241723870 tx=0x7f37c0018830 comp rx=0 tx=0).stop 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/3920221686 shutdown_connections 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 --2- 172.21.15.165:0/3920221686 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36a003cfb0 0x7f36a003f470 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 --2- 172.21.15.165:0/3920221686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824173d760 0x55824173db80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/3920221686 >> 172.21.15.165:0/3920221686 conn(0x558241731b10 msgr2=0x558241731ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/3920221686 shutdown_connections 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/3920221686 wait complete. 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824162e9b0 msgr2=0x558241729ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824162e9b0 0x558241729ec0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55824172c220 msgr2=0x55824172e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55824172c220 0x55824172e6c0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36ac03cfb0 msgr2=0x7f36ac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.726 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36ac03cfb0 0x7f36ac03f470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f37b0000c00 tx=0x7f37b00013b0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 msgr2=0x558241722870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.717+0000 7f37c8719800 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x558241722870 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f37b800a470 tx=0x7f37b8002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.718+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 shutdown_connections 2024-09-22T08:12:51.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.718+0000 7f37c8719800 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55824172c220 0x55824172e6c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.718+0000 7f37c8719800 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55824162e9b0 0x558241729ec0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.718+0000 7f37c8719800 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f36ac03cfb0 0x7f36ac03f470 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.718+0000 7f37c8719800 1 --2- 172.21.15.165:0/1415642291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55824162c080 0x558241722870 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.718+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 >> 172.21.15.165:0/1415642291 conn(0x558241625be0 msgr2=0x558241714fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.718+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 shutdown_connections 2024-09-22T08:12:51.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.718+0000 7f37c8719800 1 -- 172.21.15.165:0/1415642291 wait complete. 2024-09-22T08:12:51.728 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.728 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.728 ERROR:root:0 2024-09-22T08:12:51.728 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-22T08:12:51.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-22T08:12:51.729 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-22T08:12:51.776 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:51.776 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:51.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642f8bb800 1 Processor -- start 2024-09-22T08:12:51.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642f8bb800 1 -- start start 2024-09-22T08:12:51.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642f8bb800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ea032a2be0 0x55ea032a2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642f8bb800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea0312fa20 con 0x55ea032a7850 2024-09-22T08:12:51.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642f8bb800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ea0312f7d0 con 0x55ea032a2be0 2024-09-22T08:12:51.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642d3a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ea032a2be0 0x55ea032a2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642cba4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55ea032a7850 0x55ea032a9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:55208/0 (socket says 172.21.15.165:55208) 2024-09-22T08:12:51.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642cba4640 1 -- 172.21.15.165:0/28040349 learned_addr learned my addr 172.21.15.165:0/28040349 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:51.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642d3a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ea032a2be0 0x55ea032a2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59800/0 (socket says 172.21.15.165:59800) 2024-09-22T08:12:51.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642d3a5640 1 -- 172.21.15.165:0/28040349 >> v1:172.21.15.53:6789/0 conn(0x55ea032a7850 legacy=0x55ea032a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.776+0000 7f642d3a5640 1 -- 172.21.15.165:0/28040349 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea032ac580 con 0x55ea032a2be0 2024-09-22T08:12:51.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.778+0000 7f642d3a5640 1 --2- 172.21.15.165:0/28040349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea032a2fe0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6420005fd0 tx=0x7f6420045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abee7496389932e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.778+0000 7f6427fff640 1 -- 172.21.15.165:0/28040349 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420058530 con 0x55ea032a2be0 2024-09-22T08:12:51.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.778+0000 7f6427fff640 1 -- 172.21.15.165:0/28040349 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64200586d0 con 0x55ea032a2be0 2024-09-22T08:12:51.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.778+0000 7f6427fff640 1 -- 172.21.15.165:0/28040349 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64200589d0 con 0x55ea032a2be0 2024-09-22T08:12:51.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.779+0000 7f642f8bb800 1 -- 172.21.15.165:0/28040349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 msgr2=0x55ea032a2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.779+0000 7f642f8bb800 1 --2- 172.21.15.165:0/28040349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea032a2fe0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6420005fd0 tx=0x7f6420045c30 comp rx=0 tx=0).stop 2024-09-22T08:12:51.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.779+0000 7f642f8bb800 1 -- 172.21.15.165:0/28040349 shutdown_connections 2024-09-22T08:12:51.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.779+0000 7f642f8bb800 1 --2- 172.21.15.165:0/28040349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea032a2fe0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.779+0000 7f642f8bb800 1 -- 172.21.15.165:0/28040349 >> 172.21.15.165:0/28040349 conn(0x55ea0329e310 msgr2=0x55ea032a0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.779+0000 7f642f8bb800 1 -- 172.21.15.165:0/28040349 shutdown_connections 2024-09-22T08:12:51.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.779+0000 7f642f8bb800 1 -- 172.21.15.165:0/28040349 wait complete. 2024-09-22T08:12:51.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.793+0000 7f642f8bb800 1 Processor -- start 2024-09-22T08:12:51.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.793+0000 7f642f8bb800 1 -- start start 2024-09-22T08:12:51.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.793+0000 7f642f8bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea032a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.793+0000 7f642f8bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ea0313cdd0 con 0x55ea032a2be0 2024-09-22T08:12:51.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.793+0000 7f642d3a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea032a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.793+0000 7f642d3a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea032a4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59806/0 (socket says 172.21.15.165:59806) 2024-09-22T08:12:51.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.793+0000 7f642d3a5640 1 -- 172.21.15.165:0/252838269 learned_addr learned my addr 172.21.15.165:0/252838269 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.795 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.793+0000 7f642d3a5640 1 -- 172.21.15.165:0/252838269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea032a55a0 con 0x55ea032a2be0 2024-09-22T08:12:51.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.794+0000 7f642d3a5640 1 --2- 172.21.15.165:0/252838269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea032a4fb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6420025a60 tx=0x7f6420051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad79adb169279bb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.794+0000 7f631b606640 1 -- 172.21.15.165:0/252838269 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64200589b0 con 0x55ea032a2be0 2024-09-22T08:12:51.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.794+0000 7f631b606640 1 -- 172.21.15.165:0/252838269 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420068070 con 0x55ea032a2be0 2024-09-22T08:12:51.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.794+0000 7f631b606640 1 -- 172.21.15.165:0/252838269 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420058c80 con 0x55ea032a2be0 2024-09-22T08:12:51.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.794+0000 7f642f8bb800 1 -- 172.21.15.165:0/252838269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 msgr2=0x55ea032a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.794+0000 7f642f8bb800 1 --2- 172.21.15.165:0/252838269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea032a4fb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6420025a60 tx=0x7f6420051000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642f8bb800 1 -- 172.21.15.165:0/252838269 shutdown_connections 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642f8bb800 1 --2- 172.21.15.165:0/252838269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea032a4fb0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642f8bb800 1 -- 172.21.15.165:0/252838269 >> 172.21.15.165:0/252838269 conn(0x55ea0329e310 msgr2=0x55ea0338fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642f8bb800 1 -- 172.21.15.165:0/252838269 shutdown_connections 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642f8bb800 1 -- 172.21.15.165:0/252838269 wait complete. 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642f8bb800 1 Processor -- start 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642f8bb800 1 -- start start 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642f8bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea0339dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642f8bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ea032ab820 con 0x55ea032a2be0 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642d3a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea0339dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642d3a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea0339dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59814/0 (socket says 172.21.15.165:59814) 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.795+0000 7f642d3a5640 1 -- 172.21.15.165:0/2480185264 learned_addr learned my addr 172.21.15.165:0/2480185264 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.796+0000 7f642d3a5640 1 -- 172.21.15.165:0/2480185264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea0339e220 con 0x55ea032a2be0 2024-09-22T08:12:51.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.796+0000 7f642d3a5640 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea0339dcc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6420025a60 tx=0x7f6420003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.796+0000 7f6319e03640 1 -- 172.21.15.165:0/2480185264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420063650 con 0x55ea032a2be0 2024-09-22T08:12:51.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.796+0000 7f6319e03640 1 -- 172.21.15.165:0/2480185264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64200637f0 con 0x55ea032a2be0 2024-09-22T08:12:51.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.796+0000 7f6319e03640 1 -- 172.21.15.165:0/2480185264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6420063af0 con 0x55ea032a2be0 2024-09-22T08:12:51.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.796+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea0339e4b0 con 0x55ea032a2be0 2024-09-22T08:12:51.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.796+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea0339f0c0 con 0x55ea032a2be0 2024-09-22T08:12:51.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.797+0000 7f6319e03640 1 -- 172.21.15.165:0/2480185264 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6420063c90 con 0x55ea032a2be0 2024-09-22T08:12:51.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.797+0000 7f6319e03640 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631403cfb0 0x7f631403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.797+0000 7f6319e03640 1 -- 172.21.15.165:0/2480185264 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6420098860 con 0x55ea032a2be0 2024-09-22T08:12:51.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.797+0000 7f642cba4640 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631403cfb0 0x7f631403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.797+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea032a7850 0x55ea033a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.797+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033a5850 con 0x55ea032a7850 2024-09-22T08:12:51.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.797+0000 7f642dba6640 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea032a7850 0x55ea033a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.798+0000 7f642cba4640 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631403cfb0 0x7f631403f470 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6418001d70 tx=0x7f64180012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.798+0000 7f642dba6640 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea032a7850 0x55ea033a5310 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.798+0000 7f642dba6640 1 -- 172.21.15.165:0/2480185264 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64280083e0 con 0x55ea032a7850 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.798+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033a5bf0 con 0x55ea032a7850 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.798+0000 7f642dba6640 1 -- 172.21.15.165:0/2480185264 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64280083e0 con 0x55ea032a7850 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.798+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033a7730 0x55ea033a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.798+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033aa330 con 0x55ea033a7730 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.798+0000 7f642d3a5640 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033a7730 0x55ea033a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.799+0000 7f642d3a5640 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033a7730 0x55ea033a9ba0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.799+0000 7f642d3a5640 1 -- 172.21.15.165:0/2480185264 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033a7730 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.799+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033a6440 con 0x55ea032a7850 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.799+0000 7f642dba6640 1 -- 172.21.15.165:0/2480185264 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64280083e0 con 0x55ea032a7850 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.799+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033a68e0 con 0x55ea032a7850 2024-09-22T08:12:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.800+0000 7f642dba6640 1 -- 172.21.15.165:0/2480185264 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f64280083e0 con 0x55ea032a7850 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.800+0000 7f642f8bb800 1 Processor -- start 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.800+0000 7f642f8bb800 1 -- start start 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.800+0000 7f642f8bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033b8d10 0x55ea033b9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.800+0000 7f642f8bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ea0319bd50 con 0x55ea033b8d10 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.800+0000 7f642dba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033b8d10 0x55ea033b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.800+0000 7f642dba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033b8d10 0x55ea033b9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59826/0 (socket says 172.21.15.165:59826) 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.800+0000 7f642dba6640 1 -- 172.21.15.165:0/994823876 learned_addr learned my addr 172.21.15.165:0/994823876 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.801+0000 7f642dba6640 1 -- 172.21.15.165:0/994823876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea033b9770 con 0x55ea033b8d10 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.801+0000 7f642dba6640 1 --2- 172.21.15.165:0/994823876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033b8d10 0x55ea033b9130 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x55ea0339fc00 tx=0x7f642800af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.801+0000 7f6312ffd640 1 -- 172.21.15.165:0/994823876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6428007d60 con 0x55ea033b8d10 2024-09-22T08:12:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.801+0000 7f6312ffd640 1 -- 172.21.15.165:0/994823876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642801e020 con 0x55ea033b8d10 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.801+0000 7f642f8bb800 1 -- 172.21.15.165:0/994823876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea033b9fa0 con 0x55ea033b8d10 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.801+0000 7f6312ffd640 1 -- 172.21.15.165:0/994823876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6428019590 con 0x55ea033b8d10 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.801+0000 7f642f8bb800 1 -- 172.21.15.165:0/994823876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea033ba540 con 0x55ea033b8d10 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.802+0000 7f6312ffd640 1 -- 172.21.15.165:0/994823876 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6428016040 con 0x55ea033b8d10 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.802+0000 7f6312ffd640 1 --2- 172.21.15.165:0/994823876 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630803d000 0x7f630803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.802+0000 7f6312ffd640 1 -- 172.21.15.165:0/994823876 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f642801f030 con 0x55ea033b8d10 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.802+0000 7f642d3a5640 1 --2- 172.21.15.165:0/994823876 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630803d000 0x7f630803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.802+0000 7f642f8bb800 1 Processor -- start 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.802+0000 7f642d3a5640 1 --2- 172.21.15.165:0/994823876 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630803d000 0x7f630803f4c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55ea0339fde0 tx=0x7f6420095040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.802+0000 7f642f8bb800 1 -- start start 2024-09-22T08:12:51.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.803+0000 7f642f8bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.803+0000 7f642f8bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ea032a3990 con 0x55ea033c57d0 2024-09-22T08:12:51.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.803+0000 7f642dba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.803+0000 7f642dba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59834/0 (socket says 172.21.15.165:59834) 2024-09-22T08:12:51.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.803+0000 7f642dba6640 1 -- 172.21.15.165:0/1278652911 learned_addr learned my addr 172.21.15.165:0/1278652911 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.803+0000 7f642dba6640 1 -- 172.21.15.165:0/1278652911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea033c61c0 con 0x55ea033c57d0 2024-09-22T08:12:51.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.803+0000 7f642dba6640 1 --2- 172.21.15.165:0/1278652911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033c5bd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6428054590 tx=0x7f6428016f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eab96286b85ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.803+0000 7f6310ff9640 1 -- 172.21.15.165:0/1278652911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6428051020 con 0x55ea033c57d0 2024-09-22T08:12:51.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.803+0000 7f6310ff9640 1 -- 172.21.15.165:0/1278652911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280560d0 con 0x55ea033c57d0 2024-09-22T08:12:51.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.803+0000 7f6310ff9640 1 -- 172.21.15.165:0/1278652911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f642801d070 con 0x55ea033c57d0 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 -- 172.21.15.165:0/1278652911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 msgr2=0x55ea033c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 --2- 172.21.15.165:0/1278652911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033c5bd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6428054590 tx=0x7f6428016f80 comp rx=0 tx=0).stop 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 -- 172.21.15.165:0/1278652911 shutdown_connections 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 --2- 172.21.15.165:0/1278652911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033c5bd0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 -- 172.21.15.165:0/1278652911 >> 172.21.15.165:0/1278652911 conn(0x55ea033c1bd0 msgr2=0x55ea033bfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 -- 172.21.15.165:0/1278652911 shutdown_connections 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 -- 172.21.15.165:0/1278652911 wait complete. 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 Processor -- start 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 -- start start 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.804+0000 7f642f8bb800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ea033c67e0 con 0x55ea033c57d0 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.805+0000 7f642dba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.805+0000 7f642dba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59842/0 (socket says 172.21.15.165:59842) 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.805+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 learned_addr learned my addr 172.21.15.165:0/2653686184 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.805+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea033cd370 con 0x55ea033c57d0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.805+0000 7f642dba6640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033cce10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6428054650 tx=0x7f6428054520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.805+0000 7f62feffd640 1 -- 172.21.15.165:0/2653686184 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6428031030 con 0x55ea033c57d0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.805+0000 7f62feffd640 1 -- 172.21.15.165:0/2653686184 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6428054b30 con 0x55ea033c57d0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.805+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea033cd600 con 0x55ea033c57d0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.805+0000 7f62feffd640 1 -- 172.21.15.165:0/2653686184 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6428054e50 con 0x55ea033c57d0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.805+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea033cdf80 con 0x55ea033c57d0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.806+0000 7f62feffd640 1 -- 172.21.15.165:0/2653686184 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6428034070 con 0x55ea033c57d0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.806+0000 7f62feffd640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f62f803d1a0 0x7f62f803f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.806+0000 7f62feffd640 1 -- 172.21.15.165:0/2653686184 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6428032070 con 0x55ea033c57d0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.806+0000 7f642d3a5640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f62f803d1a0 0x7f62f803f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642d3a5640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f62f803d1a0 0x7f62f803f660 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6420074c40 tx=0x7f6420085000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea033d8790 0x55ea033dac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033db3a0 con 0x55ea033d8790 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642cba4640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea033d8790 0x55ea033dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642cba4640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea033d8790 0x55ea033dac50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6418009050 con 0x55ea033d8790 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642f8bb800 20 realm 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.807+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033d7ae0 con 0x55ea033d8790 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6418009050 con 0x55ea033d8790 2024-09-22T08:12:51.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033dbe90 con 0x55ea033d8790 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6418009050 con 0x55ea033d8790 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033dc760 con 0x55ea033d8790 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6418009050 con 0x55ea033d8790 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033dd180 0x55ea033df570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033dfcb0 con 0x55ea033dd180 2024-09-22T08:12:51.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642dba6640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033dd180 0x55ea033df570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.808+0000 7f642dba6640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033dd180 0x55ea033df570 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.809+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f64280083e0 con 0x55ea033dd180 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.809+0000 7f642f8bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.809+0000 7f642f8bb800 20 searching for the correct realm 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.809+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ea033e1c60 0x55ea033e4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.809+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033e1c60 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.809+0000 7f642d3a5640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ea033e1c60 0x55ea033e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.809+0000 7f642d3a5640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ea033e1c60 0x55ea033e4120 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.809+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.809+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033dd180 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.810+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f64280083e0 con 0x55ea033dd180 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.810+0000 7f642dba6640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6428036030 0x7f64280153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.810+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x7f6428036030 2024-09-22T08:12:51.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.810+0000 7f642cba4640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6428036030 0x7f64280153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.810+0000 7f642cba4640 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6428036030 0x7f64280153e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.810+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418009050 con 0x7f6428036030 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.810+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033d8790 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.811+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418009050 con 0x55ea033d8790 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.811+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033d8790 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.811+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.811+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x7f6428036030 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.811+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.811+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033dd180 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.811+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64280083e0 con 0x55ea033dd180 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.811+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033dd180 2024-09-22T08:12:51.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.812+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64280083e0 con 0x55ea033dd180 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.812+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033e1c60 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.812+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.812+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033d8790 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.812+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.812+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x7f6428036030 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.812+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.812+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033d8790 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.813+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.813+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033dd180 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.813+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f64280083e0 con 0x55ea033dd180 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.813+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033e1c60 2024-09-22T08:12:51.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.813+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.813+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033e1c60 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.813+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.813+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x7f6428036030 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.814+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.814+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033e1c60 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.814+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.814+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033e1c60 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.814+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.814+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033d8790 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.814+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.814+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033d8790 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.814+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.814+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x7f6428036030 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.815+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.815+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033e1c60 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.815+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.815+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033dd180 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.815+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6428066040 con 0x55ea033dd180 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.815+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033d8790 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.815+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.815+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x7f6428036030 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.816+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.816+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033e1c60 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.816+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.816+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x7f6428036030 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.816+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.816+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033dd180 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6428066040 con 0x55ea033dd180 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033e1c60 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x7f6428036030 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033d8790 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e47a0 con 0x55ea033dd180 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6428066040 con 0x55ea033dd180 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642f8bb800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642f8bb800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642f8bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642f8bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:51.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642f8bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.817+0000 7f642f8bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e0670 con 0x55ea033d8790 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e02b0 con 0x55ea033d8790 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e1090 con 0x55ea033d8790 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 20 zone default found 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 4 Realm: () 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 20 zonegroup default 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.818+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e50d0 con 0x7f6428036030 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e6d70 con 0x55ea033e1c60 2024-09-22T08:12:51.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e7220 con 0x55ea033e1c60 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642f8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642f8bb800 20 started sync module instance, tier type = 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642f8bb800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.819+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e5b70 con 0x55ea033dd180 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.820+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6428066040 con 0x55ea033dd180 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.820+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94463565127840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e5b70 con 0x55ea033dd180 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.820+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e7ce0 con 0x55ea033d8790 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.821+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94463565127840] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6428066040 con 0x55ea033dd180 2024-09-22T08:12:51.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.821+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.821+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94463565133808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e5b70 con 0x55ea033d8790 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.821+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e87b0 con 0x55ea033e1c60 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.823+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94463565133808] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.823+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.823+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94463565125312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e5ae0 con 0x55ea033e1c60 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.823+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e96a0 con 0x55ea033dd180 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.824+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94463565125312] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.824+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6428066040 con 0x55ea033dd180 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.824+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94463565140464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e9610 con 0x55ea033dd180 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.824+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033ea560 con 0x55ea033d8790 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.825+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.825+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94463565144240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033ea4d0 con 0x55ea033d8790 2024-09-22T08:12:51.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.825+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033eb4a0 con 0x7f6428036030 2024-09-22T08:12:51.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.825+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94463565140464] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6428066040 con 0x55ea033dd180 2024-09-22T08:12:51.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.826+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94463565144240] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.826+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.826+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94463565148016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033eb460 con 0x7f6428036030 2024-09-22T08:12:51.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.826+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033ebd40 con 0x7f6428036030 2024-09-22T08:12:51.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.827+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.827+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94463565149280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033ebd70 con 0x7f6428036030 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.827+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033ec860 con 0x7f6428036030 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.827+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94463565148016] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.828+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94463565149280] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.828+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.828+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94463565153072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033eb880 con 0x7f6428036030 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.828+0000 7f642f8bb800 20 add_watcher() i=0 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.828+0000 7f642f8bb800 20 add_watcher() i=1 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.828+0000 7f642f8bb800 20 add_watcher() i=2 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.828+0000 7f642f8bb800 20 add_watcher() i=3 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.828+0000 7f642f8bb800 20 add_watcher() i=4 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.828+0000 7f642f8bb800 20 add_watcher() i=5 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.828+0000 7f642f8bb800 20 add_watcher() i=6 2024-09-22T08:12:51.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.829+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94463565153072] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.829+0000 7f642f8bb800 20 add_watcher() i=7 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.829+0000 7f642f8bb800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.829+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea033ef880 con 0x55ea033d8790 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.830+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.830+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94463565142672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033eccd0 con 0x55ea033d8790 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94463565142672] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f62e3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f642f8bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f642f8bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f642f8bb800 5 note: GC not initialized 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f62e2fe5640 20 reqs_thread_entry: start 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f642f8bb800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:51.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f642f8bb800 20 Filter name: none 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f62e0fe1640 20 reqs_thread_entry: start 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f642f8bb800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f642f8bb800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.831+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea03422c60 con 0x7f6428036030 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.832+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.832+0000 7f642f8bb800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.832+0000 7f642f8bb800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.832+0000 7f642f8bb800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.832+0000 7f642f8bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.832+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea03429120 con 0x7f6428036030 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.833+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.833+0000 7f642f8bb800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.833+0000 7f642f8bb800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.833+0000 7f642f8bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:12:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.833+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94463565400976 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea03424850 con 0x55ea033d8790 2024-09-22T08:12:51.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.834+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== watch-notify(notify (1) cookie 94463565144240 notify 146028888104 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55ea0312fa20 con 0x55ea033d8790 2024-09-22T08:12:51.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.834+0000 7f6310ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94463565144240 notifier 4899 bl.length()=666 2024-09-22T08:12:51.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.834+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 notify.4 [notify cookie 94463565400976 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.834+0000 7f6310ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.834+0000 7f6310ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.834+0000 7f6310ff9640 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f62f0003ea0 con 0x55ea033d8790 2024-09-22T08:12:51.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.834+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.834+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify_complete (2) cookie 94463565400976 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f641802e8c0 con 0x55ea033d8790 2024-09-22T08:12:51.849 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:12:50.302079Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.302069Z","tags":[],"group_ids":[]} 2024-09-22T08:12:51.854 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.835+0000 7f62e3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.835+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94463565142672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea03420990 con 0x55ea033d8790 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.836+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94463565142672] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.836+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94463565127840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea03420990 con 0x55ea033dd180 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.837+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94463565127840] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6428066040 con 0x55ea033dd180 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.837+0000 7f642f8bb800 20 remove_watcher() i=0 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.837+0000 7f642f8bb800 2 removed watcher, disabling cache 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.837+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94463565133808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea03420990 con 0x55ea033d8790 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.838+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94463565133808] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.838+0000 7f642f8bb800 20 remove_watcher() i=1 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.838+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94463565125312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea03420990 con 0x55ea033e1c60 2024-09-22T08:12:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.839+0000 7f642d3a5640 1 -- 172.21.15.165:0/2653686184 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94463565125312] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64200743e0 con 0x55ea033e1c60 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.839+0000 7f642f8bb800 20 remove_watcher() i=2 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.839+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94463565140464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e56c0 con 0x55ea033dd180 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.840+0000 7f642dba6640 1 -- 172.21.15.165:0/2653686184 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94463565140464] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6428066040 con 0x55ea033dd180 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.840+0000 7f642f8bb800 20 remove_watcher() i=3 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.840+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94463565144240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e91f0 con 0x55ea033d8790 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.841+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94463565144240] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x55ea033d8790 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.841+0000 7f642f8bb800 20 remove_watcher() i=4 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.841+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94463565148016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e56c0 con 0x7f6428036030 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.842+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94463565148016] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.842+0000 7f642f8bb800 20 remove_watcher() i=5 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.842+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94463565149280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033ea0b0 con 0x7f6428036030 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.844+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94463565149280] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.844+0000 7f642f8bb800 20 remove_watcher() i=6 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.844+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94463565153072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea033e91f0 con 0x7f6428036030 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94463565153072] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6418029040 con 0x7f6428036030 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 20 remove_watcher() i=7 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6428036030 msgr2=0x7f64280153e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f6428036030 0x7f64280153e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea033d8790 msgr2=0x55ea033dac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea033d8790 0x55ea033dac50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033dd180 msgr2=0x55ea033df570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033dd180 0x55ea033df570 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ea033e1c60 msgr2=0x55ea033e4120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55ea033e1c60 0x55ea033e4120 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f62f803d1a0 msgr2=0x7f62f803f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f62f803d1a0 0x7f62f803f660 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6420074c40 tx=0x7f6420085000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 msgr2=0x55ea033cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642cba4640 1 -- 172.21.15.165:0/2653686184 reap_dead start 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033cce10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6428054650 tx=0x7f6428054520 comp rx=0 tx=0).stop 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 shutdown_connections 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2653686184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033c57d0 0x55ea033cce10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 >> 172.21.15.165:0/2653686184 conn(0x55ea033c1bd0 msgr2=0x55ea033bfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 shutdown_connections 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.845+0000 7f642f8bb800 1 -- 172.21.15.165:0/2653686184 wait complete. 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/994823876 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630803d000 msgr2=0x7f630803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/994823876 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630803d000 0x7f630803f4c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55ea0339fde0 tx=0x7f6420095040 comp rx=0 tx=0).stop 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/994823876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033b8d10 msgr2=0x55ea033b9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/994823876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033b8d10 0x55ea033b9130 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x55ea0339fc00 tx=0x7f642800af20 comp rx=0 tx=0).stop 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/994823876 shutdown_connections 2024-09-22T08:12:51.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/994823876 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f630803d000 0x7f630803f4c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/994823876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea033b8d10 0x55ea033b9130 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/994823876 >> 172.21.15.165:0/994823876 conn(0x55ea033ad0c0 msgr2=0x55ea033ad4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/994823876 shutdown_connections 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/994823876 wait complete. 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea032a7850 msgr2=0x55ea033a5310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea032a7850 0x55ea033a5310 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033a7730 msgr2=0x55ea033a9ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033a7730 0x55ea033a9ba0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631403cfb0 msgr2=0x7f631403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631403cfb0 0x7f631403f470 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6418001d70 tx=0x7f64180012d0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 msgr2=0x55ea0339dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea0339dcc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6420025a60 tx=0x7f6420003330 comp rx=0 tx=0).stop 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 shutdown_connections 2024-09-22T08:12:51.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55ea033a7730 0x55ea033a9ba0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55ea032a7850 0x55ea033a5310 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f631403cfb0 0x7f631403f470 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 --2- 172.21.15.165:0/2480185264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ea032a2be0 0x55ea0339dcc0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 >> 172.21.15.165:0/2480185264 conn(0x55ea0329e310 msgr2=0x55ea0338f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 shutdown_connections 2024-09-22T08:12:51.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.846+0000 7f642f8bb800 1 -- 172.21.15.165:0/2480185264 wait complete. 2024-09-22T08:12:51.861 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.862 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.862 ERROR:root:0 2024-09-22T08:12:51.862 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:51.866 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000001c09fd2a37704c32-0066efd183-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:12:51.866 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-22T08:12:51.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-22T08:12:51.867 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-22T08:12:51.913 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:51.913 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:51.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.913+0000 7f9bcb137800 1 Processor -- start 2024-09-22T08:12:51.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.913+0000 7f9bcb137800 1 -- start start 2024-09-22T08:12:51.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.913+0000 7f9bcb137800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e92e947cd0 0x55e92e9d94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.913+0000 7f9bcb137800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e92e85fa20 con 0x55e92e9d9a20 2024-09-22T08:12:51.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.913+0000 7f9bcb137800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e92e85f7d0 con 0x55e92e947cd0 2024-09-22T08:12:51.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.913+0000 7f9bc6e7d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e92e947cd0 0x55e92e9d94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.914+0000 7f9bc667c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e92e9d9a20 0x55e92e9dbec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:55210/0 (socket says 172.21.15.165:55210) 2024-09-22T08:12:51.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.914+0000 7f9bc6e7d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e92e947cd0 0x55e92e9d94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59856/0 (socket says 172.21.15.165:59856) 2024-09-22T08:12:51.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.914+0000 7f9bc667c640 1 -- 172.21.15.165:0/3292789172 learned_addr learned my addr 172.21.15.165:0/3292789172 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:51.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.914+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/3292789172 >> v1:172.21.15.53:6789/0 conn(0x55e92e9d9a20 legacy=0x55e92e9dbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.914+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/3292789172 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e92e9de780 con 0x55e92e947cd0 2024-09-22T08:12:51.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/3292789172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92e9d94e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800a470 tx=0x7f9bb8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c730934570f215 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bc5e7b640 1 -- 172.21.15.165:0/3292789172 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8053570 con 0x55e92e947cd0 2024-09-22T08:12:51.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bc5e7b640 1 -- 172.21.15.165:0/3292789172 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8058070 con 0x55e92e947cd0 2024-09-22T08:12:51.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bc5e7b640 1 -- 172.21.15.165:0/3292789172 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8053880 con 0x55e92e947cd0 2024-09-22T08:12:51.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bcb137800 1 -- 172.21.15.165:0/3292789172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 msgr2=0x55e92e9d94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bcb137800 1 --2- 172.21.15.165:0/3292789172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92e9d94e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800a470 tx=0x7f9bb8045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:51.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bcb137800 1 -- 172.21.15.165:0/3292789172 shutdown_connections 2024-09-22T08:12:51.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bcb137800 1 --2- 172.21.15.165:0/3292789172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92e9d94e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bcb137800 1 -- 172.21.15.165:0/3292789172 >> 172.21.15.165:0/3292789172 conn(0x55e92e9cebb0 msgr2=0x55e92e9d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bcb137800 1 -- 172.21.15.165:0/3292789172 shutdown_connections 2024-09-22T08:12:51.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.916+0000 7f9bcb137800 1 -- 172.21.15.165:0/3292789172 wait complete. 2024-09-22T08:12:51.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.930+0000 7f9bcb137800 1 Processor -- start 2024-09-22T08:12:51.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.930+0000 7f9bcb137800 1 -- start start 2024-09-22T08:12:51.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.930+0000 7f9bcb137800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eac6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.930+0000 7f9bcb137800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e92e86cdd0 con 0x55e92e947cd0 2024-09-22T08:12:51.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.931+0000 7f9bc6e7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eac6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.931+0000 7f9bc6e7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eac6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59858/0 (socket says 172.21.15.165:59858) 2024-09-22T08:12:51.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.931+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/2067083407 learned_addr learned my addr 172.21.15.165:0/2067083407 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.931+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/2067083407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e92eac6880 con 0x55e92e947cd0 2024-09-22T08:12:51.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.931+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/2067083407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eac6290 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8025c20 tx=0x7f9bb8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26572e4d31e573e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.931+0000 7f9ab4e09640 1 -- 172.21.15.165:0/2067083407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8053a20 con 0x55e92e947cd0 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.931+0000 7f9ab4e09640 1 -- 172.21.15.165:0/2067083407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8063070 con 0x55e92e947cd0 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.931+0000 7f9ab4e09640 1 -- 172.21.15.165:0/2067083407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8053cf0 con 0x55e92e947cd0 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.932+0000 7f9bcb137800 1 -- 172.21.15.165:0/2067083407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 msgr2=0x55e92eac6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.932+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2067083407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eac6290 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8025c20 tx=0x7f9bb8051000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.932+0000 7f9bcb137800 1 -- 172.21.15.165:0/2067083407 shutdown_connections 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.932+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2067083407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eac6290 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.932+0000 7f9bcb137800 1 -- 172.21.15.165:0/2067083407 >> 172.21.15.165:0/2067083407 conn(0x55e92e9cebb0 msgr2=0x55e92eac1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.932+0000 7f9bcb137800 1 -- 172.21.15.165:0/2067083407 shutdown_connections 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.932+0000 7f9bcb137800 1 -- 172.21.15.165:0/2067083407 wait complete. 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.932+0000 7f9bcb137800 1 Processor -- start 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.933+0000 7f9bcb137800 1 -- start start 2024-09-22T08:12:51.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.933+0000 7f9bcb137800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eacdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.933+0000 7f9bcb137800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e92e9dda20 con 0x55e92e947cd0 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.933+0000 7f9bc6e7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eacdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.933+0000 7f9bc6e7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eacdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59868/0 (socket says 172.21.15.165:59868) 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.933+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/2564500890 learned_addr learned my addr 172.21.15.165:0/2564500890 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.933+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/2564500890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e92eace1e0 con 0x55e92e947cd0 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.933+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eacdc80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8025c20 tx=0x7f9bb8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.933+0000 7f9ab3606640 1 -- 172.21.15.165:0/2564500890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb806c030 con 0x55e92e947cd0 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.933+0000 7f9ab3606640 1 -- 172.21.15.165:0/2564500890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8068660 con 0x55e92e947cd0 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.934+0000 7f9ab3606640 1 -- 172.21.15.165:0/2564500890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8068940 con 0x55e92e947cd0 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.934+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e92eace470 con 0x55e92e947cd0 2024-09-22T08:12:51.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.934+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e92eacee70 con 0x55e92e947cd0 2024-09-22T08:12:51.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.934+0000 7f9ab3606640 1 -- 172.21.15.165:0/2564500890 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9bb8068ae0 con 0x55e92e947cd0 2024-09-22T08:12:51.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.935+0000 7f9ab3606640 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aac03d000 0x7f9aac03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.935+0000 7f9ab3606640 1 -- 172.21.15.165:0/2564500890 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9bb8098ae0 con 0x55e92e947cd0 2024-09-22T08:12:51.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.935+0000 7f9bc667c640 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aac03d000 0x7f9aac03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.935+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92e9d9a20 0x55e92ead52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.935+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eacfa50 con 0x55e92e9d9a20 2024-09-22T08:12:51.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.935+0000 7f9bc767e640 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92e9d9a20 0x55e92ead52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.935+0000 7f9bc667c640 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aac03d000 0x7f9aac03f4c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc001d70 tx=0x7f9bbc0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.935+0000 7f9bc767e640 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92e9d9a20 0x55e92ead52d0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.936+0000 7f9bc767e640 1 -- 172.21.15.165:0/2564500890 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc000a4d0 con 0x55e92e9d9a20 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.936+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92ead5d50 con 0x55e92e9d9a20 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.936+0000 7f9bc767e640 1 -- 172.21.15.165:0/2564500890 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9bc000a4d0 con 0x55e92e9d9a20 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.936+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92ead7660 0x55e92ead9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.936+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eada290 con 0x55e92ead7660 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.936+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92ead7660 0x55e92ead9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.936+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92ead7660 0x55e92ead9b00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.937+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/2564500890 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9bb8051070 con 0x55e92ead7660 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.937+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92ead65a0 con 0x55e92e9d9a20 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.937+0000 7f9bc767e640 1 -- 172.21.15.165:0/2564500890 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9bc000a4d0 con 0x55e92e9d9a20 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.937+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92ead6940 con 0x55e92e9d9a20 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.937+0000 7f9bc767e640 1 -- 172.21.15.165:0/2564500890 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9bc000a4d0 con 0x55e92e9d9a20 2024-09-22T08:12:51.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.937+0000 7f9bcb137800 1 Processor -- start 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.938+0000 7f9bcb137800 1 -- start start 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.938+0000 7f9bcb137800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eae8c20 0x55e92eae9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.938+0000 7f9bcb137800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e92e8cbd50 con 0x55e92eae8c20 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.938+0000 7f9bc767e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eae8c20 0x55e92eae9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.938+0000 7f9bc767e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eae8c20 0x55e92eae9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59880/0 (socket says 172.21.15.165:59880) 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.938+0000 7f9bc767e640 1 -- 172.21.15.165:0/1459053989 learned_addr learned my addr 172.21.15.165:0/1459053989 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.938+0000 7f9bc767e640 1 -- 172.21.15.165:0/1459053989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e92eae9680 con 0x55e92eae8c20 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.938+0000 7f9bc767e640 1 --2- 172.21.15.165:0/1459053989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eae8c20 0x55e92eae9040 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55e92eacec80 tx=0x7f9bc0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.938+0000 7f9ab0e01640 1 -- 172.21.15.165:0/1459053989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc00180d0 con 0x55e92eae8c20 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.939+0000 7f9ab0e01640 1 -- 172.21.15.165:0/1459053989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc0018290 con 0x55e92eae8c20 2024-09-22T08:12:51.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.939+0000 7f9ab0e01640 1 -- 172.21.15.165:0/1459053989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc0014450 con 0x55e92eae8c20 2024-09-22T08:12:51.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.939+0000 7f9bcb137800 1 -- 172.21.15.165:0/1459053989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e92eae9eb0 con 0x55e92eae8c20 2024-09-22T08:12:51.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.939+0000 7f9bcb137800 1 -- 172.21.15.165:0/1459053989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e92eaea450 con 0x55e92eae8c20 2024-09-22T08:12:51.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.939+0000 7f9ab0e01640 1 -- 172.21.15.165:0/1459053989 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9bc0011040 con 0x55e92eae8c20 2024-09-22T08:12:51.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9ab0e01640 1 --2- 172.21.15.165:0/1459053989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aa003d000 0x7f9aa003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9ab0e01640 1 -- 172.21.15.165:0/1459053989 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9bc001e070 con 0x55e92eae8c20 2024-09-22T08:12:51.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/1459053989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aa003d000 0x7f9aa003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9bcb137800 1 Processor -- start 2024-09-22T08:12:51.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/1459053989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aa003d000 0x7f9aa003f4c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8096ef0 tx=0x7f9bb8005390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9bcb137800 1 -- start start 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9bcb137800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eaf5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9bcb137800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e92eac6c50 con 0x55e92eaf56a0 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9bc767e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eaf5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9bc767e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eaf5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59894/0 (socket says 172.21.15.165:59894) 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.940+0000 7f9bc767e640 1 -- 172.21.15.165:0/2462379751 learned_addr learned my addr 172.21.15.165:0/2462379751 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9bc767e640 1 -- 172.21.15.165:0/2462379751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e92eaf6090 con 0x55e92eaf56a0 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9bc767e640 1 --2- 172.21.15.165:0/2462379751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eaf5aa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00542e0 tx=0x7f9bc0011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71553eace1b86181 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9aaa7fc640 1 -- 172.21.15.165:0/2462379751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc002b350 con 0x55e92eaf56a0 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9aaa7fc640 1 -- 172.21.15.165:0/2462379751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc004b070 con 0x55e92eaf56a0 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9aaa7fc640 1 -- 172.21.15.165:0/2462379751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc002b620 con 0x55e92eaf56a0 2024-09-22T08:12:51.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9bcb137800 1 -- 172.21.15.165:0/2462379751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 msgr2=0x55e92eaf5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2462379751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eaf5aa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00542e0 tx=0x7f9bc0011700 comp rx=0 tx=0).stop 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9bcb137800 1 -- 172.21.15.165:0/2462379751 shutdown_connections 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2462379751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eaf5aa0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9bcb137800 1 -- 172.21.15.165:0/2462379751 >> 172.21.15.165:0/2462379751 conn(0x55e92eaf1ac0 msgr2=0x55e92eaefd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9bcb137800 1 -- 172.21.15.165:0/2462379751 shutdown_connections 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.941+0000 7f9bcb137800 1 -- 172.21.15.165:0/2462379751 wait complete. 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.942+0000 7f9bcb137800 1 Processor -- start 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.942+0000 7f9bcb137800 1 -- start start 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.942+0000 7f9bcb137800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eafcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.942+0000 7f9bcb137800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e92eaf66b0 con 0x55e92eaf56a0 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.942+0000 7f9bc767e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eafcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.942+0000 7f9bc767e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eafcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59898/0 (socket says 172.21.15.165:59898) 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.942+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 learned_addr learned my addr 172.21.15.165:0/1440026244 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.942+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e92eafd260 con 0x55e92eaf56a0 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.942+0000 7f9bc767e640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eafcd00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0011740 tx=0x7f9bc0054270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.943+0000 7f9aa8ff9640 1 -- 172.21.15.165:0/1440026244 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc002b8a0 con 0x55e92eaf56a0 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.943+0000 7f9aa8ff9640 1 -- 172.21.15.165:0/1440026244 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc0014640 con 0x55e92eaf56a0 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.943+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e92eafd4f0 con 0x55e92eaf56a0 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.943+0000 7f9aa8ff9640 1 -- 172.21.15.165:0/1440026244 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc0014940 con 0x55e92eaf56a0 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.943+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e92eafe080 con 0x55e92eaf56a0 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.944+0000 7f9aa8ff9640 1 -- 172.21.15.165:0/1440026244 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9bc00450b0 con 0x55e92eaf56a0 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.944+0000 7f9aa8ff9640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9a9003d000 0x7f9a9003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.944+0000 7f9aa8ff9640 1 -- 172.21.15.165:0/1440026244 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9bc0035030 con 0x55e92eaf56a0 2024-09-22T08:12:51.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.944+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9a9003d000 0x7f9a9003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.944+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9a9003d000 0x7f9a9003f4c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9bb807b8c0 tx=0x7f9bb8087000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.944+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.944+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92eb087a0 0x55e92eb0ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.944+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb0b3b0 con 0x55e92eb087a0 2024-09-22T08:12:51.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bc667c640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92eb087a0 0x55e92eb0ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bc667c640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92eb087a0 0x55e92eb0ac60 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bbc009050 con 0x55e92eb087a0 2024-09-22T08:12:51.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 20 realm 2024-09-22T08:12:51.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb07af0 con 0x55e92eb087a0 2024-09-22T08:12:51.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bbc009050 con 0x55e92eb087a0 2024-09-22T08:12:51.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:51.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb0bea0 con 0x55e92eb087a0 2024-09-22T08:12:51.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bbc009050 con 0x55e92eb087a0 2024-09-22T08:12:51.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.945+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb0c770 con 0x55e92eb087a0 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9bbc009050 con 0x55e92eb087a0 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bcb137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92eb0d190 0x55e92eb0f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb0fcc0 con 0x55e92eb0d190 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bc767e640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92eb0d190 0x55e92eb0f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bc767e640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92eb0d190 0x55e92eb0f580 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9bc005d040 con 0x55e92eb0d190 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bcb137800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bcb137800 20 searching for the correct realm 2024-09-22T08:12:51.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e92eb11c70 0x55e92eb14130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.946+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb11c70 2024-09-22T08:12:51.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.947+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e92eb11c70 0x55e92eb14130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.947+0000 7f9bc6e7d640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e92eb11c70 0x55e92eb14130 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.947+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.947+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb0d190 2024-09-22T08:12:51.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.947+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9bc005d040 con 0x55e92eb0d190 2024-09-22T08:12:51.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.947+0000 7f9bc767e640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9bc0014070 0x7f9bc002c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:51.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.947+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x7f9bc0014070 2024-09-22T08:12:51.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.947+0000 7f9bc667c640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9bc0014070 0x7f9bc002c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:51.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.948+0000 7f9bc667c640 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9bc0014070 0x7f9bc002c840 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:51.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.948+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc009050 con 0x7f9bc0014070 2024-09-22T08:12:51.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.948+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb087a0 2024-09-22T08:12:51.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.948+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc009050 con 0x55e92eb087a0 2024-09-22T08:12:51.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.948+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb087a0 2024-09-22T08:12:51.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.949+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.949+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x7f9bc0014070 2024-09-22T08:12:51.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.949+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.949+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb0d190 2024-09-22T08:12:51.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.949+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc005d040 con 0x55e92eb0d190 2024-09-22T08:12:51.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.949+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb0d190 2024-09-22T08:12:51.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.949+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc005d040 con 0x55e92eb0d190 2024-09-22T08:12:51.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.949+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb11c70 2024-09-22T08:12:51.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.950+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.950+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb087a0 2024-09-22T08:12:51.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.950+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.950+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x7f9bc0014070 2024-09-22T08:12:51.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.950+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.950+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb087a0 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.950+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.950+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb0d190 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.951+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9bc0068060 con 0x55e92eb0d190 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.951+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb11c70 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.951+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.951+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb11c70 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.951+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.951+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x7f9bc0014070 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.951+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.951+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb11c70 2024-09-22T08:12:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.951+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.951+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb11c70 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.952+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.952+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb087a0 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.952+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.952+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb087a0 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.952+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.952+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x7f9bc0014070 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.952+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.952+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb11c70 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.953+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.953+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb0d190 2024-09-22T08:12:51.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.953+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc0068060 con 0x55e92eb0d190 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.953+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb087a0 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.953+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.953+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x7f9bc0014070 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.953+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.953+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb11c70 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.954+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.954+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x7f9bc0014070 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.954+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.954+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb0d190 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.954+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc0068060 con 0x55e92eb0d190 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.954+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb11c70 2024-09-22T08:12:51.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.954+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.954+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x7f9bc0014070 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb087a0 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb147b0 con 0x55e92eb0d190 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc0068060 con 0x55e92eb0d190 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:51.975 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb10680 con 0x55e92eb087a0 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb10f20 con 0x55e92eb087a0 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.955+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb102c0 con 0x55e92eb087a0 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 20 zone default found 2024-09-22T08:12:51.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 4 Realm: () 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 20 zonegroup default 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb150e0 con 0x7f9bc0014070 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb16e10 con 0x55e92eb11c70 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.956+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb172a0 con 0x55e92eb11c70 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.957+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.957+0000 7f9bcb137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.957+0000 7f9bcb137800 20 started sync module instance, tier type = 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.957+0000 7f9bcb137800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.957+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb15be0 con 0x55e92eb0d190 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.958+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0068060 con 0x55e92eb0d190 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.958+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94459999117264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb15840 con 0x55e92eb0d190 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.958+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb181d0 con 0x55e92eb087a0 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.960+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.960+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94459999125248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb18990 con 0x55e92eb087a0 2024-09-22T08:12:51.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.960+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb194b0 con 0x55e92eb11c70 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.960+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94459999117264] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0068060 con 0x55e92eb0d190 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.962+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94459999125248] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.962+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.962+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94459999129472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb183e0 con 0x55e92eb11c70 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.962+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb19ec0 con 0x55e92eb0d190 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.963+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94459999129472] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.963+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0068060 con 0x55e92eb0d190 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.963+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94459999132176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1a2e0 con 0x55e92eb0d190 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.963+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1aca0 con 0x55e92eb087a0 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.964+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.964+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94459999135728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1b0c0 con 0x55e92eb087a0 2024-09-22T08:12:51.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.964+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1bbe0 con 0x7f9bc0014070 2024-09-22T08:12:51.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.964+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94459999132176] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0068060 con 0x55e92eb0d190 2024-09-22T08:12:51.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.965+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94459999135728] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.965+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.965+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94459999139504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1ac10 con 0x7f9bc0014070 2024-09-22T08:12:51.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.965+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1c480 con 0x7f9bc0014070 2024-09-22T08:12:51.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.966+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94459999139504] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.966+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.966+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94459999133232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1ac10 con 0x7f9bc0014070 2024-09-22T08:12:51.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.966+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1ca50 con 0x7f9bc0014070 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.967+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94459999133232] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.967+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.967+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94459999141760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1ca50 con 0x7f9bc0014070 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.967+0000 7f9bcb137800 20 add_watcher() i=0 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.967+0000 7f9bcb137800 20 add_watcher() i=1 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.967+0000 7f9bcb137800 20 add_watcher() i=2 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.967+0000 7f9bcb137800 20 add_watcher() i=3 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.967+0000 7f9bcb137800 20 add_watcher() i=4 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.967+0000 7f9bcb137800 20 add_watcher() i=5 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.967+0000 7f9bcb137800 20 add_watcher() i=6 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.968+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94459999141760] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.968+0000 7f9bcb137800 20 add_watcher() i=7 2024-09-22T08:12:51.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.968+0000 7f9bcb137800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:51.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.968+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1ff20 con 0x55e92eb087a0 2024-09-22T08:12:51.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.969+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.969+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94459999144256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb1d2d0 con 0x55e92eb087a0 2024-09-22T08:12:51.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.970+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94459999144256] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.970+0000 7f9a7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.970+0000 7f9bcb137800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:51.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.970+0000 7f9bcb137800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:51.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.970+0000 7f9bcb137800 5 note: GC not initialized 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.970+0000 7f99f7fff640 20 reqs_thread_entry: start 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.970+0000 7f9bcb137800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.970+0000 7f9bcb137800 20 Filter name: none 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.971+0000 7f99f5ffb640 20 reqs_thread_entry: start 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.971+0000 7f9bcb137800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.971+0000 7f9bcb137800 20 rados->read ofs=0 len=0 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.971+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb53320 con 0x7f9bc0014070 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.971+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.971+0000 7f9bcb137800 20 rados_obj.operate() r=0 bl.length=490 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.971+0000 7f9bcb137800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.971+0000 7f9bcb137800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.971+0000 7f9bcb137800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.971+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb59930 con 0x7f9bc0014070 2024-09-22T08:12:51.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.972+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.972+0000 7f9bcb137800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.972+0000 7f9bcb137800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.972+0000 7f9bcb137800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.972+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94459999392736 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb550a0 con 0x55e92eb087a0 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.973+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== watch-notify(notify (1) cookie 94459999135728 notify 146028888105 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55e92e85fa20 con 0x55e92eb087a0 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.973+0000 7f9aaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94459999135728 notifier 4906 bl.length()=636 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.973+0000 7f9aaa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.973+0000 7f9aaa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.973+0000 7f9aaa7fc640 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9a8c003ea0 con 0x55e92eb087a0 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.973+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 notify.4 [notify cookie 94459999392736 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.973+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.973+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify_complete (2) cookie 94459999392736 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9bbc02e8c0 con 0x55e92eb087a0 2024-09-22T08:12:51.987 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:12:50.302079Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.302069Z","tags":[],"group_ids":[]} 2024-09-22T08:12:51.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.974+0000 7f9a7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.974+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94459999144256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb51030 con 0x55e92eb087a0 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.975+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94459999144256] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.975+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94459999117264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb51030 con 0x55e92eb0d190 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.976+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94459999117264] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0068060 con 0x55e92eb0d190 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.976+0000 7f9bcb137800 20 remove_watcher() i=0 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.976+0000 7f9bcb137800 2 removed watcher, disabling cache 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.976+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94459999125248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb51030 con 0x55e92eb087a0 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.977+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94459999125248] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.977+0000 7f9bcb137800 20 remove_watcher() i=1 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.977+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94459999129472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb51030 con 0x55e92eb11c70 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.978+0000 7f9bc6e7d640 1 -- 172.21.15.165:0/1440026244 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94459999129472] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bb809f040 con 0x55e92eb11c70 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.978+0000 7f9bcb137800 20 remove_watcher() i=2 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.978+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94459999132176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb51030 con 0x55e92eb0d190 2024-09-22T08:12:51.992 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.979+0000 7f9bc767e640 1 -- 172.21.15.165:0/1440026244 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94459999132176] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0068060 con 0x55e92eb0d190 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.979+0000 7f9bcb137800 20 remove_watcher() i=3 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.979+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94459999135728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb51030 con 0x55e92eb087a0 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.980+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94459999135728] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x55e92eb087a0 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.980+0000 7f9bcb137800 20 remove_watcher() i=4 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.980+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94459999139504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb51030 con 0x7f9bc0014070 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.981+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94459999139504] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.981+0000 7f9bcb137800 20 remove_watcher() i=5 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.981+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94459999133232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb51030 con 0x7f9bc0014070 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.982+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94459999133232] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.982+0000 7f9bcb137800 20 remove_watcher() i=6 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.982+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94459999141760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e92eb51030 con 0x7f9bc0014070 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94459999141760] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc029040 con 0x7f9bc0014070 2024-09-22T08:12:51.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 20 remove_watcher() i=7 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9bc0014070 msgr2=0x7f9bc002c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f9bc0014070 0x7f9bc002c840 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92eb087a0 msgr2=0x55e92eb0ac60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92eb087a0 0x55e92eb0ac60 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92eb0d190 msgr2=0x55e92eb0f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92eb0d190 0x55e92eb0f580 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e92eb11c70 msgr2=0x55e92eb14130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55e92eb11c70 0x55e92eb14130 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9a9003d000 msgr2=0x7f9a9003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9a9003d000 0x7f9a9003f4c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9bb807b8c0 tx=0x7f9bb8087000 comp rx=0 tx=0).stop 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 msgr2=0x55e92eafcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bc667c640 1 -- 172.21.15.165:0/1440026244 reap_dead start 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.983+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eafcd00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0011740 tx=0x7f9bc0054270 comp rx=0 tx=0).stop 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 shutdown_connections 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1440026244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eaf56a0 0x55e92eafcd00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 >> 172.21.15.165:0/1440026244 conn(0x55e92eaf1ac0 msgr2=0x55e92eaefcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 shutdown_connections 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/1440026244 wait complete. 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/1459053989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aa003d000 msgr2=0x7f9aa003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1459053989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aa003d000 0x7f9aa003f4c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8096ef0 tx=0x7f9bb8005390 comp rx=0 tx=0).stop 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/1459053989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eae8c20 msgr2=0x55e92eae9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1459053989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eae8c20 0x55e92eae9040 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55e92eacec80 tx=0x7f9bc0018830 comp rx=0 tx=0).stop 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/1459053989 shutdown_connections 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1459053989 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aa003d000 0x7f9aa003f4c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 --2- 172.21.15.165:0/1459053989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92eae8c20 0x55e92eae9040 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/1459053989 >> 172.21.15.165:0/1459053989 conn(0x55e92eadcfd0 msgr2=0x55e92eadd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/1459053989 shutdown_connections 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/1459053989 wait complete. 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92e9d9a20 msgr2=0x55e92ead52d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92e9d9a20 0x55e92ead52d0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92ead7660 msgr2=0x55e92ead9b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92ead7660 0x55e92ead9b00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aac03d000 msgr2=0x7f9aac03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aac03d000 0x7f9aac03f4c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc001d70 tx=0x7f9bbc0012d0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 msgr2=0x55e92eacdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.984+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eacdc80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8025c20 tx=0x7f9bb8002fb0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.985+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 shutdown_connections 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.985+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55e92ead7660 0x55e92ead9b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.985+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55e92e9d9a20 0x55e92ead52d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.985+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f9aac03d000 0x7f9aac03f4c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.985+0000 7f9bcb137800 1 --2- 172.21.15.165:0/2564500890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e92e947cd0 0x55e92eacdc80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:51.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.985+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 >> 172.21.15.165:0/2564500890 conn(0x55e92e9cebb0 msgr2=0x55e92eac0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:51.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.985+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 shutdown_connections 2024-09-22T08:12:51.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:51.985+0000 7f9bcb137800 1 -- 172.21.15.165:0/2564500890 wait complete. 2024-09-22T08:12:51.998 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.998 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:51.998 ERROR:root:0 2024-09-22T08:12:51.998 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:12:51.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:12:51.998 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-22T08:12:52.044 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:52.044 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:52.045 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.044+0000 7f8bbab40800 1 Processor -- start 2024-09-22T08:12:52.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.044+0000 7f8bbab40800 1 -- start start 2024-09-22T08:12:52.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.044+0000 7f8bbab40800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b7ad0d4cb0 0x55b7ad0da640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.044+0000 7f8bbab40800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b7acf5ea20 con 0x55b7ad0d39e0 2024-09-22T08:12:52.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.044+0000 7f8bbab40800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b7acf5e7d0 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.045+0000 7f8bb6085640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b7ad0d4cb0 0x55b7ad0da640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.045+0000 7f8bb6886640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b7ad0d39e0 0x55b7ad0d45a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:55222/0 (socket says 172.21.15.165:55222) 2024-09-22T08:12:52.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.045+0000 7f8bb6085640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b7ad0d4cb0 0x55b7ad0da640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59906/0 (socket says 172.21.15.165:59906) 2024-09-22T08:12:52.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.045+0000 7f8bb6886640 1 -- 172.21.15.165:0/628159869 learned_addr learned my addr 172.21.15.165:0/628159869 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-22T08:12:52.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.045+0000 7f8bb6085640 1 -- 172.21.15.165:0/628159869 >> v1:172.21.15.53:6789/0 conn(0x55b7ad0d39e0 legacy=0x55b7ad0d45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.045+0000 7f8bb5884640 1 -- 172.21.15.165:0/628159869 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701580179 0 0) 0x55b7acf5ea20 con 0x55b7ad0d39e0 2024-09-22T08:12:52.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.045+0000 7f8bb6085640 1 -- 172.21.15.165:0/628159869 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ad0d40e0 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.047+0000 7f8bb6085640 1 --2- 172.21.15.165:0/628159869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d4cb0 0x55b7ad0da640 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000a470 tx=0x7f8ba0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5423833281b0ff server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.047+0000 7f8bb5884640 1 -- 172.21.15.165:0/628159869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba0053570 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.047+0000 7f8bb5884640 1 -- 172.21.15.165:0/628159869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba0058070 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.047+0000 7f8bb5884640 1 -- 172.21.15.165:0/628159869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba0053880 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.048+0000 7f8bbab40800 1 -- 172.21.15.165:0/628159869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d4cb0 msgr2=0x55b7ad0da640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.048+0000 7f8bbab40800 1 --2- 172.21.15.165:0/628159869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d4cb0 0x55b7ad0da640 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000a470 tx=0x7f8ba0045a20 comp rx=0 tx=0).stop 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.048+0000 7f8bbab40800 1 -- 172.21.15.165:0/628159869 shutdown_connections 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.048+0000 7f8bbab40800 1 --2- 172.21.15.165:0/628159869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d4cb0 0x55b7ad0da640 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.048+0000 7f8bbab40800 1 -- 172.21.15.165:0/628159869 >> 172.21.15.165:0/628159869 conn(0x55b7ad0cedb0 msgr2=0x55b7ad0d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.048+0000 7f8bbab40800 1 -- 172.21.15.165:0/628159869 shutdown_connections 2024-09-22T08:12:52.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.048+0000 7f8bbab40800 1 -- 172.21.15.165:0/628159869 wait complete. 2024-09-22T08:12:52.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.061+0000 7f8bbab40800 1 Processor -- start 2024-09-22T08:12:52.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.061+0000 7f8bbab40800 1 -- start start 2024-09-22T08:12:52.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.062+0000 7f8bbab40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad1c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.062+0000 7f8bbab40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7acf6bdd0 con 0x55b7ad0d39e0 2024-09-22T08:12:52.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.062+0000 7f8bb6886640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad1c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.062+0000 7f8bb6886640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad1c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59912/0 (socket says 172.21.15.165:59912) 2024-09-22T08:12:52.086 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.062+0000 7f8bb6886640 1 -- 172.21.15.165:0/3590813709 learned_addr learned my addr 172.21.15.165:0/3590813709 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.062+0000 7f8bb6886640 1 -- 172.21.15.165:0/3590813709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ad1c3450 con 0x55b7ad0d39e0 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8bb6886640 1 --2- 172.21.15.165:0/3590813709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad1c2e60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8001ea0 tx=0x7f8ba800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7453639f4c172a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8aa4e09640 1 -- 172.21.15.165:0/3590813709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba8008070 con 0x55b7ad0d39e0 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8aa4e09640 1 -- 172.21.15.165:0/3590813709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba800d500 con 0x55b7ad0d39e0 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8aa4e09640 1 -- 172.21.15.165:0/3590813709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba800d880 con 0x55b7ad0d39e0 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8bbab40800 1 -- 172.21.15.165:0/3590813709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 msgr2=0x55b7ad1c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8bbab40800 1 --2- 172.21.15.165:0/3590813709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad1c2e60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8001ea0 tx=0x7f8ba800b6a0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8bbab40800 1 -- 172.21.15.165:0/3590813709 shutdown_connections 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8bbab40800 1 --2- 172.21.15.165:0/3590813709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad1c2e60 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8bbab40800 1 -- 172.21.15.165:0/3590813709 >> 172.21.15.165:0/3590813709 conn(0x55b7ad0cedb0 msgr2=0x55b7ad1be7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8bbab40800 1 -- 172.21.15.165:0/3590813709 shutdown_connections 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.063+0000 7f8bbab40800 1 -- 172.21.15.165:0/3590813709 wait complete. 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.064+0000 7f8bbab40800 1 Processor -- start 2024-09-22T08:12:52.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.064+0000 7f8bbab40800 1 -- start start 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.064+0000 7f8bbab40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad049260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.064+0000 7f8bbab40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7ad0dab80 con 0x55b7ad0d39e0 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.064+0000 7f8bb6886640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad049260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.064+0000 7f8bb6886640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad049260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59914/0 (socket says 172.21.15.165:59914) 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.064+0000 7f8bb6886640 1 -- 172.21.15.165:0/1044632053 learned_addr learned my addr 172.21.15.165:0/1044632053 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.064+0000 7f8bb6886640 1 -- 172.21.15.165:0/1044632053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ad0497c0 con 0x55b7ad0d39e0 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.065+0000 7f8bb6886640 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad049260 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80012f0 tx=0x7f8ba8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.065+0000 7f8aa3606640 1 -- 172.21.15.165:0/1044632053 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba800f9d0 con 0x55b7ad0d39e0 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.065+0000 7f8aa3606640 1 -- 172.21.15.165:0/1044632053 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba800fb70 con 0x55b7ad0d39e0 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.065+0000 7f8aa3606640 1 -- 172.21.15.165:0/1044632053 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba800fe50 con 0x55b7ad0d39e0 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.065+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7ad047b70 con 0x55b7ad0d39e0 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.065+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7ad048130 con 0x55b7ad0d39e0 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.066+0000 7f8aa3606640 1 -- 172.21.15.165:0/1044632053 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8ba8017040 con 0x55b7ad0d39e0 2024-09-22T08:12:52.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.066+0000 7f8aa3606640 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9c03d150 0x7f8a9c03f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.066+0000 7f8aa3606640 1 -- 172.21.15.165:0/1044632053 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8ba8015020 con 0x55b7ad0d39e0 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.066+0000 7f8bb6085640 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9c03d150 0x7f8a9c03f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.066+0000 7f8bbab40800 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad0d4cb0 0x55b7ad1d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.066+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad1d43a0 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.066+0000 7f8bb7087640 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad0d4cb0 0x55b7ad1d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.067+0000 7f8bb6085640 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9c03d150 0x7f8a9c03f610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0057000 tx=0x7f8ba0052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.067+0000 7f8bb7087640 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad0d4cb0 0x55b7ad1d3e60 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.067+0000 7f8bb7087640 1 -- 172.21.15.165:0/1044632053 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8bb000a4d0 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.067+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad048630 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.067+0000 7f8bb7087640 1 -- 172.21.15.165:0/1044632053 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8bb000a4d0 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.067+0000 7f8bbab40800 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad1d66f0 0x55b7ad1d8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.067+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad1d91b0 con 0x55b7ad1d66f0 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.067+0000 7f8bb6886640 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad1d66f0 0x55b7ad1d8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.068+0000 7f8bb6886640 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad1d66f0 0x55b7ad1d8ae0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.068+0000 7f8bb6886640 1 -- 172.21.15.165:0/1044632053 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad1d66f0 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.068+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad1d5590 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.068+0000 7f8bb7087640 1 -- 172.21.15.165:0/1044632053 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8bb000a4d0 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.068+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad1d5a10 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.068+0000 7f8bb7087640 1 -- 172.21.15.165:0/1044632053 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8bb000a4d0 con 0x55b7ad0d4cb0 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.069+0000 7f8bbab40800 1 Processor -- start 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.069+0000 7f8bbab40800 1 -- start start 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.069+0000 7f8bbab40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1e7b60 0x55b7ad1e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.069+0000 7f8bbab40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7acfcad50 con 0x55b7ad1e7b60 2024-09-22T08:12:52.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.069+0000 7f8bb7087640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1e7b60 0x55b7ad1e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.069+0000 7f8bb7087640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1e7b60 0x55b7ad1e7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59920/0 (socket says 172.21.15.165:59920) 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.069+0000 7f8bb7087640 1 -- 172.21.15.165:0/2634358363 learned_addr learned my addr 172.21.15.165:0/2634358363 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.070+0000 7f8bb7087640 1 -- 172.21.15.165:0/2634358363 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ad1e85c0 con 0x55b7ad1e7b60 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.070+0000 7f8bb7087640 1 --2- 172.21.15.165:0/2634358363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1e7b60 0x55b7ad1e7f80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55b7ad1d47a0 tx=0x7f8bb0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.070+0000 7f8aa0e01640 1 -- 172.21.15.165:0/2634358363 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb0014450 con 0x55b7ad1e7b60 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.070+0000 7f8aa0e01640 1 -- 172.21.15.165:0/2634358363 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb00145f0 con 0x55b7ad1e7b60 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.070+0000 7f8bbab40800 1 -- 172.21.15.165:0/2634358363 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7ad1e8df0 con 0x55b7ad1e7b60 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.070+0000 7f8aa0e01640 1 -- 172.21.15.165:0/2634358363 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb0014910 con 0x55b7ad1e7b60 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.070+0000 7f8bbab40800 1 -- 172.21.15.165:0/2634358363 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7ad1e9390 con 0x55b7ad1e7b60 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.071+0000 7f8aa0e01640 1 -- 172.21.15.165:0/2634358363 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8bb0011040 con 0x55b7ad1e7b60 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.071+0000 7f8aa0e01640 1 --2- 172.21.15.165:0/2634358363 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9003d000 0x7f8a9003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.071+0000 7f8aa0e01640 1 -- 172.21.15.165:0/2634358363 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8bb001e070 con 0x55b7ad1e7b60 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.071+0000 7f8bb6886640 1 --2- 172.21.15.165:0/2634358363 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9003d000 0x7f8a9003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.071+0000 7f8bbab40800 1 Processor -- start 2024-09-22T08:12:52.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.071+0000 7f8bbab40800 1 -- start start 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.071+0000 7f8bb6886640 1 --2- 172.21.15.165:0/2634358363 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9003d000 0x7f8a9003f4c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55b7ad1d4840 tx=0x7f8ba8053170 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.072+0000 7f8bbab40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1f4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.072+0000 7f8bbab40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7ad1c3880 con 0x55b7ad1f4550 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.072+0000 7f8bb7087640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.072+0000 7f8bb7087640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1f4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59926/0 (socket says 172.21.15.165:59926) 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.072+0000 7f8bb7087640 1 -- 172.21.15.165:0/456449891 learned_addr learned my addr 172.21.15.165:0/456449891 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.072+0000 7f8bb7087640 1 -- 172.21.15.165:0/456449891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ad1f4f40 con 0x55b7ad1f4550 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.072+0000 7f8bb7087640 1 --2- 172.21.15.165:0/456449891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1f4950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00546e0 tx=0x7f8bb0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead84b2610fdee03 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.072+0000 7f8a9a7fc640 1 -- 172.21.15.165:0/456449891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb0051020 con 0x55b7ad1f4550 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.072+0000 7f8a9a7fc640 1 -- 172.21.15.165:0/456449891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb0022de0 con 0x55b7ad1f4550 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.072+0000 7f8a9a7fc640 1 -- 172.21.15.165:0/456449891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb0028070 con 0x55b7ad1f4550 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 -- 172.21.15.165:0/456449891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 msgr2=0x55b7ad1f4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 --2- 172.21.15.165:0/456449891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1f4950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00546e0 tx=0x7f8bb0011a80 comp rx=0 tx=0).stop 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 -- 172.21.15.165:0/456449891 shutdown_connections 2024-09-22T08:12:52.092 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 --2- 172.21.15.165:0/456449891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1f4950 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 -- 172.21.15.165:0/456449891 >> 172.21.15.165:0/456449891 conn(0x55b7ad1f0950 msgr2=0x55b7ad1eeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 -- 172.21.15.165:0/456449891 shutdown_connections 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 -- 172.21.15.165:0/456449891 wait complete. 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 Processor -- start 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 -- start start 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1fbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bbab40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7ad1f5560 con 0x55b7ad1f4550 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bb7087640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1fbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bb7087640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1fbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59934/0 (socket says 172.21.15.165:59934) 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.073+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 learned_addr learned my addr 172.21.15.165:0/2479258916 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.074+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ad1fc120 con 0x55b7ad1f4550 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.074+0000 7f8bb7087640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1fbbc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0011b50 tx=0x7f8bb0011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.074+0000 7f8a98ff9640 1 -- 172.21.15.165:0/2479258916 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb0016440 con 0x55b7ad1f4550 2024-09-22T08:12:52.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.074+0000 7f8a98ff9640 1 -- 172.21.15.165:0/2479258916 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb0032070 con 0x55b7ad1f4550 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.074+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7ad1fc3b0 con 0x55b7ad1f4550 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.074+0000 7f8a98ff9640 1 -- 172.21.15.165:0/2479258916 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb0056200 con 0x55b7ad1f4550 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.074+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7ad1fcd30 con 0x55b7ad1f4550 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.075+0000 7f8a98ff9640 1 -- 172.21.15.165:0/2479258916 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8bb004dd10 con 0x55b7ad1f4550 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.075+0000 7f8a98ff9640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a8003cf10 0x7f8a8003f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.075+0000 7f8a98ff9640 1 -- 172.21.15.165:0/2479258916 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8bb000e040 con 0x55b7ad1f4550 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.075+0000 7f8bb6886640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a8003cf10 0x7f8a8003f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.075+0000 7f8bb6886640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a8003cf10 0x7f8a8003f3d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800c010 tx=0x7f8ba8048000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.075+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.075+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad2076e0 0x55b7ad209ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.075+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad20a2f0 con 0x55b7ad2076e0 2024-09-22T08:12:52.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bb6085640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad2076e0 0x55b7ad209ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bb6085640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad2076e0 0x55b7ad209ba0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 20 realm 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad20a720 con 0x55b7ad2076e0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad20aff0 con 0x55b7ad2076e0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.076+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad20b390 con 0x55b7ad2076e0 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bbab40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad20c0f0 0x55b7ad20e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad20eaf0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bb7087640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad20c0f0 0x55b7ad20e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bb7087640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad20c0f0 0x55b7ad20e4e0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8bb002a070 con 0x55b7ad20c0f0 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bbab40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bbab40800 20 searching for the correct realm 2024-09-22T08:12:52.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b7ad210aa0 0x55b7ad212f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.077+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad210aa0 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.078+0000 7f8bb6886640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b7ad210aa0 0x55b7ad212f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.078+0000 7f8bb6886640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b7ad210aa0 0x55b7ad212f60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.078+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.078+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.078+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8bb002a070 con 0x55b7ad20c0f0 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.078+0000 7f8bb7087640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8bb0014070 0x7f8bb001a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.078+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x7f8bb0014070 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.078+0000 7f8bb6085640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8bb0014070 0x7f8bb001a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.079+0000 7f8bb6085640 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8bb0014070 0x7f8bb001a070 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.079+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.079+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad2076e0 2024-09-22T08:12:52.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.079+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.079+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad2076e0 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.079+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.079+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x7f8bb0014070 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.080+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.080+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.080+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb002a070 con 0x55b7ad20c0f0 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.080+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.080+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb002a070 con 0x55b7ad20c0f0 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.080+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad210aa0 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.080+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.080+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad2076e0 2024-09-22T08:12:52.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.081+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.081+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x7f8bb0014070 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.081+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.081+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad2076e0 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.081+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.081+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.081+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8bb0065060 con 0x55b7ad20c0f0 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.081+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad210aa0 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.081+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.082+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad210aa0 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.082+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.082+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x7f8bb0014070 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.082+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.082+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad210aa0 2024-09-22T08:12:52.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.082+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.082+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad210aa0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.082+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.082+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad2076e0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.083+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.083+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad2076e0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.083+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.083+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x7f8bb0014070 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.083+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.083+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad210aa0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.084+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.084+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.084+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb0065060 con 0x55b7ad20c0f0 2024-09-22T08:12:52.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.084+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad2076e0 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.084+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.084+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x7f8bb0014070 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.084+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.084+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad210aa0 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.085+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.085+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x7f8bb0014070 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.085+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.085+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.085+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb0065060 con 0x55b7ad20c0f0 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.085+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad210aa0 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.085+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.085+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x7f8bb0014070 2024-09-22T08:12:52.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad2076e0 2024-09-22T08:12:52.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2135e0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb0065060 con 0x55b7ad20c0f0 2024-09-22T08:12:52.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:52.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:52.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:52.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:52.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:52.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:52.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad20f4b0 con 0x55b7ad2076e0 2024-09-22T08:12:52.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.086+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad20fd50 con 0x55b7ad2076e0 2024-09-22T08:12:52.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:52.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad213a60 con 0x55b7ad2076e0 2024-09-22T08:12:52.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:52.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 20 zone default found 2024-09-22T08:12:52.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 4 Realm: () 2024-09-22T08:12:52.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:52.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:52.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:52.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 20 zonegroup default 2024-09-22T08:12:52.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad213e20 con 0x7f8bb0014070 2024-09-22T08:12:52.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad215c50 con 0x55b7ad210aa0 2024-09-22T08:12:52.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.087+0000 7f8bbab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.088+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.088+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2160e0 con 0x55b7ad210aa0 2024-09-22T08:12:52.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.088+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.088+0000 7f8bbab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.088+0000 7f8bbab40800 20 started sync module instance, tier type = 2024-09-22T08:12:52.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.088+0000 7f8bbab40800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:52.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.088+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2150f0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.089+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb0065060 con 0x55b7ad20c0f0 2024-09-22T08:12:52.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.089+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94247372019184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2150f0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.089+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad216c10 con 0x55b7ad2076e0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.090+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.090+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94247372019184] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb0065060 con 0x55b7ad20c0f0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.090+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94247372023520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad216c10 con 0x55b7ad2076e0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.090+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad214c60 con 0x55b7ad210aa0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.091+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94247372023520] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.091+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.091+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94247372025856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad217bb0 con 0x55b7ad210aa0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.091+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad218570 con 0x55b7ad20c0f0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.092+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94247372025856] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.092+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb0065060 con 0x55b7ad20c0f0 2024-09-22T08:12:52.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.092+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94247372030144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad218990 con 0x55b7ad20c0f0 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.092+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad219350 con 0x55b7ad2076e0 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.094+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94247372030144] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb0065060 con 0x55b7ad20c0f0 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.094+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.094+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94247372031712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad219350 con 0x55b7ad2076e0 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.094+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad219d50 con 0x7f8bb0014070 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.095+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94247372031712] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.095+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.095+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94247372036192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad219350 con 0x7f8bb0014070 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.095+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad21a760 con 0x7f8bb0014070 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.096+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94247372036192] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.096+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.096+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94247372033696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad21a940 con 0x7f8bb0014070 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.096+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad21b190 con 0x7f8bb0014070 2024-09-22T08:12:52.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.097+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94247372033696] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.097+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.097+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94247372039792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad21afe0 con 0x7f8bb0014070 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.097+0000 7f8bbab40800 20 add_watcher() i=0 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.097+0000 7f8bbab40800 20 add_watcher() i=1 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.097+0000 7f8bbab40800 20 add_watcher() i=2 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.097+0000 7f8bbab40800 20 add_watcher() i=3 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.097+0000 7f8bbab40800 20 add_watcher() i=4 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.097+0000 7f8bbab40800 20 add_watcher() i=5 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.097+0000 7f8bbab40800 20 add_watcher() i=6 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.098+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94247372039792] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.098+0000 7f8bbab40800 20 add_watcher() i=7 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.098+0000 7f8bbab40800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.098+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad21e610 con 0x55b7ad2076e0 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.098+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.119 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.098+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94247372040848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad21b9a0 con 0x55b7ad2076e0 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.099+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94247372040848] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f8a6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f8bbab40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f8bbab40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f8bbab40800 5 note: GC not initialized 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f89e7fff640 20 reqs_thread_entry: start 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f8bbab40800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f8bbab40800 20 Filter name: none 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f89e5ffb640 20 reqs_thread_entry: start 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f8bbab40800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f8bbab40800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.100+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad2519b0 con 0x7f8bb0014070 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.101+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.101+0000 7f8bbab40800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T08:12:52.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.101+0000 7f8bbab40800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.101+0000 7f8bbab40800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.101+0000 7f8bbab40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.101+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad257f70 con 0x7f8bb0014070 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.102+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.102+0000 7f8bbab40800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.102+0000 7f8bbab40800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.102+0000 7f8bbab40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.102+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94247372290416 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad253610 con 0x55b7ad2076e0 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.103+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== watch-notify(notify (1) cookie 94247372031712 notify 146028888106 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55b7ad0d40e0 con 0x55b7ad2076e0 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.103+0000 7f8a9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94247372031712 notifier 4913 bl.length()=649 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.103+0000 7f8a9a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.103+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 notify.4 [notify cookie 94247372290416 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.103+0000 7f8a9a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.103+0000 7f8a9a7fc640 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8a7c003ea0 con 0x55b7ad2076e0 2024-09-22T08:12:52.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.103+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.103+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify_complete (2) cookie 94247372290416 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8ba007b420 con 0x55b7ad2076e0 2024-09-22T08:12:52.122 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:12:50.302079Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.302069Z","tags":[],"group_ids":[]} 2024-09-22T08:12:52.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.104+0000 7f8a6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:52.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.104+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94247372040848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad252cd0 con 0x55b7ad2076e0 2024-09-22T08:12:52.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.105+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94247372040848] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.105+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94247372019184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad252cd0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.106+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94247372019184] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb0065060 con 0x55b7ad20c0f0 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.106+0000 7f8bbab40800 20 remove_watcher() i=0 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.106+0000 7f8bbab40800 2 removed watcher, disabling cache 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.106+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94247372023520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad252cd0 con 0x55b7ad2076e0 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.107+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94247372023520] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.107+0000 7f8bbab40800 20 remove_watcher() i=1 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.107+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94247372025856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad252cd0 con 0x55b7ad210aa0 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.108+0000 7f8bb6886640 1 -- 172.21.15.165:0/2479258916 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94247372025856] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba802d070 con 0x55b7ad210aa0 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.108+0000 7f8bbab40800 20 remove_watcher() i=2 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.108+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94247372030144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad24f6a0 con 0x55b7ad20c0f0 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.109+0000 7f8bb7087640 1 -- 172.21.15.165:0/2479258916 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94247372030144] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb0065060 con 0x55b7ad20c0f0 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.109+0000 7f8bbab40800 20 remove_watcher() i=3 2024-09-22T08:12:52.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.109+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94247372031712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad24f6a0 con 0x55b7ad2076e0 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.110+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94247372031712] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x55b7ad2076e0 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.110+0000 7f8bbab40800 20 remove_watcher() i=4 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.110+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94247372036192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad24f6a0 con 0x7f8bb0014070 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.111+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94247372036192] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.111+0000 7f8bbab40800 20 remove_watcher() i=5 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.111+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94247372033696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad24f6a0 con 0x7f8bb0014070 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.112+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94247372033696] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.112+0000 7f8bbab40800 20 remove_watcher() i=6 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.113+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94247372039792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b7ad24f6a0 con 0x7f8bb0014070 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94247372039792] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba0051070 con 0x7f8bb0014070 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 20 remove_watcher() i=7 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8bb0014070 msgr2=0x7f8bb001a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f8bb0014070 0x7f8bb001a070 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad2076e0 msgr2=0x55b7ad209ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad2076e0 0x55b7ad209ba0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad20c0f0 msgr2=0x55b7ad20e4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad20c0f0 0x55b7ad20e4e0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b7ad210aa0 msgr2=0x55b7ad212f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55b7ad210aa0 0x55b7ad212f60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a8003cf10 msgr2=0x7f8a8003f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a8003cf10 0x7f8a8003f3d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800c010 tx=0x7f8ba8048000 comp rx=0 tx=0).stop 2024-09-22T08:12:52.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 msgr2=0x55b7ad1fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bb6085640 1 -- 172.21.15.165:0/2479258916 reap_dead start 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1fbbc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0011b50 tx=0x7f8bb0011f60 comp rx=0 tx=0).stop 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 shutdown_connections 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2479258916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1f4550 0x55b7ad1fbbc0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 >> 172.21.15.165:0/2479258916 conn(0x55b7ad1f0950 msgr2=0x55b7ad1eeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 shutdown_connections 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2479258916 wait complete. 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2634358363 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9003d000 msgr2=0x7f8a9003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2634358363 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9003d000 0x7f8a9003f4c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55b7ad1d4840 tx=0x7f8ba8053170 comp rx=0 tx=0).stop 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2634358363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1e7b60 msgr2=0x55b7ad1e7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2634358363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1e7b60 0x55b7ad1e7f80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55b7ad1d47a0 tx=0x7f8bb0018830 comp rx=0 tx=0).stop 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2634358363 shutdown_connections 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2634358363 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9003d000 0x7f8a9003f4c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 --2- 172.21.15.165:0/2634358363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad1e7b60 0x55b7ad1e7f80 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.114+0000 7f8bbab40800 1 -- 172.21.15.165:0/2634358363 >> 172.21.15.165:0/2634358363 conn(0x55b7ad1dbf10 msgr2=0x55b7ad1dc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 -- 172.21.15.165:0/2634358363 shutdown_connections 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 -- 172.21.15.165:0/2634358363 wait complete. 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad0d4cb0 msgr2=0x55b7ad1d3e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad0d4cb0 0x55b7ad1d3e60 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad1d66f0 msgr2=0x55b7ad1d8ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad1d66f0 0x55b7ad1d8ae0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9c03d150 msgr2=0x7f8a9c03f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9c03d150 0x7f8a9c03f610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0057000 tx=0x7f8ba0052000 comp rx=0 tx=0).stop 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 msgr2=0x55b7ad049260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad049260 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80012f0 tx=0x7f8ba8000ed0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 shutdown_connections 2024-09-22T08:12:52.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55b7ad1d66f0 0x55b7ad1d8ae0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55b7ad0d4cb0 0x55b7ad1d3e60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f8a9c03d150 0x7f8a9c03f610 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 --2- 172.21.15.165:0/1044632053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7ad0d39e0 0x55b7ad049260 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 >> 172.21.15.165:0/1044632053 conn(0x55b7ad0cedb0 msgr2=0x55b7ad1c4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 shutdown_connections 2024-09-22T08:12:52.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.115+0000 7f8bbab40800 1 -- 172.21.15.165:0/1044632053 wait complete. 2024-09-22T08:12:52.133 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:52.133 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:52.133 ERROR:root:0 2024-09-22T08:12:52.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:12:52.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-22T08:12:52.134 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-22T08:12:52.180 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:12:52.180 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:12:52.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.180+0000 7fb204d2c800 1 Processor -- start 2024-09-22T08:12:52.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.180+0000 7fb204d2c800 1 -- start start 2024-09-22T08:12:52.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.180+0000 7fb204d2c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560342de3bb0 0x560342de5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.180+0000 7fb204d2c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560342c6aa20 con 0x560342de00a0 2024-09-22T08:12:52.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.180+0000 7fb204d2c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560342c6a7d0 con 0x560342de3bb0 2024-09-22T08:12:52.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.181+0000 7fb20024e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560342de3bb0 0x560342de5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.181+0000 7fb20024e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560342de3bb0 0x560342de5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59942/0 (socket says 172.21.15.165:59942) 2024-09-22T08:12:52.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.181+0000 7fb20024e640 1 -- 172.21.15.165:0/1739293263 learned_addr learned my addr 172.21.15.165:0/1739293263 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.181+0000 7fb20024e640 1 -- 172.21.15.165:0/1739293263 >> v1:172.21.15.53:6789/0 conn(0x560342de00a0 legacy=0x560342de2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.181+0000 7fb20024e640 1 -- 172.21.15.165:0/1739293263 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560342de7580 con 0x560342de3bb0 2024-09-22T08:12:52.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.183+0000 7fb20024e640 1 --2- 172.21.15.165:0/1739293263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de3bb0 0x560342de5fa0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400a520 tx=0x7fb1f40459e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c0280d9c0e3d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.183+0000 7fb1ffa4d640 1 -- 172.21.15.165:0/1739293263 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f4053400 con 0x560342de3bb0 2024-09-22T08:12:52.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.183+0000 7fb1ffa4d640 1 -- 172.21.15.165:0/1739293263 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f4058070 con 0x560342de3bb0 2024-09-22T08:12:52.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.183+0000 7fb1ffa4d640 1 -- 172.21.15.165:0/1739293263 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f4053710 con 0x560342de3bb0 2024-09-22T08:12:52.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.184+0000 7fb204d2c800 1 -- 172.21.15.165:0/1739293263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de3bb0 msgr2=0x560342de5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.184+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1739293263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de3bb0 0x560342de5fa0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400a520 tx=0x7fb1f40459e0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.184+0000 7fb204d2c800 1 -- 172.21.15.165:0/1739293263 shutdown_connections 2024-09-22T08:12:52.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.184+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1739293263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de3bb0 0x560342de5fa0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.184+0000 7fb204d2c800 1 -- 172.21.15.165:0/1739293263 >> 172.21.15.165:0/1739293263 conn(0x560342dd9be0 msgr2=0x560342ddc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.184+0000 7fb204d2c800 1 -- 172.21.15.165:0/1739293263 shutdown_connections 2024-09-22T08:12:52.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.184+0000 7fb204d2c800 1 -- 172.21.15.165:0/1739293263 wait complete. 2024-09-22T08:12:52.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.197+0000 7fb204d2c800 1 Processor -- start 2024-09-22T08:12:52.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.198+0000 7fb204d2c800 1 -- start start 2024-09-22T08:12:52.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.198+0000 7fb204d2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ddf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.198+0000 7fb204d2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560342c77dd0 con 0x560342de00a0 2024-09-22T08:12:52.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.198+0000 7fb200a4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ddf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.198+0000 7fb200a4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ddf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59958/0 (socket says 172.21.15.165:59958) 2024-09-22T08:12:52.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.198+0000 7fb200a4f640 1 -- 172.21.15.165:0/3918540134 learned_addr learned my addr 172.21.15.165:0/3918540134 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.198+0000 7fb200a4f640 1 -- 172.21.15.165:0/3918540134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560342ddfe00 con 0x560342de00a0 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.199+0000 7fb200a4f640 1 --2- 172.21.15.165:0/3918540134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ddf810 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000b300 tx=0x7fb1f000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd7a555cdf191a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.199+0000 7fb0eee0d640 1 -- 172.21.15.165:0/3918540134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f0016070 con 0x560342de00a0 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.199+0000 7fb0eee0d640 1 -- 172.21.15.165:0/3918540134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f000d6a0 con 0x560342de00a0 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.199+0000 7fb0eee0d640 1 -- 172.21.15.165:0/3918540134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f000d9c0 con 0x560342de00a0 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.199+0000 7fb204d2c800 1 -- 172.21.15.165:0/3918540134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 msgr2=0x560342ddf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.199+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3918540134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ddf810 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000b300 tx=0x7fb1f000b7c0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.199+0000 7fb204d2c800 1 -- 172.21.15.165:0/3918540134 shutdown_connections 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.199+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3918540134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ddf810 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.199+0000 7fb204d2c800 1 -- 172.21.15.165:0/3918540134 >> 172.21.15.165:0/3918540134 conn(0x560342dd9be0 msgr2=0x560342eca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.200+0000 7fb204d2c800 1 -- 172.21.15.165:0/3918540134 shutdown_connections 2024-09-22T08:12:52.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.200+0000 7fb204d2c800 1 -- 172.21.15.165:0/3918540134 wait complete. 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.200+0000 7fb204d2c800 1 Processor -- start 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.200+0000 7fb204d2c800 1 -- start start 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.200+0000 7fb204d2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ed8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.200+0000 7fb204d2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560342de6870 con 0x560342de00a0 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.200+0000 7fb200a4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ed8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.200+0000 7fb200a4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ed8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59966/0 (socket says 172.21.15.165:59966) 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.200+0000 7fb200a4f640 1 -- 172.21.15.165:0/3300494626 learned_addr learned my addr 172.21.15.165:0/3300494626 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.201+0000 7fb200a4f640 1 -- 172.21.15.165:0/3300494626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560342ed9320 con 0x560342de00a0 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.201+0000 7fb200a4f640 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ed8dc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0000fb0 tx=0x7fb1f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.201+0000 7fb0ed60a640 1 -- 172.21.15.165:0/3300494626 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f0021020 con 0x560342de00a0 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.201+0000 7fb0ed60a640 1 -- 172.21.15.165:0/3300494626 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f00016a0 con 0x560342de00a0 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.201+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560342ed9610 con 0x560342de00a0 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.201+0000 7fb0ed60a640 1 -- 172.21.15.165:0/3300494626 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f0016040 con 0x560342de00a0 2024-09-22T08:12:52.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.201+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560342eda1c0 con 0x560342de00a0 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.202+0000 7fb0ed60a640 1 -- 172.21.15.165:0/3300494626 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb1f0024020 con 0x560342de00a0 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.202+0000 7fb0ed60a640 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0e803cfb0 0x7fb0e803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.202+0000 7fb0ed60a640 1 -- 172.21.15.165:0/3300494626 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb1f0054110 con 0x560342de00a0 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.202+0000 7fb20024e640 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0e803cfb0 0x7fb0e803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.202+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342de3bb0 0x560342ee0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.202+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342ee0950 con 0x560342de3bb0 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.202+0000 7fb201250640 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342de3bb0 0x560342ee0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.203+0000 7fb20024e640 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0e803cfb0 0x7fb0e803f470 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4057000 tx=0x7fb1f4052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.203+0000 7fb201250640 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342de3bb0 0x560342ee0410 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.203+0000 7fb201250640 1 -- 172.21.15.165:0/3300494626 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x560342de3bb0 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.203+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342ee0d70 con 0x560342de3bb0 2024-09-22T08:12:52.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.203+0000 7fb201250640 1 -- 172.21.15.165:0/3300494626 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1f800a4d0 con 0x560342de3bb0 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.203+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342ee2b80 0x560342ee4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.203+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342ee5610 con 0x560342ee2b80 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.203+0000 7fb200a4f640 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342ee2b80 0x560342ee4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.204+0000 7fb200a4f640 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342ee2b80 0x560342ee4f70 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.204+0000 7fb200a4f640 1 -- 172.21.15.165:0/3300494626 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb1f0025d90 con 0x560342ee2b80 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.204+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342ee19c0 con 0x560342de3bb0 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.204+0000 7fb201250640 1 -- 172.21.15.165:0/3300494626 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1f800a4d0 con 0x560342de3bb0 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.204+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342ee1eb0 con 0x560342de3bb0 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.204+0000 7fb201250640 1 -- 172.21.15.165:0/3300494626 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb1f800a4d0 con 0x560342de3bb0 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.205+0000 7fb204d2c800 1 Processor -- start 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.205+0000 7fb204d2c800 1 -- start start 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.205+0000 7fb204d2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342ef3f80 0x560342ef43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.205+0000 7fb204d2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560342ed99c0 con 0x560342ef3f80 2024-09-22T08:12:52.215 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.205+0000 7fb201250640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342ef3f80 0x560342ef43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.205+0000 7fb201250640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342ef3f80 0x560342ef43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59982/0 (socket says 172.21.15.165:59982) 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.205+0000 7fb201250640 1 -- 172.21.15.165:0/4230644034 learned_addr learned my addr 172.21.15.165:0/4230644034 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.205+0000 7fb201250640 1 -- 172.21.15.165:0/4230644034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560342ef49e0 con 0x560342ef3f80 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.206+0000 7fb201250640 1 --2- 172.21.15.165:0/4230644034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342ef3f80 0x560342ef43a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x560342edad00 tx=0x7fb1f8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.206+0000 7fb0e67fc640 1 -- 172.21.15.165:0/4230644034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f8014450 con 0x560342ef3f80 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.206+0000 7fb0e67fc640 1 -- 172.21.15.165:0/4230644034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f80145f0 con 0x560342ef3f80 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.206+0000 7fb204d2c800 1 -- 172.21.15.165:0/4230644034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560342ef5210 con 0x560342ef3f80 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.206+0000 7fb0e67fc640 1 -- 172.21.15.165:0/4230644034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f8014910 con 0x560342ef3f80 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.206+0000 7fb204d2c800 1 -- 172.21.15.165:0/4230644034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560342ef57b0 con 0x560342ef3f80 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.207+0000 7fb0e67fc640 1 -- 172.21.15.165:0/4230644034 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb1f8011040 con 0x560342ef3f80 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.207+0000 7fb0e67fc640 1 --2- 172.21.15.165:0/4230644034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0d803d000 0x7fb0d803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.207+0000 7fb0e67fc640 1 -- 172.21.15.165:0/4230644034 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb1f801e070 con 0x560342ef3f80 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.207+0000 7fb200a4f640 1 --2- 172.21.15.165:0/4230644034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0d803d000 0x7fb0d803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.216 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.207+0000 7fb204d2c800 1 Processor -- start 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.207+0000 7fb200a4f640 1 --2- 172.21.15.165:0/4230644034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0d803d000 0x7fb0d803f4c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000b800 tx=0x7fb1f001a540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.207+0000 7fb204d2c800 1 -- start start 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.207+0000 7fb204d2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f00da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.207+0000 7fb204d2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560342cd6d50 con 0x560342f009a0 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.208+0000 7fb201250640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f00da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.208+0000 7fb201250640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f00da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:59990/0 (socket says 172.21.15.165:59990) 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.208+0000 7fb201250640 1 -- 172.21.15.165:0/2872015354 learned_addr learned my addr 172.21.15.165:0/2872015354 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.208+0000 7fb201250640 1 -- 172.21.15.165:0/2872015354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560342f01390 con 0x560342f009a0 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.208+0000 7fb201250640 1 --2- 172.21.15.165:0/2872015354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f00da0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8018430 tx=0x7fb1f8001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a5af98e0c17b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.208+0000 7fb0d7fff640 1 -- 172.21.15.165:0/2872015354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f8051020 con 0x560342f009a0 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.208+0000 7fb0d7fff640 1 -- 172.21.15.165:0/2872015354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f80532c0 con 0x560342f009a0 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.208+0000 7fb0d7fff640 1 -- 172.21.15.165:0/2872015354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f8028070 con 0x560342f009a0 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 -- 172.21.15.165:0/2872015354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 msgr2=0x560342f00da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 --2- 172.21.15.165:0/2872015354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f00da0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8018430 tx=0x7fb1f8001440 comp rx=0 tx=0).stop 2024-09-22T08:12:52.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 -- 172.21.15.165:0/2872015354 shutdown_connections 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 --2- 172.21.15.165:0/2872015354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f00da0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 -- 172.21.15.165:0/2872015354 >> 172.21.15.165:0/2872015354 conn(0x560342efcdc0 msgr2=0x560342efb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 -- 172.21.15.165:0/2872015354 shutdown_connections 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 -- 172.21.15.165:0/2872015354 wait complete. 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 Processor -- start 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 -- start start 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f07ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb204d2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560342f01830 con 0x560342f009a0 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb201250640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f07ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb201250640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f07ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:60002/0 (socket says 172.21.15.165:60002) 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.209+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 learned_addr learned my addr 172.21.15.165:0/1231690824 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:12:52.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.210+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560342f08400 con 0x560342f009a0 2024-09-22T08:12:52.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.210+0000 7fb201250640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f07ea0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80547f0 tx=0x7fb1f8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.210+0000 7fb0d67fc640 1 -- 172.21.15.165:0/1231690824 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f8031070 con 0x560342f009a0 2024-09-22T08:12:52.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.210+0000 7fb0d67fc640 1 -- 172.21.15.165:0/1231690824 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f8016440 con 0x560342f009a0 2024-09-22T08:12:52.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.210+0000 7fb0d67fc640 1 -- 172.21.15.165:0/1231690824 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f8045130 con 0x560342f009a0 2024-09-22T08:12:52.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.210+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560342f08690 con 0x560342f009a0 2024-09-22T08:12:52.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.210+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560342f09010 con 0x560342f009a0 2024-09-22T08:12:52.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.211+0000 7fb0d67fc640 1 -- 172.21.15.165:0/1231690824 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb1f8034070 con 0x560342f009a0 2024-09-22T08:12:52.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.211+0000 7fb0d67fc640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0cc03cfb0 0x7fb0cc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.211+0000 7fb0d67fc640 1 -- 172.21.15.165:0/1231690824 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb1f800e040 con 0x560342f009a0 2024-09-22T08:12:52.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.211+0000 7fb200a4f640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0cc03cfb0 0x7fb0cc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.211+0000 7fb200a4f640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0cc03cfb0 0x7fb0cc03f470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000bd60 tx=0x7fb1f004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.211+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342f139f0 0x560342f15eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f16600 con 0x560342f139f0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb20024e640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342f139f0 0x560342f15eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb20024e640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342f139f0 0x560342f15eb0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb204d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb204d2c800 20 realm 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f16a30 con 0x560342f139f0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb204d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb204d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.212+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f17300 con 0x560342f139f0 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb204d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f176a0 con 0x560342f139f0 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb204d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342f18400 0x560342f1a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f1ae00 con 0x560342f18400 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb201250640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342f18400 0x560342f1a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.213+0000 7fb201250640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342f18400 0x560342f1a7f0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.214+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.214+0000 7fb204d2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.214+0000 7fb204d2c800 20 searching for the correct realm 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.214+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560342f1cdd0 0x560342f1f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.214+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f1cdd0 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.214+0000 7fb200a4f640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560342f1cdd0 0x560342f1f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.214+0000 7fb200a4f640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560342f1cdd0 0x560342f1f290 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.214+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.214+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f18400 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.215+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.215+0000 7fb201250640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb1f8036070 0x7fb1f804d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.215+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x7fb1f8036070 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.215+0000 7fb20024e640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb1f8036070 0x7fb1f804d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:12:52.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.215+0000 7fb20024e640 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb1f8036070 0x7fb1f804d1a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.215+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.215+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f139f0 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.216+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.216+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f139f0 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.216+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.216+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x7fb1f8036070 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.216+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.216+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f18400 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.216+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.216+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f18400 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.217+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.217+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f1cdd0 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.217+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.217+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f139f0 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.217+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.217+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x7fb1f8036070 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.217+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.217+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f139f0 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.218+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.218+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f18400 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.218+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.218+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f1cdd0 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.218+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.218+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f1cdd0 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.218+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.218+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x7fb1f8036070 2024-09-22T08:12:52.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.219+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.219+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f1cdd0 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.219+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.219+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f1cdd0 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.219+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.219+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f139f0 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.219+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.219+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f139f0 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.220+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.220+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x7fb1f8036070 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.220+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.220+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f1cdd0 2024-09-22T08:12:52.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.220+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.220+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f18400 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.220+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.220+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f139f0 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.221+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.221+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x7fb1f8036070 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.221+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.221+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f1cdd0 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.221+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.221+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x7fb1f8036070 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.221+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.222+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f18400 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.222+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.222+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f1cdd0 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.222+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.222+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x7fb1f8036070 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.222+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.222+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f139f0 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560342f1f910 con 0x560342f18400 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:12:52.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:12:52.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:12:52.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f1b7c0 con 0x560342f139f0 2024-09-22T08:12:52.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f1c060 con 0x560342f139f0 2024-09-22T08:12:52.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:12:52.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.223+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f1b400 con 0x560342f139f0 2024-09-22T08:12:52.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:12:52.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 20 zone default found 2024-09-22T08:12:52.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 4 Realm: () 2024-09-22T08:12:52.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:12:52.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 20 zonegroup default 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f1fd90 con 0x7fb1f8036070 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f21b70 con 0x560342f1cdd0 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.224+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f22030 con 0x560342f1cdd0 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.225+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.225+0000 7fb204d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.225+0000 7fb204d2c800 20 started sync module instance, tier type = 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.225+0000 7fb204d2c800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.225+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f21010 con 0x560342f18400 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.226+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.226+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94572008051712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f20c70 con 0x560342f18400 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.226+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f22f40 con 0x560342f139f0 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.227+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.227+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94572008057488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f233c0 con 0x560342f139f0 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.227+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f23ed0 con 0x560342f1cdd0 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.227+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94572008051712] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.228+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94572008057488] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.228+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.228+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94572008058544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f22470 con 0x560342f1cdd0 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.228+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f247b0 con 0x560342f18400 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.229+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94572008058544] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.229+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.229+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94572008061312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f24ba0 con 0x560342f18400 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.229+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f255d0 con 0x560342f139f0 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.230+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.230+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94572008067296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f25ac0 con 0x560342f139f0 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.230+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f265a0 con 0x7fb1f8036070 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.230+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94572008061312] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.231+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94572008067296] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.231+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.231+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94572008063680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f260b0 con 0x7fb1f8036070 2024-09-22T08:12:52.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.231+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f26e70 con 0x7fb1f8036070 2024-09-22T08:12:52.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.232+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94572008063680] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.232+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.232+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94572008068560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f26c30 con 0x7fb1f8036070 2024-09-22T08:12:52.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.232+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f27480 con 0x7fb1f8036070 2024-09-22T08:12:52.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.233+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94572008068560] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.233+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.233+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94572008073568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f272f0 con 0x7fb1f8036070 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.234+0000 7fb204d2c800 20 add_watcher() i=0 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.234+0000 7fb204d2c800 20 add_watcher() i=1 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.234+0000 7fb204d2c800 20 add_watcher() i=2 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.234+0000 7fb204d2c800 20 add_watcher() i=3 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.234+0000 7fb204d2c800 20 add_watcher() i=4 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.234+0000 7fb204d2c800 20 add_watcher() i=5 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.234+0000 7fb204d2c800 20 add_watcher() i=6 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.234+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94572008073568] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.235+0000 7fb204d2c800 20 add_watcher() i=7 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.235+0000 7fb204d2c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.235+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f2a930 con 0x560342f139f0 2024-09-22T08:12:52.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.235+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.235+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94572008074624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f27cb0 con 0x560342f139f0 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.236+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94572008074624] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.236+0000 7fb0b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.236+0000 7fb204d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.236+0000 7fb204d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.236+0000 7fb204d2c800 5 note: GC not initialized 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.236+0000 7fb0b67e4640 20 reqs_thread_entry: start 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb204d2c800 20 init_complete bucket index max shards: 11 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb204d2c800 20 Filter name: none 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb0af7fe640 20 reqs_thread_entry: start 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb204d2c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb204d2c800 20 rados->read ofs=0 len=0 2024-09-22T08:12:52.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f5dd20 con 0x7fb1f8036070 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb204d2c800 20 rados_obj.operate() r=0 bl.length=473 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb204d2c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb204d2c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb204d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.237+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f645f0 con 0x7fb1f8036070 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.238+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb204d2c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb204d2c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb204d2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94572008325104 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560342f5fcf0 con 0x560342f139f0 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== watch-notify(notify (1) cookie 94572008067296 notify 146028888107 ret 0) ==== 691+0+0 (crc 0 0 0) 0x560342de7580 con 0x560342f139f0 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb0d7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94572008067296 notifier 4920 bl.length()=649 2024-09-22T08:12:52.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb0d7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-22T08:12:52.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb0d7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-22T08:12:52.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb0d7fff640 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb0c4003ea0 con 0x560342f139f0 2024-09-22T08:12:52.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(64 notify.4 [notify cookie 94572008325104 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.239+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== watch-notify(notify_complete (2) cookie 94572008325104 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb1f4050050 con 0x560342f139f0 2024-09-22T08:12:52.253 INFO:teuthology.orchestra.run.smithi165.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-22T08:12:50.302079Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-22T08:12:50.302069Z","tags":[],"group_ids":[]} 2024-09-22T08:12:52.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.240+0000 7fb0b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:12:52.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.240+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94572008074624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f638d0 con 0x560342f139f0 2024-09-22T08:12:52.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.241+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94572008074624] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.241+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94572008051712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f638d0 con 0x560342f18400 2024-09-22T08:12:52.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.242+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94572008051712] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.242+0000 7fb204d2c800 20 remove_watcher() i=0 2024-09-22T08:12:52.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.242+0000 7fb204d2c800 2 removed watcher, disabling cache 2024-09-22T08:12:52.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.242+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94572008057488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f638d0 con 0x560342f139f0 2024-09-22T08:12:52.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.244+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94572008057488] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.244+0000 7fb204d2c800 20 remove_watcher() i=1 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.244+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94572008058544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f638d0 con 0x560342f1cdd0 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.245+0000 7fb200a4f640 1 -- 172.21.15.165:0/1231690824 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94572008058544] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f004c030 con 0x560342f1cdd0 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.245+0000 7fb204d2c800 20 remove_watcher() i=2 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.245+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94572008061312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f22f40 con 0x560342f18400 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.246+0000 7fb201250640 1 -- 172.21.15.165:0/1231690824 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94572008061312] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f8033030 con 0x560342f18400 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.246+0000 7fb204d2c800 20 remove_watcher() i=3 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.246+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94572008067296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f5b9f0 con 0x560342f139f0 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.247+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94572008067296] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x560342f139f0 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.247+0000 7fb204d2c800 20 remove_watcher() i=4 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.247+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94572008063680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f5b9f0 con 0x7fb1f8036070 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.248+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94572008063680] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.248+0000 7fb204d2c800 20 remove_watcher() i=5 2024-09-22T08:12:52.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.248+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94572008068560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f5b9f0 con 0x7fb1f8036070 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.249+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94572008068560] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.249+0000 7fb204d2c800 20 remove_watcher() i=6 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.249+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94572008073568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560342f5b9f0 con 0x7fb1f8036070 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94572008073568] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f4053aa0 con 0x7fb1f8036070 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 20 remove_watcher() i=7 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb1f8036070 msgr2=0x7fb1f804d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7fb1f8036070 0x7fb1f804d1a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342f139f0 msgr2=0x560342f15eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342f139f0 0x560342f15eb0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342f18400 msgr2=0x560342f1a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342f18400 0x560342f1a7f0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560342f1cdd0 msgr2=0x560342f1f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x560342f1cdd0 0x560342f1f290 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0cc03cfb0 msgr2=0x7fb0cc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0cc03cfb0 0x7fb0cc03f470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000bd60 tx=0x7fb1f004e000 comp rx=0 tx=0).stop 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 msgr2=0x560342f07ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 --2- 172.21.15.165:0/1231690824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342f009a0 0x560342f07ea0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80547f0 tx=0x7fb1f8011f60 comp rx=0 tx=0).stop 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 reap_dead start 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb20024e640 1 -- 172.21.15.165:0/1231690824 reap_dead start 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 shutdown_connections 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 >> 172.21.15.165:0/1231690824 conn(0x560342efcdc0 msgr2=0x560342efafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 shutdown_connections 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/1231690824 wait complete. 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/4230644034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0d803d000 msgr2=0x7fb0d803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 --2- 172.21.15.165:0/4230644034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0d803d000 0x7fb0d803f4c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000b800 tx=0x7fb1f001a540 comp rx=0 tx=0).stop 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/4230644034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342ef3f80 msgr2=0x560342ef43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 --2- 172.21.15.165:0/4230644034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342ef3f80 0x560342ef43a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x560342edad00 tx=0x7fb1f8018830 comp rx=0 tx=0).stop 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/4230644034 shutdown_connections 2024-09-22T08:12:52.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 --2- 172.21.15.165:0/4230644034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0d803d000 0x7fb0d803f4c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 --2- 172.21.15.165:0/4230644034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342ef3f80 0x560342ef43a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/4230644034 >> 172.21.15.165:0/4230644034 conn(0x560342ee8330 msgr2=0x560342ee8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/4230644034 shutdown_connections 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.250+0000 7fb204d2c800 1 -- 172.21.15.165:0/4230644034 wait complete. 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342de3bb0 msgr2=0x560342ee0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342de3bb0 0x560342ee0410 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342ee2b80 msgr2=0x560342ee4f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342ee2b80 0x560342ee4f70 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0e803cfb0 msgr2=0x7fb0e803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0e803cfb0 0x7fb0e803f470 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4057000 tx=0x7fb1f4052000 comp rx=0 tx=0).stop 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 msgr2=0x560342ed8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ed8dc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0000fb0 tx=0x7fb1f0000ed0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 shutdown_connections 2024-09-22T08:12:52.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x560342ee2b80 0x560342ee4f70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x560342de3bb0 0x560342ee0410 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fb0e803cfb0 0x7fb0e803f470 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 --2- 172.21.15.165:0/3300494626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560342de00a0 0x560342ed8dc0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:12:52.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 >> 172.21.15.165:0/3300494626 conn(0x560342dd9be0 msgr2=0x560342eca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:12:52.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 shutdown_connections 2024-09-22T08:12:52.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:12:52.251+0000 7fb204d2c800 1 -- 172.21.15.165:0/3300494626 wait complete. 2024-09-22T08:12:52.264 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:52.264 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-22T08:12:50.302079Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-22T08:12:50.302069Z', 'tags': [], 'group_ids': []} 2024-09-22T08:12:52.264 ERROR:root:0 2024-09-22T08:12:52.264 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-22T08:12:52.270 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.271 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.274 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.274 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-22T08:12:52.280 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.280 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.284 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.284 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-22T08:12:52.292 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-22T08:12:52.292 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.295 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-22T08:12:52.302 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:12:52.302 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.305 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.305 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-22T08:12:52.312 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-22T08:12:52.313 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.316 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.316 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-22T08:12:52.324 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-22T08:12:52.324 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.329 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.329 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-22T08:12:52.336 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:12:52.337 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.341 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.342 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-22T08:12:52.348 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:12:52.348 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.352 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.353 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-22T08:12:52.360 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:12:52.361 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.365 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.370 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-22T08:12:52.371 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-22T08:12:52.376 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-22T08:12:52.391 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-22T08:12:52.395 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-22T08:12:52.395 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-22T08:12:52.400 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '083396ec-d900-46a5-a2e2-dd86e7b6cca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11', 'marker': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:12:52.385202Z', 'creation_time': '2024-09-22T08:12:52.380411Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-22T08:12:52.400 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-22T08:12:52.405 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '083396ec-d900-46a5-a2e2-dd86e7b6cca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11', 'marker': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:12:52.385202Z', 'creation_time': '2024-09-22T08:12:52.380411Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-22T08:12:52.409 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-22T08:12:52.413 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '083396ec-d900-46a5-a2e2-dd86e7b6cca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11', 'marker': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:12:52.385202Z', 'creation_time': '2024-09-22T08:12:52.380411Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-22T08:12:52.414 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-22T08:12:52.417 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx0000055198de2acff8a81-0066efd184-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:12:52.422 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-22T08:12:52.428 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:12:52.428 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-22T08:12:52.437 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:12:52.484 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11'} 2024-09-22T08:12:52.495 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:12:52.498 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11'} 2024-09-22T08:12:52.508 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:12:52.508 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-22T08:12:52.517 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:12:52.525 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-22T08:12:52.532 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:12:52.532 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-22T08:12:52.537 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '083396ec-d900-46a5-a2e2-dd86e7b6cca3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11', 'marker': 'cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-22T08:12:52.503858Z', 'creation_time': '2024-09-22T08:12:52.380411Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-22T08:13:52.579 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-22T08:13:52.596 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:13:52.596 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-22T08:13:52.612 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:13:52.612 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-22T08:13:52.616 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:13:52.616 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-22T08:13:52.620 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:13:52.621 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-22T08:13:52.626 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:13:52.627 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-22T08:13:52.631 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:13:52.631 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-22T08:13:52.636 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-22T08:00:00.000000Z', 'epoch': 1726992000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-22T08:13:52.636 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-22T08:13:52.642 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:13:52.642 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-22T08:13:52.646 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-22T08:13:52.646 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-22T08:13:52.655 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:13:52.659 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-22T08:13:52.667 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:13:52.919 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-22T08:13:52.924 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000efcb1c924058c04d-0066efd1c0-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.020 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-22T08:13:53.024 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-22T08:13:53.030 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-22T08:13:53.038 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-22T08:13:53.155 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-22T08:13:53.195 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:13:53.196 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-22T08:13:53.202 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-22T08:13:53.202 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-22T08:13:53.207 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-22T08:13:53.221 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-22T08:13:53.224 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000005cf60a74c67ace1-0066efd1c1-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.241 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-22T08:13:53.272 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:13:53.273 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-22T08:13:53.277 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000dd04f10eeacbce88-0066efd1c1-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-22T08:13:53.280 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'e28b0ed0-1272-43e5-8a68-aa2f8d89bec5'}]}} 2024-09-22T08:13:53.280 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-22T08:13:53.291 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-22T08:13:53.291 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-22T08:13:53.294 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-22T08:13:53.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-22T08:13:53.298 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000fb76219a235b9a3b-0066efd1c1-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.298 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-22T08:13:53.301 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000005773d64a8e257155-0066efd1c1-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.311 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-22T08:13:53.315 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-22T08:13:53.316 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-22T08:13:53.320 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000d3de14d562deb006-0066efd1c1-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.320 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-22T08:13:53.324 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000008e994cf32ab2f50d-0066efd1c1-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.324 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-22T08:13:53.329 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-22T08:13:53.329 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-22T08:13:53.334 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000080b069a979125564-0066efd1c1-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.334 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-22T08:13:53.337 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000f7aa0ca11ba1d9b6-0066efd1c1-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.337 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-22T08:13:53.340 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000c1209f0784d22541-0066efd1c1-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.341 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-22T08:13:53.345 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000000c0def3c9d736b00-0066efd1c1-4228-default', 'HostId': '4228-default-default'} 2024-09-22T08:13:53.345 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-22T08:13:53.353 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:13:53.354 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-22T08:13:53.357 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-22T08:13:53.357 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-22T08:13:53.362 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:13:53.362 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-22T08:13:53.366 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-22T08:13:53.366 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-22T08:13:53.372 INFO:tasks.radosgw_admin_rest: empty result 2024-09-22T08:13:53.377 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-22T08:13:53.395 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-22T08:13:53.395 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:13:53.396 INFO:tasks.rgw.client.0.smithi165.stdout:2024-09-22T08:13:53.395+0000 7f575e0f5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35726) UID: 0 2024-09-22T08:13:53.396 INFO:tasks.rgw.client.0.smithi165.stdout:2024-09-22T08:13:53.395+0000 7f5761955880 -1 shutting down 2024-09-22T08:13:59.497 INFO:tasks.rgw.client.0:Stopped 2024-09-22T08:13:59.497 DEBUG:teuthology.orchestra.run.smithi165:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-22T08:13:59.516 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f /etc/ceph/vault-root-token 2024-09-22T08:13:59.586 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-22T08:13:59.653 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-22T08:13:59.653 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-22T08:13:59.653 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-22T08:13:59.740 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:13:59.740 INFO:teuthology.orchestra.run.smithi165.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.740+0000 7f97ff840800 1 Processor -- start 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.740+0000 7f97ff840800 1 -- start start 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.740+0000 7f97ff840800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d035da8d30 0x55d035e38140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.740+0000 7f97ff840800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d035cc0a20 con 0x55d035e387f0 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.740+0000 7f97ff840800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d035cc07d0 con 0x55d035da8d30 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.741+0000 7f97fd32a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d035da8d30 0x55d035e38140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.741+0000 7f97fd32a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d035da8d30 0x55d035e38140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51950/0 (socket says 172.21.15.165:51950) 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.741+0000 7f97fd32a640 1 -- 172.21.15.165:0/664782668 learned_addr learned my addr 172.21.15.165:0/664782668 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.741+0000 7f97fcb29640 1 --1- 172.21.15.165:0/664782668 >> v1:172.21.15.53:6789/0 conn(0x55d035e387f0 0x55d035e3acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.165:52764/0 (socket says 172.21.15.165:52764) 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.741+0000 7f97fd32a640 1 -- 172.21.15.165:0/664782668 >> v1:172.21.15.53:6789/0 conn(0x55d035e387f0 legacy=0x55d035e3acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.741+0000 7f97fd32a640 1 -- 172.21.15.165:0/664782668 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d035e3d570 con 0x55d035da8d30 2024-09-22T08:13:59.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.743+0000 7f97fd32a640 1 --2- 172.21.15.165:0/664782668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035e38140 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005fd0 tx=0x7f97f0045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe27e203e03337fe server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.743+0000 7f97f7fff640 1 -- 172.21.15.165:0/664782668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f004e600 con 0x55d035da8d30 2024-09-22T08:13:59.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.743+0000 7f97f7fff640 1 -- 172.21.15.165:0/664782668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f004e7a0 con 0x55d035da8d30 2024-09-22T08:13:59.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.743+0000 7f97f7fff640 1 -- 172.21.15.165:0/664782668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f004eaa0 con 0x55d035da8d30 2024-09-22T08:13:59.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.744+0000 7f97ff840800 1 -- 172.21.15.165:0/664782668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 msgr2=0x55d035e38140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.744+0000 7f97ff840800 1 --2- 172.21.15.165:0/664782668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035e38140 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005fd0 tx=0x7f97f0045cf0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.744+0000 7f97ff840800 1 -- 172.21.15.165:0/664782668 shutdown_connections 2024-09-22T08:13:59.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.744+0000 7f97ff840800 1 --2- 172.21.15.165:0/664782668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035e38140 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.744+0000 7f97ff840800 1 -- 172.21.15.165:0/664782668 >> 172.21.15.165:0/664782668 conn(0x55d035e2fbb0 msgr2=0x55d035e32010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:13:59.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.744+0000 7f97ff840800 1 -- 172.21.15.165:0/664782668 shutdown_connections 2024-09-22T08:13:59.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.744+0000 7f97ff840800 1 -- 172.21.15.165:0/664782668 wait complete. 2024-09-22T08:13:59.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.758+0000 7f97ff840800 1 Processor -- start 2024-09-22T08:13:59.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.758+0000 7f97ff840800 1 -- start start 2024-09-22T08:13:59.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.759+0000 7f97ff840800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035e358a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.759+0000 7f97ff840800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d035ccddd0 con 0x55d035da8d30 2024-09-22T08:13:59.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.759+0000 7f97fd32a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035e358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.759+0000 7f97fd32a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035e358a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51952/0 (socket says 172.21.15.165:51952) 2024-09-22T08:13:59.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.759+0000 7f97fd32a640 1 -- 172.21.15.165:0/2475597331 learned_addr learned my addr 172.21.15.165:0/2475597331 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:13:59.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.759+0000 7f97fd32a640 1 -- 172.21.15.165:0/2475597331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d035e35e90 con 0x55d035da8d30 2024-09-22T08:13:59.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.760+0000 7f97fd32a640 1 --2- 172.21.15.165:0/2475597331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035e358a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005fd0 tx=0x7f97f0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37abe2a48caa6d74 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.760+0000 7f96eb606640 1 -- 172.21.15.165:0/2475597331 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f004eb40 con 0x55d035da8d30 2024-09-22T08:13:59.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.760+0000 7f96eb606640 1 -- 172.21.15.165:0/2475597331 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f0066070 con 0x55d035da8d30 2024-09-22T08:13:59.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.760+0000 7f96eb606640 1 -- 172.21.15.165:0/2475597331 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f004ee50 con 0x55d035da8d30 2024-09-22T08:13:59.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.760+0000 7f97ff840800 1 -- 172.21.15.165:0/2475597331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 msgr2=0x55d035e358a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.760+0000 7f97ff840800 1 --2- 172.21.15.165:0/2475597331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035e358a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005fd0 tx=0x7f97f0050000 comp rx=0 tx=0).stop 2024-09-22T08:13:59.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.760+0000 7f97ff840800 1 -- 172.21.15.165:0/2475597331 shutdown_connections 2024-09-22T08:13:59.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.760+0000 7f97ff840800 1 --2- 172.21.15.165:0/2475597331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035e358a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.760+0000 7f97ff840800 1 -- 172.21.15.165:0/2475597331 >> 172.21.15.165:0/2475597331 conn(0x55d035e2fbb0 msgr2=0x55d035f209c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.761+0000 7f97ff840800 1 -- 172.21.15.165:0/2475597331 shutdown_connections 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.761+0000 7f97ff840800 1 -- 172.21.15.165:0/2475597331 wait complete. 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.761+0000 7f97ff840800 1 Processor -- start 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.761+0000 7f97ff840800 1 -- start start 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.761+0000 7f97ff840800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035f2eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.761+0000 7f97ff840800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d035e3c810 con 0x55d035da8d30 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.761+0000 7f97fd32a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035f2eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.761+0000 7f97fd32a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035f2eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51954/0 (socket says 172.21.15.165:51954) 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.761+0000 7f97fd32a640 1 -- 172.21.15.165:0/1248417049 learned_addr learned my addr 172.21.15.165:0/1248417049 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.762+0000 7f97fd32a640 1 -- 172.21.15.165:0/1248417049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d035f2f100 con 0x55d035da8d30 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.762+0000 7f97fd32a640 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035f2eba0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005fd0 tx=0x7f97f0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.762+0000 7f96e9e03640 1 -- 172.21.15.165:0/1248417049 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f006d420 con 0x55d035da8d30 2024-09-22T08:13:59.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.762+0000 7f96e9e03640 1 -- 172.21.15.165:0/1248417049 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f0071030 con 0x55d035da8d30 2024-09-22T08:13:59.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.762+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d035f2f390 con 0x55d035da8d30 2024-09-22T08:13:59.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.762+0000 7f96e9e03640 1 -- 172.21.15.165:0/1248417049 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f006d6f0 con 0x55d035da8d30 2024-09-22T08:13:59.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.762+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d035f2fd90 con 0x55d035da8d30 2024-09-22T08:13:59.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.763+0000 7f96e9e03640 1 -- 172.21.15.165:0/1248417049 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f97f006d9a0 con 0x55d035da8d30 2024-09-22T08:13:59.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.763+0000 7f96e9e03640 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96e403cfb0 0x7f96e403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.763+0000 7f96e9e03640 1 -- 172.21.15.165:0/1248417049 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f97f0098e70 con 0x55d035da8d30 2024-09-22T08:13:59.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.764+0000 7f97fcb29640 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96e403cfb0 0x7f96e403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.764+0000 7f97ff840800 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035e387f0 0x55d035f361f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.764+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f30980 con 0x55d035e387f0 2024-09-22T08:13:59.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.764+0000 7f97fdb2b640 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035e387f0 0x55d035f361f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.764+0000 7f97fcb29640 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96e403cfb0 0x7f96e403f470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f97e8001e80 tx=0x7f97e80013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.764+0000 7f97fdb2b640 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035e387f0 0x55d035f361f0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.764+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1248417049 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035e387f0 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.764+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f36c70 con 0x55d035e387f0 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.765+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1248417049 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035e387f0 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.765+0000 7f97ff840800 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f38580 0x55d035f3aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.765+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:3 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f3b1b0 con 0x55d035f38580 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.765+0000 7f97fd32a640 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f38580 0x55d035f3aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.765+0000 7f97fd32a640 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f38580 0x55d035f3aa20 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.765+0000 7f97fd32a640 1 -- 172.21.15.165:0/1248417049 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(3 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f97f007d070 con 0x55d035f38580 2024-09-22T08:13:59.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.765+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f374c0 con 0x55d035e387f0 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.766+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1248417049 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035e387f0 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.766+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:5 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f378f0 con 0x55d035e387f0 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.766+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1248417049 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(5 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035e387f0 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.766+0000 7f97ff840800 1 Processor -- start 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.766+0000 7f97ff840800 1 -- start start 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.766+0000 7f97ff840800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f49ba0 0x55d035f49fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.766+0000 7f97ff840800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d035d2cd50 con 0x55d035f49ba0 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.767+0000 7f97fdb2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f49ba0 0x55d035f49fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.767+0000 7f97fdb2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f49ba0 0x55d035f49fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51962/0 (socket says 172.21.15.165:51962) 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.767+0000 7f97fdb2b640 1 -- 172.21.15.165:0/4267832475 learned_addr learned my addr 172.21.15.165:0/4267832475 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.767+0000 7f97fdb2b640 1 -- 172.21.15.165:0/4267832475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d035f4a600 con 0x55d035f49ba0 2024-09-22T08:13:59.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.767+0000 7f97fdb2b640 1 --2- 172.21.15.165:0/4267832475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f49ba0 0x55d035f49fc0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x55d035f30190 tx=0x7f97f800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.767+0000 7f96e2ffd640 1 -- 172.21.15.165:0/4267832475 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f8007dc0 con 0x55d035f49ba0 2024-09-22T08:13:59.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.767+0000 7f96e2ffd640 1 -- 172.21.15.165:0/4267832475 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f801e020 con 0x55d035f49ba0 2024-09-22T08:13:59.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.768+0000 7f97ff840800 1 -- 172.21.15.165:0/4267832475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d035f4ae30 con 0x55d035f49ba0 2024-09-22T08:13:59.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.768+0000 7f96e2ffd640 1 -- 172.21.15.165:0/4267832475 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f8019570 con 0x55d035f49ba0 2024-09-22T08:13:59.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.768+0000 7f97ff840800 1 -- 172.21.15.165:0/4267832475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d035f4b3d0 con 0x55d035f49ba0 2024-09-22T08:13:59.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.768+0000 7f96e2ffd640 1 -- 172.21.15.165:0/4267832475 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f97f8016040 con 0x55d035f49ba0 2024-09-22T08:13:59.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.769+0000 7f96e2ffd640 1 --2- 172.21.15.165:0/4267832475 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96d403cfb0 0x7f96d403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.769+0000 7f96e2ffd640 1 -- 172.21.15.165:0/4267832475 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f97f801f030 con 0x55d035f49ba0 2024-09-22T08:13:59.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.769+0000 7f97fd32a640 1 --2- 172.21.15.165:0/4267832475 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96d403cfb0 0x7f96d403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.769+0000 7f97ff840800 1 Processor -- start 2024-09-22T08:13:59.783 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.769+0000 7f97fd32a640 1 --2- 172.21.15.165:0/4267832475 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96d403cfb0 0x7f96d403f470 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55d035f30370 tx=0x7f97f006b940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.769+0000 7f97ff840800 1 -- start start 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.769+0000 7f97ff840800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f56a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.769+0000 7f97ff840800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d035e34230 con 0x55d035f56690 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.770+0000 7f97fdb2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f56a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.770+0000 7f97fdb2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f56a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51976/0 (socket says 172.21.15.165:51976) 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.770+0000 7f97fdb2b640 1 -- 172.21.15.165:0/2271101056 learned_addr learned my addr 172.21.15.165:0/2271101056 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.770+0000 7f97fdb2b640 1 -- 172.21.15.165:0/2271101056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d035f57080 con 0x55d035f56690 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.770+0000 7f97fdb2b640 1 --2- 172.21.15.165:0/2271101056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f56a90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f97f8014d90 tx=0x7f97f8014340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ddfb42a9bfab84 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.770+0000 7f96e0ff9640 1 -- 172.21.15.165:0/2271101056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f8051020 con 0x55d035f56690 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.770+0000 7f96e0ff9640 1 -- 172.21.15.165:0/2271101056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f80560d0 con 0x55d035f56690 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.770+0000 7f96e0ff9640 1 -- 172.21.15.165:0/2271101056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f801d070 con 0x55d035f56690 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 -- 172.21.15.165:0/2271101056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 msgr2=0x55d035f56a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 --2- 172.21.15.165:0/2271101056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f56a90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f97f8014d90 tx=0x7f97f8014340 comp rx=0 tx=0).stop 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 -- 172.21.15.165:0/2271101056 shutdown_connections 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 --2- 172.21.15.165:0/2271101056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f56a90 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 -- 172.21.15.165:0/2271101056 >> 172.21.15.165:0/2271101056 conn(0x55d035f52a90 msgr2=0x55d035f50cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 -- 172.21.15.165:0/2271101056 shutdown_connections 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 -- 172.21.15.165:0/2271101056 wait complete. 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 Processor -- start 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 -- start start 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f5dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97ff840800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d035f576a0 con 0x55d035f56690 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97fdb2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f5dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97fdb2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f5dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.165:51984/0 (socket says 172.21.15.165:51984) 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.771+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 learned_addr learned my addr 172.21.15.165:0/1241000078 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.772+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d035f5e140 con 0x55d035f56690 2024-09-22T08:13:59.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.772+0000 7f97fdb2b640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f5dbe0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f97f8056380 tx=0x7f97f80545f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.772+0000 7f96d2ffd640 1 -- 172.21.15.165:0/1241000078 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f8030020 con 0x55d035f56690 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.772+0000 7f96d2ffd640 1 -- 172.21.15.165:0/1241000078 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f8045340 con 0x55d035f56690 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.772+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d035f5e3d0 con 0x55d035f56690 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.772+0000 7f96d2ffd640 1 -- 172.21.15.165:0/1241000078 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f80173b0 con 0x55d035f56690 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.772+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d035f5ed50 con 0x55d035f56690 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.773+0000 7f96d2ffd640 1 -- 172.21.15.165:0/1241000078 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f97f8033020 con 0x55d035f56690 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.773+0000 7f96d2ffd640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96c803cfb0 0x7f96c803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.773+0000 7f96d2ffd640 1 -- 172.21.15.165:0/1241000078 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f97f8040570 con 0x55d035f56690 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.773+0000 7f97fd32a640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96c803cfb0 0x7f96c803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.774+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.774+0000 7f97fd32a640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96c803cfb0 0x7f96c803f470 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f97f0061fd0 tx=0x7f97f0089000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.774+0000 7f97ff840800 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035f69570 0x55d035f6ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.774+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f6c180 con 0x55d035f69570 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.774+0000 7f97fcb29640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035f69570 0x55d035f6ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.774+0000 7f97fcb29640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035f69570 0x55d035f6ba30 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97e800f630 con 0x55d035f69570 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 20 realm 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f688c0 con 0x55d035f69570 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97e800f630 con 0x55d035f69570 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f6cc70 con 0x55d035f69570 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97e800f630 con 0x55d035f69570 2024-09-22T08:13:59.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f6d540 con 0x55d035f69570 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97e800f630 con 0x55d035f69570 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f6df60 0x55d035f70350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.775+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:5 5.10 5:0d02e28a:::zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f70a90 con 0x55d035f6df60 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.776+0000 7f97fdb2b640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f6df60 0x55d035f70350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.776+0000 7f97fdb2b640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f6df60 0x55d035f70350 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.776+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== osd_op_reply(5 zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.776+0000 7f97ff840800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.776+0000 7f97ff840800 20 searching for the correct realm 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.776+0000 7f97ff840800 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d035f72a40 0x55d035f74f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.776+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f72a40 2024-09-22T08:13:59.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.776+0000 7f97fd32a640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d035f72a40 0x55d035f74f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.776+0000 7f97fd32a640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d035f72a40 0x55d035f74f00 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.777+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.777+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f6df60 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.777+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.777+0000 7f97fdb2b640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f97f8035020 0x7f97f8015a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.777+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x7f97f8035020 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.777+0000 7f97fcb29640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f97f8035020 0x7f97f8015a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.778+0000 7f97fcb29640 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f97f8035020 0x7f97f8015a30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.778+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e800f630 con 0x7f97f8035020 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.778+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f69570 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.778+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e800f630 con 0x55d035f69570 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.778+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f69570 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.779+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.779+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x7f97f8035020 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.779+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.779+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f6df60 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.779+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.779+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f6df60 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.780+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.780+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f72a40 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.780+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.780+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f69570 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.780+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.780+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x7f97f8035020 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.780+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.780+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f69570 2024-09-22T08:13:59.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.781+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.781+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f6df60 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.781+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 5 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.781+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f72a40 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.781+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.781+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f72a40 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.781+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.781+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x7f97f8035020 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.782+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.782+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f72a40 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.782+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.782+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f72a40 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.782+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.782+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f69570 2024-09-22T08:13:59.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.782+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.782+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f69570 2024-09-22T08:13:59.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.783+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.783+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x7f97f8035020 2024-09-22T08:13:59.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.783+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.783+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f72a40 2024-09-22T08:13:59.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.783+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.783+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f6df60 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.783+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 6 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.783+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f69570 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.784+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.784+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x7f97f8035020 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.784+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=82b] v34'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.784+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f72a40 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.784+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.784+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x7f97f8035020 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.785+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.785+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f6df60 2024-09-22T08:13:59.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.785+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.785+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f72a40 2024-09-22T08:13:59.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.785+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.785+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x7f97f8035020 2024-09-22T08:13:59.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.785+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.785+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f69570 2024-09-22T08:13:59.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75580 con 0x55d035f6df60 2024-09-22T08:13:59.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 RGWRados::pool_iterate: got zone_info.cc1223c2-11fd-49fe-8726-a14b177df4cc 2024-09-22T08:13:59.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 RGWRados::pool_iterate: got zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 RGWRados::pool_iterate: got period_config.default 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f71450 con 0x55d035f69570 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f71090 con 0x55d035f69570 2024-09-22T08:13:59.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.786+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:40 5.4 5:24d805b4:::zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f71e70 con 0x55d035f69570 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 15 ==== osd_op_reply(40 zonegroup_info.083396ec-d900-46a5-a2e2-dd86e7b6cca3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 20 zone default found 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 4 Realm: () 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 4 ZoneGroup: default (083396ec-d900-46a5-a2e2-dd86e7b6cca3) 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 4 Zone: default (cc1223c2-11fd-49fe-8726-a14b177df4cc) 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 20 zonegroup default 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f75eb0 con 0x7f97f8035020 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.787+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f77c70 con 0x55d035f72a40 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.788+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.788+0000 7f97ff840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.788+0000 7f97ff840800 20 rados->read ofs=0 len=0 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.788+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f78110 con 0x55d035f72a40 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.788+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.788+0000 7f97ff840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.788+0000 7f97ff840800 20 started sync module instance, tier type = 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.788+0000 7f97ff840800 20 started zone id=cc1223c2-11fd-49fe-8726-a14b177df4cc (name=default) with tier type = 2024-09-22T08:13:59.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.788+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f76a70 con 0x55d035f6df60 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.789+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 9 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.789+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94352746966944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f76a70 con 0x55d035f6df60 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.789+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f78c10 con 0x55d035f69570 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.790+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94352746966944] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.790+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 16 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.790+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94352746972896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f76a70 con 0x55d035f69570 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.790+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f79620 con 0x55d035f72a40 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.791+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94352746972896] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.792+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 12 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.792+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94352746964416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f769e0 con 0x55d035f72a40 2024-09-22T08:13:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.792+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7a3e0 con 0x55d035f6df60 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.793+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 11 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.793+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94352746979008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7ac80 con 0x55d035f6df60 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.793+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94352746964416] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.793+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7b780 con 0x55d035f69570 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.794+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 18 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.794+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94352746984048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7b740 con 0x55d035f69570 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.794+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7c1e0 con 0x7f97f8035020 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.794+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94352746979008] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.795+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94352746984048] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.795+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 10 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.795+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94352746977808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7c1e0 con 0x7f97f8035020 2024-09-22T08:13:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.795+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7ca80 con 0x7f97f8035020 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.797+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94352746977808] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.797+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 12 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.797+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94352746986768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7c1e0 con 0x7f97f8035020 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.797+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7d0a0 con 0x7f97f8035020 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.798+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94352746986768] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.798+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 14 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.798+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94352746988480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7d0a0 con 0x7f97f8035020 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.798+0000 7f97ff840800 20 add_watcher() i=0 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.798+0000 7f97ff840800 20 add_watcher() i=1 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.798+0000 7f97ff840800 20 add_watcher() i=2 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.798+0000 7f97ff840800 20 add_watcher() i=3 2024-09-22T08:13:59.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.798+0000 7f97ff840800 20 add_watcher() i=4 2024-09-22T08:13:59.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.798+0000 7f97ff840800 20 add_watcher() i=5 2024-09-22T08:13:59.808 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.798+0000 7f97ff840800 20 add_watcher() i=6 2024-09-22T08:13:59.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.799+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94352746988480] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.799+0000 7f97ff840800 20 add_watcher() i=7 2024-09-22T08:13:59.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.799+0000 7f97ff840800 2 all 8 watchers are set, enabling cache 2024-09-22T08:13:59.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.799+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f80520 con 0x55d035f69570 2024-09-22T08:13:59.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.800+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.800+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94352747003632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7d210 con 0x55d035f69570 2024-09-22T08:13:59.810 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.801+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94352747003632] v34'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.801+0000 7f96b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.801+0000 7f97ff840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.801+0000 7f97ff840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.801+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f88fe0 con 0x55d035f69570 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.802+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.802+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f89610 con 0x7f97f8035020 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.803+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.803+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f89a70 con 0x55d035f72a40 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.804+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.804+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8a490 con 0x55d035f69570 2024-09-22T08:13:59.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.805+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.805+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8a490 con 0x55d035f6df60 2024-09-22T08:13:59.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.806+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.806+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8a510 con 0x55d035f72a40 2024-09-22T08:13:59.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.807+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.807+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8a990 con 0x55d035f69570 2024-09-22T08:13:59.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.809+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.812 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.809+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8a920 con 0x7f97f8035020 2024-09-22T08:13:59.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.810+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'57 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.810+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8a8c0 con 0x55d035f6df60 2024-09-22T08:13:59.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.811+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.811+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8a950 con 0x55d035f72a40 2024-09-22T08:13:59.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.812+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.812+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8af60 con 0x55d035f6df60 2024-09-22T08:13:59.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.813+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.814 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.813+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8af10 con 0x7f97f8035020 2024-09-22T08:13:59.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.814+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.814+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8af10 con 0x55d035f6df60 2024-09-22T08:13:59.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.815+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.815+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae90 con 0x7f97f8035020 2024-09-22T08:13:59.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.816+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'64 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.816+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae00 con 0x55d035f69570 2024-09-22T08:13:59.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.817+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.817+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae00 con 0x55d035f72a40 2024-09-22T08:13:59.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.818+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'77 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.819+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae00 con 0x55d035f6df60 2024-09-22T08:13:59.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.819+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.819+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae00 con 0x55d035f72a40 2024-09-22T08:13:59.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.820+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.820+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae90 con 0x55d035f69570 2024-09-22T08:13:59.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.821+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.821+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae90 con 0x55d035f69570 2024-09-22T08:13:59.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.822+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.822+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae90 con 0x55d035f72a40 2024-09-22T08:13:59.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.824+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'78 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.824+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae90 con 0x55d035f6df60 2024-09-22T08:13:59.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.825+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.825+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae90 con 0x55d035f72a40 2024-09-22T08:13:59.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.826+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.826+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae90 con 0x55d035f72a40 2024-09-22T08:13:59.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.827+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.827+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae90 con 0x55d035f72a40 2024-09-22T08:13:59.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.828+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.828+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae90 con 0x55d035f72a40 2024-09-22T08:13:59.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.829+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.829+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8ae90 con 0x7f97f8035020 2024-09-22T08:13:59.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.830+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.830+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8af00 con 0x55d035f72a40 2024-09-22T08:13:59.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.831+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.831+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8af00 con 0x7f97f8035020 2024-09-22T08:13:59.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.832+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'58 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.832+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8af00 con 0x55d035f72a40 2024-09-22T08:13:59.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.833+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'79 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.833+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8af00 con 0x7f97f8035020 2024-09-22T08:13:59.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.834+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'65 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.834+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f8af00 con 0x55d035f6df60 2024-09-22T08:13:59.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.835+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.836+0000 7f96b27e4640 20 reqs_thread_entry: start 2024-09-22T08:13:59.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.836+0000 7f97ff840800 20 init_complete bucket index max shards: 11 2024-09-22T08:13:59.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.836+0000 7f97ff840800 20 Filter name: none 2024-09-22T08:13:59.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.836+0000 7f9623fff640 20 reqs_thread_entry: start 2024-09-22T08:13:59.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.836+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T08:13:59.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.836+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:94 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.837+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 23 ==== osd_op_reply(94 gc.11 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.837+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:95 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.837+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 24 ==== osd_op_reply(95 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.837+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.837+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:96 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.838+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 25 ==== osd_op_reply(96 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.838+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:97 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.838+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 26 ==== osd_op_reply(97 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.838+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.838+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:98 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.838+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 27 ==== osd_op_reply(98 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.838+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.838+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:99 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.839+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 28 ==== osd_op_reply(99 gc.11 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.839+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T08:13:59.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.839+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:100 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.840+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 20 ==== osd_op_reply(100 gc.12 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.841 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.840+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:101 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 21 ==== osd_op_reply(101 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:102 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 22 ==== osd_op_reply(102 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:103 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 23 ==== osd_op_reply(103 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:104 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 24 ==== osd_op_reply(104 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.841+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:105 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.842+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 25 ==== osd_op_reply(105 gc.12 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.842+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T08:13:59.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.842+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:106 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.844+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 29 ==== osd_op_reply(106 gc.13 [call] v34'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.844+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:107 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.844+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 30 ==== osd_op_reply(107 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.844+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.844+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:108 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.844+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 31 ==== osd_op_reply(108 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.844+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:109 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.845+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 32 ==== osd_op_reply(109 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.845+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.845+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:110 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.845+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 33 ==== osd_op_reply(110 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.845+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.845+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:111 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.846+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 34 ==== osd_op_reply(111 gc.13 [call] v34'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.846+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T08:13:59.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.846+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:112 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.847+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 28 ==== osd_op_reply(112 gc.14 [call] v34'278 uv278 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.847+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:113 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.847+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 29 ==== osd_op_reply(113 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.847+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.847+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:114 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.848+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 30 ==== osd_op_reply(114 gc.14 [call out=24b] v0'0 uv278 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.848+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:115 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.848+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 31 ==== osd_op_reply(115 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.848+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.848+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:116 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.848+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 32 ==== osd_op_reply(116 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.848+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.848+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:117 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.849+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 33 ==== osd_op_reply(117 gc.14 [call] v34'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.849+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T08:13:59.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.849+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:118 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.850+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 26 ==== osd_op_reply(118 gc.15 [call] v34'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.852 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.850+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:119 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 27 ==== osd_op_reply(119 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:120 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 28 ==== osd_op_reply(120 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:121 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 29 ==== osd_op_reply(121 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:122 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 30 ==== osd_op_reply(122 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.851+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:123 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.852+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 31 ==== osd_op_reply(123 gc.15 [call] v34'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.852+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T08:13:59.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.852+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:124 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.853+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 26 ==== osd_op_reply(124 gc.16 [call] v34'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.853+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:125 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 27 ==== osd_op_reply(125 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:126 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 28 ==== osd_op_reply(126 gc.16 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:127 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 29 ==== osd_op_reply(127 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:128 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 30 ==== osd_op_reply(128 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.854+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:129 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.855+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 31 ==== osd_op_reply(129 gc.16 [call] v34'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.855+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T08:13:59.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.855+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:130 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.856+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 32 ==== osd_op_reply(130 gc.17 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.856+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:131 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.856+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 33 ==== osd_op_reply(131 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.856+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.856+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:132 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.857+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 34 ==== osd_op_reply(132 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.857+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:133 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.857+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 35 ==== osd_op_reply(133 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.857+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.857+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:134 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.857+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 36 ==== osd_op_reply(134 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.857+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.859 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.857+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:135 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.858+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 37 ==== osd_op_reply(135 gc.17 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.858+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T08:13:59.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.858+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:136 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.859+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 34 ==== osd_op_reply(136 gc.18 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.859+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:137 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.859+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 35 ==== osd_op_reply(137 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.859+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.859+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:138 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.859+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 36 ==== osd_op_reply(138 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.859+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:139 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.860+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 37 ==== osd_op_reply(139 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.860+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.860+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:140 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.860+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 38 ==== osd_op_reply(140 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.860+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.860+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:141 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.861+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 39 ==== osd_op_reply(141 gc.18 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.861+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T08:13:59.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.861+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:142 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.862+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 40 ==== osd_op_reply(142 gc.19 [call] v34'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.862+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:143 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.862+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 41 ==== osd_op_reply(143 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.862+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.862+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:144 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.863+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 42 ==== osd_op_reply(144 gc.19 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.863+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:145 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.863+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 43 ==== osd_op_reply(145 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.863+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.863+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:146 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.863+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 44 ==== osd_op_reply(146 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.863+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.865 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.863+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:147 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f69570 2024-09-22T08:13:59.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.864+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 45 ==== osd_op_reply(147 gc.19 [call] v34'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.864+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T08:13:59.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.864+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:148 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.865+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 38 ==== osd_op_reply(148 gc.20 [call] v34'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.865+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:149 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.865+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 39 ==== osd_op_reply(149 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.865+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.865+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:150 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.866+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 40 ==== osd_op_reply(150 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.866+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:151 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.866+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 41 ==== osd_op_reply(151 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.866+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.866+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:152 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.866+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 42 ==== osd_op_reply(152 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.866+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.866+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:153 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.867+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 43 ==== osd_op_reply(153 gc.20 [call] v34'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.867+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.867+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:154 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.868+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 32 ==== osd_op_reply(154 gc.21 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.868+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:155 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.868+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 33 ==== osd_op_reply(155 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.868+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.868+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:156 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.869+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 34 ==== osd_op_reply(156 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.869+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.869+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.869+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.870 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.869+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.869+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 36 ==== osd_op_reply(158 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.872 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.869+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.869+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f6df60 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.870+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 37 ==== osd_op_reply(159 gc.21 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.870+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.870+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.871+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 44 ==== osd_op_reply(160 gc.22 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.871+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.871+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 45 ==== osd_op_reply(161 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.871+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.871+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.871+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 46 ==== osd_op_reply(162 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.871+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:163 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.872+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 47 ==== osd_op_reply(163 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.872+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.872+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:164 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.872+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 48 ==== osd_op_reply(164 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.872+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.872+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:165 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.873+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 49 ==== osd_op_reply(165 gc.22 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.873+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.873+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:166 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.874+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 50 ==== osd_op_reply(166 gc.23 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.874+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:167 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.874+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 51 ==== osd_op_reply(167 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.874+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.874+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:168 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.874+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 52 ==== osd_op_reply(168 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.874+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:169 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.874+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 53 ==== osd_op_reply(169 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.874+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.874+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:170 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.875+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 54 ==== osd_op_reply(170 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.875+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.875+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:171 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.875+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 55 ==== osd_op_reply(171 gc.23 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.875+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T08:13:59.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.875+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:172 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.876+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 56 ==== osd_op_reply(172 gc.24 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.876+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:173 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 57 ==== osd_op_reply(173 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:174 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 58 ==== osd_op_reply(174 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:175 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 59 ==== osd_op_reply(175 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:176 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 60 ==== osd_op_reply(176 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.877+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:177 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.878+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 61 ==== osd_op_reply(177 gc.24 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.878+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T08:13:59.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.878+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:178 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.879+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 62 ==== osd_op_reply(178 gc.25 [call] v34'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.879+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:179 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.879+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 63 ==== osd_op_reply(179 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.879+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.879+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:180 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.880+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 64 ==== osd_op_reply(180 gc.25 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.880+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:181 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.880+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 65 ==== osd_op_reply(181 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.880+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.880+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:182 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.880+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 66 ==== osd_op_reply(182 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.880+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.880+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:183 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.881+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 67 ==== osd_op_reply(183 gc.25 [call] v34'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.881+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T08:13:59.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.881+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:184 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.882+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 35 ==== osd_op_reply(184 gc.26 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.882+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:185 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.883+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 36 ==== osd_op_reply(185 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.883+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.883+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:186 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.883+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 37 ==== osd_op_reply(186 gc.26 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.883+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:187 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.883+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 38 ==== osd_op_reply(187 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.883+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.883+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:188 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.884+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 39 ==== osd_op_reply(188 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.884+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.884+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:189 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.885+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 40 ==== osd_op_reply(189 gc.26 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.885+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T08:13:59.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.885+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:190 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.886+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 68 ==== osd_op_reply(190 gc.27 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.886+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:191 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.886+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 69 ==== osd_op_reply(191 gc.27 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.886+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.886+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:192 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.886+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 70 ==== osd_op_reply(192 gc.27 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.886+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:193 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.887+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 71 ==== osd_op_reply(193 gc.27 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.887+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.887+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:194 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.887+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 72 ==== osd_op_reply(194 gc.27 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.887+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.887+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:195 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.888+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 73 ==== osd_op_reply(195 gc.27 [call] v34'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.888+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T08:13:59.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.888+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:196 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.889+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 41 ==== osd_op_reply(196 gc.28 [call] v34'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.889+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:197 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 42 ==== osd_op_reply(197 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:198 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 43 ==== osd_op_reply(198 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:199 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 44 ==== osd_op_reply(199 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:200 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 45 ==== osd_op_reply(200 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.890+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:201 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.892+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 46 ==== osd_op_reply(201 gc.28 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.892+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T08:13:59.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.892+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:202 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.893+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 74 ==== osd_op_reply(202 gc.29 [call] v34'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.893+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:203 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.893+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 75 ==== osd_op_reply(203 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.893+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.893+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:204 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.893+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 76 ==== osd_op_reply(204 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.893+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:205 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.893+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 77 ==== osd_op_reply(205 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.893+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.893+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:206 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.894+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 78 ==== osd_op_reply(206 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.894+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.894+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:207 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x55d035f72a40 2024-09-22T08:13:59.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.895+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 79 ==== osd_op_reply(207 gc.29 [call] v34'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.895+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T08:13:59.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.895+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:208 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.896+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 47 ==== osd_op_reply(208 gc.30 [call] v34'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.896+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:209 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.896+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 48 ==== osd_op_reply(209 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.896+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.896+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:210 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 49 ==== osd_op_reply(210 gc.30 [call out=24b] v0'0 uv68 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:211 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 50 ==== osd_op_reply(211 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:212 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035f87290 con 0x7f97f8035020 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 51 ==== osd_op_reply(212 gc.30 [call out=1715b] v0'0 uv68 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97ff840800 20 garbage collection: RGWGC::process iterating over entry tag='cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.6616830564911303828', time=2024-09-22T08:14:07.918875+0000, chain.objs.size()=7 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97ff840800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_1 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:213 3.1cs0 3:3820e271:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7470 con 0x55d035f69570 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97ff840800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_2 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:214 3.23s0 3:c6823693:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba070 con 0x7f97f8035020 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.897+0000 7f97ff840800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_3 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.898+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:215 3.2s0 3:41c1fd7d:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fbc9b0 con 0x55d035f72a40 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.898+0000 7f97ff840800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_4 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.898+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:216 3.27s0 3:e77bb792:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fbf220 con 0x7f97f8035020 2024-09-22T08:13:59.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.898+0000 7f97ff840800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_5 2024-09-22T08:13:59.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.898+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:217 3.23s0 3:c53c959d:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fc1af0 con 0x7f97f8035020 2024-09-22T08:13:59.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.898+0000 7f97ff840800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_6 2024-09-22T08:13:59.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.898+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:218 3.1s0 3:834d5d2a:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fbf220 con 0x7f97f8035020 2024-09-22T08:13:59.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.898+0000 7f97ff840800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_7 2024-09-22T08:13:59.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.898+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:219 3.15s0 3:a9601e99:::cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fc1af0 con 0x55d035f6df60 2024-09-22T08:13:59.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.900+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 52 ==== osd_op_reply(216 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_4 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.900+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 53 ==== osd_op_reply(214 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_2 [call] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.900+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 54 ==== osd_op_reply(218 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_6 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.900+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 46 ==== osd_op_reply(213 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_1 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.900+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 55 ==== osd_op_reply(217 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_5 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.901+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 80 ==== osd_op_reply(215 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_3 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.902+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 38 ==== osd_op_reply(219 cc1223c2-11fd-49fe-8726-a14b177df4cc.4228.11__shadow_.0NXtm6BR4uBwgdHv7KgC8lEJu7DizpN_7 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.902+0000 7f97ff840800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T08:13:59.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.902+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:220 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x7f97f8035020 2024-09-22T08:13:59.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.904+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 56 ==== osd_op_reply(220 gc.30 [call] v34'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.904+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:221 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x7f97f8035020 2024-09-22T08:13:59.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.905+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 57 ==== osd_op_reply(221 gc.30 [call] v34'70 uv70 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.905+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T08:13:59.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.905+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:222 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f6df60 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.906+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 39 ==== osd_op_reply(222 gc.31 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.906+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:223 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f6df60 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.906+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 40 ==== osd_op_reply(223 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.906+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.906+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:224 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f6df60 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.906+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 41 ==== osd_op_reply(224 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.907+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:225 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f6df60 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.907+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 42 ==== osd_op_reply(225 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.907+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.907+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:226 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba470 con 0x55d035f6df60 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.907+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 43 ==== osd_op_reply(226 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.907+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.907+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:227 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba470 con 0x55d035f6df60 2024-09-22T08:13:59.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.908+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 44 ==== osd_op_reply(227 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.908+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T08:13:59.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.908+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:228 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba470 con 0x55d035f69570 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.909+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 47 ==== osd_op_reply(228 gc.0 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.909+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:229 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba470 con 0x55d035f69570 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.909+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 48 ==== osd_op_reply(229 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.909+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.909+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:230 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba470 con 0x55d035f69570 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.909+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 49 ==== osd_op_reply(230 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.909+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:231 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba470 con 0x55d035f69570 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.910+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 50 ==== osd_op_reply(231 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.910+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.910+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:232 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba470 con 0x55d035f69570 2024-09-22T08:13:59.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.910+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 51 ==== osd_op_reply(232 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.910+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.910+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:233 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba470 con 0x55d035f69570 2024-09-22T08:13:59.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.911+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 52 ==== osd_op_reply(233 gc.0 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.911+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T08:13:59.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.911+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:234 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba470 con 0x7f97f8035020 2024-09-22T08:13:59.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.912+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 58 ==== osd_op_reply(234 gc.1 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.912+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:235 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fba470 con 0x7f97f8035020 2024-09-22T08:13:59.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.912+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 59 ==== osd_op_reply(235 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.912+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.912+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:236 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fbb860 con 0x7f97f8035020 2024-09-22T08:13:59.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.912+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 60 ==== osd_op_reply(236 gc.1 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.912+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:237 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x7f97f8035020 2024-09-22T08:13:59.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.913+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 61 ==== osd_op_reply(237 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.913+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.913+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:238 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x7f97f8035020 2024-09-22T08:13:59.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.913+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 62 ==== osd_op_reply(238 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.913+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.913+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:239 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x7f97f8035020 2024-09-22T08:13:59.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.914+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 63 ==== osd_op_reply(239 gc.1 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.914+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T08:13:59.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.914+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:240 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f72a40 2024-09-22T08:13:59.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.915+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 81 ==== osd_op_reply(240 gc.2 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.915+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:241 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f72a40 2024-09-22T08:13:59.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 82 ==== osd_op_reply(241 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:242 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fbb860 con 0x55d035f72a40 2024-09-22T08:13:59.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 83 ==== osd_op_reply(242 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:243 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f72a40 2024-09-22T08:13:59.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 84 ==== osd_op_reply(243 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:244 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f72a40 2024-09-22T08:13:59.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 85 ==== osd_op_reply(244 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.916+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:245 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f72a40 2024-09-22T08:13:59.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.917+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 86 ==== osd_op_reply(245 gc.2 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.917+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T08:13:59.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.917+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:246 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f69570 2024-09-22T08:13:59.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.918+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 53 ==== osd_op_reply(246 gc.3 [call] v34'282 uv282 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.918+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:247 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f69570 2024-09-22T08:13:59.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 54 ==== osd_op_reply(247 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:248 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fbb860 con 0x55d035f69570 2024-09-22T08:13:59.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 55 ==== osd_op_reply(248 gc.3 [call out=24b] v0'0 uv282 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:249 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f69570 2024-09-22T08:13:59.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 56 ==== osd_op_reply(249 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:250 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f69570 2024-09-22T08:13:59.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 57 ==== osd_op_reply(250 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.919+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:251 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f69570 2024-09-22T08:13:59.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.920+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 58 ==== osd_op_reply(251 gc.3 [call] v34'283 uv283 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.920+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T08:13:59.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.920+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:252 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb4fa0 con 0x55d035f6df60 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.922+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 45 ==== osd_op_reply(252 gc.4 [call] v34'88 uv88 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.922+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:253 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7950 con 0x55d035f6df60 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.922+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 46 ==== osd_op_reply(253 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.922+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.922+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:254 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.922+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 47 ==== osd_op_reply(254 gc.4 [call out=24b] v0'0 uv88 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.922+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:255 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.922+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 48 ==== osd_op_reply(255 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.922+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.922+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:256 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.923+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 49 ==== osd_op_reply(256 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.923+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.923+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:257 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.924+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 50 ==== osd_op_reply(257 gc.4 [call] v34'89 uv89 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.924+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T08:13:59.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.924+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:258 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.925+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 87 ==== osd_op_reply(258 gc.5 [call] v34'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.925+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:259 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.925+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 88 ==== osd_op_reply(259 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.925+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.925+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:260 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.925+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 89 ==== osd_op_reply(260 gc.5 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.925+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:261 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.925+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 90 ==== osd_op_reply(261 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.925+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.925+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:262 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.926+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 91 ==== osd_op_reply(262 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.926+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.926+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:263 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.926+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 92 ==== osd_op_reply(263 gc.5 [call] v34'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.926+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T08:13:59.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.926+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:264 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f69570 2024-09-22T08:13:59.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.928+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 59 ==== osd_op_reply(264 gc.6 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.928+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:265 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f69570 2024-09-22T08:13:59.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.928+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 60 ==== osd_op_reply(265 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.928+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.928+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:266 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb6460 con 0x55d035f69570 2024-09-22T08:13:59.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.928+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 61 ==== osd_op_reply(266 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.928+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:267 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f69570 2024-09-22T08:13:59.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.928+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 62 ==== osd_op_reply(267 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.928+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.928+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:268 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f69570 2024-09-22T08:13:59.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.929+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 63 ==== osd_op_reply(268 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.929+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.929+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:269 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f69570 2024-09-22T08:13:59.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.930+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 64 ==== osd_op_reply(269 gc.6 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.930+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T08:13:59.931 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.930+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:270 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x7f97f8035020 2024-09-22T08:13:59.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.931+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 64 ==== osd_op_reply(270 gc.7 [call] v34'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.932 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.931+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:271 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x7f97f8035020 2024-09-22T08:13:59.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.931+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 65 ==== osd_op_reply(271 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.931+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.931+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:272 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb6460 con 0x7f97f8035020 2024-09-22T08:13:59.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.931+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 66 ==== osd_op_reply(272 gc.7 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.931+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:273 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x7f97f8035020 2024-09-22T08:13:59.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.932+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 67 ==== osd_op_reply(273 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.932+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.932+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:274 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x7f97f8035020 2024-09-22T08:13:59.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.932+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 68 ==== osd_op_reply(274 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.932+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.932+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:275 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x7f97f8035020 2024-09-22T08:13:59.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.933+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 69 ==== osd_op_reply(275 gc.7 [call] v34'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.933+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T08:13:59.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.933+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:276 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.934+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 51 ==== osd_op_reply(276 gc.8 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.934+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:277 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.934+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 52 ==== osd_op_reply(277 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.934+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.934+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:278 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.934+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 53 ==== osd_op_reply(278 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.934+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:279 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.935+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 54 ==== osd_op_reply(279 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.935+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.935+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:280 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.935+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 55 ==== osd_op_reply(280 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.935+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.935+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:281 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.936+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 56 ==== osd_op_reply(281 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.936+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T08:13:59.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.936+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:282 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.937+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 93 ==== osd_op_reply(282 gc.9 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.937+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:283 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.937+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 94 ==== osd_op_reply(283 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.937+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.937+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:284 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.938+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 95 ==== osd_op_reply(284 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.938+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:285 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.939 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.938+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 96 ==== osd_op_reply(285 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.938+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.938+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:286 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.938+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 97 ==== osd_op_reply(286 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.938+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.940 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.938+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:287 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f72a40 2024-09-22T08:13:59.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.939+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 98 ==== osd_op_reply(287 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.939+0000 7f97ff840800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.939+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:288 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.940+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 57 ==== osd_op_reply(288 gc.10 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.940+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:289 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.940+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 58 ==== osd_op_reply(289 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.940+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.940+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:290 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.940+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 59 ==== osd_op_reply(290 gc.10 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.940+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:291 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.941+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 60 ==== osd_op_reply(291 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.941+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.941+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:292 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.941+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 61 ==== osd_op_reply(292 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.941+0000 7f97ff840800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T08:13:59.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.941+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:293 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035fb7900 con 0x55d035f6df60 2024-09-22T08:13:59.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.942+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 62 ==== osd_op_reply(293 gc.10 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.942+0000 7f96b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:13:59.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.942+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94352747003632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7efb0 con 0x55d035f69570 2024-09-22T08:13:59.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.944+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94352747003632] v34'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.944+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94352746966944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7fef0 con 0x55d035f6df60 2024-09-22T08:13:59.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.945+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94352746966944] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.945+0000 7f97ff840800 20 remove_watcher() i=0 2024-09-22T08:13:59.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.945+0000 7f97ff840800 2 removed watcher, disabling cache 2024-09-22T08:13:59.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.945+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94352746972896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f76e90 con 0x55d035f69570 2024-09-22T08:13:59.947 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.946+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94352746972896] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.947 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.946+0000 7f97ff840800 20 remove_watcher() i=1 2024-09-22T08:13:59.947 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.946+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94352746964416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f786e0 con 0x55d035f72a40 2024-09-22T08:13:59.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.947+0000 7f97fd32a640 1 -- 172.21.15.165:0/1241000078 <== osd.3 v2:172.21.15.165:6800/215521179 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94352746964416] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f009b030 con 0x55d035f72a40 2024-09-22T08:13:59.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.947+0000 7f97ff840800 20 remove_watcher() i=2 2024-09-22T08:13:59.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.947+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94352746979008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f786e0 con 0x55d035f6df60 2024-09-22T08:13:59.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.948+0000 7f97fdb2b640 1 -- 172.21.15.165:0/1241000078 <== osd.2 v2:172.21.15.165:6808/3197121696 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94352746979008] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80083e0 con 0x55d035f6df60 2024-09-22T08:13:59.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.948+0000 7f97ff840800 20 remove_watcher() i=3 2024-09-22T08:13:59.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.948+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94352746984048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f786e0 con 0x55d035f69570 2024-09-22T08:13:59.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.949+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.1 v2:172.21.15.165:6816/2347568643 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94352746984048] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x55d035f69570 2024-09-22T08:13:59.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.949+0000 7f97ff840800 20 remove_watcher() i=4 2024-09-22T08:13:59.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.949+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94352746977808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f7b270 con 0x7f97f8035020 2024-09-22T08:13:59.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.951+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 70 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94352746977808] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.951+0000 7f97ff840800 20 remove_watcher() i=5 2024-09-22T08:13:59.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.951+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94352746986768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f786e0 con 0x7f97f8035020 2024-09-22T08:13:59.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.952+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 71 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94352746986768] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.952+0000 7f97ff840800 20 remove_watcher() i=6 2024-09-22T08:13:59.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.952+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94352746988480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d035f79a10 con 0x7f97f8035020 2024-09-22T08:13:59.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 <== osd.0 v2:172.21.15.53:6800/2902972477 72 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94352746988480] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97e802b040 con 0x7f97f8035020 2024-09-22T08:13:59.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 20 remove_watcher() i=7 2024-09-22T08:13:59.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f97f8035020 msgr2=0x7f97f8015a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f97f8035020 0x7f97f8015a30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035f69570 msgr2=0x55d035f6ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035f69570 0x55d035f6ba30 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f6df60 msgr2=0x55d035f70350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.956 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f6df60 0x55d035f70350 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d035f72a40 msgr2=0x55d035f74f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x55d035f72a40 0x55d035f74f00 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96c803cfb0 msgr2=0x7f96c803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96c803cfb0 0x7f96c803f470 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f97f0061fd0 tx=0x7f97f0089000 comp rx=0 tx=0).stop 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 msgr2=0x55d035f5dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97fcb29640 1 -- 172.21.15.165:0/1241000078 reap_dead start 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f5dbe0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f97f8056380 tx=0x7f97f80545f0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 shutdown_connections 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 --2- 172.21.15.165:0/1241000078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f56690 0x55d035f5dbe0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 >> 172.21.15.165:0/1241000078 conn(0x55d035f52a90 msgr2=0x55d035f50ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 shutdown_connections 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/1241000078 wait complete. 2024-09-22T08:13:59.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/4267832475 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96d403cfb0 msgr2=0x7f96d403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 --2- 172.21.15.165:0/4267832475 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96d403cfb0 0x7f96d403f470 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55d035f30370 tx=0x7f97f006b940 comp rx=0 tx=0).stop 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 -- 172.21.15.165:0/4267832475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f49ba0 msgr2=0x55d035f49fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.953+0000 7f97ff840800 1 --2- 172.21.15.165:0/4267832475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f49ba0 0x55d035f49fc0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x55d035f30190 tx=0x7f97f800af40 comp rx=0 tx=0).stop 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/4267832475 shutdown_connections 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 --2- 172.21.15.165:0/4267832475 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96d403cfb0 0x7f96d403f470 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 --2- 172.21.15.165:0/4267832475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035f49ba0 0x55d035f49fc0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/4267832475 >> 172.21.15.165:0/4267832475 conn(0x55d035f3df50 msgr2=0x55d035f3e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/4267832475 shutdown_connections 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/4267832475 wait complete. 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035e387f0 msgr2=0x55d035f361f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035e387f0 0x55d035f361f0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f38580 msgr2=0x55d035f3aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f38580 0x55d035f3aa20 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96e403cfb0 msgr2=0x7f96e403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96e403cfb0 0x7f96e403f470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f97e8001e80 tx=0x7f97e80013e0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 msgr2=0x55d035f2eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:13:59.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035f2eba0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005fd0 tx=0x7f97f0003330 comp rx=0 tx=0).stop 2024-09-22T08:13:59.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 shutdown_connections 2024-09-22T08:13:59.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x55d035f38580 0x55d035f3aa20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x55d035e387f0 0x55d035f361f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f96e403cfb0 0x7f96e403f470 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 --2- 172.21.15.165:0/1248417049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d035da8d30 0x55d035f2eba0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:13:59.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 >> 172.21.15.165:0/1248417049 conn(0x55d035e2fbb0 msgr2=0x55d035f20510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:13:59.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 shutdown_connections 2024-09-22T08:13:59.960 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-22T08:13:59.954+0000 7f97ff840800 1 -- 172.21.15.165:0/1248417049 wait complete. 2024-09-22T08:13:59.964 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-22T08:13:59.976 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T08:13:59.976 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:14:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.081+0000 7f4aed3b5640 1 Processor -- start 2024-09-22T08:14:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.081+0000 7f4aed3b5640 1 -- start start 2024-09-22T08:14:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.081+0000 7f4aed3b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ae806f280 0x7f4ae806f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.081+0000 7f4aed3b5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae8099ee0 con 0x7f4ae806fba0 2024-09-22T08:14:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.081+0000 7f4aed3b5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae8070d00 con 0x7f4ae806f280 2024-09-22T08:14:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.081+0000 7f4ae6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ae806f280 0x7f4ae806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:00.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.081+0000 7f4adffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4ae806fba0 0x7f4ae8097070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56194/0 (socket says 172.21.15.53:56194) 2024-09-22T08:14:00.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.081+0000 7f4adffff640 1 -- 172.21.15.53:0/2589907789 learned_addr learned my addr 172.21.15.53:0/2589907789 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:00.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.081+0000 7f4ae6ffd640 1 -- 172.21.15.53:0/2589907789 >> v1:172.21.15.53:6789/0 conn(0x7f4ae806fba0 legacy=0x7f4ae8097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:00.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.082+0000 7f4ae67fc640 1 -- 172.21.15.53:0/2589907789 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359589749 0 0) 0x7f4ae8099ee0 con 0x7f4ae806fba0 2024-09-22T08:14:00.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.082+0000 7f4ae6ffd640 1 -- 172.21.15.53:0/2589907789 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae8070f40 con 0x7f4ae806f280 2024-09-22T08:14:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.082+0000 7f4ae6ffd640 1 --2- 172.21.15.53:0/2589907789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 0x7f4ae806f660 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009720 tx=0x7f4ad802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2809006c2e0afd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.082+0000 7f4ae67fc640 1 -- 172.21.15.53:0/2589907789 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad8037070 con 0x7f4ae806f280 2024-09-22T08:14:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.082+0000 7f4ae67fc640 1 -- 172.21.15.53:0/2589907789 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad802ad90 con 0x7f4ae806f280 2024-09-22T08:14:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.082+0000 7f4ae67fc640 1 -- 172.21.15.53:0/2589907789 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad8032590 con 0x7f4ae806f280 2024-09-22T08:14:00.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.083+0000 7f4aed3b5640 1 -- 172.21.15.53:0/2589907789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 msgr2=0x7f4ae806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.083+0000 7f4aed3b5640 1 --2- 172.21.15.53:0/2589907789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 0x7f4ae806f660 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009720 tx=0x7f4ad802a110 comp rx=0 tx=0).stop 2024-09-22T08:14:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.083+0000 7f4aed3b5640 1 -- 172.21.15.53:0/2589907789 shutdown_connections 2024-09-22T08:14:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.083+0000 7f4aed3b5640 1 --2- 172.21.15.53:0/2589907789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 0x7f4ae806f660 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.083+0000 7f4aed3b5640 1 -- 172.21.15.53:0/2589907789 >> 172.21.15.53:0/2589907789 conn(0x7f4ae809ac80 msgr2=0x7f4ae8098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.083+0000 7f4aed3b5640 1 -- 172.21.15.53:0/2589907789 shutdown_connections 2024-09-22T08:14:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.083+0000 7f4aed3b5640 1 -- 172.21.15.53:0/2589907789 wait complete. 2024-09-22T08:14:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.084+0000 7f4aed3b5640 1 Processor -- start 2024-09-22T08:14:00.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.084+0000 7f4aed3b5640 1 -- start start 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.084+0000 7f4aed3b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 0x7f4ae808db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.084+0000 7f4aed3b5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8097780 con 0x7f4ae806f280 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.084+0000 7f4ae6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 0x7f4ae808db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.084+0000 7f4ae6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 0x7f4ae808db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48022/0 (socket says 172.21.15.53:48022) 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.084+0000 7f4ae6ffd640 1 -- 172.21.15.53:0/1732413523 learned_addr learned my addr 172.21.15.53:0/1732413523 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.085+0000 7f4ae6ffd640 1 -- 172.21.15.53:0/1732413523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae808f270 con 0x7f4ae806f280 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.085+0000 7f4ae6ffd640 1 --2- 172.21.15.53:0/1732413523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 0x7f4ae808db80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009840 tx=0x7f4ad80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.085+0000 7f4adf7fe640 1 -- 172.21.15.53:0/1732413523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad8041070 con 0x7f4ae806f280 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.085+0000 7f4adf7fe640 1 -- 172.21.15.53:0/1732413523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad803c460 con 0x7f4ae806f280 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.085+0000 7f4adf7fe640 1 -- 172.21.15.53:0/1732413523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad8037040 con 0x7f4ae806f280 2024-09-22T08:14:00.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.085+0000 7f4aed3b5640 1 -- 172.21.15.53:0/1732413523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae80903a0 con 0x7f4ae806f280 2024-09-22T08:14:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.085+0000 7f4aed3b5640 1 -- 172.21.15.53:0/1732413523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae808e0c0 con 0x7f4ae806f280 2024-09-22T08:14:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.086+0000 7f4adf7fe640 1 -- 172.21.15.53:0/1732413523 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4ad8044070 con 0x7f4ae806f280 2024-09-22T08:14:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.086+0000 7f4aed3b5640 1 -- 172.21.15.53:0/1732413523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae8073f90 con 0x7f4ae806f280 2024-09-22T08:14:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.086+0000 7f4adf7fe640 1 --2- 172.21.15.53:0/1732413523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4ac803e710 0x7f4ac8040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.086+0000 7f4adf7fe640 1 -- 172.21.15.53:0/1732413523 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4ad80742b0 con 0x7f4ae806f280 2024-09-22T08:14:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.087+0000 7f4adffff640 1 --2- 172.21.15.53:0/1732413523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4ac803e710 0x7f4ac8040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:00.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.087+0000 7f4adffff640 1 --2- 172.21.15.53:0/1732413523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4ac803e710 0x7f4ac8040bd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0000c00 tx=0x7f4ad00078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:00.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.091+0000 7f4adf7fe640 1 -- 172.21.15.53:0/1732413523 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4ad803d3f0 con 0x7f4ae806f280 2024-09-22T08:14:00.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.274+0000 7f4aed3b5640 1 -- 172.21.15.53:0/1732413523 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ae808ff50 con 0x7f4ac803e710 2024-09-22T08:14:00.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.284+0000 7f4adf7fe640 1 -- 172.21.15.53:0/1732413523 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666030 (secure 0 0 0) 0x7f4ae808ff50 con 0x7f4ac803e710 2024-09-22T08:14:00.293 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:14:00.299 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:14:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.289+0000 7f4aed3b5640 1 -- 172.21.15.53:0/1732413523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4ac803e710 msgr2=0x7f4ac8040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.289+0000 7f4aed3b5640 1 --2- 172.21.15.53:0/1732413523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4ac803e710 0x7f4ac8040bd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0000c00 tx=0x7f4ad00078f0 comp rx=0 tx=0).stop 2024-09-22T08:14:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.289+0000 7f4aed3b5640 1 -- 172.21.15.53:0/1732413523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 msgr2=0x7f4ae808db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.289+0000 7f4aed3b5640 1 --2- 172.21.15.53:0/1732413523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 0x7f4ae808db80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009840 tx=0x7f4ad80046c0 comp rx=0 tx=0).stop 2024-09-22T08:14:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.289+0000 7f4aed3b5640 1 -- 172.21.15.53:0/1732413523 shutdown_connections 2024-09-22T08:14:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.289+0000 7f4aed3b5640 1 --2- 172.21.15.53:0/1732413523 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4ac803e710 0x7f4ac8040bd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:00.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.289+0000 7f4aed3b5640 1 --2- 172.21.15.53:0/1732413523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae806f280 0x7f4ae808db80 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:00.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.289+0000 7f4aed3b5640 1 -- 172.21.15.53:0/1732413523 >> 172.21.15.53:0/1732413523 conn(0x7f4ae809ac80 msgr2=0x7f4ae806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:00.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.289+0000 7f4aed3b5640 1 -- 172.21.15.53:0/1732413523 shutdown_connections 2024-09-22T08:14:00.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.289+0000 7f4aed3b5640 1 -- 172.21.15.53:0/1732413523 wait complete. 2024-09-22T08:14:00.303 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-22T08:13:59.624505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416912,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4963,"num_read_kb":4501,"num_write":2048,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4434,"ondisk_log_size":4434,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177912,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309448,"statfs":{"total":386547056640,"available":386364874752,"internally_reserved":0,"allocated":37412864,"data_stored":36214392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004315"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208925+0000","last_change":"2024-09-22T08:10:43.175476+0000","last_active":"2024-09-22T08:11:23.208925+0000","last_peered":"2024-09-22T08:11:23.208925+0000","last_clean":"2024-09-22T08:11:23.208925+0000","last_became_active":"2024-09-22T08:10:43.174489+0000","last_became_peered":"2024-09-22T08:10:43.174489+0000","last_unstale":"2024-09-22T08:11:23.208925+0000","last_undegraded":"2024-09-22T08:11:23.208925+0000","last_fullsized":"2024-09-22T08:11:23.208925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:48.444642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037868+0000","last_change":"2024-09-22T08:10:45.180446+0000","last_active":"2024-09-22T08:11:27.037868+0000","last_peered":"2024-09-22T08:11:27.037868+0000","last_clean":"2024-09-22T08:11:27.037868+0000","last_became_active":"2024-09-22T08:10:45.179969+0000","last_became_peered":"2024-09-22T08:10:45.179969+0000","last_unstale":"2024-09-22T08:11:27.037868+0000","last_undegraded":"2024-09-22T08:11:27.037868+0000","last_fullsized":"2024-09-22T08:11:27.037868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:37.801061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223475+0000","last_change":"2024-09-22T08:10:43.187818+0000","last_active":"2024-09-22T08:11:23.223475+0000","last_peered":"2024-09-22T08:11:23.223475+0000","last_clean":"2024-09-22T08:11:23.223475+0000","last_became_active":"2024-09-22T08:10:43.187128+0000","last_became_peered":"2024-09-22T08:10:43.187128+0000","last_unstale":"2024-09-22T08:11:23.223475+0000","last_undegraded":"2024-09-22T08:11:23.223475+0000","last_fullsized":"2024-09-22T08:11:23.223475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:35.616676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210762+0000","last_change":"2024-09-22T08:10:45.170031+0000","last_active":"2024-09-22T08:11:23.210762+0000","last_peered":"2024-09-22T08:11:23.210762+0000","last_clean":"2024-09-22T08:11:23.210762+0000","last_became_active":"2024-09-22T08:10:45.169768+0000","last_became_peered":"2024-09-22T08:10:45.169768+0000","last_unstale":"2024-09-22T08:11:23.210762+0000","last_undegraded":"2024-09-22T08:11:23.210762+0000","last_fullsized":"2024-09-22T08:11:23.210762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:06.709611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.001193+0000","last_change":"2024-09-22T08:10:43.202010+0000","last_active":"2024-09-22T08:12:09.001193+0000","last_peered":"2024-09-22T08:12:09.001193+0000","last_clean":"2024-09-22T08:12:09.001193+0000","last_became_active":"2024-09-22T08:10:43.200436+0000","last_became_peered":"2024-09-22T08:10:43.200436+0000","last_unstale":"2024-09-22T08:12:09.001193+0000","last_undegraded":"2024-09-22T08:12:09.001193+0000","last_fullsized":"2024-09-22T08:12:09.001193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:53.517821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.175954+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.169110+0000","last_became_peered":"2024-09-22T08:10:45.169110+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:13.716183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.565361+0000","last_change":"2024-09-22T08:10:43.182888+0000","last_active":"2024-09-22T08:11:25.565361+0000","last_peered":"2024-09-22T08:11:25.565361+0000","last_clean":"2024-09-22T08:11:25.565361+0000","last_became_active":"2024-09-22T08:10:43.180088+0000","last_became_peered":"2024-09-22T08:10:43.180088+0000","last_unstale":"2024-09-22T08:11:25.565361+0000","last_undegraded":"2024-09-22T08:11:25.565361+0000","last_fullsized":"2024-09-22T08:11:25.565361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:17.087244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183683+0000","last_change":"2024-09-22T08:11:23.220302+0000","last_active":"2024-09-22T08:13:53.183683+0000","last_peered":"2024-09-22T08:13:53.183683+0000","last_clean":"2024-09-22T08:13:53.183683+0000","last_became_active":"2024-09-22T08:11:23.220081+0000","last_became_peered":"2024-09-22T08:11:23.220081+0000","last_unstale":"2024-09-22T08:13:53.183683+0000","last_undegraded":"2024-09-22T08:13:53.183683+0000","last_fullsized":"2024-09-22T08:13:53.183683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:33.959971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211346+0000","last_change":"2024-09-22T08:10:43.200685+0000","last_active":"2024-09-22T08:11:23.211346+0000","last_peered":"2024-09-22T08:11:23.211346+0000","last_clean":"2024-09-22T08:11:23.211346+0000","last_became_active":"2024-09-22T08:10:43.200013+0000","last_became_peered":"2024-09-22T08:10:43.200013+0000","last_unstale":"2024-09-22T08:11:23.211346+0000","last_undegraded":"2024-09-22T08:11:23.211346+0000","last_fullsized":"2024-09-22T08:11:23.211346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:43.911800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227900+0000","last_change":"2024-09-22T08:10:45.178916+0000","last_active":"2024-09-22T08:13:53.227900+0000","last_peered":"2024-09-22T08:13:53.227900+0000","last_clean":"2024-09-22T08:13:53.227900+0000","last_became_active":"2024-09-22T08:10:45.176491+0000","last_became_peered":"2024-09-22T08:10:45.176491+0000","last_unstale":"2024-09-22T08:13:53.227900+0000","last_undegraded":"2024-09-22T08:13:53.227900+0000","last_fullsized":"2024-09-22T08:13:53.227900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:10.583367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206702+0000","last_change":"2024-09-22T08:10:43.172716+0000","last_active":"2024-09-22T08:11:23.206702+0000","last_peered":"2024-09-22T08:11:23.206702+0000","last_clean":"2024-09-22T08:11:23.206702+0000","last_became_active":"2024-09-22T08:10:43.172330+0000","last_became_peered":"2024-09-22T08:10:43.172330+0000","last_unstale":"2024-09-22T08:11:23.206702+0000","last_undegraded":"2024-09-22T08:11:23.206702+0000","last_fullsized":"2024-09-22T08:11:23.206702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:17.018405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.951226+0000","last_change":"2024-09-22T08:10:45.176141+0000","last_active":"2024-09-22T08:13:52.951226+0000","last_peered":"2024-09-22T08:13:52.951226+0000","last_clean":"2024-09-22T08:13:52.951226+0000","last_became_active":"2024-09-22T08:10:45.175775+0000","last_became_peered":"2024-09-22T08:10:45.175775+0000","last_unstale":"2024-09-22T08:13:52.951226+0000","last_undegraded":"2024-09-22T08:13:52.951226+0000","last_fullsized":"2024-09-22T08:13:52.951226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:08.930275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210326+0000","last_change":"2024-09-22T08:10:43.188239+0000","last_active":"2024-09-22T08:11:23.210326+0000","last_peered":"2024-09-22T08:11:23.210326+0000","last_clean":"2024-09-22T08:11:23.210326+0000","last_became_active":"2024-09-22T08:10:43.187858+0000","last_became_peered":"2024-09-22T08:10:43.187858+0000","last_unstale":"2024-09-22T08:11:23.210326+0000","last_undegraded":"2024-09-22T08:11:23.210326+0000","last_fullsized":"2024-09-22T08:11:23.210326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:35.814525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.054945+0000","last_change":"2024-09-22T08:10:45.180145+0000","last_active":"2024-09-22T08:13:53.054945+0000","last_peered":"2024-09-22T08:13:53.054945+0000","last_clean":"2024-09-22T08:13:53.054945+0000","last_became_active":"2024-09-22T08:10:45.179870+0000","last_became_peered":"2024-09-22T08:10:45.179870+0000","last_unstale":"2024-09-22T08:13:53.054945+0000","last_undegraded":"2024-09-22T08:13:53.054945+0000","last_fullsized":"2024-09-22T08:13:53.054945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:13:33.107569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220202+0000","last_change":"2024-09-22T08:10:43.178636+0000","last_active":"2024-09-22T08:11:23.220202+0000","last_peered":"2024-09-22T08:11:23.220202+0000","last_clean":"2024-09-22T08:11:23.220202+0000","last_became_active":"2024-09-22T08:10:43.178146+0000","last_became_peered":"2024-09-22T08:10:43.178146+0000","last_unstale":"2024-09-22T08:11:23.220202+0000","last_undegraded":"2024-09-22T08:11:23.220202+0000","last_fullsized":"2024-09-22T08:11:23.220202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:37.378948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.829002+0000","last_change":"2024-09-22T08:10:45.177410+0000","last_active":"2024-09-22T08:12:08.829002+0000","last_peered":"2024-09-22T08:12:08.829002+0000","last_clean":"2024-09-22T08:12:08.829002+0000","last_became_active":"2024-09-22T08:10:45.177101+0000","last_became_peered":"2024-09-22T08:10:45.177101+0000","last_unstale":"2024-09-22T08:12:08.829002+0000","last_undegraded":"2024-09-22T08:12:08.829002+0000","last_fullsized":"2024-09-22T08:12:08.829002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:22:33.661673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828898+0000","last_change":"2024-09-22T08:10:45.170689+0000","last_active":"2024-09-22T08:12:08.828898+0000","last_peered":"2024-09-22T08:12:08.828898+0000","last_clean":"2024-09-22T08:12:08.828898+0000","last_became_active":"2024-09-22T08:10:45.169140+0000","last_became_peered":"2024-09-22T08:10:45.169140+0000","last_unstale":"2024-09-22T08:12:08.828898+0000","last_undegraded":"2024-09-22T08:12:08.828898+0000","last_fullsized":"2024-09-22T08:12:08.828898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:02.240838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.167301+0000","last_change":"2024-09-22T08:10:43.185987+0000","last_active":"2024-09-22T08:13:53.167301+0000","last_peered":"2024-09-22T08:13:53.167301+0000","last_clean":"2024-09-22T08:13:53.167301+0000","last_became_active":"2024-09-22T08:10:43.185301+0000","last_became_peered":"2024-09-22T08:10:43.185301+0000","last_unstale":"2024-09-22T08:13:53.167301+0000","last_undegraded":"2024-09-22T08:13:53.167301+0000","last_fullsized":"2024-09-22T08:13:53.167301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:21.858399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213294+0000","last_change":"2024-09-22T08:10:45.172853+0000","last_active":"2024-09-22T08:11:23.213294+0000","last_peered":"2024-09-22T08:11:23.213294+0000","last_clean":"2024-09-22T08:11:23.213294+0000","last_became_active":"2024-09-22T08:10:45.172557+0000","last_became_peered":"2024-09-22T08:10:45.172557+0000","last_unstale":"2024-09-22T08:11:23.213294+0000","last_undegraded":"2024-09-22T08:11:23.213294+0000","last_fullsized":"2024-09-22T08:11:23.213294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:38.198254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211528+0000","last_change":"2024-09-22T08:10:43.193026+0000","last_active":"2024-09-22T08:11:23.211528+0000","last_peered":"2024-09-22T08:11:23.211528+0000","last_clean":"2024-09-22T08:11:23.211528+0000","last_became_active":"2024-09-22T08:10:43.189273+0000","last_became_peered":"2024-09-22T08:10:43.189273+0000","last_unstale":"2024-09-22T08:11:23.211528+0000","last_undegraded":"2024-09-22T08:11:23.211528+0000","last_fullsized":"2024-09-22T08:11:23.211528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:52.937847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.307146+0000","last_change":"2024-09-22T08:10:45.178843+0000","last_active":"2024-09-22T08:13:53.307146+0000","last_peered":"2024-09-22T08:13:53.307146+0000","last_clean":"2024-09-22T08:13:53.307146+0000","last_became_active":"2024-09-22T08:10:45.176885+0000","last_became_peered":"2024-09-22T08:10:45.176885+0000","last_unstale":"2024-09-22T08:13:53.307146+0000","last_undegraded":"2024-09-22T08:13:53.307146+0000","last_fullsized":"2024-09-22T08:13:53.307146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:27.127106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214958+0000","last_change":"2024-09-22T08:10:43.184292+0000","last_active":"2024-09-22T08:11:23.214958+0000","last_peered":"2024-09-22T08:11:23.214958+0000","last_clean":"2024-09-22T08:11:23.214958+0000","last_became_active":"2024-09-22T08:10:43.183887+0000","last_became_peered":"2024-09-22T08:10:43.183887+0000","last_unstale":"2024-09-22T08:11:23.214958+0000","last_undegraded":"2024-09-22T08:11:23.214958+0000","last_fullsized":"2024-09-22T08:11:23.214958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:53.082618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228331+0000","last_change":"2024-09-22T08:10:45.172136+0000","last_active":"2024-09-22T08:13:53.228331+0000","last_peered":"2024-09-22T08:13:53.228331+0000","last_clean":"2024-09-22T08:13:53.228331+0000","last_became_active":"2024-09-22T08:10:45.171492+0000","last_became_peered":"2024-09-22T08:10:45.171492+0000","last_unstale":"2024-09-22T08:13:53.228331+0000","last_undegraded":"2024-09-22T08:13:53.228331+0000","last_fullsized":"2024-09-22T08:13:53.228331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:55.520692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.819194+0000","last_change":"2024-09-22T08:10:43.179557+0000","last_active":"2024-09-22T08:12:08.819194+0000","last_peered":"2024-09-22T08:12:08.819194+0000","last_clean":"2024-09-22T08:12:08.819194+0000","last_became_active":"2024-09-22T08:10:43.179133+0000","last_became_peered":"2024-09-22T08:10:43.179133+0000","last_unstale":"2024-09-22T08:12:08.819194+0000","last_undegraded":"2024-09-22T08:12:08.819194+0000","last_fullsized":"2024-09-22T08:12:08.819194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:51.687725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13,"num_write":24,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.056124+0000","last_change":"2024-09-22T08:10:45.174057+0000","last_active":"2024-09-22T08:13:53.056124+0000","last_peered":"2024-09-22T08:13:53.056124+0000","last_clean":"2024-09-22T08:13:53.056124+0000","last_became_active":"2024-09-22T08:10:45.173524+0000","last_became_peered":"2024-09-22T08:10:45.173524+0000","last_unstale":"2024-09-22T08:13:53.056124+0000","last_undegraded":"2024-09-22T08:13:53.056124+0000","last_fullsized":"2024-09-22T08:13:53.056124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:21.335898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562821+0000","last_change":"2024-09-22T08:10:43.187823+0000","last_active":"2024-09-22T08:11:25.562821+0000","last_peered":"2024-09-22T08:11:25.562821+0000","last_clean":"2024-09-22T08:11:25.562821+0000","last_became_active":"2024-09-22T08:10:43.186739+0000","last_became_peered":"2024-09-22T08:10:43.186739+0000","last_unstale":"2024-09-22T08:11:25.562821+0000","last_undegraded":"2024-09-22T08:11:25.562821+0000","last_fullsized":"2024-09-22T08:11:25.562821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:58.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037355+0000","last_change":"2024-09-22T08:10:45.172711+0000","last_active":"2024-09-22T08:11:27.037355+0000","last_peered":"2024-09-22T08:11:27.037355+0000","last_clean":"2024-09-22T08:11:27.037355+0000","last_became_active":"2024-09-22T08:10:45.170247+0000","last_became_peered":"2024-09-22T08:10:45.170247+0000","last_unstale":"2024-09-22T08:11:27.037355+0000","last_undegraded":"2024-09-22T08:11:27.037355+0000","last_fullsized":"2024-09-22T08:11:27.037355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:51.811049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562616+0000","last_change":"2024-09-22T08:10:43.191158+0000","last_active":"2024-09-22T08:11:25.562616+0000","last_peered":"2024-09-22T08:11:25.562616+0000","last_clean":"2024-09-22T08:11:25.562616+0000","last_became_active":"2024-09-22T08:10:43.190674+0000","last_became_peered":"2024-09-22T08:10:43.190674+0000","last_unstale":"2024-09-22T08:11:25.562616+0000","last_undegraded":"2024-09-22T08:11:25.562616+0000","last_fullsized":"2024-09-22T08:11:25.562616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:24.822605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.206848+0000","last_change":"2024-09-22T08:10:53.203618+0000","last_active":"2024-09-22T08:13:53.206848+0000","last_peered":"2024-09-22T08:13:53.206848+0000","last_clean":"2024-09-22T08:13:53.206848+0000","last_became_active":"2024-09-22T08:10:53.203146+0000","last_became_peered":"2024-09-22T08:10:53.203146+0000","last_unstale":"2024-09-22T08:13:53.206848+0000","last_undegraded":"2024-09-22T08:13:53.206848+0000","last_fullsized":"2024-09-22T08:13:53.206848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:09.081236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042651+0000","last_change":"2024-09-22T08:10:45.168914+0000","last_active":"2024-09-22T08:13:53.042651+0000","last_peered":"2024-09-22T08:13:53.042651+0000","last_clean":"2024-09-22T08:13:53.042651+0000","last_became_active":"2024-09-22T08:10:45.168308+0000","last_became_peered":"2024-09-22T08:10:45.168308+0000","last_unstale":"2024-09-22T08:13:53.042651+0000","last_undegraded":"2024-09-22T08:13:53.042651+0000","last_fullsized":"2024-09-22T08:13:53.042651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:33.215832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210935+0000","last_change":"2024-09-22T08:10:43.200744+0000","last_active":"2024-09-22T08:11:23.210935+0000","last_peered":"2024-09-22T08:11:23.210935+0000","last_clean":"2024-09-22T08:11:23.210935+0000","last_became_active":"2024-09-22T08:10:43.200307+0000","last_became_peered":"2024-09-22T08:10:43.200307+0000","last_unstale":"2024-09-22T08:11:23.210935+0000","last_undegraded":"2024-09-22T08:11:23.210935+0000","last_fullsized":"2024-09-22T08:11:23.210935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:05.094419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210664+0000","last_change":"2024-09-22T08:10:47.176870+0000","last_active":"2024-09-22T08:11:23.210664+0000","last_peered":"2024-09-22T08:11:23.210664+0000","last_clean":"2024-09-22T08:11:23.210664+0000","last_became_active":"2024-09-22T08:10:47.176568+0000","last_became_peered":"2024-09-22T08:10:47.176568+0000","last_unstale":"2024-09-22T08:11:23.210664+0000","last_undegraded":"2024-09-22T08:11:23.210664+0000","last_fullsized":"2024-09-22T08:11:23.210664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:55.338812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.141632+0000","last_change":"2024-09-22T08:10:49.189137+0000","last_active":"2024-09-22T08:12:51.141632+0000","last_peered":"2024-09-22T08:12:51.141632+0000","last_clean":"2024-09-22T08:12:51.141632+0000","last_became_active":"2024-09-22T08:10:49.188697+0000","last_became_peered":"2024-09-22T08:10:49.188697+0000","last_unstale":"2024-09-22T08:12:51.141632+0000","last_undegraded":"2024-09-22T08:12:51.141632+0000","last_fullsized":"2024-09-22T08:12:51.141632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:20.077797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216659+0000","last_change":"2024-09-22T08:10:51.202175+0000","last_active":"2024-09-22T08:11:23.216659+0000","last_peered":"2024-09-22T08:11:23.216659+0000","last_clean":"2024-09-22T08:11:23.216659+0000","last_became_active":"2024-09-22T08:10:51.201855+0000","last_became_peered":"2024-09-22T08:10:51.201855+0000","last_unstale":"2024-09-22T08:11:23.216659+0000","last_undegraded":"2024-09-22T08:11:23.216659+0000","last_fullsized":"2024-09-22T08:11:23.216659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'11","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.833839+0000","last_change":"2024-09-22T08:10:53.204685+0000","last_active":"2024-09-22T08:12:08.833839+0000","last_peered":"2024-09-22T08:12:08.833839+0000","last_clean":"2024-09-22T08:12:08.833839+0000","last_became_active":"2024-09-22T08:10:53.204407+0000","last_became_peered":"2024-09-22T08:10:53.204407+0000","last_unstale":"2024-09-22T08:12:08.833839+0000","last_undegraded":"2024-09-22T08:12:08.833839+0000","last_fullsized":"2024-09-22T08:12:08.833839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:07.954674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'16","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.261467+0000","last_change":"2024-09-22T08:10:45.171230+0000","last_active":"2024-09-22T08:13:53.261467+0000","last_peered":"2024-09-22T08:13:53.261467+0000","last_clean":"2024-09-22T08:13:53.261467+0000","last_became_active":"2024-09-22T08:10:45.170765+0000","last_became_peered":"2024-09-22T08:10:45.170765+0000","last_unstale":"2024-09-22T08:13:53.261467+0000","last_undegraded":"2024-09-22T08:13:53.261467+0000","last_fullsized":"2024-09-22T08:13:53.261467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:18.560588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206421+0000","last_change":"2024-09-22T08:10:43.180996+0000","last_active":"2024-09-22T08:11:23.206421+0000","last_peered":"2024-09-22T08:11:23.206421+0000","last_clean":"2024-09-22T08:11:23.206421+0000","last_became_active":"2024-09-22T08:10:43.180600+0000","last_became_peered":"2024-09-22T08:10:43.180600+0000","last_unstale":"2024-09-22T08:11:23.206421+0000","last_undegraded":"2024-09-22T08:11:23.206421+0000","last_fullsized":"2024-09-22T08:11:23.206421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:21.162231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221157+0000","last_change":"2024-09-22T08:10:47.168270+0000","last_active":"2024-09-22T08:11:23.221157+0000","last_peered":"2024-09-22T08:11:23.221157+0000","last_clean":"2024-09-22T08:11:23.221157+0000","last_became_active":"2024-09-22T08:10:47.167913+0000","last_became_peered":"2024-09-22T08:10:47.167913+0000","last_unstale":"2024-09-22T08:11:23.221157+0000","last_undegraded":"2024-09-22T08:11:23.221157+0000","last_fullsized":"2024-09-22T08:11:23.221157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:42.817181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216231+0000","last_change":"2024-09-22T08:10:49.182777+0000","last_active":"2024-09-22T08:11:23.216231+0000","last_peered":"2024-09-22T08:11:23.216231+0000","last_clean":"2024-09-22T08:11:23.216231+0000","last_became_active":"2024-09-22T08:10:49.182481+0000","last_became_peered":"2024-09-22T08:10:49.182481+0000","last_unstale":"2024-09-22T08:11:23.216231+0000","last_undegraded":"2024-09-22T08:11:23.216231+0000","last_fullsized":"2024-09-22T08:11:23.216231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:56.405074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.215699+0000","last_change":"2024-09-22T08:10:51.200151+0000","last_active":"2024-09-22T08:11:23.215699+0000","last_peered":"2024-09-22T08:11:23.215699+0000","last_clean":"2024-09-22T08:11:23.215699+0000","last_became_active":"2024-09-22T08:10:51.199837+0000","last_became_peered":"2024-09-22T08:10:51.199837+0000","last_unstale":"2024-09-22T08:11:23.215699+0000","last_undegraded":"2024-09-22T08:11:23.215699+0000","last_fullsized":"2024-09-22T08:11:23.215699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220094+0000","last_change":"2024-09-22T08:10:53.199608+0000","last_active":"2024-09-22T08:11:23.220094+0000","last_peered":"2024-09-22T08:11:23.220094+0000","last_clean":"2024-09-22T08:11:23.220094+0000","last_became_active":"2024-09-22T08:10:53.199303+0000","last_became_peered":"2024-09-22T08:10:53.199303+0000","last_unstale":"2024-09-22T08:11:23.220094+0000","last_undegraded":"2024-09-22T08:11:23.220094+0000","last_fullsized":"2024-09-22T08:11:23.220094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:27.339830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228089+0000","last_change":"2024-09-22T08:10:45.169254+0000","last_active":"2024-09-22T08:13:53.228089+0000","last_peered":"2024-09-22T08:13:53.228089+0000","last_clean":"2024-09-22T08:13:53.228089+0000","last_became_active":"2024-09-22T08:10:45.168554+0000","last_became_peered":"2024-09-22T08:10:45.168554+0000","last_unstale":"2024-09-22T08:13:53.228089+0000","last_undegraded":"2024-09-22T08:13:53.228089+0000","last_fullsized":"2024-09-22T08:13:53.228089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:25.135787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.932991+0000","last_change":"2024-09-22T08:10:43.189688+0000","last_active":"2024-09-22T08:13:52.932991+0000","last_peered":"2024-09-22T08:13:52.932991+0000","last_clean":"2024-09-22T08:13:52.932991+0000","last_became_active":"2024-09-22T08:10:43.189333+0000","last_became_peered":"2024-09-22T08:10:43.189333+0000","last_unstale":"2024-09-22T08:13:52.932991+0000","last_undegraded":"2024-09-22T08:13:52.932991+0000","last_fullsized":"2024-09-22T08:13:52.932991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:30.638919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223891+0000","last_change":"2024-09-22T08:10:47.176263+0000","last_active":"2024-09-22T08:11:23.223891+0000","last_peered":"2024-09-22T08:11:23.223891+0000","last_clean":"2024-09-22T08:11:23.223891+0000","last_became_active":"2024-09-22T08:10:47.175959+0000","last_became_peered":"2024-09-22T08:10:47.175959+0000","last_unstale":"2024-09-22T08:11:23.223891+0000","last_undegraded":"2024-09-22T08:11:23.223891+0000","last_fullsized":"2024-09-22T08:11:23.223891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:44.259414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207630+0000","last_change":"2024-09-22T08:10:49.185591+0000","last_active":"2024-09-22T08:11:23.207630+0000","last_peered":"2024-09-22T08:11:23.207630+0000","last_clean":"2024-09-22T08:11:23.207630+0000","last_became_active":"2024-09-22T08:10:49.185269+0000","last_became_peered":"2024-09-22T08:10:49.185269+0000","last_unstale":"2024-09-22T08:11:23.207630+0000","last_undegraded":"2024-09-22T08:11:23.207630+0000","last_fullsized":"2024-09-22T08:11:23.207630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.872968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":382,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254422+0000","last_change":"2024-09-22T08:10:51.196489+0000","last_active":"2024-09-22T08:13:52.254422+0000","last_peered":"2024-09-22T08:13:52.254422+0000","last_clean":"2024-09-22T08:13:52.254422+0000","last_became_active":"2024-09-22T08:10:51.196199+0000","last_became_peered":"2024-09-22T08:10:51.196199+0000","last_unstale":"2024-09-22T08:13:52.254422+0000","last_undegraded":"2024-09-22T08:13:52.254422+0000","last_fullsized":"2024-09-22T08:13:52.254422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:26.614683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.217337+0000","last_change":"2024-09-22T08:10:53.194394+0000","last_active":"2024-09-22T08:13:53.217337+0000","last_peered":"2024-09-22T08:13:53.217337+0000","last_clean":"2024-09-22T08:13:53.217337+0000","last_became_active":"2024-09-22T08:10:53.194118+0000","last_became_peered":"2024-09-22T08:10:53.194118+0000","last_unstale":"2024-09-22T08:13:53.217337+0000","last_undegraded":"2024-09-22T08:13:53.217337+0000","last_fullsized":"2024-09-22T08:13:53.217337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:00.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.234003+0000","last_change":"2024-09-22T08:10:45.183666+0000","last_active":"2024-09-22T08:13:53.234003+0000","last_peered":"2024-09-22T08:13:53.234003+0000","last_clean":"2024-09-22T08:13:53.234003+0000","last_became_active":"2024-09-22T08:10:45.183307+0000","last_became_peered":"2024-09-22T08:10:45.183307+0000","last_unstale":"2024-09-22T08:13:53.234003+0000","last_undegraded":"2024-09-22T08:13:53.234003+0000","last_fullsized":"2024-09-22T08:13:53.234003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:58.141567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211089+0000","last_change":"2024-09-22T08:10:43.188519+0000","last_active":"2024-09-22T08:11:23.211089+0000","last_peered":"2024-09-22T08:11:23.211089+0000","last_clean":"2024-09-22T08:11:23.211089+0000","last_became_active":"2024-09-22T08:10:43.187835+0000","last_became_peered":"2024-09-22T08:10:43.187835+0000","last_unstale":"2024-09-22T08:11:23.211089+0000","last_undegraded":"2024-09-22T08:11:23.211089+0000","last_fullsized":"2024-09-22T08:11:23.211089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:29.246042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211282+0000","last_change":"2024-09-22T08:10:47.175684+0000","last_active":"2024-09-22T08:11:23.211282+0000","last_peered":"2024-09-22T08:11:23.211282+0000","last_clean":"2024-09-22T08:11:23.211282+0000","last_became_active":"2024-09-22T08:10:47.175386+0000","last_became_peered":"2024-09-22T08:10:47.175386+0000","last_unstale":"2024-09-22T08:11:23.211282+0000","last_undegraded":"2024-09-22T08:11:23.211282+0000","last_fullsized":"2024-09-22T08:11:23.211282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:48.587319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.136350+0000","last_change":"2024-09-22T08:10:49.185291+0000","last_active":"2024-09-22T08:12:51.136350+0000","last_peered":"2024-09-22T08:12:51.136350+0000","last_clean":"2024-09-22T08:12:51.136350+0000","last_became_active":"2024-09-22T08:10:49.184963+0000","last_became_peered":"2024-09-22T08:10:49.184963+0000","last_unstale":"2024-09-22T08:12:51.136350+0000","last_undegraded":"2024-09-22T08:12:51.136350+0000","last_fullsized":"2024-09-22T08:12:51.136350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:53.469586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":442,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.257784+0000","last_change":"2024-09-22T08:10:51.193999+0000","last_active":"2024-09-22T08:13:53.257784+0000","last_peered":"2024-09-22T08:13:53.257784+0000","last_clean":"2024-09-22T08:13:53.257784+0000","last_became_active":"2024-09-22T08:10:51.193678+0000","last_became_peered":"2024-09-22T08:10:51.193678+0000","last_unstale":"2024-09-22T08:13:53.257784+0000","last_undegraded":"2024-09-22T08:13:53.257784+0000","last_fullsized":"2024-09-22T08:13:53.257784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.950936+0000","last_change":"2024-09-22T08:10:45.184006+0000","last_active":"2024-09-22T08:13:52.950936+0000","last_peered":"2024-09-22T08:13:52.950936+0000","last_clean":"2024-09-22T08:13:52.950936+0000","last_became_active":"2024-09-22T08:10:45.183598+0000","last_became_peered":"2024-09-22T08:10:45.183598+0000","last_unstale":"2024-09-22T08:13:52.950936+0000","last_undegraded":"2024-09-22T08:13:52.950936+0000","last_fullsized":"2024-09-22T08:13:52.950936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:42.041157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208676+0000","last_change":"2024-09-22T08:10:43.175203+0000","last_active":"2024-09-22T08:11:23.208676+0000","last_peered":"2024-09-22T08:11:23.208676+0000","last_clean":"2024-09-22T08:11:23.208676+0000","last_became_active":"2024-09-22T08:10:43.173543+0000","last_became_peered":"2024-09-22T08:10:43.173543+0000","last_unstale":"2024-09-22T08:11:23.208676+0000","last_undegraded":"2024-09-22T08:11:23.208676+0000","last_fullsized":"2024-09-22T08:11:23.208676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:49.711451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212481+0000","last_change":"2024-09-22T08:10:47.176921+0000","last_active":"2024-09-22T08:11:23.212481+0000","last_peered":"2024-09-22T08:11:23.212481+0000","last_clean":"2024-09-22T08:11:23.212481+0000","last_became_active":"2024-09-22T08:10:47.176657+0000","last_became_peered":"2024-09-22T08:10:47.176657+0000","last_unstale":"2024-09-22T08:11:23.212481+0000","last_undegraded":"2024-09-22T08:11:23.212481+0000","last_fullsized":"2024-09-22T08:11:23.212481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:32.681711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.145964+0000","last_change":"2024-09-22T08:10:49.184460+0000","last_active":"2024-09-22T08:12:51.145964+0000","last_peered":"2024-09-22T08:12:51.145964+0000","last_clean":"2024-09-22T08:12:51.145964+0000","last_became_active":"2024-09-22T08:10:49.182985+0000","last_became_peered":"2024-09-22T08:10:49.182985+0000","last_unstale":"2024-09-22T08:12:51.145964+0000","last_undegraded":"2024-09-22T08:12:51.145964+0000","last_fullsized":"2024-09-22T08:12:51.145964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:56.307814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222432+0000","last_change":"2024-09-22T08:10:51.193335+0000","last_active":"2024-09-22T08:11:23.222432+0000","last_peered":"2024-09-22T08:11:23.222432+0000","last_clean":"2024-09-22T08:11:23.222432+0000","last_became_active":"2024-09-22T08:10:51.192623+0000","last_became_peered":"2024-09-22T08:10:51.192623+0000","last_unstale":"2024-09-22T08:11:23.222432+0000","last_undegraded":"2024-09-22T08:11:23.222432+0000","last_fullsized":"2024-09-22T08:11:23.222432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.835562+0000","last_change":"2024-09-22T08:10:53.198555+0000","last_active":"2024-09-22T08:12:08.835562+0000","last_peered":"2024-09-22T08:12:08.835562+0000","last_clean":"2024-09-22T08:12:08.835562+0000","last_became_active":"2024-09-22T08:10:53.198219+0000","last_became_peered":"2024-09-22T08:10:53.198219+0000","last_unstale":"2024-09-22T08:12:08.835562+0000","last_undegraded":"2024-09-22T08:12:08.835562+0000","last_fullsized":"2024-09-22T08:12:08.835562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:04.308739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213131+0000","last_change":"2024-09-22T08:10:45.172178+0000","last_active":"2024-09-22T08:11:23.213131+0000","last_peered":"2024-09-22T08:11:23.213131+0000","last_clean":"2024-09-22T08:11:23.213131+0000","last_became_active":"2024-09-22T08:10:45.171911+0000","last_became_peered":"2024-09-22T08:10:45.171911+0000","last_unstale":"2024-09-22T08:11:23.213131+0000","last_undegraded":"2024-09-22T08:11:23.213131+0000","last_fullsized":"2024-09-22T08:11:23.213131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:57.459714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210955+0000","last_change":"2024-09-22T08:10:43.193335+0000","last_active":"2024-09-22T08:11:23.210955+0000","last_peered":"2024-09-22T08:11:23.210955+0000","last_clean":"2024-09-22T08:11:23.210955+0000","last_became_active":"2024-09-22T08:10:43.189780+0000","last_became_peered":"2024-09-22T08:10:43.189780+0000","last_unstale":"2024-09-22T08:11:23.210955+0000","last_undegraded":"2024-09-22T08:11:23.210955+0000","last_fullsized":"2024-09-22T08:11:23.210955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:29.886101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220270+0000","last_change":"2024-09-22T08:10:47.177997+0000","last_active":"2024-09-22T08:11:23.220270+0000","last_peered":"2024-09-22T08:11:23.220270+0000","last_clean":"2024-09-22T08:11:23.220270+0000","last_became_active":"2024-09-22T08:10:47.177695+0000","last_became_peered":"2024-09-22T08:10:47.177695+0000","last_unstale":"2024-09-22T08:11:23.220270+0000","last_undegraded":"2024-09-22T08:11:23.220270+0000","last_fullsized":"2024-09-22T08:11:23.220270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:09.326387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.125298+0000","last_change":"2024-09-22T08:10:49.185696+0000","last_active":"2024-09-22T08:12:51.125298+0000","last_peered":"2024-09-22T08:12:51.125298+0000","last_clean":"2024-09-22T08:12:51.125298+0000","last_became_active":"2024-09-22T08:10:49.185419+0000","last_became_peered":"2024-09-22T08:10:49.185419+0000","last_unstale":"2024-09-22T08:12:51.125298+0000","last_undegraded":"2024-09-22T08:12:51.125298+0000","last_fullsized":"2024-09-22T08:12:51.125298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:57.299371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221426+0000","last_change":"2024-09-22T08:10:51.202896+0000","last_active":"2024-09-22T08:11:23.221426+0000","last_peered":"2024-09-22T08:11:23.221426+0000","last_clean":"2024-09-22T08:11:23.221426+0000","last_became_active":"2024-09-22T08:10:51.202564+0000","last_became_peered":"2024-09-22T08:10:51.202564+0000","last_unstale":"2024-09-22T08:11:23.221426+0000","last_undegraded":"2024-09-22T08:11:23.221426+0000","last_fullsized":"2024-09-22T08:11:23.221426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:58.270948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:03.306650+0000","last_change":"2024-09-22T08:10:53.196844+0000","last_active":"2024-09-22T08:12:03.306650+0000","last_peered":"2024-09-22T08:12:03.306650+0000","last_clean":"2024-09-22T08:12:03.306650+0000","last_became_active":"2024-09-22T08:10:53.196392+0000","last_became_peered":"2024-09-22T08:10:53.196392+0000","last_unstale":"2024-09-22T08:12:03.306650+0000","last_undegraded":"2024-09-22T08:12:03.306650+0000","last_fullsized":"2024-09-22T08:12:03.306650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:30.239443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207308+0000","last_change":"2024-09-22T08:10:45.177813+0000","last_active":"2024-09-22T08:11:23.207308+0000","last_peered":"2024-09-22T08:11:23.207308+0000","last_clean":"2024-09-22T08:11:23.207308+0000","last_became_active":"2024-09-22T08:10:45.177530+0000","last_became_peered":"2024-09-22T08:10:45.177530+0000","last_unstale":"2024-09-22T08:11:23.207308+0000","last_undegraded":"2024-09-22T08:11:23.207308+0000","last_fullsized":"2024-09-22T08:11:23.207308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:03.255386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213304+0000","last_change":"2024-09-22T08:10:43.202319+0000","last_active":"2024-09-22T08:11:23.213304+0000","last_peered":"2024-09-22T08:11:23.213304+0000","last_clean":"2024-09-22T08:11:23.213304+0000","last_became_active":"2024-09-22T08:10:43.201669+0000","last_became_peered":"2024-09-22T08:10:43.201669+0000","last_unstale":"2024-09-22T08:11:23.213304+0000","last_undegraded":"2024-09-22T08:11:23.213304+0000","last_fullsized":"2024-09-22T08:11:23.213304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:18.648215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221742+0000","last_change":"2024-09-22T08:10:47.177950+0000","last_active":"2024-09-22T08:11:23.221742+0000","last_peered":"2024-09-22T08:11:23.221742+0000","last_clean":"2024-09-22T08:11:23.221742+0000","last_became_active":"2024-09-22T08:10:47.177613+0000","last_became_peered":"2024-09-22T08:10:47.177613+0000","last_unstale":"2024-09-22T08:11:23.221742+0000","last_undegraded":"2024-09-22T08:11:23.221742+0000","last_fullsized":"2024-09-22T08:11:23.221742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:26.919515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.147891+0000","last_change":"2024-09-22T08:10:49.187229+0000","last_active":"2024-09-22T08:12:51.147891+0000","last_peered":"2024-09-22T08:12:51.147891+0000","last_clean":"2024-09-22T08:12:51.147891+0000","last_became_active":"2024-09-22T08:10:49.186941+0000","last_became_peered":"2024-09-22T08:10:49.186941+0000","last_unstale":"2024-09-22T08:12:51.147891+0000","last_undegraded":"2024-09-22T08:12:51.147891+0000","last_fullsized":"2024-09-22T08:12:51.147891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:28.645390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":349,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.372929+0000","last_change":"2024-09-22T08:10:51.192885+0000","last_active":"2024-09-22T08:13:53.372929+0000","last_peered":"2024-09-22T08:13:53.372929+0000","last_clean":"2024-09-22T08:13:53.372929+0000","last_became_active":"2024-09-22T08:10:51.192483+0000","last_became_peered":"2024-09-22T08:10:51.192483+0000","last_unstale":"2024-09-22T08:13:53.372929+0000","last_undegraded":"2024-09-22T08:13:53.372929+0000","last_fullsized":"2024-09-22T08:13:53.372929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:47.260805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222488+0000","last_change":"2024-09-22T08:10:53.199613+0000","last_active":"2024-09-22T08:11:23.222488+0000","last_peered":"2024-09-22T08:11:23.222488+0000","last_clean":"2024-09-22T08:11:23.222488+0000","last_became_active":"2024-09-22T08:10:53.199273+0000","last_became_peered":"2024-09-22T08:10:53.199273+0000","last_unstale":"2024-09-22T08:11:23.222488+0000","last_undegraded":"2024-09-22T08:11:23.222488+0000","last_fullsized":"2024-09-22T08:11:23.222488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:07.308140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183660+0000","last_change":"2024-09-22T08:10:45.165644+0000","last_active":"2024-09-22T08:13:53.183660+0000","last_peered":"2024-09-22T08:13:53.183660+0000","last_clean":"2024-09-22T08:13:53.183660+0000","last_became_active":"2024-09-22T08:10:45.165352+0000","last_became_peered":"2024-09-22T08:10:45.165352+0000","last_unstale":"2024-09-22T08:13:53.183660+0000","last_undegraded":"2024-09-22T08:13:53.183660+0000","last_fullsized":"2024-09-22T08:13:53.183660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:15.188589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211087+0000","last_change":"2024-09-22T08:10:43.199804+0000","last_active":"2024-09-22T08:11:23.211087+0000","last_peered":"2024-09-22T08:11:23.211087+0000","last_clean":"2024-09-22T08:11:23.211087+0000","last_became_active":"2024-09-22T08:10:43.198696+0000","last_became_peered":"2024-09-22T08:10:43.198696+0000","last_unstale":"2024-09-22T08:11:23.211087+0000","last_undegraded":"2024-09-22T08:11:23.211087+0000","last_fullsized":"2024-09-22T08:11:23.211087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:50.899075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220881+0000","last_change":"2024-09-22T08:10:47.176680+0000","last_active":"2024-09-22T08:11:23.220881+0000","last_peered":"2024-09-22T08:11:23.220881+0000","last_clean":"2024-09-22T08:11:23.220881+0000","last_became_active":"2024-09-22T08:10:47.176263+0000","last_became_peered":"2024-09-22T08:10:47.176263+0000","last_unstale":"2024-09-22T08:11:23.220881+0000","last_undegraded":"2024-09-22T08:11:23.220881+0000","last_fullsized":"2024-09-22T08:11:23.220881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:38.640214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.150072+0000","last_change":"2024-09-22T08:10:49.189658+0000","last_active":"2024-09-22T08:12:51.150072+0000","last_peered":"2024-09-22T08:12:51.150072+0000","last_clean":"2024-09-22T08:12:51.150072+0000","last_became_active":"2024-09-22T08:10:49.188724+0000","last_became_peered":"2024-09-22T08:10:49.188724+0000","last_unstale":"2024-09-22T08:12:51.150072+0000","last_undegraded":"2024-09-22T08:12:51.150072+0000","last_fullsized":"2024-09-22T08:12:51.150072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:49.620069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220087+0000","last_change":"2024-09-22T08:10:51.195268+0000","last_active":"2024-09-22T08:11:23.220087+0000","last_peered":"2024-09-22T08:11:23.220087+0000","last_clean":"2024-09-22T08:11:23.220087+0000","last_became_active":"2024-09-22T08:10:51.194937+0000","last_became_peered":"2024-09-22T08:10:51.194937+0000","last_unstale":"2024-09-22T08:11:23.220087+0000","last_undegraded":"2024-09-22T08:11:23.220087+0000","last_fullsized":"2024-09-22T08:11:23.220087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.350209+0000","last_change":"2024-09-22T08:10:53.201595+0000","last_active":"2024-09-22T08:13:53.350209+0000","last_peered":"2024-09-22T08:13:53.350209+0000","last_clean":"2024-09-22T08:13:53.350209+0000","last_became_active":"2024-09-22T08:10:53.201289+0000","last_became_peered":"2024-09-22T08:10:53.201289+0000","last_unstale":"2024-09-22T08:13:53.350209+0000","last_undegraded":"2024-09-22T08:13:53.350209+0000","last_fullsized":"2024-09-22T08:13:53.350209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:22.640385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.468134+0000","last_change":"2024-09-22T08:10:45.181031+0000","last_active":"2024-09-22T08:12:49.468134+0000","last_peered":"2024-09-22T08:12:49.468134+0000","last_clean":"2024-09-22T08:12:49.468134+0000","last_became_active":"2024-09-22T08:10:45.180762+0000","last_became_peered":"2024-09-22T08:10:45.180762+0000","last_unstale":"2024-09-22T08:12:49.468134+0000","last_undegraded":"2024-09-22T08:12:49.468134+0000","last_fullsized":"2024-09-22T08:12:49.468134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:39.170953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562819+0000","last_change":"2024-09-22T08:10:43.177974+0000","last_active":"2024-09-22T08:11:25.562819+0000","last_peered":"2024-09-22T08:11:25.562819+0000","last_clean":"2024-09-22T08:11:25.562819+0000","last_became_active":"2024-09-22T08:10:43.177202+0000","last_became_peered":"2024-09-22T08:10:43.177202+0000","last_unstale":"2024-09-22T08:11:25.562819+0000","last_undegraded":"2024-09-22T08:11:25.562819+0000","last_fullsized":"2024-09-22T08:11:25.562819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:21.858399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207951+0000","last_change":"2024-09-22T08:10:47.173920+0000","last_active":"2024-09-22T08:11:23.207951+0000","last_peered":"2024-09-22T08:11:23.207951+0000","last_clean":"2024-09-22T08:11:23.207951+0000","last_became_active":"2024-09-22T08:10:47.173636+0000","last_became_peered":"2024-09-22T08:10:47.173636+0000","last_unstale":"2024-09-22T08:11:23.207951+0000","last_undegraded":"2024-09-22T08:11:23.207951+0000","last_fullsized":"2024-09-22T08:11:23.207951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:07.844753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.129598+0000","last_change":"2024-09-22T08:10:49.175235+0000","last_active":"2024-09-22T08:12:51.129598+0000","last_peered":"2024-09-22T08:12:51.129598+0000","last_clean":"2024-09-22T08:12:51.129598+0000","last_became_active":"2024-09-22T08:10:49.174933+0000","last_became_peered":"2024-09-22T08:10:49.174933+0000","last_unstale":"2024-09-22T08:12:51.129598+0000","last_undegraded":"2024-09-22T08:12:51.129598+0000","last_fullsized":"2024-09-22T08:12:51.129598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:09.101942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212489+0000","last_change":"2024-09-22T08:10:51.195590+0000","last_active":"2024-09-22T08:11:23.212489+0000","last_peered":"2024-09-22T08:11:23.212489+0000","last_clean":"2024-09-22T08:11:23.212489+0000","last_became_active":"2024-09-22T08:10:51.195308+0000","last_became_peered":"2024-09-22T08:10:51.195308+0000","last_unstale":"2024-09-22T08:11:23.212489+0000","last_undegraded":"2024-09-22T08:11:23.212489+0000","last_fullsized":"2024-09-22T08:11:23.212489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:13.979616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584694+0000","last_change":"2024-09-22T08:10:53.201429+0000","last_active":"2024-09-22T08:12:52.584694+0000","last_peered":"2024-09-22T08:12:52.584694+0000","last_clean":"2024-09-22T08:12:52.584694+0000","last_became_active":"2024-09-22T08:10:53.200458+0000","last_became_peered":"2024-09-22T08:10:53.200458+0000","last_unstale":"2024-09-22T08:12:52.584694+0000","last_undegraded":"2024-09-22T08:12:52.584694+0000","last_fullsized":"2024-09-22T08:12:52.584694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:15.839331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:02.586743+0000","last_change":"2024-09-22T08:10:45.183532+0000","last_active":"2024-09-22T08:13:02.586743+0000","last_peered":"2024-09-22T08:13:02.586743+0000","last_clean":"2024-09-22T08:13:02.586743+0000","last_became_active":"2024-09-22T08:10:45.183258+0000","last_became_peered":"2024-09-22T08:10:45.183258+0000","last_unstale":"2024-09-22T08:13:02.586743+0000","last_undegraded":"2024-09-22T08:13:02.586743+0000","last_fullsized":"2024-09-22T08:13:02.586743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:38.687579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213355+0000","last_change":"2024-09-22T08:10:43.197491+0000","last_active":"2024-09-22T08:11:23.213355+0000","last_peered":"2024-09-22T08:11:23.213355+0000","last_clean":"2024-09-22T08:11:23.213355+0000","last_became_active":"2024-09-22T08:10:43.195959+0000","last_became_peered":"2024-09-22T08:10:43.195959+0000","last_unstale":"2024-09-22T08:11:23.213355+0000","last_undegraded":"2024-09-22T08:11:23.213355+0000","last_fullsized":"2024-09-22T08:11:23.213355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:31.630549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216166+0000","last_change":"2024-09-22T08:11:23.215294+0000","last_active":"2024-09-22T08:11:23.216166+0000","last_peered":"2024-09-22T08:11:23.216166+0000","last_clean":"2024-09-22T08:11:23.216166+0000","last_became_active":"2024-09-22T08:11:23.214959+0000","last_became_peered":"2024-09-22T08:11:23.214959+0000","last_unstale":"2024-09-22T08:11:23.216166+0000","last_undegraded":"2024-09-22T08:11:23.216166+0000","last_fullsized":"2024-09-22T08:11:23.216166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:50.116285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.156739+0000","last_change":"2024-09-22T08:10:49.181291+0000","last_active":"2024-09-22T08:12:51.156739+0000","last_peered":"2024-09-22T08:12:51.156739+0000","last_clean":"2024-09-22T08:12:51.156739+0000","last_became_active":"2024-09-22T08:10:49.180820+0000","last_became_peered":"2024-09-22T08:10:49.180820+0000","last_unstale":"2024-09-22T08:12:51.156739+0000","last_undegraded":"2024-09-22T08:12:51.156739+0000","last_fullsized":"2024-09-22T08:12:51.156739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:56.059910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":432,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.353982+0000","last_change":"2024-09-22T08:10:51.197307+0000","last_active":"2024-09-22T08:13:53.353982+0000","last_peered":"2024-09-22T08:13:53.353982+0000","last_clean":"2024-09-22T08:13:53.353982+0000","last_became_active":"2024-09-22T08:10:51.197020+0000","last_became_peered":"2024-09-22T08:10:51.197020+0000","last_unstale":"2024-09-22T08:13:53.353982+0000","last_undegraded":"2024-09-22T08:13:53.353982+0000","last_fullsized":"2024-09-22T08:13:53.353982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:39.376197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:01.585334+0000","last_change":"2024-09-22T08:10:53.192873+0000","last_active":"2024-09-22T08:13:01.585334+0000","last_peered":"2024-09-22T08:13:01.585334+0000","last_clean":"2024-09-22T08:13:01.585334+0000","last_became_active":"2024-09-22T08:10:53.192481+0000","last_became_peered":"2024-09-22T08:10:53.192481+0000","last_unstale":"2024-09-22T08:13:01.585334+0000","last_undegraded":"2024-09-22T08:13:01.585334+0000","last_fullsized":"2024-09-22T08:13:01.585334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:06.451090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183469+0000","last_change":"2024-09-22T08:10:45.173005+0000","last_active":"2024-09-22T08:13:53.183469+0000","last_peered":"2024-09-22T08:13:53.183469+0000","last_clean":"2024-09-22T08:13:53.183469+0000","last_became_active":"2024-09-22T08:10:45.172740+0000","last_became_peered":"2024-09-22T08:10:45.172740+0000","last_unstale":"2024-09-22T08:13:53.183469+0000","last_undegraded":"2024-09-22T08:13:53.183469+0000","last_fullsized":"2024-09-22T08:13:53.183469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:20.794542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212966+0000","last_change":"2024-09-22T08:10:43.195715+0000","last_active":"2024-09-22T08:11:23.212966+0000","last_peered":"2024-09-22T08:11:23.212966+0000","last_clean":"2024-09-22T08:11:23.212966+0000","last_became_active":"2024-09-22T08:10:43.195355+0000","last_became_peered":"2024-09-22T08:10:43.195355+0000","last_unstale":"2024-09-22T08:11:23.212966+0000","last_undegraded":"2024-09-22T08:11:23.212966+0000","last_fullsized":"2024-09-22T08:11:23.212966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:01.525176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":426,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.224617+0000","last_change":"2024-09-22T08:11:23.229177+0000","last_active":"2024-09-22T08:12:52.224617+0000","last_peered":"2024-09-22T08:12:52.224617+0000","last_clean":"2024-09-22T08:12:52.224617+0000","last_became_active":"2024-09-22T08:11:23.221981+0000","last_became_peered":"2024-09-22T08:11:23.221981+0000","last_unstale":"2024-09-22T08:12:52.224617+0000","last_undegraded":"2024-09-22T08:12:52.224617+0000","last_fullsized":"2024-09-22T08:12:52.224617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:00.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213610+0000","last_change":"2024-09-22T08:10:49.188917+0000","last_active":"2024-09-22T08:11:23.213610+0000","last_peered":"2024-09-22T08:11:23.213610+0000","last_clean":"2024-09-22T08:11:23.213610+0000","last_became_active":"2024-09-22T08:10:49.188444+0000","last_became_peered":"2024-09-22T08:10:49.188444+0000","last_unstale":"2024-09-22T08:11:23.213610+0000","last_undegraded":"2024-09-22T08:11:23.213610+0000","last_fullsized":"2024-09-22T08:11:23.213610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:27.352744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":469,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.310805+0000","last_change":"2024-09-22T08:10:51.197818+0000","last_active":"2024-09-22T08:13:53.310805+0000","last_peered":"2024-09-22T08:13:53.310805+0000","last_clean":"2024-09-22T08:13:53.310805+0000","last_became_active":"2024-09-22T08:10:51.197248+0000","last_became_peered":"2024-09-22T08:10:51.197248+0000","last_unstale":"2024-09-22T08:13:53.310805+0000","last_undegraded":"2024-09-22T08:13:53.310805+0000","last_fullsized":"2024-09-22T08:13:53.310805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.360311+0000","last_change":"2024-09-22T08:10:53.195875+0000","last_active":"2024-09-22T08:12:52.360311+0000","last_peered":"2024-09-22T08:12:52.360311+0000","last_clean":"2024-09-22T08:12:52.360311+0000","last_became_active":"2024-09-22T08:10:53.195539+0000","last_became_peered":"2024-09-22T08:10:53.195539+0000","last_unstale":"2024-09-22T08:12:52.360311+0000","last_undegraded":"2024-09-22T08:12:52.360311+0000","last_fullsized":"2024-09-22T08:12:52.360311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:10.933920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254832+0000","last_change":"2024-09-22T08:11:23.226070+0000","last_active":"2024-09-22T08:13:53.254832+0000","last_peered":"2024-09-22T08:13:53.254832+0000","last_clean":"2024-09-22T08:13:53.254832+0000","last_became_active":"2024-09-22T08:11:23.220943+0000","last_became_peered":"2024-09-22T08:11:23.220943+0000","last_unstale":"2024-09-22T08:13:53.254832+0000","last_undegraded":"2024-09-22T08:13:53.254832+0000","last_fullsized":"2024-09-22T08:13:53.254832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:18.981650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.249213+0000","last_change":"2024-09-22T08:10:43.198294+0000","last_active":"2024-09-22T08:13:53.249213+0000","last_peered":"2024-09-22T08:13:53.249213+0000","last_clean":"2024-09-22T08:13:53.249213+0000","last_became_active":"2024-09-22T08:10:43.196211+0000","last_became_peered":"2024-09-22T08:10:43.196211+0000","last_unstale":"2024-09-22T08:13:53.249213+0000","last_undegraded":"2024-09-22T08:13:53.249213+0000","last_fullsized":"2024-09-22T08:13:53.249213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:16.704599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211379+0000","last_change":"2024-09-22T08:10:47.177015+0000","last_active":"2024-09-22T08:11:23.211379+0000","last_peered":"2024-09-22T08:11:23.211379+0000","last_clean":"2024-09-22T08:11:23.211379+0000","last_became_active":"2024-09-22T08:10:47.176634+0000","last_became_peered":"2024-09-22T08:10:47.176634+0000","last_unstale":"2024-09-22T08:11:23.211379+0000","last_undegraded":"2024-09-22T08:11:23.211379+0000","last_fullsized":"2024-09-22T08:11:23.211379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:32.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.142937+0000","last_change":"2024-09-22T08:10:49.179447+0000","last_active":"2024-09-22T08:12:51.142937+0000","last_peered":"2024-09-22T08:12:51.142937+0000","last_clean":"2024-09-22T08:12:51.142937+0000","last_became_active":"2024-09-22T08:10:49.178942+0000","last_became_peered":"2024-09-22T08:10:49.178942+0000","last_unstale":"2024-09-22T08:12:51.142937+0000","last_undegraded":"2024-09-22T08:12:51.142937+0000","last_fullsized":"2024-09-22T08:12:51.142937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:49.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207501+0000","last_change":"2024-09-22T08:10:51.192777+0000","last_active":"2024-09-22T08:11:23.207501+0000","last_peered":"2024-09-22T08:11:23.207501+0000","last_clean":"2024-09-22T08:11:23.207501+0000","last_became_active":"2024-09-22T08:10:51.192482+0000","last_became_peered":"2024-09-22T08:10:51.192482+0000","last_unstale":"2024-09-22T08:11:23.207501+0000","last_undegraded":"2024-09-22T08:11:23.207501+0000","last_fullsized":"2024-09-22T08:11:23.207501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:39.871977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.288651+0000","last_change":"2024-09-22T08:10:53.193739+0000","last_active":"2024-09-22T08:13:53.288651+0000","last_peered":"2024-09-22T08:13:53.288651+0000","last_clean":"2024-09-22T08:13:53.288651+0000","last_became_active":"2024-09-22T08:10:53.193315+0000","last_became_peered":"2024-09-22T08:10:53.193315+0000","last_unstale":"2024-09-22T08:13:53.288651+0000","last_undegraded":"2024-09-22T08:13:53.288651+0000","last_fullsized":"2024-09-22T08:13:53.288651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:02.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.576265+0000","last_change":"2024-09-22T08:10:45.176318+0000","last_active":"2024-09-22T08:12:52.576265+0000","last_peered":"2024-09-22T08:12:52.576265+0000","last_clean":"2024-09-22T08:12:52.576265+0000","last_became_active":"2024-09-22T08:10:45.176033+0000","last_became_peered":"2024-09-22T08:10:45.176033+0000","last_unstale":"2024-09-22T08:12:52.576265+0000","last_undegraded":"2024-09-22T08:12:52.576265+0000","last_fullsized":"2024-09-22T08:12:52.576265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:16.885517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210644+0000","last_change":"2024-09-22T08:10:29.013963+0000","last_active":"2024-09-22T08:11:23.210644+0000","last_peered":"2024-09-22T08:11:23.210644+0000","last_clean":"2024-09-22T08:11:23.210644+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:11:23.210644+0000","last_undegraded":"2024-09-22T08:11:23.210644+0000","last_fullsized":"2024-09-22T08:11:23.210644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_clean_scrub_stamp":"2024-09-22T08:10:27.897500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:09.733603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211507+0000","last_change":"2024-09-22T08:10:35.923301+0000","last_active":"2024-09-22T08:11:23.211507+0000","last_peered":"2024-09-22T08:11:23.211507+0000","last_clean":"2024-09-22T08:11:23.211507+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:11:23.211507+0000","last_undegraded":"2024-09-22T08:11:23.211507+0000","last_fullsized":"2024-09-22T08:11:23.211507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:47.170548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:47.584171+0000","last_change":"2024-09-22T08:10:43.201333+0000","last_active":"2024-09-22T08:12:47.584171+0000","last_peered":"2024-09-22T08:12:47.584171+0000","last_clean":"2024-09-22T08:12:47.584171+0000","last_became_active":"2024-09-22T08:10:43.200918+0000","last_became_peered":"2024-09-22T08:10:43.200918+0000","last_unstale":"2024-09-22T08:12:47.584171+0000","last_undegraded":"2024-09-22T08:12:47.584171+0000","last_fullsized":"2024-09-22T08:12:47.584171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:56.138697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"25'1","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.224891+0000","last_change":"2024-09-22T08:10:47.176080+0000","last_active":"2024-09-22T08:12:52.224891+0000","last_peered":"2024-09-22T08:12:52.224891+0000","last_clean":"2024-09-22T08:12:52.224891+0000","last_became_active":"2024-09-22T08:10:47.175775+0000","last_became_peered":"2024-09-22T08:10:47.175775+0000","last_unstale":"2024-09-22T08:12:52.224891+0000","last_undegraded":"2024-09-22T08:12:52.224891+0000","last_fullsized":"2024-09-22T08:12:52.224891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:05.368279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.154641+0000","last_change":"2024-09-22T08:10:49.185987+0000","last_active":"2024-09-22T08:12:51.154641+0000","last_peered":"2024-09-22T08:12:51.154641+0000","last_clean":"2024-09-22T08:12:51.154641+0000","last_became_active":"2024-09-22T08:10:49.185661+0000","last_became_peered":"2024-09-22T08:10:49.185661+0000","last_unstale":"2024-09-22T08:12:51.154641+0000","last_undegraded":"2024-09-22T08:12:51.154641+0000","last_fullsized":"2024-09-22T08:12:51.154641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:08.519832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222697+0000","last_change":"2024-09-22T08:10:51.202811+0000","last_active":"2024-09-22T08:11:23.222697+0000","last_peered":"2024-09-22T08:11:23.222697+0000","last_clean":"2024-09-22T08:11:23.222697+0000","last_became_active":"2024-09-22T08:10:51.202473+0000","last_became_peered":"2024-09-22T08:10:51.202473+0000","last_unstale":"2024-09-22T08:11:23.222697+0000","last_undegraded":"2024-09-22T08:11:23.222697+0000","last_fullsized":"2024-09-22T08:11:23.222697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.556104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.266227+0000","last_change":"2024-09-22T08:10:53.192244+0000","last_active":"2024-09-22T08:13:53.266227+0000","last_peered":"2024-09-22T08:13:53.266227+0000","last_clean":"2024-09-22T08:13:53.266227+0000","last_became_active":"2024-09-22T08:10:53.191752+0000","last_became_peered":"2024-09-22T08:10:53.191752+0000","last_unstale":"2024-09-22T08:13:53.266227+0000","last_undegraded":"2024-09-22T08:13:53.266227+0000","last_fullsized":"2024-09-22T08:13:53.266227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:21.155421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183521+0000","last_change":"2024-09-22T08:10:45.167615+0000","last_active":"2024-09-22T08:13:53.183521+0000","last_peered":"2024-09-22T08:13:53.183521+0000","last_clean":"2024-09-22T08:13:53.183521+0000","last_became_active":"2024-09-22T08:10:45.167260+0000","last_became_peered":"2024-09-22T08:10:45.167260+0000","last_unstale":"2024-09-22T08:13:53.183521+0000","last_undegraded":"2024-09-22T08:13:53.183521+0000","last_fullsized":"2024-09-22T08:13:53.183521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:09.439811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209592+0000","last_change":"2024-09-22T08:10:35.922413+0000","last_active":"2024-09-22T08:11:23.209592+0000","last_peered":"2024-09-22T08:11:23.209592+0000","last_clean":"2024-09-22T08:11:23.209592+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:11:23.209592+0000","last_undegraded":"2024-09-22T08:11:23.209592+0000","last_fullsized":"2024-09-22T08:11:23.209592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:14.955260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.175049+0000","last_change":"2024-09-22T08:10:43.178602+0000","last_active":"2024-09-22T08:13:53.175049+0000","last_peered":"2024-09-22T08:13:53.175049+0000","last_clean":"2024-09-22T08:13:53.175049+0000","last_became_active":"2024-09-22T08:10:43.177928+0000","last_became_peered":"2024-09-22T08:10:43.177928+0000","last_unstale":"2024-09-22T08:13:53.175049+0000","last_undegraded":"2024-09-22T08:13:53.175049+0000","last_fullsized":"2024-09-22T08:13:53.175049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:47.867688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212854+0000","last_change":"2024-09-22T08:10:47.176700+0000","last_active":"2024-09-22T08:11:23.212854+0000","last_peered":"2024-09-22T08:11:23.212854+0000","last_clean":"2024-09-22T08:11:23.212854+0000","last_became_active":"2024-09-22T08:10:47.176402+0000","last_became_peered":"2024-09-22T08:10:47.176402+0000","last_unstale":"2024-09-22T08:11:23.212854+0000","last_undegraded":"2024-09-22T08:11:23.212854+0000","last_fullsized":"2024-09-22T08:11:23.212854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:30.271890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'273","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254453+0000","last_change":"2024-09-22T08:10:49.186526+0000","last_active":"2024-09-22T08:13:52.254453+0000","last_peered":"2024-09-22T08:13:52.254453+0000","last_clean":"2024-09-22T08:13:52.254453+0000","last_became_active":"2024-09-22T08:10:49.186277+0000","last_became_peered":"2024-09-22T08:10:49.186277+0000","last_unstale":"2024-09-22T08:13:52.254453+0000","last_undegraded":"2024-09-22T08:13:52.254453+0000","last_fullsized":"2024-09-22T08:13:52.254453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:42.950185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210281+0000","last_change":"2024-09-22T08:10:51.198493+0000","last_active":"2024-09-22T08:11:23.210281+0000","last_peered":"2024-09-22T08:11:23.210281+0000","last_clean":"2024-09-22T08:11:23.210281+0000","last_became_active":"2024-09-22T08:10:51.196837+0000","last_became_peered":"2024-09-22T08:10:51.196837+0000","last_unstale":"2024-09-22T08:11:23.210281+0000","last_undegraded":"2024-09-22T08:11:23.210281+0000","last_fullsized":"2024-09-22T08:11:23.210281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:20.497307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.832166+0000","last_change":"2024-09-22T08:10:53.199926+0000","last_active":"2024-09-22T08:12:08.832166+0000","last_peered":"2024-09-22T08:12:08.832166+0000","last_clean":"2024-09-22T08:12:08.832166+0000","last_became_active":"2024-09-22T08:10:53.199214+0000","last_became_peered":"2024-09-22T08:10:53.199214+0000","last_unstale":"2024-09-22T08:12:08.832166+0000","last_undegraded":"2024-09-22T08:12:08.832166+0000","last_fullsized":"2024-09-22T08:12:08.832166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:35.327109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'11","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.958255+0000","last_change":"2024-09-22T08:10:45.176242+0000","last_active":"2024-09-22T08:13:52.958255+0000","last_peered":"2024-09-22T08:13:52.958255+0000","last_clean":"2024-09-22T08:13:52.958255+0000","last_became_active":"2024-09-22T08:10:45.175923+0000","last_became_peered":"2024-09-22T08:10:45.175923+0000","last_unstale":"2024-09-22T08:13:52.958255+0000","last_undegraded":"2024-09-22T08:13:52.958255+0000","last_fullsized":"2024-09-22T08:13:52.958255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:05.397239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207525+0000","last_change":"2024-09-22T08:10:36.081840+0000","last_active":"2024-09-22T08:11:23.207525+0000","last_peered":"2024-09-22T08:11:23.207525+0000","last_clean":"2024-09-22T08:11:23.207525+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:11:23.207525+0000","last_undegraded":"2024-09-22T08:11:23.207525+0000","last_fullsized":"2024-09-22T08:11:23.207525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:30.701302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.219803+0000","last_change":"2024-09-22T08:10:43.187298+0000","last_active":"2024-09-22T08:11:23.219803+0000","last_peered":"2024-09-22T08:11:23.219803+0000","last_clean":"2024-09-22T08:11:23.219803+0000","last_became_active":"2024-09-22T08:10:43.186500+0000","last_became_peered":"2024-09-22T08:10:43.186500+0000","last_unstale":"2024-09-22T08:11:23.219803+0000","last_undegraded":"2024-09-22T08:11:23.219803+0000","last_fullsized":"2024-09-22T08:11:23.219803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:05.709839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208957+0000","last_change":"2024-09-22T08:10:47.172553+0000","last_active":"2024-09-22T08:11:23.208957+0000","last_peered":"2024-09-22T08:11:23.208957+0000","last_clean":"2024-09-22T08:11:23.208957+0000","last_became_active":"2024-09-22T08:10:47.172041+0000","last_became_peered":"2024-09-22T08:10:47.172041+0000","last_unstale":"2024-09-22T08:11:23.208957+0000","last_undegraded":"2024-09-22T08:11:23.208957+0000","last_fullsized":"2024-09-22T08:11:23.208957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:29.368363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'18","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254753+0000","last_change":"2024-09-22T08:10:49.180939+0000","last_active":"2024-09-22T08:13:52.254753+0000","last_peered":"2024-09-22T08:13:52.254753+0000","last_clean":"2024-09-22T08:13:52.254753+0000","last_became_active":"2024-09-22T08:10:49.180563+0000","last_became_peered":"2024-09-22T08:10:49.180563+0000","last_unstale":"2024-09-22T08:13:52.254753+0000","last_undegraded":"2024-09-22T08:13:52.254753+0000","last_fullsized":"2024-09-22T08:13:52.254753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:39.091603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221445+0000","last_change":"2024-09-22T08:10:51.202850+0000","last_active":"2024-09-22T08:11:23.221445+0000","last_peered":"2024-09-22T08:11:23.221445+0000","last_clean":"2024-09-22T08:11:23.221445+0000","last_became_active":"2024-09-22T08:10:51.202422+0000","last_became_peered":"2024-09-22T08:10:51.202422+0000","last_unstale":"2024-09-22T08:11:23.221445+0000","last_undegraded":"2024-09-22T08:11:23.221445+0000","last_fullsized":"2024-09-22T08:11:23.221445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:08.745501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209116+0000","last_change":"2024-09-22T08:10:53.200159+0000","last_active":"2024-09-22T08:11:23.209116+0000","last_peered":"2024-09-22T08:11:23.209116+0000","last_clean":"2024-09-22T08:11:23.209116+0000","last_became_active":"2024-09-22T08:10:53.199894+0000","last_became_peered":"2024-09-22T08:10:53.199894+0000","last_unstale":"2024-09-22T08:11:23.209116+0000","last_undegraded":"2024-09-22T08:11:23.209116+0000","last_fullsized":"2024-09-22T08:11:23.209116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:07.697983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828326+0000","last_change":"2024-09-22T08:10:45.167126+0000","last_active":"2024-09-22T08:12:08.828326+0000","last_peered":"2024-09-22T08:12:08.828326+0000","last_clean":"2024-09-22T08:12:08.828326+0000","last_became_active":"2024-09-22T08:10:45.166816+0000","last_became_peered":"2024-09-22T08:10:45.166816+0000","last_unstale":"2024-09-22T08:12:08.828326+0000","last_undegraded":"2024-09-22T08:12:08.828326+0000","last_fullsized":"2024-09-22T08:12:08.828326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:52.901946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209498+0000","last_change":"2024-09-22T08:10:35.923055+0000","last_active":"2024-09-22T08:11:23.209498+0000","last_peered":"2024-09-22T08:11:23.209498+0000","last_clean":"2024-09-22T08:11:23.209498+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:11:23.209498+0000","last_undegraded":"2024-09-22T08:11:23.209498+0000","last_fullsized":"2024-09-22T08:11:23.209498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:18.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207661+0000","last_change":"2024-09-22T08:10:43.187474+0000","last_active":"2024-09-22T08:11:23.207661+0000","last_peered":"2024-09-22T08:11:23.207661+0000","last_clean":"2024-09-22T08:11:23.207661+0000","last_became_active":"2024-09-22T08:10:43.187103+0000","last_became_peered":"2024-09-22T08:10:43.187103+0000","last_unstale":"2024-09-22T08:11:23.207661+0000","last_undegraded":"2024-09-22T08:11:23.207661+0000","last_fullsized":"2024-09-22T08:11:23.207661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:48.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222126+0000","last_change":"2024-09-22T08:10:47.168792+0000","last_active":"2024-09-22T08:11:23.222126+0000","last_peered":"2024-09-22T08:11:23.222126+0000","last_clean":"2024-09-22T08:11:23.222126+0000","last_became_active":"2024-09-22T08:10:47.168480+0000","last_became_peered":"2024-09-22T08:10:47.168480+0000","last_unstale":"2024-09-22T08:11:23.222126+0000","last_undegraded":"2024-09-22T08:11:23.222126+0000","last_fullsized":"2024-09-22T08:11:23.222126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:19.091966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.586312+0000","last_change":"2024-09-22T08:10:49.185221+0000","last_active":"2024-09-22T08:13:52.586312+0000","last_peered":"2024-09-22T08:13:52.586312+0000","last_clean":"2024-09-22T08:13:52.586312+0000","last_became_active":"2024-09-22T08:10:49.184961+0000","last_became_peered":"2024-09-22T08:10:49.184961+0000","last_unstale":"2024-09-22T08:13:52.586312+0000","last_undegraded":"2024-09-22T08:13:52.586312+0000","last_fullsized":"2024-09-22T08:13:52.586312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:00.221298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213144+0000","last_change":"2024-09-22T08:10:51.195952+0000","last_active":"2024-09-22T08:11:23.213144+0000","last_peered":"2024-09-22T08:11:23.213144+0000","last_clean":"2024-09-22T08:11:23.213144+0000","last_became_active":"2024-09-22T08:10:51.195643+0000","last_became_peered":"2024-09-22T08:10:51.195643+0000","last_unstale":"2024-09-22T08:11:23.213144+0000","last_undegraded":"2024-09-22T08:11:23.213144+0000","last_fullsized":"2024-09-22T08:11:23.213144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:18.035075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.336216+0000","last_change":"2024-09-22T08:10:53.203765+0000","last_active":"2024-09-22T08:12:52.336216+0000","last_peered":"2024-09-22T08:12:52.336216+0000","last_clean":"2024-09-22T08:12:52.336216+0000","last_became_active":"2024-09-22T08:10:53.203330+0000","last_became_peered":"2024-09-22T08:10:53.203330+0000","last_unstale":"2024-09-22T08:12:52.336216+0000","last_undegraded":"2024-09-22T08:12:52.336216+0000","last_fullsized":"2024-09-22T08:12:52.336216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:46.081338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.047853+0000","last_change":"2024-09-22T08:10:45.182440+0000","last_active":"2024-09-22T08:13:53.047853+0000","last_peered":"2024-09-22T08:13:53.047853+0000","last_clean":"2024-09-22T08:13:53.047853+0000","last_became_active":"2024-09-22T08:10:45.182276+0000","last_became_peered":"2024-09-22T08:10:45.182276+0000","last_unstale":"2024-09-22T08:13:53.047853+0000","last_undegraded":"2024-09-22T08:13:53.047853+0000","last_fullsized":"2024-09-22T08:13:53.047853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:53.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.164200+0000","last_change":"2024-09-22T08:10:43.193611+0000","last_active":"2024-09-22T08:13:53.164200+0000","last_peered":"2024-09-22T08:13:53.164200+0000","last_clean":"2024-09-22T08:13:53.164200+0000","last_became_active":"2024-09-22T08:10:43.186175+0000","last_became_peered":"2024-09-22T08:10:43.186175+0000","last_unstale":"2024-09-22T08:13:53.164200+0000","last_undegraded":"2024-09-22T08:13:53.164200+0000","last_fullsized":"2024-09-22T08:13:53.164200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:31.708040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221346+0000","last_change":"2024-09-22T08:10:35.924829+0000","last_active":"2024-09-22T08:11:23.221346+0000","last_peered":"2024-09-22T08:11:23.221346+0000","last_clean":"2024-09-22T08:11:23.221346+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:11:23.221346+0000","last_undegraded":"2024-09-22T08:11:23.221346+0000","last_fullsized":"2024-09-22T08:11:23.221346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:15.126946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.583815+0000","last_change":"2024-09-22T08:10:47.167981+0000","last_active":"2024-09-22T08:12:51.583815+0000","last_peered":"2024-09-22T08:12:51.583815+0000","last_clean":"2024-09-22T08:12:51.583815+0000","last_became_active":"2024-09-22T08:10:47.167620+0000","last_became_peered":"2024-09-22T08:10:47.167620+0000","last_unstale":"2024-09-22T08:12:51.583815+0000","last_undegraded":"2024-09-22T08:12:51.583815+0000","last_fullsized":"2024-09-22T08:12:51.583815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:35.145384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'63","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.265186+0000","last_change":"2024-09-22T08:10:49.185023+0000","last_active":"2024-09-22T08:13:53.265186+0000","last_peered":"2024-09-22T08:13:53.265186+0000","last_clean":"2024-09-22T08:13:53.265186+0000","last_became_active":"2024-09-22T08:10:49.184753+0000","last_became_peered":"2024-09-22T08:10:49.184753+0000","last_unstale":"2024-09-22T08:13:53.265186+0000","last_undegraded":"2024-09-22T08:13:53.265186+0000","last_fullsized":"2024-09-22T08:13:53.265186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:46.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":61,"num_read_kb":49,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206763+0000","last_change":"2024-09-22T08:10:51.197026+0000","last_active":"2024-09-22T08:11:23.206763+0000","last_peered":"2024-09-22T08:11:23.206763+0000","last_clean":"2024-09-22T08:11:23.206763+0000","last_became_active":"2024-09-22T08:10:51.196724+0000","last_became_peered":"2024-09-22T08:10:51.196724+0000","last_unstale":"2024-09-22T08:11:23.206763+0000","last_undegraded":"2024-09-22T08:11:23.206763+0000","last_fullsized":"2024-09-22T08:11:23.206763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:06.499640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.230225+0000","last_change":"2024-09-22T08:10:53.196686+0000","last_active":"2024-09-22T08:13:53.230225+0000","last_peered":"2024-09-22T08:13:53.230225+0000","last_clean":"2024-09-22T08:13:53.230225+0000","last_became_active":"2024-09-22T08:10:53.196406+0000","last_became_peered":"2024-09-22T08:10:53.196406+0000","last_unstale":"2024-09-22T08:13:53.230225+0000","last_undegraded":"2024-09-22T08:13:53.230225+0000","last_fullsized":"2024-09-22T08:13:53.230225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:42.892968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254919+0000","last_change":"2024-09-22T08:10:45.176907+0000","last_active":"2024-09-22T08:13:53.254919+0000","last_peered":"2024-09-22T08:13:53.254919+0000","last_clean":"2024-09-22T08:13:53.254919+0000","last_became_active":"2024-09-22T08:10:45.176601+0000","last_became_peered":"2024-09-22T08:10:45.176601+0000","last_unstale":"2024-09-22T08:13:53.254919+0000","last_undegraded":"2024-09-22T08:13:53.254919+0000","last_fullsized":"2024-09-22T08:13:53.254919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:23:25.305179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.170482+0000","last_change":"2024-09-22T08:10:43.187808+0000","last_active":"2024-09-22T08:13:53.170482+0000","last_peered":"2024-09-22T08:13:53.170482+0000","last_clean":"2024-09-22T08:13:53.170482+0000","last_became_active":"2024-09-22T08:10:43.186758+0000","last_became_peered":"2024-09-22T08:10:43.186758+0000","last_unstale":"2024-09-22T08:13:53.170482+0000","last_undegraded":"2024-09-22T08:13:53.170482+0000","last_fullsized":"2024-09-22T08:13:53.170482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:23.595549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211013+0000","last_change":"2024-09-22T08:10:35.922434+0000","last_active":"2024-09-22T08:11:23.211013+0000","last_peered":"2024-09-22T08:11:23.211013+0000","last_clean":"2024-09-22T08:11:23.211013+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:11:23.211013+0000","last_undegraded":"2024-09-22T08:11:23.211013+0000","last_fullsized":"2024-09-22T08:11:23.211013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:36.971498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209307+0000","last_change":"2024-09-22T08:10:47.173748+0000","last_active":"2024-09-22T08:11:23.209307+0000","last_peered":"2024-09-22T08:11:23.209307+0000","last_clean":"2024-09-22T08:11:23.209307+0000","last_became_active":"2024-09-22T08:10:47.173348+0000","last_became_peered":"2024-09-22T08:10:47.173348+0000","last_unstale":"2024-09-22T08:11:23.209307+0000","last_undegraded":"2024-09-22T08:11:23.209307+0000","last_fullsized":"2024-09-22T08:11:23.209307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:18:06.081248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212964+0000","last_change":"2024-09-22T08:10:49.187453+0000","last_active":"2024-09-22T08:11:23.212964+0000","last_peered":"2024-09-22T08:11:23.212964+0000","last_clean":"2024-09-22T08:11:23.212964+0000","last_became_active":"2024-09-22T08:10:49.187184+0000","last_became_peered":"2024-09-22T08:10:49.187184+0000","last_unstale":"2024-09-22T08:11:23.212964+0000","last_undegraded":"2024-09-22T08:11:23.212964+0000","last_fullsized":"2024-09-22T08:11:23.212964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:19:08.593807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":370,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254387+0000","last_change":"2024-09-22T08:10:51.197450+0000","last_active":"2024-09-22T08:13:52.254387+0000","last_peered":"2024-09-22T08:13:52.254387+0000","last_clean":"2024-09-22T08:13:52.254387+0000","last_became_active":"2024-09-22T08:10:51.197111+0000","last_became_peered":"2024-09-22T08:10:51.197111+0000","last_unstale":"2024-09-22T08:13:52.254387+0000","last_undegraded":"2024-09-22T08:13:52.254387+0000","last_fullsized":"2024-09-22T08:13:52.254387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212274+0000","last_change":"2024-09-22T08:10:53.200428+0000","last_active":"2024-09-22T08:11:23.212274+0000","last_peered":"2024-09-22T08:11:23.212274+0000","last_clean":"2024-09-22T08:11:23.212274+0000","last_became_active":"2024-09-22T08:10:53.199612+0000","last_became_peered":"2024-09-22T08:10:53.199612+0000","last_unstale":"2024-09-22T08:11:23.212274+0000","last_undegraded":"2024-09-22T08:11:23.212274+0000","last_fullsized":"2024-09-22T08:11:23.212274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:47.560464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.007599+0000","last_change":"2024-09-22T08:10:45.183951+0000","last_active":"2024-09-22T08:11:26.007599+0000","last_peered":"2024-09-22T08:11:26.007599+0000","last_clean":"2024-09-22T08:11:26.007599+0000","last_became_active":"2024-09-22T08:10:45.183229+0000","last_became_peered":"2024-09-22T08:10:45.183229+0000","last_unstale":"2024-09-22T08:11:26.007599+0000","last_undegraded":"2024-09-22T08:11:26.007599+0000","last_fullsized":"2024-09-22T08:11:26.007599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:03.361288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214275+0000","last_change":"2024-09-22T08:10:43.199726+0000","last_active":"2024-09-22T08:11:23.214275+0000","last_peered":"2024-09-22T08:11:23.214275+0000","last_clean":"2024-09-22T08:11:23.214275+0000","last_became_active":"2024-09-22T08:10:43.198637+0000","last_became_peered":"2024-09-22T08:10:43.198637+0000","last_unstale":"2024-09-22T08:11:23.214275+0000","last_undegraded":"2024-09-22T08:11:23.214275+0000","last_fullsized":"2024-09-22T08:11:23.214275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.086176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222838+0000","last_change":"2024-09-22T08:10:35.924894+0000","last_active":"2024-09-22T08:11:23.222838+0000","last_peered":"2024-09-22T08:11:23.222838+0000","last_clean":"2024-09-22T08:11:23.222838+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:11:23.222838+0000","last_undegraded":"2024-09-22T08:11:23.222838+0000","last_fullsized":"2024-09-22T08:11:23.222838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:31.373918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221460+0000","last_change":"2024-09-22T08:11:23.216945+0000","last_active":"2024-09-22T08:11:23.221460+0000","last_peered":"2024-09-22T08:11:23.221460+0000","last_clean":"2024-09-22T08:11:23.221460+0000","last_became_active":"2024-09-22T08:11:23.216676+0000","last_became_peered":"2024-09-22T08:11:23.216676+0000","last_unstale":"2024-09-22T08:11:23.221460+0000","last_undegraded":"2024-09-22T08:11:23.221460+0000","last_fullsized":"2024-09-22T08:11:23.221460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:46.451332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213139+0000","last_change":"2024-09-22T08:10:49.188685+0000","last_active":"2024-09-22T08:11:23.213139+0000","last_peered":"2024-09-22T08:11:23.213139+0000","last_clean":"2024-09-22T08:11:23.213139+0000","last_became_active":"2024-09-22T08:10:49.188309+0000","last_became_peered":"2024-09-22T08:10:49.188309+0000","last_unstale":"2024-09-22T08:11:23.213139+0000","last_undegraded":"2024-09-22T08:11:23.213139+0000","last_fullsized":"2024-09-22T08:11:23.213139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.497319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":400,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.362561+0000","last_change":"2024-09-22T08:10:51.193163+0000","last_active":"2024-09-22T08:13:53.362561+0000","last_peered":"2024-09-22T08:13:53.362561+0000","last_clean":"2024-09-22T08:13:53.362561+0000","last_became_active":"2024-09-22T08:10:51.192058+0000","last_became_peered":"2024-09-22T08:10:51.192058+0000","last_unstale":"2024-09-22T08:13:53.362561+0000","last_undegraded":"2024-09-22T08:13:53.362561+0000","last_fullsized":"2024-09-22T08:13:53.362561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213624+0000","last_change":"2024-09-22T08:10:53.203958+0000","last_active":"2024-09-22T08:11:23.213624+0000","last_peered":"2024-09-22T08:11:23.213624+0000","last_clean":"2024-09-22T08:11:23.213624+0000","last_became_active":"2024-09-22T08:10:53.203670+0000","last_became_peered":"2024-09-22T08:10:53.203670+0000","last_unstale":"2024-09-22T08:11:23.213624+0000","last_undegraded":"2024-09-22T08:11:23.213624+0000","last_fullsized":"2024-09-22T08:11:23.213624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:04.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'17","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.190706+0000","last_change":"2024-09-22T08:10:45.172007+0000","last_active":"2024-09-22T08:13:53.190706+0000","last_peered":"2024-09-22T08:13:53.190706+0000","last_clean":"2024-09-22T08:13:53.190706+0000","last_became_active":"2024-09-22T08:10:45.171667+0000","last_became_peered":"2024-09-22T08:10:45.171667+0000","last_unstale":"2024-09-22T08:13:53.190706+0000","last_undegraded":"2024-09-22T08:13:53.190706+0000","last_fullsized":"2024-09-22T08:13:53.190706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:31.764706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562709+0000","last_change":"2024-09-22T08:10:43.182563+0000","last_active":"2024-09-22T08:11:25.562709+0000","last_peered":"2024-09-22T08:11:25.562709+0000","last_clean":"2024-09-22T08:11:25.562709+0000","last_became_active":"2024-09-22T08:10:43.182161+0000","last_became_peered":"2024-09-22T08:10:43.182161+0000","last_unstale":"2024-09-22T08:11:25.562709+0000","last_undegraded":"2024-09-22T08:11:25.562709+0000","last_fullsized":"2024-09-22T08:11:25.562709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:48.821851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213965+0000","last_change":"2024-09-22T08:10:35.923155+0000","last_active":"2024-09-22T08:11:23.213965+0000","last_peered":"2024-09-22T08:11:23.213965+0000","last_clean":"2024-09-22T08:11:23.213965+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:11:23.213965+0000","last_undegraded":"2024-09-22T08:11:23.213965+0000","last_fullsized":"2024-09-22T08:11:23.213965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:11:54.812723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209442+0000","last_change":"2024-09-22T08:10:47.174132+0000","last_active":"2024-09-22T08:11:23.209442+0000","last_peered":"2024-09-22T08:11:23.209442+0000","last_clean":"2024-09-22T08:11:23.209442+0000","last_became_active":"2024-09-22T08:10:47.172441+0000","last_became_peered":"2024-09-22T08:10:47.172441+0000","last_unstale":"2024-09-22T08:11:23.209442+0000","last_undegraded":"2024-09-22T08:11:23.209442+0000","last_fullsized":"2024-09-22T08:11:23.209442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:47.078285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":155,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.140573+0000","last_change":"2024-09-22T08:10:49.185244+0000","last_active":"2024-09-22T08:12:51.140573+0000","last_peered":"2024-09-22T08:12:51.140573+0000","last_clean":"2024-09-22T08:12:51.140573+0000","last_became_active":"2024-09-22T08:10:49.184942+0000","last_became_peered":"2024-09-22T08:10:49.184942+0000","last_unstale":"2024-09-22T08:12:51.140573+0000","last_undegraded":"2024-09-22T08:12:51.140573+0000","last_fullsized":"2024-09-22T08:12:51.140573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:53.328309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220410+0000","last_change":"2024-09-22T08:10:51.195295+0000","last_active":"2024-09-22T08:11:23.220410+0000","last_peered":"2024-09-22T08:11:23.220410+0000","last_clean":"2024-09-22T08:11:23.220410+0000","last_became_active":"2024-09-22T08:10:51.194912+0000","last_became_peered":"2024-09-22T08:10:51.194912+0000","last_unstale":"2024-09-22T08:11:23.220410+0000","last_undegraded":"2024-09-22T08:11:23.220410+0000","last_fullsized":"2024-09-22T08:11:23.220410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:22.604330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208925+0000","last_change":"2024-09-22T08:10:53.192489+0000","last_active":"2024-09-22T08:11:23.208925+0000","last_peered":"2024-09-22T08:11:23.208925+0000","last_clean":"2024-09-22T08:11:23.208925+0000","last_became_active":"2024-09-22T08:10:53.192189+0000","last_became_peered":"2024-09-22T08:10:53.192189+0000","last_unstale":"2024-09-22T08:11:23.208925+0000","last_undegraded":"2024-09-22T08:11:23.208925+0000","last_fullsized":"2024-09-22T08:11:23.208925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:14.737752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208582+0000","last_change":"2024-09-22T08:10:53.198120+0000","last_active":"2024-09-22T08:11:23.208582+0000","last_peered":"2024-09-22T08:11:23.208582+0000","last_clean":"2024-09-22T08:11:23.208582+0000","last_became_active":"2024-09-22T08:10:53.197799+0000","last_became_peered":"2024-09-22T08:10:53.197799+0000","last_unstale":"2024-09-22T08:11:23.208582+0000","last_undegraded":"2024-09-22T08:11:23.208582+0000","last_fullsized":"2024-09-22T08:11:23.208582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:55.526373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.047862+0000","last_change":"2024-09-22T08:10:45.174189+0000","last_active":"2024-09-22T08:13:53.047862+0000","last_peered":"2024-09-22T08:13:53.047862+0000","last_clean":"2024-09-22T08:13:53.047862+0000","last_became_active":"2024-09-22T08:10:45.173916+0000","last_became_peered":"2024-09-22T08:10:45.173916+0000","last_unstale":"2024-09-22T08:13:53.047862+0000","last_undegraded":"2024-09-22T08:13:53.047862+0000","last_fullsized":"2024-09-22T08:13:53.047862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:27.673736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.422254+0000","last_change":"2024-09-22T08:10:43.201372+0000","last_active":"2024-09-22T08:12:52.422254+0000","last_peered":"2024-09-22T08:12:52.422254+0000","last_clean":"2024-09-22T08:12:52.422254+0000","last_became_active":"2024-09-22T08:10:43.201007+0000","last_became_peered":"2024-09-22T08:10:43.201007+0000","last_unstale":"2024-09-22T08:12:52.422254+0000","last_undegraded":"2024-09-22T08:12:52.422254+0000","last_fullsized":"2024-09-22T08:12:52.422254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:49.200344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212648+0000","last_change":"2024-09-22T08:10:47.176086+0000","last_active":"2024-09-22T08:11:23.212648+0000","last_peered":"2024-09-22T08:11:23.212648+0000","last_clean":"2024-09-22T08:11:23.212648+0000","last_became_active":"2024-09-22T08:10:47.175524+0000","last_became_peered":"2024-09-22T08:10:47.175524+0000","last_unstale":"2024-09-22T08:11:23.212648+0000","last_undegraded":"2024-09-22T08:11:23.212648+0000","last_fullsized":"2024-09-22T08:11:23.212648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:13.592432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.146947+0000","last_change":"2024-09-22T08:10:49.186252+0000","last_active":"2024-09-22T08:12:51.146947+0000","last_peered":"2024-09-22T08:12:51.146947+0000","last_clean":"2024-09-22T08:12:51.146947+0000","last_became_active":"2024-09-22T08:10:49.185693+0000","last_became_peered":"2024-09-22T08:10:49.185693+0000","last_unstale":"2024-09-22T08:12:51.146947+0000","last_undegraded":"2024-09-22T08:12:51.146947+0000","last_fullsized":"2024-09-22T08:12:51.146947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:02.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213000+0000","last_change":"2024-09-22T08:10:51.200112+0000","last_active":"2024-09-22T08:11:23.213000+0000","last_peered":"2024-09-22T08:11:23.213000+0000","last_clean":"2024-09-22T08:11:23.213000+0000","last_became_active":"2024-09-22T08:10:51.199799+0000","last_became_peered":"2024-09-22T08:10:51.199799+0000","last_unstale":"2024-09-22T08:11:23.213000+0000","last_undegraded":"2024-09-22T08:11:23.213000+0000","last_fullsized":"2024-09-22T08:11:23.213000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:06.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'13","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.308456+0000","last_change":"2024-09-22T08:10:53.201508+0000","last_active":"2024-09-22T08:13:53.308456+0000","last_peered":"2024-09-22T08:13:53.308456+0000","last_clean":"2024-09-22T08:13:53.308456+0000","last_became_active":"2024-09-22T08:10:53.201209+0000","last_became_peered":"2024-09-22T08:10:53.201209+0000","last_unstale":"2024-09-22T08:13:53.308456+0000","last_undegraded":"2024-09-22T08:13:53.308456+0000","last_fullsized":"2024-09-22T08:13:53.308456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:20.642196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":69,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183415+0000","last_change":"2024-09-22T08:10:45.182432+0000","last_active":"2024-09-22T08:13:53.183415+0000","last_peered":"2024-09-22T08:13:53.183415+0000","last_clean":"2024-09-22T08:13:53.183415+0000","last_became_active":"2024-09-22T08:10:45.182245+0000","last_became_peered":"2024-09-22T08:10:45.182245+0000","last_unstale":"2024-09-22T08:13:53.183415+0000","last_undegraded":"2024-09-22T08:13:53.183415+0000","last_fullsized":"2024-09-22T08:13:53.183415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:33.105535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:07.586758+0000","last_change":"2024-09-22T08:10:43.193144+0000","last_active":"2024-09-22T08:13:07.586758+0000","last_peered":"2024-09-22T08:13:07.586758+0000","last_clean":"2024-09-22T08:13:07.586758+0000","last_became_active":"2024-09-22T08:10:43.185230+0000","last_became_peered":"2024-09-22T08:10:43.185230+0000","last_unstale":"2024-09-22T08:13:07.586758+0000","last_undegraded":"2024-09-22T08:13:07.586758+0000","last_fullsized":"2024-09-22T08:13:07.586758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:51.284672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209614+0000","last_change":"2024-09-22T08:10:47.176256+0000","last_active":"2024-09-22T08:11:23.209614+0000","last_peered":"2024-09-22T08:11:23.209614+0000","last_clean":"2024-09-22T08:11:23.209614+0000","last_became_active":"2024-09-22T08:10:47.175747+0000","last_became_peered":"2024-09-22T08:10:47.175747+0000","last_unstale":"2024-09-22T08:11:23.209614+0000","last_undegraded":"2024-09-22T08:11:23.209614+0000","last_fullsized":"2024-09-22T08:11:23.209614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:17.217421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.591034+0000","last_change":"2024-09-22T08:10:49.181276+0000","last_active":"2024-09-22T08:13:52.591034+0000","last_peered":"2024-09-22T08:13:52.591034+0000","last_clean":"2024-09-22T08:13:52.591034+0000","last_became_active":"2024-09-22T08:10:49.180921+0000","last_became_peered":"2024-09-22T08:10:49.180921+0000","last_unstale":"2024-09-22T08:13:52.591034+0000","last_undegraded":"2024-09-22T08:13:52.591034+0000","last_fullsized":"2024-09-22T08:13:52.591034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:10.724160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207132+0000","last_change":"2024-09-22T08:10:51.193254+0000","last_active":"2024-09-22T08:11:23.207132+0000","last_peered":"2024-09-22T08:11:23.207132+0000","last_clean":"2024-09-22T08:11:23.207132+0000","last_became_active":"2024-09-22T08:10:51.192989+0000","last_became_peered":"2024-09-22T08:10:51.192989+0000","last_unstale":"2024-09-22T08:11:23.207132+0000","last_undegraded":"2024-09-22T08:11:23.207132+0000","last_fullsized":"2024-09-22T08:11:23.207132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:29.015464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.008653+0000","last_change":"2024-09-22T08:10:53.193317+0000","last_active":"2024-09-22T08:12:09.008653+0000","last_peered":"2024-09-22T08:12:09.008653+0000","last_clean":"2024-09-22T08:12:09.008653+0000","last_became_active":"2024-09-22T08:10:53.192967+0000","last_became_peered":"2024-09-22T08:10:53.192967+0000","last_unstale":"2024-09-22T08:12:09.008653+0000","last_undegraded":"2024-09-22T08:12:09.008653+0000","last_fullsized":"2024-09-22T08:12:09.008653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:48.815518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.468115+0000","last_change":"2024-09-22T08:10:45.172599+0000","last_active":"2024-09-22T08:12:49.468115+0000","last_peered":"2024-09-22T08:12:49.468115+0000","last_clean":"2024-09-22T08:12:49.468115+0000","last_became_active":"2024-09-22T08:10:45.171555+0000","last_became_peered":"2024-09-22T08:10:45.171555+0000","last_unstale":"2024-09-22T08:12:49.468115+0000","last_undegraded":"2024-09-22T08:12:49.468115+0000","last_fullsized":"2024-09-22T08:12:49.468115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:27.811575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211087+0000","last_change":"2024-09-22T08:10:43.192664+0000","last_active":"2024-09-22T08:11:23.211087+0000","last_peered":"2024-09-22T08:11:23.211087+0000","last_clean":"2024-09-22T08:11:23.211087+0000","last_became_active":"2024-09-22T08:10:43.187044+0000","last_became_peered":"2024-09-22T08:10:43.187044+0000","last_unstale":"2024-09-22T08:11:23.211087+0000","last_undegraded":"2024-09-22T08:11:23.211087+0000","last_fullsized":"2024-09-22T08:11:23.211087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:51.698704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.214782+0000","last_change":"2024-09-22T08:10:47.178036+0000","last_active":"2024-09-22T08:12:52.214782+0000","last_peered":"2024-09-22T08:12:52.214782+0000","last_clean":"2024-09-22T08:12:52.214782+0000","last_became_active":"2024-09-22T08:10:47.177735+0000","last_became_peered":"2024-09-22T08:10:47.177735+0000","last_unstale":"2024-09-22T08:12:52.214782+0000","last_undegraded":"2024-09-22T08:12:52.214782+0000","last_fullsized":"2024-09-22T08:12:52.214782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:05.249659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.646582+0000","last_change":"2024-09-22T08:10:49.182878+0000","last_active":"2024-09-22T08:13:52.646582+0000","last_peered":"2024-09-22T08:13:52.646582+0000","last_clean":"2024-09-22T08:13:52.646582+0000","last_became_active":"2024-09-22T08:10:49.182557+0000","last_became_peered":"2024-09-22T08:10:49.182557+0000","last_unstale":"2024-09-22T08:13:52.646582+0000","last_undegraded":"2024-09-22T08:13:52.646582+0000","last_fullsized":"2024-09-22T08:13:52.646582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:37.230381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212363+0000","last_change":"2024-09-22T08:10:51.198536+0000","last_active":"2024-09-22T08:11:23.212363+0000","last_peered":"2024-09-22T08:11:23.212363+0000","last_clean":"2024-09-22T08:11:23.212363+0000","last_became_active":"2024-09-22T08:10:51.198204+0000","last_became_peered":"2024-09-22T08:10:51.198204+0000","last_unstale":"2024-09-22T08:11:23.212363+0000","last_undegraded":"2024-09-22T08:11:23.212363+0000","last_fullsized":"2024-09-22T08:11:23.212363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.041147+0000","last_change":"2024-09-22T08:10:53.200288+0000","last_active":"2024-09-22T08:11:27.041147+0000","last_peered":"2024-09-22T08:11:27.041147+0000","last_clean":"2024-09-22T08:11:27.041147+0000","last_became_active":"2024-09-22T08:10:53.199827+0000","last_became_peered":"2024-09-22T08:10:53.199827+0000","last_unstale":"2024-09-22T08:11:27.041147+0000","last_undegraded":"2024-09-22T08:11:27.041147+0000","last_fullsized":"2024-09-22T08:11:27.041147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:31.568753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209916+0000","last_change":"2024-09-22T08:10:45.184232+0000","last_active":"2024-09-22T08:11:23.209916+0000","last_peered":"2024-09-22T08:11:23.209916+0000","last_clean":"2024-09-22T08:11:23.209916+0000","last_became_active":"2024-09-22T08:10:45.183674+0000","last_became_peered":"2024-09-22T08:10:45.183674+0000","last_unstale":"2024-09-22T08:11:23.209916+0000","last_undegraded":"2024-09-22T08:11:23.209916+0000","last_fullsized":"2024-09-22T08:11:23.209916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:11.585440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216574+0000","last_change":"2024-09-22T08:10:43.185629+0000","last_active":"2024-09-22T08:11:23.216574+0000","last_peered":"2024-09-22T08:11:23.216574+0000","last_clean":"2024-09-22T08:11:23.216574+0000","last_became_active":"2024-09-22T08:10:43.184287+0000","last_became_peered":"2024-09-22T08:10:43.184287+0000","last_unstale":"2024-09-22T08:11:23.216574+0000","last_undegraded":"2024-09-22T08:11:23.216574+0000","last_fullsized":"2024-09-22T08:11:23.216574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:47.867688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209665+0000","last_change":"2024-09-22T08:10:47.173065+0000","last_active":"2024-09-22T08:11:23.209665+0000","last_peered":"2024-09-22T08:11:23.209665+0000","last_clean":"2024-09-22T08:11:23.209665+0000","last_became_active":"2024-09-22T08:10:47.172816+0000","last_became_peered":"2024-09-22T08:10:47.172816+0000","last_unstale":"2024-09-22T08:11:23.209665+0000","last_undegraded":"2024-09-22T08:11:23.209665+0000","last_fullsized":"2024-09-22T08:11:23.209665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:42.365873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.131969+0000","last_change":"2024-09-22T08:10:49.180939+0000","last_active":"2024-09-22T08:12:51.131969+0000","last_peered":"2024-09-22T08:12:51.131969+0000","last_clean":"2024-09-22T08:12:51.131969+0000","last_became_active":"2024-09-22T08:10:49.180621+0000","last_became_peered":"2024-09-22T08:10:49.180621+0000","last_unstale":"2024-09-22T08:12:51.131969+0000","last_undegraded":"2024-09-22T08:12:51.131969+0000","last_fullsized":"2024-09-22T08:12:51.131969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:10.845059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206973+0000","last_change":"2024-09-22T08:10:51.190255+0000","last_active":"2024-09-22T08:11:23.206973+0000","last_peered":"2024-09-22T08:11:23.206973+0000","last_clean":"2024-09-22T08:11:23.206973+0000","last_became_active":"2024-09-22T08:10:51.189640+0000","last_became_peered":"2024-09-22T08:10:51.189640+0000","last_unstale":"2024-09-22T08:11:23.206973+0000","last_undegraded":"2024-09-22T08:11:23.206973+0000","last_fullsized":"2024-09-22T08:11:23.206973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:01.319577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228734+0000","last_change":"2024-09-22T08:10:45.166911+0000","last_active":"2024-09-22T08:13:53.228734+0000","last_peered":"2024-09-22T08:13:53.228734+0000","last_clean":"2024-09-22T08:13:53.228734+0000","last_became_active":"2024-09-22T08:10:45.166591+0000","last_became_peered":"2024-09-22T08:10:45.166591+0000","last_unstale":"2024-09-22T08:13:53.228734+0000","last_undegraded":"2024-09-22T08:13:53.228734+0000","last_fullsized":"2024-09-22T08:13:53.228734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:01.404622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209800+0000","last_change":"2024-09-22T08:10:43.196054+0000","last_active":"2024-09-22T08:11:23.209800+0000","last_peered":"2024-09-22T08:11:23.209800+0000","last_clean":"2024-09-22T08:11:23.209800+0000","last_became_active":"2024-09-22T08:10:43.195608+0000","last_became_peered":"2024-09-22T08:10:43.195608+0000","last_unstale":"2024-09-22T08:11:23.209800+0000","last_undegraded":"2024-09-22T08:11:23.209800+0000","last_fullsized":"2024-09-22T08:11:23.209800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:24.463602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222765+0000","last_change":"2024-09-22T08:10:47.173698+0000","last_active":"2024-09-22T08:11:23.222765+0000","last_peered":"2024-09-22T08:11:23.222765+0000","last_clean":"2024-09-22T08:11:23.222765+0000","last_became_active":"2024-09-22T08:10:47.173043+0000","last_became_peered":"2024-09-22T08:10:47.173043+0000","last_unstale":"2024-09-22T08:11:23.222765+0000","last_undegraded":"2024-09-22T08:11:23.222765+0000","last_fullsized":"2024-09-22T08:11:23.222765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:50.368872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.577548+0000","last_change":"2024-09-22T08:10:49.181954+0000","last_active":"2024-09-22T08:12:52.577548+0000","last_peered":"2024-09-22T08:12:52.577548+0000","last_clean":"2024-09-22T08:12:52.577548+0000","last_became_active":"2024-09-22T08:10:49.181611+0000","last_became_peered":"2024-09-22T08:10:49.181611+0000","last_unstale":"2024-09-22T08:12:52.577548+0000","last_undegraded":"2024-09-22T08:12:52.577548+0000","last_fullsized":"2024-09-22T08:12:52.577548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:12.944824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207395+0000","last_change":"2024-09-22T08:10:51.190156+0000","last_active":"2024-09-22T08:11:23.207395+0000","last_peered":"2024-09-22T08:11:23.207395+0000","last_clean":"2024-09-22T08:11:23.207395+0000","last_became_active":"2024-09-22T08:10:51.189592+0000","last_became_peered":"2024-09-22T08:10:51.189592+0000","last_unstale":"2024-09-22T08:11:23.207395+0000","last_undegraded":"2024-09-22T08:11:23.207395+0000","last_fullsized":"2024-09-22T08:11:23.207395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:44.042635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.513524+0000","last_change":"2024-09-22T08:10:53.199349+0000","last_active":"2024-09-22T08:12:52.513524+0000","last_peered":"2024-09-22T08:12:52.513524+0000","last_clean":"2024-09-22T08:12:52.513524+0000","last_became_active":"2024-09-22T08:10:53.198999+0000","last_became_peered":"2024-09-22T08:10:53.198999+0000","last_unstale":"2024-09-22T08:12:52.513524+0000","last_undegraded":"2024-09-22T08:12:52.513524+0000","last_fullsized":"2024-09-22T08:12:52.513524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:40.998103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'22","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183552+0000","last_change":"2024-09-22T08:10:45.183697+0000","last_active":"2024-09-22T08:13:53.183552+0000","last_peered":"2024-09-22T08:13:53.183552+0000","last_clean":"2024-09-22T08:13:53.183552+0000","last_became_active":"2024-09-22T08:10:45.183173+0000","last_became_peered":"2024-09-22T08:10:45.183173+0000","last_unstale":"2024-09-22T08:13:53.183552+0000","last_undegraded":"2024-09-22T08:13:53.183552+0000","last_fullsized":"2024-09-22T08:13:53.183552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:20.651086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.564042+0000","last_change":"2024-09-22T08:10:43.178081+0000","last_active":"2024-09-22T08:11:26.564042+0000","last_peered":"2024-09-22T08:11:26.564042+0000","last_clean":"2024-09-22T08:11:26.564042+0000","last_became_active":"2024-09-22T08:10:43.177711+0000","last_became_peered":"2024-09-22T08:10:43.177711+0000","last_unstale":"2024-09-22T08:11:26.564042+0000","last_undegraded":"2024-09-22T08:11:26.564042+0000","last_fullsized":"2024-09-22T08:11:26.564042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:58.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210165+0000","last_change":"2024-09-22T08:10:47.172301+0000","last_active":"2024-09-22T08:11:23.210165+0000","last_peered":"2024-09-22T08:11:23.210165+0000","last_clean":"2024-09-22T08:11:23.210165+0000","last_became_active":"2024-09-22T08:10:47.171702+0000","last_became_peered":"2024-09-22T08:10:47.171702+0000","last_unstale":"2024-09-22T08:11:23.210165+0000","last_undegraded":"2024-09-22T08:11:23.210165+0000","last_fullsized":"2024-09-22T08:11:23.210165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.251018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.132994+0000","last_change":"2024-09-22T08:10:49.183268+0000","last_active":"2024-09-22T08:12:51.132994+0000","last_peered":"2024-09-22T08:12:51.132994+0000","last_clean":"2024-09-22T08:12:51.132994+0000","last_became_active":"2024-09-22T08:10:49.182398+0000","last_became_peered":"2024-09-22T08:10:49.182398+0000","last_unstale":"2024-09-22T08:12:51.132994+0000","last_undegraded":"2024-09-22T08:12:51.132994+0000","last_fullsized":"2024-09-22T08:12:51.132994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:20.960730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214581+0000","last_change":"2024-09-22T08:10:51.202949+0000","last_active":"2024-09-22T08:11:23.214581+0000","last_peered":"2024-09-22T08:11:23.214581+0000","last_clean":"2024-09-22T08:11:23.214581+0000","last_became_active":"2024-09-22T08:10:51.202485+0000","last_became_peered":"2024-09-22T08:10:51.202485+0000","last_unstale":"2024-09-22T08:11:23.214581+0000","last_undegraded":"2024-09-22T08:11:23.214581+0000","last_fullsized":"2024-09-22T08:11:23.214581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.969767+0000","last_change":"2024-09-22T08:10:53.202374+0000","last_active":"2024-09-22T08:13:52.969767+0000","last_peered":"2024-09-22T08:13:52.969767+0000","last_clean":"2024-09-22T08:13:52.969767+0000","last_became_active":"2024-09-22T08:10:53.201942+0000","last_became_peered":"2024-09-22T08:10:53.201942+0000","last_unstale":"2024-09-22T08:13:52.969767+0000","last_undegraded":"2024-09-22T08:13:52.969767+0000","last_fullsized":"2024-09-22T08:13:52.969767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:00.185249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.345446+0000","last_change":"2024-09-22T08:10:45.183871+0000","last_active":"2024-09-22T08:11:26.345446+0000","last_peered":"2024-09-22T08:11:26.345446+0000","last_clean":"2024-09-22T08:11:26.345446+0000","last_became_active":"2024-09-22T08:10:45.183576+0000","last_became_peered":"2024-09-22T08:10:45.183576+0000","last_unstale":"2024-09-22T08:11:26.345446+0000","last_undegraded":"2024-09-22T08:11:26.345446+0000","last_fullsized":"2024-09-22T08:11:26.345446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:50.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212748+0000","last_change":"2024-09-22T08:10:43.179376+0000","last_active":"2024-09-22T08:11:23.212748+0000","last_peered":"2024-09-22T08:11:23.212748+0000","last_clean":"2024-09-22T08:11:23.212748+0000","last_became_active":"2024-09-22T08:10:43.178403+0000","last_became_peered":"2024-09-22T08:10:43.178403+0000","last_unstale":"2024-09-22T08:11:23.212748+0000","last_undegraded":"2024-09-22T08:11:23.212748+0000","last_fullsized":"2024-09-22T08:11:23.212748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:56.538345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208266+0000","last_change":"2024-09-22T08:10:47.172371+0000","last_active":"2024-09-22T08:11:23.208266+0000","last_peered":"2024-09-22T08:11:23.208266+0000","last_clean":"2024-09-22T08:11:23.208266+0000","last_became_active":"2024-09-22T08:10:47.171973+0000","last_became_peered":"2024-09-22T08:10:47.171973+0000","last_unstale":"2024-09-22T08:11:23.208266+0000","last_undegraded":"2024-09-22T08:11:23.208266+0000","last_fullsized":"2024-09-22T08:11:23.208266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:41.035575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:56.584606+0000","last_change":"2024-09-22T08:10:49.185261+0000","last_active":"2024-09-22T08:12:56.584606+0000","last_peered":"2024-09-22T08:12:56.584606+0000","last_clean":"2024-09-22T08:12:56.584606+0000","last_became_active":"2024-09-22T08:10:49.184885+0000","last_became_peered":"2024-09-22T08:10:49.184885+0000","last_unstale":"2024-09-22T08:12:56.584606+0000","last_undegraded":"2024-09-22T08:12:56.584606+0000","last_fullsized":"2024-09-22T08:12:56.584606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:29.150336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222373+0000","last_change":"2024-09-22T08:10:51.194317+0000","last_active":"2024-09-22T08:11:23.222373+0000","last_peered":"2024-09-22T08:11:23.222373+0000","last_clean":"2024-09-22T08:11:23.222373+0000","last_became_active":"2024-09-22T08:10:51.193970+0000","last_became_peered":"2024-09-22T08:10:51.193970+0000","last_unstale":"2024-09-22T08:11:23.222373+0000","last_undegraded":"2024-09-22T08:11:23.222373+0000","last_fullsized":"2024-09-22T08:11:23.222373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:52.931798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.572122+0000","last_change":"2024-09-22T08:10:53.202778+0000","last_active":"2024-09-22T08:12:52.572122+0000","last_peered":"2024-09-22T08:12:52.572122+0000","last_clean":"2024-09-22T08:12:52.572122+0000","last_became_active":"2024-09-22T08:10:53.202493+0000","last_became_peered":"2024-09-22T08:10:53.202493+0000","last_unstale":"2024-09-22T08:12:52.572122+0000","last_undegraded":"2024-09-22T08:12:52.572122+0000","last_fullsized":"2024-09-22T08:12:52.572122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:44.822421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828530+0000","last_change":"2024-09-22T08:10:45.167131+0000","last_active":"2024-09-22T08:12:08.828530+0000","last_peered":"2024-09-22T08:12:08.828530+0000","last_clean":"2024-09-22T08:12:08.828530+0000","last_became_active":"2024-09-22T08:10:45.166540+0000","last_became_peered":"2024-09-22T08:10:45.166540+0000","last_unstale":"2024-09-22T08:12:08.828530+0000","last_undegraded":"2024-09-22T08:12:08.828530+0000","last_fullsized":"2024-09-22T08:12:08.828530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:51.203215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211107+0000","last_change":"2024-09-22T08:10:43.200355+0000","last_active":"2024-09-22T08:11:23.211107+0000","last_peered":"2024-09-22T08:11:23.211107+0000","last_clean":"2024-09-22T08:11:23.211107+0000","last_became_active":"2024-09-22T08:10:43.199724+0000","last_became_peered":"2024-09-22T08:10:43.199724+0000","last_unstale":"2024-09-22T08:11:23.211107+0000","last_undegraded":"2024-09-22T08:11:23.211107+0000","last_fullsized":"2024-09-22T08:11:23.211107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:25.660243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214717+0000","last_change":"2024-09-22T08:10:47.175833+0000","last_active":"2024-09-22T08:11:23.214717+0000","last_peered":"2024-09-22T08:11:23.214717+0000","last_clean":"2024-09-22T08:11:23.214717+0000","last_became_active":"2024-09-22T08:10:47.175541+0000","last_became_peered":"2024-09-22T08:10:47.175541+0000","last_unstale":"2024-09-22T08:11:23.214717+0000","last_undegraded":"2024-09-22T08:11:23.214717+0000","last_fullsized":"2024-09-22T08:11:23.214717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:17.796324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584978+0000","last_change":"2024-09-22T08:10:49.188295+0000","last_active":"2024-09-22T08:12:52.584978+0000","last_peered":"2024-09-22T08:12:52.584978+0000","last_clean":"2024-09-22T08:12:52.584978+0000","last_became_active":"2024-09-22T08:10:49.187767+0000","last_became_peered":"2024-09-22T08:10:49.187767+0000","last_unstale":"2024-09-22T08:12:52.584978+0000","last_undegraded":"2024-09-22T08:12:52.584978+0000","last_fullsized":"2024-09-22T08:12:52.584978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:02.055272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":367,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254414+0000","last_change":"2024-09-22T08:10:51.198099+0000","last_active":"2024-09-22T08:13:52.254414+0000","last_peered":"2024-09-22T08:13:52.254414+0000","last_clean":"2024-09-22T08:13:52.254414+0000","last_became_active":"2024-09-22T08:10:51.197814+0000","last_became_peered":"2024-09-22T08:10:51.197814+0000","last_unstale":"2024-09-22T08:13:52.254414+0000","last_undegraded":"2024-09-22T08:13:52.254414+0000","last_fullsized":"2024-09-22T08:13:52.254414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.509973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209032+0000","last_change":"2024-09-22T08:10:53.200170+0000","last_active":"2024-09-22T08:11:23.209032+0000","last_peered":"2024-09-22T08:11:23.209032+0000","last_clean":"2024-09-22T08:11:23.209032+0000","last_became_active":"2024-09-22T08:10:53.199881+0000","last_became_peered":"2024-09-22T08:10:53.199881+0000","last_unstale":"2024-09-22T08:11:23.209032+0000","last_undegraded":"2024-09-22T08:11:23.209032+0000","last_fullsized":"2024-09-22T08:11:23.209032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:46.946049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208021+0000","last_change":"2024-09-22T08:10:45.166388+0000","last_active":"2024-09-22T08:11:23.208021+0000","last_peered":"2024-09-22T08:11:23.208021+0000","last_clean":"2024-09-22T08:11:23.208021+0000","last_became_active":"2024-09-22T08:10:45.166103+0000","last_became_peered":"2024-09-22T08:10:45.166103+0000","last_unstale":"2024-09-22T08:11:23.208021+0000","last_undegraded":"2024-09-22T08:11:23.208021+0000","last_fullsized":"2024-09-22T08:11:23.208021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:07.647439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.587783+0000","last_change":"2024-09-22T08:10:43.180475+0000","last_active":"2024-09-22T08:13:12.587783+0000","last_peered":"2024-09-22T08:13:12.587783+0000","last_clean":"2024-09-22T08:13:12.587783+0000","last_became_active":"2024-09-22T08:10:43.180097+0000","last_became_peered":"2024-09-22T08:10:43.180097+0000","last_unstale":"2024-09-22T08:13:12.587783+0000","last_undegraded":"2024-09-22T08:13:12.587783+0000","last_fullsized":"2024-09-22T08:13:12.587783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:37.378948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212558+0000","last_change":"2024-09-22T08:10:47.175982+0000","last_active":"2024-09-22T08:11:23.212558+0000","last_peered":"2024-09-22T08:11:23.212558+0000","last_clean":"2024-09-22T08:11:23.212558+0000","last_became_active":"2024-09-22T08:10:47.175604+0000","last_became_peered":"2024-09-22T08:10:47.175604+0000","last_unstale":"2024-09-22T08:11:23.212558+0000","last_undegraded":"2024-09-22T08:11:23.212558+0000","last_fullsized":"2024-09-22T08:11:23.212558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:15.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.123249+0000","last_change":"2024-09-22T08:10:49.176102+0000","last_active":"2024-09-22T08:12:51.123249+0000","last_peered":"2024-09-22T08:12:51.123249+0000","last_clean":"2024-09-22T08:12:51.123249+0000","last_became_active":"2024-09-22T08:10:49.175817+0000","last_became_peered":"2024-09-22T08:10:49.175817+0000","last_unstale":"2024-09-22T08:12:51.123249+0000","last_undegraded":"2024-09-22T08:12:51.123249+0000","last_fullsized":"2024-09-22T08:12:51.123249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:19.626204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.219931+0000","last_change":"2024-09-22T08:10:51.192395+0000","last_active":"2024-09-22T08:11:23.219931+0000","last_peered":"2024-09-22T08:11:23.219931+0000","last_clean":"2024-09-22T08:11:23.219931+0000","last_became_active":"2024-09-22T08:10:51.191988+0000","last_became_peered":"2024-09-22T08:10:51.191988+0000","last_unstale":"2024-09-22T08:11:23.219931+0000","last_undegraded":"2024-09-22T08:11:23.219931+0000","last_fullsized":"2024-09-22T08:11:23.219931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216778+0000","last_change":"2024-09-22T08:10:53.199421+0000","last_active":"2024-09-22T08:11:23.216778+0000","last_peered":"2024-09-22T08:11:23.216778+0000","last_clean":"2024-09-22T08:11:23.216778+0000","last_became_active":"2024-09-22T08:10:53.199158+0000","last_became_peered":"2024-09-22T08:10:53.199158+0000","last_unstale":"2024-09-22T08:11:23.216778+0000","last_undegraded":"2024-09-22T08:11:23.216778+0000","last_fullsized":"2024-09-22T08:11:23.216778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:32.896582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.005197+0000","last_change":"2024-09-22T08:10:45.165605+0000","last_active":"2024-09-22T08:11:26.005197+0000","last_peered":"2024-09-22T08:11:26.005197+0000","last_clean":"2024-09-22T08:11:26.005197+0000","last_became_active":"2024-09-22T08:10:45.165116+0000","last_became_peered":"2024-09-22T08:10:45.165116+0000","last_unstale":"2024-09-22T08:11:26.005197+0000","last_undegraded":"2024-09-22T08:11:26.005197+0000","last_fullsized":"2024-09-22T08:11:26.005197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:29.645770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211112+0000","last_change":"2024-09-22T08:10:43.202146+0000","last_active":"2024-09-22T08:11:23.211112+0000","last_peered":"2024-09-22T08:11:23.211112+0000","last_clean":"2024-09-22T08:11:23.211112+0000","last_became_active":"2024-09-22T08:10:43.201076+0000","last_became_peered":"2024-09-22T08:10:43.201076+0000","last_unstale":"2024-09-22T08:11:23.211112+0000","last_undegraded":"2024-09-22T08:11:23.211112+0000","last_fullsized":"2024-09-22T08:11:23.211112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:43.112413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208142+0000","last_change":"2024-09-22T08:10:47.173239+0000","last_active":"2024-09-22T08:11:23.208142+0000","last_peered":"2024-09-22T08:11:23.208142+0000","last_clean":"2024-09-22T08:11:23.208142+0000","last_became_active":"2024-09-22T08:10:47.172988+0000","last_became_peered":"2024-09-22T08:10:47.172988+0000","last_unstale":"2024-09-22T08:11:23.208142+0000","last_undegraded":"2024-09-22T08:11:23.208142+0000","last_fullsized":"2024-09-22T08:11:23.208142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:57.256991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.124336+0000","last_change":"2024-09-22T08:10:49.185163+0000","last_active":"2024-09-22T08:12:51.124336+0000","last_peered":"2024-09-22T08:12:51.124336+0000","last_clean":"2024-09-22T08:12:51.124336+0000","last_became_active":"2024-09-22T08:10:49.184860+0000","last_became_peered":"2024-09-22T08:10:49.184860+0000","last_unstale":"2024-09-22T08:12:51.124336+0000","last_undegraded":"2024-09-22T08:12:51.124336+0000","last_fullsized":"2024-09-22T08:12:51.124336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.255387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209254+0000","last_change":"2024-09-22T08:10:51.200556+0000","last_active":"2024-09-22T08:11:23.209254+0000","last_peered":"2024-09-22T08:11:23.209254+0000","last_clean":"2024-09-22T08:11:23.209254+0000","last_became_active":"2024-09-22T08:10:51.199870+0000","last_became_peered":"2024-09-22T08:10:51.199870+0000","last_unstale":"2024-09-22T08:11:23.209254+0000","last_undegraded":"2024-09-22T08:11:23.209254+0000","last_fullsized":"2024-09-22T08:11:23.209254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.684662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212091+0000","last_change":"2024-09-22T08:10:53.201219+0000","last_active":"2024-09-22T08:11:23.212091+0000","last_peered":"2024-09-22T08:11:23.212091+0000","last_clean":"2024-09-22T08:11:23.212091+0000","last_became_active":"2024-09-22T08:10:53.200904+0000","last_became_peered":"2024-09-22T08:10:53.200904+0000","last_unstale":"2024-09-22T08:11:23.212091+0000","last_undegraded":"2024-09-22T08:11:23.212091+0000","last_fullsized":"2024-09-22T08:11:23.212091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:58.296182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'9","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.588330+0000","last_change":"2024-09-22T08:10:45.165741+0000","last_active":"2024-09-22T08:13:12.588330+0000","last_peered":"2024-09-22T08:13:12.588330+0000","last_clean":"2024-09-22T08:13:12.588330+0000","last_became_active":"2024-09-22T08:10:45.165511+0000","last_became_peered":"2024-09-22T08:10:45.165511+0000","last_unstale":"2024-09-22T08:13:12.588330+0000","last_undegraded":"2024-09-22T08:13:12.588330+0000","last_fullsized":"2024-09-22T08:13:12.588330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:15.789333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223338+0000","last_change":"2024-09-22T08:10:43.177415+0000","last_active":"2024-09-22T08:11:23.223338+0000","last_peered":"2024-09-22T08:11:23.223338+0000","last_clean":"2024-09-22T08:11:23.223338+0000","last_became_active":"2024-09-22T08:10:43.176954+0000","last_became_peered":"2024-09-22T08:10:43.176954+0000","last_unstale":"2024-09-22T08:11:23.223338+0000","last_undegraded":"2024-09-22T08:11:23.223338+0000","last_fullsized":"2024-09-22T08:11:23.223338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:24.996283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210491+0000","last_change":"2024-09-22T08:10:47.176984+0000","last_active":"2024-09-22T08:11:23.210491+0000","last_peered":"2024-09-22T08:11:23.210491+0000","last_clean":"2024-09-22T08:11:23.210491+0000","last_became_active":"2024-09-22T08:10:47.176641+0000","last_became_peered":"2024-09-22T08:10:47.176641+0000","last_unstale":"2024-09-22T08:11:23.210491+0000","last_undegraded":"2024-09-22T08:11:23.210491+0000","last_fullsized":"2024-09-22T08:11:23.210491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:49.329521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.148968+0000","last_change":"2024-09-22T08:10:49.188256+0000","last_active":"2024-09-22T08:12:51.148968+0000","last_peered":"2024-09-22T08:12:51.148968+0000","last_clean":"2024-09-22T08:12:51.148968+0000","last_became_active":"2024-09-22T08:10:49.187467+0000","last_became_peered":"2024-09-22T08:10:49.187467+0000","last_unstale":"2024-09-22T08:12:51.148968+0000","last_undegraded":"2024-09-22T08:12:51.148968+0000","last_fullsized":"2024-09-22T08:12:51.148968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:27.242973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209400+0000","last_change":"2024-09-22T08:10:51.198209+0000","last_active":"2024-09-22T08:11:23.209400+0000","last_peered":"2024-09-22T08:11:23.209400+0000","last_clean":"2024-09-22T08:11:23.209400+0000","last_became_active":"2024-09-22T08:10:51.197942+0000","last_became_peered":"2024-09-22T08:10:51.197942+0000","last_unstale":"2024-09-22T08:11:23.209400+0000","last_undegraded":"2024-09-22T08:11:23.209400+0000","last_fullsized":"2024-09-22T08:11:23.209400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:42.833261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.573626+0000","last_change":"2024-09-22T08:10:53.204064+0000","last_active":"2024-09-22T08:12:52.573626+0000","last_peered":"2024-09-22T08:12:52.573626+0000","last_clean":"2024-09-22T08:12:52.573626+0000","last_became_active":"2024-09-22T08:10:53.203791+0000","last_became_peered":"2024-09-22T08:10:53.203791+0000","last_unstale":"2024-09-22T08:12:52.573626+0000","last_undegraded":"2024-09-22T08:12:52.573626+0000","last_fullsized":"2024-09-22T08:12:52.573626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:42.795444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042279+0000","last_change":"2024-09-22T08:10:45.164568+0000","last_active":"2024-09-22T08:13:53.042279+0000","last_peered":"2024-09-22T08:13:53.042279+0000","last_clean":"2024-09-22T08:13:53.042279+0000","last_became_active":"2024-09-22T08:10:45.163402+0000","last_became_peered":"2024-09-22T08:10:45.163402+0000","last_unstale":"2024-09-22T08:13:53.042279+0000","last_undegraded":"2024-09-22T08:13:53.042279+0000","last_fullsized":"2024-09-22T08:13:53.042279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:31.128783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216675+0000","last_change":"2024-09-22T08:10:43.185767+0000","last_active":"2024-09-22T08:11:23.216675+0000","last_peered":"2024-09-22T08:11:23.216675+0000","last_clean":"2024-09-22T08:11:23.216675+0000","last_became_active":"2024-09-22T08:10:43.184777+0000","last_became_peered":"2024-09-22T08:10:43.184777+0000","last_unstale":"2024-09-22T08:11:23.216675+0000","last_undegraded":"2024-09-22T08:11:23.216675+0000","last_fullsized":"2024-09-22T08:11:23.216675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:44.875297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.796204+0000","last_change":"2024-09-22T08:10:47.176659+0000","last_active":"2024-09-22T08:12:49.796204+0000","last_peered":"2024-09-22T08:12:49.796204+0000","last_clean":"2024-09-22T08:12:49.796204+0000","last_became_active":"2024-09-22T08:10:47.176390+0000","last_became_peered":"2024-09-22T08:10:47.176390+0000","last_unstale":"2024-09-22T08:12:49.796204+0000","last_undegraded":"2024-09-22T08:12:49.796204+0000","last_fullsized":"2024-09-22T08:12:49.796204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:24.829227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'34","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.591839+0000","last_change":"2024-09-22T08:10:49.189639+0000","last_active":"2024-09-22T08:13:52.591839+0000","last_peered":"2024-09-22T08:13:52.591839+0000","last_clean":"2024-09-22T08:13:52.591839+0000","last_became_active":"2024-09-22T08:10:49.188231+0000","last_became_peered":"2024-09-22T08:10:49.188231+0000","last_unstale":"2024-09-22T08:13:52.591839+0000","last_undegraded":"2024-09-22T08:13:52.591839+0000","last_fullsized":"2024-09-22T08:13:52.591839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:08.360453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":51,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221258+0000","last_change":"2024-09-22T08:10:51.202802+0000","last_active":"2024-09-22T08:11:23.221258+0000","last_peered":"2024-09-22T08:11:23.221258+0000","last_clean":"2024-09-22T08:11:23.221258+0000","last_became_active":"2024-09-22T08:10:51.202476+0000","last_became_peered":"2024-09-22T08:10:51.202476+0000","last_unstale":"2024-09-22T08:11:23.221258+0000","last_undegraded":"2024-09-22T08:11:23.221258+0000","last_fullsized":"2024-09-22T08:11:23.221258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.161803+0000","last_change":"2024-09-22T08:10:53.201417+0000","last_active":"2024-09-22T08:12:51.161803+0000","last_peered":"2024-09-22T08:12:51.161803+0000","last_clean":"2024-09-22T08:12:51.161803+0000","last_became_active":"2024-09-22T08:10:53.201125+0000","last_became_peered":"2024-09-22T08:10:53.201125+0000","last_unstale":"2024-09-22T08:12:51.161803+0000","last_undegraded":"2024-09-22T08:12:51.161803+0000","last_fullsized":"2024-09-22T08:12:51.161803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:16.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254853+0000","last_change":"2024-09-22T08:10:45.181046+0000","last_active":"2024-09-22T08:13:53.254853+0000","last_peered":"2024-09-22T08:13:53.254853+0000","last_clean":"2024-09-22T08:13:53.254853+0000","last_became_active":"2024-09-22T08:10:45.180781+0000","last_became_peered":"2024-09-22T08:10:45.180781+0000","last_unstale":"2024-09-22T08:13:53.254853+0000","last_undegraded":"2024-09-22T08:13:53.254853+0000","last_fullsized":"2024-09-22T08:13:53.254853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:50.052801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.529697+0000","last_change":"2024-09-22T08:10:43.183556+0000","last_active":"2024-09-22T08:12:52.529697+0000","last_peered":"2024-09-22T08:12:52.529697+0000","last_clean":"2024-09-22T08:12:52.529697+0000","last_became_active":"2024-09-22T08:10:43.179693+0000","last_became_peered":"2024-09-22T08:10:43.179693+0000","last_unstale":"2024-09-22T08:12:52.529697+0000","last_undegraded":"2024-09-22T08:12:52.529697+0000","last_fullsized":"2024-09-22T08:12:52.529697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:56.127185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.950213+0000","last_change":"2024-09-22T08:10:45.164763+0000","last_active":"2024-09-22T08:13:52.950213+0000","last_peered":"2024-09-22T08:13:52.950213+0000","last_clean":"2024-09-22T08:13:52.950213+0000","last_became_active":"2024-09-22T08:10:45.164406+0000","last_became_peered":"2024-09-22T08:10:45.164406+0000","last_unstale":"2024-09-22T08:13:52.950213+0000","last_undegraded":"2024-09-22T08:13:52.950213+0000","last_fullsized":"2024-09-22T08:13:52.950213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:37.404156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.557173+0000","last_change":"2024-09-22T08:10:43.178608+0000","last_active":"2024-09-22T08:11:26.557173+0000","last_peered":"2024-09-22T08:11:26.557173+0000","last_clean":"2024-09-22T08:11:26.557173+0000","last_became_active":"2024-09-22T08:10:43.178018+0000","last_became_peered":"2024-09-22T08:10:43.178018+0000","last_unstale":"2024-09-22T08:11:26.557173+0000","last_undegraded":"2024-09-22T08:11:26.557173+0000","last_fullsized":"2024-09-22T08:11:26.557173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:25.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227865+0000","last_change":"2024-09-22T08:10:45.170408+0000","last_active":"2024-09-22T08:13:53.227865+0000","last_peered":"2024-09-22T08:13:53.227865+0000","last_clean":"2024-09-22T08:13:53.227865+0000","last_became_active":"2024-09-22T08:10:45.168526+0000","last_became_peered":"2024-09-22T08:10:45.168526+0000","last_unstale":"2024-09-22T08:13:53.227865+0000","last_undegraded":"2024-09-22T08:13:53.227865+0000","last_fullsized":"2024-09-22T08:13:53.227865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:17.590758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":86,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209592+0000","last_change":"2024-09-22T08:10:43.198536+0000","last_active":"2024-09-22T08:11:23.209592+0000","last_peered":"2024-09-22T08:11:23.209592+0000","last_clean":"2024-09-22T08:11:23.209592+0000","last_became_active":"2024-09-22T08:10:43.196221+0000","last_became_peered":"2024-09-22T08:10:43.196221+0000","last_unstale":"2024-09-22T08:11:23.209592+0000","last_undegraded":"2024-09-22T08:11:23.209592+0000","last_fullsized":"2024-09-22T08:11:23.209592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:05.712585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.166823+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.166432+0000","last_became_peered":"2024-09-22T08:10:45.166432+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:07.715456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.834623+0000","last_change":"2024-09-22T08:10:43.178126+0000","last_active":"2024-09-22T08:13:52.834623+0000","last_peered":"2024-09-22T08:13:52.834623+0000","last_clean":"2024-09-22T08:13:52.834623+0000","last_became_active":"2024-09-22T08:10:43.177673+0000","last_became_peered":"2024-09-22T08:10:43.177673+0000","last_unstale":"2024-09-22T08:13:52.834623+0000","last_undegraded":"2024-09-22T08:13:52.834623+0000","last_fullsized":"2024-09-22T08:13:52.834623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:44.875297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.575693+0000","last_change":"2024-09-22T08:10:45.171880+0000","last_active":"2024-09-22T08:12:52.575693+0000","last_peered":"2024-09-22T08:12:52.575693+0000","last_clean":"2024-09-22T08:12:52.575693+0000","last_became_active":"2024-09-22T08:10:45.171476+0000","last_became_peered":"2024-09-22T08:10:45.171476+0000","last_unstale":"2024-09-22T08:12:52.575693+0000","last_undegraded":"2024-09-22T08:12:52.575693+0000","last_fullsized":"2024-09-22T08:12:52.575693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:09.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221609+0000","last_change":"2024-09-22T08:10:43.187785+0000","last_active":"2024-09-22T08:11:23.221609+0000","last_peered":"2024-09-22T08:11:23.221609+0000","last_clean":"2024-09-22T08:11:23.221609+0000","last_became_active":"2024-09-22T08:10:43.186671+0000","last_became_peered":"2024-09-22T08:10:43.186671+0000","last_unstale":"2024-09-22T08:11:23.221609+0000","last_undegraded":"2024-09-22T08:11:23.221609+0000","last_fullsized":"2024-09-22T08:11:23.221609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:34.692797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.952726+0000","last_change":"2024-09-22T08:10:45.183046+0000","last_active":"2024-09-22T08:13:52.952726+0000","last_peered":"2024-09-22T08:13:52.952726+0000","last_clean":"2024-09-22T08:13:52.952726+0000","last_became_active":"2024-09-22T08:10:45.182785+0000","last_became_peered":"2024-09-22T08:10:45.182785+0000","last_unstale":"2024-09-22T08:13:52.952726+0000","last_undegraded":"2024-09-22T08:13:52.952726+0000","last_fullsized":"2024-09-22T08:13:52.952726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:51.776555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.484272+0000","last_change":"2024-09-22T08:10:43.183177+0000","last_active":"2024-09-22T08:12:52.484272+0000","last_peered":"2024-09-22T08:12:52.484272+0000","last_clean":"2024-09-22T08:12:52.484272+0000","last_became_active":"2024-09-22T08:10:43.182824+0000","last_became_peered":"2024-09-22T08:10:43.182824+0000","last_unstale":"2024-09-22T08:12:52.484272+0000","last_undegraded":"2024-09-22T08:12:52.484272+0000","last_fullsized":"2024-09-22T08:12:52.484272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:25.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'25","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.263612+0000","last_change":"2024-09-22T08:10:45.175920+0000","last_active":"2024-09-22T08:13:53.263612+0000","last_peered":"2024-09-22T08:13:53.263612+0000","last_clean":"2024-09-22T08:13:53.263612+0000","last_became_active":"2024-09-22T08:10:45.175600+0000","last_became_peered":"2024-09-22T08:10:45.175600+0000","last_unstale":"2024-09-22T08:13:53.263612+0000","last_undegraded":"2024-09-22T08:13:53.263612+0000","last_fullsized":"2024-09-22T08:13:53.263612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:53.580143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211182+0000","last_change":"2024-09-22T08:10:43.183024+0000","last_active":"2024-09-22T08:11:23.211182+0000","last_peered":"2024-09-22T08:11:23.211182+0000","last_clean":"2024-09-22T08:11:23.211182+0000","last_became_active":"2024-09-22T08:10:43.179529+0000","last_became_peered":"2024-09-22T08:10:43.179529+0000","last_unstale":"2024-09-22T08:11:23.211182+0000","last_undegraded":"2024-09-22T08:11:23.211182+0000","last_fullsized":"2024-09-22T08:11:23.211182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:25.240566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042521+0000","last_change":"2024-09-22T08:10:45.184241+0000","last_active":"2024-09-22T08:13:53.042521+0000","last_peered":"2024-09-22T08:13:53.042521+0000","last_clean":"2024-09-22T08:13:53.042521+0000","last_became_active":"2024-09-22T08:10:45.183901+0000","last_became_peered":"2024-09-22T08:10:45.183901+0000","last_unstale":"2024-09-22T08:13:53.042521+0000","last_undegraded":"2024-09-22T08:13:53.042521+0000","last_fullsized":"2024-09-22T08:13:53.042521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:28:48.567601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:56.584617+0000","last_change":"2024-09-22T08:10:43.178191+0000","last_active":"2024-09-22T08:12:56.584617+0000","last_peered":"2024-09-22T08:12:56.584617+0000","last_clean":"2024-09-22T08:12:56.584617+0000","last_became_active":"2024-09-22T08:10:43.177461+0000","last_became_peered":"2024-09-22T08:10:43.177461+0000","last_unstale":"2024-09-22T08:12:56.584617+0000","last_undegraded":"2024-09-22T08:12:56.584617+0000","last_fullsized":"2024-09-22T08:12:56.584617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:55.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.952431+0000","last_change":"2024-09-22T08:10:45.170004+0000","last_active":"2024-09-22T08:13:52.952431+0000","last_peered":"2024-09-22T08:13:52.952431+0000","last_clean":"2024-09-22T08:13:52.952431+0000","last_became_active":"2024-09-22T08:10:45.169723+0000","last_became_peered":"2024-09-22T08:10:45.169723+0000","last_unstale":"2024-09-22T08:13:52.952431+0000","last_undegraded":"2024-09-22T08:13:52.952431+0000","last_fullsized":"2024-09-22T08:13:52.952431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:45.662588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212281+0000","last_change":"2024-09-22T08:10:43.196560+0000","last_active":"2024-09-22T08:11:23.212281+0000","last_peered":"2024-09-22T08:11:23.212281+0000","last_clean":"2024-09-22T08:11:23.212281+0000","last_became_active":"2024-09-22T08:10:43.195587+0000","last_became_peered":"2024-09-22T08:10:43.195587+0000","last_unstale":"2024-09-22T08:11:23.212281+0000","last_undegraded":"2024-09-22T08:11:23.212281+0000","last_fullsized":"2024-09-22T08:11:23.212281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:23.625176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183433+0000","last_change":"2024-09-22T08:10:45.170370+0000","last_active":"2024-09-22T08:13:53.183433+0000","last_peered":"2024-09-22T08:13:53.183433+0000","last_clean":"2024-09-22T08:13:53.183433+0000","last_became_active":"2024-09-22T08:10:45.169366+0000","last_became_peered":"2024-09-22T08:10:45.169366+0000","last_unstale":"2024-09-22T08:13:53.183433+0000","last_undegraded":"2024-09-22T08:13:53.183433+0000","last_fullsized":"2024-09-22T08:13:53.183433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.634336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.915352+0000","last_change":"2024-09-22T08:10:43.187942+0000","last_active":"2024-09-22T08:13:52.915352+0000","last_peered":"2024-09-22T08:13:52.915352+0000","last_clean":"2024-09-22T08:13:52.915352+0000","last_became_active":"2024-09-22T08:10:43.187246+0000","last_became_peered":"2024-09-22T08:10:43.187246+0000","last_unstale":"2024-09-22T08:13:52.915352+0000","last_undegraded":"2024-09-22T08:13:52.915352+0000","last_fullsized":"2024-09-22T08:13:52.915352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:56.538345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.044952+0000","last_change":"2024-09-22T08:10:45.172556+0000","last_active":"2024-09-22T08:13:53.044952+0000","last_peered":"2024-09-22T08:13:53.044952+0000","last_clean":"2024-09-22T08:13:53.044952+0000","last_became_active":"2024-09-22T08:10:45.172080+0000","last_became_peered":"2024-09-22T08:10:45.172080+0000","last_unstale":"2024-09-22T08:13:53.044952+0000","last_undegraded":"2024-09-22T08:13:53.044952+0000","last_fullsized":"2024-09-22T08:13:53.044952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:33.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213039+0000","last_change":"2024-09-22T08:10:43.179415+0000","last_active":"2024-09-22T08:11:23.213039+0000","last_peered":"2024-09-22T08:11:23.213039+0000","last_clean":"2024-09-22T08:11:23.213039+0000","last_became_active":"2024-09-22T08:10:43.178924+0000","last_became_peered":"2024-09-22T08:10:43.178924+0000","last_unstale":"2024-09-22T08:11:23.213039+0000","last_undegraded":"2024-09-22T08:11:23.213039+0000","last_fullsized":"2024-09-22T08:11:23.213039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:05.127567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'15","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.190568+0000","last_change":"2024-09-22T08:10:45.172376+0000","last_active":"2024-09-22T08:13:53.190568+0000","last_peered":"2024-09-22T08:13:53.190568+0000","last_clean":"2024-09-22T08:13:53.190568+0000","last_became_active":"2024-09-22T08:10:45.172101+0000","last_became_peered":"2024-09-22T08:10:45.172101+0000","last_unstale":"2024-09-22T08:13:53.190568+0000","last_undegraded":"2024-09-22T08:13:53.190568+0000","last_fullsized":"2024-09-22T08:13:53.190568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:42.945533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213721+0000","last_change":"2024-09-22T08:10:43.179255+0000","last_active":"2024-09-22T08:11:23.213721+0000","last_peered":"2024-09-22T08:11:23.213721+0000","last_clean":"2024-09-22T08:11:23.213721+0000","last_became_active":"2024-09-22T08:10:43.178876+0000","last_became_peered":"2024-09-22T08:10:43.178876+0000","last_unstale":"2024-09-22T08:11:23.213721+0000","last_undegraded":"2024-09-22T08:11:23.213721+0000","last_fullsized":"2024-09-22T08:11:23.213721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:40:11.526265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.829072+0000","last_change":"2024-09-22T08:10:45.180356+0000","last_active":"2024-09-22T08:12:08.829072+0000","last_peered":"2024-09-22T08:12:08.829072+0000","last_clean":"2024-09-22T08:12:08.829072+0000","last_became_active":"2024-09-22T08:10:45.180117+0000","last_became_peered":"2024-09-22T08:10:45.180117+0000","last_unstale":"2024-09-22T08:12:08.829072+0000","last_undegraded":"2024-09-22T08:12:08.829072+0000","last_fullsized":"2024-09-22T08:12:08.829072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:07.097290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211963+0000","last_change":"2024-09-22T08:10:43.196149+0000","last_active":"2024-09-22T08:11:23.211963+0000","last_peered":"2024-09-22T08:11:23.211963+0000","last_clean":"2024-09-22T08:11:23.211963+0000","last_became_active":"2024-09-22T08:10:43.195770+0000","last_became_peered":"2024-09-22T08:10:43.195770+0000","last_unstale":"2024-09-22T08:11:23.211963+0000","last_undegraded":"2024-09-22T08:11:23.211963+0000","last_fullsized":"2024-09-22T08:11:23.211963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:35.401285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183848+0000","last_change":"2024-09-22T08:10:45.180354+0000","last_active":"2024-09-22T08:13:53.183848+0000","last_peered":"2024-09-22T08:13:53.183848+0000","last_clean":"2024-09-22T08:13:53.183848+0000","last_became_active":"2024-09-22T08:10:45.180098+0000","last_became_peered":"2024-09-22T08:10:45.180098+0000","last_unstale":"2024-09-22T08:13:53.183848+0000","last_undegraded":"2024-09-22T08:13:53.183848+0000","last_fullsized":"2024-09-22T08:13:53.183848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:45.833791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213202+0000","last_change":"2024-09-22T08:10:43.202451+0000","last_active":"2024-09-22T08:11:23.213202+0000","last_peered":"2024-09-22T08:11:23.213202+0000","last_clean":"2024-09-22T08:11:23.213202+0000","last_became_active":"2024-09-22T08:10:43.201687+0000","last_became_peered":"2024-09-22T08:10:43.201687+0000","last_unstale":"2024-09-22T08:11:23.213202+0000","last_undegraded":"2024-09-22T08:11:23.213202+0000","last_fullsized":"2024-09-22T08:11:23.213202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:03.394369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037719+0000","last_change":"2024-09-22T08:11:23.222217+0000","last_active":"2024-09-22T08:11:27.037719+0000","last_peered":"2024-09-22T08:11:27.037719+0000","last_clean":"2024-09-22T08:11:27.037719+0000","last_became_active":"2024-09-22T08:11:23.215110+0000","last_became_peered":"2024-09-22T08:11:23.215110+0000","last_unstale":"2024-09-22T08:11:27.037719+0000","last_undegraded":"2024-09-22T08:11:27.037719+0000","last_fullsized":"2024-09-22T08:11:27.037719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:56.580950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.560515+0000","last_change":"2024-09-22T08:10:43.190134+0000","last_active":"2024-09-22T08:11:25.560515+0000","last_peered":"2024-09-22T08:11:25.560515+0000","last_clean":"2024-09-22T08:11:25.560515+0000","last_became_active":"2024-09-22T08:10:43.187195+0000","last_became_peered":"2024-09-22T08:10:43.187195+0000","last_unstale":"2024-09-22T08:11:25.560515+0000","last_undegraded":"2024-09-22T08:11:25.560515+0000","last_fullsized":"2024-09-22T08:11:25.560515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:28.903101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183984+0000","last_change":"2024-09-22T08:10:45.179422+0000","last_active":"2024-09-22T08:13:53.183984+0000","last_peered":"2024-09-22T08:13:53.183984+0000","last_clean":"2024-09-22T08:13:53.183984+0000","last_became_active":"2024-09-22T08:10:45.179150+0000","last_became_peered":"2024-09-22T08:10:45.179150+0000","last_unstale":"2024-09-22T08:13:53.183984+0000","last_undegraded":"2024-09-22T08:13:53.183984+0000","last_fullsized":"2024-09-22T08:13:53.183984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:32.350768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213258+0000","last_change":"2024-09-22T08:10:43.200646+0000","last_active":"2024-09-22T08:11:23.213258+0000","last_peered":"2024-09-22T08:11:23.213258+0000","last_clean":"2024-09-22T08:11:23.213258+0000","last_became_active":"2024-09-22T08:10:43.200282+0000","last_became_peered":"2024-09-22T08:10:43.200282+0000","last_unstale":"2024-09-22T08:11:23.213258+0000","last_undegraded":"2024-09-22T08:11:23.213258+0000","last_fullsized":"2024-09-22T08:11:23.213258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:40.745524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.560615+0000","last_change":"2024-09-22T08:10:43.190222+0000","last_active":"2024-09-22T08:11:26.560615+0000","last_peered":"2024-09-22T08:11:26.560615+0000","last_clean":"2024-09-22T08:11:26.560615+0000","last_became_active":"2024-09-22T08:10:43.189848+0000","last_became_peered":"2024-09-22T08:10:43.189848+0000","last_unstale":"2024-09-22T08:11:26.560615+0000","last_undegraded":"2024-09-22T08:11:26.560615+0000","last_fullsized":"2024-09-22T08:11:26.560615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:06.237724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.234367+0000","last_change":"2024-09-22T08:10:45.183685+0000","last_active":"2024-09-22T08:13:53.234367+0000","last_peered":"2024-09-22T08:13:53.234367+0000","last_clean":"2024-09-22T08:13:53.234367+0000","last_became_active":"2024-09-22T08:10:45.183407+0000","last_became_peered":"2024-09-22T08:10:45.183407+0000","last_unstale":"2024-09-22T08:13:53.234367+0000","last_undegraded":"2024-09-22T08:13:53.234367+0000","last_fullsized":"2024-09-22T08:13:53.234367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:45.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.178063+0000","last_change":"2024-09-22T08:10:43.187945+0000","last_active":"2024-09-22T08:13:53.178063+0000","last_peered":"2024-09-22T08:13:53.178063+0000","last_clean":"2024-09-22T08:13:53.178063+0000","last_became_active":"2024-09-22T08:10:43.187119+0000","last_became_peered":"2024-09-22T08:10:43.187119+0000","last_unstale":"2024-09-22T08:13:53.178063+0000","last_undegraded":"2024-09-22T08:13:53.178063+0000","last_fullsized":"2024-09-22T08:13:53.178063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:05.083470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'7","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.587845+0000","last_change":"2024-09-22T08:11:23.218926+0000","last_active":"2024-09-22T08:13:12.587845+0000","last_peered":"2024-09-22T08:13:12.587845+0000","last_clean":"2024-09-22T08:13:12.587845+0000","last_became_active":"2024-09-22T08:11:23.218693+0000","last_became_peered":"2024-09-22T08:11:23.218693+0000","last_unstale":"2024-09-22T08:13:12.587845+0000","last_undegraded":"2024-09-22T08:13:12.587845+0000","last_fullsized":"2024-09-22T08:13:12.587845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:23.796030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44224,"kb_used_data":8880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327616,"statfs":{"total":96636764160,"available":96591478784,"internally_reserved":0,"allocated":9093120,"data_stored":8760075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673006,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48900,"kb_used_data":9396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322940,"statfs":{"total":96636764160,"available":96586690560,"internally_reserved":0,"allocated":9621504,"data_stored":9347107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44760,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327080,"statfs":{"total":96636764160,"available":96590929920,"internally_reserved":0,"allocated":9641984,"data_stored":9347795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":9056256,"data_stored":8759415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:14:00.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:14:00.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.442+0000 7f6613f4b640 1 Processor -- start 2024-09-22T08:14:00.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.442+0000 7f6613f4b640 1 -- start start 2024-09-22T08:14:00.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.442+0000 7f6613f4b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f660c06fd70 0x7f660c131660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:00.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.442+0000 7f6613f4b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f660c099ee0 con 0x7f660c06f280 2024-09-22T08:14:00.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.442+0000 7f6613f4b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f660c070d00 con 0x7f660c06fd70 2024-09-22T08:14:00.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.442+0000 7f66114e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f660c06fd70 0x7f660c131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:00.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.442+0000 7f6611ce7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f660c06f280 0x7f660c06f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56202/0 (socket says 172.21.15.53:56202) 2024-09-22T08:14:00.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.442+0000 7f6611ce7640 1 -- 172.21.15.53:0/2887260037 learned_addr learned my addr 172.21.15.53:0/2887260037 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:00.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.443+0000 7f66114e6640 1 -- 172.21.15.53:0/2887260037 >> v1:172.21.15.53:6789/0 conn(0x7f660c06f280 legacy=0x7f660c06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:00.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.443+0000 7f66114e6640 1 -- 172.21.15.53:0/2887260037 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660c070f40 con 0x7f660c06fd70 2024-09-22T08:14:00.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.443+0000 7f6610ce5640 1 -- 172.21.15.53:0/2887260037 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099802447 0 0) 0x7f660c099ee0 con 0x7f660c06f280 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.443+0000 7f66114e6640 1 --2- 172.21.15.53:0/2887260037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06fd70 0x7f660c131660 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009720 tx=0x7f65fc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74332233c182678 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.444+0000 7f6610ce5640 1 -- 172.21.15.53:0/2887260037 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65fc037070 con 0x7f660c06fd70 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.444+0000 7f6610ce5640 1 -- 172.21.15.53:0/2887260037 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65fc02ad90 con 0x7f660c06fd70 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.444+0000 7f6610ce5640 1 -- 172.21.15.53:0/2887260037 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65fc032590 con 0x7f660c06fd70 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.444+0000 7f6613f4b640 1 -- 172.21.15.53:0/2887260037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06fd70 msgr2=0x7f660c131660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.444+0000 7f6613f4b640 1 --2- 172.21.15.53:0/2887260037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06fd70 0x7f660c131660 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009720 tx=0x7f65fc02a110 comp rx=0 tx=0).stop 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.444+0000 7f6613f4b640 1 -- 172.21.15.53:0/2887260037 shutdown_connections 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.444+0000 7f6613f4b640 1 --2- 172.21.15.53:0/2887260037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06fd70 0x7f660c131660 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.444+0000 7f6613f4b640 1 -- 172.21.15.53:0/2887260037 >> 172.21.15.53:0/2887260037 conn(0x7f660c09ac80 msgr2=0x7f660c098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.444+0000 7f6613f4b640 1 -- 172.21.15.53:0/2887260037 shutdown_connections 2024-09-22T08:14:00.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.444+0000 7f6613f4b640 1 -- 172.21.15.53:0/2887260037 wait complete. 2024-09-22T08:14:00.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.445+0000 7f6613f4b640 1 Processor -- start 2024-09-22T08:14:00.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.445+0000 7f6613f4b640 1 -- start start 2024-09-22T08:14:00.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.445+0000 7f6613f4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06f280 0x7f660c1c2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:00.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.445+0000 7f6613f4b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f660c131d20 con 0x7f660c06f280 2024-09-22T08:14:00.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.446+0000 7f6611ce7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06f280 0x7f660c1c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:00.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.446+0000 7f6611ce7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06f280 0x7f660c1c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48042/0 (socket says 172.21.15.53:48042) 2024-09-22T08:14:00.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.446+0000 7f6611ce7640 1 -- 172.21.15.53:0/2542940034 learned_addr learned my addr 172.21.15.53:0/2542940034 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:00.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.446+0000 7f6611ce7640 1 -- 172.21.15.53:0/2542940034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660c073fb0 con 0x7f660c06f280 2024-09-22T08:14:00.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.446+0000 7f6611ce7640 1 --2- 172.21.15.53:0/2542940034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06f280 0x7f660c1c2050 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f660800c3d0 tx=0x7f660800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:00.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.446+0000 7f66027fc640 1 -- 172.21.15.53:0/2542940034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66080074d0 con 0x7f660c06f280 2024-09-22T08:14:00.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.446+0000 7f66027fc640 1 -- 172.21.15.53:0/2542940034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66080047e0 con 0x7f660c06f280 2024-09-22T08:14:00.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.446+0000 7f6613f4b640 1 -- 172.21.15.53:0/2542940034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660c1282c0 con 0x7f660c06f280 2024-09-22T08:14:00.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.446+0000 7f66027fc640 1 -- 172.21.15.53:0/2542940034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6608007670 con 0x7f660c06f280 2024-09-22T08:14:00.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.446+0000 7f6613f4b640 1 -- 172.21.15.53:0/2542940034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660c1c2590 con 0x7f660c06f280 2024-09-22T08:14:00.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.447+0000 7f66027fc640 1 -- 172.21.15.53:0/2542940034 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6608011070 con 0x7f660c06f280 2024-09-22T08:14:00.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.447+0000 7f6613f4b640 1 -- 172.21.15.53:0/2542940034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660c06f660 con 0x7f660c06f280 2024-09-22T08:14:00.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.447+0000 7f66027fc640 1 --2- 172.21.15.53:0/2542940034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65f003e790 0x7f65f0040c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:00.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.447+0000 7f66027fc640 1 -- 172.21.15.53:0/2542940034 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f66080534c0 con 0x7f660c06f280 2024-09-22T08:14:00.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.448+0000 7f66114e6640 1 --2- 172.21.15.53:0/2542940034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65f003e790 0x7f65f0040c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:00.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.448+0000 7f66114e6640 1 --2- 172.21.15.53:0/2542940034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65f003e790 0x7f65f0040c50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009720 tx=0x7f65fc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:00.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.452+0000 7f66027fc640 1 -- 172.21.15.53:0/2542940034 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f660c073fb0 con 0x7f660c06f280 2024-09-22T08:14:00.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.635+0000 7f6613f4b640 1 -- 172.21.15.53:0/2542940034 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f660c127e20 con 0x7f65f003e790 2024-09-22T08:14:00.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.645+0000 7f66027fc640 1 -- 172.21.15.53:0/2542940034 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666030 (secure 0 0 0) 0x7f660c127e20 con 0x7f65f003e790 2024-09-22T08:14:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:14:00.658 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:14:00.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.649+0000 7f6613f4b640 1 -- 172.21.15.53:0/2542940034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65f003e790 msgr2=0x7f65f0040c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.649+0000 7f6613f4b640 1 --2- 172.21.15.53:0/2542940034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65f003e790 0x7f65f0040c50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009720 tx=0x7f65fc02e000 comp rx=0 tx=0).stop 2024-09-22T08:14:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.649+0000 7f6613f4b640 1 -- 172.21.15.53:0/2542940034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06f280 msgr2=0x7f660c1c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.649+0000 7f6613f4b640 1 --2- 172.21.15.53:0/2542940034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06f280 0x7f660c1c2050 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f660800c3d0 tx=0x7f660800c890 comp rx=0 tx=0).stop 2024-09-22T08:14:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.650+0000 7f6613f4b640 1 -- 172.21.15.53:0/2542940034 shutdown_connections 2024-09-22T08:14:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.650+0000 7f6613f4b640 1 --2- 172.21.15.53:0/2542940034 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f65f003e790 0x7f65f0040c50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.650+0000 7f6613f4b640 1 --2- 172.21.15.53:0/2542940034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c06f280 0x7f660c1c2050 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.650+0000 7f6613f4b640 1 -- 172.21.15.53:0/2542940034 >> 172.21.15.53:0/2542940034 conn(0x7f660c09ac80 msgr2=0x7f660c071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.650+0000 7f6613f4b640 1 -- 172.21.15.53:0/2542940034 shutdown_connections 2024-09-22T08:14:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.650+0000 7f6613f4b640 1 -- 172.21.15.53:0/2542940034 wait complete. 2024-09-22T08:14:00.661 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-22T08:13:59.624505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416912,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4963,"num_read_kb":4501,"num_write":2048,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4434,"ondisk_log_size":4434,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177912,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309448,"statfs":{"total":386547056640,"available":386364874752,"internally_reserved":0,"allocated":37412864,"data_stored":36214392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004315"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208925+0000","last_change":"2024-09-22T08:10:43.175476+0000","last_active":"2024-09-22T08:11:23.208925+0000","last_peered":"2024-09-22T08:11:23.208925+0000","last_clean":"2024-09-22T08:11:23.208925+0000","last_became_active":"2024-09-22T08:10:43.174489+0000","last_became_peered":"2024-09-22T08:10:43.174489+0000","last_unstale":"2024-09-22T08:11:23.208925+0000","last_undegraded":"2024-09-22T08:11:23.208925+0000","last_fullsized":"2024-09-22T08:11:23.208925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:48.444642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037868+0000","last_change":"2024-09-22T08:10:45.180446+0000","last_active":"2024-09-22T08:11:27.037868+0000","last_peered":"2024-09-22T08:11:27.037868+0000","last_clean":"2024-09-22T08:11:27.037868+0000","last_became_active":"2024-09-22T08:10:45.179969+0000","last_became_peered":"2024-09-22T08:10:45.179969+0000","last_unstale":"2024-09-22T08:11:27.037868+0000","last_undegraded":"2024-09-22T08:11:27.037868+0000","last_fullsized":"2024-09-22T08:11:27.037868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:37.801061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223475+0000","last_change":"2024-09-22T08:10:43.187818+0000","last_active":"2024-09-22T08:11:23.223475+0000","last_peered":"2024-09-22T08:11:23.223475+0000","last_clean":"2024-09-22T08:11:23.223475+0000","last_became_active":"2024-09-22T08:10:43.187128+0000","last_became_peered":"2024-09-22T08:10:43.187128+0000","last_unstale":"2024-09-22T08:11:23.223475+0000","last_undegraded":"2024-09-22T08:11:23.223475+0000","last_fullsized":"2024-09-22T08:11:23.223475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:35.616676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210762+0000","last_change":"2024-09-22T08:10:45.170031+0000","last_active":"2024-09-22T08:11:23.210762+0000","last_peered":"2024-09-22T08:11:23.210762+0000","last_clean":"2024-09-22T08:11:23.210762+0000","last_became_active":"2024-09-22T08:10:45.169768+0000","last_became_peered":"2024-09-22T08:10:45.169768+0000","last_unstale":"2024-09-22T08:11:23.210762+0000","last_undegraded":"2024-09-22T08:11:23.210762+0000","last_fullsized":"2024-09-22T08:11:23.210762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:06.709611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.001193+0000","last_change":"2024-09-22T08:10:43.202010+0000","last_active":"2024-09-22T08:12:09.001193+0000","last_peered":"2024-09-22T08:12:09.001193+0000","last_clean":"2024-09-22T08:12:09.001193+0000","last_became_active":"2024-09-22T08:10:43.200436+0000","last_became_peered":"2024-09-22T08:10:43.200436+0000","last_unstale":"2024-09-22T08:12:09.001193+0000","last_undegraded":"2024-09-22T08:12:09.001193+0000","last_fullsized":"2024-09-22T08:12:09.001193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:53.517821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.175954+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.169110+0000","last_became_peered":"2024-09-22T08:10:45.169110+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:13.716183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.565361+0000","last_change":"2024-09-22T08:10:43.182888+0000","last_active":"2024-09-22T08:11:25.565361+0000","last_peered":"2024-09-22T08:11:25.565361+0000","last_clean":"2024-09-22T08:11:25.565361+0000","last_became_active":"2024-09-22T08:10:43.180088+0000","last_became_peered":"2024-09-22T08:10:43.180088+0000","last_unstale":"2024-09-22T08:11:25.565361+0000","last_undegraded":"2024-09-22T08:11:25.565361+0000","last_fullsized":"2024-09-22T08:11:25.565361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:17.087244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183683+0000","last_change":"2024-09-22T08:11:23.220302+0000","last_active":"2024-09-22T08:13:53.183683+0000","last_peered":"2024-09-22T08:13:53.183683+0000","last_clean":"2024-09-22T08:13:53.183683+0000","last_became_active":"2024-09-22T08:11:23.220081+0000","last_became_peered":"2024-09-22T08:11:23.220081+0000","last_unstale":"2024-09-22T08:13:53.183683+0000","last_undegraded":"2024-09-22T08:13:53.183683+0000","last_fullsized":"2024-09-22T08:13:53.183683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:33.959971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211346+0000","last_change":"2024-09-22T08:10:43.200685+0000","last_active":"2024-09-22T08:11:23.211346+0000","last_peered":"2024-09-22T08:11:23.211346+0000","last_clean":"2024-09-22T08:11:23.211346+0000","last_became_active":"2024-09-22T08:10:43.200013+0000","last_became_peered":"2024-09-22T08:10:43.200013+0000","last_unstale":"2024-09-22T08:11:23.211346+0000","last_undegraded":"2024-09-22T08:11:23.211346+0000","last_fullsized":"2024-09-22T08:11:23.211346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:43.911800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227900+0000","last_change":"2024-09-22T08:10:45.178916+0000","last_active":"2024-09-22T08:13:53.227900+0000","last_peered":"2024-09-22T08:13:53.227900+0000","last_clean":"2024-09-22T08:13:53.227900+0000","last_became_active":"2024-09-22T08:10:45.176491+0000","last_became_peered":"2024-09-22T08:10:45.176491+0000","last_unstale":"2024-09-22T08:13:53.227900+0000","last_undegraded":"2024-09-22T08:13:53.227900+0000","last_fullsized":"2024-09-22T08:13:53.227900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:10.583367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206702+0000","last_change":"2024-09-22T08:10:43.172716+0000","last_active":"2024-09-22T08:11:23.206702+0000","last_peered":"2024-09-22T08:11:23.206702+0000","last_clean":"2024-09-22T08:11:23.206702+0000","last_became_active":"2024-09-22T08:10:43.172330+0000","last_became_peered":"2024-09-22T08:10:43.172330+0000","last_unstale":"2024-09-22T08:11:23.206702+0000","last_undegraded":"2024-09-22T08:11:23.206702+0000","last_fullsized":"2024-09-22T08:11:23.206702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:17.018405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.951226+0000","last_change":"2024-09-22T08:10:45.176141+0000","last_active":"2024-09-22T08:13:52.951226+0000","last_peered":"2024-09-22T08:13:52.951226+0000","last_clean":"2024-09-22T08:13:52.951226+0000","last_became_active":"2024-09-22T08:10:45.175775+0000","last_became_peered":"2024-09-22T08:10:45.175775+0000","last_unstale":"2024-09-22T08:13:52.951226+0000","last_undegraded":"2024-09-22T08:13:52.951226+0000","last_fullsized":"2024-09-22T08:13:52.951226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:08.930275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210326+0000","last_change":"2024-09-22T08:10:43.188239+0000","last_active":"2024-09-22T08:11:23.210326+0000","last_peered":"2024-09-22T08:11:23.210326+0000","last_clean":"2024-09-22T08:11:23.210326+0000","last_became_active":"2024-09-22T08:10:43.187858+0000","last_became_peered":"2024-09-22T08:10:43.187858+0000","last_unstale":"2024-09-22T08:11:23.210326+0000","last_undegraded":"2024-09-22T08:11:23.210326+0000","last_fullsized":"2024-09-22T08:11:23.210326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:35.814525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.054945+0000","last_change":"2024-09-22T08:10:45.180145+0000","last_active":"2024-09-22T08:13:53.054945+0000","last_peered":"2024-09-22T08:13:53.054945+0000","last_clean":"2024-09-22T08:13:53.054945+0000","last_became_active":"2024-09-22T08:10:45.179870+0000","last_became_peered":"2024-09-22T08:10:45.179870+0000","last_unstale":"2024-09-22T08:13:53.054945+0000","last_undegraded":"2024-09-22T08:13:53.054945+0000","last_fullsized":"2024-09-22T08:13:53.054945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:13:33.107569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220202+0000","last_change":"2024-09-22T08:10:43.178636+0000","last_active":"2024-09-22T08:11:23.220202+0000","last_peered":"2024-09-22T08:11:23.220202+0000","last_clean":"2024-09-22T08:11:23.220202+0000","last_became_active":"2024-09-22T08:10:43.178146+0000","last_became_peered":"2024-09-22T08:10:43.178146+0000","last_unstale":"2024-09-22T08:11:23.220202+0000","last_undegraded":"2024-09-22T08:11:23.220202+0000","last_fullsized":"2024-09-22T08:11:23.220202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:37.378948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.829002+0000","last_change":"2024-09-22T08:10:45.177410+0000","last_active":"2024-09-22T08:12:08.829002+0000","last_peered":"2024-09-22T08:12:08.829002+0000","last_clean":"2024-09-22T08:12:08.829002+0000","last_became_active":"2024-09-22T08:10:45.177101+0000","last_became_peered":"2024-09-22T08:10:45.177101+0000","last_unstale":"2024-09-22T08:12:08.829002+0000","last_undegraded":"2024-09-22T08:12:08.829002+0000","last_fullsized":"2024-09-22T08:12:08.829002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:22:33.661673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828898+0000","last_change":"2024-09-22T08:10:45.170689+0000","last_active":"2024-09-22T08:12:08.828898+0000","last_peered":"2024-09-22T08:12:08.828898+0000","last_clean":"2024-09-22T08:12:08.828898+0000","last_became_active":"2024-09-22T08:10:45.169140+0000","last_became_peered":"2024-09-22T08:10:45.169140+0000","last_unstale":"2024-09-22T08:12:08.828898+0000","last_undegraded":"2024-09-22T08:12:08.828898+0000","last_fullsized":"2024-09-22T08:12:08.828898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:02.240838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.167301+0000","last_change":"2024-09-22T08:10:43.185987+0000","last_active":"2024-09-22T08:13:53.167301+0000","last_peered":"2024-09-22T08:13:53.167301+0000","last_clean":"2024-09-22T08:13:53.167301+0000","last_became_active":"2024-09-22T08:10:43.185301+0000","last_became_peered":"2024-09-22T08:10:43.185301+0000","last_unstale":"2024-09-22T08:13:53.167301+0000","last_undegraded":"2024-09-22T08:13:53.167301+0000","last_fullsized":"2024-09-22T08:13:53.167301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:21.858399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213294+0000","last_change":"2024-09-22T08:10:45.172853+0000","last_active":"2024-09-22T08:11:23.213294+0000","last_peered":"2024-09-22T08:11:23.213294+0000","last_clean":"2024-09-22T08:11:23.213294+0000","last_became_active":"2024-09-22T08:10:45.172557+0000","last_became_peered":"2024-09-22T08:10:45.172557+0000","last_unstale":"2024-09-22T08:11:23.213294+0000","last_undegraded":"2024-09-22T08:11:23.213294+0000","last_fullsized":"2024-09-22T08:11:23.213294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:38.198254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211528+0000","last_change":"2024-09-22T08:10:43.193026+0000","last_active":"2024-09-22T08:11:23.211528+0000","last_peered":"2024-09-22T08:11:23.211528+0000","last_clean":"2024-09-22T08:11:23.211528+0000","last_became_active":"2024-09-22T08:10:43.189273+0000","last_became_peered":"2024-09-22T08:10:43.189273+0000","last_unstale":"2024-09-22T08:11:23.211528+0000","last_undegraded":"2024-09-22T08:11:23.211528+0000","last_fullsized":"2024-09-22T08:11:23.211528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:52.937847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.307146+0000","last_change":"2024-09-22T08:10:45.178843+0000","last_active":"2024-09-22T08:13:53.307146+0000","last_peered":"2024-09-22T08:13:53.307146+0000","last_clean":"2024-09-22T08:13:53.307146+0000","last_became_active":"2024-09-22T08:10:45.176885+0000","last_became_peered":"2024-09-22T08:10:45.176885+0000","last_unstale":"2024-09-22T08:13:53.307146+0000","last_undegraded":"2024-09-22T08:13:53.307146+0000","last_fullsized":"2024-09-22T08:13:53.307146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:27.127106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214958+0000","last_change":"2024-09-22T08:10:43.184292+0000","last_active":"2024-09-22T08:11:23.214958+0000","last_peered":"2024-09-22T08:11:23.214958+0000","last_clean":"2024-09-22T08:11:23.214958+0000","last_became_active":"2024-09-22T08:10:43.183887+0000","last_became_peered":"2024-09-22T08:10:43.183887+0000","last_unstale":"2024-09-22T08:11:23.214958+0000","last_undegraded":"2024-09-22T08:11:23.214958+0000","last_fullsized":"2024-09-22T08:11:23.214958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:53.082618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228331+0000","last_change":"2024-09-22T08:10:45.172136+0000","last_active":"2024-09-22T08:13:53.228331+0000","last_peered":"2024-09-22T08:13:53.228331+0000","last_clean":"2024-09-22T08:13:53.228331+0000","last_became_active":"2024-09-22T08:10:45.171492+0000","last_became_peered":"2024-09-22T08:10:45.171492+0000","last_unstale":"2024-09-22T08:13:53.228331+0000","last_undegraded":"2024-09-22T08:13:53.228331+0000","last_fullsized":"2024-09-22T08:13:53.228331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:55.520692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.819194+0000","last_change":"2024-09-22T08:10:43.179557+0000","last_active":"2024-09-22T08:12:08.819194+0000","last_peered":"2024-09-22T08:12:08.819194+0000","last_clean":"2024-09-22T08:12:08.819194+0000","last_became_active":"2024-09-22T08:10:43.179133+0000","last_became_peered":"2024-09-22T08:10:43.179133+0000","last_unstale":"2024-09-22T08:12:08.819194+0000","last_undegraded":"2024-09-22T08:12:08.819194+0000","last_fullsized":"2024-09-22T08:12:08.819194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:51.687725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13,"num_write":24,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.056124+0000","last_change":"2024-09-22T08:10:45.174057+0000","last_active":"2024-09-22T08:13:53.056124+0000","last_peered":"2024-09-22T08:13:53.056124+0000","last_clean":"2024-09-22T08:13:53.056124+0000","last_became_active":"2024-09-22T08:10:45.173524+0000","last_became_peered":"2024-09-22T08:10:45.173524+0000","last_unstale":"2024-09-22T08:13:53.056124+0000","last_undegraded":"2024-09-22T08:13:53.056124+0000","last_fullsized":"2024-09-22T08:13:53.056124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:21.335898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562821+0000","last_change":"2024-09-22T08:10:43.187823+0000","last_active":"2024-09-22T08:11:25.562821+0000","last_peered":"2024-09-22T08:11:25.562821+0000","last_clean":"2024-09-22T08:11:25.562821+0000","last_became_active":"2024-09-22T08:10:43.186739+0000","last_became_peered":"2024-09-22T08:10:43.186739+0000","last_unstale":"2024-09-22T08:11:25.562821+0000","last_undegraded":"2024-09-22T08:11:25.562821+0000","last_fullsized":"2024-09-22T08:11:25.562821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:58.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037355+0000","last_change":"2024-09-22T08:10:45.172711+0000","last_active":"2024-09-22T08:11:27.037355+0000","last_peered":"2024-09-22T08:11:27.037355+0000","last_clean":"2024-09-22T08:11:27.037355+0000","last_became_active":"2024-09-22T08:10:45.170247+0000","last_became_peered":"2024-09-22T08:10:45.170247+0000","last_unstale":"2024-09-22T08:11:27.037355+0000","last_undegraded":"2024-09-22T08:11:27.037355+0000","last_fullsized":"2024-09-22T08:11:27.037355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:51.811049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562616+0000","last_change":"2024-09-22T08:10:43.191158+0000","last_active":"2024-09-22T08:11:25.562616+0000","last_peered":"2024-09-22T08:11:25.562616+0000","last_clean":"2024-09-22T08:11:25.562616+0000","last_became_active":"2024-09-22T08:10:43.190674+0000","last_became_peered":"2024-09-22T08:10:43.190674+0000","last_unstale":"2024-09-22T08:11:25.562616+0000","last_undegraded":"2024-09-22T08:11:25.562616+0000","last_fullsized":"2024-09-22T08:11:25.562616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:24.822605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.206848+0000","last_change":"2024-09-22T08:10:53.203618+0000","last_active":"2024-09-22T08:13:53.206848+0000","last_peered":"2024-09-22T08:13:53.206848+0000","last_clean":"2024-09-22T08:13:53.206848+0000","last_became_active":"2024-09-22T08:10:53.203146+0000","last_became_peered":"2024-09-22T08:10:53.203146+0000","last_unstale":"2024-09-22T08:13:53.206848+0000","last_undegraded":"2024-09-22T08:13:53.206848+0000","last_fullsized":"2024-09-22T08:13:53.206848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:09.081236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042651+0000","last_change":"2024-09-22T08:10:45.168914+0000","last_active":"2024-09-22T08:13:53.042651+0000","last_peered":"2024-09-22T08:13:53.042651+0000","last_clean":"2024-09-22T08:13:53.042651+0000","last_became_active":"2024-09-22T08:10:45.168308+0000","last_became_peered":"2024-09-22T08:10:45.168308+0000","last_unstale":"2024-09-22T08:13:53.042651+0000","last_undegraded":"2024-09-22T08:13:53.042651+0000","last_fullsized":"2024-09-22T08:13:53.042651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:33.215832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210935+0000","last_change":"2024-09-22T08:10:43.200744+0000","last_active":"2024-09-22T08:11:23.210935+0000","last_peered":"2024-09-22T08:11:23.210935+0000","last_clean":"2024-09-22T08:11:23.210935+0000","last_became_active":"2024-09-22T08:10:43.200307+0000","last_became_peered":"2024-09-22T08:10:43.200307+0000","last_unstale":"2024-09-22T08:11:23.210935+0000","last_undegraded":"2024-09-22T08:11:23.210935+0000","last_fullsized":"2024-09-22T08:11:23.210935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:05.094419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210664+0000","last_change":"2024-09-22T08:10:47.176870+0000","last_active":"2024-09-22T08:11:23.210664+0000","last_peered":"2024-09-22T08:11:23.210664+0000","last_clean":"2024-09-22T08:11:23.210664+0000","last_became_active":"2024-09-22T08:10:47.176568+0000","last_became_peered":"2024-09-22T08:10:47.176568+0000","last_unstale":"2024-09-22T08:11:23.210664+0000","last_undegraded":"2024-09-22T08:11:23.210664+0000","last_fullsized":"2024-09-22T08:11:23.210664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:55.338812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.141632+0000","last_change":"2024-09-22T08:10:49.189137+0000","last_active":"2024-09-22T08:12:51.141632+0000","last_peered":"2024-09-22T08:12:51.141632+0000","last_clean":"2024-09-22T08:12:51.141632+0000","last_became_active":"2024-09-22T08:10:49.188697+0000","last_became_peered":"2024-09-22T08:10:49.188697+0000","last_unstale":"2024-09-22T08:12:51.141632+0000","last_undegraded":"2024-09-22T08:12:51.141632+0000","last_fullsized":"2024-09-22T08:12:51.141632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:20.077797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216659+0000","last_change":"2024-09-22T08:10:51.202175+0000","last_active":"2024-09-22T08:11:23.216659+0000","last_peered":"2024-09-22T08:11:23.216659+0000","last_clean":"2024-09-22T08:11:23.216659+0000","last_became_active":"2024-09-22T08:10:51.201855+0000","last_became_peered":"2024-09-22T08:10:51.201855+0000","last_unstale":"2024-09-22T08:11:23.216659+0000","last_undegraded":"2024-09-22T08:11:23.216659+0000","last_fullsized":"2024-09-22T08:11:23.216659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'11","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.833839+0000","last_change":"2024-09-22T08:10:53.204685+0000","last_active":"2024-09-22T08:12:08.833839+0000","last_peered":"2024-09-22T08:12:08.833839+0000","last_clean":"2024-09-22T08:12:08.833839+0000","last_became_active":"2024-09-22T08:10:53.204407+0000","last_became_peered":"2024-09-22T08:10:53.204407+0000","last_unstale":"2024-09-22T08:12:08.833839+0000","last_undegraded":"2024-09-22T08:12:08.833839+0000","last_fullsized":"2024-09-22T08:12:08.833839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:07.954674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'16","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.261467+0000","last_change":"2024-09-22T08:10:45.171230+0000","last_active":"2024-09-22T08:13:53.261467+0000","last_peered":"2024-09-22T08:13:53.261467+0000","last_clean":"2024-09-22T08:13:53.261467+0000","last_became_active":"2024-09-22T08:10:45.170765+0000","last_became_peered":"2024-09-22T08:10:45.170765+0000","last_unstale":"2024-09-22T08:13:53.261467+0000","last_undegraded":"2024-09-22T08:13:53.261467+0000","last_fullsized":"2024-09-22T08:13:53.261467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:18.560588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206421+0000","last_change":"2024-09-22T08:10:43.180996+0000","last_active":"2024-09-22T08:11:23.206421+0000","last_peered":"2024-09-22T08:11:23.206421+0000","last_clean":"2024-09-22T08:11:23.206421+0000","last_became_active":"2024-09-22T08:10:43.180600+0000","last_became_peered":"2024-09-22T08:10:43.180600+0000","last_unstale":"2024-09-22T08:11:23.206421+0000","last_undegraded":"2024-09-22T08:11:23.206421+0000","last_fullsized":"2024-09-22T08:11:23.206421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:21.162231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221157+0000","last_change":"2024-09-22T08:10:47.168270+0000","last_active":"2024-09-22T08:11:23.221157+0000","last_peered":"2024-09-22T08:11:23.221157+0000","last_clean":"2024-09-22T08:11:23.221157+0000","last_became_active":"2024-09-22T08:10:47.167913+0000","last_became_peered":"2024-09-22T08:10:47.167913+0000","last_unstale":"2024-09-22T08:11:23.221157+0000","last_undegraded":"2024-09-22T08:11:23.221157+0000","last_fullsized":"2024-09-22T08:11:23.221157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:42.817181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216231+0000","last_change":"2024-09-22T08:10:49.182777+0000","last_active":"2024-09-22T08:11:23.216231+0000","last_peered":"2024-09-22T08:11:23.216231+0000","last_clean":"2024-09-22T08:11:23.216231+0000","last_became_active":"2024-09-22T08:10:49.182481+0000","last_became_peered":"2024-09-22T08:10:49.182481+0000","last_unstale":"2024-09-22T08:11:23.216231+0000","last_undegraded":"2024-09-22T08:11:23.216231+0000","last_fullsized":"2024-09-22T08:11:23.216231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:56.405074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.215699+0000","last_change":"2024-09-22T08:10:51.200151+0000","last_active":"2024-09-22T08:11:23.215699+0000","last_peered":"2024-09-22T08:11:23.215699+0000","last_clean":"2024-09-22T08:11:23.215699+0000","last_became_active":"2024-09-22T08:10:51.199837+0000","last_became_peered":"2024-09-22T08:10:51.199837+0000","last_unstale":"2024-09-22T08:11:23.215699+0000","last_undegraded":"2024-09-22T08:11:23.215699+0000","last_fullsized":"2024-09-22T08:11:23.215699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220094+0000","last_change":"2024-09-22T08:10:53.199608+0000","last_active":"2024-09-22T08:11:23.220094+0000","last_peered":"2024-09-22T08:11:23.220094+0000","last_clean":"2024-09-22T08:11:23.220094+0000","last_became_active":"2024-09-22T08:10:53.199303+0000","last_became_peered":"2024-09-22T08:10:53.199303+0000","last_unstale":"2024-09-22T08:11:23.220094+0000","last_undegraded":"2024-09-22T08:11:23.220094+0000","last_fullsized":"2024-09-22T08:11:23.220094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:27.339830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228089+0000","last_change":"2024-09-22T08:10:45.169254+0000","last_active":"2024-09-22T08:13:53.228089+0000","last_peered":"2024-09-22T08:13:53.228089+0000","last_clean":"2024-09-22T08:13:53.228089+0000","last_became_active":"2024-09-22T08:10:45.168554+0000","last_became_peered":"2024-09-22T08:10:45.168554+0000","last_unstale":"2024-09-22T08:13:53.228089+0000","last_undegraded":"2024-09-22T08:13:53.228089+0000","last_fullsized":"2024-09-22T08:13:53.228089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:25.135787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.932991+0000","last_change":"2024-09-22T08:10:43.189688+0000","last_active":"2024-09-22T08:13:52.932991+0000","last_peered":"2024-09-22T08:13:52.932991+0000","last_clean":"2024-09-22T08:13:52.932991+0000","last_became_active":"2024-09-22T08:10:43.189333+0000","last_became_peered":"2024-09-22T08:10:43.189333+0000","last_unstale":"2024-09-22T08:13:52.932991+0000","last_undegraded":"2024-09-22T08:13:52.932991+0000","last_fullsized":"2024-09-22T08:13:52.932991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:30.638919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223891+0000","last_change":"2024-09-22T08:10:47.176263+0000","last_active":"2024-09-22T08:11:23.223891+0000","last_peered":"2024-09-22T08:11:23.223891+0000","last_clean":"2024-09-22T08:11:23.223891+0000","last_became_active":"2024-09-22T08:10:47.175959+0000","last_became_peered":"2024-09-22T08:10:47.175959+0000","last_unstale":"2024-09-22T08:11:23.223891+0000","last_undegraded":"2024-09-22T08:11:23.223891+0000","last_fullsized":"2024-09-22T08:11:23.223891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:44.259414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207630+0000","last_change":"2024-09-22T08:10:49.185591+0000","last_active":"2024-09-22T08:11:23.207630+0000","last_peered":"2024-09-22T08:11:23.207630+0000","last_clean":"2024-09-22T08:11:23.207630+0000","last_became_active":"2024-09-22T08:10:49.185269+0000","last_became_peered":"2024-09-22T08:10:49.185269+0000","last_unstale":"2024-09-22T08:11:23.207630+0000","last_undegraded":"2024-09-22T08:11:23.207630+0000","last_fullsized":"2024-09-22T08:11:23.207630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.872968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":382,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254422+0000","last_change":"2024-09-22T08:10:51.196489+0000","last_active":"2024-09-22T08:13:52.254422+0000","last_peered":"2024-09-22T08:13:52.254422+0000","last_clean":"2024-09-22T08:13:52.254422+0000","last_became_active":"2024-09-22T08:10:51.196199+0000","last_became_peered":"2024-09-22T08:10:51.196199+0000","last_unstale":"2024-09-22T08:13:52.254422+0000","last_undegraded":"2024-09-22T08:13:52.254422+0000","last_fullsized":"2024-09-22T08:13:52.254422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:26.614683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.217337+0000","last_change":"2024-09-22T08:10:53.194394+0000","last_active":"2024-09-22T08:13:53.217337+0000","last_peered":"2024-09-22T08:13:53.217337+0000","last_clean":"2024-09-22T08:13:53.217337+0000","last_became_active":"2024-09-22T08:10:53.194118+0000","last_became_peered":"2024-09-22T08:10:53.194118+0000","last_unstale":"2024-09-22T08:13:53.217337+0000","last_undegraded":"2024-09-22T08:13:53.217337+0000","last_fullsized":"2024-09-22T08:13:53.217337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:00.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.234003+0000","last_change":"2024-09-22T08:10:45.183666+0000","last_active":"2024-09-22T08:13:53.234003+0000","last_peered":"2024-09-22T08:13:53.234003+0000","last_clean":"2024-09-22T08:13:53.234003+0000","last_became_active":"2024-09-22T08:10:45.183307+0000","last_became_peered":"2024-09-22T08:10:45.183307+0000","last_unstale":"2024-09-22T08:13:53.234003+0000","last_undegraded":"2024-09-22T08:13:53.234003+0000","last_fullsized":"2024-09-22T08:13:53.234003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:58.141567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211089+0000","last_change":"2024-09-22T08:10:43.188519+0000","last_active":"2024-09-22T08:11:23.211089+0000","last_peered":"2024-09-22T08:11:23.211089+0000","last_clean":"2024-09-22T08:11:23.211089+0000","last_became_active":"2024-09-22T08:10:43.187835+0000","last_became_peered":"2024-09-22T08:10:43.187835+0000","last_unstale":"2024-09-22T08:11:23.211089+0000","last_undegraded":"2024-09-22T08:11:23.211089+0000","last_fullsized":"2024-09-22T08:11:23.211089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:29.246042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211282+0000","last_change":"2024-09-22T08:10:47.175684+0000","last_active":"2024-09-22T08:11:23.211282+0000","last_peered":"2024-09-22T08:11:23.211282+0000","last_clean":"2024-09-22T08:11:23.211282+0000","last_became_active":"2024-09-22T08:10:47.175386+0000","last_became_peered":"2024-09-22T08:10:47.175386+0000","last_unstale":"2024-09-22T08:11:23.211282+0000","last_undegraded":"2024-09-22T08:11:23.211282+0000","last_fullsized":"2024-09-22T08:11:23.211282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:48.587319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.136350+0000","last_change":"2024-09-22T08:10:49.185291+0000","last_active":"2024-09-22T08:12:51.136350+0000","last_peered":"2024-09-22T08:12:51.136350+0000","last_clean":"2024-09-22T08:12:51.136350+0000","last_became_active":"2024-09-22T08:10:49.184963+0000","last_became_peered":"2024-09-22T08:10:49.184963+0000","last_unstale":"2024-09-22T08:12:51.136350+0000","last_undegraded":"2024-09-22T08:12:51.136350+0000","last_fullsized":"2024-09-22T08:12:51.136350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:53.469586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":442,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.257784+0000","last_change":"2024-09-22T08:10:51.193999+0000","last_active":"2024-09-22T08:13:53.257784+0000","last_peered":"2024-09-22T08:13:53.257784+0000","last_clean":"2024-09-22T08:13:53.257784+0000","last_became_active":"2024-09-22T08:10:51.193678+0000","last_became_peered":"2024-09-22T08:10:51.193678+0000","last_unstale":"2024-09-22T08:13:53.257784+0000","last_undegraded":"2024-09-22T08:13:53.257784+0000","last_fullsized":"2024-09-22T08:13:53.257784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.950936+0000","last_change":"2024-09-22T08:10:45.184006+0000","last_active":"2024-09-22T08:13:52.950936+0000","last_peered":"2024-09-22T08:13:52.950936+0000","last_clean":"2024-09-22T08:13:52.950936+0000","last_became_active":"2024-09-22T08:10:45.183598+0000","last_became_peered":"2024-09-22T08:10:45.183598+0000","last_unstale":"2024-09-22T08:13:52.950936+0000","last_undegraded":"2024-09-22T08:13:52.950936+0000","last_fullsized":"2024-09-22T08:13:52.950936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:42.041157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208676+0000","last_change":"2024-09-22T08:10:43.175203+0000","last_active":"2024-09-22T08:11:23.208676+0000","last_peered":"2024-09-22T08:11:23.208676+0000","last_clean":"2024-09-22T08:11:23.208676+0000","last_became_active":"2024-09-22T08:10:43.173543+0000","last_became_peered":"2024-09-22T08:10:43.173543+0000","last_unstale":"2024-09-22T08:11:23.208676+0000","last_undegraded":"2024-09-22T08:11:23.208676+0000","last_fullsized":"2024-09-22T08:11:23.208676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:49.711451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212481+0000","last_change":"2024-09-22T08:10:47.176921+0000","last_active":"2024-09-22T08:11:23.212481+0000","last_peered":"2024-09-22T08:11:23.212481+0000","last_clean":"2024-09-22T08:11:23.212481+0000","last_became_active":"2024-09-22T08:10:47.176657+0000","last_became_peered":"2024-09-22T08:10:47.176657+0000","last_unstale":"2024-09-22T08:11:23.212481+0000","last_undegraded":"2024-09-22T08:11:23.212481+0000","last_fullsized":"2024-09-22T08:11:23.212481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:32.681711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.145964+0000","last_change":"2024-09-22T08:10:49.184460+0000","last_active":"2024-09-22T08:12:51.145964+0000","last_peered":"2024-09-22T08:12:51.145964+0000","last_clean":"2024-09-22T08:12:51.145964+0000","last_became_active":"2024-09-22T08:10:49.182985+0000","last_became_peered":"2024-09-22T08:10:49.182985+0000","last_unstale":"2024-09-22T08:12:51.145964+0000","last_undegraded":"2024-09-22T08:12:51.145964+0000","last_fullsized":"2024-09-22T08:12:51.145964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:56.307814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222432+0000","last_change":"2024-09-22T08:10:51.193335+0000","last_active":"2024-09-22T08:11:23.222432+0000","last_peered":"2024-09-22T08:11:23.222432+0000","last_clean":"2024-09-22T08:11:23.222432+0000","last_became_active":"2024-09-22T08:10:51.192623+0000","last_became_peered":"2024-09-22T08:10:51.192623+0000","last_unstale":"2024-09-22T08:11:23.222432+0000","last_undegraded":"2024-09-22T08:11:23.222432+0000","last_fullsized":"2024-09-22T08:11:23.222432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.835562+0000","last_change":"2024-09-22T08:10:53.198555+0000","last_active":"2024-09-22T08:12:08.835562+0000","last_peered":"2024-09-22T08:12:08.835562+0000","last_clean":"2024-09-22T08:12:08.835562+0000","last_became_active":"2024-09-22T08:10:53.198219+0000","last_became_peered":"2024-09-22T08:10:53.198219+0000","last_unstale":"2024-09-22T08:12:08.835562+0000","last_undegraded":"2024-09-22T08:12:08.835562+0000","last_fullsized":"2024-09-22T08:12:08.835562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:04.308739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213131+0000","last_change":"2024-09-22T08:10:45.172178+0000","last_active":"2024-09-22T08:11:23.213131+0000","last_peered":"2024-09-22T08:11:23.213131+0000","last_clean":"2024-09-22T08:11:23.213131+0000","last_became_active":"2024-09-22T08:10:45.171911+0000","last_became_peered":"2024-09-22T08:10:45.171911+0000","last_unstale":"2024-09-22T08:11:23.213131+0000","last_undegraded":"2024-09-22T08:11:23.213131+0000","last_fullsized":"2024-09-22T08:11:23.213131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:57.459714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210955+0000","last_change":"2024-09-22T08:10:43.193335+0000","last_active":"2024-09-22T08:11:23.210955+0000","last_peered":"2024-09-22T08:11:23.210955+0000","last_clean":"2024-09-22T08:11:23.210955+0000","last_became_active":"2024-09-22T08:10:43.189780+0000","last_became_peered":"2024-09-22T08:10:43.189780+0000","last_unstale":"2024-09-22T08:11:23.210955+0000","last_undegraded":"2024-09-22T08:11:23.210955+0000","last_fullsized":"2024-09-22T08:11:23.210955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:29.886101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220270+0000","last_change":"2024-09-22T08:10:47.177997+0000","last_active":"2024-09-22T08:11:23.220270+0000","last_peered":"2024-09-22T08:11:23.220270+0000","last_clean":"2024-09-22T08:11:23.220270+0000","last_became_active":"2024-09-22T08:10:47.177695+0000","last_became_peered":"2024-09-22T08:10:47.177695+0000","last_unstale":"2024-09-22T08:11:23.220270+0000","last_undegraded":"2024-09-22T08:11:23.220270+0000","last_fullsized":"2024-09-22T08:11:23.220270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:09.326387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.125298+0000","last_change":"2024-09-22T08:10:49.185696+0000","last_active":"2024-09-22T08:12:51.125298+0000","last_peered":"2024-09-22T08:12:51.125298+0000","last_clean":"2024-09-22T08:12:51.125298+0000","last_became_active":"2024-09-22T08:10:49.185419+0000","last_became_peered":"2024-09-22T08:10:49.185419+0000","last_unstale":"2024-09-22T08:12:51.125298+0000","last_undegraded":"2024-09-22T08:12:51.125298+0000","last_fullsized":"2024-09-22T08:12:51.125298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:57.299371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221426+0000","last_change":"2024-09-22T08:10:51.202896+0000","last_active":"2024-09-22T08:11:23.221426+0000","last_peered":"2024-09-22T08:11:23.221426+0000","last_clean":"2024-09-22T08:11:23.221426+0000","last_became_active":"2024-09-22T08:10:51.202564+0000","last_became_peered":"2024-09-22T08:10:51.202564+0000","last_unstale":"2024-09-22T08:11:23.221426+0000","last_undegraded":"2024-09-22T08:11:23.221426+0000","last_fullsized":"2024-09-22T08:11:23.221426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:58.270948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:03.306650+0000","last_change":"2024-09-22T08:10:53.196844+0000","last_active":"2024-09-22T08:12:03.306650+0000","last_peered":"2024-09-22T08:12:03.306650+0000","last_clean":"2024-09-22T08:12:03.306650+0000","last_became_active":"2024-09-22T08:10:53.196392+0000","last_became_peered":"2024-09-22T08:10:53.196392+0000","last_unstale":"2024-09-22T08:12:03.306650+0000","last_undegraded":"2024-09-22T08:12:03.306650+0000","last_fullsized":"2024-09-22T08:12:03.306650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:30.239443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207308+0000","last_change":"2024-09-22T08:10:45.177813+0000","last_active":"2024-09-22T08:11:23.207308+0000","last_peered":"2024-09-22T08:11:23.207308+0000","last_clean":"2024-09-22T08:11:23.207308+0000","last_became_active":"2024-09-22T08:10:45.177530+0000","last_became_peered":"2024-09-22T08:10:45.177530+0000","last_unstale":"2024-09-22T08:11:23.207308+0000","last_undegraded":"2024-09-22T08:11:23.207308+0000","last_fullsized":"2024-09-22T08:11:23.207308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:03.255386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213304+0000","last_change":"2024-09-22T08:10:43.202319+0000","last_active":"2024-09-22T08:11:23.213304+0000","last_peered":"2024-09-22T08:11:23.213304+0000","last_clean":"2024-09-22T08:11:23.213304+0000","last_became_active":"2024-09-22T08:10:43.201669+0000","last_became_peered":"2024-09-22T08:10:43.201669+0000","last_unstale":"2024-09-22T08:11:23.213304+0000","last_undegraded":"2024-09-22T08:11:23.213304+0000","last_fullsized":"2024-09-22T08:11:23.213304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:18.648215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221742+0000","last_change":"2024-09-22T08:10:47.177950+0000","last_active":"2024-09-22T08:11:23.221742+0000","last_peered":"2024-09-22T08:11:23.221742+0000","last_clean":"2024-09-22T08:11:23.221742+0000","last_became_active":"2024-09-22T08:10:47.177613+0000","last_became_peered":"2024-09-22T08:10:47.177613+0000","last_unstale":"2024-09-22T08:11:23.221742+0000","last_undegraded":"2024-09-22T08:11:23.221742+0000","last_fullsized":"2024-09-22T08:11:23.221742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:26.919515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.147891+0000","last_change":"2024-09-22T08:10:49.187229+0000","last_active":"2024-09-22T08:12:51.147891+0000","last_peered":"2024-09-22T08:12:51.147891+0000","last_clean":"2024-09-22T08:12:51.147891+0000","last_became_active":"2024-09-22T08:10:49.186941+0000","last_became_peered":"2024-09-22T08:10:49.186941+0000","last_unstale":"2024-09-22T08:12:51.147891+0000","last_undegraded":"2024-09-22T08:12:51.147891+0000","last_fullsized":"2024-09-22T08:12:51.147891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:28.645390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":349,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.372929+0000","last_change":"2024-09-22T08:10:51.192885+0000","last_active":"2024-09-22T08:13:53.372929+0000","last_peered":"2024-09-22T08:13:53.372929+0000","last_clean":"2024-09-22T08:13:53.372929+0000","last_became_active":"2024-09-22T08:10:51.192483+0000","last_became_peered":"2024-09-22T08:10:51.192483+0000","last_unstale":"2024-09-22T08:13:53.372929+0000","last_undegraded":"2024-09-22T08:13:53.372929+0000","last_fullsized":"2024-09-22T08:13:53.372929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:47.260805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222488+0000","last_change":"2024-09-22T08:10:53.199613+0000","last_active":"2024-09-22T08:11:23.222488+0000","last_peered":"2024-09-22T08:11:23.222488+0000","last_clean":"2024-09-22T08:11:23.222488+0000","last_became_active":"2024-09-22T08:10:53.199273+0000","last_became_peered":"2024-09-22T08:10:53.199273+0000","last_unstale":"2024-09-22T08:11:23.222488+0000","last_undegraded":"2024-09-22T08:11:23.222488+0000","last_fullsized":"2024-09-22T08:11:23.222488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:07.308140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183660+0000","last_change":"2024-09-22T08:10:45.165644+0000","last_active":"2024-09-22T08:13:53.183660+0000","last_peered":"2024-09-22T08:13:53.183660+0000","last_clean":"2024-09-22T08:13:53.183660+0000","last_became_active":"2024-09-22T08:10:45.165352+0000","last_became_peered":"2024-09-22T08:10:45.165352+0000","last_unstale":"2024-09-22T08:13:53.183660+0000","last_undegraded":"2024-09-22T08:13:53.183660+0000","last_fullsized":"2024-09-22T08:13:53.183660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:15.188589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211087+0000","last_change":"2024-09-22T08:10:43.199804+0000","last_active":"2024-09-22T08:11:23.211087+0000","last_peered":"2024-09-22T08:11:23.211087+0000","last_clean":"2024-09-22T08:11:23.211087+0000","last_became_active":"2024-09-22T08:10:43.198696+0000","last_became_peered":"2024-09-22T08:10:43.198696+0000","last_unstale":"2024-09-22T08:11:23.211087+0000","last_undegraded":"2024-09-22T08:11:23.211087+0000","last_fullsized":"2024-09-22T08:11:23.211087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:50.899075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220881+0000","last_change":"2024-09-22T08:10:47.176680+0000","last_active":"2024-09-22T08:11:23.220881+0000","last_peered":"2024-09-22T08:11:23.220881+0000","last_clean":"2024-09-22T08:11:23.220881+0000","last_became_active":"2024-09-22T08:10:47.176263+0000","last_became_peered":"2024-09-22T08:10:47.176263+0000","last_unstale":"2024-09-22T08:11:23.220881+0000","last_undegraded":"2024-09-22T08:11:23.220881+0000","last_fullsized":"2024-09-22T08:11:23.220881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:38.640214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.150072+0000","last_change":"2024-09-22T08:10:49.189658+0000","last_active":"2024-09-22T08:12:51.150072+0000","last_peered":"2024-09-22T08:12:51.150072+0000","last_clean":"2024-09-22T08:12:51.150072+0000","last_became_active":"2024-09-22T08:10:49.188724+0000","last_became_peered":"2024-09-22T08:10:49.188724+0000","last_unstale":"2024-09-22T08:12:51.150072+0000","last_undegraded":"2024-09-22T08:12:51.150072+0000","last_fullsized":"2024-09-22T08:12:51.150072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:49.620069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220087+0000","last_change":"2024-09-22T08:10:51.195268+0000","last_active":"2024-09-22T08:11:23.220087+0000","last_peered":"2024-09-22T08:11:23.220087+0000","last_clean":"2024-09-22T08:11:23.220087+0000","last_became_active":"2024-09-22T08:10:51.194937+0000","last_became_peered":"2024-09-22T08:10:51.194937+0000","last_unstale":"2024-09-22T08:11:23.220087+0000","last_undegraded":"2024-09-22T08:11:23.220087+0000","last_fullsized":"2024-09-22T08:11:23.220087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.350209+0000","last_change":"2024-09-22T08:10:53.201595+0000","last_active":"2024-09-22T08:13:53.350209+0000","last_peered":"2024-09-22T08:13:53.350209+0000","last_clean":"2024-09-22T08:13:53.350209+0000","last_became_active":"2024-09-22T08:10:53.201289+0000","last_became_peered":"2024-09-22T08:10:53.201289+0000","last_unstale":"2024-09-22T08:13:53.350209+0000","last_undegraded":"2024-09-22T08:13:53.350209+0000","last_fullsized":"2024-09-22T08:13:53.350209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:22.640385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.468134+0000","last_change":"2024-09-22T08:10:45.181031+0000","last_active":"2024-09-22T08:12:49.468134+0000","last_peered":"2024-09-22T08:12:49.468134+0000","last_clean":"2024-09-22T08:12:49.468134+0000","last_became_active":"2024-09-22T08:10:45.180762+0000","last_became_peered":"2024-09-22T08:10:45.180762+0000","last_unstale":"2024-09-22T08:12:49.468134+0000","last_undegraded":"2024-09-22T08:12:49.468134+0000","last_fullsized":"2024-09-22T08:12:49.468134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:39.170953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562819+0000","last_change":"2024-09-22T08:10:43.177974+0000","last_active":"2024-09-22T08:11:25.562819+0000","last_peered":"2024-09-22T08:11:25.562819+0000","last_clean":"2024-09-22T08:11:25.562819+0000","last_became_active":"2024-09-22T08:10:43.177202+0000","last_became_peered":"2024-09-22T08:10:43.177202+0000","last_unstale":"2024-09-22T08:11:25.562819+0000","last_undegraded":"2024-09-22T08:11:25.562819+0000","last_fullsized":"2024-09-22T08:11:25.562819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:21.858399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207951+0000","last_change":"2024-09-22T08:10:47.173920+0000","last_active":"2024-09-22T08:11:23.207951+0000","last_peered":"2024-09-22T08:11:23.207951+0000","last_clean":"2024-09-22T08:11:23.207951+0000","last_became_active":"2024-09-22T08:10:47.173636+0000","last_became_peered":"2024-09-22T08:10:47.173636+0000","last_unstale":"2024-09-22T08:11:23.207951+0000","last_undegraded":"2024-09-22T08:11:23.207951+0000","last_fullsized":"2024-09-22T08:11:23.207951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:07.844753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.129598+0000","last_change":"2024-09-22T08:10:49.175235+0000","last_active":"2024-09-22T08:12:51.129598+0000","last_peered":"2024-09-22T08:12:51.129598+0000","last_clean":"2024-09-22T08:12:51.129598+0000","last_became_active":"2024-09-22T08:10:49.174933+0000","last_became_peered":"2024-09-22T08:10:49.174933+0000","last_unstale":"2024-09-22T08:12:51.129598+0000","last_undegraded":"2024-09-22T08:12:51.129598+0000","last_fullsized":"2024-09-22T08:12:51.129598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:09.101942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212489+0000","last_change":"2024-09-22T08:10:51.195590+0000","last_active":"2024-09-22T08:11:23.212489+0000","last_peered":"2024-09-22T08:11:23.212489+0000","last_clean":"2024-09-22T08:11:23.212489+0000","last_became_active":"2024-09-22T08:10:51.195308+0000","last_became_peered":"2024-09-22T08:10:51.195308+0000","last_unstale":"2024-09-22T08:11:23.212489+0000","last_undegraded":"2024-09-22T08:11:23.212489+0000","last_fullsized":"2024-09-22T08:11:23.212489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:13.979616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584694+0000","last_change":"2024-09-22T08:10:53.201429+0000","last_active":"2024-09-22T08:12:52.584694+0000","last_peered":"2024-09-22T08:12:52.584694+0000","last_clean":"2024-09-22T08:12:52.584694+0000","last_became_active":"2024-09-22T08:10:53.200458+0000","last_became_peered":"2024-09-22T08:10:53.200458+0000","last_unstale":"2024-09-22T08:12:52.584694+0000","last_undegraded":"2024-09-22T08:12:52.584694+0000","last_fullsized":"2024-09-22T08:12:52.584694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:15.839331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:02.586743+0000","last_change":"2024-09-22T08:10:45.183532+0000","last_active":"2024-09-22T08:13:02.586743+0000","last_peered":"2024-09-22T08:13:02.586743+0000","last_clean":"2024-09-22T08:13:02.586743+0000","last_became_active":"2024-09-22T08:10:45.183258+0000","last_became_peered":"2024-09-22T08:10:45.183258+0000","last_unstale":"2024-09-22T08:13:02.586743+0000","last_undegraded":"2024-09-22T08:13:02.586743+0000","last_fullsized":"2024-09-22T08:13:02.586743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:38.687579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213355+0000","last_change":"2024-09-22T08:10:43.197491+0000","last_active":"2024-09-22T08:11:23.213355+0000","last_peered":"2024-09-22T08:11:23.213355+0000","last_clean":"2024-09-22T08:11:23.213355+0000","last_became_active":"2024-09-22T08:10:43.195959+0000","last_became_peered":"2024-09-22T08:10:43.195959+0000","last_unstale":"2024-09-22T08:11:23.213355+0000","last_undegraded":"2024-09-22T08:11:23.213355+0000","last_fullsized":"2024-09-22T08:11:23.213355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:31.630549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216166+0000","last_change":"2024-09-22T08:11:23.215294+0000","last_active":"2024-09-22T08:11:23.216166+0000","last_peered":"2024-09-22T08:11:23.216166+0000","last_clean":"2024-09-22T08:11:23.216166+0000","last_became_active":"2024-09-22T08:11:23.214959+0000","last_became_peered":"2024-09-22T08:11:23.214959+0000","last_unstale":"2024-09-22T08:11:23.216166+0000","last_undegraded":"2024-09-22T08:11:23.216166+0000","last_fullsized":"2024-09-22T08:11:23.216166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:50.116285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.156739+0000","last_change":"2024-09-22T08:10:49.181291+0000","last_active":"2024-09-22T08:12:51.156739+0000","last_peered":"2024-09-22T08:12:51.156739+0000","last_clean":"2024-09-22T08:12:51.156739+0000","last_became_active":"2024-09-22T08:10:49.180820+0000","last_became_peered":"2024-09-22T08:10:49.180820+0000","last_unstale":"2024-09-22T08:12:51.156739+0000","last_undegraded":"2024-09-22T08:12:51.156739+0000","last_fullsized":"2024-09-22T08:12:51.156739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:56.059910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":432,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.353982+0000","last_change":"2024-09-22T08:10:51.197307+0000","last_active":"2024-09-22T08:13:53.353982+0000","last_peered":"2024-09-22T08:13:53.353982+0000","last_clean":"2024-09-22T08:13:53.353982+0000","last_became_active":"2024-09-22T08:10:51.197020+0000","last_became_peered":"2024-09-22T08:10:51.197020+0000","last_unstale":"2024-09-22T08:13:53.353982+0000","last_undegraded":"2024-09-22T08:13:53.353982+0000","last_fullsized":"2024-09-22T08:13:53.353982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:39.376197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:01.585334+0000","last_change":"2024-09-22T08:10:53.192873+0000","last_active":"2024-09-22T08:13:01.585334+0000","last_peered":"2024-09-22T08:13:01.585334+0000","last_clean":"2024-09-22T08:13:01.585334+0000","last_became_active":"2024-09-22T08:10:53.192481+0000","last_became_peered":"2024-09-22T08:10:53.192481+0000","last_unstale":"2024-09-22T08:13:01.585334+0000","last_undegraded":"2024-09-22T08:13:01.585334+0000","last_fullsized":"2024-09-22T08:13:01.585334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:06.451090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183469+0000","last_change":"2024-09-22T08:10:45.173005+0000","last_active":"2024-09-22T08:13:53.183469+0000","last_peered":"2024-09-22T08:13:53.183469+0000","last_clean":"2024-09-22T08:13:53.183469+0000","last_became_active":"2024-09-22T08:10:45.172740+0000","last_became_peered":"2024-09-22T08:10:45.172740+0000","last_unstale":"2024-09-22T08:13:53.183469+0000","last_undegraded":"2024-09-22T08:13:53.183469+0000","last_fullsized":"2024-09-22T08:13:53.183469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:20.794542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212966+0000","last_change":"2024-09-22T08:10:43.195715+0000","last_active":"2024-09-22T08:11:23.212966+0000","last_peered":"2024-09-22T08:11:23.212966+0000","last_clean":"2024-09-22T08:11:23.212966+0000","last_became_active":"2024-09-22T08:10:43.195355+0000","last_became_peered":"2024-09-22T08:10:43.195355+0000","last_unstale":"2024-09-22T08:11:23.212966+0000","last_undegraded":"2024-09-22T08:11:23.212966+0000","last_fullsized":"2024-09-22T08:11:23.212966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:01.525176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":426,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.224617+0000","last_change":"2024-09-22T08:11:23.229177+0000","last_active":"2024-09-22T08:12:52.224617+0000","last_peered":"2024-09-22T08:12:52.224617+0000","last_clean":"2024-09-22T08:12:52.224617+0000","last_became_active":"2024-09-22T08:11:23.221981+0000","last_became_peered":"2024-09-22T08:11:23.221981+0000","last_unstale":"2024-09-22T08:12:52.224617+0000","last_undegraded":"2024-09-22T08:12:52.224617+0000","last_fullsized":"2024-09-22T08:12:52.224617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:00.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213610+0000","last_change":"2024-09-22T08:10:49.188917+0000","last_active":"2024-09-22T08:11:23.213610+0000","last_peered":"2024-09-22T08:11:23.213610+0000","last_clean":"2024-09-22T08:11:23.213610+0000","last_became_active":"2024-09-22T08:10:49.188444+0000","last_became_peered":"2024-09-22T08:10:49.188444+0000","last_unstale":"2024-09-22T08:11:23.213610+0000","last_undegraded":"2024-09-22T08:11:23.213610+0000","last_fullsized":"2024-09-22T08:11:23.213610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:27.352744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":469,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.310805+0000","last_change":"2024-09-22T08:10:51.197818+0000","last_active":"2024-09-22T08:13:53.310805+0000","last_peered":"2024-09-22T08:13:53.310805+0000","last_clean":"2024-09-22T08:13:53.310805+0000","last_became_active":"2024-09-22T08:10:51.197248+0000","last_became_peered":"2024-09-22T08:10:51.197248+0000","last_unstale":"2024-09-22T08:13:53.310805+0000","last_undegraded":"2024-09-22T08:13:53.310805+0000","last_fullsized":"2024-09-22T08:13:53.310805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.360311+0000","last_change":"2024-09-22T08:10:53.195875+0000","last_active":"2024-09-22T08:12:52.360311+0000","last_peered":"2024-09-22T08:12:52.360311+0000","last_clean":"2024-09-22T08:12:52.360311+0000","last_became_active":"2024-09-22T08:10:53.195539+0000","last_became_peered":"2024-09-22T08:10:53.195539+0000","last_unstale":"2024-09-22T08:12:52.360311+0000","last_undegraded":"2024-09-22T08:12:52.360311+0000","last_fullsized":"2024-09-22T08:12:52.360311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:10.933920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254832+0000","last_change":"2024-09-22T08:11:23.226070+0000","last_active":"2024-09-22T08:13:53.254832+0000","last_peered":"2024-09-22T08:13:53.254832+0000","last_clean":"2024-09-22T08:13:53.254832+0000","last_became_active":"2024-09-22T08:11:23.220943+0000","last_became_peered":"2024-09-22T08:11:23.220943+0000","last_unstale":"2024-09-22T08:13:53.254832+0000","last_undegraded":"2024-09-22T08:13:53.254832+0000","last_fullsized":"2024-09-22T08:13:53.254832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:18.981650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.249213+0000","last_change":"2024-09-22T08:10:43.198294+0000","last_active":"2024-09-22T08:13:53.249213+0000","last_peered":"2024-09-22T08:13:53.249213+0000","last_clean":"2024-09-22T08:13:53.249213+0000","last_became_active":"2024-09-22T08:10:43.196211+0000","last_became_peered":"2024-09-22T08:10:43.196211+0000","last_unstale":"2024-09-22T08:13:53.249213+0000","last_undegraded":"2024-09-22T08:13:53.249213+0000","last_fullsized":"2024-09-22T08:13:53.249213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:16.704599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211379+0000","last_change":"2024-09-22T08:10:47.177015+0000","last_active":"2024-09-22T08:11:23.211379+0000","last_peered":"2024-09-22T08:11:23.211379+0000","last_clean":"2024-09-22T08:11:23.211379+0000","last_became_active":"2024-09-22T08:10:47.176634+0000","last_became_peered":"2024-09-22T08:10:47.176634+0000","last_unstale":"2024-09-22T08:11:23.211379+0000","last_undegraded":"2024-09-22T08:11:23.211379+0000","last_fullsized":"2024-09-22T08:11:23.211379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:32.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.142937+0000","last_change":"2024-09-22T08:10:49.179447+0000","last_active":"2024-09-22T08:12:51.142937+0000","last_peered":"2024-09-22T08:12:51.142937+0000","last_clean":"2024-09-22T08:12:51.142937+0000","last_became_active":"2024-09-22T08:10:49.178942+0000","last_became_peered":"2024-09-22T08:10:49.178942+0000","last_unstale":"2024-09-22T08:12:51.142937+0000","last_undegraded":"2024-09-22T08:12:51.142937+0000","last_fullsized":"2024-09-22T08:12:51.142937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:49.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207501+0000","last_change":"2024-09-22T08:10:51.192777+0000","last_active":"2024-09-22T08:11:23.207501+0000","last_peered":"2024-09-22T08:11:23.207501+0000","last_clean":"2024-09-22T08:11:23.207501+0000","last_became_active":"2024-09-22T08:10:51.192482+0000","last_became_peered":"2024-09-22T08:10:51.192482+0000","last_unstale":"2024-09-22T08:11:23.207501+0000","last_undegraded":"2024-09-22T08:11:23.207501+0000","last_fullsized":"2024-09-22T08:11:23.207501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:39.871977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.288651+0000","last_change":"2024-09-22T08:10:53.193739+0000","last_active":"2024-09-22T08:13:53.288651+0000","last_peered":"2024-09-22T08:13:53.288651+0000","last_clean":"2024-09-22T08:13:53.288651+0000","last_became_active":"2024-09-22T08:10:53.193315+0000","last_became_peered":"2024-09-22T08:10:53.193315+0000","last_unstale":"2024-09-22T08:13:53.288651+0000","last_undegraded":"2024-09-22T08:13:53.288651+0000","last_fullsized":"2024-09-22T08:13:53.288651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:02.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.576265+0000","last_change":"2024-09-22T08:10:45.176318+0000","last_active":"2024-09-22T08:12:52.576265+0000","last_peered":"2024-09-22T08:12:52.576265+0000","last_clean":"2024-09-22T08:12:52.576265+0000","last_became_active":"2024-09-22T08:10:45.176033+0000","last_became_peered":"2024-09-22T08:10:45.176033+0000","last_unstale":"2024-09-22T08:12:52.576265+0000","last_undegraded":"2024-09-22T08:12:52.576265+0000","last_fullsized":"2024-09-22T08:12:52.576265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:16.885517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210644+0000","last_change":"2024-09-22T08:10:29.013963+0000","last_active":"2024-09-22T08:11:23.210644+0000","last_peered":"2024-09-22T08:11:23.210644+0000","last_clean":"2024-09-22T08:11:23.210644+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:11:23.210644+0000","last_undegraded":"2024-09-22T08:11:23.210644+0000","last_fullsized":"2024-09-22T08:11:23.210644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_clean_scrub_stamp":"2024-09-22T08:10:27.897500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:09.733603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211507+0000","last_change":"2024-09-22T08:10:35.923301+0000","last_active":"2024-09-22T08:11:23.211507+0000","last_peered":"2024-09-22T08:11:23.211507+0000","last_clean":"2024-09-22T08:11:23.211507+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:11:23.211507+0000","last_undegraded":"2024-09-22T08:11:23.211507+0000","last_fullsized":"2024-09-22T08:11:23.211507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:47.170548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:47.584171+0000","last_change":"2024-09-22T08:10:43.201333+0000","last_active":"2024-09-22T08:12:47.584171+0000","last_peered":"2024-09-22T08:12:47.584171+0000","last_clean":"2024-09-22T08:12:47.584171+0000","last_became_active":"2024-09-22T08:10:43.200918+0000","last_became_peered":"2024-09-22T08:10:43.200918+0000","last_unstale":"2024-09-22T08:12:47.584171+0000","last_undegraded":"2024-09-22T08:12:47.584171+0000","last_fullsized":"2024-09-22T08:12:47.584171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:56.138697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"25'1","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.224891+0000","last_change":"2024-09-22T08:10:47.176080+0000","last_active":"2024-09-22T08:12:52.224891+0000","last_peered":"2024-09-22T08:12:52.224891+0000","last_clean":"2024-09-22T08:12:52.224891+0000","last_became_active":"2024-09-22T08:10:47.175775+0000","last_became_peered":"2024-09-22T08:10:47.175775+0000","last_unstale":"2024-09-22T08:12:52.224891+0000","last_undegraded":"2024-09-22T08:12:52.224891+0000","last_fullsized":"2024-09-22T08:12:52.224891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:05.368279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.154641+0000","last_change":"2024-09-22T08:10:49.185987+0000","last_active":"2024-09-22T08:12:51.154641+0000","last_peered":"2024-09-22T08:12:51.154641+0000","last_clean":"2024-09-22T08:12:51.154641+0000","last_became_active":"2024-09-22T08:10:49.185661+0000","last_became_peered":"2024-09-22T08:10:49.185661+0000","last_unstale":"2024-09-22T08:12:51.154641+0000","last_undegraded":"2024-09-22T08:12:51.154641+0000","last_fullsized":"2024-09-22T08:12:51.154641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:08.519832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222697+0000","last_change":"2024-09-22T08:10:51.202811+0000","last_active":"2024-09-22T08:11:23.222697+0000","last_peered":"2024-09-22T08:11:23.222697+0000","last_clean":"2024-09-22T08:11:23.222697+0000","last_became_active":"2024-09-22T08:10:51.202473+0000","last_became_peered":"2024-09-22T08:10:51.202473+0000","last_unstale":"2024-09-22T08:11:23.222697+0000","last_undegraded":"2024-09-22T08:11:23.222697+0000","last_fullsized":"2024-09-22T08:11:23.222697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.556104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.266227+0000","last_change":"2024-09-22T08:10:53.192244+0000","last_active":"2024-09-22T08:13:53.266227+0000","last_peered":"2024-09-22T08:13:53.266227+0000","last_clean":"2024-09-22T08:13:53.266227+0000","last_became_active":"2024-09-22T08:10:53.191752+0000","last_became_peered":"2024-09-22T08:10:53.191752+0000","last_unstale":"2024-09-22T08:13:53.266227+0000","last_undegraded":"2024-09-22T08:13:53.266227+0000","last_fullsized":"2024-09-22T08:13:53.266227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:21.155421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183521+0000","last_change":"2024-09-22T08:10:45.167615+0000","last_active":"2024-09-22T08:13:53.183521+0000","last_peered":"2024-09-22T08:13:53.183521+0000","last_clean":"2024-09-22T08:13:53.183521+0000","last_became_active":"2024-09-22T08:10:45.167260+0000","last_became_peered":"2024-09-22T08:10:45.167260+0000","last_unstale":"2024-09-22T08:13:53.183521+0000","last_undegraded":"2024-09-22T08:13:53.183521+0000","last_fullsized":"2024-09-22T08:13:53.183521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:09.439811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209592+0000","last_change":"2024-09-22T08:10:35.922413+0000","last_active":"2024-09-22T08:11:23.209592+0000","last_peered":"2024-09-22T08:11:23.209592+0000","last_clean":"2024-09-22T08:11:23.209592+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:11:23.209592+0000","last_undegraded":"2024-09-22T08:11:23.209592+0000","last_fullsized":"2024-09-22T08:11:23.209592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:14.955260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.175049+0000","last_change":"2024-09-22T08:10:43.178602+0000","last_active":"2024-09-22T08:13:53.175049+0000","last_peered":"2024-09-22T08:13:53.175049+0000","last_clean":"2024-09-22T08:13:53.175049+0000","last_became_active":"2024-09-22T08:10:43.177928+0000","last_became_peered":"2024-09-22T08:10:43.177928+0000","last_unstale":"2024-09-22T08:13:53.175049+0000","last_undegraded":"2024-09-22T08:13:53.175049+0000","last_fullsized":"2024-09-22T08:13:53.175049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:47.867688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212854+0000","last_change":"2024-09-22T08:10:47.176700+0000","last_active":"2024-09-22T08:11:23.212854+0000","last_peered":"2024-09-22T08:11:23.212854+0000","last_clean":"2024-09-22T08:11:23.212854+0000","last_became_active":"2024-09-22T08:10:47.176402+0000","last_became_peered":"2024-09-22T08:10:47.176402+0000","last_unstale":"2024-09-22T08:11:23.212854+0000","last_undegraded":"2024-09-22T08:11:23.212854+0000","last_fullsized":"2024-09-22T08:11:23.212854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:30.271890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'273","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254453+0000","last_change":"2024-09-22T08:10:49.186526+0000","last_active":"2024-09-22T08:13:52.254453+0000","last_peered":"2024-09-22T08:13:52.254453+0000","last_clean":"2024-09-22T08:13:52.254453+0000","last_became_active":"2024-09-22T08:10:49.186277+0000","last_became_peered":"2024-09-22T08:10:49.186277+0000","last_unstale":"2024-09-22T08:13:52.254453+0000","last_undegraded":"2024-09-22T08:13:52.254453+0000","last_fullsized":"2024-09-22T08:13:52.254453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:42.950185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210281+0000","last_change":"2024-09-22T08:10:51.198493+0000","last_active":"2024-09-22T08:11:23.210281+0000","last_peered":"2024-09-22T08:11:23.210281+0000","last_clean":"2024-09-22T08:11:23.210281+0000","last_became_active":"2024-09-22T08:10:51.196837+0000","last_became_peered":"2024-09-22T08:10:51.196837+0000","last_unstale":"2024-09-22T08:11:23.210281+0000","last_undegraded":"2024-09-22T08:11:23.210281+0000","last_fullsized":"2024-09-22T08:11:23.210281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:20.497307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.832166+0000","last_change":"2024-09-22T08:10:53.199926+0000","last_active":"2024-09-22T08:12:08.832166+0000","last_peered":"2024-09-22T08:12:08.832166+0000","last_clean":"2024-09-22T08:12:08.832166+0000","last_became_active":"2024-09-22T08:10:53.199214+0000","last_became_peered":"2024-09-22T08:10:53.199214+0000","last_unstale":"2024-09-22T08:12:08.832166+0000","last_undegraded":"2024-09-22T08:12:08.832166+0000","last_fullsized":"2024-09-22T08:12:08.832166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:35.327109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'11","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.958255+0000","last_change":"2024-09-22T08:10:45.176242+0000","last_active":"2024-09-22T08:13:52.958255+0000","last_peered":"2024-09-22T08:13:52.958255+0000","last_clean":"2024-09-22T08:13:52.958255+0000","last_became_active":"2024-09-22T08:10:45.175923+0000","last_became_peered":"2024-09-22T08:10:45.175923+0000","last_unstale":"2024-09-22T08:13:52.958255+0000","last_undegraded":"2024-09-22T08:13:52.958255+0000","last_fullsized":"2024-09-22T08:13:52.958255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:05.397239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207525+0000","last_change":"2024-09-22T08:10:36.081840+0000","last_active":"2024-09-22T08:11:23.207525+0000","last_peered":"2024-09-22T08:11:23.207525+0000","last_clean":"2024-09-22T08:11:23.207525+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:11:23.207525+0000","last_undegraded":"2024-09-22T08:11:23.207525+0000","last_fullsized":"2024-09-22T08:11:23.207525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:30.701302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.219803+0000","last_change":"2024-09-22T08:10:43.187298+0000","last_active":"2024-09-22T08:11:23.219803+0000","last_peered":"2024-09-22T08:11:23.219803+0000","last_clean":"2024-09-22T08:11:23.219803+0000","last_became_active":"2024-09-22T08:10:43.186500+0000","last_became_peered":"2024-09-22T08:10:43.186500+0000","last_unstale":"2024-09-22T08:11:23.219803+0000","last_undegraded":"2024-09-22T08:11:23.219803+0000","last_fullsized":"2024-09-22T08:11:23.219803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:05.709839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208957+0000","last_change":"2024-09-22T08:10:47.172553+0000","last_active":"2024-09-22T08:11:23.208957+0000","last_peered":"2024-09-22T08:11:23.208957+0000","last_clean":"2024-09-22T08:11:23.208957+0000","last_became_active":"2024-09-22T08:10:47.172041+0000","last_became_peered":"2024-09-22T08:10:47.172041+0000","last_unstale":"2024-09-22T08:11:23.208957+0000","last_undegraded":"2024-09-22T08:11:23.208957+0000","last_fullsized":"2024-09-22T08:11:23.208957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:29.368363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'18","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254753+0000","last_change":"2024-09-22T08:10:49.180939+0000","last_active":"2024-09-22T08:13:52.254753+0000","last_peered":"2024-09-22T08:13:52.254753+0000","last_clean":"2024-09-22T08:13:52.254753+0000","last_became_active":"2024-09-22T08:10:49.180563+0000","last_became_peered":"2024-09-22T08:10:49.180563+0000","last_unstale":"2024-09-22T08:13:52.254753+0000","last_undegraded":"2024-09-22T08:13:52.254753+0000","last_fullsized":"2024-09-22T08:13:52.254753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:39.091603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221445+0000","last_change":"2024-09-22T08:10:51.202850+0000","last_active":"2024-09-22T08:11:23.221445+0000","last_peered":"2024-09-22T08:11:23.221445+0000","last_clean":"2024-09-22T08:11:23.221445+0000","last_became_active":"2024-09-22T08:10:51.202422+0000","last_became_peered":"2024-09-22T08:10:51.202422+0000","last_unstale":"2024-09-22T08:11:23.221445+0000","last_undegraded":"2024-09-22T08:11:23.221445+0000","last_fullsized":"2024-09-22T08:11:23.221445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:08.745501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209116+0000","last_change":"2024-09-22T08:10:53.200159+0000","last_active":"2024-09-22T08:11:23.209116+0000","last_peered":"2024-09-22T08:11:23.209116+0000","last_clean":"2024-09-22T08:11:23.209116+0000","last_became_active":"2024-09-22T08:10:53.199894+0000","last_became_peered":"2024-09-22T08:10:53.199894+0000","last_unstale":"2024-09-22T08:11:23.209116+0000","last_undegraded":"2024-09-22T08:11:23.209116+0000","last_fullsized":"2024-09-22T08:11:23.209116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:07.697983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828326+0000","last_change":"2024-09-22T08:10:45.167126+0000","last_active":"2024-09-22T08:12:08.828326+0000","last_peered":"2024-09-22T08:12:08.828326+0000","last_clean":"2024-09-22T08:12:08.828326+0000","last_became_active":"2024-09-22T08:10:45.166816+0000","last_became_peered":"2024-09-22T08:10:45.166816+0000","last_unstale":"2024-09-22T08:12:08.828326+0000","last_undegraded":"2024-09-22T08:12:08.828326+0000","last_fullsized":"2024-09-22T08:12:08.828326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:52.901946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209498+0000","last_change":"2024-09-22T08:10:35.923055+0000","last_active":"2024-09-22T08:11:23.209498+0000","last_peered":"2024-09-22T08:11:23.209498+0000","last_clean":"2024-09-22T08:11:23.209498+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:11:23.209498+0000","last_undegraded":"2024-09-22T08:11:23.209498+0000","last_fullsized":"2024-09-22T08:11:23.209498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:18.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207661+0000","last_change":"2024-09-22T08:10:43.187474+0000","last_active":"2024-09-22T08:11:23.207661+0000","last_peered":"2024-09-22T08:11:23.207661+0000","last_clean":"2024-09-22T08:11:23.207661+0000","last_became_active":"2024-09-22T08:10:43.187103+0000","last_became_peered":"2024-09-22T08:10:43.187103+0000","last_unstale":"2024-09-22T08:11:23.207661+0000","last_undegraded":"2024-09-22T08:11:23.207661+0000","last_fullsized":"2024-09-22T08:11:23.207661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:48.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222126+0000","last_change":"2024-09-22T08:10:47.168792+0000","last_active":"2024-09-22T08:11:23.222126+0000","last_peered":"2024-09-22T08:11:23.222126+0000","last_clean":"2024-09-22T08:11:23.222126+0000","last_became_active":"2024-09-22T08:10:47.168480+0000","last_became_peered":"2024-09-22T08:10:47.168480+0000","last_unstale":"2024-09-22T08:11:23.222126+0000","last_undegraded":"2024-09-22T08:11:23.222126+0000","last_fullsized":"2024-09-22T08:11:23.222126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:19.091966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.586312+0000","last_change":"2024-09-22T08:10:49.185221+0000","last_active":"2024-09-22T08:13:52.586312+0000","last_peered":"2024-09-22T08:13:52.586312+0000","last_clean":"2024-09-22T08:13:52.586312+0000","last_became_active":"2024-09-22T08:10:49.184961+0000","last_became_peered":"2024-09-22T08:10:49.184961+0000","last_unstale":"2024-09-22T08:13:52.586312+0000","last_undegraded":"2024-09-22T08:13:52.586312+0000","last_fullsized":"2024-09-22T08:13:52.586312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:00.221298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213144+0000","last_change":"2024-09-22T08:10:51.195952+0000","last_active":"2024-09-22T08:11:23.213144+0000","last_peered":"2024-09-22T08:11:23.213144+0000","last_clean":"2024-09-22T08:11:23.213144+0000","last_became_active":"2024-09-22T08:10:51.195643+0000","last_became_peered":"2024-09-22T08:10:51.195643+0000","last_unstale":"2024-09-22T08:11:23.213144+0000","last_undegraded":"2024-09-22T08:11:23.213144+0000","last_fullsized":"2024-09-22T08:11:23.213144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:18.035075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.336216+0000","last_change":"2024-09-22T08:10:53.203765+0000","last_active":"2024-09-22T08:12:52.336216+0000","last_peered":"2024-09-22T08:12:52.336216+0000","last_clean":"2024-09-22T08:12:52.336216+0000","last_became_active":"2024-09-22T08:10:53.203330+0000","last_became_peered":"2024-09-22T08:10:53.203330+0000","last_unstale":"2024-09-22T08:12:52.336216+0000","last_undegraded":"2024-09-22T08:12:52.336216+0000","last_fullsized":"2024-09-22T08:12:52.336216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:46.081338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.047853+0000","last_change":"2024-09-22T08:10:45.182440+0000","last_active":"2024-09-22T08:13:53.047853+0000","last_peered":"2024-09-22T08:13:53.047853+0000","last_clean":"2024-09-22T08:13:53.047853+0000","last_became_active":"2024-09-22T08:10:45.182276+0000","last_became_peered":"2024-09-22T08:10:45.182276+0000","last_unstale":"2024-09-22T08:13:53.047853+0000","last_undegraded":"2024-09-22T08:13:53.047853+0000","last_fullsized":"2024-09-22T08:13:53.047853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:53.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.164200+0000","last_change":"2024-09-22T08:10:43.193611+0000","last_active":"2024-09-22T08:13:53.164200+0000","last_peered":"2024-09-22T08:13:53.164200+0000","last_clean":"2024-09-22T08:13:53.164200+0000","last_became_active":"2024-09-22T08:10:43.186175+0000","last_became_peered":"2024-09-22T08:10:43.186175+0000","last_unstale":"2024-09-22T08:13:53.164200+0000","last_undegraded":"2024-09-22T08:13:53.164200+0000","last_fullsized":"2024-09-22T08:13:53.164200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:31.708040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221346+0000","last_change":"2024-09-22T08:10:35.924829+0000","last_active":"2024-09-22T08:11:23.221346+0000","last_peered":"2024-09-22T08:11:23.221346+0000","last_clean":"2024-09-22T08:11:23.221346+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:11:23.221346+0000","last_undegraded":"2024-09-22T08:11:23.221346+0000","last_fullsized":"2024-09-22T08:11:23.221346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:15.126946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.583815+0000","last_change":"2024-09-22T08:10:47.167981+0000","last_active":"2024-09-22T08:12:51.583815+0000","last_peered":"2024-09-22T08:12:51.583815+0000","last_clean":"2024-09-22T08:12:51.583815+0000","last_became_active":"2024-09-22T08:10:47.167620+0000","last_became_peered":"2024-09-22T08:10:47.167620+0000","last_unstale":"2024-09-22T08:12:51.583815+0000","last_undegraded":"2024-09-22T08:12:51.583815+0000","last_fullsized":"2024-09-22T08:12:51.583815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:35.145384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'63","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.265186+0000","last_change":"2024-09-22T08:10:49.185023+0000","last_active":"2024-09-22T08:13:53.265186+0000","last_peered":"2024-09-22T08:13:53.265186+0000","last_clean":"2024-09-22T08:13:53.265186+0000","last_became_active":"2024-09-22T08:10:49.184753+0000","last_became_peered":"2024-09-22T08:10:49.184753+0000","last_unstale":"2024-09-22T08:13:53.265186+0000","last_undegraded":"2024-09-22T08:13:53.265186+0000","last_fullsized":"2024-09-22T08:13:53.265186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:46.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":61,"num_read_kb":49,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206763+0000","last_change":"2024-09-22T08:10:51.197026+0000","last_active":"2024-09-22T08:11:23.206763+0000","last_peered":"2024-09-22T08:11:23.206763+0000","last_clean":"2024-09-22T08:11:23.206763+0000","last_became_active":"2024-09-22T08:10:51.196724+0000","last_became_peered":"2024-09-22T08:10:51.196724+0000","last_unstale":"2024-09-22T08:11:23.206763+0000","last_undegraded":"2024-09-22T08:11:23.206763+0000","last_fullsized":"2024-09-22T08:11:23.206763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:06.499640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.230225+0000","last_change":"2024-09-22T08:10:53.196686+0000","last_active":"2024-09-22T08:13:53.230225+0000","last_peered":"2024-09-22T08:13:53.230225+0000","last_clean":"2024-09-22T08:13:53.230225+0000","last_became_active":"2024-09-22T08:10:53.196406+0000","last_became_peered":"2024-09-22T08:10:53.196406+0000","last_unstale":"2024-09-22T08:13:53.230225+0000","last_undegraded":"2024-09-22T08:13:53.230225+0000","last_fullsized":"2024-09-22T08:13:53.230225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:42.892968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254919+0000","last_change":"2024-09-22T08:10:45.176907+0000","last_active":"2024-09-22T08:13:53.254919+0000","last_peered":"2024-09-22T08:13:53.254919+0000","last_clean":"2024-09-22T08:13:53.254919+0000","last_became_active":"2024-09-22T08:10:45.176601+0000","last_became_peered":"2024-09-22T08:10:45.176601+0000","last_unstale":"2024-09-22T08:13:53.254919+0000","last_undegraded":"2024-09-22T08:13:53.254919+0000","last_fullsized":"2024-09-22T08:13:53.254919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:23:25.305179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.170482+0000","last_change":"2024-09-22T08:10:43.187808+0000","last_active":"2024-09-22T08:13:53.170482+0000","last_peered":"2024-09-22T08:13:53.170482+0000","last_clean":"2024-09-22T08:13:53.170482+0000","last_became_active":"2024-09-22T08:10:43.186758+0000","last_became_peered":"2024-09-22T08:10:43.186758+0000","last_unstale":"2024-09-22T08:13:53.170482+0000","last_undegraded":"2024-09-22T08:13:53.170482+0000","last_fullsized":"2024-09-22T08:13:53.170482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:23.595549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211013+0000","last_change":"2024-09-22T08:10:35.922434+0000","last_active":"2024-09-22T08:11:23.211013+0000","last_peered":"2024-09-22T08:11:23.211013+0000","last_clean":"2024-09-22T08:11:23.211013+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:11:23.211013+0000","last_undegraded":"2024-09-22T08:11:23.211013+0000","last_fullsized":"2024-09-22T08:11:23.211013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:36.971498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209307+0000","last_change":"2024-09-22T08:10:47.173748+0000","last_active":"2024-09-22T08:11:23.209307+0000","last_peered":"2024-09-22T08:11:23.209307+0000","last_clean":"2024-09-22T08:11:23.209307+0000","last_became_active":"2024-09-22T08:10:47.173348+0000","last_became_peered":"2024-09-22T08:10:47.173348+0000","last_unstale":"2024-09-22T08:11:23.209307+0000","last_undegraded":"2024-09-22T08:11:23.209307+0000","last_fullsized":"2024-09-22T08:11:23.209307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:18:06.081248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212964+0000","last_change":"2024-09-22T08:10:49.187453+0000","last_active":"2024-09-22T08:11:23.212964+0000","last_peered":"2024-09-22T08:11:23.212964+0000","last_clean":"2024-09-22T08:11:23.212964+0000","last_became_active":"2024-09-22T08:10:49.187184+0000","last_became_peered":"2024-09-22T08:10:49.187184+0000","last_unstale":"2024-09-22T08:11:23.212964+0000","last_undegraded":"2024-09-22T08:11:23.212964+0000","last_fullsized":"2024-09-22T08:11:23.212964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:19:08.593807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":370,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254387+0000","last_change":"2024-09-22T08:10:51.197450+0000","last_active":"2024-09-22T08:13:52.254387+0000","last_peered":"2024-09-22T08:13:52.254387+0000","last_clean":"2024-09-22T08:13:52.254387+0000","last_became_active":"2024-09-22T08:10:51.197111+0000","last_became_peered":"2024-09-22T08:10:51.197111+0000","last_unstale":"2024-09-22T08:13:52.254387+0000","last_undegraded":"2024-09-22T08:13:52.254387+0000","last_fullsized":"2024-09-22T08:13:52.254387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212274+0000","last_change":"2024-09-22T08:10:53.200428+0000","last_active":"2024-09-22T08:11:23.212274+0000","last_peered":"2024-09-22T08:11:23.212274+0000","last_clean":"2024-09-22T08:11:23.212274+0000","last_became_active":"2024-09-22T08:10:53.199612+0000","last_became_peered":"2024-09-22T08:10:53.199612+0000","last_unstale":"2024-09-22T08:11:23.212274+0000","last_undegraded":"2024-09-22T08:11:23.212274+0000","last_fullsized":"2024-09-22T08:11:23.212274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:47.560464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.007599+0000","last_change":"2024-09-22T08:10:45.183951+0000","last_active":"2024-09-22T08:11:26.007599+0000","last_peered":"2024-09-22T08:11:26.007599+0000","last_clean":"2024-09-22T08:11:26.007599+0000","last_became_active":"2024-09-22T08:10:45.183229+0000","last_became_peered":"2024-09-22T08:10:45.183229+0000","last_unstale":"2024-09-22T08:11:26.007599+0000","last_undegraded":"2024-09-22T08:11:26.007599+0000","last_fullsized":"2024-09-22T08:11:26.007599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:03.361288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214275+0000","last_change":"2024-09-22T08:10:43.199726+0000","last_active":"2024-09-22T08:11:23.214275+0000","last_peered":"2024-09-22T08:11:23.214275+0000","last_clean":"2024-09-22T08:11:23.214275+0000","last_became_active":"2024-09-22T08:10:43.198637+0000","last_became_peered":"2024-09-22T08:10:43.198637+0000","last_unstale":"2024-09-22T08:11:23.214275+0000","last_undegraded":"2024-09-22T08:11:23.214275+0000","last_fullsized":"2024-09-22T08:11:23.214275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.086176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222838+0000","last_change":"2024-09-22T08:10:35.924894+0000","last_active":"2024-09-22T08:11:23.222838+0000","last_peered":"2024-09-22T08:11:23.222838+0000","last_clean":"2024-09-22T08:11:23.222838+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:11:23.222838+0000","last_undegraded":"2024-09-22T08:11:23.222838+0000","last_fullsized":"2024-09-22T08:11:23.222838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:31.373918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221460+0000","last_change":"2024-09-22T08:11:23.216945+0000","last_active":"2024-09-22T08:11:23.221460+0000","last_peered":"2024-09-22T08:11:23.221460+0000","last_clean":"2024-09-22T08:11:23.221460+0000","last_became_active":"2024-09-22T08:11:23.216676+0000","last_became_peered":"2024-09-22T08:11:23.216676+0000","last_unstale":"2024-09-22T08:11:23.221460+0000","last_undegraded":"2024-09-22T08:11:23.221460+0000","last_fullsized":"2024-09-22T08:11:23.221460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:46.451332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213139+0000","last_change":"2024-09-22T08:10:49.188685+0000","last_active":"2024-09-22T08:11:23.213139+0000","last_peered":"2024-09-22T08:11:23.213139+0000","last_clean":"2024-09-22T08:11:23.213139+0000","last_became_active":"2024-09-22T08:10:49.188309+0000","last_became_peered":"2024-09-22T08:10:49.188309+0000","last_unstale":"2024-09-22T08:11:23.213139+0000","last_undegraded":"2024-09-22T08:11:23.213139+0000","last_fullsized":"2024-09-22T08:11:23.213139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.497319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":400,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.362561+0000","last_change":"2024-09-22T08:10:51.193163+0000","last_active":"2024-09-22T08:13:53.362561+0000","last_peered":"2024-09-22T08:13:53.362561+0000","last_clean":"2024-09-22T08:13:53.362561+0000","last_became_active":"2024-09-22T08:10:51.192058+0000","last_became_peered":"2024-09-22T08:10:51.192058+0000","last_unstale":"2024-09-22T08:13:53.362561+0000","last_undegraded":"2024-09-22T08:13:53.362561+0000","last_fullsized":"2024-09-22T08:13:53.362561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213624+0000","last_change":"2024-09-22T08:10:53.203958+0000","last_active":"2024-09-22T08:11:23.213624+0000","last_peered":"2024-09-22T08:11:23.213624+0000","last_clean":"2024-09-22T08:11:23.213624+0000","last_became_active":"2024-09-22T08:10:53.203670+0000","last_became_peered":"2024-09-22T08:10:53.203670+0000","last_unstale":"2024-09-22T08:11:23.213624+0000","last_undegraded":"2024-09-22T08:11:23.213624+0000","last_fullsized":"2024-09-22T08:11:23.213624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:04.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'17","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.190706+0000","last_change":"2024-09-22T08:10:45.172007+0000","last_active":"2024-09-22T08:13:53.190706+0000","last_peered":"2024-09-22T08:13:53.190706+0000","last_clean":"2024-09-22T08:13:53.190706+0000","last_became_active":"2024-09-22T08:10:45.171667+0000","last_became_peered":"2024-09-22T08:10:45.171667+0000","last_unstale":"2024-09-22T08:13:53.190706+0000","last_undegraded":"2024-09-22T08:13:53.190706+0000","last_fullsized":"2024-09-22T08:13:53.190706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:31.764706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562709+0000","last_change":"2024-09-22T08:10:43.182563+0000","last_active":"2024-09-22T08:11:25.562709+0000","last_peered":"2024-09-22T08:11:25.562709+0000","last_clean":"2024-09-22T08:11:25.562709+0000","last_became_active":"2024-09-22T08:10:43.182161+0000","last_became_peered":"2024-09-22T08:10:43.182161+0000","last_unstale":"2024-09-22T08:11:25.562709+0000","last_undegraded":"2024-09-22T08:11:25.562709+0000","last_fullsized":"2024-09-22T08:11:25.562709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:48.821851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213965+0000","last_change":"2024-09-22T08:10:35.923155+0000","last_active":"2024-09-22T08:11:23.213965+0000","last_peered":"2024-09-22T08:11:23.213965+0000","last_clean":"2024-09-22T08:11:23.213965+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:11:23.213965+0000","last_undegraded":"2024-09-22T08:11:23.213965+0000","last_fullsized":"2024-09-22T08:11:23.213965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:11:54.812723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209442+0000","last_change":"2024-09-22T08:10:47.174132+0000","last_active":"2024-09-22T08:11:23.209442+0000","last_peered":"2024-09-22T08:11:23.209442+0000","last_clean":"2024-09-22T08:11:23.209442+0000","last_became_active":"2024-09-22T08:10:47.172441+0000","last_became_peered":"2024-09-22T08:10:47.172441+0000","last_unstale":"2024-09-22T08:11:23.209442+0000","last_undegraded":"2024-09-22T08:11:23.209442+0000","last_fullsized":"2024-09-22T08:11:23.209442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:47.078285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":155,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.140573+0000","last_change":"2024-09-22T08:10:49.185244+0000","last_active":"2024-09-22T08:12:51.140573+0000","last_peered":"2024-09-22T08:12:51.140573+0000","last_clean":"2024-09-22T08:12:51.140573+0000","last_became_active":"2024-09-22T08:10:49.184942+0000","last_became_peered":"2024-09-22T08:10:49.184942+0000","last_unstale":"2024-09-22T08:12:51.140573+0000","last_undegraded":"2024-09-22T08:12:51.140573+0000","last_fullsized":"2024-09-22T08:12:51.140573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:53.328309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220410+0000","last_change":"2024-09-22T08:10:51.195295+0000","last_active":"2024-09-22T08:11:23.220410+0000","last_peered":"2024-09-22T08:11:23.220410+0000","last_clean":"2024-09-22T08:11:23.220410+0000","last_became_active":"2024-09-22T08:10:51.194912+0000","last_became_peered":"2024-09-22T08:10:51.194912+0000","last_unstale":"2024-09-22T08:11:23.220410+0000","last_undegraded":"2024-09-22T08:11:23.220410+0000","last_fullsized":"2024-09-22T08:11:23.220410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:22.604330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208925+0000","last_change":"2024-09-22T08:10:53.192489+0000","last_active":"2024-09-22T08:11:23.208925+0000","last_peered":"2024-09-22T08:11:23.208925+0000","last_clean":"2024-09-22T08:11:23.208925+0000","last_became_active":"2024-09-22T08:10:53.192189+0000","last_became_peered":"2024-09-22T08:10:53.192189+0000","last_unstale":"2024-09-22T08:11:23.208925+0000","last_undegraded":"2024-09-22T08:11:23.208925+0000","last_fullsized":"2024-09-22T08:11:23.208925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:14.737752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208582+0000","last_change":"2024-09-22T08:10:53.198120+0000","last_active":"2024-09-22T08:11:23.208582+0000","last_peered":"2024-09-22T08:11:23.208582+0000","last_clean":"2024-09-22T08:11:23.208582+0000","last_became_active":"2024-09-22T08:10:53.197799+0000","last_became_peered":"2024-09-22T08:10:53.197799+0000","last_unstale":"2024-09-22T08:11:23.208582+0000","last_undegraded":"2024-09-22T08:11:23.208582+0000","last_fullsized":"2024-09-22T08:11:23.208582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:55.526373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.047862+0000","last_change":"2024-09-22T08:10:45.174189+0000","last_active":"2024-09-22T08:13:53.047862+0000","last_peered":"2024-09-22T08:13:53.047862+0000","last_clean":"2024-09-22T08:13:53.047862+0000","last_became_active":"2024-09-22T08:10:45.173916+0000","last_became_peered":"2024-09-22T08:10:45.173916+0000","last_unstale":"2024-09-22T08:13:53.047862+0000","last_undegraded":"2024-09-22T08:13:53.047862+0000","last_fullsized":"2024-09-22T08:13:53.047862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:27.673736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.422254+0000","last_change":"2024-09-22T08:10:43.201372+0000","last_active":"2024-09-22T08:12:52.422254+0000","last_peered":"2024-09-22T08:12:52.422254+0000","last_clean":"2024-09-22T08:12:52.422254+0000","last_became_active":"2024-09-22T08:10:43.201007+0000","last_became_peered":"2024-09-22T08:10:43.201007+0000","last_unstale":"2024-09-22T08:12:52.422254+0000","last_undegraded":"2024-09-22T08:12:52.422254+0000","last_fullsized":"2024-09-22T08:12:52.422254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:49.200344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212648+0000","last_change":"2024-09-22T08:10:47.176086+0000","last_active":"2024-09-22T08:11:23.212648+0000","last_peered":"2024-09-22T08:11:23.212648+0000","last_clean":"2024-09-22T08:11:23.212648+0000","last_became_active":"2024-09-22T08:10:47.175524+0000","last_became_peered":"2024-09-22T08:10:47.175524+0000","last_unstale":"2024-09-22T08:11:23.212648+0000","last_undegraded":"2024-09-22T08:11:23.212648+0000","last_fullsized":"2024-09-22T08:11:23.212648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:13.592432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.146947+0000","last_change":"2024-09-22T08:10:49.186252+0000","last_active":"2024-09-22T08:12:51.146947+0000","last_peered":"2024-09-22T08:12:51.146947+0000","last_clean":"2024-09-22T08:12:51.146947+0000","last_became_active":"2024-09-22T08:10:49.185693+0000","last_became_peered":"2024-09-22T08:10:49.185693+0000","last_unstale":"2024-09-22T08:12:51.146947+0000","last_undegraded":"2024-09-22T08:12:51.146947+0000","last_fullsized":"2024-09-22T08:12:51.146947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:02.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213000+0000","last_change":"2024-09-22T08:10:51.200112+0000","last_active":"2024-09-22T08:11:23.213000+0000","last_peered":"2024-09-22T08:11:23.213000+0000","last_clean":"2024-09-22T08:11:23.213000+0000","last_became_active":"2024-09-22T08:10:51.199799+0000","last_became_peered":"2024-09-22T08:10:51.199799+0000","last_unstale":"2024-09-22T08:11:23.213000+0000","last_undegraded":"2024-09-22T08:11:23.213000+0000","last_fullsized":"2024-09-22T08:11:23.213000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:06.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'13","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.308456+0000","last_change":"2024-09-22T08:10:53.201508+0000","last_active":"2024-09-22T08:13:53.308456+0000","last_peered":"2024-09-22T08:13:53.308456+0000","last_clean":"2024-09-22T08:13:53.308456+0000","last_became_active":"2024-09-22T08:10:53.201209+0000","last_became_peered":"2024-09-22T08:10:53.201209+0000","last_unstale":"2024-09-22T08:13:53.308456+0000","last_undegraded":"2024-09-22T08:13:53.308456+0000","last_fullsized":"2024-09-22T08:13:53.308456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:20.642196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":69,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183415+0000","last_change":"2024-09-22T08:10:45.182432+0000","last_active":"2024-09-22T08:13:53.183415+0000","last_peered":"2024-09-22T08:13:53.183415+0000","last_clean":"2024-09-22T08:13:53.183415+0000","last_became_active":"2024-09-22T08:10:45.182245+0000","last_became_peered":"2024-09-22T08:10:45.182245+0000","last_unstale":"2024-09-22T08:13:53.183415+0000","last_undegraded":"2024-09-22T08:13:53.183415+0000","last_fullsized":"2024-09-22T08:13:53.183415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:33.105535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:07.586758+0000","last_change":"2024-09-22T08:10:43.193144+0000","last_active":"2024-09-22T08:13:07.586758+0000","last_peered":"2024-09-22T08:13:07.586758+0000","last_clean":"2024-09-22T08:13:07.586758+0000","last_became_active":"2024-09-22T08:10:43.185230+0000","last_became_peered":"2024-09-22T08:10:43.185230+0000","last_unstale":"2024-09-22T08:13:07.586758+0000","last_undegraded":"2024-09-22T08:13:07.586758+0000","last_fullsized":"2024-09-22T08:13:07.586758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:51.284672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209614+0000","last_change":"2024-09-22T08:10:47.176256+0000","last_active":"2024-09-22T08:11:23.209614+0000","last_peered":"2024-09-22T08:11:23.209614+0000","last_clean":"2024-09-22T08:11:23.209614+0000","last_became_active":"2024-09-22T08:10:47.175747+0000","last_became_peered":"2024-09-22T08:10:47.175747+0000","last_unstale":"2024-09-22T08:11:23.209614+0000","last_undegraded":"2024-09-22T08:11:23.209614+0000","last_fullsized":"2024-09-22T08:11:23.209614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:17.217421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.591034+0000","last_change":"2024-09-22T08:10:49.181276+0000","last_active":"2024-09-22T08:13:52.591034+0000","last_peered":"2024-09-22T08:13:52.591034+0000","last_clean":"2024-09-22T08:13:52.591034+0000","last_became_active":"2024-09-22T08:10:49.180921+0000","last_became_peered":"2024-09-22T08:10:49.180921+0000","last_unstale":"2024-09-22T08:13:52.591034+0000","last_undegraded":"2024-09-22T08:13:52.591034+0000","last_fullsized":"2024-09-22T08:13:52.591034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:10.724160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207132+0000","last_change":"2024-09-22T08:10:51.193254+0000","last_active":"2024-09-22T08:11:23.207132+0000","last_peered":"2024-09-22T08:11:23.207132+0000","last_clean":"2024-09-22T08:11:23.207132+0000","last_became_active":"2024-09-22T08:10:51.192989+0000","last_became_peered":"2024-09-22T08:10:51.192989+0000","last_unstale":"2024-09-22T08:11:23.207132+0000","last_undegraded":"2024-09-22T08:11:23.207132+0000","last_fullsized":"2024-09-22T08:11:23.207132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:29.015464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.008653+0000","last_change":"2024-09-22T08:10:53.193317+0000","last_active":"2024-09-22T08:12:09.008653+0000","last_peered":"2024-09-22T08:12:09.008653+0000","last_clean":"2024-09-22T08:12:09.008653+0000","last_became_active":"2024-09-22T08:10:53.192967+0000","last_became_peered":"2024-09-22T08:10:53.192967+0000","last_unstale":"2024-09-22T08:12:09.008653+0000","last_undegraded":"2024-09-22T08:12:09.008653+0000","last_fullsized":"2024-09-22T08:12:09.008653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:48.815518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.468115+0000","last_change":"2024-09-22T08:10:45.172599+0000","last_active":"2024-09-22T08:12:49.468115+0000","last_peered":"2024-09-22T08:12:49.468115+0000","last_clean":"2024-09-22T08:12:49.468115+0000","last_became_active":"2024-09-22T08:10:45.171555+0000","last_became_peered":"2024-09-22T08:10:45.171555+0000","last_unstale":"2024-09-22T08:12:49.468115+0000","last_undegraded":"2024-09-22T08:12:49.468115+0000","last_fullsized":"2024-09-22T08:12:49.468115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:27.811575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211087+0000","last_change":"2024-09-22T08:10:43.192664+0000","last_active":"2024-09-22T08:11:23.211087+0000","last_peered":"2024-09-22T08:11:23.211087+0000","last_clean":"2024-09-22T08:11:23.211087+0000","last_became_active":"2024-09-22T08:10:43.187044+0000","last_became_peered":"2024-09-22T08:10:43.187044+0000","last_unstale":"2024-09-22T08:11:23.211087+0000","last_undegraded":"2024-09-22T08:11:23.211087+0000","last_fullsized":"2024-09-22T08:11:23.211087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:51.698704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.214782+0000","last_change":"2024-09-22T08:10:47.178036+0000","last_active":"2024-09-22T08:12:52.214782+0000","last_peered":"2024-09-22T08:12:52.214782+0000","last_clean":"2024-09-22T08:12:52.214782+0000","last_became_active":"2024-09-22T08:10:47.177735+0000","last_became_peered":"2024-09-22T08:10:47.177735+0000","last_unstale":"2024-09-22T08:12:52.214782+0000","last_undegraded":"2024-09-22T08:12:52.214782+0000","last_fullsized":"2024-09-22T08:12:52.214782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:05.249659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.646582+0000","last_change":"2024-09-22T08:10:49.182878+0000","last_active":"2024-09-22T08:13:52.646582+0000","last_peered":"2024-09-22T08:13:52.646582+0000","last_clean":"2024-09-22T08:13:52.646582+0000","last_became_active":"2024-09-22T08:10:49.182557+0000","last_became_peered":"2024-09-22T08:10:49.182557+0000","last_unstale":"2024-09-22T08:13:52.646582+0000","last_undegraded":"2024-09-22T08:13:52.646582+0000","last_fullsized":"2024-09-22T08:13:52.646582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:37.230381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212363+0000","last_change":"2024-09-22T08:10:51.198536+0000","last_active":"2024-09-22T08:11:23.212363+0000","last_peered":"2024-09-22T08:11:23.212363+0000","last_clean":"2024-09-22T08:11:23.212363+0000","last_became_active":"2024-09-22T08:10:51.198204+0000","last_became_peered":"2024-09-22T08:10:51.198204+0000","last_unstale":"2024-09-22T08:11:23.212363+0000","last_undegraded":"2024-09-22T08:11:23.212363+0000","last_fullsized":"2024-09-22T08:11:23.212363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.041147+0000","last_change":"2024-09-22T08:10:53.200288+0000","last_active":"2024-09-22T08:11:27.041147+0000","last_peered":"2024-09-22T08:11:27.041147+0000","last_clean":"2024-09-22T08:11:27.041147+0000","last_became_active":"2024-09-22T08:10:53.199827+0000","last_became_peered":"2024-09-22T08:10:53.199827+0000","last_unstale":"2024-09-22T08:11:27.041147+0000","last_undegraded":"2024-09-22T08:11:27.041147+0000","last_fullsized":"2024-09-22T08:11:27.041147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:31.568753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209916+0000","last_change":"2024-09-22T08:10:45.184232+0000","last_active":"2024-09-22T08:11:23.209916+0000","last_peered":"2024-09-22T08:11:23.209916+0000","last_clean":"2024-09-22T08:11:23.209916+0000","last_became_active":"2024-09-22T08:10:45.183674+0000","last_became_peered":"2024-09-22T08:10:45.183674+0000","last_unstale":"2024-09-22T08:11:23.209916+0000","last_undegraded":"2024-09-22T08:11:23.209916+0000","last_fullsized":"2024-09-22T08:11:23.209916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:11.585440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216574+0000","last_change":"2024-09-22T08:10:43.185629+0000","last_active":"2024-09-22T08:11:23.216574+0000","last_peered":"2024-09-22T08:11:23.216574+0000","last_clean":"2024-09-22T08:11:23.216574+0000","last_became_active":"2024-09-22T08:10:43.184287+0000","last_became_peered":"2024-09-22T08:10:43.184287+0000","last_unstale":"2024-09-22T08:11:23.216574+0000","last_undegraded":"2024-09-22T08:11:23.216574+0000","last_fullsized":"2024-09-22T08:11:23.216574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:47.867688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209665+0000","last_change":"2024-09-22T08:10:47.173065+0000","last_active":"2024-09-22T08:11:23.209665+0000","last_peered":"2024-09-22T08:11:23.209665+0000","last_clean":"2024-09-22T08:11:23.209665+0000","last_became_active":"2024-09-22T08:10:47.172816+0000","last_became_peered":"2024-09-22T08:10:47.172816+0000","last_unstale":"2024-09-22T08:11:23.209665+0000","last_undegraded":"2024-09-22T08:11:23.209665+0000","last_fullsized":"2024-09-22T08:11:23.209665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:42.365873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.131969+0000","last_change":"2024-09-22T08:10:49.180939+0000","last_active":"2024-09-22T08:12:51.131969+0000","last_peered":"2024-09-22T08:12:51.131969+0000","last_clean":"2024-09-22T08:12:51.131969+0000","last_became_active":"2024-09-22T08:10:49.180621+0000","last_became_peered":"2024-09-22T08:10:49.180621+0000","last_unstale":"2024-09-22T08:12:51.131969+0000","last_undegraded":"2024-09-22T08:12:51.131969+0000","last_fullsized":"2024-09-22T08:12:51.131969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:10.845059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206973+0000","last_change":"2024-09-22T08:10:51.190255+0000","last_active":"2024-09-22T08:11:23.206973+0000","last_peered":"2024-09-22T08:11:23.206973+0000","last_clean":"2024-09-22T08:11:23.206973+0000","last_became_active":"2024-09-22T08:10:51.189640+0000","last_became_peered":"2024-09-22T08:10:51.189640+0000","last_unstale":"2024-09-22T08:11:23.206973+0000","last_undegraded":"2024-09-22T08:11:23.206973+0000","last_fullsized":"2024-09-22T08:11:23.206973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:01.319577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228734+0000","last_change":"2024-09-22T08:10:45.166911+0000","last_active":"2024-09-22T08:13:53.228734+0000","last_peered":"2024-09-22T08:13:53.228734+0000","last_clean":"2024-09-22T08:13:53.228734+0000","last_became_active":"2024-09-22T08:10:45.166591+0000","last_became_peered":"2024-09-22T08:10:45.166591+0000","last_unstale":"2024-09-22T08:13:53.228734+0000","last_undegraded":"2024-09-22T08:13:53.228734+0000","last_fullsized":"2024-09-22T08:13:53.228734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:01.404622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209800+0000","last_change":"2024-09-22T08:10:43.196054+0000","last_active":"2024-09-22T08:11:23.209800+0000","last_peered":"2024-09-22T08:11:23.209800+0000","last_clean":"2024-09-22T08:11:23.209800+0000","last_became_active":"2024-09-22T08:10:43.195608+0000","last_became_peered":"2024-09-22T08:10:43.195608+0000","last_unstale":"2024-09-22T08:11:23.209800+0000","last_undegraded":"2024-09-22T08:11:23.209800+0000","last_fullsized":"2024-09-22T08:11:23.209800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:24.463602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222765+0000","last_change":"2024-09-22T08:10:47.173698+0000","last_active":"2024-09-22T08:11:23.222765+0000","last_peered":"2024-09-22T08:11:23.222765+0000","last_clean":"2024-09-22T08:11:23.222765+0000","last_became_active":"2024-09-22T08:10:47.173043+0000","last_became_peered":"2024-09-22T08:10:47.173043+0000","last_unstale":"2024-09-22T08:11:23.222765+0000","last_undegraded":"2024-09-22T08:11:23.222765+0000","last_fullsized":"2024-09-22T08:11:23.222765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:50.368872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.577548+0000","last_change":"2024-09-22T08:10:49.181954+0000","last_active":"2024-09-22T08:12:52.577548+0000","last_peered":"2024-09-22T08:12:52.577548+0000","last_clean":"2024-09-22T08:12:52.577548+0000","last_became_active":"2024-09-22T08:10:49.181611+0000","last_became_peered":"2024-09-22T08:10:49.181611+0000","last_unstale":"2024-09-22T08:12:52.577548+0000","last_undegraded":"2024-09-22T08:12:52.577548+0000","last_fullsized":"2024-09-22T08:12:52.577548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:12.944824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207395+0000","last_change":"2024-09-22T08:10:51.190156+0000","last_active":"2024-09-22T08:11:23.207395+0000","last_peered":"2024-09-22T08:11:23.207395+0000","last_clean":"2024-09-22T08:11:23.207395+0000","last_became_active":"2024-09-22T08:10:51.189592+0000","last_became_peered":"2024-09-22T08:10:51.189592+0000","last_unstale":"2024-09-22T08:11:23.207395+0000","last_undegraded":"2024-09-22T08:11:23.207395+0000","last_fullsized":"2024-09-22T08:11:23.207395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:44.042635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.513524+0000","last_change":"2024-09-22T08:10:53.199349+0000","last_active":"2024-09-22T08:12:52.513524+0000","last_peered":"2024-09-22T08:12:52.513524+0000","last_clean":"2024-09-22T08:12:52.513524+0000","last_became_active":"2024-09-22T08:10:53.198999+0000","last_became_peered":"2024-09-22T08:10:53.198999+0000","last_unstale":"2024-09-22T08:12:52.513524+0000","last_undegraded":"2024-09-22T08:12:52.513524+0000","last_fullsized":"2024-09-22T08:12:52.513524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:40.998103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'22","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183552+0000","last_change":"2024-09-22T08:10:45.183697+0000","last_active":"2024-09-22T08:13:53.183552+0000","last_peered":"2024-09-22T08:13:53.183552+0000","last_clean":"2024-09-22T08:13:53.183552+0000","last_became_active":"2024-09-22T08:10:45.183173+0000","last_became_peered":"2024-09-22T08:10:45.183173+0000","last_unstale":"2024-09-22T08:13:53.183552+0000","last_undegraded":"2024-09-22T08:13:53.183552+0000","last_fullsized":"2024-09-22T08:13:53.183552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:20.651086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.564042+0000","last_change":"2024-09-22T08:10:43.178081+0000","last_active":"2024-09-22T08:11:26.564042+0000","last_peered":"2024-09-22T08:11:26.564042+0000","last_clean":"2024-09-22T08:11:26.564042+0000","last_became_active":"2024-09-22T08:10:43.177711+0000","last_became_peered":"2024-09-22T08:10:43.177711+0000","last_unstale":"2024-09-22T08:11:26.564042+0000","last_undegraded":"2024-09-22T08:11:26.564042+0000","last_fullsized":"2024-09-22T08:11:26.564042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:58.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210165+0000","last_change":"2024-09-22T08:10:47.172301+0000","last_active":"2024-09-22T08:11:23.210165+0000","last_peered":"2024-09-22T08:11:23.210165+0000","last_clean":"2024-09-22T08:11:23.210165+0000","last_became_active":"2024-09-22T08:10:47.171702+0000","last_became_peered":"2024-09-22T08:10:47.171702+0000","last_unstale":"2024-09-22T08:11:23.210165+0000","last_undegraded":"2024-09-22T08:11:23.210165+0000","last_fullsized":"2024-09-22T08:11:23.210165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.251018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.132994+0000","last_change":"2024-09-22T08:10:49.183268+0000","last_active":"2024-09-22T08:12:51.132994+0000","last_peered":"2024-09-22T08:12:51.132994+0000","last_clean":"2024-09-22T08:12:51.132994+0000","last_became_active":"2024-09-22T08:10:49.182398+0000","last_became_peered":"2024-09-22T08:10:49.182398+0000","last_unstale":"2024-09-22T08:12:51.132994+0000","last_undegraded":"2024-09-22T08:12:51.132994+0000","last_fullsized":"2024-09-22T08:12:51.132994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:20.960730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214581+0000","last_change":"2024-09-22T08:10:51.202949+0000","last_active":"2024-09-22T08:11:23.214581+0000","last_peered":"2024-09-22T08:11:23.214581+0000","last_clean":"2024-09-22T08:11:23.214581+0000","last_became_active":"2024-09-22T08:10:51.202485+0000","last_became_peered":"2024-09-22T08:10:51.202485+0000","last_unstale":"2024-09-22T08:11:23.214581+0000","last_undegraded":"2024-09-22T08:11:23.214581+0000","last_fullsized":"2024-09-22T08:11:23.214581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.969767+0000","last_change":"2024-09-22T08:10:53.202374+0000","last_active":"2024-09-22T08:13:52.969767+0000","last_peered":"2024-09-22T08:13:52.969767+0000","last_clean":"2024-09-22T08:13:52.969767+0000","last_became_active":"2024-09-22T08:10:53.201942+0000","last_became_peered":"2024-09-22T08:10:53.201942+0000","last_unstale":"2024-09-22T08:13:52.969767+0000","last_undegraded":"2024-09-22T08:13:52.969767+0000","last_fullsized":"2024-09-22T08:13:52.969767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:00.185249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.345446+0000","last_change":"2024-09-22T08:10:45.183871+0000","last_active":"2024-09-22T08:11:26.345446+0000","last_peered":"2024-09-22T08:11:26.345446+0000","last_clean":"2024-09-22T08:11:26.345446+0000","last_became_active":"2024-09-22T08:10:45.183576+0000","last_became_peered":"2024-09-22T08:10:45.183576+0000","last_unstale":"2024-09-22T08:11:26.345446+0000","last_undegraded":"2024-09-22T08:11:26.345446+0000","last_fullsized":"2024-09-22T08:11:26.345446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:50.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212748+0000","last_change":"2024-09-22T08:10:43.179376+0000","last_active":"2024-09-22T08:11:23.212748+0000","last_peered":"2024-09-22T08:11:23.212748+0000","last_clean":"2024-09-22T08:11:23.212748+0000","last_became_active":"2024-09-22T08:10:43.178403+0000","last_became_peered":"2024-09-22T08:10:43.178403+0000","last_unstale":"2024-09-22T08:11:23.212748+0000","last_undegraded":"2024-09-22T08:11:23.212748+0000","last_fullsized":"2024-09-22T08:11:23.212748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:56.538345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208266+0000","last_change":"2024-09-22T08:10:47.172371+0000","last_active":"2024-09-22T08:11:23.208266+0000","last_peered":"2024-09-22T08:11:23.208266+0000","last_clean":"2024-09-22T08:11:23.208266+0000","last_became_active":"2024-09-22T08:10:47.171973+0000","last_became_peered":"2024-09-22T08:10:47.171973+0000","last_unstale":"2024-09-22T08:11:23.208266+0000","last_undegraded":"2024-09-22T08:11:23.208266+0000","last_fullsized":"2024-09-22T08:11:23.208266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:41.035575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:56.584606+0000","last_change":"2024-09-22T08:10:49.185261+0000","last_active":"2024-09-22T08:12:56.584606+0000","last_peered":"2024-09-22T08:12:56.584606+0000","last_clean":"2024-09-22T08:12:56.584606+0000","last_became_active":"2024-09-22T08:10:49.184885+0000","last_became_peered":"2024-09-22T08:10:49.184885+0000","last_unstale":"2024-09-22T08:12:56.584606+0000","last_undegraded":"2024-09-22T08:12:56.584606+0000","last_fullsized":"2024-09-22T08:12:56.584606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:29.150336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222373+0000","last_change":"2024-09-22T08:10:51.194317+0000","last_active":"2024-09-22T08:11:23.222373+0000","last_peered":"2024-09-22T08:11:23.222373+0000","last_clean":"2024-09-22T08:11:23.222373+0000","last_became_active":"2024-09-22T08:10:51.193970+0000","last_became_peered":"2024-09-22T08:10:51.193970+0000","last_unstale":"2024-09-22T08:11:23.222373+0000","last_undegraded":"2024-09-22T08:11:23.222373+0000","last_fullsized":"2024-09-22T08:11:23.222373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:52.931798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.572122+0000","last_change":"2024-09-22T08:10:53.202778+0000","last_active":"2024-09-22T08:12:52.572122+0000","last_peered":"2024-09-22T08:12:52.572122+0000","last_clean":"2024-09-22T08:12:52.572122+0000","last_became_active":"2024-09-22T08:10:53.202493+0000","last_became_peered":"2024-09-22T08:10:53.202493+0000","last_unstale":"2024-09-22T08:12:52.572122+0000","last_undegraded":"2024-09-22T08:12:52.572122+0000","last_fullsized":"2024-09-22T08:12:52.572122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:44.822421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828530+0000","last_change":"2024-09-22T08:10:45.167131+0000","last_active":"2024-09-22T08:12:08.828530+0000","last_peered":"2024-09-22T08:12:08.828530+0000","last_clean":"2024-09-22T08:12:08.828530+0000","last_became_active":"2024-09-22T08:10:45.166540+0000","last_became_peered":"2024-09-22T08:10:45.166540+0000","last_unstale":"2024-09-22T08:12:08.828530+0000","last_undegraded":"2024-09-22T08:12:08.828530+0000","last_fullsized":"2024-09-22T08:12:08.828530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:51.203215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211107+0000","last_change":"2024-09-22T08:10:43.200355+0000","last_active":"2024-09-22T08:11:23.211107+0000","last_peered":"2024-09-22T08:11:23.211107+0000","last_clean":"2024-09-22T08:11:23.211107+0000","last_became_active":"2024-09-22T08:10:43.199724+0000","last_became_peered":"2024-09-22T08:10:43.199724+0000","last_unstale":"2024-09-22T08:11:23.211107+0000","last_undegraded":"2024-09-22T08:11:23.211107+0000","last_fullsized":"2024-09-22T08:11:23.211107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:25.660243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214717+0000","last_change":"2024-09-22T08:10:47.175833+0000","last_active":"2024-09-22T08:11:23.214717+0000","last_peered":"2024-09-22T08:11:23.214717+0000","last_clean":"2024-09-22T08:11:23.214717+0000","last_became_active":"2024-09-22T08:10:47.175541+0000","last_became_peered":"2024-09-22T08:10:47.175541+0000","last_unstale":"2024-09-22T08:11:23.214717+0000","last_undegraded":"2024-09-22T08:11:23.214717+0000","last_fullsized":"2024-09-22T08:11:23.214717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:17.796324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584978+0000","last_change":"2024-09-22T08:10:49.188295+0000","last_active":"2024-09-22T08:12:52.584978+0000","last_peered":"2024-09-22T08:12:52.584978+0000","last_clean":"2024-09-22T08:12:52.584978+0000","last_became_active":"2024-09-22T08:10:49.187767+0000","last_became_peered":"2024-09-22T08:10:49.187767+0000","last_unstale":"2024-09-22T08:12:52.584978+0000","last_undegraded":"2024-09-22T08:12:52.584978+0000","last_fullsized":"2024-09-22T08:12:52.584978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:02.055272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":367,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254414+0000","last_change":"2024-09-22T08:10:51.198099+0000","last_active":"2024-09-22T08:13:52.254414+0000","last_peered":"2024-09-22T08:13:52.254414+0000","last_clean":"2024-09-22T08:13:52.254414+0000","last_became_active":"2024-09-22T08:10:51.197814+0000","last_became_peered":"2024-09-22T08:10:51.197814+0000","last_unstale":"2024-09-22T08:13:52.254414+0000","last_undegraded":"2024-09-22T08:13:52.254414+0000","last_fullsized":"2024-09-22T08:13:52.254414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.509973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209032+0000","last_change":"2024-09-22T08:10:53.200170+0000","last_active":"2024-09-22T08:11:23.209032+0000","last_peered":"2024-09-22T08:11:23.209032+0000","last_clean":"2024-09-22T08:11:23.209032+0000","last_became_active":"2024-09-22T08:10:53.199881+0000","last_became_peered":"2024-09-22T08:10:53.199881+0000","last_unstale":"2024-09-22T08:11:23.209032+0000","last_undegraded":"2024-09-22T08:11:23.209032+0000","last_fullsized":"2024-09-22T08:11:23.209032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:46.946049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208021+0000","last_change":"2024-09-22T08:10:45.166388+0000","last_active":"2024-09-22T08:11:23.208021+0000","last_peered":"2024-09-22T08:11:23.208021+0000","last_clean":"2024-09-22T08:11:23.208021+0000","last_became_active":"2024-09-22T08:10:45.166103+0000","last_became_peered":"2024-09-22T08:10:45.166103+0000","last_unstale":"2024-09-22T08:11:23.208021+0000","last_undegraded":"2024-09-22T08:11:23.208021+0000","last_fullsized":"2024-09-22T08:11:23.208021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:07.647439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.587783+0000","last_change":"2024-09-22T08:10:43.180475+0000","last_active":"2024-09-22T08:13:12.587783+0000","last_peered":"2024-09-22T08:13:12.587783+0000","last_clean":"2024-09-22T08:13:12.587783+0000","last_became_active":"2024-09-22T08:10:43.180097+0000","last_became_peered":"2024-09-22T08:10:43.180097+0000","last_unstale":"2024-09-22T08:13:12.587783+0000","last_undegraded":"2024-09-22T08:13:12.587783+0000","last_fullsized":"2024-09-22T08:13:12.587783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:37.378948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212558+0000","last_change":"2024-09-22T08:10:47.175982+0000","last_active":"2024-09-22T08:11:23.212558+0000","last_peered":"2024-09-22T08:11:23.212558+0000","last_clean":"2024-09-22T08:11:23.212558+0000","last_became_active":"2024-09-22T08:10:47.175604+0000","last_became_peered":"2024-09-22T08:10:47.175604+0000","last_unstale":"2024-09-22T08:11:23.212558+0000","last_undegraded":"2024-09-22T08:11:23.212558+0000","last_fullsized":"2024-09-22T08:11:23.212558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:15.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.123249+0000","last_change":"2024-09-22T08:10:49.176102+0000","last_active":"2024-09-22T08:12:51.123249+0000","last_peered":"2024-09-22T08:12:51.123249+0000","last_clean":"2024-09-22T08:12:51.123249+0000","last_became_active":"2024-09-22T08:10:49.175817+0000","last_became_peered":"2024-09-22T08:10:49.175817+0000","last_unstale":"2024-09-22T08:12:51.123249+0000","last_undegraded":"2024-09-22T08:12:51.123249+0000","last_fullsized":"2024-09-22T08:12:51.123249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:19.626204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.219931+0000","last_change":"2024-09-22T08:10:51.192395+0000","last_active":"2024-09-22T08:11:23.219931+0000","last_peered":"2024-09-22T08:11:23.219931+0000","last_clean":"2024-09-22T08:11:23.219931+0000","last_became_active":"2024-09-22T08:10:51.191988+0000","last_became_peered":"2024-09-22T08:10:51.191988+0000","last_unstale":"2024-09-22T08:11:23.219931+0000","last_undegraded":"2024-09-22T08:11:23.219931+0000","last_fullsized":"2024-09-22T08:11:23.219931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216778+0000","last_change":"2024-09-22T08:10:53.199421+0000","last_active":"2024-09-22T08:11:23.216778+0000","last_peered":"2024-09-22T08:11:23.216778+0000","last_clean":"2024-09-22T08:11:23.216778+0000","last_became_active":"2024-09-22T08:10:53.199158+0000","last_became_peered":"2024-09-22T08:10:53.199158+0000","last_unstale":"2024-09-22T08:11:23.216778+0000","last_undegraded":"2024-09-22T08:11:23.216778+0000","last_fullsized":"2024-09-22T08:11:23.216778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:32.896582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.005197+0000","last_change":"2024-09-22T08:10:45.165605+0000","last_active":"2024-09-22T08:11:26.005197+0000","last_peered":"2024-09-22T08:11:26.005197+0000","last_clean":"2024-09-22T08:11:26.005197+0000","last_became_active":"2024-09-22T08:10:45.165116+0000","last_became_peered":"2024-09-22T08:10:45.165116+0000","last_unstale":"2024-09-22T08:11:26.005197+0000","last_undegraded":"2024-09-22T08:11:26.005197+0000","last_fullsized":"2024-09-22T08:11:26.005197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:29.645770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211112+0000","last_change":"2024-09-22T08:10:43.202146+0000","last_active":"2024-09-22T08:11:23.211112+0000","last_peered":"2024-09-22T08:11:23.211112+0000","last_clean":"2024-09-22T08:11:23.211112+0000","last_became_active":"2024-09-22T08:10:43.201076+0000","last_became_peered":"2024-09-22T08:10:43.201076+0000","last_unstale":"2024-09-22T08:11:23.211112+0000","last_undegraded":"2024-09-22T08:11:23.211112+0000","last_fullsized":"2024-09-22T08:11:23.211112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:43.112413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208142+0000","last_change":"2024-09-22T08:10:47.173239+0000","last_active":"2024-09-22T08:11:23.208142+0000","last_peered":"2024-09-22T08:11:23.208142+0000","last_clean":"2024-09-22T08:11:23.208142+0000","last_became_active":"2024-09-22T08:10:47.172988+0000","last_became_peered":"2024-09-22T08:10:47.172988+0000","last_unstale":"2024-09-22T08:11:23.208142+0000","last_undegraded":"2024-09-22T08:11:23.208142+0000","last_fullsized":"2024-09-22T08:11:23.208142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:57.256991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.124336+0000","last_change":"2024-09-22T08:10:49.185163+0000","last_active":"2024-09-22T08:12:51.124336+0000","last_peered":"2024-09-22T08:12:51.124336+0000","last_clean":"2024-09-22T08:12:51.124336+0000","last_became_active":"2024-09-22T08:10:49.184860+0000","last_became_peered":"2024-09-22T08:10:49.184860+0000","last_unstale":"2024-09-22T08:12:51.124336+0000","last_undegraded":"2024-09-22T08:12:51.124336+0000","last_fullsized":"2024-09-22T08:12:51.124336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.255387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209254+0000","last_change":"2024-09-22T08:10:51.200556+0000","last_active":"2024-09-22T08:11:23.209254+0000","last_peered":"2024-09-22T08:11:23.209254+0000","last_clean":"2024-09-22T08:11:23.209254+0000","last_became_active":"2024-09-22T08:10:51.199870+0000","last_became_peered":"2024-09-22T08:10:51.199870+0000","last_unstale":"2024-09-22T08:11:23.209254+0000","last_undegraded":"2024-09-22T08:11:23.209254+0000","last_fullsized":"2024-09-22T08:11:23.209254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.684662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212091+0000","last_change":"2024-09-22T08:10:53.201219+0000","last_active":"2024-09-22T08:11:23.212091+0000","last_peered":"2024-09-22T08:11:23.212091+0000","last_clean":"2024-09-22T08:11:23.212091+0000","last_became_active":"2024-09-22T08:10:53.200904+0000","last_became_peered":"2024-09-22T08:10:53.200904+0000","last_unstale":"2024-09-22T08:11:23.212091+0000","last_undegraded":"2024-09-22T08:11:23.212091+0000","last_fullsized":"2024-09-22T08:11:23.212091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:58.296182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'9","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.588330+0000","last_change":"2024-09-22T08:10:45.165741+0000","last_active":"2024-09-22T08:13:12.588330+0000","last_peered":"2024-09-22T08:13:12.588330+0000","last_clean":"2024-09-22T08:13:12.588330+0000","last_became_active":"2024-09-22T08:10:45.165511+0000","last_became_peered":"2024-09-22T08:10:45.165511+0000","last_unstale":"2024-09-22T08:13:12.588330+0000","last_undegraded":"2024-09-22T08:13:12.588330+0000","last_fullsized":"2024-09-22T08:13:12.588330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:15.789333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223338+0000","last_change":"2024-09-22T08:10:43.177415+0000","last_active":"2024-09-22T08:11:23.223338+0000","last_peered":"2024-09-22T08:11:23.223338+0000","last_clean":"2024-09-22T08:11:23.223338+0000","last_became_active":"2024-09-22T08:10:43.176954+0000","last_became_peered":"2024-09-22T08:10:43.176954+0000","last_unstale":"2024-09-22T08:11:23.223338+0000","last_undegraded":"2024-09-22T08:11:23.223338+0000","last_fullsized":"2024-09-22T08:11:23.223338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:24.996283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210491+0000","last_change":"2024-09-22T08:10:47.176984+0000","last_active":"2024-09-22T08:11:23.210491+0000","last_peered":"2024-09-22T08:11:23.210491+0000","last_clean":"2024-09-22T08:11:23.210491+0000","last_became_active":"2024-09-22T08:10:47.176641+0000","last_became_peered":"2024-09-22T08:10:47.176641+0000","last_unstale":"2024-09-22T08:11:23.210491+0000","last_undegraded":"2024-09-22T08:11:23.210491+0000","last_fullsized":"2024-09-22T08:11:23.210491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:49.329521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.148968+0000","last_change":"2024-09-22T08:10:49.188256+0000","last_active":"2024-09-22T08:12:51.148968+0000","last_peered":"2024-09-22T08:12:51.148968+0000","last_clean":"2024-09-22T08:12:51.148968+0000","last_became_active":"2024-09-22T08:10:49.187467+0000","last_became_peered":"2024-09-22T08:10:49.187467+0000","last_unstale":"2024-09-22T08:12:51.148968+0000","last_undegraded":"2024-09-22T08:12:51.148968+0000","last_fullsized":"2024-09-22T08:12:51.148968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:27.242973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209400+0000","last_change":"2024-09-22T08:10:51.198209+0000","last_active":"2024-09-22T08:11:23.209400+0000","last_peered":"2024-09-22T08:11:23.209400+0000","last_clean":"2024-09-22T08:11:23.209400+0000","last_became_active":"2024-09-22T08:10:51.197942+0000","last_became_peered":"2024-09-22T08:10:51.197942+0000","last_unstale":"2024-09-22T08:11:23.209400+0000","last_undegraded":"2024-09-22T08:11:23.209400+0000","last_fullsized":"2024-09-22T08:11:23.209400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:42.833261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.573626+0000","last_change":"2024-09-22T08:10:53.204064+0000","last_active":"2024-09-22T08:12:52.573626+0000","last_peered":"2024-09-22T08:12:52.573626+0000","last_clean":"2024-09-22T08:12:52.573626+0000","last_became_active":"2024-09-22T08:10:53.203791+0000","last_became_peered":"2024-09-22T08:10:53.203791+0000","last_unstale":"2024-09-22T08:12:52.573626+0000","last_undegraded":"2024-09-22T08:12:52.573626+0000","last_fullsized":"2024-09-22T08:12:52.573626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:42.795444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042279+0000","last_change":"2024-09-22T08:10:45.164568+0000","last_active":"2024-09-22T08:13:53.042279+0000","last_peered":"2024-09-22T08:13:53.042279+0000","last_clean":"2024-09-22T08:13:53.042279+0000","last_became_active":"2024-09-22T08:10:45.163402+0000","last_became_peered":"2024-09-22T08:10:45.163402+0000","last_unstale":"2024-09-22T08:13:53.042279+0000","last_undegraded":"2024-09-22T08:13:53.042279+0000","last_fullsized":"2024-09-22T08:13:53.042279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:31.128783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216675+0000","last_change":"2024-09-22T08:10:43.185767+0000","last_active":"2024-09-22T08:11:23.216675+0000","last_peered":"2024-09-22T08:11:23.216675+0000","last_clean":"2024-09-22T08:11:23.216675+0000","last_became_active":"2024-09-22T08:10:43.184777+0000","last_became_peered":"2024-09-22T08:10:43.184777+0000","last_unstale":"2024-09-22T08:11:23.216675+0000","last_undegraded":"2024-09-22T08:11:23.216675+0000","last_fullsized":"2024-09-22T08:11:23.216675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:44.875297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.796204+0000","last_change":"2024-09-22T08:10:47.176659+0000","last_active":"2024-09-22T08:12:49.796204+0000","last_peered":"2024-09-22T08:12:49.796204+0000","last_clean":"2024-09-22T08:12:49.796204+0000","last_became_active":"2024-09-22T08:10:47.176390+0000","last_became_peered":"2024-09-22T08:10:47.176390+0000","last_unstale":"2024-09-22T08:12:49.796204+0000","last_undegraded":"2024-09-22T08:12:49.796204+0000","last_fullsized":"2024-09-22T08:12:49.796204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:24.829227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'34","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.591839+0000","last_change":"2024-09-22T08:10:49.189639+0000","last_active":"2024-09-22T08:13:52.591839+0000","last_peered":"2024-09-22T08:13:52.591839+0000","last_clean":"2024-09-22T08:13:52.591839+0000","last_became_active":"2024-09-22T08:10:49.188231+0000","last_became_peered":"2024-09-22T08:10:49.188231+0000","last_unstale":"2024-09-22T08:13:52.591839+0000","last_undegraded":"2024-09-22T08:13:52.591839+0000","last_fullsized":"2024-09-22T08:13:52.591839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:08.360453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":51,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221258+0000","last_change":"2024-09-22T08:10:51.202802+0000","last_active":"2024-09-22T08:11:23.221258+0000","last_peered":"2024-09-22T08:11:23.221258+0000","last_clean":"2024-09-22T08:11:23.221258+0000","last_became_active":"2024-09-22T08:10:51.202476+0000","last_became_peered":"2024-09-22T08:10:51.202476+0000","last_unstale":"2024-09-22T08:11:23.221258+0000","last_undegraded":"2024-09-22T08:11:23.221258+0000","last_fullsized":"2024-09-22T08:11:23.221258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.161803+0000","last_change":"2024-09-22T08:10:53.201417+0000","last_active":"2024-09-22T08:12:51.161803+0000","last_peered":"2024-09-22T08:12:51.161803+0000","last_clean":"2024-09-22T08:12:51.161803+0000","last_became_active":"2024-09-22T08:10:53.201125+0000","last_became_peered":"2024-09-22T08:10:53.201125+0000","last_unstale":"2024-09-22T08:12:51.161803+0000","last_undegraded":"2024-09-22T08:12:51.161803+0000","last_fullsized":"2024-09-22T08:12:51.161803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:16.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254853+0000","last_change":"2024-09-22T08:10:45.181046+0000","last_active":"2024-09-22T08:13:53.254853+0000","last_peered":"2024-09-22T08:13:53.254853+0000","last_clean":"2024-09-22T08:13:53.254853+0000","last_became_active":"2024-09-22T08:10:45.180781+0000","last_became_peered":"2024-09-22T08:10:45.180781+0000","last_unstale":"2024-09-22T08:13:53.254853+0000","last_undegraded":"2024-09-22T08:13:53.254853+0000","last_fullsized":"2024-09-22T08:13:53.254853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:50.052801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.529697+0000","last_change":"2024-09-22T08:10:43.183556+0000","last_active":"2024-09-22T08:12:52.529697+0000","last_peered":"2024-09-22T08:12:52.529697+0000","last_clean":"2024-09-22T08:12:52.529697+0000","last_became_active":"2024-09-22T08:10:43.179693+0000","last_became_peered":"2024-09-22T08:10:43.179693+0000","last_unstale":"2024-09-22T08:12:52.529697+0000","last_undegraded":"2024-09-22T08:12:52.529697+0000","last_fullsized":"2024-09-22T08:12:52.529697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:56.127185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.950213+0000","last_change":"2024-09-22T08:10:45.164763+0000","last_active":"2024-09-22T08:13:52.950213+0000","last_peered":"2024-09-22T08:13:52.950213+0000","last_clean":"2024-09-22T08:13:52.950213+0000","last_became_active":"2024-09-22T08:10:45.164406+0000","last_became_peered":"2024-09-22T08:10:45.164406+0000","last_unstale":"2024-09-22T08:13:52.950213+0000","last_undegraded":"2024-09-22T08:13:52.950213+0000","last_fullsized":"2024-09-22T08:13:52.950213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:37.404156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.557173+0000","last_change":"2024-09-22T08:10:43.178608+0000","last_active":"2024-09-22T08:11:26.557173+0000","last_peered":"2024-09-22T08:11:26.557173+0000","last_clean":"2024-09-22T08:11:26.557173+0000","last_became_active":"2024-09-22T08:10:43.178018+0000","last_became_peered":"2024-09-22T08:10:43.178018+0000","last_unstale":"2024-09-22T08:11:26.557173+0000","last_undegraded":"2024-09-22T08:11:26.557173+0000","last_fullsized":"2024-09-22T08:11:26.557173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:25.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227865+0000","last_change":"2024-09-22T08:10:45.170408+0000","last_active":"2024-09-22T08:13:53.227865+0000","last_peered":"2024-09-22T08:13:53.227865+0000","last_clean":"2024-09-22T08:13:53.227865+0000","last_became_active":"2024-09-22T08:10:45.168526+0000","last_became_peered":"2024-09-22T08:10:45.168526+0000","last_unstale":"2024-09-22T08:13:53.227865+0000","last_undegraded":"2024-09-22T08:13:53.227865+0000","last_fullsized":"2024-09-22T08:13:53.227865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:17.590758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":86,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209592+0000","last_change":"2024-09-22T08:10:43.198536+0000","last_active":"2024-09-22T08:11:23.209592+0000","last_peered":"2024-09-22T08:11:23.209592+0000","last_clean":"2024-09-22T08:11:23.209592+0000","last_became_active":"2024-09-22T08:10:43.196221+0000","last_became_peered":"2024-09-22T08:10:43.196221+0000","last_unstale":"2024-09-22T08:11:23.209592+0000","last_undegraded":"2024-09-22T08:11:23.209592+0000","last_fullsized":"2024-09-22T08:11:23.209592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:05.712585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.166823+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.166432+0000","last_became_peered":"2024-09-22T08:10:45.166432+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:07.715456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.834623+0000","last_change":"2024-09-22T08:10:43.178126+0000","last_active":"2024-09-22T08:13:52.834623+0000","last_peered":"2024-09-22T08:13:52.834623+0000","last_clean":"2024-09-22T08:13:52.834623+0000","last_became_active":"2024-09-22T08:10:43.177673+0000","last_became_peered":"2024-09-22T08:10:43.177673+0000","last_unstale":"2024-09-22T08:13:52.834623+0000","last_undegraded":"2024-09-22T08:13:52.834623+0000","last_fullsized":"2024-09-22T08:13:52.834623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:44.875297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.575693+0000","last_change":"2024-09-22T08:10:45.171880+0000","last_active":"2024-09-22T08:12:52.575693+0000","last_peered":"2024-09-22T08:12:52.575693+0000","last_clean":"2024-09-22T08:12:52.575693+0000","last_became_active":"2024-09-22T08:10:45.171476+0000","last_became_peered":"2024-09-22T08:10:45.171476+0000","last_unstale":"2024-09-22T08:12:52.575693+0000","last_undegraded":"2024-09-22T08:12:52.575693+0000","last_fullsized":"2024-09-22T08:12:52.575693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:09.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221609+0000","last_change":"2024-09-22T08:10:43.187785+0000","last_active":"2024-09-22T08:11:23.221609+0000","last_peered":"2024-09-22T08:11:23.221609+0000","last_clean":"2024-09-22T08:11:23.221609+0000","last_became_active":"2024-09-22T08:10:43.186671+0000","last_became_peered":"2024-09-22T08:10:43.186671+0000","last_unstale":"2024-09-22T08:11:23.221609+0000","last_undegraded":"2024-09-22T08:11:23.221609+0000","last_fullsized":"2024-09-22T08:11:23.221609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:34.692797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.952726+0000","last_change":"2024-09-22T08:10:45.183046+0000","last_active":"2024-09-22T08:13:52.952726+0000","last_peered":"2024-09-22T08:13:52.952726+0000","last_clean":"2024-09-22T08:13:52.952726+0000","last_became_active":"2024-09-22T08:10:45.182785+0000","last_became_peered":"2024-09-22T08:10:45.182785+0000","last_unstale":"2024-09-22T08:13:52.952726+0000","last_undegraded":"2024-09-22T08:13:52.952726+0000","last_fullsized":"2024-09-22T08:13:52.952726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:51.776555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.484272+0000","last_change":"2024-09-22T08:10:43.183177+0000","last_active":"2024-09-22T08:12:52.484272+0000","last_peered":"2024-09-22T08:12:52.484272+0000","last_clean":"2024-09-22T08:12:52.484272+0000","last_became_active":"2024-09-22T08:10:43.182824+0000","last_became_peered":"2024-09-22T08:10:43.182824+0000","last_unstale":"2024-09-22T08:12:52.484272+0000","last_undegraded":"2024-09-22T08:12:52.484272+0000","last_fullsized":"2024-09-22T08:12:52.484272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:25.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'25","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.263612+0000","last_change":"2024-09-22T08:10:45.175920+0000","last_active":"2024-09-22T08:13:53.263612+0000","last_peered":"2024-09-22T08:13:53.263612+0000","last_clean":"2024-09-22T08:13:53.263612+0000","last_became_active":"2024-09-22T08:10:45.175600+0000","last_became_peered":"2024-09-22T08:10:45.175600+0000","last_unstale":"2024-09-22T08:13:53.263612+0000","last_undegraded":"2024-09-22T08:13:53.263612+0000","last_fullsized":"2024-09-22T08:13:53.263612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:53.580143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211182+0000","last_change":"2024-09-22T08:10:43.183024+0000","last_active":"2024-09-22T08:11:23.211182+0000","last_peered":"2024-09-22T08:11:23.211182+0000","last_clean":"2024-09-22T08:11:23.211182+0000","last_became_active":"2024-09-22T08:10:43.179529+0000","last_became_peered":"2024-09-22T08:10:43.179529+0000","last_unstale":"2024-09-22T08:11:23.211182+0000","last_undegraded":"2024-09-22T08:11:23.211182+0000","last_fullsized":"2024-09-22T08:11:23.211182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:25.240566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042521+0000","last_change":"2024-09-22T08:10:45.184241+0000","last_active":"2024-09-22T08:13:53.042521+0000","last_peered":"2024-09-22T08:13:53.042521+0000","last_clean":"2024-09-22T08:13:53.042521+0000","last_became_active":"2024-09-22T08:10:45.183901+0000","last_became_peered":"2024-09-22T08:10:45.183901+0000","last_unstale":"2024-09-22T08:13:53.042521+0000","last_undegraded":"2024-09-22T08:13:53.042521+0000","last_fullsized":"2024-09-22T08:13:53.042521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:28:48.567601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:56.584617+0000","last_change":"2024-09-22T08:10:43.178191+0000","last_active":"2024-09-22T08:12:56.584617+0000","last_peered":"2024-09-22T08:12:56.584617+0000","last_clean":"2024-09-22T08:12:56.584617+0000","last_became_active":"2024-09-22T08:10:43.177461+0000","last_became_peered":"2024-09-22T08:10:43.177461+0000","last_unstale":"2024-09-22T08:12:56.584617+0000","last_undegraded":"2024-09-22T08:12:56.584617+0000","last_fullsized":"2024-09-22T08:12:56.584617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:55.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.952431+0000","last_change":"2024-09-22T08:10:45.170004+0000","last_active":"2024-09-22T08:13:52.952431+0000","last_peered":"2024-09-22T08:13:52.952431+0000","last_clean":"2024-09-22T08:13:52.952431+0000","last_became_active":"2024-09-22T08:10:45.169723+0000","last_became_peered":"2024-09-22T08:10:45.169723+0000","last_unstale":"2024-09-22T08:13:52.952431+0000","last_undegraded":"2024-09-22T08:13:52.952431+0000","last_fullsized":"2024-09-22T08:13:52.952431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:45.662588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212281+0000","last_change":"2024-09-22T08:10:43.196560+0000","last_active":"2024-09-22T08:11:23.212281+0000","last_peered":"2024-09-22T08:11:23.212281+0000","last_clean":"2024-09-22T08:11:23.212281+0000","last_became_active":"2024-09-22T08:10:43.195587+0000","last_became_peered":"2024-09-22T08:10:43.195587+0000","last_unstale":"2024-09-22T08:11:23.212281+0000","last_undegraded":"2024-09-22T08:11:23.212281+0000","last_fullsized":"2024-09-22T08:11:23.212281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:23.625176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183433+0000","last_change":"2024-09-22T08:10:45.170370+0000","last_active":"2024-09-22T08:13:53.183433+0000","last_peered":"2024-09-22T08:13:53.183433+0000","last_clean":"2024-09-22T08:13:53.183433+0000","last_became_active":"2024-09-22T08:10:45.169366+0000","last_became_peered":"2024-09-22T08:10:45.169366+0000","last_unstale":"2024-09-22T08:13:53.183433+0000","last_undegraded":"2024-09-22T08:13:53.183433+0000","last_fullsized":"2024-09-22T08:13:53.183433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.634336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.915352+0000","last_change":"2024-09-22T08:10:43.187942+0000","last_active":"2024-09-22T08:13:52.915352+0000","last_peered":"2024-09-22T08:13:52.915352+0000","last_clean":"2024-09-22T08:13:52.915352+0000","last_became_active":"2024-09-22T08:10:43.187246+0000","last_became_peered":"2024-09-22T08:10:43.187246+0000","last_unstale":"2024-09-22T08:13:52.915352+0000","last_undegraded":"2024-09-22T08:13:52.915352+0000","last_fullsized":"2024-09-22T08:13:52.915352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:56.538345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.044952+0000","last_change":"2024-09-22T08:10:45.172556+0000","last_active":"2024-09-22T08:13:53.044952+0000","last_peered":"2024-09-22T08:13:53.044952+0000","last_clean":"2024-09-22T08:13:53.044952+0000","last_became_active":"2024-09-22T08:10:45.172080+0000","last_became_peered":"2024-09-22T08:10:45.172080+0000","last_unstale":"2024-09-22T08:13:53.044952+0000","last_undegraded":"2024-09-22T08:13:53.044952+0000","last_fullsized":"2024-09-22T08:13:53.044952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:33.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213039+0000","last_change":"2024-09-22T08:10:43.179415+0000","last_active":"2024-09-22T08:11:23.213039+0000","last_peered":"2024-09-22T08:11:23.213039+0000","last_clean":"2024-09-22T08:11:23.213039+0000","last_became_active":"2024-09-22T08:10:43.178924+0000","last_became_peered":"2024-09-22T08:10:43.178924+0000","last_unstale":"2024-09-22T08:11:23.213039+0000","last_undegraded":"2024-09-22T08:11:23.213039+0000","last_fullsized":"2024-09-22T08:11:23.213039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:05.127567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'15","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.190568+0000","last_change":"2024-09-22T08:10:45.172376+0000","last_active":"2024-09-22T08:13:53.190568+0000","last_peered":"2024-09-22T08:13:53.190568+0000","last_clean":"2024-09-22T08:13:53.190568+0000","last_became_active":"2024-09-22T08:10:45.172101+0000","last_became_peered":"2024-09-22T08:10:45.172101+0000","last_unstale":"2024-09-22T08:13:53.190568+0000","last_undegraded":"2024-09-22T08:13:53.190568+0000","last_fullsized":"2024-09-22T08:13:53.190568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:42.945533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213721+0000","last_change":"2024-09-22T08:10:43.179255+0000","last_active":"2024-09-22T08:11:23.213721+0000","last_peered":"2024-09-22T08:11:23.213721+0000","last_clean":"2024-09-22T08:11:23.213721+0000","last_became_active":"2024-09-22T08:10:43.178876+0000","last_became_peered":"2024-09-22T08:10:43.178876+0000","last_unstale":"2024-09-22T08:11:23.213721+0000","last_undegraded":"2024-09-22T08:11:23.213721+0000","last_fullsized":"2024-09-22T08:11:23.213721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:40:11.526265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.829072+0000","last_change":"2024-09-22T08:10:45.180356+0000","last_active":"2024-09-22T08:12:08.829072+0000","last_peered":"2024-09-22T08:12:08.829072+0000","last_clean":"2024-09-22T08:12:08.829072+0000","last_became_active":"2024-09-22T08:10:45.180117+0000","last_became_peered":"2024-09-22T08:10:45.180117+0000","last_unstale":"2024-09-22T08:12:08.829072+0000","last_undegraded":"2024-09-22T08:12:08.829072+0000","last_fullsized":"2024-09-22T08:12:08.829072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:07.097290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211963+0000","last_change":"2024-09-22T08:10:43.196149+0000","last_active":"2024-09-22T08:11:23.211963+0000","last_peered":"2024-09-22T08:11:23.211963+0000","last_clean":"2024-09-22T08:11:23.211963+0000","last_became_active":"2024-09-22T08:10:43.195770+0000","last_became_peered":"2024-09-22T08:10:43.195770+0000","last_unstale":"2024-09-22T08:11:23.211963+0000","last_undegraded":"2024-09-22T08:11:23.211963+0000","last_fullsized":"2024-09-22T08:11:23.211963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:35.401285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183848+0000","last_change":"2024-09-22T08:10:45.180354+0000","last_active":"2024-09-22T08:13:53.183848+0000","last_peered":"2024-09-22T08:13:53.183848+0000","last_clean":"2024-09-22T08:13:53.183848+0000","last_became_active":"2024-09-22T08:10:45.180098+0000","last_became_peered":"2024-09-22T08:10:45.180098+0000","last_unstale":"2024-09-22T08:13:53.183848+0000","last_undegraded":"2024-09-22T08:13:53.183848+0000","last_fullsized":"2024-09-22T08:13:53.183848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:45.833791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213202+0000","last_change":"2024-09-22T08:10:43.202451+0000","last_active":"2024-09-22T08:11:23.213202+0000","last_peered":"2024-09-22T08:11:23.213202+0000","last_clean":"2024-09-22T08:11:23.213202+0000","last_became_active":"2024-09-22T08:10:43.201687+0000","last_became_peered":"2024-09-22T08:10:43.201687+0000","last_unstale":"2024-09-22T08:11:23.213202+0000","last_undegraded":"2024-09-22T08:11:23.213202+0000","last_fullsized":"2024-09-22T08:11:23.213202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:03.394369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037719+0000","last_change":"2024-09-22T08:11:23.222217+0000","last_active":"2024-09-22T08:11:27.037719+0000","last_peered":"2024-09-22T08:11:27.037719+0000","last_clean":"2024-09-22T08:11:27.037719+0000","last_became_active":"2024-09-22T08:11:23.215110+0000","last_became_peered":"2024-09-22T08:11:23.215110+0000","last_unstale":"2024-09-22T08:11:27.037719+0000","last_undegraded":"2024-09-22T08:11:27.037719+0000","last_fullsized":"2024-09-22T08:11:27.037719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:56.580950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.560515+0000","last_change":"2024-09-22T08:10:43.190134+0000","last_active":"2024-09-22T08:11:25.560515+0000","last_peered":"2024-09-22T08:11:25.560515+0000","last_clean":"2024-09-22T08:11:25.560515+0000","last_became_active":"2024-09-22T08:10:43.187195+0000","last_became_peered":"2024-09-22T08:10:43.187195+0000","last_unstale":"2024-09-22T08:11:25.560515+0000","last_undegraded":"2024-09-22T08:11:25.560515+0000","last_fullsized":"2024-09-22T08:11:25.560515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:28.903101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183984+0000","last_change":"2024-09-22T08:10:45.179422+0000","last_active":"2024-09-22T08:13:53.183984+0000","last_peered":"2024-09-22T08:13:53.183984+0000","last_clean":"2024-09-22T08:13:53.183984+0000","last_became_active":"2024-09-22T08:10:45.179150+0000","last_became_peered":"2024-09-22T08:10:45.179150+0000","last_unstale":"2024-09-22T08:13:53.183984+0000","last_undegraded":"2024-09-22T08:13:53.183984+0000","last_fullsized":"2024-09-22T08:13:53.183984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:32.350768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213258+0000","last_change":"2024-09-22T08:10:43.200646+0000","last_active":"2024-09-22T08:11:23.213258+0000","last_peered":"2024-09-22T08:11:23.213258+0000","last_clean":"2024-09-22T08:11:23.213258+0000","last_became_active":"2024-09-22T08:10:43.200282+0000","last_became_peered":"2024-09-22T08:10:43.200282+0000","last_unstale":"2024-09-22T08:11:23.213258+0000","last_undegraded":"2024-09-22T08:11:23.213258+0000","last_fullsized":"2024-09-22T08:11:23.213258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:40.745524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.560615+0000","last_change":"2024-09-22T08:10:43.190222+0000","last_active":"2024-09-22T08:11:26.560615+0000","last_peered":"2024-09-22T08:11:26.560615+0000","last_clean":"2024-09-22T08:11:26.560615+0000","last_became_active":"2024-09-22T08:10:43.189848+0000","last_became_peered":"2024-09-22T08:10:43.189848+0000","last_unstale":"2024-09-22T08:11:26.560615+0000","last_undegraded":"2024-09-22T08:11:26.560615+0000","last_fullsized":"2024-09-22T08:11:26.560615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:06.237724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.234367+0000","last_change":"2024-09-22T08:10:45.183685+0000","last_active":"2024-09-22T08:13:53.234367+0000","last_peered":"2024-09-22T08:13:53.234367+0000","last_clean":"2024-09-22T08:13:53.234367+0000","last_became_active":"2024-09-22T08:10:45.183407+0000","last_became_peered":"2024-09-22T08:10:45.183407+0000","last_unstale":"2024-09-22T08:13:53.234367+0000","last_undegraded":"2024-09-22T08:13:53.234367+0000","last_fullsized":"2024-09-22T08:13:53.234367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:45.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.178063+0000","last_change":"2024-09-22T08:10:43.187945+0000","last_active":"2024-09-22T08:13:53.178063+0000","last_peered":"2024-09-22T08:13:53.178063+0000","last_clean":"2024-09-22T08:13:53.178063+0000","last_became_active":"2024-09-22T08:10:43.187119+0000","last_became_peered":"2024-09-22T08:10:43.187119+0000","last_unstale":"2024-09-22T08:13:53.178063+0000","last_undegraded":"2024-09-22T08:13:53.178063+0000","last_fullsized":"2024-09-22T08:13:53.178063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:05.083470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'7","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.587845+0000","last_change":"2024-09-22T08:11:23.218926+0000","last_active":"2024-09-22T08:13:12.587845+0000","last_peered":"2024-09-22T08:13:12.587845+0000","last_clean":"2024-09-22T08:13:12.587845+0000","last_became_active":"2024-09-22T08:11:23.218693+0000","last_became_peered":"2024-09-22T08:11:23.218693+0000","last_unstale":"2024-09-22T08:13:12.587845+0000","last_undegraded":"2024-09-22T08:13:12.587845+0000","last_fullsized":"2024-09-22T08:13:12.587845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:23.796030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44224,"kb_used_data":8880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327616,"statfs":{"total":96636764160,"available":96591478784,"internally_reserved":0,"allocated":9093120,"data_stored":8760075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673006,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48900,"kb_used_data":9396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322940,"statfs":{"total":96636764160,"available":96586690560,"internally_reserved":0,"allocated":9621504,"data_stored":9347107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44760,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327080,"statfs":{"total":96636764160,"available":96590929920,"internally_reserved":0,"allocated":9641984,"data_stored":9347795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":9056256,"data_stored":8759415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:14:00.670 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T08:14:00.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:14:00.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.801+0000 7f4e4567c640 1 Processor -- start 2024-09-22T08:14:00.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.801+0000 7f4e4567c640 1 -- start start 2024-09-22T08:14:00.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.801+0000 7f4e4567c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e4006e8e0 0x7f4e4006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:00.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.801+0000 7f4e4567c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e4006ff50 con 0x7f4e4006f200 2024-09-22T08:14:00.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.801+0000 7f4e4567c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4e40099c10 con 0x7f4e4006e8e0 2024-09-22T08:14:00.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.801+0000 7f4e3effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e4006e8e0 0x7f4e4006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:00.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.801+0000 7f4e3e7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4e4006f200 0x7f4e4012f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56212/0 (socket says 172.21.15.53:56212) 2024-09-22T08:14:00.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.801+0000 7f4e3e7fc640 1 -- 172.21.15.53:0/4187075464 learned_addr learned my addr 172.21.15.53:0/4187075464 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:00.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.801+0000 7f4e3effd640 1 -- 172.21.15.53:0/4187075464 >> v1:172.21.15.53:6789/0 conn(0x7f4e4006f200 legacy=0x7f4e4012f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:00.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.802+0000 7f4e3effd640 1 -- 172.21.15.53:0/4187075464 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e40099710 con 0x7f4e4006e8e0 2024-09-22T08:14:00.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.802+0000 7f4e3dffb640 1 -- 172.21.15.53:0/4187075464 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587490556 0 0) 0x7f4e4006ff50 con 0x7f4e4006f200 2024-09-22T08:14:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.802+0000 7f4e3effd640 1 --2- 172.21.15.53:0/4187075464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 0x7f4e4006ecc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009720 tx=0x7f4e3002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d94ed9302c9b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.802+0000 7f4e3dffb640 1 -- 172.21.15.53:0/4187075464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e30037070 con 0x7f4e4006e8e0 2024-09-22T08:14:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.802+0000 7f4e3dffb640 1 -- 172.21.15.53:0/4187075464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3002ae20 con 0x7f4e4006e8e0 2024-09-22T08:14:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.802+0000 7f4e3dffb640 1 -- 172.21.15.53:0/4187075464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e30032590 con 0x7f4e4006e8e0 2024-09-22T08:14:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.803+0000 7f4e4567c640 1 -- 172.21.15.53:0/4187075464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 msgr2=0x7f4e4006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.803+0000 7f4e4567c640 1 --2- 172.21.15.53:0/4187075464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 0x7f4e4006ecc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009720 tx=0x7f4e3002a1a0 comp rx=0 tx=0).stop 2024-09-22T08:14:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.803+0000 7f4e4567c640 1 -- 172.21.15.53:0/4187075464 shutdown_connections 2024-09-22T08:14:00.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.803+0000 7f4e4567c640 1 --2- 172.21.15.53:0/4187075464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 0x7f4e4006ecc0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.803+0000 7f4e4567c640 1 -- 172.21.15.53:0/4187075464 >> 172.21.15.53:0/4187075464 conn(0x7f4e400a01c0 msgr2=0x7f4e400a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.803+0000 7f4e4567c640 1 -- 172.21.15.53:0/4187075464 shutdown_connections 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.803+0000 7f4e4567c640 1 -- 172.21.15.53:0/4187075464 wait complete. 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.804+0000 7f4e4567c640 1 Processor -- start 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.804+0000 7f4e4567c640 1 -- start start 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.804+0000 7f4e4567c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 0x7f4e401c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.804+0000 7f4e4567c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4e401300f0 con 0x7f4e4006e8e0 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.804+0000 7f4e3effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 0x7f4e401c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.804+0000 7f4e3effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 0x7f4e401c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48070/0 (socket says 172.21.15.53:48070) 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.804+0000 7f4e3effd640 1 -- 172.21.15.53:0/3643331461 learned_addr learned my addr 172.21.15.53:0/3643331461 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:00.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.805+0000 7f4e3effd640 1 -- 172.21.15.53:0/3643331461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4008eb60 con 0x7f4e4006e8e0 2024-09-22T08:14:00.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.805+0000 7f4e3effd640 1 --2- 172.21.15.53:0/3643331461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 0x7f4e401c4780 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f4e30035040 tx=0x7f4e300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:00.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.805+0000 7f4e377fe640 1 -- 172.21.15.53:0/3643331461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e30037040 con 0x7f4e4006e8e0 2024-09-22T08:14:00.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.805+0000 7f4e377fe640 1 -- 172.21.15.53:0/3643331461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e30004160 con 0x7f4e4006e8e0 2024-09-22T08:14:00.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.805+0000 7f4e4567c640 1 -- 172.21.15.53:0/3643331461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e401c4cc0 con 0x7f4e4006e8e0 2024-09-22T08:14:00.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.805+0000 7f4e377fe640 1 -- 172.21.15.53:0/3643331461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e30004440 con 0x7f4e4006e8e0 2024-09-22T08:14:00.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.805+0000 7f4e4567c640 1 -- 172.21.15.53:0/3643331461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e401c5180 con 0x7f4e4006e8e0 2024-09-22T08:14:00.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.806+0000 7f4e377fe640 1 -- 172.21.15.53:0/3643331461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4e3003a040 con 0x7f4e4006e8e0 2024-09-22T08:14:00.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.806+0000 7f4e377fe640 1 --2- 172.21.15.53:0/3643331461 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e2003e6c0 0x7f4e20040b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:00.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.806+0000 7f4e4567c640 1 -- 172.21.15.53:0/3643331461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e4009c980 con 0x7f4e4006e8e0 2024-09-22T08:14:00.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.806+0000 7f4e377fe640 1 -- 172.21.15.53:0/3643331461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4e30073fb0 con 0x7f4e4006e8e0 2024-09-22T08:14:00.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.806+0000 7f4e3e7fc640 1 --2- 172.21.15.53:0/3643331461 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e2003e6c0 0x7f4e20040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:00.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.807+0000 7f4e3e7fc640 1 --2- 172.21.15.53:0/3643331461 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e2003e6c0 0x7f4e20040b80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4e28000c00 tx=0x7f4e280078d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:00.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.811+0000 7f4e377fe640 1 -- 172.21.15.53:0/3643331461 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4e4009c980 con 0x7f4e4006e8e0 2024-09-22T08:14:00.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:00.997+0000 7f4e4567c640 1 -- 172.21.15.53:0/3643331461 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e40129f90 con 0x7f4e2003e6c0 2024-09-22T08:14:01.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.007+0000 7f4e377fe640 1 -- 172.21.15.53:0/3643331461 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666030 (secure 0 0 0) 0x7f4e40129f90 con 0x7f4e2003e6c0 2024-09-22T08:14:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:14:01.020 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:14:01.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.012+0000 7f4e4567c640 1 -- 172.21.15.53:0/3643331461 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e2003e6c0 msgr2=0x7f4e20040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:01.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.012+0000 7f4e4567c640 1 --2- 172.21.15.53:0/3643331461 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e2003e6c0 0x7f4e20040b80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4e28000c00 tx=0x7f4e280078d0 comp rx=0 tx=0).stop 2024-09-22T08:14:01.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.012+0000 7f4e4567c640 1 -- 172.21.15.53:0/3643331461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 msgr2=0x7f4e401c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:01.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.012+0000 7f4e4567c640 1 --2- 172.21.15.53:0/3643331461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 0x7f4e401c4780 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f4e30035040 tx=0x7f4e300046c0 comp rx=0 tx=0).stop 2024-09-22T08:14:01.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.012+0000 7f4e4567c640 1 -- 172.21.15.53:0/3643331461 shutdown_connections 2024-09-22T08:14:01.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.012+0000 7f4e4567c640 1 --2- 172.21.15.53:0/3643331461 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f4e2003e6c0 0x7f4e20040b80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:01.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.012+0000 7f4e4567c640 1 --2- 172.21.15.53:0/3643331461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e4006e8e0 0x7f4e401c4780 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:01.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.012+0000 7f4e4567c640 1 -- 172.21.15.53:0/3643331461 >> 172.21.15.53:0/3643331461 conn(0x7f4e400a01c0 msgr2=0x7f4e4009aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:01.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.012+0000 7f4e4567c640 1 -- 172.21.15.53:0/3643331461 shutdown_connections 2024-09-22T08:14:01.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.012+0000 7f4e4567c640 1 -- 172.21.15.53:0/3643331461 wait complete. 2024-09-22T08:14:01.024 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-22T08:13:59.624505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416912,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4963,"num_read_kb":4501,"num_write":2048,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4434,"ondisk_log_size":4434,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177912,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309448,"statfs":{"total":386547056640,"available":386364874752,"internally_reserved":0,"allocated":37412864,"data_stored":36214392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004315"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208925+0000","last_change":"2024-09-22T08:10:43.175476+0000","last_active":"2024-09-22T08:11:23.208925+0000","last_peered":"2024-09-22T08:11:23.208925+0000","last_clean":"2024-09-22T08:11:23.208925+0000","last_became_active":"2024-09-22T08:10:43.174489+0000","last_became_peered":"2024-09-22T08:10:43.174489+0000","last_unstale":"2024-09-22T08:11:23.208925+0000","last_undegraded":"2024-09-22T08:11:23.208925+0000","last_fullsized":"2024-09-22T08:11:23.208925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:48.444642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037868+0000","last_change":"2024-09-22T08:10:45.180446+0000","last_active":"2024-09-22T08:11:27.037868+0000","last_peered":"2024-09-22T08:11:27.037868+0000","last_clean":"2024-09-22T08:11:27.037868+0000","last_became_active":"2024-09-22T08:10:45.179969+0000","last_became_peered":"2024-09-22T08:10:45.179969+0000","last_unstale":"2024-09-22T08:11:27.037868+0000","last_undegraded":"2024-09-22T08:11:27.037868+0000","last_fullsized":"2024-09-22T08:11:27.037868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:37.801061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223475+0000","last_change":"2024-09-22T08:10:43.187818+0000","last_active":"2024-09-22T08:11:23.223475+0000","last_peered":"2024-09-22T08:11:23.223475+0000","last_clean":"2024-09-22T08:11:23.223475+0000","last_became_active":"2024-09-22T08:10:43.187128+0000","last_became_peered":"2024-09-22T08:10:43.187128+0000","last_unstale":"2024-09-22T08:11:23.223475+0000","last_undegraded":"2024-09-22T08:11:23.223475+0000","last_fullsized":"2024-09-22T08:11:23.223475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:35.616676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210762+0000","last_change":"2024-09-22T08:10:45.170031+0000","last_active":"2024-09-22T08:11:23.210762+0000","last_peered":"2024-09-22T08:11:23.210762+0000","last_clean":"2024-09-22T08:11:23.210762+0000","last_became_active":"2024-09-22T08:10:45.169768+0000","last_became_peered":"2024-09-22T08:10:45.169768+0000","last_unstale":"2024-09-22T08:11:23.210762+0000","last_undegraded":"2024-09-22T08:11:23.210762+0000","last_fullsized":"2024-09-22T08:11:23.210762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:06.709611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.001193+0000","last_change":"2024-09-22T08:10:43.202010+0000","last_active":"2024-09-22T08:12:09.001193+0000","last_peered":"2024-09-22T08:12:09.001193+0000","last_clean":"2024-09-22T08:12:09.001193+0000","last_became_active":"2024-09-22T08:10:43.200436+0000","last_became_peered":"2024-09-22T08:10:43.200436+0000","last_unstale":"2024-09-22T08:12:09.001193+0000","last_undegraded":"2024-09-22T08:12:09.001193+0000","last_fullsized":"2024-09-22T08:12:09.001193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:53.517821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.175954+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.169110+0000","last_became_peered":"2024-09-22T08:10:45.169110+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:13.716183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.565361+0000","last_change":"2024-09-22T08:10:43.182888+0000","last_active":"2024-09-22T08:11:25.565361+0000","last_peered":"2024-09-22T08:11:25.565361+0000","last_clean":"2024-09-22T08:11:25.565361+0000","last_became_active":"2024-09-22T08:10:43.180088+0000","last_became_peered":"2024-09-22T08:10:43.180088+0000","last_unstale":"2024-09-22T08:11:25.565361+0000","last_undegraded":"2024-09-22T08:11:25.565361+0000","last_fullsized":"2024-09-22T08:11:25.565361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:17.087244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183683+0000","last_change":"2024-09-22T08:11:23.220302+0000","last_active":"2024-09-22T08:13:53.183683+0000","last_peered":"2024-09-22T08:13:53.183683+0000","last_clean":"2024-09-22T08:13:53.183683+0000","last_became_active":"2024-09-22T08:11:23.220081+0000","last_became_peered":"2024-09-22T08:11:23.220081+0000","last_unstale":"2024-09-22T08:13:53.183683+0000","last_undegraded":"2024-09-22T08:13:53.183683+0000","last_fullsized":"2024-09-22T08:13:53.183683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:33.959971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211346+0000","last_change":"2024-09-22T08:10:43.200685+0000","last_active":"2024-09-22T08:11:23.211346+0000","last_peered":"2024-09-22T08:11:23.211346+0000","last_clean":"2024-09-22T08:11:23.211346+0000","last_became_active":"2024-09-22T08:10:43.200013+0000","last_became_peered":"2024-09-22T08:10:43.200013+0000","last_unstale":"2024-09-22T08:11:23.211346+0000","last_undegraded":"2024-09-22T08:11:23.211346+0000","last_fullsized":"2024-09-22T08:11:23.211346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:43.911800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227900+0000","last_change":"2024-09-22T08:10:45.178916+0000","last_active":"2024-09-22T08:13:53.227900+0000","last_peered":"2024-09-22T08:13:53.227900+0000","last_clean":"2024-09-22T08:13:53.227900+0000","last_became_active":"2024-09-22T08:10:45.176491+0000","last_became_peered":"2024-09-22T08:10:45.176491+0000","last_unstale":"2024-09-22T08:13:53.227900+0000","last_undegraded":"2024-09-22T08:13:53.227900+0000","last_fullsized":"2024-09-22T08:13:53.227900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:10.583367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206702+0000","last_change":"2024-09-22T08:10:43.172716+0000","last_active":"2024-09-22T08:11:23.206702+0000","last_peered":"2024-09-22T08:11:23.206702+0000","last_clean":"2024-09-22T08:11:23.206702+0000","last_became_active":"2024-09-22T08:10:43.172330+0000","last_became_peered":"2024-09-22T08:10:43.172330+0000","last_unstale":"2024-09-22T08:11:23.206702+0000","last_undegraded":"2024-09-22T08:11:23.206702+0000","last_fullsized":"2024-09-22T08:11:23.206702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:17.018405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.951226+0000","last_change":"2024-09-22T08:10:45.176141+0000","last_active":"2024-09-22T08:13:52.951226+0000","last_peered":"2024-09-22T08:13:52.951226+0000","last_clean":"2024-09-22T08:13:52.951226+0000","last_became_active":"2024-09-22T08:10:45.175775+0000","last_became_peered":"2024-09-22T08:10:45.175775+0000","last_unstale":"2024-09-22T08:13:52.951226+0000","last_undegraded":"2024-09-22T08:13:52.951226+0000","last_fullsized":"2024-09-22T08:13:52.951226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:08.930275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210326+0000","last_change":"2024-09-22T08:10:43.188239+0000","last_active":"2024-09-22T08:11:23.210326+0000","last_peered":"2024-09-22T08:11:23.210326+0000","last_clean":"2024-09-22T08:11:23.210326+0000","last_became_active":"2024-09-22T08:10:43.187858+0000","last_became_peered":"2024-09-22T08:10:43.187858+0000","last_unstale":"2024-09-22T08:11:23.210326+0000","last_undegraded":"2024-09-22T08:11:23.210326+0000","last_fullsized":"2024-09-22T08:11:23.210326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:35.814525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.054945+0000","last_change":"2024-09-22T08:10:45.180145+0000","last_active":"2024-09-22T08:13:53.054945+0000","last_peered":"2024-09-22T08:13:53.054945+0000","last_clean":"2024-09-22T08:13:53.054945+0000","last_became_active":"2024-09-22T08:10:45.179870+0000","last_became_peered":"2024-09-22T08:10:45.179870+0000","last_unstale":"2024-09-22T08:13:53.054945+0000","last_undegraded":"2024-09-22T08:13:53.054945+0000","last_fullsized":"2024-09-22T08:13:53.054945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:13:33.107569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220202+0000","last_change":"2024-09-22T08:10:43.178636+0000","last_active":"2024-09-22T08:11:23.220202+0000","last_peered":"2024-09-22T08:11:23.220202+0000","last_clean":"2024-09-22T08:11:23.220202+0000","last_became_active":"2024-09-22T08:10:43.178146+0000","last_became_peered":"2024-09-22T08:10:43.178146+0000","last_unstale":"2024-09-22T08:11:23.220202+0000","last_undegraded":"2024-09-22T08:11:23.220202+0000","last_fullsized":"2024-09-22T08:11:23.220202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:37.378948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.829002+0000","last_change":"2024-09-22T08:10:45.177410+0000","last_active":"2024-09-22T08:12:08.829002+0000","last_peered":"2024-09-22T08:12:08.829002+0000","last_clean":"2024-09-22T08:12:08.829002+0000","last_became_active":"2024-09-22T08:10:45.177101+0000","last_became_peered":"2024-09-22T08:10:45.177101+0000","last_unstale":"2024-09-22T08:12:08.829002+0000","last_undegraded":"2024-09-22T08:12:08.829002+0000","last_fullsized":"2024-09-22T08:12:08.829002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:22:33.661673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828898+0000","last_change":"2024-09-22T08:10:45.170689+0000","last_active":"2024-09-22T08:12:08.828898+0000","last_peered":"2024-09-22T08:12:08.828898+0000","last_clean":"2024-09-22T08:12:08.828898+0000","last_became_active":"2024-09-22T08:10:45.169140+0000","last_became_peered":"2024-09-22T08:10:45.169140+0000","last_unstale":"2024-09-22T08:12:08.828898+0000","last_undegraded":"2024-09-22T08:12:08.828898+0000","last_fullsized":"2024-09-22T08:12:08.828898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:02.240838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.167301+0000","last_change":"2024-09-22T08:10:43.185987+0000","last_active":"2024-09-22T08:13:53.167301+0000","last_peered":"2024-09-22T08:13:53.167301+0000","last_clean":"2024-09-22T08:13:53.167301+0000","last_became_active":"2024-09-22T08:10:43.185301+0000","last_became_peered":"2024-09-22T08:10:43.185301+0000","last_unstale":"2024-09-22T08:13:53.167301+0000","last_undegraded":"2024-09-22T08:13:53.167301+0000","last_fullsized":"2024-09-22T08:13:53.167301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:21.858399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213294+0000","last_change":"2024-09-22T08:10:45.172853+0000","last_active":"2024-09-22T08:11:23.213294+0000","last_peered":"2024-09-22T08:11:23.213294+0000","last_clean":"2024-09-22T08:11:23.213294+0000","last_became_active":"2024-09-22T08:10:45.172557+0000","last_became_peered":"2024-09-22T08:10:45.172557+0000","last_unstale":"2024-09-22T08:11:23.213294+0000","last_undegraded":"2024-09-22T08:11:23.213294+0000","last_fullsized":"2024-09-22T08:11:23.213294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:38.198254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211528+0000","last_change":"2024-09-22T08:10:43.193026+0000","last_active":"2024-09-22T08:11:23.211528+0000","last_peered":"2024-09-22T08:11:23.211528+0000","last_clean":"2024-09-22T08:11:23.211528+0000","last_became_active":"2024-09-22T08:10:43.189273+0000","last_became_peered":"2024-09-22T08:10:43.189273+0000","last_unstale":"2024-09-22T08:11:23.211528+0000","last_undegraded":"2024-09-22T08:11:23.211528+0000","last_fullsized":"2024-09-22T08:11:23.211528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:52.937847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.307146+0000","last_change":"2024-09-22T08:10:45.178843+0000","last_active":"2024-09-22T08:13:53.307146+0000","last_peered":"2024-09-22T08:13:53.307146+0000","last_clean":"2024-09-22T08:13:53.307146+0000","last_became_active":"2024-09-22T08:10:45.176885+0000","last_became_peered":"2024-09-22T08:10:45.176885+0000","last_unstale":"2024-09-22T08:13:53.307146+0000","last_undegraded":"2024-09-22T08:13:53.307146+0000","last_fullsized":"2024-09-22T08:13:53.307146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:27.127106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214958+0000","last_change":"2024-09-22T08:10:43.184292+0000","last_active":"2024-09-22T08:11:23.214958+0000","last_peered":"2024-09-22T08:11:23.214958+0000","last_clean":"2024-09-22T08:11:23.214958+0000","last_became_active":"2024-09-22T08:10:43.183887+0000","last_became_peered":"2024-09-22T08:10:43.183887+0000","last_unstale":"2024-09-22T08:11:23.214958+0000","last_undegraded":"2024-09-22T08:11:23.214958+0000","last_fullsized":"2024-09-22T08:11:23.214958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:53.082618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228331+0000","last_change":"2024-09-22T08:10:45.172136+0000","last_active":"2024-09-22T08:13:53.228331+0000","last_peered":"2024-09-22T08:13:53.228331+0000","last_clean":"2024-09-22T08:13:53.228331+0000","last_became_active":"2024-09-22T08:10:45.171492+0000","last_became_peered":"2024-09-22T08:10:45.171492+0000","last_unstale":"2024-09-22T08:13:53.228331+0000","last_undegraded":"2024-09-22T08:13:53.228331+0000","last_fullsized":"2024-09-22T08:13:53.228331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:55.520692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.819194+0000","last_change":"2024-09-22T08:10:43.179557+0000","last_active":"2024-09-22T08:12:08.819194+0000","last_peered":"2024-09-22T08:12:08.819194+0000","last_clean":"2024-09-22T08:12:08.819194+0000","last_became_active":"2024-09-22T08:10:43.179133+0000","last_became_peered":"2024-09-22T08:10:43.179133+0000","last_unstale":"2024-09-22T08:12:08.819194+0000","last_undegraded":"2024-09-22T08:12:08.819194+0000","last_fullsized":"2024-09-22T08:12:08.819194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:51.687725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13,"num_write":24,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.056124+0000","last_change":"2024-09-22T08:10:45.174057+0000","last_active":"2024-09-22T08:13:53.056124+0000","last_peered":"2024-09-22T08:13:53.056124+0000","last_clean":"2024-09-22T08:13:53.056124+0000","last_became_active":"2024-09-22T08:10:45.173524+0000","last_became_peered":"2024-09-22T08:10:45.173524+0000","last_unstale":"2024-09-22T08:13:53.056124+0000","last_undegraded":"2024-09-22T08:13:53.056124+0000","last_fullsized":"2024-09-22T08:13:53.056124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:21.335898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562821+0000","last_change":"2024-09-22T08:10:43.187823+0000","last_active":"2024-09-22T08:11:25.562821+0000","last_peered":"2024-09-22T08:11:25.562821+0000","last_clean":"2024-09-22T08:11:25.562821+0000","last_became_active":"2024-09-22T08:10:43.186739+0000","last_became_peered":"2024-09-22T08:10:43.186739+0000","last_unstale":"2024-09-22T08:11:25.562821+0000","last_undegraded":"2024-09-22T08:11:25.562821+0000","last_fullsized":"2024-09-22T08:11:25.562821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:58.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037355+0000","last_change":"2024-09-22T08:10:45.172711+0000","last_active":"2024-09-22T08:11:27.037355+0000","last_peered":"2024-09-22T08:11:27.037355+0000","last_clean":"2024-09-22T08:11:27.037355+0000","last_became_active":"2024-09-22T08:10:45.170247+0000","last_became_peered":"2024-09-22T08:10:45.170247+0000","last_unstale":"2024-09-22T08:11:27.037355+0000","last_undegraded":"2024-09-22T08:11:27.037355+0000","last_fullsized":"2024-09-22T08:11:27.037355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:51.811049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562616+0000","last_change":"2024-09-22T08:10:43.191158+0000","last_active":"2024-09-22T08:11:25.562616+0000","last_peered":"2024-09-22T08:11:25.562616+0000","last_clean":"2024-09-22T08:11:25.562616+0000","last_became_active":"2024-09-22T08:10:43.190674+0000","last_became_peered":"2024-09-22T08:10:43.190674+0000","last_unstale":"2024-09-22T08:11:25.562616+0000","last_undegraded":"2024-09-22T08:11:25.562616+0000","last_fullsized":"2024-09-22T08:11:25.562616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:24.822605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.206848+0000","last_change":"2024-09-22T08:10:53.203618+0000","last_active":"2024-09-22T08:13:53.206848+0000","last_peered":"2024-09-22T08:13:53.206848+0000","last_clean":"2024-09-22T08:13:53.206848+0000","last_became_active":"2024-09-22T08:10:53.203146+0000","last_became_peered":"2024-09-22T08:10:53.203146+0000","last_unstale":"2024-09-22T08:13:53.206848+0000","last_undegraded":"2024-09-22T08:13:53.206848+0000","last_fullsized":"2024-09-22T08:13:53.206848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:09.081236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042651+0000","last_change":"2024-09-22T08:10:45.168914+0000","last_active":"2024-09-22T08:13:53.042651+0000","last_peered":"2024-09-22T08:13:53.042651+0000","last_clean":"2024-09-22T08:13:53.042651+0000","last_became_active":"2024-09-22T08:10:45.168308+0000","last_became_peered":"2024-09-22T08:10:45.168308+0000","last_unstale":"2024-09-22T08:13:53.042651+0000","last_undegraded":"2024-09-22T08:13:53.042651+0000","last_fullsized":"2024-09-22T08:13:53.042651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:33.215832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210935+0000","last_change":"2024-09-22T08:10:43.200744+0000","last_active":"2024-09-22T08:11:23.210935+0000","last_peered":"2024-09-22T08:11:23.210935+0000","last_clean":"2024-09-22T08:11:23.210935+0000","last_became_active":"2024-09-22T08:10:43.200307+0000","last_became_peered":"2024-09-22T08:10:43.200307+0000","last_unstale":"2024-09-22T08:11:23.210935+0000","last_undegraded":"2024-09-22T08:11:23.210935+0000","last_fullsized":"2024-09-22T08:11:23.210935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:05.094419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210664+0000","last_change":"2024-09-22T08:10:47.176870+0000","last_active":"2024-09-22T08:11:23.210664+0000","last_peered":"2024-09-22T08:11:23.210664+0000","last_clean":"2024-09-22T08:11:23.210664+0000","last_became_active":"2024-09-22T08:10:47.176568+0000","last_became_peered":"2024-09-22T08:10:47.176568+0000","last_unstale":"2024-09-22T08:11:23.210664+0000","last_undegraded":"2024-09-22T08:11:23.210664+0000","last_fullsized":"2024-09-22T08:11:23.210664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:55.338812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.141632+0000","last_change":"2024-09-22T08:10:49.189137+0000","last_active":"2024-09-22T08:12:51.141632+0000","last_peered":"2024-09-22T08:12:51.141632+0000","last_clean":"2024-09-22T08:12:51.141632+0000","last_became_active":"2024-09-22T08:10:49.188697+0000","last_became_peered":"2024-09-22T08:10:49.188697+0000","last_unstale":"2024-09-22T08:12:51.141632+0000","last_undegraded":"2024-09-22T08:12:51.141632+0000","last_fullsized":"2024-09-22T08:12:51.141632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:20.077797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216659+0000","last_change":"2024-09-22T08:10:51.202175+0000","last_active":"2024-09-22T08:11:23.216659+0000","last_peered":"2024-09-22T08:11:23.216659+0000","last_clean":"2024-09-22T08:11:23.216659+0000","last_became_active":"2024-09-22T08:10:51.201855+0000","last_became_peered":"2024-09-22T08:10:51.201855+0000","last_unstale":"2024-09-22T08:11:23.216659+0000","last_undegraded":"2024-09-22T08:11:23.216659+0000","last_fullsized":"2024-09-22T08:11:23.216659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'11","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.833839+0000","last_change":"2024-09-22T08:10:53.204685+0000","last_active":"2024-09-22T08:12:08.833839+0000","last_peered":"2024-09-22T08:12:08.833839+0000","last_clean":"2024-09-22T08:12:08.833839+0000","last_became_active":"2024-09-22T08:10:53.204407+0000","last_became_peered":"2024-09-22T08:10:53.204407+0000","last_unstale":"2024-09-22T08:12:08.833839+0000","last_undegraded":"2024-09-22T08:12:08.833839+0000","last_fullsized":"2024-09-22T08:12:08.833839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:07.954674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'16","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.261467+0000","last_change":"2024-09-22T08:10:45.171230+0000","last_active":"2024-09-22T08:13:53.261467+0000","last_peered":"2024-09-22T08:13:53.261467+0000","last_clean":"2024-09-22T08:13:53.261467+0000","last_became_active":"2024-09-22T08:10:45.170765+0000","last_became_peered":"2024-09-22T08:10:45.170765+0000","last_unstale":"2024-09-22T08:13:53.261467+0000","last_undegraded":"2024-09-22T08:13:53.261467+0000","last_fullsized":"2024-09-22T08:13:53.261467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:18.560588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206421+0000","last_change":"2024-09-22T08:10:43.180996+0000","last_active":"2024-09-22T08:11:23.206421+0000","last_peered":"2024-09-22T08:11:23.206421+0000","last_clean":"2024-09-22T08:11:23.206421+0000","last_became_active":"2024-09-22T08:10:43.180600+0000","last_became_peered":"2024-09-22T08:10:43.180600+0000","last_unstale":"2024-09-22T08:11:23.206421+0000","last_undegraded":"2024-09-22T08:11:23.206421+0000","last_fullsized":"2024-09-22T08:11:23.206421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:21.162231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221157+0000","last_change":"2024-09-22T08:10:47.168270+0000","last_active":"2024-09-22T08:11:23.221157+0000","last_peered":"2024-09-22T08:11:23.221157+0000","last_clean":"2024-09-22T08:11:23.221157+0000","last_became_active":"2024-09-22T08:10:47.167913+0000","last_became_peered":"2024-09-22T08:10:47.167913+0000","last_unstale":"2024-09-22T08:11:23.221157+0000","last_undegraded":"2024-09-22T08:11:23.221157+0000","last_fullsized":"2024-09-22T08:11:23.221157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:42.817181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216231+0000","last_change":"2024-09-22T08:10:49.182777+0000","last_active":"2024-09-22T08:11:23.216231+0000","last_peered":"2024-09-22T08:11:23.216231+0000","last_clean":"2024-09-22T08:11:23.216231+0000","last_became_active":"2024-09-22T08:10:49.182481+0000","last_became_peered":"2024-09-22T08:10:49.182481+0000","last_unstale":"2024-09-22T08:11:23.216231+0000","last_undegraded":"2024-09-22T08:11:23.216231+0000","last_fullsized":"2024-09-22T08:11:23.216231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:56.405074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.215699+0000","last_change":"2024-09-22T08:10:51.200151+0000","last_active":"2024-09-22T08:11:23.215699+0000","last_peered":"2024-09-22T08:11:23.215699+0000","last_clean":"2024-09-22T08:11:23.215699+0000","last_became_active":"2024-09-22T08:10:51.199837+0000","last_became_peered":"2024-09-22T08:10:51.199837+0000","last_unstale":"2024-09-22T08:11:23.215699+0000","last_undegraded":"2024-09-22T08:11:23.215699+0000","last_fullsized":"2024-09-22T08:11:23.215699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220094+0000","last_change":"2024-09-22T08:10:53.199608+0000","last_active":"2024-09-22T08:11:23.220094+0000","last_peered":"2024-09-22T08:11:23.220094+0000","last_clean":"2024-09-22T08:11:23.220094+0000","last_became_active":"2024-09-22T08:10:53.199303+0000","last_became_peered":"2024-09-22T08:10:53.199303+0000","last_unstale":"2024-09-22T08:11:23.220094+0000","last_undegraded":"2024-09-22T08:11:23.220094+0000","last_fullsized":"2024-09-22T08:11:23.220094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:27.339830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228089+0000","last_change":"2024-09-22T08:10:45.169254+0000","last_active":"2024-09-22T08:13:53.228089+0000","last_peered":"2024-09-22T08:13:53.228089+0000","last_clean":"2024-09-22T08:13:53.228089+0000","last_became_active":"2024-09-22T08:10:45.168554+0000","last_became_peered":"2024-09-22T08:10:45.168554+0000","last_unstale":"2024-09-22T08:13:53.228089+0000","last_undegraded":"2024-09-22T08:13:53.228089+0000","last_fullsized":"2024-09-22T08:13:53.228089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:25.135787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.932991+0000","last_change":"2024-09-22T08:10:43.189688+0000","last_active":"2024-09-22T08:13:52.932991+0000","last_peered":"2024-09-22T08:13:52.932991+0000","last_clean":"2024-09-22T08:13:52.932991+0000","last_became_active":"2024-09-22T08:10:43.189333+0000","last_became_peered":"2024-09-22T08:10:43.189333+0000","last_unstale":"2024-09-22T08:13:52.932991+0000","last_undegraded":"2024-09-22T08:13:52.932991+0000","last_fullsized":"2024-09-22T08:13:52.932991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:30.638919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223891+0000","last_change":"2024-09-22T08:10:47.176263+0000","last_active":"2024-09-22T08:11:23.223891+0000","last_peered":"2024-09-22T08:11:23.223891+0000","last_clean":"2024-09-22T08:11:23.223891+0000","last_became_active":"2024-09-22T08:10:47.175959+0000","last_became_peered":"2024-09-22T08:10:47.175959+0000","last_unstale":"2024-09-22T08:11:23.223891+0000","last_undegraded":"2024-09-22T08:11:23.223891+0000","last_fullsized":"2024-09-22T08:11:23.223891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:44.259414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207630+0000","last_change":"2024-09-22T08:10:49.185591+0000","last_active":"2024-09-22T08:11:23.207630+0000","last_peered":"2024-09-22T08:11:23.207630+0000","last_clean":"2024-09-22T08:11:23.207630+0000","last_became_active":"2024-09-22T08:10:49.185269+0000","last_became_peered":"2024-09-22T08:10:49.185269+0000","last_unstale":"2024-09-22T08:11:23.207630+0000","last_undegraded":"2024-09-22T08:11:23.207630+0000","last_fullsized":"2024-09-22T08:11:23.207630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.872968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":382,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254422+0000","last_change":"2024-09-22T08:10:51.196489+0000","last_active":"2024-09-22T08:13:52.254422+0000","last_peered":"2024-09-22T08:13:52.254422+0000","last_clean":"2024-09-22T08:13:52.254422+0000","last_became_active":"2024-09-22T08:10:51.196199+0000","last_became_peered":"2024-09-22T08:10:51.196199+0000","last_unstale":"2024-09-22T08:13:52.254422+0000","last_undegraded":"2024-09-22T08:13:52.254422+0000","last_fullsized":"2024-09-22T08:13:52.254422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:26.614683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.217337+0000","last_change":"2024-09-22T08:10:53.194394+0000","last_active":"2024-09-22T08:13:53.217337+0000","last_peered":"2024-09-22T08:13:53.217337+0000","last_clean":"2024-09-22T08:13:53.217337+0000","last_became_active":"2024-09-22T08:10:53.194118+0000","last_became_peered":"2024-09-22T08:10:53.194118+0000","last_unstale":"2024-09-22T08:13:53.217337+0000","last_undegraded":"2024-09-22T08:13:53.217337+0000","last_fullsized":"2024-09-22T08:13:53.217337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:00.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.234003+0000","last_change":"2024-09-22T08:10:45.183666+0000","last_active":"2024-09-22T08:13:53.234003+0000","last_peered":"2024-09-22T08:13:53.234003+0000","last_clean":"2024-09-22T08:13:53.234003+0000","last_became_active":"2024-09-22T08:10:45.183307+0000","last_became_peered":"2024-09-22T08:10:45.183307+0000","last_unstale":"2024-09-22T08:13:53.234003+0000","last_undegraded":"2024-09-22T08:13:53.234003+0000","last_fullsized":"2024-09-22T08:13:53.234003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:58.141567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211089+0000","last_change":"2024-09-22T08:10:43.188519+0000","last_active":"2024-09-22T08:11:23.211089+0000","last_peered":"2024-09-22T08:11:23.211089+0000","last_clean":"2024-09-22T08:11:23.211089+0000","last_became_active":"2024-09-22T08:10:43.187835+0000","last_became_peered":"2024-09-22T08:10:43.187835+0000","last_unstale":"2024-09-22T08:11:23.211089+0000","last_undegraded":"2024-09-22T08:11:23.211089+0000","last_fullsized":"2024-09-22T08:11:23.211089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:29.246042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211282+0000","last_change":"2024-09-22T08:10:47.175684+0000","last_active":"2024-09-22T08:11:23.211282+0000","last_peered":"2024-09-22T08:11:23.211282+0000","last_clean":"2024-09-22T08:11:23.211282+0000","last_became_active":"2024-09-22T08:10:47.175386+0000","last_became_peered":"2024-09-22T08:10:47.175386+0000","last_unstale":"2024-09-22T08:11:23.211282+0000","last_undegraded":"2024-09-22T08:11:23.211282+0000","last_fullsized":"2024-09-22T08:11:23.211282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:48.587319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.136350+0000","last_change":"2024-09-22T08:10:49.185291+0000","last_active":"2024-09-22T08:12:51.136350+0000","last_peered":"2024-09-22T08:12:51.136350+0000","last_clean":"2024-09-22T08:12:51.136350+0000","last_became_active":"2024-09-22T08:10:49.184963+0000","last_became_peered":"2024-09-22T08:10:49.184963+0000","last_unstale":"2024-09-22T08:12:51.136350+0000","last_undegraded":"2024-09-22T08:12:51.136350+0000","last_fullsized":"2024-09-22T08:12:51.136350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:53.469586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":442,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.257784+0000","last_change":"2024-09-22T08:10:51.193999+0000","last_active":"2024-09-22T08:13:53.257784+0000","last_peered":"2024-09-22T08:13:53.257784+0000","last_clean":"2024-09-22T08:13:53.257784+0000","last_became_active":"2024-09-22T08:10:51.193678+0000","last_became_peered":"2024-09-22T08:10:51.193678+0000","last_unstale":"2024-09-22T08:13:53.257784+0000","last_undegraded":"2024-09-22T08:13:53.257784+0000","last_fullsized":"2024-09-22T08:13:53.257784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.950936+0000","last_change":"2024-09-22T08:10:45.184006+0000","last_active":"2024-09-22T08:13:52.950936+0000","last_peered":"2024-09-22T08:13:52.950936+0000","last_clean":"2024-09-22T08:13:52.950936+0000","last_became_active":"2024-09-22T08:10:45.183598+0000","last_became_peered":"2024-09-22T08:10:45.183598+0000","last_unstale":"2024-09-22T08:13:52.950936+0000","last_undegraded":"2024-09-22T08:13:52.950936+0000","last_fullsized":"2024-09-22T08:13:52.950936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:42.041157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208676+0000","last_change":"2024-09-22T08:10:43.175203+0000","last_active":"2024-09-22T08:11:23.208676+0000","last_peered":"2024-09-22T08:11:23.208676+0000","last_clean":"2024-09-22T08:11:23.208676+0000","last_became_active":"2024-09-22T08:10:43.173543+0000","last_became_peered":"2024-09-22T08:10:43.173543+0000","last_unstale":"2024-09-22T08:11:23.208676+0000","last_undegraded":"2024-09-22T08:11:23.208676+0000","last_fullsized":"2024-09-22T08:11:23.208676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:49.711451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212481+0000","last_change":"2024-09-22T08:10:47.176921+0000","last_active":"2024-09-22T08:11:23.212481+0000","last_peered":"2024-09-22T08:11:23.212481+0000","last_clean":"2024-09-22T08:11:23.212481+0000","last_became_active":"2024-09-22T08:10:47.176657+0000","last_became_peered":"2024-09-22T08:10:47.176657+0000","last_unstale":"2024-09-22T08:11:23.212481+0000","last_undegraded":"2024-09-22T08:11:23.212481+0000","last_fullsized":"2024-09-22T08:11:23.212481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:32.681711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.145964+0000","last_change":"2024-09-22T08:10:49.184460+0000","last_active":"2024-09-22T08:12:51.145964+0000","last_peered":"2024-09-22T08:12:51.145964+0000","last_clean":"2024-09-22T08:12:51.145964+0000","last_became_active":"2024-09-22T08:10:49.182985+0000","last_became_peered":"2024-09-22T08:10:49.182985+0000","last_unstale":"2024-09-22T08:12:51.145964+0000","last_undegraded":"2024-09-22T08:12:51.145964+0000","last_fullsized":"2024-09-22T08:12:51.145964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:56.307814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222432+0000","last_change":"2024-09-22T08:10:51.193335+0000","last_active":"2024-09-22T08:11:23.222432+0000","last_peered":"2024-09-22T08:11:23.222432+0000","last_clean":"2024-09-22T08:11:23.222432+0000","last_became_active":"2024-09-22T08:10:51.192623+0000","last_became_peered":"2024-09-22T08:10:51.192623+0000","last_unstale":"2024-09-22T08:11:23.222432+0000","last_undegraded":"2024-09-22T08:11:23.222432+0000","last_fullsized":"2024-09-22T08:11:23.222432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.835562+0000","last_change":"2024-09-22T08:10:53.198555+0000","last_active":"2024-09-22T08:12:08.835562+0000","last_peered":"2024-09-22T08:12:08.835562+0000","last_clean":"2024-09-22T08:12:08.835562+0000","last_became_active":"2024-09-22T08:10:53.198219+0000","last_became_peered":"2024-09-22T08:10:53.198219+0000","last_unstale":"2024-09-22T08:12:08.835562+0000","last_undegraded":"2024-09-22T08:12:08.835562+0000","last_fullsized":"2024-09-22T08:12:08.835562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:04.308739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213131+0000","last_change":"2024-09-22T08:10:45.172178+0000","last_active":"2024-09-22T08:11:23.213131+0000","last_peered":"2024-09-22T08:11:23.213131+0000","last_clean":"2024-09-22T08:11:23.213131+0000","last_became_active":"2024-09-22T08:10:45.171911+0000","last_became_peered":"2024-09-22T08:10:45.171911+0000","last_unstale":"2024-09-22T08:11:23.213131+0000","last_undegraded":"2024-09-22T08:11:23.213131+0000","last_fullsized":"2024-09-22T08:11:23.213131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:57.459714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210955+0000","last_change":"2024-09-22T08:10:43.193335+0000","last_active":"2024-09-22T08:11:23.210955+0000","last_peered":"2024-09-22T08:11:23.210955+0000","last_clean":"2024-09-22T08:11:23.210955+0000","last_became_active":"2024-09-22T08:10:43.189780+0000","last_became_peered":"2024-09-22T08:10:43.189780+0000","last_unstale":"2024-09-22T08:11:23.210955+0000","last_undegraded":"2024-09-22T08:11:23.210955+0000","last_fullsized":"2024-09-22T08:11:23.210955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:29.886101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220270+0000","last_change":"2024-09-22T08:10:47.177997+0000","last_active":"2024-09-22T08:11:23.220270+0000","last_peered":"2024-09-22T08:11:23.220270+0000","last_clean":"2024-09-22T08:11:23.220270+0000","last_became_active":"2024-09-22T08:10:47.177695+0000","last_became_peered":"2024-09-22T08:10:47.177695+0000","last_unstale":"2024-09-22T08:11:23.220270+0000","last_undegraded":"2024-09-22T08:11:23.220270+0000","last_fullsized":"2024-09-22T08:11:23.220270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:09.326387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.125298+0000","last_change":"2024-09-22T08:10:49.185696+0000","last_active":"2024-09-22T08:12:51.125298+0000","last_peered":"2024-09-22T08:12:51.125298+0000","last_clean":"2024-09-22T08:12:51.125298+0000","last_became_active":"2024-09-22T08:10:49.185419+0000","last_became_peered":"2024-09-22T08:10:49.185419+0000","last_unstale":"2024-09-22T08:12:51.125298+0000","last_undegraded":"2024-09-22T08:12:51.125298+0000","last_fullsized":"2024-09-22T08:12:51.125298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:57.299371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221426+0000","last_change":"2024-09-22T08:10:51.202896+0000","last_active":"2024-09-22T08:11:23.221426+0000","last_peered":"2024-09-22T08:11:23.221426+0000","last_clean":"2024-09-22T08:11:23.221426+0000","last_became_active":"2024-09-22T08:10:51.202564+0000","last_became_peered":"2024-09-22T08:10:51.202564+0000","last_unstale":"2024-09-22T08:11:23.221426+0000","last_undegraded":"2024-09-22T08:11:23.221426+0000","last_fullsized":"2024-09-22T08:11:23.221426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:58.270948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:03.306650+0000","last_change":"2024-09-22T08:10:53.196844+0000","last_active":"2024-09-22T08:12:03.306650+0000","last_peered":"2024-09-22T08:12:03.306650+0000","last_clean":"2024-09-22T08:12:03.306650+0000","last_became_active":"2024-09-22T08:10:53.196392+0000","last_became_peered":"2024-09-22T08:10:53.196392+0000","last_unstale":"2024-09-22T08:12:03.306650+0000","last_undegraded":"2024-09-22T08:12:03.306650+0000","last_fullsized":"2024-09-22T08:12:03.306650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:30.239443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207308+0000","last_change":"2024-09-22T08:10:45.177813+0000","last_active":"2024-09-22T08:11:23.207308+0000","last_peered":"2024-09-22T08:11:23.207308+0000","last_clean":"2024-09-22T08:11:23.207308+0000","last_became_active":"2024-09-22T08:10:45.177530+0000","last_became_peered":"2024-09-22T08:10:45.177530+0000","last_unstale":"2024-09-22T08:11:23.207308+0000","last_undegraded":"2024-09-22T08:11:23.207308+0000","last_fullsized":"2024-09-22T08:11:23.207308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:03.255386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213304+0000","last_change":"2024-09-22T08:10:43.202319+0000","last_active":"2024-09-22T08:11:23.213304+0000","last_peered":"2024-09-22T08:11:23.213304+0000","last_clean":"2024-09-22T08:11:23.213304+0000","last_became_active":"2024-09-22T08:10:43.201669+0000","last_became_peered":"2024-09-22T08:10:43.201669+0000","last_unstale":"2024-09-22T08:11:23.213304+0000","last_undegraded":"2024-09-22T08:11:23.213304+0000","last_fullsized":"2024-09-22T08:11:23.213304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:18.648215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221742+0000","last_change":"2024-09-22T08:10:47.177950+0000","last_active":"2024-09-22T08:11:23.221742+0000","last_peered":"2024-09-22T08:11:23.221742+0000","last_clean":"2024-09-22T08:11:23.221742+0000","last_became_active":"2024-09-22T08:10:47.177613+0000","last_became_peered":"2024-09-22T08:10:47.177613+0000","last_unstale":"2024-09-22T08:11:23.221742+0000","last_undegraded":"2024-09-22T08:11:23.221742+0000","last_fullsized":"2024-09-22T08:11:23.221742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:26.919515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.147891+0000","last_change":"2024-09-22T08:10:49.187229+0000","last_active":"2024-09-22T08:12:51.147891+0000","last_peered":"2024-09-22T08:12:51.147891+0000","last_clean":"2024-09-22T08:12:51.147891+0000","last_became_active":"2024-09-22T08:10:49.186941+0000","last_became_peered":"2024-09-22T08:10:49.186941+0000","last_unstale":"2024-09-22T08:12:51.147891+0000","last_undegraded":"2024-09-22T08:12:51.147891+0000","last_fullsized":"2024-09-22T08:12:51.147891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:28.645390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":349,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.372929+0000","last_change":"2024-09-22T08:10:51.192885+0000","last_active":"2024-09-22T08:13:53.372929+0000","last_peered":"2024-09-22T08:13:53.372929+0000","last_clean":"2024-09-22T08:13:53.372929+0000","last_became_active":"2024-09-22T08:10:51.192483+0000","last_became_peered":"2024-09-22T08:10:51.192483+0000","last_unstale":"2024-09-22T08:13:53.372929+0000","last_undegraded":"2024-09-22T08:13:53.372929+0000","last_fullsized":"2024-09-22T08:13:53.372929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:47.260805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222488+0000","last_change":"2024-09-22T08:10:53.199613+0000","last_active":"2024-09-22T08:11:23.222488+0000","last_peered":"2024-09-22T08:11:23.222488+0000","last_clean":"2024-09-22T08:11:23.222488+0000","last_became_active":"2024-09-22T08:10:53.199273+0000","last_became_peered":"2024-09-22T08:10:53.199273+0000","last_unstale":"2024-09-22T08:11:23.222488+0000","last_undegraded":"2024-09-22T08:11:23.222488+0000","last_fullsized":"2024-09-22T08:11:23.222488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:07.308140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183660+0000","last_change":"2024-09-22T08:10:45.165644+0000","last_active":"2024-09-22T08:13:53.183660+0000","last_peered":"2024-09-22T08:13:53.183660+0000","last_clean":"2024-09-22T08:13:53.183660+0000","last_became_active":"2024-09-22T08:10:45.165352+0000","last_became_peered":"2024-09-22T08:10:45.165352+0000","last_unstale":"2024-09-22T08:13:53.183660+0000","last_undegraded":"2024-09-22T08:13:53.183660+0000","last_fullsized":"2024-09-22T08:13:53.183660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:15.188589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211087+0000","last_change":"2024-09-22T08:10:43.199804+0000","last_active":"2024-09-22T08:11:23.211087+0000","last_peered":"2024-09-22T08:11:23.211087+0000","last_clean":"2024-09-22T08:11:23.211087+0000","last_became_active":"2024-09-22T08:10:43.198696+0000","last_became_peered":"2024-09-22T08:10:43.198696+0000","last_unstale":"2024-09-22T08:11:23.211087+0000","last_undegraded":"2024-09-22T08:11:23.211087+0000","last_fullsized":"2024-09-22T08:11:23.211087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:50.899075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220881+0000","last_change":"2024-09-22T08:10:47.176680+0000","last_active":"2024-09-22T08:11:23.220881+0000","last_peered":"2024-09-22T08:11:23.220881+0000","last_clean":"2024-09-22T08:11:23.220881+0000","last_became_active":"2024-09-22T08:10:47.176263+0000","last_became_peered":"2024-09-22T08:10:47.176263+0000","last_unstale":"2024-09-22T08:11:23.220881+0000","last_undegraded":"2024-09-22T08:11:23.220881+0000","last_fullsized":"2024-09-22T08:11:23.220881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:38.640214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.150072+0000","last_change":"2024-09-22T08:10:49.189658+0000","last_active":"2024-09-22T08:12:51.150072+0000","last_peered":"2024-09-22T08:12:51.150072+0000","last_clean":"2024-09-22T08:12:51.150072+0000","last_became_active":"2024-09-22T08:10:49.188724+0000","last_became_peered":"2024-09-22T08:10:49.188724+0000","last_unstale":"2024-09-22T08:12:51.150072+0000","last_undegraded":"2024-09-22T08:12:51.150072+0000","last_fullsized":"2024-09-22T08:12:51.150072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:49.620069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220087+0000","last_change":"2024-09-22T08:10:51.195268+0000","last_active":"2024-09-22T08:11:23.220087+0000","last_peered":"2024-09-22T08:11:23.220087+0000","last_clean":"2024-09-22T08:11:23.220087+0000","last_became_active":"2024-09-22T08:10:51.194937+0000","last_became_peered":"2024-09-22T08:10:51.194937+0000","last_unstale":"2024-09-22T08:11:23.220087+0000","last_undegraded":"2024-09-22T08:11:23.220087+0000","last_fullsized":"2024-09-22T08:11:23.220087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.350209+0000","last_change":"2024-09-22T08:10:53.201595+0000","last_active":"2024-09-22T08:13:53.350209+0000","last_peered":"2024-09-22T08:13:53.350209+0000","last_clean":"2024-09-22T08:13:53.350209+0000","last_became_active":"2024-09-22T08:10:53.201289+0000","last_became_peered":"2024-09-22T08:10:53.201289+0000","last_unstale":"2024-09-22T08:13:53.350209+0000","last_undegraded":"2024-09-22T08:13:53.350209+0000","last_fullsized":"2024-09-22T08:13:53.350209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:22.640385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.468134+0000","last_change":"2024-09-22T08:10:45.181031+0000","last_active":"2024-09-22T08:12:49.468134+0000","last_peered":"2024-09-22T08:12:49.468134+0000","last_clean":"2024-09-22T08:12:49.468134+0000","last_became_active":"2024-09-22T08:10:45.180762+0000","last_became_peered":"2024-09-22T08:10:45.180762+0000","last_unstale":"2024-09-22T08:12:49.468134+0000","last_undegraded":"2024-09-22T08:12:49.468134+0000","last_fullsized":"2024-09-22T08:12:49.468134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:39.170953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562819+0000","last_change":"2024-09-22T08:10:43.177974+0000","last_active":"2024-09-22T08:11:25.562819+0000","last_peered":"2024-09-22T08:11:25.562819+0000","last_clean":"2024-09-22T08:11:25.562819+0000","last_became_active":"2024-09-22T08:10:43.177202+0000","last_became_peered":"2024-09-22T08:10:43.177202+0000","last_unstale":"2024-09-22T08:11:25.562819+0000","last_undegraded":"2024-09-22T08:11:25.562819+0000","last_fullsized":"2024-09-22T08:11:25.562819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:21.858399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207951+0000","last_change":"2024-09-22T08:10:47.173920+0000","last_active":"2024-09-22T08:11:23.207951+0000","last_peered":"2024-09-22T08:11:23.207951+0000","last_clean":"2024-09-22T08:11:23.207951+0000","last_became_active":"2024-09-22T08:10:47.173636+0000","last_became_peered":"2024-09-22T08:10:47.173636+0000","last_unstale":"2024-09-22T08:11:23.207951+0000","last_undegraded":"2024-09-22T08:11:23.207951+0000","last_fullsized":"2024-09-22T08:11:23.207951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:07.844753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.129598+0000","last_change":"2024-09-22T08:10:49.175235+0000","last_active":"2024-09-22T08:12:51.129598+0000","last_peered":"2024-09-22T08:12:51.129598+0000","last_clean":"2024-09-22T08:12:51.129598+0000","last_became_active":"2024-09-22T08:10:49.174933+0000","last_became_peered":"2024-09-22T08:10:49.174933+0000","last_unstale":"2024-09-22T08:12:51.129598+0000","last_undegraded":"2024-09-22T08:12:51.129598+0000","last_fullsized":"2024-09-22T08:12:51.129598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:09.101942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212489+0000","last_change":"2024-09-22T08:10:51.195590+0000","last_active":"2024-09-22T08:11:23.212489+0000","last_peered":"2024-09-22T08:11:23.212489+0000","last_clean":"2024-09-22T08:11:23.212489+0000","last_became_active":"2024-09-22T08:10:51.195308+0000","last_became_peered":"2024-09-22T08:10:51.195308+0000","last_unstale":"2024-09-22T08:11:23.212489+0000","last_undegraded":"2024-09-22T08:11:23.212489+0000","last_fullsized":"2024-09-22T08:11:23.212489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:13.979616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584694+0000","last_change":"2024-09-22T08:10:53.201429+0000","last_active":"2024-09-22T08:12:52.584694+0000","last_peered":"2024-09-22T08:12:52.584694+0000","last_clean":"2024-09-22T08:12:52.584694+0000","last_became_active":"2024-09-22T08:10:53.200458+0000","last_became_peered":"2024-09-22T08:10:53.200458+0000","last_unstale":"2024-09-22T08:12:52.584694+0000","last_undegraded":"2024-09-22T08:12:52.584694+0000","last_fullsized":"2024-09-22T08:12:52.584694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:15.839331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:02.586743+0000","last_change":"2024-09-22T08:10:45.183532+0000","last_active":"2024-09-22T08:13:02.586743+0000","last_peered":"2024-09-22T08:13:02.586743+0000","last_clean":"2024-09-22T08:13:02.586743+0000","last_became_active":"2024-09-22T08:10:45.183258+0000","last_became_peered":"2024-09-22T08:10:45.183258+0000","last_unstale":"2024-09-22T08:13:02.586743+0000","last_undegraded":"2024-09-22T08:13:02.586743+0000","last_fullsized":"2024-09-22T08:13:02.586743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:38.687579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213355+0000","last_change":"2024-09-22T08:10:43.197491+0000","last_active":"2024-09-22T08:11:23.213355+0000","last_peered":"2024-09-22T08:11:23.213355+0000","last_clean":"2024-09-22T08:11:23.213355+0000","last_became_active":"2024-09-22T08:10:43.195959+0000","last_became_peered":"2024-09-22T08:10:43.195959+0000","last_unstale":"2024-09-22T08:11:23.213355+0000","last_undegraded":"2024-09-22T08:11:23.213355+0000","last_fullsized":"2024-09-22T08:11:23.213355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:31.630549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216166+0000","last_change":"2024-09-22T08:11:23.215294+0000","last_active":"2024-09-22T08:11:23.216166+0000","last_peered":"2024-09-22T08:11:23.216166+0000","last_clean":"2024-09-22T08:11:23.216166+0000","last_became_active":"2024-09-22T08:11:23.214959+0000","last_became_peered":"2024-09-22T08:11:23.214959+0000","last_unstale":"2024-09-22T08:11:23.216166+0000","last_undegraded":"2024-09-22T08:11:23.216166+0000","last_fullsized":"2024-09-22T08:11:23.216166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:50.116285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.156739+0000","last_change":"2024-09-22T08:10:49.181291+0000","last_active":"2024-09-22T08:12:51.156739+0000","last_peered":"2024-09-22T08:12:51.156739+0000","last_clean":"2024-09-22T08:12:51.156739+0000","last_became_active":"2024-09-22T08:10:49.180820+0000","last_became_peered":"2024-09-22T08:10:49.180820+0000","last_unstale":"2024-09-22T08:12:51.156739+0000","last_undegraded":"2024-09-22T08:12:51.156739+0000","last_fullsized":"2024-09-22T08:12:51.156739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:56.059910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":432,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.353982+0000","last_change":"2024-09-22T08:10:51.197307+0000","last_active":"2024-09-22T08:13:53.353982+0000","last_peered":"2024-09-22T08:13:53.353982+0000","last_clean":"2024-09-22T08:13:53.353982+0000","last_became_active":"2024-09-22T08:10:51.197020+0000","last_became_peered":"2024-09-22T08:10:51.197020+0000","last_unstale":"2024-09-22T08:13:53.353982+0000","last_undegraded":"2024-09-22T08:13:53.353982+0000","last_fullsized":"2024-09-22T08:13:53.353982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:39.376197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:01.585334+0000","last_change":"2024-09-22T08:10:53.192873+0000","last_active":"2024-09-22T08:13:01.585334+0000","last_peered":"2024-09-22T08:13:01.585334+0000","last_clean":"2024-09-22T08:13:01.585334+0000","last_became_active":"2024-09-22T08:10:53.192481+0000","last_became_peered":"2024-09-22T08:10:53.192481+0000","last_unstale":"2024-09-22T08:13:01.585334+0000","last_undegraded":"2024-09-22T08:13:01.585334+0000","last_fullsized":"2024-09-22T08:13:01.585334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:06.451090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183469+0000","last_change":"2024-09-22T08:10:45.173005+0000","last_active":"2024-09-22T08:13:53.183469+0000","last_peered":"2024-09-22T08:13:53.183469+0000","last_clean":"2024-09-22T08:13:53.183469+0000","last_became_active":"2024-09-22T08:10:45.172740+0000","last_became_peered":"2024-09-22T08:10:45.172740+0000","last_unstale":"2024-09-22T08:13:53.183469+0000","last_undegraded":"2024-09-22T08:13:53.183469+0000","last_fullsized":"2024-09-22T08:13:53.183469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:20.794542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212966+0000","last_change":"2024-09-22T08:10:43.195715+0000","last_active":"2024-09-22T08:11:23.212966+0000","last_peered":"2024-09-22T08:11:23.212966+0000","last_clean":"2024-09-22T08:11:23.212966+0000","last_became_active":"2024-09-22T08:10:43.195355+0000","last_became_peered":"2024-09-22T08:10:43.195355+0000","last_unstale":"2024-09-22T08:11:23.212966+0000","last_undegraded":"2024-09-22T08:11:23.212966+0000","last_fullsized":"2024-09-22T08:11:23.212966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:01.525176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":426,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.224617+0000","last_change":"2024-09-22T08:11:23.229177+0000","last_active":"2024-09-22T08:12:52.224617+0000","last_peered":"2024-09-22T08:12:52.224617+0000","last_clean":"2024-09-22T08:12:52.224617+0000","last_became_active":"2024-09-22T08:11:23.221981+0000","last_became_peered":"2024-09-22T08:11:23.221981+0000","last_unstale":"2024-09-22T08:12:52.224617+0000","last_undegraded":"2024-09-22T08:12:52.224617+0000","last_fullsized":"2024-09-22T08:12:52.224617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:00.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213610+0000","last_change":"2024-09-22T08:10:49.188917+0000","last_active":"2024-09-22T08:11:23.213610+0000","last_peered":"2024-09-22T08:11:23.213610+0000","last_clean":"2024-09-22T08:11:23.213610+0000","last_became_active":"2024-09-22T08:10:49.188444+0000","last_became_peered":"2024-09-22T08:10:49.188444+0000","last_unstale":"2024-09-22T08:11:23.213610+0000","last_undegraded":"2024-09-22T08:11:23.213610+0000","last_fullsized":"2024-09-22T08:11:23.213610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:27.352744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":469,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.310805+0000","last_change":"2024-09-22T08:10:51.197818+0000","last_active":"2024-09-22T08:13:53.310805+0000","last_peered":"2024-09-22T08:13:53.310805+0000","last_clean":"2024-09-22T08:13:53.310805+0000","last_became_active":"2024-09-22T08:10:51.197248+0000","last_became_peered":"2024-09-22T08:10:51.197248+0000","last_unstale":"2024-09-22T08:13:53.310805+0000","last_undegraded":"2024-09-22T08:13:53.310805+0000","last_fullsized":"2024-09-22T08:13:53.310805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.360311+0000","last_change":"2024-09-22T08:10:53.195875+0000","last_active":"2024-09-22T08:12:52.360311+0000","last_peered":"2024-09-22T08:12:52.360311+0000","last_clean":"2024-09-22T08:12:52.360311+0000","last_became_active":"2024-09-22T08:10:53.195539+0000","last_became_peered":"2024-09-22T08:10:53.195539+0000","last_unstale":"2024-09-22T08:12:52.360311+0000","last_undegraded":"2024-09-22T08:12:52.360311+0000","last_fullsized":"2024-09-22T08:12:52.360311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:10.933920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254832+0000","last_change":"2024-09-22T08:11:23.226070+0000","last_active":"2024-09-22T08:13:53.254832+0000","last_peered":"2024-09-22T08:13:53.254832+0000","last_clean":"2024-09-22T08:13:53.254832+0000","last_became_active":"2024-09-22T08:11:23.220943+0000","last_became_peered":"2024-09-22T08:11:23.220943+0000","last_unstale":"2024-09-22T08:13:53.254832+0000","last_undegraded":"2024-09-22T08:13:53.254832+0000","last_fullsized":"2024-09-22T08:13:53.254832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:18.981650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.249213+0000","last_change":"2024-09-22T08:10:43.198294+0000","last_active":"2024-09-22T08:13:53.249213+0000","last_peered":"2024-09-22T08:13:53.249213+0000","last_clean":"2024-09-22T08:13:53.249213+0000","last_became_active":"2024-09-22T08:10:43.196211+0000","last_became_peered":"2024-09-22T08:10:43.196211+0000","last_unstale":"2024-09-22T08:13:53.249213+0000","last_undegraded":"2024-09-22T08:13:53.249213+0000","last_fullsized":"2024-09-22T08:13:53.249213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:16.704599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211379+0000","last_change":"2024-09-22T08:10:47.177015+0000","last_active":"2024-09-22T08:11:23.211379+0000","last_peered":"2024-09-22T08:11:23.211379+0000","last_clean":"2024-09-22T08:11:23.211379+0000","last_became_active":"2024-09-22T08:10:47.176634+0000","last_became_peered":"2024-09-22T08:10:47.176634+0000","last_unstale":"2024-09-22T08:11:23.211379+0000","last_undegraded":"2024-09-22T08:11:23.211379+0000","last_fullsized":"2024-09-22T08:11:23.211379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:32.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.142937+0000","last_change":"2024-09-22T08:10:49.179447+0000","last_active":"2024-09-22T08:12:51.142937+0000","last_peered":"2024-09-22T08:12:51.142937+0000","last_clean":"2024-09-22T08:12:51.142937+0000","last_became_active":"2024-09-22T08:10:49.178942+0000","last_became_peered":"2024-09-22T08:10:49.178942+0000","last_unstale":"2024-09-22T08:12:51.142937+0000","last_undegraded":"2024-09-22T08:12:51.142937+0000","last_fullsized":"2024-09-22T08:12:51.142937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:49.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207501+0000","last_change":"2024-09-22T08:10:51.192777+0000","last_active":"2024-09-22T08:11:23.207501+0000","last_peered":"2024-09-22T08:11:23.207501+0000","last_clean":"2024-09-22T08:11:23.207501+0000","last_became_active":"2024-09-22T08:10:51.192482+0000","last_became_peered":"2024-09-22T08:10:51.192482+0000","last_unstale":"2024-09-22T08:11:23.207501+0000","last_undegraded":"2024-09-22T08:11:23.207501+0000","last_fullsized":"2024-09-22T08:11:23.207501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:39.871977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.288651+0000","last_change":"2024-09-22T08:10:53.193739+0000","last_active":"2024-09-22T08:13:53.288651+0000","last_peered":"2024-09-22T08:13:53.288651+0000","last_clean":"2024-09-22T08:13:53.288651+0000","last_became_active":"2024-09-22T08:10:53.193315+0000","last_became_peered":"2024-09-22T08:10:53.193315+0000","last_unstale":"2024-09-22T08:13:53.288651+0000","last_undegraded":"2024-09-22T08:13:53.288651+0000","last_fullsized":"2024-09-22T08:13:53.288651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:02.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.576265+0000","last_change":"2024-09-22T08:10:45.176318+0000","last_active":"2024-09-22T08:12:52.576265+0000","last_peered":"2024-09-22T08:12:52.576265+0000","last_clean":"2024-09-22T08:12:52.576265+0000","last_became_active":"2024-09-22T08:10:45.176033+0000","last_became_peered":"2024-09-22T08:10:45.176033+0000","last_unstale":"2024-09-22T08:12:52.576265+0000","last_undegraded":"2024-09-22T08:12:52.576265+0000","last_fullsized":"2024-09-22T08:12:52.576265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:16.885517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210644+0000","last_change":"2024-09-22T08:10:29.013963+0000","last_active":"2024-09-22T08:11:23.210644+0000","last_peered":"2024-09-22T08:11:23.210644+0000","last_clean":"2024-09-22T08:11:23.210644+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:11:23.210644+0000","last_undegraded":"2024-09-22T08:11:23.210644+0000","last_fullsized":"2024-09-22T08:11:23.210644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_clean_scrub_stamp":"2024-09-22T08:10:27.897500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:09.733603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211507+0000","last_change":"2024-09-22T08:10:35.923301+0000","last_active":"2024-09-22T08:11:23.211507+0000","last_peered":"2024-09-22T08:11:23.211507+0000","last_clean":"2024-09-22T08:11:23.211507+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:11:23.211507+0000","last_undegraded":"2024-09-22T08:11:23.211507+0000","last_fullsized":"2024-09-22T08:11:23.211507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:47.170548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:47.584171+0000","last_change":"2024-09-22T08:10:43.201333+0000","last_active":"2024-09-22T08:12:47.584171+0000","last_peered":"2024-09-22T08:12:47.584171+0000","last_clean":"2024-09-22T08:12:47.584171+0000","last_became_active":"2024-09-22T08:10:43.200918+0000","last_became_peered":"2024-09-22T08:10:43.200918+0000","last_unstale":"2024-09-22T08:12:47.584171+0000","last_undegraded":"2024-09-22T08:12:47.584171+0000","last_fullsized":"2024-09-22T08:12:47.584171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:56.138697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"25'1","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.224891+0000","last_change":"2024-09-22T08:10:47.176080+0000","last_active":"2024-09-22T08:12:52.224891+0000","last_peered":"2024-09-22T08:12:52.224891+0000","last_clean":"2024-09-22T08:12:52.224891+0000","last_became_active":"2024-09-22T08:10:47.175775+0000","last_became_peered":"2024-09-22T08:10:47.175775+0000","last_unstale":"2024-09-22T08:12:52.224891+0000","last_undegraded":"2024-09-22T08:12:52.224891+0000","last_fullsized":"2024-09-22T08:12:52.224891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:05.368279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.154641+0000","last_change":"2024-09-22T08:10:49.185987+0000","last_active":"2024-09-22T08:12:51.154641+0000","last_peered":"2024-09-22T08:12:51.154641+0000","last_clean":"2024-09-22T08:12:51.154641+0000","last_became_active":"2024-09-22T08:10:49.185661+0000","last_became_peered":"2024-09-22T08:10:49.185661+0000","last_unstale":"2024-09-22T08:12:51.154641+0000","last_undegraded":"2024-09-22T08:12:51.154641+0000","last_fullsized":"2024-09-22T08:12:51.154641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:08.519832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222697+0000","last_change":"2024-09-22T08:10:51.202811+0000","last_active":"2024-09-22T08:11:23.222697+0000","last_peered":"2024-09-22T08:11:23.222697+0000","last_clean":"2024-09-22T08:11:23.222697+0000","last_became_active":"2024-09-22T08:10:51.202473+0000","last_became_peered":"2024-09-22T08:10:51.202473+0000","last_unstale":"2024-09-22T08:11:23.222697+0000","last_undegraded":"2024-09-22T08:11:23.222697+0000","last_fullsized":"2024-09-22T08:11:23.222697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.556104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.266227+0000","last_change":"2024-09-22T08:10:53.192244+0000","last_active":"2024-09-22T08:13:53.266227+0000","last_peered":"2024-09-22T08:13:53.266227+0000","last_clean":"2024-09-22T08:13:53.266227+0000","last_became_active":"2024-09-22T08:10:53.191752+0000","last_became_peered":"2024-09-22T08:10:53.191752+0000","last_unstale":"2024-09-22T08:13:53.266227+0000","last_undegraded":"2024-09-22T08:13:53.266227+0000","last_fullsized":"2024-09-22T08:13:53.266227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:21.155421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183521+0000","last_change":"2024-09-22T08:10:45.167615+0000","last_active":"2024-09-22T08:13:53.183521+0000","last_peered":"2024-09-22T08:13:53.183521+0000","last_clean":"2024-09-22T08:13:53.183521+0000","last_became_active":"2024-09-22T08:10:45.167260+0000","last_became_peered":"2024-09-22T08:10:45.167260+0000","last_unstale":"2024-09-22T08:13:53.183521+0000","last_undegraded":"2024-09-22T08:13:53.183521+0000","last_fullsized":"2024-09-22T08:13:53.183521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:09.439811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209592+0000","last_change":"2024-09-22T08:10:35.922413+0000","last_active":"2024-09-22T08:11:23.209592+0000","last_peered":"2024-09-22T08:11:23.209592+0000","last_clean":"2024-09-22T08:11:23.209592+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:11:23.209592+0000","last_undegraded":"2024-09-22T08:11:23.209592+0000","last_fullsized":"2024-09-22T08:11:23.209592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:14.955260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.175049+0000","last_change":"2024-09-22T08:10:43.178602+0000","last_active":"2024-09-22T08:13:53.175049+0000","last_peered":"2024-09-22T08:13:53.175049+0000","last_clean":"2024-09-22T08:13:53.175049+0000","last_became_active":"2024-09-22T08:10:43.177928+0000","last_became_peered":"2024-09-22T08:10:43.177928+0000","last_unstale":"2024-09-22T08:13:53.175049+0000","last_undegraded":"2024-09-22T08:13:53.175049+0000","last_fullsized":"2024-09-22T08:13:53.175049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:47.867688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212854+0000","last_change":"2024-09-22T08:10:47.176700+0000","last_active":"2024-09-22T08:11:23.212854+0000","last_peered":"2024-09-22T08:11:23.212854+0000","last_clean":"2024-09-22T08:11:23.212854+0000","last_became_active":"2024-09-22T08:10:47.176402+0000","last_became_peered":"2024-09-22T08:10:47.176402+0000","last_unstale":"2024-09-22T08:11:23.212854+0000","last_undegraded":"2024-09-22T08:11:23.212854+0000","last_fullsized":"2024-09-22T08:11:23.212854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:30.271890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'273","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254453+0000","last_change":"2024-09-22T08:10:49.186526+0000","last_active":"2024-09-22T08:13:52.254453+0000","last_peered":"2024-09-22T08:13:52.254453+0000","last_clean":"2024-09-22T08:13:52.254453+0000","last_became_active":"2024-09-22T08:10:49.186277+0000","last_became_peered":"2024-09-22T08:10:49.186277+0000","last_unstale":"2024-09-22T08:13:52.254453+0000","last_undegraded":"2024-09-22T08:13:52.254453+0000","last_fullsized":"2024-09-22T08:13:52.254453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:42.950185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210281+0000","last_change":"2024-09-22T08:10:51.198493+0000","last_active":"2024-09-22T08:11:23.210281+0000","last_peered":"2024-09-22T08:11:23.210281+0000","last_clean":"2024-09-22T08:11:23.210281+0000","last_became_active":"2024-09-22T08:10:51.196837+0000","last_became_peered":"2024-09-22T08:10:51.196837+0000","last_unstale":"2024-09-22T08:11:23.210281+0000","last_undegraded":"2024-09-22T08:11:23.210281+0000","last_fullsized":"2024-09-22T08:11:23.210281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:20.497307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.832166+0000","last_change":"2024-09-22T08:10:53.199926+0000","last_active":"2024-09-22T08:12:08.832166+0000","last_peered":"2024-09-22T08:12:08.832166+0000","last_clean":"2024-09-22T08:12:08.832166+0000","last_became_active":"2024-09-22T08:10:53.199214+0000","last_became_peered":"2024-09-22T08:10:53.199214+0000","last_unstale":"2024-09-22T08:12:08.832166+0000","last_undegraded":"2024-09-22T08:12:08.832166+0000","last_fullsized":"2024-09-22T08:12:08.832166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:35.327109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'11","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.958255+0000","last_change":"2024-09-22T08:10:45.176242+0000","last_active":"2024-09-22T08:13:52.958255+0000","last_peered":"2024-09-22T08:13:52.958255+0000","last_clean":"2024-09-22T08:13:52.958255+0000","last_became_active":"2024-09-22T08:10:45.175923+0000","last_became_peered":"2024-09-22T08:10:45.175923+0000","last_unstale":"2024-09-22T08:13:52.958255+0000","last_undegraded":"2024-09-22T08:13:52.958255+0000","last_fullsized":"2024-09-22T08:13:52.958255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:05.397239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207525+0000","last_change":"2024-09-22T08:10:36.081840+0000","last_active":"2024-09-22T08:11:23.207525+0000","last_peered":"2024-09-22T08:11:23.207525+0000","last_clean":"2024-09-22T08:11:23.207525+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:11:23.207525+0000","last_undegraded":"2024-09-22T08:11:23.207525+0000","last_fullsized":"2024-09-22T08:11:23.207525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:30.701302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.219803+0000","last_change":"2024-09-22T08:10:43.187298+0000","last_active":"2024-09-22T08:11:23.219803+0000","last_peered":"2024-09-22T08:11:23.219803+0000","last_clean":"2024-09-22T08:11:23.219803+0000","last_became_active":"2024-09-22T08:10:43.186500+0000","last_became_peered":"2024-09-22T08:10:43.186500+0000","last_unstale":"2024-09-22T08:11:23.219803+0000","last_undegraded":"2024-09-22T08:11:23.219803+0000","last_fullsized":"2024-09-22T08:11:23.219803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:05.709839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208957+0000","last_change":"2024-09-22T08:10:47.172553+0000","last_active":"2024-09-22T08:11:23.208957+0000","last_peered":"2024-09-22T08:11:23.208957+0000","last_clean":"2024-09-22T08:11:23.208957+0000","last_became_active":"2024-09-22T08:10:47.172041+0000","last_became_peered":"2024-09-22T08:10:47.172041+0000","last_unstale":"2024-09-22T08:11:23.208957+0000","last_undegraded":"2024-09-22T08:11:23.208957+0000","last_fullsized":"2024-09-22T08:11:23.208957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:29.368363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'18","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254753+0000","last_change":"2024-09-22T08:10:49.180939+0000","last_active":"2024-09-22T08:13:52.254753+0000","last_peered":"2024-09-22T08:13:52.254753+0000","last_clean":"2024-09-22T08:13:52.254753+0000","last_became_active":"2024-09-22T08:10:49.180563+0000","last_became_peered":"2024-09-22T08:10:49.180563+0000","last_unstale":"2024-09-22T08:13:52.254753+0000","last_undegraded":"2024-09-22T08:13:52.254753+0000","last_fullsized":"2024-09-22T08:13:52.254753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:39.091603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221445+0000","last_change":"2024-09-22T08:10:51.202850+0000","last_active":"2024-09-22T08:11:23.221445+0000","last_peered":"2024-09-22T08:11:23.221445+0000","last_clean":"2024-09-22T08:11:23.221445+0000","last_became_active":"2024-09-22T08:10:51.202422+0000","last_became_peered":"2024-09-22T08:10:51.202422+0000","last_unstale":"2024-09-22T08:11:23.221445+0000","last_undegraded":"2024-09-22T08:11:23.221445+0000","last_fullsized":"2024-09-22T08:11:23.221445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:08.745501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209116+0000","last_change":"2024-09-22T08:10:53.200159+0000","last_active":"2024-09-22T08:11:23.209116+0000","last_peered":"2024-09-22T08:11:23.209116+0000","last_clean":"2024-09-22T08:11:23.209116+0000","last_became_active":"2024-09-22T08:10:53.199894+0000","last_became_peered":"2024-09-22T08:10:53.199894+0000","last_unstale":"2024-09-22T08:11:23.209116+0000","last_undegraded":"2024-09-22T08:11:23.209116+0000","last_fullsized":"2024-09-22T08:11:23.209116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:07.697983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828326+0000","last_change":"2024-09-22T08:10:45.167126+0000","last_active":"2024-09-22T08:12:08.828326+0000","last_peered":"2024-09-22T08:12:08.828326+0000","last_clean":"2024-09-22T08:12:08.828326+0000","last_became_active":"2024-09-22T08:10:45.166816+0000","last_became_peered":"2024-09-22T08:10:45.166816+0000","last_unstale":"2024-09-22T08:12:08.828326+0000","last_undegraded":"2024-09-22T08:12:08.828326+0000","last_fullsized":"2024-09-22T08:12:08.828326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:52.901946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209498+0000","last_change":"2024-09-22T08:10:35.923055+0000","last_active":"2024-09-22T08:11:23.209498+0000","last_peered":"2024-09-22T08:11:23.209498+0000","last_clean":"2024-09-22T08:11:23.209498+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:11:23.209498+0000","last_undegraded":"2024-09-22T08:11:23.209498+0000","last_fullsized":"2024-09-22T08:11:23.209498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:18.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207661+0000","last_change":"2024-09-22T08:10:43.187474+0000","last_active":"2024-09-22T08:11:23.207661+0000","last_peered":"2024-09-22T08:11:23.207661+0000","last_clean":"2024-09-22T08:11:23.207661+0000","last_became_active":"2024-09-22T08:10:43.187103+0000","last_became_peered":"2024-09-22T08:10:43.187103+0000","last_unstale":"2024-09-22T08:11:23.207661+0000","last_undegraded":"2024-09-22T08:11:23.207661+0000","last_fullsized":"2024-09-22T08:11:23.207661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:48.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222126+0000","last_change":"2024-09-22T08:10:47.168792+0000","last_active":"2024-09-22T08:11:23.222126+0000","last_peered":"2024-09-22T08:11:23.222126+0000","last_clean":"2024-09-22T08:11:23.222126+0000","last_became_active":"2024-09-22T08:10:47.168480+0000","last_became_peered":"2024-09-22T08:10:47.168480+0000","last_unstale":"2024-09-22T08:11:23.222126+0000","last_undegraded":"2024-09-22T08:11:23.222126+0000","last_fullsized":"2024-09-22T08:11:23.222126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:19.091966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.586312+0000","last_change":"2024-09-22T08:10:49.185221+0000","last_active":"2024-09-22T08:13:52.586312+0000","last_peered":"2024-09-22T08:13:52.586312+0000","last_clean":"2024-09-22T08:13:52.586312+0000","last_became_active":"2024-09-22T08:10:49.184961+0000","last_became_peered":"2024-09-22T08:10:49.184961+0000","last_unstale":"2024-09-22T08:13:52.586312+0000","last_undegraded":"2024-09-22T08:13:52.586312+0000","last_fullsized":"2024-09-22T08:13:52.586312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:00.221298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213144+0000","last_change":"2024-09-22T08:10:51.195952+0000","last_active":"2024-09-22T08:11:23.213144+0000","last_peered":"2024-09-22T08:11:23.213144+0000","last_clean":"2024-09-22T08:11:23.213144+0000","last_became_active":"2024-09-22T08:10:51.195643+0000","last_became_peered":"2024-09-22T08:10:51.195643+0000","last_unstale":"2024-09-22T08:11:23.213144+0000","last_undegraded":"2024-09-22T08:11:23.213144+0000","last_fullsized":"2024-09-22T08:11:23.213144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:18.035075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.336216+0000","last_change":"2024-09-22T08:10:53.203765+0000","last_active":"2024-09-22T08:12:52.336216+0000","last_peered":"2024-09-22T08:12:52.336216+0000","last_clean":"2024-09-22T08:12:52.336216+0000","last_became_active":"2024-09-22T08:10:53.203330+0000","last_became_peered":"2024-09-22T08:10:53.203330+0000","last_unstale":"2024-09-22T08:12:52.336216+0000","last_undegraded":"2024-09-22T08:12:52.336216+0000","last_fullsized":"2024-09-22T08:12:52.336216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:46.081338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.047853+0000","last_change":"2024-09-22T08:10:45.182440+0000","last_active":"2024-09-22T08:13:53.047853+0000","last_peered":"2024-09-22T08:13:53.047853+0000","last_clean":"2024-09-22T08:13:53.047853+0000","last_became_active":"2024-09-22T08:10:45.182276+0000","last_became_peered":"2024-09-22T08:10:45.182276+0000","last_unstale":"2024-09-22T08:13:53.047853+0000","last_undegraded":"2024-09-22T08:13:53.047853+0000","last_fullsized":"2024-09-22T08:13:53.047853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:53.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.164200+0000","last_change":"2024-09-22T08:10:43.193611+0000","last_active":"2024-09-22T08:13:53.164200+0000","last_peered":"2024-09-22T08:13:53.164200+0000","last_clean":"2024-09-22T08:13:53.164200+0000","last_became_active":"2024-09-22T08:10:43.186175+0000","last_became_peered":"2024-09-22T08:10:43.186175+0000","last_unstale":"2024-09-22T08:13:53.164200+0000","last_undegraded":"2024-09-22T08:13:53.164200+0000","last_fullsized":"2024-09-22T08:13:53.164200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:31.708040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221346+0000","last_change":"2024-09-22T08:10:35.924829+0000","last_active":"2024-09-22T08:11:23.221346+0000","last_peered":"2024-09-22T08:11:23.221346+0000","last_clean":"2024-09-22T08:11:23.221346+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:11:23.221346+0000","last_undegraded":"2024-09-22T08:11:23.221346+0000","last_fullsized":"2024-09-22T08:11:23.221346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:15.126946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.583815+0000","last_change":"2024-09-22T08:10:47.167981+0000","last_active":"2024-09-22T08:12:51.583815+0000","last_peered":"2024-09-22T08:12:51.583815+0000","last_clean":"2024-09-22T08:12:51.583815+0000","last_became_active":"2024-09-22T08:10:47.167620+0000","last_became_peered":"2024-09-22T08:10:47.167620+0000","last_unstale":"2024-09-22T08:12:51.583815+0000","last_undegraded":"2024-09-22T08:12:51.583815+0000","last_fullsized":"2024-09-22T08:12:51.583815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:35.145384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'63","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.265186+0000","last_change":"2024-09-22T08:10:49.185023+0000","last_active":"2024-09-22T08:13:53.265186+0000","last_peered":"2024-09-22T08:13:53.265186+0000","last_clean":"2024-09-22T08:13:53.265186+0000","last_became_active":"2024-09-22T08:10:49.184753+0000","last_became_peered":"2024-09-22T08:10:49.184753+0000","last_unstale":"2024-09-22T08:13:53.265186+0000","last_undegraded":"2024-09-22T08:13:53.265186+0000","last_fullsized":"2024-09-22T08:13:53.265186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:46.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":61,"num_read_kb":49,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206763+0000","last_change":"2024-09-22T08:10:51.197026+0000","last_active":"2024-09-22T08:11:23.206763+0000","last_peered":"2024-09-22T08:11:23.206763+0000","last_clean":"2024-09-22T08:11:23.206763+0000","last_became_active":"2024-09-22T08:10:51.196724+0000","last_became_peered":"2024-09-22T08:10:51.196724+0000","last_unstale":"2024-09-22T08:11:23.206763+0000","last_undegraded":"2024-09-22T08:11:23.206763+0000","last_fullsized":"2024-09-22T08:11:23.206763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:06.499640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.230225+0000","last_change":"2024-09-22T08:10:53.196686+0000","last_active":"2024-09-22T08:13:53.230225+0000","last_peered":"2024-09-22T08:13:53.230225+0000","last_clean":"2024-09-22T08:13:53.230225+0000","last_became_active":"2024-09-22T08:10:53.196406+0000","last_became_peered":"2024-09-22T08:10:53.196406+0000","last_unstale":"2024-09-22T08:13:53.230225+0000","last_undegraded":"2024-09-22T08:13:53.230225+0000","last_fullsized":"2024-09-22T08:13:53.230225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:42.892968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254919+0000","last_change":"2024-09-22T08:10:45.176907+0000","last_active":"2024-09-22T08:13:53.254919+0000","last_peered":"2024-09-22T08:13:53.254919+0000","last_clean":"2024-09-22T08:13:53.254919+0000","last_became_active":"2024-09-22T08:10:45.176601+0000","last_became_peered":"2024-09-22T08:10:45.176601+0000","last_unstale":"2024-09-22T08:13:53.254919+0000","last_undegraded":"2024-09-22T08:13:53.254919+0000","last_fullsized":"2024-09-22T08:13:53.254919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:23:25.305179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.170482+0000","last_change":"2024-09-22T08:10:43.187808+0000","last_active":"2024-09-22T08:13:53.170482+0000","last_peered":"2024-09-22T08:13:53.170482+0000","last_clean":"2024-09-22T08:13:53.170482+0000","last_became_active":"2024-09-22T08:10:43.186758+0000","last_became_peered":"2024-09-22T08:10:43.186758+0000","last_unstale":"2024-09-22T08:13:53.170482+0000","last_undegraded":"2024-09-22T08:13:53.170482+0000","last_fullsized":"2024-09-22T08:13:53.170482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:23.595549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211013+0000","last_change":"2024-09-22T08:10:35.922434+0000","last_active":"2024-09-22T08:11:23.211013+0000","last_peered":"2024-09-22T08:11:23.211013+0000","last_clean":"2024-09-22T08:11:23.211013+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:11:23.211013+0000","last_undegraded":"2024-09-22T08:11:23.211013+0000","last_fullsized":"2024-09-22T08:11:23.211013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:36.971498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209307+0000","last_change":"2024-09-22T08:10:47.173748+0000","last_active":"2024-09-22T08:11:23.209307+0000","last_peered":"2024-09-22T08:11:23.209307+0000","last_clean":"2024-09-22T08:11:23.209307+0000","last_became_active":"2024-09-22T08:10:47.173348+0000","last_became_peered":"2024-09-22T08:10:47.173348+0000","last_unstale":"2024-09-22T08:11:23.209307+0000","last_undegraded":"2024-09-22T08:11:23.209307+0000","last_fullsized":"2024-09-22T08:11:23.209307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:18:06.081248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212964+0000","last_change":"2024-09-22T08:10:49.187453+0000","last_active":"2024-09-22T08:11:23.212964+0000","last_peered":"2024-09-22T08:11:23.212964+0000","last_clean":"2024-09-22T08:11:23.212964+0000","last_became_active":"2024-09-22T08:10:49.187184+0000","last_became_peered":"2024-09-22T08:10:49.187184+0000","last_unstale":"2024-09-22T08:11:23.212964+0000","last_undegraded":"2024-09-22T08:11:23.212964+0000","last_fullsized":"2024-09-22T08:11:23.212964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:19:08.593807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":370,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254387+0000","last_change":"2024-09-22T08:10:51.197450+0000","last_active":"2024-09-22T08:13:52.254387+0000","last_peered":"2024-09-22T08:13:52.254387+0000","last_clean":"2024-09-22T08:13:52.254387+0000","last_became_active":"2024-09-22T08:10:51.197111+0000","last_became_peered":"2024-09-22T08:10:51.197111+0000","last_unstale":"2024-09-22T08:13:52.254387+0000","last_undegraded":"2024-09-22T08:13:52.254387+0000","last_fullsized":"2024-09-22T08:13:52.254387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212274+0000","last_change":"2024-09-22T08:10:53.200428+0000","last_active":"2024-09-22T08:11:23.212274+0000","last_peered":"2024-09-22T08:11:23.212274+0000","last_clean":"2024-09-22T08:11:23.212274+0000","last_became_active":"2024-09-22T08:10:53.199612+0000","last_became_peered":"2024-09-22T08:10:53.199612+0000","last_unstale":"2024-09-22T08:11:23.212274+0000","last_undegraded":"2024-09-22T08:11:23.212274+0000","last_fullsized":"2024-09-22T08:11:23.212274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:47.560464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.007599+0000","last_change":"2024-09-22T08:10:45.183951+0000","last_active":"2024-09-22T08:11:26.007599+0000","last_peered":"2024-09-22T08:11:26.007599+0000","last_clean":"2024-09-22T08:11:26.007599+0000","last_became_active":"2024-09-22T08:10:45.183229+0000","last_became_peered":"2024-09-22T08:10:45.183229+0000","last_unstale":"2024-09-22T08:11:26.007599+0000","last_undegraded":"2024-09-22T08:11:26.007599+0000","last_fullsized":"2024-09-22T08:11:26.007599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:03.361288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214275+0000","last_change":"2024-09-22T08:10:43.199726+0000","last_active":"2024-09-22T08:11:23.214275+0000","last_peered":"2024-09-22T08:11:23.214275+0000","last_clean":"2024-09-22T08:11:23.214275+0000","last_became_active":"2024-09-22T08:10:43.198637+0000","last_became_peered":"2024-09-22T08:10:43.198637+0000","last_unstale":"2024-09-22T08:11:23.214275+0000","last_undegraded":"2024-09-22T08:11:23.214275+0000","last_fullsized":"2024-09-22T08:11:23.214275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.086176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222838+0000","last_change":"2024-09-22T08:10:35.924894+0000","last_active":"2024-09-22T08:11:23.222838+0000","last_peered":"2024-09-22T08:11:23.222838+0000","last_clean":"2024-09-22T08:11:23.222838+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:11:23.222838+0000","last_undegraded":"2024-09-22T08:11:23.222838+0000","last_fullsized":"2024-09-22T08:11:23.222838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:31.373918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221460+0000","last_change":"2024-09-22T08:11:23.216945+0000","last_active":"2024-09-22T08:11:23.221460+0000","last_peered":"2024-09-22T08:11:23.221460+0000","last_clean":"2024-09-22T08:11:23.221460+0000","last_became_active":"2024-09-22T08:11:23.216676+0000","last_became_peered":"2024-09-22T08:11:23.216676+0000","last_unstale":"2024-09-22T08:11:23.221460+0000","last_undegraded":"2024-09-22T08:11:23.221460+0000","last_fullsized":"2024-09-22T08:11:23.221460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:46.451332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213139+0000","last_change":"2024-09-22T08:10:49.188685+0000","last_active":"2024-09-22T08:11:23.213139+0000","last_peered":"2024-09-22T08:11:23.213139+0000","last_clean":"2024-09-22T08:11:23.213139+0000","last_became_active":"2024-09-22T08:10:49.188309+0000","last_became_peered":"2024-09-22T08:10:49.188309+0000","last_unstale":"2024-09-22T08:11:23.213139+0000","last_undegraded":"2024-09-22T08:11:23.213139+0000","last_fullsized":"2024-09-22T08:11:23.213139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.497319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":400,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.362561+0000","last_change":"2024-09-22T08:10:51.193163+0000","last_active":"2024-09-22T08:13:53.362561+0000","last_peered":"2024-09-22T08:13:53.362561+0000","last_clean":"2024-09-22T08:13:53.362561+0000","last_became_active":"2024-09-22T08:10:51.192058+0000","last_became_peered":"2024-09-22T08:10:51.192058+0000","last_unstale":"2024-09-22T08:13:53.362561+0000","last_undegraded":"2024-09-22T08:13:53.362561+0000","last_fullsized":"2024-09-22T08:13:53.362561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213624+0000","last_change":"2024-09-22T08:10:53.203958+0000","last_active":"2024-09-22T08:11:23.213624+0000","last_peered":"2024-09-22T08:11:23.213624+0000","last_clean":"2024-09-22T08:11:23.213624+0000","last_became_active":"2024-09-22T08:10:53.203670+0000","last_became_peered":"2024-09-22T08:10:53.203670+0000","last_unstale":"2024-09-22T08:11:23.213624+0000","last_undegraded":"2024-09-22T08:11:23.213624+0000","last_fullsized":"2024-09-22T08:11:23.213624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:04.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'17","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.190706+0000","last_change":"2024-09-22T08:10:45.172007+0000","last_active":"2024-09-22T08:13:53.190706+0000","last_peered":"2024-09-22T08:13:53.190706+0000","last_clean":"2024-09-22T08:13:53.190706+0000","last_became_active":"2024-09-22T08:10:45.171667+0000","last_became_peered":"2024-09-22T08:10:45.171667+0000","last_unstale":"2024-09-22T08:13:53.190706+0000","last_undegraded":"2024-09-22T08:13:53.190706+0000","last_fullsized":"2024-09-22T08:13:53.190706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:31.764706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562709+0000","last_change":"2024-09-22T08:10:43.182563+0000","last_active":"2024-09-22T08:11:25.562709+0000","last_peered":"2024-09-22T08:11:25.562709+0000","last_clean":"2024-09-22T08:11:25.562709+0000","last_became_active":"2024-09-22T08:10:43.182161+0000","last_became_peered":"2024-09-22T08:10:43.182161+0000","last_unstale":"2024-09-22T08:11:25.562709+0000","last_undegraded":"2024-09-22T08:11:25.562709+0000","last_fullsized":"2024-09-22T08:11:25.562709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:48.821851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213965+0000","last_change":"2024-09-22T08:10:35.923155+0000","last_active":"2024-09-22T08:11:23.213965+0000","last_peered":"2024-09-22T08:11:23.213965+0000","last_clean":"2024-09-22T08:11:23.213965+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:11:23.213965+0000","last_undegraded":"2024-09-22T08:11:23.213965+0000","last_fullsized":"2024-09-22T08:11:23.213965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:11:54.812723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209442+0000","last_change":"2024-09-22T08:10:47.174132+0000","last_active":"2024-09-22T08:11:23.209442+0000","last_peered":"2024-09-22T08:11:23.209442+0000","last_clean":"2024-09-22T08:11:23.209442+0000","last_became_active":"2024-09-22T08:10:47.172441+0000","last_became_peered":"2024-09-22T08:10:47.172441+0000","last_unstale":"2024-09-22T08:11:23.209442+0000","last_undegraded":"2024-09-22T08:11:23.209442+0000","last_fullsized":"2024-09-22T08:11:23.209442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:47.078285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":155,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.140573+0000","last_change":"2024-09-22T08:10:49.185244+0000","last_active":"2024-09-22T08:12:51.140573+0000","last_peered":"2024-09-22T08:12:51.140573+0000","last_clean":"2024-09-22T08:12:51.140573+0000","last_became_active":"2024-09-22T08:10:49.184942+0000","last_became_peered":"2024-09-22T08:10:49.184942+0000","last_unstale":"2024-09-22T08:12:51.140573+0000","last_undegraded":"2024-09-22T08:12:51.140573+0000","last_fullsized":"2024-09-22T08:12:51.140573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:53.328309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220410+0000","last_change":"2024-09-22T08:10:51.195295+0000","last_active":"2024-09-22T08:11:23.220410+0000","last_peered":"2024-09-22T08:11:23.220410+0000","last_clean":"2024-09-22T08:11:23.220410+0000","last_became_active":"2024-09-22T08:10:51.194912+0000","last_became_peered":"2024-09-22T08:10:51.194912+0000","last_unstale":"2024-09-22T08:11:23.220410+0000","last_undegraded":"2024-09-22T08:11:23.220410+0000","last_fullsized":"2024-09-22T08:11:23.220410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:22.604330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208925+0000","last_change":"2024-09-22T08:10:53.192489+0000","last_active":"2024-09-22T08:11:23.208925+0000","last_peered":"2024-09-22T08:11:23.208925+0000","last_clean":"2024-09-22T08:11:23.208925+0000","last_became_active":"2024-09-22T08:10:53.192189+0000","last_became_peered":"2024-09-22T08:10:53.192189+0000","last_unstale":"2024-09-22T08:11:23.208925+0000","last_undegraded":"2024-09-22T08:11:23.208925+0000","last_fullsized":"2024-09-22T08:11:23.208925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:14.737752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208582+0000","last_change":"2024-09-22T08:10:53.198120+0000","last_active":"2024-09-22T08:11:23.208582+0000","last_peered":"2024-09-22T08:11:23.208582+0000","last_clean":"2024-09-22T08:11:23.208582+0000","last_became_active":"2024-09-22T08:10:53.197799+0000","last_became_peered":"2024-09-22T08:10:53.197799+0000","last_unstale":"2024-09-22T08:11:23.208582+0000","last_undegraded":"2024-09-22T08:11:23.208582+0000","last_fullsized":"2024-09-22T08:11:23.208582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:55.526373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.047862+0000","last_change":"2024-09-22T08:10:45.174189+0000","last_active":"2024-09-22T08:13:53.047862+0000","last_peered":"2024-09-22T08:13:53.047862+0000","last_clean":"2024-09-22T08:13:53.047862+0000","last_became_active":"2024-09-22T08:10:45.173916+0000","last_became_peered":"2024-09-22T08:10:45.173916+0000","last_unstale":"2024-09-22T08:13:53.047862+0000","last_undegraded":"2024-09-22T08:13:53.047862+0000","last_fullsized":"2024-09-22T08:13:53.047862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:27.673736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.422254+0000","last_change":"2024-09-22T08:10:43.201372+0000","last_active":"2024-09-22T08:12:52.422254+0000","last_peered":"2024-09-22T08:12:52.422254+0000","last_clean":"2024-09-22T08:12:52.422254+0000","last_became_active":"2024-09-22T08:10:43.201007+0000","last_became_peered":"2024-09-22T08:10:43.201007+0000","last_unstale":"2024-09-22T08:12:52.422254+0000","last_undegraded":"2024-09-22T08:12:52.422254+0000","last_fullsized":"2024-09-22T08:12:52.422254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:49.200344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212648+0000","last_change":"2024-09-22T08:10:47.176086+0000","last_active":"2024-09-22T08:11:23.212648+0000","last_peered":"2024-09-22T08:11:23.212648+0000","last_clean":"2024-09-22T08:11:23.212648+0000","last_became_active":"2024-09-22T08:10:47.175524+0000","last_became_peered":"2024-09-22T08:10:47.175524+0000","last_unstale":"2024-09-22T08:11:23.212648+0000","last_undegraded":"2024-09-22T08:11:23.212648+0000","last_fullsized":"2024-09-22T08:11:23.212648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:13.592432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.146947+0000","last_change":"2024-09-22T08:10:49.186252+0000","last_active":"2024-09-22T08:12:51.146947+0000","last_peered":"2024-09-22T08:12:51.146947+0000","last_clean":"2024-09-22T08:12:51.146947+0000","last_became_active":"2024-09-22T08:10:49.185693+0000","last_became_peered":"2024-09-22T08:10:49.185693+0000","last_unstale":"2024-09-22T08:12:51.146947+0000","last_undegraded":"2024-09-22T08:12:51.146947+0000","last_fullsized":"2024-09-22T08:12:51.146947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:02.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213000+0000","last_change":"2024-09-22T08:10:51.200112+0000","last_active":"2024-09-22T08:11:23.213000+0000","last_peered":"2024-09-22T08:11:23.213000+0000","last_clean":"2024-09-22T08:11:23.213000+0000","last_became_active":"2024-09-22T08:10:51.199799+0000","last_became_peered":"2024-09-22T08:10:51.199799+0000","last_unstale":"2024-09-22T08:11:23.213000+0000","last_undegraded":"2024-09-22T08:11:23.213000+0000","last_fullsized":"2024-09-22T08:11:23.213000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:06.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'13","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.308456+0000","last_change":"2024-09-22T08:10:53.201508+0000","last_active":"2024-09-22T08:13:53.308456+0000","last_peered":"2024-09-22T08:13:53.308456+0000","last_clean":"2024-09-22T08:13:53.308456+0000","last_became_active":"2024-09-22T08:10:53.201209+0000","last_became_peered":"2024-09-22T08:10:53.201209+0000","last_unstale":"2024-09-22T08:13:53.308456+0000","last_undegraded":"2024-09-22T08:13:53.308456+0000","last_fullsized":"2024-09-22T08:13:53.308456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:20.642196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":69,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183415+0000","last_change":"2024-09-22T08:10:45.182432+0000","last_active":"2024-09-22T08:13:53.183415+0000","last_peered":"2024-09-22T08:13:53.183415+0000","last_clean":"2024-09-22T08:13:53.183415+0000","last_became_active":"2024-09-22T08:10:45.182245+0000","last_became_peered":"2024-09-22T08:10:45.182245+0000","last_unstale":"2024-09-22T08:13:53.183415+0000","last_undegraded":"2024-09-22T08:13:53.183415+0000","last_fullsized":"2024-09-22T08:13:53.183415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:33.105535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:07.586758+0000","last_change":"2024-09-22T08:10:43.193144+0000","last_active":"2024-09-22T08:13:07.586758+0000","last_peered":"2024-09-22T08:13:07.586758+0000","last_clean":"2024-09-22T08:13:07.586758+0000","last_became_active":"2024-09-22T08:10:43.185230+0000","last_became_peered":"2024-09-22T08:10:43.185230+0000","last_unstale":"2024-09-22T08:13:07.586758+0000","last_undegraded":"2024-09-22T08:13:07.586758+0000","last_fullsized":"2024-09-22T08:13:07.586758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:51.284672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209614+0000","last_change":"2024-09-22T08:10:47.176256+0000","last_active":"2024-09-22T08:11:23.209614+0000","last_peered":"2024-09-22T08:11:23.209614+0000","last_clean":"2024-09-22T08:11:23.209614+0000","last_became_active":"2024-09-22T08:10:47.175747+0000","last_became_peered":"2024-09-22T08:10:47.175747+0000","last_unstale":"2024-09-22T08:11:23.209614+0000","last_undegraded":"2024-09-22T08:11:23.209614+0000","last_fullsized":"2024-09-22T08:11:23.209614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:17.217421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.591034+0000","last_change":"2024-09-22T08:10:49.181276+0000","last_active":"2024-09-22T08:13:52.591034+0000","last_peered":"2024-09-22T08:13:52.591034+0000","last_clean":"2024-09-22T08:13:52.591034+0000","last_became_active":"2024-09-22T08:10:49.180921+0000","last_became_peered":"2024-09-22T08:10:49.180921+0000","last_unstale":"2024-09-22T08:13:52.591034+0000","last_undegraded":"2024-09-22T08:13:52.591034+0000","last_fullsized":"2024-09-22T08:13:52.591034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:10.724160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207132+0000","last_change":"2024-09-22T08:10:51.193254+0000","last_active":"2024-09-22T08:11:23.207132+0000","last_peered":"2024-09-22T08:11:23.207132+0000","last_clean":"2024-09-22T08:11:23.207132+0000","last_became_active":"2024-09-22T08:10:51.192989+0000","last_became_peered":"2024-09-22T08:10:51.192989+0000","last_unstale":"2024-09-22T08:11:23.207132+0000","last_undegraded":"2024-09-22T08:11:23.207132+0000","last_fullsized":"2024-09-22T08:11:23.207132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:29.015464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.008653+0000","last_change":"2024-09-22T08:10:53.193317+0000","last_active":"2024-09-22T08:12:09.008653+0000","last_peered":"2024-09-22T08:12:09.008653+0000","last_clean":"2024-09-22T08:12:09.008653+0000","last_became_active":"2024-09-22T08:10:53.192967+0000","last_became_peered":"2024-09-22T08:10:53.192967+0000","last_unstale":"2024-09-22T08:12:09.008653+0000","last_undegraded":"2024-09-22T08:12:09.008653+0000","last_fullsized":"2024-09-22T08:12:09.008653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:48.815518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.468115+0000","last_change":"2024-09-22T08:10:45.172599+0000","last_active":"2024-09-22T08:12:49.468115+0000","last_peered":"2024-09-22T08:12:49.468115+0000","last_clean":"2024-09-22T08:12:49.468115+0000","last_became_active":"2024-09-22T08:10:45.171555+0000","last_became_peered":"2024-09-22T08:10:45.171555+0000","last_unstale":"2024-09-22T08:12:49.468115+0000","last_undegraded":"2024-09-22T08:12:49.468115+0000","last_fullsized":"2024-09-22T08:12:49.468115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:27.811575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211087+0000","last_change":"2024-09-22T08:10:43.192664+0000","last_active":"2024-09-22T08:11:23.211087+0000","last_peered":"2024-09-22T08:11:23.211087+0000","last_clean":"2024-09-22T08:11:23.211087+0000","last_became_active":"2024-09-22T08:10:43.187044+0000","last_became_peered":"2024-09-22T08:10:43.187044+0000","last_unstale":"2024-09-22T08:11:23.211087+0000","last_undegraded":"2024-09-22T08:11:23.211087+0000","last_fullsized":"2024-09-22T08:11:23.211087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:51.698704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.214782+0000","last_change":"2024-09-22T08:10:47.178036+0000","last_active":"2024-09-22T08:12:52.214782+0000","last_peered":"2024-09-22T08:12:52.214782+0000","last_clean":"2024-09-22T08:12:52.214782+0000","last_became_active":"2024-09-22T08:10:47.177735+0000","last_became_peered":"2024-09-22T08:10:47.177735+0000","last_unstale":"2024-09-22T08:12:52.214782+0000","last_undegraded":"2024-09-22T08:12:52.214782+0000","last_fullsized":"2024-09-22T08:12:52.214782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:05.249659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.646582+0000","last_change":"2024-09-22T08:10:49.182878+0000","last_active":"2024-09-22T08:13:52.646582+0000","last_peered":"2024-09-22T08:13:52.646582+0000","last_clean":"2024-09-22T08:13:52.646582+0000","last_became_active":"2024-09-22T08:10:49.182557+0000","last_became_peered":"2024-09-22T08:10:49.182557+0000","last_unstale":"2024-09-22T08:13:52.646582+0000","last_undegraded":"2024-09-22T08:13:52.646582+0000","last_fullsized":"2024-09-22T08:13:52.646582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:37.230381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212363+0000","last_change":"2024-09-22T08:10:51.198536+0000","last_active":"2024-09-22T08:11:23.212363+0000","last_peered":"2024-09-22T08:11:23.212363+0000","last_clean":"2024-09-22T08:11:23.212363+0000","last_became_active":"2024-09-22T08:10:51.198204+0000","last_became_peered":"2024-09-22T08:10:51.198204+0000","last_unstale":"2024-09-22T08:11:23.212363+0000","last_undegraded":"2024-09-22T08:11:23.212363+0000","last_fullsized":"2024-09-22T08:11:23.212363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.041147+0000","last_change":"2024-09-22T08:10:53.200288+0000","last_active":"2024-09-22T08:11:27.041147+0000","last_peered":"2024-09-22T08:11:27.041147+0000","last_clean":"2024-09-22T08:11:27.041147+0000","last_became_active":"2024-09-22T08:10:53.199827+0000","last_became_peered":"2024-09-22T08:10:53.199827+0000","last_unstale":"2024-09-22T08:11:27.041147+0000","last_undegraded":"2024-09-22T08:11:27.041147+0000","last_fullsized":"2024-09-22T08:11:27.041147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:31.568753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209916+0000","last_change":"2024-09-22T08:10:45.184232+0000","last_active":"2024-09-22T08:11:23.209916+0000","last_peered":"2024-09-22T08:11:23.209916+0000","last_clean":"2024-09-22T08:11:23.209916+0000","last_became_active":"2024-09-22T08:10:45.183674+0000","last_became_peered":"2024-09-22T08:10:45.183674+0000","last_unstale":"2024-09-22T08:11:23.209916+0000","last_undegraded":"2024-09-22T08:11:23.209916+0000","last_fullsized":"2024-09-22T08:11:23.209916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:11.585440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216574+0000","last_change":"2024-09-22T08:10:43.185629+0000","last_active":"2024-09-22T08:11:23.216574+0000","last_peered":"2024-09-22T08:11:23.216574+0000","last_clean":"2024-09-22T08:11:23.216574+0000","last_became_active":"2024-09-22T08:10:43.184287+0000","last_became_peered":"2024-09-22T08:10:43.184287+0000","last_unstale":"2024-09-22T08:11:23.216574+0000","last_undegraded":"2024-09-22T08:11:23.216574+0000","last_fullsized":"2024-09-22T08:11:23.216574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:47.867688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209665+0000","last_change":"2024-09-22T08:10:47.173065+0000","last_active":"2024-09-22T08:11:23.209665+0000","last_peered":"2024-09-22T08:11:23.209665+0000","last_clean":"2024-09-22T08:11:23.209665+0000","last_became_active":"2024-09-22T08:10:47.172816+0000","last_became_peered":"2024-09-22T08:10:47.172816+0000","last_unstale":"2024-09-22T08:11:23.209665+0000","last_undegraded":"2024-09-22T08:11:23.209665+0000","last_fullsized":"2024-09-22T08:11:23.209665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:42.365873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.131969+0000","last_change":"2024-09-22T08:10:49.180939+0000","last_active":"2024-09-22T08:12:51.131969+0000","last_peered":"2024-09-22T08:12:51.131969+0000","last_clean":"2024-09-22T08:12:51.131969+0000","last_became_active":"2024-09-22T08:10:49.180621+0000","last_became_peered":"2024-09-22T08:10:49.180621+0000","last_unstale":"2024-09-22T08:12:51.131969+0000","last_undegraded":"2024-09-22T08:12:51.131969+0000","last_fullsized":"2024-09-22T08:12:51.131969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:10.845059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206973+0000","last_change":"2024-09-22T08:10:51.190255+0000","last_active":"2024-09-22T08:11:23.206973+0000","last_peered":"2024-09-22T08:11:23.206973+0000","last_clean":"2024-09-22T08:11:23.206973+0000","last_became_active":"2024-09-22T08:10:51.189640+0000","last_became_peered":"2024-09-22T08:10:51.189640+0000","last_unstale":"2024-09-22T08:11:23.206973+0000","last_undegraded":"2024-09-22T08:11:23.206973+0000","last_fullsized":"2024-09-22T08:11:23.206973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:01.319577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228734+0000","last_change":"2024-09-22T08:10:45.166911+0000","last_active":"2024-09-22T08:13:53.228734+0000","last_peered":"2024-09-22T08:13:53.228734+0000","last_clean":"2024-09-22T08:13:53.228734+0000","last_became_active":"2024-09-22T08:10:45.166591+0000","last_became_peered":"2024-09-22T08:10:45.166591+0000","last_unstale":"2024-09-22T08:13:53.228734+0000","last_undegraded":"2024-09-22T08:13:53.228734+0000","last_fullsized":"2024-09-22T08:13:53.228734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:01.404622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209800+0000","last_change":"2024-09-22T08:10:43.196054+0000","last_active":"2024-09-22T08:11:23.209800+0000","last_peered":"2024-09-22T08:11:23.209800+0000","last_clean":"2024-09-22T08:11:23.209800+0000","last_became_active":"2024-09-22T08:10:43.195608+0000","last_became_peered":"2024-09-22T08:10:43.195608+0000","last_unstale":"2024-09-22T08:11:23.209800+0000","last_undegraded":"2024-09-22T08:11:23.209800+0000","last_fullsized":"2024-09-22T08:11:23.209800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:24.463602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222765+0000","last_change":"2024-09-22T08:10:47.173698+0000","last_active":"2024-09-22T08:11:23.222765+0000","last_peered":"2024-09-22T08:11:23.222765+0000","last_clean":"2024-09-22T08:11:23.222765+0000","last_became_active":"2024-09-22T08:10:47.173043+0000","last_became_peered":"2024-09-22T08:10:47.173043+0000","last_unstale":"2024-09-22T08:11:23.222765+0000","last_undegraded":"2024-09-22T08:11:23.222765+0000","last_fullsized":"2024-09-22T08:11:23.222765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:50.368872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.577548+0000","last_change":"2024-09-22T08:10:49.181954+0000","last_active":"2024-09-22T08:12:52.577548+0000","last_peered":"2024-09-22T08:12:52.577548+0000","last_clean":"2024-09-22T08:12:52.577548+0000","last_became_active":"2024-09-22T08:10:49.181611+0000","last_became_peered":"2024-09-22T08:10:49.181611+0000","last_unstale":"2024-09-22T08:12:52.577548+0000","last_undegraded":"2024-09-22T08:12:52.577548+0000","last_fullsized":"2024-09-22T08:12:52.577548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:12.944824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207395+0000","last_change":"2024-09-22T08:10:51.190156+0000","last_active":"2024-09-22T08:11:23.207395+0000","last_peered":"2024-09-22T08:11:23.207395+0000","last_clean":"2024-09-22T08:11:23.207395+0000","last_became_active":"2024-09-22T08:10:51.189592+0000","last_became_peered":"2024-09-22T08:10:51.189592+0000","last_unstale":"2024-09-22T08:11:23.207395+0000","last_undegraded":"2024-09-22T08:11:23.207395+0000","last_fullsized":"2024-09-22T08:11:23.207395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:44.042635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.513524+0000","last_change":"2024-09-22T08:10:53.199349+0000","last_active":"2024-09-22T08:12:52.513524+0000","last_peered":"2024-09-22T08:12:52.513524+0000","last_clean":"2024-09-22T08:12:52.513524+0000","last_became_active":"2024-09-22T08:10:53.198999+0000","last_became_peered":"2024-09-22T08:10:53.198999+0000","last_unstale":"2024-09-22T08:12:52.513524+0000","last_undegraded":"2024-09-22T08:12:52.513524+0000","last_fullsized":"2024-09-22T08:12:52.513524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:40.998103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'22","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183552+0000","last_change":"2024-09-22T08:10:45.183697+0000","last_active":"2024-09-22T08:13:53.183552+0000","last_peered":"2024-09-22T08:13:53.183552+0000","last_clean":"2024-09-22T08:13:53.183552+0000","last_became_active":"2024-09-22T08:10:45.183173+0000","last_became_peered":"2024-09-22T08:10:45.183173+0000","last_unstale":"2024-09-22T08:13:53.183552+0000","last_undegraded":"2024-09-22T08:13:53.183552+0000","last_fullsized":"2024-09-22T08:13:53.183552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:20.651086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.564042+0000","last_change":"2024-09-22T08:10:43.178081+0000","last_active":"2024-09-22T08:11:26.564042+0000","last_peered":"2024-09-22T08:11:26.564042+0000","last_clean":"2024-09-22T08:11:26.564042+0000","last_became_active":"2024-09-22T08:10:43.177711+0000","last_became_peered":"2024-09-22T08:10:43.177711+0000","last_unstale":"2024-09-22T08:11:26.564042+0000","last_undegraded":"2024-09-22T08:11:26.564042+0000","last_fullsized":"2024-09-22T08:11:26.564042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:58.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210165+0000","last_change":"2024-09-22T08:10:47.172301+0000","last_active":"2024-09-22T08:11:23.210165+0000","last_peered":"2024-09-22T08:11:23.210165+0000","last_clean":"2024-09-22T08:11:23.210165+0000","last_became_active":"2024-09-22T08:10:47.171702+0000","last_became_peered":"2024-09-22T08:10:47.171702+0000","last_unstale":"2024-09-22T08:11:23.210165+0000","last_undegraded":"2024-09-22T08:11:23.210165+0000","last_fullsized":"2024-09-22T08:11:23.210165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.251018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.132994+0000","last_change":"2024-09-22T08:10:49.183268+0000","last_active":"2024-09-22T08:12:51.132994+0000","last_peered":"2024-09-22T08:12:51.132994+0000","last_clean":"2024-09-22T08:12:51.132994+0000","last_became_active":"2024-09-22T08:10:49.182398+0000","last_became_peered":"2024-09-22T08:10:49.182398+0000","last_unstale":"2024-09-22T08:12:51.132994+0000","last_undegraded":"2024-09-22T08:12:51.132994+0000","last_fullsized":"2024-09-22T08:12:51.132994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:20.960730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214581+0000","last_change":"2024-09-22T08:10:51.202949+0000","last_active":"2024-09-22T08:11:23.214581+0000","last_peered":"2024-09-22T08:11:23.214581+0000","last_clean":"2024-09-22T08:11:23.214581+0000","last_became_active":"2024-09-22T08:10:51.202485+0000","last_became_peered":"2024-09-22T08:10:51.202485+0000","last_unstale":"2024-09-22T08:11:23.214581+0000","last_undegraded":"2024-09-22T08:11:23.214581+0000","last_fullsized":"2024-09-22T08:11:23.214581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.969767+0000","last_change":"2024-09-22T08:10:53.202374+0000","last_active":"2024-09-22T08:13:52.969767+0000","last_peered":"2024-09-22T08:13:52.969767+0000","last_clean":"2024-09-22T08:13:52.969767+0000","last_became_active":"2024-09-22T08:10:53.201942+0000","last_became_peered":"2024-09-22T08:10:53.201942+0000","last_unstale":"2024-09-22T08:13:52.969767+0000","last_undegraded":"2024-09-22T08:13:52.969767+0000","last_fullsized":"2024-09-22T08:13:52.969767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:00.185249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.345446+0000","last_change":"2024-09-22T08:10:45.183871+0000","last_active":"2024-09-22T08:11:26.345446+0000","last_peered":"2024-09-22T08:11:26.345446+0000","last_clean":"2024-09-22T08:11:26.345446+0000","last_became_active":"2024-09-22T08:10:45.183576+0000","last_became_peered":"2024-09-22T08:10:45.183576+0000","last_unstale":"2024-09-22T08:11:26.345446+0000","last_undegraded":"2024-09-22T08:11:26.345446+0000","last_fullsized":"2024-09-22T08:11:26.345446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:50.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212748+0000","last_change":"2024-09-22T08:10:43.179376+0000","last_active":"2024-09-22T08:11:23.212748+0000","last_peered":"2024-09-22T08:11:23.212748+0000","last_clean":"2024-09-22T08:11:23.212748+0000","last_became_active":"2024-09-22T08:10:43.178403+0000","last_became_peered":"2024-09-22T08:10:43.178403+0000","last_unstale":"2024-09-22T08:11:23.212748+0000","last_undegraded":"2024-09-22T08:11:23.212748+0000","last_fullsized":"2024-09-22T08:11:23.212748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:56.538345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208266+0000","last_change":"2024-09-22T08:10:47.172371+0000","last_active":"2024-09-22T08:11:23.208266+0000","last_peered":"2024-09-22T08:11:23.208266+0000","last_clean":"2024-09-22T08:11:23.208266+0000","last_became_active":"2024-09-22T08:10:47.171973+0000","last_became_peered":"2024-09-22T08:10:47.171973+0000","last_unstale":"2024-09-22T08:11:23.208266+0000","last_undegraded":"2024-09-22T08:11:23.208266+0000","last_fullsized":"2024-09-22T08:11:23.208266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:41.035575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:56.584606+0000","last_change":"2024-09-22T08:10:49.185261+0000","last_active":"2024-09-22T08:12:56.584606+0000","last_peered":"2024-09-22T08:12:56.584606+0000","last_clean":"2024-09-22T08:12:56.584606+0000","last_became_active":"2024-09-22T08:10:49.184885+0000","last_became_peered":"2024-09-22T08:10:49.184885+0000","last_unstale":"2024-09-22T08:12:56.584606+0000","last_undegraded":"2024-09-22T08:12:56.584606+0000","last_fullsized":"2024-09-22T08:12:56.584606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:29.150336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222373+0000","last_change":"2024-09-22T08:10:51.194317+0000","last_active":"2024-09-22T08:11:23.222373+0000","last_peered":"2024-09-22T08:11:23.222373+0000","last_clean":"2024-09-22T08:11:23.222373+0000","last_became_active":"2024-09-22T08:10:51.193970+0000","last_became_peered":"2024-09-22T08:10:51.193970+0000","last_unstale":"2024-09-22T08:11:23.222373+0000","last_undegraded":"2024-09-22T08:11:23.222373+0000","last_fullsized":"2024-09-22T08:11:23.222373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:52.931798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.572122+0000","last_change":"2024-09-22T08:10:53.202778+0000","last_active":"2024-09-22T08:12:52.572122+0000","last_peered":"2024-09-22T08:12:52.572122+0000","last_clean":"2024-09-22T08:12:52.572122+0000","last_became_active":"2024-09-22T08:10:53.202493+0000","last_became_peered":"2024-09-22T08:10:53.202493+0000","last_unstale":"2024-09-22T08:12:52.572122+0000","last_undegraded":"2024-09-22T08:12:52.572122+0000","last_fullsized":"2024-09-22T08:12:52.572122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:44.822421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828530+0000","last_change":"2024-09-22T08:10:45.167131+0000","last_active":"2024-09-22T08:12:08.828530+0000","last_peered":"2024-09-22T08:12:08.828530+0000","last_clean":"2024-09-22T08:12:08.828530+0000","last_became_active":"2024-09-22T08:10:45.166540+0000","last_became_peered":"2024-09-22T08:10:45.166540+0000","last_unstale":"2024-09-22T08:12:08.828530+0000","last_undegraded":"2024-09-22T08:12:08.828530+0000","last_fullsized":"2024-09-22T08:12:08.828530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:51.203215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211107+0000","last_change":"2024-09-22T08:10:43.200355+0000","last_active":"2024-09-22T08:11:23.211107+0000","last_peered":"2024-09-22T08:11:23.211107+0000","last_clean":"2024-09-22T08:11:23.211107+0000","last_became_active":"2024-09-22T08:10:43.199724+0000","last_became_peered":"2024-09-22T08:10:43.199724+0000","last_unstale":"2024-09-22T08:11:23.211107+0000","last_undegraded":"2024-09-22T08:11:23.211107+0000","last_fullsized":"2024-09-22T08:11:23.211107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:25.660243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214717+0000","last_change":"2024-09-22T08:10:47.175833+0000","last_active":"2024-09-22T08:11:23.214717+0000","last_peered":"2024-09-22T08:11:23.214717+0000","last_clean":"2024-09-22T08:11:23.214717+0000","last_became_active":"2024-09-22T08:10:47.175541+0000","last_became_peered":"2024-09-22T08:10:47.175541+0000","last_unstale":"2024-09-22T08:11:23.214717+0000","last_undegraded":"2024-09-22T08:11:23.214717+0000","last_fullsized":"2024-09-22T08:11:23.214717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:17.796324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584978+0000","last_change":"2024-09-22T08:10:49.188295+0000","last_active":"2024-09-22T08:12:52.584978+0000","last_peered":"2024-09-22T08:12:52.584978+0000","last_clean":"2024-09-22T08:12:52.584978+0000","last_became_active":"2024-09-22T08:10:49.187767+0000","last_became_peered":"2024-09-22T08:10:49.187767+0000","last_unstale":"2024-09-22T08:12:52.584978+0000","last_undegraded":"2024-09-22T08:12:52.584978+0000","last_fullsized":"2024-09-22T08:12:52.584978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:02.055272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":367,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254414+0000","last_change":"2024-09-22T08:10:51.198099+0000","last_active":"2024-09-22T08:13:52.254414+0000","last_peered":"2024-09-22T08:13:52.254414+0000","last_clean":"2024-09-22T08:13:52.254414+0000","last_became_active":"2024-09-22T08:10:51.197814+0000","last_became_peered":"2024-09-22T08:10:51.197814+0000","last_unstale":"2024-09-22T08:13:52.254414+0000","last_undegraded":"2024-09-22T08:13:52.254414+0000","last_fullsized":"2024-09-22T08:13:52.254414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.509973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209032+0000","last_change":"2024-09-22T08:10:53.200170+0000","last_active":"2024-09-22T08:11:23.209032+0000","last_peered":"2024-09-22T08:11:23.209032+0000","last_clean":"2024-09-22T08:11:23.209032+0000","last_became_active":"2024-09-22T08:10:53.199881+0000","last_became_peered":"2024-09-22T08:10:53.199881+0000","last_unstale":"2024-09-22T08:11:23.209032+0000","last_undegraded":"2024-09-22T08:11:23.209032+0000","last_fullsized":"2024-09-22T08:11:23.209032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:46.946049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208021+0000","last_change":"2024-09-22T08:10:45.166388+0000","last_active":"2024-09-22T08:11:23.208021+0000","last_peered":"2024-09-22T08:11:23.208021+0000","last_clean":"2024-09-22T08:11:23.208021+0000","last_became_active":"2024-09-22T08:10:45.166103+0000","last_became_peered":"2024-09-22T08:10:45.166103+0000","last_unstale":"2024-09-22T08:11:23.208021+0000","last_undegraded":"2024-09-22T08:11:23.208021+0000","last_fullsized":"2024-09-22T08:11:23.208021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:07.647439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.587783+0000","last_change":"2024-09-22T08:10:43.180475+0000","last_active":"2024-09-22T08:13:12.587783+0000","last_peered":"2024-09-22T08:13:12.587783+0000","last_clean":"2024-09-22T08:13:12.587783+0000","last_became_active":"2024-09-22T08:10:43.180097+0000","last_became_peered":"2024-09-22T08:10:43.180097+0000","last_unstale":"2024-09-22T08:13:12.587783+0000","last_undegraded":"2024-09-22T08:13:12.587783+0000","last_fullsized":"2024-09-22T08:13:12.587783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:37.378948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212558+0000","last_change":"2024-09-22T08:10:47.175982+0000","last_active":"2024-09-22T08:11:23.212558+0000","last_peered":"2024-09-22T08:11:23.212558+0000","last_clean":"2024-09-22T08:11:23.212558+0000","last_became_active":"2024-09-22T08:10:47.175604+0000","last_became_peered":"2024-09-22T08:10:47.175604+0000","last_unstale":"2024-09-22T08:11:23.212558+0000","last_undegraded":"2024-09-22T08:11:23.212558+0000","last_fullsized":"2024-09-22T08:11:23.212558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:15.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.123249+0000","last_change":"2024-09-22T08:10:49.176102+0000","last_active":"2024-09-22T08:12:51.123249+0000","last_peered":"2024-09-22T08:12:51.123249+0000","last_clean":"2024-09-22T08:12:51.123249+0000","last_became_active":"2024-09-22T08:10:49.175817+0000","last_became_peered":"2024-09-22T08:10:49.175817+0000","last_unstale":"2024-09-22T08:12:51.123249+0000","last_undegraded":"2024-09-22T08:12:51.123249+0000","last_fullsized":"2024-09-22T08:12:51.123249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:19.626204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.219931+0000","last_change":"2024-09-22T08:10:51.192395+0000","last_active":"2024-09-22T08:11:23.219931+0000","last_peered":"2024-09-22T08:11:23.219931+0000","last_clean":"2024-09-22T08:11:23.219931+0000","last_became_active":"2024-09-22T08:10:51.191988+0000","last_became_peered":"2024-09-22T08:10:51.191988+0000","last_unstale":"2024-09-22T08:11:23.219931+0000","last_undegraded":"2024-09-22T08:11:23.219931+0000","last_fullsized":"2024-09-22T08:11:23.219931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216778+0000","last_change":"2024-09-22T08:10:53.199421+0000","last_active":"2024-09-22T08:11:23.216778+0000","last_peered":"2024-09-22T08:11:23.216778+0000","last_clean":"2024-09-22T08:11:23.216778+0000","last_became_active":"2024-09-22T08:10:53.199158+0000","last_became_peered":"2024-09-22T08:10:53.199158+0000","last_unstale":"2024-09-22T08:11:23.216778+0000","last_undegraded":"2024-09-22T08:11:23.216778+0000","last_fullsized":"2024-09-22T08:11:23.216778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:32.896582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.005197+0000","last_change":"2024-09-22T08:10:45.165605+0000","last_active":"2024-09-22T08:11:26.005197+0000","last_peered":"2024-09-22T08:11:26.005197+0000","last_clean":"2024-09-22T08:11:26.005197+0000","last_became_active":"2024-09-22T08:10:45.165116+0000","last_became_peered":"2024-09-22T08:10:45.165116+0000","last_unstale":"2024-09-22T08:11:26.005197+0000","last_undegraded":"2024-09-22T08:11:26.005197+0000","last_fullsized":"2024-09-22T08:11:26.005197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:29.645770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211112+0000","last_change":"2024-09-22T08:10:43.202146+0000","last_active":"2024-09-22T08:11:23.211112+0000","last_peered":"2024-09-22T08:11:23.211112+0000","last_clean":"2024-09-22T08:11:23.211112+0000","last_became_active":"2024-09-22T08:10:43.201076+0000","last_became_peered":"2024-09-22T08:10:43.201076+0000","last_unstale":"2024-09-22T08:11:23.211112+0000","last_undegraded":"2024-09-22T08:11:23.211112+0000","last_fullsized":"2024-09-22T08:11:23.211112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:43.112413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208142+0000","last_change":"2024-09-22T08:10:47.173239+0000","last_active":"2024-09-22T08:11:23.208142+0000","last_peered":"2024-09-22T08:11:23.208142+0000","last_clean":"2024-09-22T08:11:23.208142+0000","last_became_active":"2024-09-22T08:10:47.172988+0000","last_became_peered":"2024-09-22T08:10:47.172988+0000","last_unstale":"2024-09-22T08:11:23.208142+0000","last_undegraded":"2024-09-22T08:11:23.208142+0000","last_fullsized":"2024-09-22T08:11:23.208142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:57.256991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.124336+0000","last_change":"2024-09-22T08:10:49.185163+0000","last_active":"2024-09-22T08:12:51.124336+0000","last_peered":"2024-09-22T08:12:51.124336+0000","last_clean":"2024-09-22T08:12:51.124336+0000","last_became_active":"2024-09-22T08:10:49.184860+0000","last_became_peered":"2024-09-22T08:10:49.184860+0000","last_unstale":"2024-09-22T08:12:51.124336+0000","last_undegraded":"2024-09-22T08:12:51.124336+0000","last_fullsized":"2024-09-22T08:12:51.124336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.255387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209254+0000","last_change":"2024-09-22T08:10:51.200556+0000","last_active":"2024-09-22T08:11:23.209254+0000","last_peered":"2024-09-22T08:11:23.209254+0000","last_clean":"2024-09-22T08:11:23.209254+0000","last_became_active":"2024-09-22T08:10:51.199870+0000","last_became_peered":"2024-09-22T08:10:51.199870+0000","last_unstale":"2024-09-22T08:11:23.209254+0000","last_undegraded":"2024-09-22T08:11:23.209254+0000","last_fullsized":"2024-09-22T08:11:23.209254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.684662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212091+0000","last_change":"2024-09-22T08:10:53.201219+0000","last_active":"2024-09-22T08:11:23.212091+0000","last_peered":"2024-09-22T08:11:23.212091+0000","last_clean":"2024-09-22T08:11:23.212091+0000","last_became_active":"2024-09-22T08:10:53.200904+0000","last_became_peered":"2024-09-22T08:10:53.200904+0000","last_unstale":"2024-09-22T08:11:23.212091+0000","last_undegraded":"2024-09-22T08:11:23.212091+0000","last_fullsized":"2024-09-22T08:11:23.212091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:58.296182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'9","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.588330+0000","last_change":"2024-09-22T08:10:45.165741+0000","last_active":"2024-09-22T08:13:12.588330+0000","last_peered":"2024-09-22T08:13:12.588330+0000","last_clean":"2024-09-22T08:13:12.588330+0000","last_became_active":"2024-09-22T08:10:45.165511+0000","last_became_peered":"2024-09-22T08:10:45.165511+0000","last_unstale":"2024-09-22T08:13:12.588330+0000","last_undegraded":"2024-09-22T08:13:12.588330+0000","last_fullsized":"2024-09-22T08:13:12.588330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:15.789333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223338+0000","last_change":"2024-09-22T08:10:43.177415+0000","last_active":"2024-09-22T08:11:23.223338+0000","last_peered":"2024-09-22T08:11:23.223338+0000","last_clean":"2024-09-22T08:11:23.223338+0000","last_became_active":"2024-09-22T08:10:43.176954+0000","last_became_peered":"2024-09-22T08:10:43.176954+0000","last_unstale":"2024-09-22T08:11:23.223338+0000","last_undegraded":"2024-09-22T08:11:23.223338+0000","last_fullsized":"2024-09-22T08:11:23.223338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:24.996283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210491+0000","last_change":"2024-09-22T08:10:47.176984+0000","last_active":"2024-09-22T08:11:23.210491+0000","last_peered":"2024-09-22T08:11:23.210491+0000","last_clean":"2024-09-22T08:11:23.210491+0000","last_became_active":"2024-09-22T08:10:47.176641+0000","last_became_peered":"2024-09-22T08:10:47.176641+0000","last_unstale":"2024-09-22T08:11:23.210491+0000","last_undegraded":"2024-09-22T08:11:23.210491+0000","last_fullsized":"2024-09-22T08:11:23.210491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:49.329521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.148968+0000","last_change":"2024-09-22T08:10:49.188256+0000","last_active":"2024-09-22T08:12:51.148968+0000","last_peered":"2024-09-22T08:12:51.148968+0000","last_clean":"2024-09-22T08:12:51.148968+0000","last_became_active":"2024-09-22T08:10:49.187467+0000","last_became_peered":"2024-09-22T08:10:49.187467+0000","last_unstale":"2024-09-22T08:12:51.148968+0000","last_undegraded":"2024-09-22T08:12:51.148968+0000","last_fullsized":"2024-09-22T08:12:51.148968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:27.242973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209400+0000","last_change":"2024-09-22T08:10:51.198209+0000","last_active":"2024-09-22T08:11:23.209400+0000","last_peered":"2024-09-22T08:11:23.209400+0000","last_clean":"2024-09-22T08:11:23.209400+0000","last_became_active":"2024-09-22T08:10:51.197942+0000","last_became_peered":"2024-09-22T08:10:51.197942+0000","last_unstale":"2024-09-22T08:11:23.209400+0000","last_undegraded":"2024-09-22T08:11:23.209400+0000","last_fullsized":"2024-09-22T08:11:23.209400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:42.833261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.573626+0000","last_change":"2024-09-22T08:10:53.204064+0000","last_active":"2024-09-22T08:12:52.573626+0000","last_peered":"2024-09-22T08:12:52.573626+0000","last_clean":"2024-09-22T08:12:52.573626+0000","last_became_active":"2024-09-22T08:10:53.203791+0000","last_became_peered":"2024-09-22T08:10:53.203791+0000","last_unstale":"2024-09-22T08:12:52.573626+0000","last_undegraded":"2024-09-22T08:12:52.573626+0000","last_fullsized":"2024-09-22T08:12:52.573626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:42.795444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042279+0000","last_change":"2024-09-22T08:10:45.164568+0000","last_active":"2024-09-22T08:13:53.042279+0000","last_peered":"2024-09-22T08:13:53.042279+0000","last_clean":"2024-09-22T08:13:53.042279+0000","last_became_active":"2024-09-22T08:10:45.163402+0000","last_became_peered":"2024-09-22T08:10:45.163402+0000","last_unstale":"2024-09-22T08:13:53.042279+0000","last_undegraded":"2024-09-22T08:13:53.042279+0000","last_fullsized":"2024-09-22T08:13:53.042279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:31.128783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216675+0000","last_change":"2024-09-22T08:10:43.185767+0000","last_active":"2024-09-22T08:11:23.216675+0000","last_peered":"2024-09-22T08:11:23.216675+0000","last_clean":"2024-09-22T08:11:23.216675+0000","last_became_active":"2024-09-22T08:10:43.184777+0000","last_became_peered":"2024-09-22T08:10:43.184777+0000","last_unstale":"2024-09-22T08:11:23.216675+0000","last_undegraded":"2024-09-22T08:11:23.216675+0000","last_fullsized":"2024-09-22T08:11:23.216675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:44.875297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.796204+0000","last_change":"2024-09-22T08:10:47.176659+0000","last_active":"2024-09-22T08:12:49.796204+0000","last_peered":"2024-09-22T08:12:49.796204+0000","last_clean":"2024-09-22T08:12:49.796204+0000","last_became_active":"2024-09-22T08:10:47.176390+0000","last_became_peered":"2024-09-22T08:10:47.176390+0000","last_unstale":"2024-09-22T08:12:49.796204+0000","last_undegraded":"2024-09-22T08:12:49.796204+0000","last_fullsized":"2024-09-22T08:12:49.796204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:24.829227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'34","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.591839+0000","last_change":"2024-09-22T08:10:49.189639+0000","last_active":"2024-09-22T08:13:52.591839+0000","last_peered":"2024-09-22T08:13:52.591839+0000","last_clean":"2024-09-22T08:13:52.591839+0000","last_became_active":"2024-09-22T08:10:49.188231+0000","last_became_peered":"2024-09-22T08:10:49.188231+0000","last_unstale":"2024-09-22T08:13:52.591839+0000","last_undegraded":"2024-09-22T08:13:52.591839+0000","last_fullsized":"2024-09-22T08:13:52.591839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:08.360453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":51,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221258+0000","last_change":"2024-09-22T08:10:51.202802+0000","last_active":"2024-09-22T08:11:23.221258+0000","last_peered":"2024-09-22T08:11:23.221258+0000","last_clean":"2024-09-22T08:11:23.221258+0000","last_became_active":"2024-09-22T08:10:51.202476+0000","last_became_peered":"2024-09-22T08:10:51.202476+0000","last_unstale":"2024-09-22T08:11:23.221258+0000","last_undegraded":"2024-09-22T08:11:23.221258+0000","last_fullsized":"2024-09-22T08:11:23.221258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.161803+0000","last_change":"2024-09-22T08:10:53.201417+0000","last_active":"2024-09-22T08:12:51.161803+0000","last_peered":"2024-09-22T08:12:51.161803+0000","last_clean":"2024-09-22T08:12:51.161803+0000","last_became_active":"2024-09-22T08:10:53.201125+0000","last_became_peered":"2024-09-22T08:10:53.201125+0000","last_unstale":"2024-09-22T08:12:51.161803+0000","last_undegraded":"2024-09-22T08:12:51.161803+0000","last_fullsized":"2024-09-22T08:12:51.161803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:16.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254853+0000","last_change":"2024-09-22T08:10:45.181046+0000","last_active":"2024-09-22T08:13:53.254853+0000","last_peered":"2024-09-22T08:13:53.254853+0000","last_clean":"2024-09-22T08:13:53.254853+0000","last_became_active":"2024-09-22T08:10:45.180781+0000","last_became_peered":"2024-09-22T08:10:45.180781+0000","last_unstale":"2024-09-22T08:13:53.254853+0000","last_undegraded":"2024-09-22T08:13:53.254853+0000","last_fullsized":"2024-09-22T08:13:53.254853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:50.052801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.529697+0000","last_change":"2024-09-22T08:10:43.183556+0000","last_active":"2024-09-22T08:12:52.529697+0000","last_peered":"2024-09-22T08:12:52.529697+0000","last_clean":"2024-09-22T08:12:52.529697+0000","last_became_active":"2024-09-22T08:10:43.179693+0000","last_became_peered":"2024-09-22T08:10:43.179693+0000","last_unstale":"2024-09-22T08:12:52.529697+0000","last_undegraded":"2024-09-22T08:12:52.529697+0000","last_fullsized":"2024-09-22T08:12:52.529697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:56.127185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.950213+0000","last_change":"2024-09-22T08:10:45.164763+0000","last_active":"2024-09-22T08:13:52.950213+0000","last_peered":"2024-09-22T08:13:52.950213+0000","last_clean":"2024-09-22T08:13:52.950213+0000","last_became_active":"2024-09-22T08:10:45.164406+0000","last_became_peered":"2024-09-22T08:10:45.164406+0000","last_unstale":"2024-09-22T08:13:52.950213+0000","last_undegraded":"2024-09-22T08:13:52.950213+0000","last_fullsized":"2024-09-22T08:13:52.950213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:37.404156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.557173+0000","last_change":"2024-09-22T08:10:43.178608+0000","last_active":"2024-09-22T08:11:26.557173+0000","last_peered":"2024-09-22T08:11:26.557173+0000","last_clean":"2024-09-22T08:11:26.557173+0000","last_became_active":"2024-09-22T08:10:43.178018+0000","last_became_peered":"2024-09-22T08:10:43.178018+0000","last_unstale":"2024-09-22T08:11:26.557173+0000","last_undegraded":"2024-09-22T08:11:26.557173+0000","last_fullsized":"2024-09-22T08:11:26.557173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:25.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227865+0000","last_change":"2024-09-22T08:10:45.170408+0000","last_active":"2024-09-22T08:13:53.227865+0000","last_peered":"2024-09-22T08:13:53.227865+0000","last_clean":"2024-09-22T08:13:53.227865+0000","last_became_active":"2024-09-22T08:10:45.168526+0000","last_became_peered":"2024-09-22T08:10:45.168526+0000","last_unstale":"2024-09-22T08:13:53.227865+0000","last_undegraded":"2024-09-22T08:13:53.227865+0000","last_fullsized":"2024-09-22T08:13:53.227865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:17.590758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":86,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209592+0000","last_change":"2024-09-22T08:10:43.198536+0000","last_active":"2024-09-22T08:11:23.209592+0000","last_peered":"2024-09-22T08:11:23.209592+0000","last_clean":"2024-09-22T08:11:23.209592+0000","last_became_active":"2024-09-22T08:10:43.196221+0000","last_became_peered":"2024-09-22T08:10:43.196221+0000","last_unstale":"2024-09-22T08:11:23.209592+0000","last_undegraded":"2024-09-22T08:11:23.209592+0000","last_fullsized":"2024-09-22T08:11:23.209592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:05.712585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.166823+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.166432+0000","last_became_peered":"2024-09-22T08:10:45.166432+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:07.715456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.834623+0000","last_change":"2024-09-22T08:10:43.178126+0000","last_active":"2024-09-22T08:13:52.834623+0000","last_peered":"2024-09-22T08:13:52.834623+0000","last_clean":"2024-09-22T08:13:52.834623+0000","last_became_active":"2024-09-22T08:10:43.177673+0000","last_became_peered":"2024-09-22T08:10:43.177673+0000","last_unstale":"2024-09-22T08:13:52.834623+0000","last_undegraded":"2024-09-22T08:13:52.834623+0000","last_fullsized":"2024-09-22T08:13:52.834623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:44.875297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.575693+0000","last_change":"2024-09-22T08:10:45.171880+0000","last_active":"2024-09-22T08:12:52.575693+0000","last_peered":"2024-09-22T08:12:52.575693+0000","last_clean":"2024-09-22T08:12:52.575693+0000","last_became_active":"2024-09-22T08:10:45.171476+0000","last_became_peered":"2024-09-22T08:10:45.171476+0000","last_unstale":"2024-09-22T08:12:52.575693+0000","last_undegraded":"2024-09-22T08:12:52.575693+0000","last_fullsized":"2024-09-22T08:12:52.575693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:09.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221609+0000","last_change":"2024-09-22T08:10:43.187785+0000","last_active":"2024-09-22T08:11:23.221609+0000","last_peered":"2024-09-22T08:11:23.221609+0000","last_clean":"2024-09-22T08:11:23.221609+0000","last_became_active":"2024-09-22T08:10:43.186671+0000","last_became_peered":"2024-09-22T08:10:43.186671+0000","last_unstale":"2024-09-22T08:11:23.221609+0000","last_undegraded":"2024-09-22T08:11:23.221609+0000","last_fullsized":"2024-09-22T08:11:23.221609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:34.692797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.952726+0000","last_change":"2024-09-22T08:10:45.183046+0000","last_active":"2024-09-22T08:13:52.952726+0000","last_peered":"2024-09-22T08:13:52.952726+0000","last_clean":"2024-09-22T08:13:52.952726+0000","last_became_active":"2024-09-22T08:10:45.182785+0000","last_became_peered":"2024-09-22T08:10:45.182785+0000","last_unstale":"2024-09-22T08:13:52.952726+0000","last_undegraded":"2024-09-22T08:13:52.952726+0000","last_fullsized":"2024-09-22T08:13:52.952726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:51.776555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.484272+0000","last_change":"2024-09-22T08:10:43.183177+0000","last_active":"2024-09-22T08:12:52.484272+0000","last_peered":"2024-09-22T08:12:52.484272+0000","last_clean":"2024-09-22T08:12:52.484272+0000","last_became_active":"2024-09-22T08:10:43.182824+0000","last_became_peered":"2024-09-22T08:10:43.182824+0000","last_unstale":"2024-09-22T08:12:52.484272+0000","last_undegraded":"2024-09-22T08:12:52.484272+0000","last_fullsized":"2024-09-22T08:12:52.484272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:25.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'25","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.263612+0000","last_change":"2024-09-22T08:10:45.175920+0000","last_active":"2024-09-22T08:13:53.263612+0000","last_peered":"2024-09-22T08:13:53.263612+0000","last_clean":"2024-09-22T08:13:53.263612+0000","last_became_active":"2024-09-22T08:10:45.175600+0000","last_became_peered":"2024-09-22T08:10:45.175600+0000","last_unstale":"2024-09-22T08:13:53.263612+0000","last_undegraded":"2024-09-22T08:13:53.263612+0000","last_fullsized":"2024-09-22T08:13:53.263612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:53.580143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211182+0000","last_change":"2024-09-22T08:10:43.183024+0000","last_active":"2024-09-22T08:11:23.211182+0000","last_peered":"2024-09-22T08:11:23.211182+0000","last_clean":"2024-09-22T08:11:23.211182+0000","last_became_active":"2024-09-22T08:10:43.179529+0000","last_became_peered":"2024-09-22T08:10:43.179529+0000","last_unstale":"2024-09-22T08:11:23.211182+0000","last_undegraded":"2024-09-22T08:11:23.211182+0000","last_fullsized":"2024-09-22T08:11:23.211182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:25.240566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042521+0000","last_change":"2024-09-22T08:10:45.184241+0000","last_active":"2024-09-22T08:13:53.042521+0000","last_peered":"2024-09-22T08:13:53.042521+0000","last_clean":"2024-09-22T08:13:53.042521+0000","last_became_active":"2024-09-22T08:10:45.183901+0000","last_became_peered":"2024-09-22T08:10:45.183901+0000","last_unstale":"2024-09-22T08:13:53.042521+0000","last_undegraded":"2024-09-22T08:13:53.042521+0000","last_fullsized":"2024-09-22T08:13:53.042521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:28:48.567601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:56.584617+0000","last_change":"2024-09-22T08:10:43.178191+0000","last_active":"2024-09-22T08:12:56.584617+0000","last_peered":"2024-09-22T08:12:56.584617+0000","last_clean":"2024-09-22T08:12:56.584617+0000","last_became_active":"2024-09-22T08:10:43.177461+0000","last_became_peered":"2024-09-22T08:10:43.177461+0000","last_unstale":"2024-09-22T08:12:56.584617+0000","last_undegraded":"2024-09-22T08:12:56.584617+0000","last_fullsized":"2024-09-22T08:12:56.584617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:55.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.952431+0000","last_change":"2024-09-22T08:10:45.170004+0000","last_active":"2024-09-22T08:13:52.952431+0000","last_peered":"2024-09-22T08:13:52.952431+0000","last_clean":"2024-09-22T08:13:52.952431+0000","last_became_active":"2024-09-22T08:10:45.169723+0000","last_became_peered":"2024-09-22T08:10:45.169723+0000","last_unstale":"2024-09-22T08:13:52.952431+0000","last_undegraded":"2024-09-22T08:13:52.952431+0000","last_fullsized":"2024-09-22T08:13:52.952431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:45.662588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212281+0000","last_change":"2024-09-22T08:10:43.196560+0000","last_active":"2024-09-22T08:11:23.212281+0000","last_peered":"2024-09-22T08:11:23.212281+0000","last_clean":"2024-09-22T08:11:23.212281+0000","last_became_active":"2024-09-22T08:10:43.195587+0000","last_became_peered":"2024-09-22T08:10:43.195587+0000","last_unstale":"2024-09-22T08:11:23.212281+0000","last_undegraded":"2024-09-22T08:11:23.212281+0000","last_fullsized":"2024-09-22T08:11:23.212281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:23.625176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183433+0000","last_change":"2024-09-22T08:10:45.170370+0000","last_active":"2024-09-22T08:13:53.183433+0000","last_peered":"2024-09-22T08:13:53.183433+0000","last_clean":"2024-09-22T08:13:53.183433+0000","last_became_active":"2024-09-22T08:10:45.169366+0000","last_became_peered":"2024-09-22T08:10:45.169366+0000","last_unstale":"2024-09-22T08:13:53.183433+0000","last_undegraded":"2024-09-22T08:13:53.183433+0000","last_fullsized":"2024-09-22T08:13:53.183433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.634336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.915352+0000","last_change":"2024-09-22T08:10:43.187942+0000","last_active":"2024-09-22T08:13:52.915352+0000","last_peered":"2024-09-22T08:13:52.915352+0000","last_clean":"2024-09-22T08:13:52.915352+0000","last_became_active":"2024-09-22T08:10:43.187246+0000","last_became_peered":"2024-09-22T08:10:43.187246+0000","last_unstale":"2024-09-22T08:13:52.915352+0000","last_undegraded":"2024-09-22T08:13:52.915352+0000","last_fullsized":"2024-09-22T08:13:52.915352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:56.538345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.044952+0000","last_change":"2024-09-22T08:10:45.172556+0000","last_active":"2024-09-22T08:13:53.044952+0000","last_peered":"2024-09-22T08:13:53.044952+0000","last_clean":"2024-09-22T08:13:53.044952+0000","last_became_active":"2024-09-22T08:10:45.172080+0000","last_became_peered":"2024-09-22T08:10:45.172080+0000","last_unstale":"2024-09-22T08:13:53.044952+0000","last_undegraded":"2024-09-22T08:13:53.044952+0000","last_fullsized":"2024-09-22T08:13:53.044952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:33.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213039+0000","last_change":"2024-09-22T08:10:43.179415+0000","last_active":"2024-09-22T08:11:23.213039+0000","last_peered":"2024-09-22T08:11:23.213039+0000","last_clean":"2024-09-22T08:11:23.213039+0000","last_became_active":"2024-09-22T08:10:43.178924+0000","last_became_peered":"2024-09-22T08:10:43.178924+0000","last_unstale":"2024-09-22T08:11:23.213039+0000","last_undegraded":"2024-09-22T08:11:23.213039+0000","last_fullsized":"2024-09-22T08:11:23.213039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:05.127567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'15","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.190568+0000","last_change":"2024-09-22T08:10:45.172376+0000","last_active":"2024-09-22T08:13:53.190568+0000","last_peered":"2024-09-22T08:13:53.190568+0000","last_clean":"2024-09-22T08:13:53.190568+0000","last_became_active":"2024-09-22T08:10:45.172101+0000","last_became_peered":"2024-09-22T08:10:45.172101+0000","last_unstale":"2024-09-22T08:13:53.190568+0000","last_undegraded":"2024-09-22T08:13:53.190568+0000","last_fullsized":"2024-09-22T08:13:53.190568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:42.945533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213721+0000","last_change":"2024-09-22T08:10:43.179255+0000","last_active":"2024-09-22T08:11:23.213721+0000","last_peered":"2024-09-22T08:11:23.213721+0000","last_clean":"2024-09-22T08:11:23.213721+0000","last_became_active":"2024-09-22T08:10:43.178876+0000","last_became_peered":"2024-09-22T08:10:43.178876+0000","last_unstale":"2024-09-22T08:11:23.213721+0000","last_undegraded":"2024-09-22T08:11:23.213721+0000","last_fullsized":"2024-09-22T08:11:23.213721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:40:11.526265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.829072+0000","last_change":"2024-09-22T08:10:45.180356+0000","last_active":"2024-09-22T08:12:08.829072+0000","last_peered":"2024-09-22T08:12:08.829072+0000","last_clean":"2024-09-22T08:12:08.829072+0000","last_became_active":"2024-09-22T08:10:45.180117+0000","last_became_peered":"2024-09-22T08:10:45.180117+0000","last_unstale":"2024-09-22T08:12:08.829072+0000","last_undegraded":"2024-09-22T08:12:08.829072+0000","last_fullsized":"2024-09-22T08:12:08.829072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:07.097290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211963+0000","last_change":"2024-09-22T08:10:43.196149+0000","last_active":"2024-09-22T08:11:23.211963+0000","last_peered":"2024-09-22T08:11:23.211963+0000","last_clean":"2024-09-22T08:11:23.211963+0000","last_became_active":"2024-09-22T08:10:43.195770+0000","last_became_peered":"2024-09-22T08:10:43.195770+0000","last_unstale":"2024-09-22T08:11:23.211963+0000","last_undegraded":"2024-09-22T08:11:23.211963+0000","last_fullsized":"2024-09-22T08:11:23.211963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:35.401285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183848+0000","last_change":"2024-09-22T08:10:45.180354+0000","last_active":"2024-09-22T08:13:53.183848+0000","last_peered":"2024-09-22T08:13:53.183848+0000","last_clean":"2024-09-22T08:13:53.183848+0000","last_became_active":"2024-09-22T08:10:45.180098+0000","last_became_peered":"2024-09-22T08:10:45.180098+0000","last_unstale":"2024-09-22T08:13:53.183848+0000","last_undegraded":"2024-09-22T08:13:53.183848+0000","last_fullsized":"2024-09-22T08:13:53.183848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:45.833791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213202+0000","last_change":"2024-09-22T08:10:43.202451+0000","last_active":"2024-09-22T08:11:23.213202+0000","last_peered":"2024-09-22T08:11:23.213202+0000","last_clean":"2024-09-22T08:11:23.213202+0000","last_became_active":"2024-09-22T08:10:43.201687+0000","last_became_peered":"2024-09-22T08:10:43.201687+0000","last_unstale":"2024-09-22T08:11:23.213202+0000","last_undegraded":"2024-09-22T08:11:23.213202+0000","last_fullsized":"2024-09-22T08:11:23.213202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:03.394369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037719+0000","last_change":"2024-09-22T08:11:23.222217+0000","last_active":"2024-09-22T08:11:27.037719+0000","last_peered":"2024-09-22T08:11:27.037719+0000","last_clean":"2024-09-22T08:11:27.037719+0000","last_became_active":"2024-09-22T08:11:23.215110+0000","last_became_peered":"2024-09-22T08:11:23.215110+0000","last_unstale":"2024-09-22T08:11:27.037719+0000","last_undegraded":"2024-09-22T08:11:27.037719+0000","last_fullsized":"2024-09-22T08:11:27.037719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:56.580950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.560515+0000","last_change":"2024-09-22T08:10:43.190134+0000","last_active":"2024-09-22T08:11:25.560515+0000","last_peered":"2024-09-22T08:11:25.560515+0000","last_clean":"2024-09-22T08:11:25.560515+0000","last_became_active":"2024-09-22T08:10:43.187195+0000","last_became_peered":"2024-09-22T08:10:43.187195+0000","last_unstale":"2024-09-22T08:11:25.560515+0000","last_undegraded":"2024-09-22T08:11:25.560515+0000","last_fullsized":"2024-09-22T08:11:25.560515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:28.903101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183984+0000","last_change":"2024-09-22T08:10:45.179422+0000","last_active":"2024-09-22T08:13:53.183984+0000","last_peered":"2024-09-22T08:13:53.183984+0000","last_clean":"2024-09-22T08:13:53.183984+0000","last_became_active":"2024-09-22T08:10:45.179150+0000","last_became_peered":"2024-09-22T08:10:45.179150+0000","last_unstale":"2024-09-22T08:13:53.183984+0000","last_undegraded":"2024-09-22T08:13:53.183984+0000","last_fullsized":"2024-09-22T08:13:53.183984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:32.350768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213258+0000","last_change":"2024-09-22T08:10:43.200646+0000","last_active":"2024-09-22T08:11:23.213258+0000","last_peered":"2024-09-22T08:11:23.213258+0000","last_clean":"2024-09-22T08:11:23.213258+0000","last_became_active":"2024-09-22T08:10:43.200282+0000","last_became_peered":"2024-09-22T08:10:43.200282+0000","last_unstale":"2024-09-22T08:11:23.213258+0000","last_undegraded":"2024-09-22T08:11:23.213258+0000","last_fullsized":"2024-09-22T08:11:23.213258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:40.745524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.560615+0000","last_change":"2024-09-22T08:10:43.190222+0000","last_active":"2024-09-22T08:11:26.560615+0000","last_peered":"2024-09-22T08:11:26.560615+0000","last_clean":"2024-09-22T08:11:26.560615+0000","last_became_active":"2024-09-22T08:10:43.189848+0000","last_became_peered":"2024-09-22T08:10:43.189848+0000","last_unstale":"2024-09-22T08:11:26.560615+0000","last_undegraded":"2024-09-22T08:11:26.560615+0000","last_fullsized":"2024-09-22T08:11:26.560615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:06.237724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.234367+0000","last_change":"2024-09-22T08:10:45.183685+0000","last_active":"2024-09-22T08:13:53.234367+0000","last_peered":"2024-09-22T08:13:53.234367+0000","last_clean":"2024-09-22T08:13:53.234367+0000","last_became_active":"2024-09-22T08:10:45.183407+0000","last_became_peered":"2024-09-22T08:10:45.183407+0000","last_unstale":"2024-09-22T08:13:53.234367+0000","last_undegraded":"2024-09-22T08:13:53.234367+0000","last_fullsized":"2024-09-22T08:13:53.234367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:45.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.178063+0000","last_change":"2024-09-22T08:10:43.187945+0000","last_active":"2024-09-22T08:13:53.178063+0000","last_peered":"2024-09-22T08:13:53.178063+0000","last_clean":"2024-09-22T08:13:53.178063+0000","last_became_active":"2024-09-22T08:10:43.187119+0000","last_became_peered":"2024-09-22T08:10:43.187119+0000","last_unstale":"2024-09-22T08:13:53.178063+0000","last_undegraded":"2024-09-22T08:13:53.178063+0000","last_fullsized":"2024-09-22T08:13:53.178063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:05.083470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'7","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.587845+0000","last_change":"2024-09-22T08:11:23.218926+0000","last_active":"2024-09-22T08:13:12.587845+0000","last_peered":"2024-09-22T08:13:12.587845+0000","last_clean":"2024-09-22T08:13:12.587845+0000","last_became_active":"2024-09-22T08:11:23.218693+0000","last_became_peered":"2024-09-22T08:11:23.218693+0000","last_unstale":"2024-09-22T08:13:12.587845+0000","last_undegraded":"2024-09-22T08:13:12.587845+0000","last_fullsized":"2024-09-22T08:13:12.587845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:23.796030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44224,"kb_used_data":8880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327616,"statfs":{"total":96636764160,"available":96591478784,"internally_reserved":0,"allocated":9093120,"data_stored":8760075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673006,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48900,"kb_used_data":9396,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322940,"statfs":{"total":96636764160,"available":96586690560,"internally_reserved":0,"allocated":9621504,"data_stored":9347107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44760,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327080,"statfs":{"total":96636764160,"available":96590929920,"internally_reserved":0,"allocated":9641984,"data_stored":9347795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":9056256,"data_stored":8759415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:14:01.033 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:14:01.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.164+0000 7fe251b24640 1 Processor -- start 2024-09-22T08:14:01.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.164+0000 7fe251b24640 1 -- start start 2024-09-22T08:14:01.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.165+0000 7fe251b24640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe24c071e30 0x7fe24c132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.165+0000 7fe251b24640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24c071770 con 0x7fe24c06e170 2024-09-22T08:14:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.165+0000 7fe251b24640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe24c099ee0 con 0x7fe24c071e30 2024-09-22T08:14:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.165+0000 7fe24affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe24c071e30 0x7fe24c132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.165+0000 7fe24b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe24c06e170 0x7fe24c06e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56220/0 (socket says 172.21.15.53:56220) 2024-09-22T08:14:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.165+0000 7fe24b7fe640 1 -- 172.21.15.53:0/1265281635 learned_addr learned my addr 172.21.15.53:0/1265281635 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.165+0000 7fe24affd640 1 -- 172.21.15.53:0/1265281635 >> v1:172.21.15.53:6789/0 conn(0x7fe24c06e170 legacy=0x7fe24c06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.165+0000 7fe24affd640 1 -- 172.21.15.53:0/1265281635 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c072530 con 0x7fe24c071e30 2024-09-22T08:14:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe24affd640 1 --2- 172.21.15.53:0/1265281635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c071e30 0x7fe24c132790 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe240009750 tx=0x7fe24002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109c6c09d880ab95 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe24a7fc640 1 -- 172.21.15.53:0/1265281635 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe240037070 con 0x7fe24c071e30 2024-09-22T08:14:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe24a7fc640 1 -- 172.21.15.53:0/1265281635 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24002ad80 con 0x7fe24c071e30 2024-09-22T08:14:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe24a7fc640 1 -- 172.21.15.53:0/1265281635 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe240032590 con 0x7fe24c071e30 2024-09-22T08:14:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe251b24640 1 -- 172.21.15.53:0/1265281635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c071e30 msgr2=0x7fe24c132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe251b24640 1 --2- 172.21.15.53:0/1265281635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c071e30 0x7fe24c132790 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe240009750 tx=0x7fe24002a140 comp rx=0 tx=0).stop 2024-09-22T08:14:01.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe251b24640 1 -- 172.21.15.53:0/1265281635 shutdown_connections 2024-09-22T08:14:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe251b24640 1 --2- 172.21.15.53:0/1265281635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c071e30 0x7fe24c132790 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe251b24640 1 -- 172.21.15.53:0/1265281635 >> 172.21.15.53:0/1265281635 conn(0x7fe24c09ac80 msgr2=0x7fe24c098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe251b24640 1 -- 172.21.15.53:0/1265281635 shutdown_connections 2024-09-22T08:14:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.166+0000 7fe251b24640 1 -- 172.21.15.53:0/1265281635 wait complete. 2024-09-22T08:14:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.167+0000 7fe251b24640 1 Processor -- start 2024-09-22T08:14:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.167+0000 7fe251b24640 1 -- start start 2024-09-22T08:14:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.168+0000 7fe251b24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c06e170 0x7fe24c1250f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.168+0000 7fe251b24640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c06ee70 con 0x7fe24c06e170 2024-09-22T08:14:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.168+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c06e170 0x7fe24c1250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:01.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.168+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c06e170 0x7fe24c1250f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48094/0 (socket says 172.21.15.53:48094) 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.168+0000 7fe24b7fe640 1 -- 172.21.15.53:0/4183301375 learned_addr learned my addr 172.21.15.53:0/4183301375 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.168+0000 7fe24b7fe640 1 -- 172.21.15.53:0/4183301375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c074170 con 0x7fe24c06e170 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.168+0000 7fe24b7fe640 1 --2- 172.21.15.53:0/4183301375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c06e170 0x7fe24c1250f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00c450 tx=0x7fe23c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.168+0000 7fe233fff640 1 -- 172.21.15.53:0/4183301375 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe23c017070 con 0x7fe24c06e170 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.168+0000 7fe233fff640 1 -- 172.21.15.53:0/4183301375 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c005c10 con 0x7fe24c06e170 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.169+0000 7fe251b24640 1 -- 172.21.15.53:0/4183301375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24c1279b0 con 0x7fe24c06e170 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.169+0000 7fe233fff640 1 -- 172.21.15.53:0/4183301375 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe23c0070d0 con 0x7fe24c06e170 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.169+0000 7fe251b24640 1 -- 172.21.15.53:0/4183301375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24c125630 con 0x7fe24c06e170 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.169+0000 7fe233fff640 1 -- 172.21.15.53:0/4183301375 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe23c01a070 con 0x7fe24c06e170 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.169+0000 7fe251b24640 1 -- 172.21.15.53:0/4183301375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24c06e550 con 0x7fe24c06e170 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.170+0000 7fe233fff640 1 --2- 172.21.15.53:0/4183301375 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe23803e710 0x7fe238040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:01.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.170+0000 7fe233fff640 1 -- 172.21.15.53:0/4183301375 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe23c052c10 con 0x7fe24c06e170 2024-09-22T08:14:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.170+0000 7fe24affd640 1 --2- 172.21.15.53:0/4183301375 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe23803e710 0x7fe238040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.171+0000 7fe24affd640 1 --2- 172.21.15.53:0/4183301375 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe23803e710 0x7fe238040bd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe240034000 tx=0x7fe24002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:01.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.174+0000 7fe233fff640 1 -- 172.21.15.53:0/4183301375 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe23c01ada0 con 0x7fe24c06e170 2024-09-22T08:14:01.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.362+0000 7fe251b24640 1 -- 172.21.15.53:0/4183301375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe24c076560 con 0x7fe24c06e170 2024-09-22T08:14:01.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.363+0000 7fe233fff640 1 -- 172.21.15.53:0/4183301375 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+21197 (secure 0 0 0) 0x7fe23c01b8d0 con 0x7fe24c06e170 2024-09-22T08:14:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:14:01.365 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"fsid":"e28b0ed0-1272-43e5-8a68-aa2f8d89bec5","created":"2024-09-22T08:10:17.147434+0000","modified":"2024-09-22T08:11:23.203311+0000","last_up_change":"2024-09-22T08:10:26.896360+0000","last_in_change":"2024-09-22T08:10:18.218936+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:10:27.573518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:10:32.734377+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-22T08:10:41.934086+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-22T08:10:43.487379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-22T08:10:45.455091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-22T08:10:47.239190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-22T08:10:49.194082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-22T08:10:51.260091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0004653-b98d-4b1a-a928-2f6ef86bf15c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6801","nonce":2902972477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6803","nonce":2902972477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6807","nonce":2902972477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":2902972477},{"type":"v1","addr":"172.21.15.53:6805","nonce":2902972477}]},"public_addr":"172.21.15.53:6801/2902972477","cluster_addr":"172.21.15.53:6803/2902972477","heartbeat_back_addr":"172.21.15.53:6807/2902972477","heartbeat_front_addr":"172.21.15.53:6805/2902972477","state":["exists","up"]},{"osd":1,"uuid":"c85ab72a-9b5c-4d4d-a0d1-3d32724a8d29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6817","nonce":2347568643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6819","nonce":2347568643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6823","nonce":2347568643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2347568643},{"type":"v1","addr":"172.21.15.165:6821","nonce":2347568643}]},"public_addr":"172.21.15.165:6817/2347568643","cluster_addr":"172.21.15.165:6819/2347568643","heartbeat_back_addr":"172.21.15.165:6823/2347568643","heartbeat_front_addr":"172.21.15.165:6821/2347568643","state":["exists","up"]},{"osd":2,"uuid":"f0698e09-e99e-43f6-840b-999b20fc7d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6809","nonce":3197121696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6811","nonce":3197121696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6815","nonce":3197121696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3197121696},{"type":"v1","addr":"172.21.15.165:6813","nonce":3197121696}]},"public_addr":"172.21.15.165:6809/3197121696","cluster_addr":"172.21.15.165:6811/3197121696","heartbeat_back_addr":"172.21.15.165:6815/3197121696","heartbeat_front_addr":"172.21.15.165:6813/3197121696","state":["exists","up"]},{"osd":3,"uuid":"413ad162-0b9b-437b-a3b4-0c4e1170cd61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6801","nonce":215521179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6803","nonce":215521179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6807","nonce":215521179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":215521179},{"type":"v1","addr":"172.21.15.165:6805","nonce":215521179}]},"public_addr":"172.21.15.165:6801/215521179","cluster_addr":"172.21.15.165:6803/215521179","heartbeat_back_addr":"172.21.15.165:6807/215521179","heartbeat_front_addr":"172.21.15.165:6805/215521179","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.156688+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.537972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:24.998790+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:10:25.920032+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.36","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"5.1","mappings":[{"from":0,"to":2}]},{"pgid":"5.c","mappings":[{"from":0,"to":2}]},{"pgid":"5.f","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:14:01.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.365+0000 7fe251b24640 1 -- 172.21.15.53:0/4183301375 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe23803e710 msgr2=0x7fe238040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:01.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.365+0000 7fe251b24640 1 --2- 172.21.15.53:0/4183301375 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe23803e710 0x7fe238040bd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe240034000 tx=0x7fe24002e000 comp rx=0 tx=0).stop 2024-09-22T08:14:01.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.365+0000 7fe251b24640 1 -- 172.21.15.53:0/4183301375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c06e170 msgr2=0x7fe24c1250f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:01.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.365+0000 7fe251b24640 1 --2- 172.21.15.53:0/4183301375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c06e170 0x7fe24c1250f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00c450 tx=0x7fe23c00c910 comp rx=0 tx=0).stop 2024-09-22T08:14:01.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.365+0000 7fe251b24640 1 -- 172.21.15.53:0/4183301375 shutdown_connections 2024-09-22T08:14:01.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.365+0000 7fe251b24640 1 --2- 172.21.15.53:0/4183301375 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fe23803e710 0x7fe238040bd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:01.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.365+0000 7fe251b24640 1 --2- 172.21.15.53:0/4183301375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe24c06e170 0x7fe24c1250f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:01.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.365+0000 7fe251b24640 1 -- 172.21.15.53:0/4183301375 >> 172.21.15.53:0/4183301375 conn(0x7fe24c09ac80 msgr2=0x7fe24c097280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:01.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.365+0000 7fe251b24640 1 -- 172.21.15.53:0/4183301375 shutdown_connections 2024-09-22T08:14:01.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:01.365+0000 7fe251b24640 1 -- 172.21.15.53:0/4183301375 wait complete. 2024-09-22T08:14:02.378 INFO:tasks.ceph:Scrubbing osd.0 2024-09-22T08:14:02.378 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:14:02.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.495+0000 7f63b1517640 1 Processor -- start 2024-09-22T08:14:02.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.495+0000 7f63b1517640 1 -- start start 2024-09-22T08:14:02.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.495+0000 7f63b1517640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f63ac12bd40 0x7f63ac096630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.496+0000 7f63b1517640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac097f10 con 0x7f63ac12c120 2024-09-22T08:14:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.496+0000 7f63b1517640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f63ac12ba50 con 0x7f63ac12bd40 2024-09-22T08:14:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.496+0000 7f63aaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f63ac12bd40 0x7f63ac096630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.496+0000 7f63aa7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f63ac12c120 0x7f63ac128260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56236/0 (socket says 172.21.15.53:56236) 2024-09-22T08:14:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.496+0000 7f63aa7fc640 1 -- 172.21.15.53:0/2595386532 learned_addr learned my addr 172.21.15.53:0/2595386532 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.496+0000 7f63aaffd640 1 -- 172.21.15.53:0/2595386532 >> v1:172.21.15.53:6789/0 conn(0x7f63ac12c120 legacy=0x7f63ac128260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.496+0000 7f63aaffd640 1 -- 172.21.15.53:0/2595386532 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac12c590 con 0x7f63ac12bd40 2024-09-22T08:14:02.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.497+0000 7f63aaffd640 1 --2- 172.21.15.53:0/2595386532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 0x7f63ac096630 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f639c00b9f0 tx=0x7f639c02c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3d9b783c611b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.497+0000 7f63a9ffb640 1 -- 172.21.15.53:0/2595386532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639c03a070 con 0x7f63ac12bd40 2024-09-22T08:14:02.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.497+0000 7f63a9ffb640 1 -- 172.21.15.53:0/2595386532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c031070 con 0x7f63ac12bd40 2024-09-22T08:14:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.497+0000 7f63a9ffb640 1 -- 172.21.15.53:0/2595386532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639c032620 con 0x7f63ac12bd40 2024-09-22T08:14:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.497+0000 7f63b1517640 1 -- 172.21.15.53:0/2595386532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 msgr2=0x7f63ac096630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.497+0000 7f63b1517640 1 --2- 172.21.15.53:0/2595386532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 0x7f63ac096630 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f639c00b9f0 tx=0x7f639c02c810 comp rx=0 tx=0).stop 2024-09-22T08:14:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.497+0000 7f63b1517640 1 -- 172.21.15.53:0/2595386532 shutdown_connections 2024-09-22T08:14:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.497+0000 7f63b1517640 1 --2- 172.21.15.53:0/2595386532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 0x7f63ac096630 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.497+0000 7f63b1517640 1 -- 172.21.15.53:0/2595386532 >> 172.21.15.53:0/2595386532 conn(0x7f63ac09ac80 msgr2=0x7f63ac09b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.498+0000 7f63b1517640 1 -- 172.21.15.53:0/2595386532 shutdown_connections 2024-09-22T08:14:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.498+0000 7f63b1517640 1 -- 172.21.15.53:0/2595386532 wait complete. 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.498+0000 7f63b1517640 1 Processor -- start 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.499+0000 7f63b1517640 1 -- start start 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.499+0000 7f63b1517640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 0x7f63ac072580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.499+0000 7f63b1517640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac099f20 con 0x7f63ac12bd40 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.499+0000 7f63aaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 0x7f63ac072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.499+0000 7f63aaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 0x7f63ac072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48112/0 (socket says 172.21.15.53:48112) 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.499+0000 7f63aaffd640 1 -- 172.21.15.53:0/1476754376 learned_addr learned my addr 172.21.15.53:0/1476754376 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.499+0000 7f63aaffd640 1 -- 172.21.15.53:0/1476754376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac128580 con 0x7f63ac12bd40 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.499+0000 7f63aaffd640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 0x7f63ac072580 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f639c00b9f0 tx=0x7f639c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.500+0000 7f63937fe640 1 -- 172.21.15.53:0/1476754376 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639c03a040 con 0x7f63ac12bd40 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.500+0000 7f63937fe640 1 -- 172.21.15.53:0/1476754376 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c045070 con 0x7f63ac12bd40 2024-09-22T08:14:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.500+0000 7f63937fe640 1 -- 172.21.15.53:0/1476754376 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639c0358a0 con 0x7f63ac12bd40 2024-09-22T08:14:02.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.500+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ac1287b0 con 0x7f63ac12bd40 2024-09-22T08:14:02.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.500+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ac08c1a0 con 0x7f63ac12bd40 2024-09-22T08:14:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.501+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63ac094ea0 con 0x7f63ac12bd40 2024-09-22T08:14:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.501+0000 7f63937fe640 1 -- 172.21.15.53:0/1476754376 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f639c033070 con 0x7f63ac12bd40 2024-09-22T08:14:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.501+0000 7f63937fe640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f639803e710 0x7f6398040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.501+0000 7f63937fe640 1 -- 172.21.15.53:0/1476754376 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f639c074440 con 0x7f63ac12bd40 2024-09-22T08:14:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.501+0000 7f63937fe640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f639804ab80 0x7f639804d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.501+0000 7f63937fe640 1 -- 172.21.15.53:0/1476754376 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f639804d6f0 con 0x7f639804ab80 2024-09-22T08:14:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.501+0000 7f63937fe640 1 -- 172.21.15.53:0/1476754376 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f639c07b050 con 0x7f63ac12bd40 2024-09-22T08:14:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.501+0000 7f63ab7fe640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f639804ab80 0x7f639804d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.501+0000 7f63aa7fc640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f639803e710 0x7f6398040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.502+0000 7f63ab7fe640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f639804ab80 0x7f639804d020 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.502+0000 7f63aa7fc640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f639803e710 0x7f6398040bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f63a0000f60 tx=0x7f63a0007ae0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.502+0000 7f63937fe640 1 -- 172.21.15.53:0/1476754376 <== osd.0 v2:172.21.15.53:6800/2902972477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f639804d6f0 con 0x7f639804ab80 2024-09-22T08:14:02.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.515+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 --> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f63ac096630 con 0x7f639804ab80 2024-09-22T08:14:02.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.515+0000 7f63937fe640 1 -- 172.21.15.53:0/1476754376 <== osd.0 v2:172.21.15.53:6800/2902972477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f63ac096630 con 0x7f639804ab80 2024-09-22T08:14:02.517 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-22T08:14:02.517 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:14:02.517 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-22T08:14:02.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f639804ab80 msgr2=0x7f639804d020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f639804ab80 0x7f639804d020 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f639803e710 msgr2=0x7f6398040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f639803e710 0x7f6398040bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f63a0000f60 tx=0x7f63a0007ae0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 msgr2=0x7f63ac072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 0x7f63ac072580 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f639c00b9f0 tx=0x7f639c004730 comp rx=0 tx=0).stop 2024-09-22T08:14:02.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 shutdown_connections 2024-09-22T08:14:02.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.53:6800/2902972477,v1:172.21.15.53:6801/2902972477] conn(0x7f639804ab80 0x7f639804d020 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f639803e710 0x7f6398040bd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 --2- 172.21.15.53:0/1476754376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63ac12bd40 0x7f63ac072580 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 >> 172.21.15.53:0/1476754376 conn(0x7f63ac09ac80 msgr2=0x7f63ac09bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:02.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 shutdown_connections 2024-09-22T08:14:02.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.516+0000 7f63b1517640 1 -- 172.21.15.53:0/1476754376 wait complete. 2024-09-22T08:14:02.528 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-22T08:14:02.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.628+0000 7efe03f17640 1 Processor -- start 2024-09-22T08:14:02.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.628+0000 7efe03f17640 1 -- start start 2024-09-22T08:14:02.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.629+0000 7efe03f17640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efdfc06e170 0x7efdfc06e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.629+0000 7efe03f17640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdfc071770 con 0x7efdfc071e30 2024-09-22T08:14:02.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.629+0000 7efe03f17640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7efdfc099ee0 con 0x7efdfc06e170 2024-09-22T08:14:02.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.629+0000 7efe01cb3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efdfc06e170 0x7efdfc06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.629+0000 7efe014b2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efdfc071e30 0x7efdfc097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56238/0 (socket says 172.21.15.53:56238) 2024-09-22T08:14:02.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.629+0000 7efe014b2640 1 -- 172.21.15.53:0/1895841167 learned_addr learned my addr 172.21.15.53:0/1895841167 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:02.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.629+0000 7efe01cb3640 1 -- 172.21.15.53:0/1895841167 >> v1:172.21.15.53:6789/0 conn(0x7efdfc071e30 legacy=0x7efdfc097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.629+0000 7efe01cb3640 1 -- 172.21.15.53:0/1895841167 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc072530 con 0x7efdfc06e170 2024-09-22T08:14:02.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.630+0000 7efe01cb3640 1 --2- 172.21.15.53:0/1895841167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 0x7efdfc06e550 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009750 tx=0x7efdf802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c36c805506ede6 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.630+0000 7efe00cb1640 1 -- 172.21.15.53:0/1895841167 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf8037070 con 0x7efdfc06e170 2024-09-22T08:14:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.630+0000 7efe00cb1640 1 -- 172.21.15.53:0/1895841167 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf802ad80 con 0x7efdfc06e170 2024-09-22T08:14:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.630+0000 7efe00cb1640 1 -- 172.21.15.53:0/1895841167 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf8032590 con 0x7efdfc06e170 2024-09-22T08:14:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.630+0000 7efe03f17640 1 -- 172.21.15.53:0/1895841167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 msgr2=0x7efdfc06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.630+0000 7efe03f17640 1 --2- 172.21.15.53:0/1895841167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 0x7efdfc06e550 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009750 tx=0x7efdf802a140 comp rx=0 tx=0).stop 2024-09-22T08:14:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.630+0000 7efe03f17640 1 -- 172.21.15.53:0/1895841167 shutdown_connections 2024-09-22T08:14:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.630+0000 7efe03f17640 1 --2- 172.21.15.53:0/1895841167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 0x7efdfc06e550 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.630+0000 7efe03f17640 1 -- 172.21.15.53:0/1895841167 >> 172.21.15.53:0/1895841167 conn(0x7efdfc09ac80 msgr2=0x7efdfc098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.631+0000 7efe03f17640 1 -- 172.21.15.53:0/1895841167 shutdown_connections 2024-09-22T08:14:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.631+0000 7efe03f17640 1 -- 172.21.15.53:0/1895841167 wait complete. 2024-09-22T08:14:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.631+0000 7efe03f17640 1 Processor -- start 2024-09-22T08:14:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.631+0000 7efe03f17640 1 -- start start 2024-09-22T08:14:02.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efe03f17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 0x7efdfc127080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efe03f17640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc06ee20 con 0x7efdfc06e170 2024-09-22T08:14:02.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efe01cb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 0x7efdfc127080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efe01cb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 0x7efdfc127080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48126/0 (socket says 172.21.15.53:48126) 2024-09-22T08:14:02.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efe01cb3640 1 -- 172.21.15.53:0/1047033494 learned_addr learned my addr 172.21.15.53:0/1047033494 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:02.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efe01cb3640 1 -- 172.21.15.53:0/1047033494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc129b50 con 0x7efdfc06e170 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efe01cb3640 1 --2- 172.21.15.53:0/1047033494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 0x7efdfc127080 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009750 tx=0x7efdf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efdee7fc640 1 -- 172.21.15.53:0/1047033494 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf8041070 con 0x7efdfc06e170 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efdee7fc640 1 -- 172.21.15.53:0/1047033494 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf803c590 con 0x7efdfc06e170 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efe03f17640 1 -- 172.21.15.53:0/1047033494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc129620 con 0x7efdfc06e170 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.632+0000 7efdee7fc640 1 -- 172.21.15.53:0/1047033494 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf8037040 con 0x7efdfc06e170 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.633+0000 7efe03f17640 1 -- 172.21.15.53:0/1047033494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc1277a0 con 0x7efdfc06e170 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.633+0000 7efdee7fc640 1 -- 172.21.15.53:0/1047033494 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efdf8044070 con 0x7efdfc06e170 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.633+0000 7efdee7fc640 1 --2- 172.21.15.53:0/1047033494 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efde003e710 0x7efde0040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.633+0000 7efe03f17640 1 -- 172.21.15.53:0/1047033494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdfc06e550 con 0x7efdfc06e170 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.634+0000 7efdee7fc640 1 -- 172.21.15.53:0/1047033494 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efdf8074300 con 0x7efdfc06e170 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.634+0000 7efe014b2640 1 --2- 172.21.15.53:0/1047033494 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efde003e710 0x7efde0040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.634+0000 7efe014b2640 1 --2- 172.21.15.53:0/1047033494 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efde003e710 0x7efde0040bd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efdf0007fd0 tx=0x7efdf0007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.638+0000 7efdee7fc640 1 -- 172.21.15.53:0/1047033494 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efdf802ad10 con 0x7efdfc06e170 2024-09-22T08:14:02.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.828+0000 7efe03f17640 1 -- 172.21.15.53:0/1047033494 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7efdfc128a90 con 0x7efde003e710 2024-09-22T08:14:02.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.829+0000 7efdee7fc640 1 -- 172.21.15.53:0/1047033494 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efdfc128a90 con 0x7efde003e710 2024-09-22T08:14:02.831 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2024-09-22T08:14:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.832+0000 7efe03f17640 1 -- 172.21.15.53:0/1047033494 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efde003e710 msgr2=0x7efde0040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.832+0000 7efe03f17640 1 --2- 172.21.15.53:0/1047033494 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efde003e710 0x7efde0040bd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7efdf0007fd0 tx=0x7efdf0007ac0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.832+0000 7efe03f17640 1 -- 172.21.15.53:0/1047033494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 msgr2=0x7efdfc127080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.832+0000 7efe03f17640 1 --2- 172.21.15.53:0/1047033494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 0x7efdfc127080 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009750 tx=0x7efdf80046c0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.832+0000 7efe03f17640 1 -- 172.21.15.53:0/1047033494 shutdown_connections 2024-09-22T08:14:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.832+0000 7efe03f17640 1 --2- 172.21.15.53:0/1047033494 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7efde003e710 0x7efde0040bd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.832+0000 7efe03f17640 1 --2- 172.21.15.53:0/1047033494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdfc06e170 0x7efdfc127080 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.832+0000 7efe03f17640 1 -- 172.21.15.53:0/1047033494 >> 172.21.15.53:0/1047033494 conn(0x7efdfc09ac80 msgr2=0x7efdfc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.832+0000 7efe03f17640 1 -- 172.21.15.53:0/1047033494 shutdown_connections 2024-09-22T08:14:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.832+0000 7efe03f17640 1 -- 172.21.15.53:0/1047033494 wait complete. 2024-09-22T08:14:02.844 INFO:tasks.ceph:Scrubbing osd.1 2024-09-22T08:14:02.844 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:14:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.948+0000 7f5717652640 1 Processor -- start 2024-09-22T08:14:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.948+0000 7f5717652640 1 -- start start 2024-09-22T08:14:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.948+0000 7f5717652640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5710094390 0x7f5710094770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.948+0000 7f5717652640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5710097980 con 0x7f571012d140 2024-09-22T08:14:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.948+0000 7f5717652640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f571009a270 con 0x7f5710094390 2024-09-22T08:14:02.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.949+0000 7f57153ee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5710094390 0x7f5710094770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.949+0000 7f5714bed640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f571012d140 0x7f571012d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56252/0 (socket says 172.21.15.53:56252) 2024-09-22T08:14:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.949+0000 7f5714bed640 1 -- 172.21.15.53:0/743337698 learned_addr learned my addr 172.21.15.53:0/743337698 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.949+0000 7f57153ee640 1 -- 172.21.15.53:0/743337698 >> v1:172.21.15.53:6789/0 conn(0x7f571012d140 legacy=0x7f571012d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.949+0000 7f57153ee640 1 -- 172.21.15.53:0/743337698 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5710099e00 con 0x7f5710094390 2024-09-22T08:14:02.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.949+0000 7f57153ee640 1 --2- 172.21.15.53:0/743337698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 0x7f5710094770 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f570c009750 tx=0x7f570c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12cd7b5295abc3f server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.950+0000 7f5707fff640 1 -- 172.21.15.53:0/743337698 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f570c037070 con 0x7f5710094390 2024-09-22T08:14:02.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.950+0000 7f5707fff640 1 -- 172.21.15.53:0/743337698 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c02ad80 con 0x7f5710094390 2024-09-22T08:14:02.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.950+0000 7f5707fff640 1 -- 172.21.15.53:0/743337698 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f570c032590 con 0x7f5710094390 2024-09-22T08:14:02.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.950+0000 7f5717652640 1 -- 172.21.15.53:0/743337698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 msgr2=0x7f5710094770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.950+0000 7f5717652640 1 --2- 172.21.15.53:0/743337698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 0x7f5710094770 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f570c009750 tx=0x7f570c02a140 comp rx=0 tx=0).stop 2024-09-22T08:14:02.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.950+0000 7f5717652640 1 -- 172.21.15.53:0/743337698 shutdown_connections 2024-09-22T08:14:02.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.950+0000 7f5717652640 1 --2- 172.21.15.53:0/743337698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 0x7f5710094770 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.950+0000 7f5717652640 1 -- 172.21.15.53:0/743337698 >> 172.21.15.53:0/743337698 conn(0x7f571009ac80 msgr2=0x7f571009b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:02.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.950+0000 7f5717652640 1 -- 172.21.15.53:0/743337698 shutdown_connections 2024-09-22T08:14:02.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.950+0000 7f5717652640 1 -- 172.21.15.53:0/743337698 wait complete. 2024-09-22T08:14:02.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.951+0000 7f5717652640 1 Processor -- start 2024-09-22T08:14:02.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.951+0000 7f5717652640 1 -- start start 2024-09-22T08:14:02.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f5717652640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 0x7f57101c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f5717652640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5710094e30 con 0x7f5710094390 2024-09-22T08:14:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f57153ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 0x7f57101c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f57153ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 0x7f57101c22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48150/0 (socket says 172.21.15.53:48150) 2024-09-22T08:14:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f57153ee640 1 -- 172.21.15.53:0/1344497339 learned_addr learned my addr 172.21.15.53:0/1344497339 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f57153ee640 1 -- 172.21.15.53:0/1344497339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5710097e60 con 0x7f5710094390 2024-09-22T08:14:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f57153ee640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 0x7f57101c22c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f570c009870 tx=0x7f570c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f5705ffb640 1 -- 172.21.15.53:0/1344497339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f570c041070 con 0x7f5710094390 2024-09-22T08:14:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f5705ffb640 1 -- 172.21.15.53:0/1344497339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c03c590 con 0x7f5710094390 2024-09-22T08:14:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f5705ffb640 1 -- 172.21.15.53:0/1344497339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f570c037040 con 0x7f5710094390 2024-09-22T08:14:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.952+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5710129730 con 0x7f5710094390 2024-09-22T08:14:02.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.953+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57101c29e0 con 0x7f5710094390 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.953+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5710094770 con 0x7f5710094390 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.953+0000 7f5705ffb640 1 -- 172.21.15.53:0/1344497339 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f570c044070 con 0x7f5710094390 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.954+0000 7f5705ffb640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f56f403e710 0x7f56f4040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.954+0000 7f5705ffb640 1 -- 172.21.15.53:0/1344497339 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f570c0740e0 con 0x7f5710094390 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.954+0000 7f5705ffb640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7f56f404abe0 0x7f56f404d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.954+0000 7f5705ffb640 1 -- 172.21.15.53:0/1344497339 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f570c033e50 con 0x7f56f404abe0 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.954+0000 7f5705ffb640 1 -- 172.21.15.53:0/1344497339 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f570c07b050 con 0x7f5710094390 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.954+0000 7f5714bed640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f56f403e710 0x7f56f4040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.954+0000 7f5715bef640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7f56f404abe0 0x7f56f404d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.955+0000 7f5714bed640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f56f403e710 0x7f56f4040bd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5700007fd0 tx=0x7f5700007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.955+0000 7f5715bef640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7f56f404abe0 0x7f56f404d080 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.957+0000 7f5705ffb640 1 -- 172.21.15.53:0/1344497339 <== osd.1 v2:172.21.15.165:6816/2347568643 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f570c033e50 con 0x7f56f404abe0 2024-09-22T08:14:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.970+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 --> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f571012d140 con 0x7f56f404abe0 2024-09-22T08:14:02.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5705ffb640 1 -- 172.21.15.53:0/1344497339 <== osd.1 v2:172.21.15.165:6816/2347568643 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f571012d140 con 0x7f56f404abe0 2024-09-22T08:14:02.972 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-22T08:14:02.973 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:14:02.973 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-22T08:14:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7f56f404abe0 msgr2=0x7f56f404d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7f56f404abe0 0x7f56f404d080 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f56f403e710 msgr2=0x7f56f4040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f56f403e710 0x7f56f4040bd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5700007fd0 tx=0x7f5700007aa0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 msgr2=0x7f57101c22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 0x7f57101c22c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f570c009870 tx=0x7f570c0046c0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 shutdown_connections 2024-09-22T08:14:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6816/2347568643,v1:172.21.15.165:6817/2347568643] conn(0x7f56f404abe0 0x7f56f404d080 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f56f403e710 0x7f56f4040bd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 --2- 172.21.15.53:0/1344497339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710094390 0x7f57101c22c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.971+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 >> 172.21.15.53:0/1344497339 conn(0x7f571009ac80 msgr2=0x7f571009bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.972+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 shutdown_connections 2024-09-22T08:14:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:02.972+0000 7f5717652640 1 -- 172.21.15.53:0/1344497339 wait complete. 2024-09-22T08:14:02.983 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-22T08:14:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.083+0000 7f1cc4a59640 1 Processor -- start 2024-09-22T08:14:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.083+0000 7f1cc4a59640 1 -- start start 2024-09-22T08:14:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.084+0000 7f1cc4a59640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1cc006e170 0x7f1cc006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.084+0000 7f1cc4a59640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc0071770 con 0x7f1cc0071e30 2024-09-22T08:14:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.084+0000 7f1cc4a59640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc0099ee0 con 0x7f1cc006e170 2024-09-22T08:14:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.084+0000 7f1cbe59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1cc006e170 0x7f1cc006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.084+0000 7f1cbdd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1cc0071e30 0x7f1cc0097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56266/0 (socket says 172.21.15.53:56266) 2024-09-22T08:14:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.084+0000 7f1cbdd9b640 1 -- 172.21.15.53:0/955206261 learned_addr learned my addr 172.21.15.53:0/955206261 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.084+0000 7f1cbe59c640 1 -- 172.21.15.53:0/955206261 >> v1:172.21.15.53:6789/0 conn(0x7f1cc0071e30 legacy=0x7f1cc0097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.084+0000 7f1cbe59c640 1 -- 172.21.15.53:0/955206261 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc0072530 con 0x7f1cc006e170 2024-09-22T08:14:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.085+0000 7f1cbe59c640 1 --2- 172.21.15.53:0/955206261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 0x7f1cc006e550 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009750 tx=0x7f1cb002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bdbe0ad51b6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.085+0000 7f1cbd59a640 1 -- 172.21.15.53:0/955206261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb0037070 con 0x7f1cc006e170 2024-09-22T08:14:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.085+0000 7f1cbd59a640 1 -- 172.21.15.53:0/955206261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb002ad80 con 0x7f1cc006e170 2024-09-22T08:14:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.085+0000 7f1cbd59a640 1 -- 172.21.15.53:0/955206261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb0032590 con 0x7f1cc006e170 2024-09-22T08:14:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.086+0000 7f1cc4a59640 1 -- 172.21.15.53:0/955206261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 msgr2=0x7f1cc006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.086+0000 7f1cc4a59640 1 --2- 172.21.15.53:0/955206261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 0x7f1cc006e550 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009750 tx=0x7f1cb002a140 comp rx=0 tx=0).stop 2024-09-22T08:14:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.086+0000 7f1cc4a59640 1 -- 172.21.15.53:0/955206261 shutdown_connections 2024-09-22T08:14:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.086+0000 7f1cc4a59640 1 --2- 172.21.15.53:0/955206261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 0x7f1cc006e550 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.086+0000 7f1cc4a59640 1 -- 172.21.15.53:0/955206261 >> 172.21.15.53:0/955206261 conn(0x7f1cc009ac80 msgr2=0x7f1cc0098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.086+0000 7f1cc4a59640 1 -- 172.21.15.53:0/955206261 shutdown_connections 2024-09-22T08:14:03.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.086+0000 7f1cc4a59640 1 -- 172.21.15.53:0/955206261 wait complete. 2024-09-22T08:14:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.087+0000 7f1cc4a59640 1 Processor -- start 2024-09-22T08:14:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.087+0000 7f1cc4a59640 1 -- start start 2024-09-22T08:14:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.087+0000 7f1cc4a59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 0x7f1cc0127080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.087+0000 7f1cc4a59640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc006ee20 con 0x7f1cc006e170 2024-09-22T08:14:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.087+0000 7f1cbe59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 0x7f1cc0127080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.087+0000 7f1cbe59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 0x7f1cc0127080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48172/0 (socket says 172.21.15.53:48172) 2024-09-22T08:14:03.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.087+0000 7f1cbe59c640 1 -- 172.21.15.53:0/2302072566 learned_addr learned my addr 172.21.15.53:0/2302072566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:03.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.088+0000 7f1cbe59c640 1 -- 172.21.15.53:0/2302072566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc0129b50 con 0x7f1cc006e170 2024-09-22T08:14:03.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.088+0000 7f1cbe59c640 1 --2- 172.21.15.53:0/2302072566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 0x7f1cc0127080 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009750 tx=0x7f1cb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.088+0000 7f1caeffd640 1 -- 172.21.15.53:0/2302072566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb0041070 con 0x7f1cc006e170 2024-09-22T08:14:03.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.088+0000 7f1caeffd640 1 -- 172.21.15.53:0/2302072566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb003c590 con 0x7f1cc006e170 2024-09-22T08:14:03.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.088+0000 7f1caeffd640 1 -- 172.21.15.53:0/2302072566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cb0037040 con 0x7f1cc006e170 2024-09-22T08:14:03.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.088+0000 7f1cc4a59640 1 -- 172.21.15.53:0/2302072566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc0129620 con 0x7f1cc006e170 2024-09-22T08:14:03.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.088+0000 7f1cc4a59640 1 -- 172.21.15.53:0/2302072566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc01277a0 con 0x7f1cc006e170 2024-09-22T08:14:03.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.089+0000 7f1caeffd640 1 -- 172.21.15.53:0/2302072566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1cb0044070 con 0x7f1cc006e170 2024-09-22T08:14:03.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.089+0000 7f1cc4a59640 1 -- 172.21.15.53:0/2302072566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc006e550 con 0x7f1cc006e170 2024-09-22T08:14:03.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.089+0000 7f1caeffd640 1 --2- 172.21.15.53:0/2302072566 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1ca003e710 0x7f1ca0040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.089+0000 7f1caeffd640 1 -- 172.21.15.53:0/2302072566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1cb0074300 con 0x7f1cc006e170 2024-09-22T08:14:03.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.090+0000 7f1cbdd9b640 1 --2- 172.21.15.53:0/2302072566 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1ca003e710 0x7f1ca0040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.090+0000 7f1cbdd9b640 1 --2- 172.21.15.53:0/2302072566 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1ca003e710 0x7f1ca0040bd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4007fd0 tx=0x7f1cb4007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.094+0000 7f1caeffd640 1 -- 172.21.15.53:0/2302072566 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1cb002ad10 con 0x7f1cc006e170 2024-09-22T08:14:03.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.285+0000 7f1cc4a59640 1 -- 172.21.15.53:0/2302072566 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f1cc0128a90 con 0x7f1ca003e710 2024-09-22T08:14:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.286+0000 7f1caeffd640 1 -- 172.21.15.53:0/2302072566 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1cc0128a90 con 0x7f1ca003e710 2024-09-22T08:14:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2024-09-22T08:14:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.288+0000 7f1cc4a59640 1 -- 172.21.15.53:0/2302072566 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1ca003e710 msgr2=0x7f1ca0040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.288+0000 7f1cc4a59640 1 --2- 172.21.15.53:0/2302072566 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1ca003e710 0x7f1ca0040bd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4007fd0 tx=0x7f1cb4007ac0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.288+0000 7f1cc4a59640 1 -- 172.21.15.53:0/2302072566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 msgr2=0x7f1cc0127080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.288+0000 7f1cc4a59640 1 --2- 172.21.15.53:0/2302072566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 0x7f1cc0127080 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009750 tx=0x7f1cb00046c0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.288+0000 7f1cc4a59640 1 -- 172.21.15.53:0/2302072566 shutdown_connections 2024-09-22T08:14:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.288+0000 7f1cc4a59640 1 --2- 172.21.15.53:0/2302072566 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f1ca003e710 0x7f1ca0040bd0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.288+0000 7f1cc4a59640 1 --2- 172.21.15.53:0/2302072566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cc006e170 0x7f1cc0127080 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.288+0000 7f1cc4a59640 1 -- 172.21.15.53:0/2302072566 >> 172.21.15.53:0/2302072566 conn(0x7f1cc009ac80 msgr2=0x7f1cc009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.288+0000 7f1cc4a59640 1 -- 172.21.15.53:0/2302072566 shutdown_connections 2024-09-22T08:14:03.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.288+0000 7f1cc4a59640 1 -- 172.21.15.53:0/2302072566 wait complete. 2024-09-22T08:14:03.300 INFO:tasks.ceph:Scrubbing osd.2 2024-09-22T08:14:03.300 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:14:03.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.404+0000 7fc028f32640 1 Processor -- start 2024-09-22T08:14:03.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.404+0000 7fc028f32640 1 -- start start 2024-09-22T08:14:03.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.404+0000 7fc028f32640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc02412bd40 0x7fc024096630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.404+0000 7fc028f32640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc024097f10 con 0x7fc02412c120 2024-09-22T08:14:03.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.404+0000 7fc028f32640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc02412ba50 con 0x7fc02412bd40 2024-09-22T08:14:03.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.404+0000 7fc02259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc02412bd40 0x7fc024096630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.404+0000 7fc021d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc02412c120 0x7fc024128260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56270/0 (socket says 172.21.15.53:56270) 2024-09-22T08:14:03.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.405+0000 7fc02259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc02412bd40 0x7fc024096630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48174/0 (socket says 172.21.15.53:48174) 2024-09-22T08:14:03.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.405+0000 7fc021d9b640 1 -- 172.21.15.53:0/3214773510 learned_addr learned my addr 172.21.15.53:0/3214773510 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:03.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.405+0000 7fc02259c640 1 -- 172.21.15.53:0/3214773510 >> v1:172.21.15.53:6789/0 conn(0x7fc02412c120 legacy=0x7fc024128260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.405+0000 7fc02259c640 1 -- 172.21.15.53:0/3214773510 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02412c590 con 0x7fc02412bd40 2024-09-22T08:14:03.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.405+0000 7fc02259c640 1 --2- 172.21.15.53:0/3214773510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 0x7fc024096630 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc014009750 tx=0x7fc01402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780657ebf0d4f194 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.406+0000 7fc02159a640 1 -- 172.21.15.53:0/3214773510 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc014037070 con 0x7fc02412bd40 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.406+0000 7fc02159a640 1 -- 172.21.15.53:0/3214773510 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01402ad80 con 0x7fc02412bd40 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.406+0000 7fc02159a640 1 -- 172.21.15.53:0/3214773510 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc014032590 con 0x7fc02412bd40 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.406+0000 7fc028f32640 1 -- 172.21.15.53:0/3214773510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 msgr2=0x7fc024096630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.406+0000 7fc028f32640 1 --2- 172.21.15.53:0/3214773510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 0x7fc024096630 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc014009750 tx=0x7fc01402a140 comp rx=0 tx=0).stop 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.406+0000 7fc028f32640 1 -- 172.21.15.53:0/3214773510 shutdown_connections 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.406+0000 7fc028f32640 1 --2- 172.21.15.53:0/3214773510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 0x7fc024096630 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.406+0000 7fc028f32640 1 -- 172.21.15.53:0/3214773510 >> 172.21.15.53:0/3214773510 conn(0x7fc02409ac80 msgr2=0x7fc02409b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.406+0000 7fc028f32640 1 -- 172.21.15.53:0/3214773510 shutdown_connections 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.406+0000 7fc028f32640 1 -- 172.21.15.53:0/3214773510 wait complete. 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.407+0000 7fc028f32640 1 Processor -- start 2024-09-22T08:14:03.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.407+0000 7fc028f32640 1 -- start start 2024-09-22T08:14:03.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc028f32640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 0x7fc024072580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc028f32640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc024099f20 con 0x7fc02412bd40 2024-09-22T08:14:03.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc02259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 0x7fc024072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc02259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 0x7fc024072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48184/0 (socket says 172.21.15.53:48184) 2024-09-22T08:14:03.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc02259c640 1 -- 172.21.15.53:0/1065043074 learned_addr learned my addr 172.21.15.53:0/1065043074 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:03.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc02259c640 1 -- 172.21.15.53:0/1065043074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0240736b0 con 0x7fc02412bd40 2024-09-22T08:14:03.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc02259c640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 0x7fc024072580 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc014009750 tx=0x7fc0140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc012ffd640 1 -- 172.21.15.53:0/1065043074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc014041070 con 0x7fc02412bd40 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc012ffd640 1 -- 172.21.15.53:0/1065043074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01403c590 con 0x7fc02412bd40 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc024125f30 con 0x7fc02412bd40 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc012ffd640 1 -- 172.21.15.53:0/1065043074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc014037040 con 0x7fc02412bd40 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.408+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc024128880 con 0x7fc02412bd40 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.409+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc02408c180 con 0x7fc02412bd40 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.409+0000 7fc012ffd640 1 -- 172.21.15.53:0/1065043074 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc014044070 con 0x7fc02412bd40 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.410+0000 7fc012ffd640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc00403e740 0x7fc004040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.410+0000 7fc012ffd640 1 -- 172.21.15.53:0/1065043074 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc0140740d0 con 0x7fc02412bd40 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.410+0000 7fc012ffd640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7fc00404abb0 0x7fc00404d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.410+0000 7fc012ffd640 1 -- 172.21.15.53:0/1065043074 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc00404d720 con 0x7fc00404abb0 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.410+0000 7fc012ffd640 1 -- 172.21.15.53:0/1065043074 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc01407b050 con 0x7fc02412bd40 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.410+0000 7fc021d9b640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc00403e740 0x7fc004040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.410+0000 7fc022d9d640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7fc00404abb0 0x7fc00404d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.410+0000 7fc022d9d640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7fc00404abb0 0x7fc00404d050 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.411+0000 7fc021d9b640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc00403e740 0x7fc004040c00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc018007fd0 tx=0x7fc018007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.411+0000 7fc012ffd640 1 -- 172.21.15.53:0/1065043074 <== osd.2 v2:172.21.15.165:6808/3197121696 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc00404d720 con 0x7fc00404abb0 2024-09-22T08:14:03.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.424+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 --> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc024073f30 con 0x7fc00404abb0 2024-09-22T08:14:03.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.424+0000 7fc012ffd640 1 -- 172.21.15.53:0/1065043074 <== osd.2 v2:172.21.15.165:6808/3197121696 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc01c00ad10 con 0x7fc00404abb0 2024-09-22T08:14:03.426 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-22T08:14:03.426 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:14:03.426 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.424+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7fc00404abb0 msgr2=0x7fc00404d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.424+0000 7fc028f32640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7fc00404abb0 0x7fc00404d050 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc00403e740 msgr2=0x7fc004040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc00403e740 0x7fc004040c00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc018007fd0 tx=0x7fc018007ac0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 msgr2=0x7fc024072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 0x7fc024072580 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc014009750 tx=0x7fc0140046c0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 shutdown_connections 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6808/3197121696,v1:172.21.15.165:6809/3197121696] conn(0x7fc00404abb0 0x7fc00404d050 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc00403e740 0x7fc004040c00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 --2- 172.21.15.53:0/1065043074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc02412bd40 0x7fc024072580 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 >> 172.21.15.53:0/1065043074 conn(0x7fc02409ac80 msgr2=0x7fc02409bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:03.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 shutdown_connections 2024-09-22T08:14:03.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.425+0000 7fc028f32640 1 -- 172.21.15.53:0/1065043074 wait complete. 2024-09-22T08:14:03.436 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-22T08:14:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.536+0000 7fc0b6060640 1 Processor -- start 2024-09-22T08:14:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0b6060640 1 -- start start 2024-09-22T08:14:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0b6060640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0b006fd70 0x7fc0b0131660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0b6060640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b0071920 con 0x7fc0b006f280 2024-09-22T08:14:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0b6060640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b0071610 con 0x7fc0b006fd70 2024-09-22T08:14:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0af7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc0b006f280 0x7fc0b006f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56284/0 (socket says 172.21.15.53:56284) 2024-09-22T08:14:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0af7fe640 1 -- 172.21.15.53:0/3434352182 learned_addr learned my addr 172.21.15.53:0/3434352182 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0aeffd640 1 --2- 172.21.15.53:0/3434352182 >> v2:172.21.15.53:3300/0 conn(0x7fc0b006fd70 0x7fc0b0131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0ae7fc640 1 -- 172.21.15.53:0/3434352182 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283507215 0 0) 0x7fc0b0071920 con 0x7fc0b006f280 2024-09-22T08:14:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0ae7fc640 1 -- 172.21.15.53:0/3434352182 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc098003520 con 0x7fc0b006f280 2024-09-22T08:14:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0aeffd640 1 -- 172.21.15.53:0/3434352182 >> v1:172.21.15.53:6789/0 conn(0x7fc0b006f280 legacy=0x7fc0b006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.537+0000 7fc0aeffd640 1 -- 172.21.15.53:0/3434352182 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b0070ec0 con 0x7fc0b006fd70 2024-09-22T08:14:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.538+0000 7fc0aeffd640 1 --2- 172.21.15.53:0/3434352182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006fd70 0x7fc0b0131660 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009720 tx=0x7fc0a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2041da1305a3742 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.538+0000 7fc0ae7fc640 1 -- 172.21.15.53:0/3434352182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4037070 con 0x7fc0b006fd70 2024-09-22T08:14:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.538+0000 7fc0ae7fc640 1 -- 172.21.15.53:0/3434352182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a402ad90 con 0x7fc0b006fd70 2024-09-22T08:14:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.538+0000 7fc0ae7fc640 1 -- 172.21.15.53:0/3434352182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a4032570 con 0x7fc0b006fd70 2024-09-22T08:14:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.539+0000 7fc0b6060640 1 -- 172.21.15.53:0/3434352182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006fd70 msgr2=0x7fc0b0131660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.539+0000 7fc0b6060640 1 --2- 172.21.15.53:0/3434352182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006fd70 0x7fc0b0131660 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009720 tx=0x7fc0a402a110 comp rx=0 tx=0).stop 2024-09-22T08:14:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.539+0000 7fc0b6060640 1 -- 172.21.15.53:0/3434352182 shutdown_connections 2024-09-22T08:14:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.539+0000 7fc0b6060640 1 --2- 172.21.15.53:0/3434352182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006fd70 0x7fc0b0131660 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.539+0000 7fc0b6060640 1 -- 172.21.15.53:0/3434352182 >> 172.21.15.53:0/3434352182 conn(0x7fc0b009ac80 msgr2=0x7fc0b0098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.539+0000 7fc0b6060640 1 -- 172.21.15.53:0/3434352182 shutdown_connections 2024-09-22T08:14:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.539+0000 7fc0b6060640 1 -- 172.21.15.53:0/3434352182 wait complete. 2024-09-22T08:14:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.540+0000 7fc0b6060640 1 Processor -- start 2024-09-22T08:14:03.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.540+0000 7fc0b6060640 1 -- start start 2024-09-22T08:14:03.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.540+0000 7fc0b6060640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006f280 0x7fc0b0127f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.540+0000 7fc0b6060640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b0131ba0 con 0x7fc0b006f280 2024-09-22T08:14:03.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.540+0000 7fc0af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006f280 0x7fc0b0127f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.540+0000 7fc0af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006f280 0x7fc0b0127f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48208/0 (socket says 172.21.15.53:48208) 2024-09-22T08:14:03.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.540+0000 7fc0af7fe640 1 -- 172.21.15.53:0/1550672474 learned_addr learned my addr 172.21.15.53:0/1550672474 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:03.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.541+0000 7fc0af7fe640 1 -- 172.21.15.53:0/1550672474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b0073fb0 con 0x7fc0b006f280 2024-09-22T08:14:03.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.541+0000 7fc0af7fe640 1 --2- 172.21.15.53:0/1550672474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006f280 0x7fc0b0127f00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c480 tx=0x7fc0a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.541+0000 7fc097fff640 1 -- 172.21.15.53:0/1550672474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a0017070 con 0x7fc0b006f280 2024-09-22T08:14:03.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.541+0000 7fc097fff640 1 -- 172.21.15.53:0/1550672474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a0005cd0 con 0x7fc0b006f280 2024-09-22T08:14:03.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.541+0000 7fc0b6060640 1 -- 172.21.15.53:0/1550672474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b008cf30 con 0x7fc0b006f280 2024-09-22T08:14:03.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.541+0000 7fc097fff640 1 -- 172.21.15.53:0/1550672474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a0007200 con 0x7fc0b006f280 2024-09-22T08:14:03.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.541+0000 7fc0b6060640 1 -- 172.21.15.53:0/1550672474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b0128440 con 0x7fc0b006f280 2024-09-22T08:14:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.542+0000 7fc097fff640 1 -- 172.21.15.53:0/1550672474 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc0a001a070 con 0x7fc0b006f280 2024-09-22T08:14:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.542+0000 7fc0b6060640 1 -- 172.21.15.53:0/1550672474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b006f660 con 0x7fc0b006f280 2024-09-22T08:14:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.542+0000 7fc097fff640 1 --2- 172.21.15.53:0/1550672474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc09c03e710 0x7fc09c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.542+0000 7fc097fff640 1 -- 172.21.15.53:0/1550672474 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc0a0052b20 con 0x7fc0b006f280 2024-09-22T08:14:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.542+0000 7fc0aeffd640 1 --2- 172.21.15.53:0/1550672474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc09c03e710 0x7fc09c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.543+0000 7fc0aeffd640 1 --2- 172.21.15.53:0/1550672474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc09c03e710 0x7fc09c040bd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4034000 tx=0x7fc0a402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.547+0000 7fc097fff640 1 -- 172.21.15.53:0/1550672474 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc0a001b3b0 con 0x7fc0b006f280 2024-09-22T08:14:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.737+0000 7fc0b6060640 1 -- 172.21.15.53:0/1550672474 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc0b008cbb0 con 0x7fc09c03e710 2024-09-22T08:14:03.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.739+0000 7fc097fff640 1 -- 172.21.15.53:0/1550672474 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc0a4032610 con 0x7fc09c03e710 2024-09-22T08:14:03.740 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2024-09-22T08:14:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.741+0000 7fc0b6060640 1 -- 172.21.15.53:0/1550672474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc09c03e710 msgr2=0x7fc09c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.741+0000 7fc0b6060640 1 --2- 172.21.15.53:0/1550672474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc09c03e710 0x7fc09c040bd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4034000 tx=0x7fc0a402e000 comp rx=0 tx=0).stop 2024-09-22T08:14:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.741+0000 7fc0b6060640 1 -- 172.21.15.53:0/1550672474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006f280 msgr2=0x7fc0b0127f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.741+0000 7fc0b6060640 1 --2- 172.21.15.53:0/1550672474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006f280 0x7fc0b0127f00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c480 tx=0x7fc0a000c940 comp rx=0 tx=0).stop 2024-09-22T08:14:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.741+0000 7fc0b6060640 1 -- 172.21.15.53:0/1550672474 shutdown_connections 2024-09-22T08:14:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.741+0000 7fc0b6060640 1 --2- 172.21.15.53:0/1550672474 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fc09c03e710 0x7fc09c040bd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.741+0000 7fc0b6060640 1 --2- 172.21.15.53:0/1550672474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b006f280 0x7fc0b0127f00 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.741+0000 7fc0b6060640 1 -- 172.21.15.53:0/1550672474 >> 172.21.15.53:0/1550672474 conn(0x7fc0b009ac80 msgr2=0x7fc0b012bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.741+0000 7fc0b6060640 1 -- 172.21.15.53:0/1550672474 shutdown_connections 2024-09-22T08:14:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.741+0000 7fc0b6060640 1 -- 172.21.15.53:0/1550672474 wait complete. 2024-09-22T08:14:03.753 INFO:tasks.ceph:Scrubbing osd.3 2024-09-22T08:14:03.753 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-22T08:14:03.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.857+0000 7f78b339b640 1 Processor -- start 2024-09-22T08:14:03.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.858+0000 7f78b339b640 1 -- start start 2024-09-22T08:14:03.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.858+0000 7f78b339b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78ac094420 0x7f78ac094800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.858+0000 7f78b339b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78ac06e5f0 con 0x7f78ac12c090 2024-09-22T08:14:03.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.858+0000 7f78b339b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f78ac09a4b0 con 0x7f78ac094420 2024-09-22T08:14:03.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.858+0000 7f78b1137640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78ac094420 0x7f78ac094800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.858+0000 7f78b0936640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f78ac12c090 0x7f78ac12c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56294/0 (socket says 172.21.15.53:56294) 2024-09-22T08:14:03.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.858+0000 7f78b1137640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78ac094420 0x7f78ac094800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48216/0 (socket says 172.21.15.53:48216) 2024-09-22T08:14:03.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.858+0000 7f78b0936640 1 -- 172.21.15.53:0/1080147093 learned_addr learned my addr 172.21.15.53:0/1080147093 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:03.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.858+0000 7f78b1137640 1 -- 172.21.15.53:0/1080147093 >> v1:172.21.15.53:6789/0 conn(0x7f78ac12c090 legacy=0x7f78ac12c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.858+0000 7f78b1137640 1 -- 172.21.15.53:0/1080147093 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac099e00 con 0x7f78ac094420 2024-09-22T08:14:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.859+0000 7f78b1137640 1 --2- 172.21.15.53:0/1080147093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 0x7f78ac094800 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009720 tx=0x7f78a802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b104190c44094bd server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.859+0000 7f789ffff640 1 -- 172.21.15.53:0/1080147093 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78a8037070 con 0x7f78ac094420 2024-09-22T08:14:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.859+0000 7f789ffff640 1 -- 172.21.15.53:0/1080147093 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a802ae20 con 0x7f78ac094420 2024-09-22T08:14:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.859+0000 7f789ffff640 1 -- 172.21.15.53:0/1080147093 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78a8032590 con 0x7f78ac094420 2024-09-22T08:14:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.860+0000 7f78b339b640 1 -- 172.21.15.53:0/1080147093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 msgr2=0x7f78ac094800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.860+0000 7f78b339b640 1 --2- 172.21.15.53:0/1080147093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 0x7f78ac094800 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009720 tx=0x7f78a802a1a0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.860+0000 7f78b339b640 1 -- 172.21.15.53:0/1080147093 shutdown_connections 2024-09-22T08:14:03.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.860+0000 7f78b339b640 1 --2- 172.21.15.53:0/1080147093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 0x7f78ac094800 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.860+0000 7f78b339b640 1 -- 172.21.15.53:0/1080147093 >> 172.21.15.53:0/1080147093 conn(0x7f78ac09ac80 msgr2=0x7f78ac09b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:03.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.860+0000 7f78b339b640 1 -- 172.21.15.53:0/1080147093 shutdown_connections 2024-09-22T08:14:03.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.860+0000 7f78b339b640 1 -- 172.21.15.53:0/1080147093 wait complete. 2024-09-22T08:14:03.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.861+0000 7f78b339b640 1 Processor -- start 2024-09-22T08:14:03.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.861+0000 7f78b339b640 1 -- start start 2024-09-22T08:14:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.861+0000 7f78b339b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 0x7f78ac12b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.861+0000 7f78b339b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac094d40 con 0x7f78ac094420 2024-09-22T08:14:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.861+0000 7f78b1137640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 0x7f78ac12b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.861+0000 7f78b1137640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 0x7f78ac12b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48222/0 (socket says 172.21.15.53:48222) 2024-09-22T08:14:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.861+0000 7f78b1137640 1 -- 172.21.15.53:0/1386885771 learned_addr learned my addr 172.21.15.53:0/1386885771 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.861+0000 7f78b1137640 1 -- 172.21.15.53:0/1386885771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac073e80 con 0x7f78ac094420 2024-09-22T08:14:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.862+0000 7f78b1137640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 0x7f78ac12b710 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f78a802adf0 tx=0x7f78a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.862+0000 7f789dffb640 1 -- 172.21.15.53:0/1386885771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78a8041070 con 0x7f78ac094420 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.862+0000 7f789dffb640 1 -- 172.21.15.53:0/1386885771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a803c590 con 0x7f78ac094420 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.862+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ac093060 con 0x7f78ac094420 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.862+0000 7f789dffb640 1 -- 172.21.15.53:0/1386885771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78a8037040 con 0x7f78ac094420 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.862+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ac12bc50 con 0x7f78ac094420 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.863+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78ac092e90 con 0x7f78ac094420 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.863+0000 7f789dffb640 1 -- 172.21.15.53:0/1386885771 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f78a8044070 con 0x7f78ac094420 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.863+0000 7f789dffb640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f789003e740 0x7f7890040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.863+0000 7f789dffb640 1 -- 172.21.15.53:0/1386885771 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f78a8074000 con 0x7f78ac094420 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.863+0000 7f789dffb640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f789004ac10 0x7f789004d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.863+0000 7f789dffb640 1 -- 172.21.15.53:0/1386885771 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78a8004490 con 0x7f789004ac10 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.863+0000 7f789dffb640 1 -- 172.21.15.53:0/1386885771 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f78a807b050 con 0x7f78ac094420 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.864+0000 7f78b0936640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f789003e740 0x7f7890040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.864+0000 7f78b1938640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f789004ac10 0x7f789004d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.864+0000 7f78b1938640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f789004ac10 0x7f789004d0b0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.864+0000 7f78b0936640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f789003e740 0x7f7890040c00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f78a0007fd0 tx=0x7f78a0007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.865+0000 7f789dffb640 1 -- 172.21.15.53:0/1386885771 <== osd.3 v2:172.21.15.165:6800/215521179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f78a8004490 con 0x7f789004ac10 2024-09-22T08:14:03.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.877+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 --> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f78ac094800 con 0x7f789004ac10 2024-09-22T08:14:03.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.878+0000 7f789dffb640 1 -- 172.21.15.53:0/1386885771 <== osd.3 v2:172.21.15.165:6800/215521179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f78ac094800 con 0x7f789004ac10 2024-09-22T08:14:03.880 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-22T08:14:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T08:14:03.880 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-22T08:14:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f789004ac10 msgr2=0x7f789004d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f789004ac10 0x7f789004d0b0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f789003e740 msgr2=0x7f7890040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f789003e740 0x7f7890040c00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f78a0007fd0 tx=0x7f78a0007aa0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 msgr2=0x7f78ac12b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 0x7f78ac12b710 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f78a802adf0 tx=0x7f78a80046c0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 shutdown_connections 2024-09-22T08:14:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6800/215521179,v1:172.21.15.165:6801/215521179] conn(0x7f789004ac10 0x7f789004d0b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f789003e740 0x7f7890040c00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 --2- 172.21.15.53:0/1386885771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78ac094420 0x7f78ac12b710 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 >> 172.21.15.53:0/1386885771 conn(0x7f78ac09ac80 msgr2=0x7f78ac095a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 shutdown_connections 2024-09-22T08:14:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.879+0000 7f78b339b640 1 -- 172.21.15.53:0/1386885771 wait complete. 2024-09-22T08:14:03.890 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-22T08:14:03.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.991+0000 7f15df6b1640 1 Processor -- start 2024-09-22T08:14:03.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.991+0000 7f15df6b1640 1 -- start start 2024-09-22T08:14:03.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.991+0000 7f15df6b1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15d806e170 0x7f15d806e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.992+0000 7f15df6b1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d8071770 con 0x7f15d8071e30 2024-09-22T08:14:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.992+0000 7f15df6b1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f15d8099ee0 con 0x7f15d806e170 2024-09-22T08:14:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.992+0000 7f15dd44d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15d806e170 0x7f15d806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.992+0000 7f15dcc4c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f15d8071e30 0x7f15d8097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56310/0 (socket says 172.21.15.53:56310) 2024-09-22T08:14:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.992+0000 7f15dd44d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15d806e170 0x7f15d806e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48228/0 (socket says 172.21.15.53:48228) 2024-09-22T08:14:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.992+0000 7f15dcc4c640 1 -- 172.21.15.53:0/2024489657 learned_addr learned my addr 172.21.15.53:0/2024489657 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.992+0000 7f15dd44d640 1 -- 172.21.15.53:0/2024489657 >> v1:172.21.15.53:6789/0 conn(0x7f15d8071e30 legacy=0x7f15d8097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.992+0000 7f15dd44d640 1 -- 172.21.15.53:0/2024489657 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d8072530 con 0x7f15d806e170 2024-09-22T08:14:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.993+0000 7f15dd44d640 1 --2- 172.21.15.53:0/2024489657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 0x7f15d806e550 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009750 tx=0x7f15d402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d1486c3a903803 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.993+0000 7f15cffff640 1 -- 172.21.15.53:0/2024489657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4037070 con 0x7f15d806e170 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.993+0000 7f15cffff640 1 -- 172.21.15.53:0/2024489657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d402ad80 con 0x7f15d806e170 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.993+0000 7f15cffff640 1 -- 172.21.15.53:0/2024489657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4032590 con 0x7f15d806e170 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.993+0000 7f15df6b1640 1 -- 172.21.15.53:0/2024489657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 msgr2=0x7f15d806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.993+0000 7f15df6b1640 1 --2- 172.21.15.53:0/2024489657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 0x7f15d806e550 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009750 tx=0x7f15d402a140 comp rx=0 tx=0).stop 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.993+0000 7f15df6b1640 1 -- 172.21.15.53:0/2024489657 shutdown_connections 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.993+0000 7f15df6b1640 1 --2- 172.21.15.53:0/2024489657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 0x7f15d806e550 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.993+0000 7f15df6b1640 1 -- 172.21.15.53:0/2024489657 >> 172.21.15.53:0/2024489657 conn(0x7f15d809ac80 msgr2=0x7f15d8098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.993+0000 7f15df6b1640 1 -- 172.21.15.53:0/2024489657 shutdown_connections 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.994+0000 7f15df6b1640 1 -- 172.21.15.53:0/2024489657 wait complete. 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.994+0000 7f15df6b1640 1 Processor -- start 2024-09-22T08:14:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.994+0000 7f15df6b1640 1 -- start start 2024-09-22T08:14:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15df6b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 0x7f15d808bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15df6b1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f15d806ee20 con 0x7f15d806e170 2024-09-22T08:14:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15dd44d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 0x7f15d808bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15dd44d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 0x7f15d808bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48240/0 (socket says 172.21.15.53:48240) 2024-09-22T08:14:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15dd44d640 1 -- 172.21.15.53:0/1425640440 learned_addr learned my addr 172.21.15.53:0/1425640440 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15dd44d640 1 -- 172.21.15.53:0/1425640440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d808d5e0 con 0x7f15d806e170 2024-09-22T08:14:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15dd44d640 1 --2- 172.21.15.53:0/1425640440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 0x7f15d808bfc0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f15d402a180 tx=0x7f15d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15cdffb640 1 -- 172.21.15.53:0/1425640440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4041070 con 0x7f15d806e170 2024-09-22T08:14:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15cdffb640 1 -- 172.21.15.53:0/1425640440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d403c670 con 0x7f15d806e170 2024-09-22T08:14:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15df6b1640 1 -- 172.21.15.53:0/1425640440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d812a7f0 con 0x7f15d806e170 2024-09-22T08:14:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.995+0000 7f15cdffb640 1 -- 172.21.15.53:0/1425640440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d4037040 con 0x7f15d806e170 2024-09-22T08:14:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.996+0000 7f15df6b1640 1 -- 172.21.15.53:0/1425640440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d808e450 con 0x7f15d806e170 2024-09-22T08:14:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.997+0000 7f15cdffb640 1 -- 172.21.15.53:0/1425640440 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f15d4044070 con 0x7f15d806e170 2024-09-22T08:14:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.997+0000 7f15df6b1640 1 -- 172.21.15.53:0/1425640440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d806e550 con 0x7f15d806e170 2024-09-22T08:14:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.997+0000 7f15cdffb640 1 --2- 172.21.15.53:0/1425640440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f15bc03e710 0x7f15bc040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.997+0000 7f15cdffb640 1 -- 172.21.15.53:0/1425640440 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f15d4074190 con 0x7f15d806e170 2024-09-22T08:14:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.997+0000 7f15dcc4c640 1 --2- 172.21.15.53:0/1425640440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f15bc03e710 0x7f15bc040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:03.998+0000 7f15dcc4c640 1 --2- 172.21.15.53:0/1425640440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f15bc03e710 0x7f15bc040bd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f15c8000f60 tx=0x7f15c8007ae0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.002+0000 7f15cdffb640 1 -- 172.21.15.53:0/1425640440 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f15d4044c60 con 0x7f15d806e170 2024-09-22T08:14:04.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.189+0000 7f15df6b1640 1 -- 172.21.15.53:0/1425640440 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f15d808d140 con 0x7f15bc03e710 2024-09-22T08:14:04.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.191+0000 7f15cdffb640 1 -- 172.21.15.53:0/1425640440 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f15d808d140 con 0x7f15bc03e710 2024-09-22T08:14:04.192 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2024-09-22T08:14:04.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.193+0000 7f15df6b1640 1 -- 172.21.15.53:0/1425640440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f15bc03e710 msgr2=0x7f15bc040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:04.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.193+0000 7f15df6b1640 1 --2- 172.21.15.53:0/1425640440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f15bc03e710 0x7f15bc040bd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f15c8000f60 tx=0x7f15c8007ae0 comp rx=0 tx=0).stop 2024-09-22T08:14:04.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.193+0000 7f15df6b1640 1 -- 172.21.15.53:0/1425640440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 msgr2=0x7f15d808bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:04.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.193+0000 7f15df6b1640 1 --2- 172.21.15.53:0/1425640440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 0x7f15d808bfc0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f15d402a180 tx=0x7f15d40046c0 comp rx=0 tx=0).stop 2024-09-22T08:14:04.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.193+0000 7f15df6b1640 1 -- 172.21.15.53:0/1425640440 shutdown_connections 2024-09-22T08:14:04.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.193+0000 7f15df6b1640 1 --2- 172.21.15.53:0/1425640440 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f15bc03e710 0x7f15bc040bd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:04.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.193+0000 7f15df6b1640 1 --2- 172.21.15.53:0/1425640440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d806e170 0x7f15d808bfc0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:04.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.193+0000 7f15df6b1640 1 -- 172.21.15.53:0/1425640440 >> 172.21.15.53:0/1425640440 conn(0x7f15d809ac80 msgr2=0x7f15d812be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:04.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.193+0000 7f15df6b1640 1 -- 172.21.15.53:0/1425640440 shutdown_connections 2024-09-22T08:14:04.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.193+0000 7f15df6b1640 1 -- 172.21.15.53:0/1425640440 wait complete. 2024-09-22T08:14:04.205 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:14:04.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.305+0000 7f7f31285640 1 Processor -- start 2024-09-22T08:14:04.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.306+0000 7f7f31285640 1 -- start start 2024-09-22T08:14:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.306+0000 7f7f31285640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7f2c09e140 0x7f7f2c12fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.306+0000 7f7f31285640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f2c09e520 con 0x7f7f2c1301f0 2024-09-22T08:14:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.306+0000 7f7f31285640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2c12f870 con 0x7f7f2c09e140 2024-09-22T08:14:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.306+0000 7f7f2affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7f2c09e140 0x7f7f2c12fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.306+0000 7f7f23fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7f2c1301f0 0x7f7f2c12c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56322/0 (socket says 172.21.15.53:56322) 2024-09-22T08:14:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.306+0000 7f7f23fff640 1 -- 172.21.15.53:0/1854067163 learned_addr learned my addr 172.21.15.53:0/1854067163 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.306+0000 7f7f2affd640 1 -- 172.21.15.53:0/1854067163 >> v1:172.21.15.53:6789/0 conn(0x7f7f2c1301f0 legacy=0x7f7f2c12c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:04.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.306+0000 7f7f2affd640 1 -- 172.21.15.53:0/1854067163 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c12fa20 con 0x7f7f2c09e140 2024-09-22T08:14:04.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.307+0000 7f7f2affd640 1 --2- 172.21.15.53:0/1854067163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 0x7f7f2c12fcb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009720 tx=0x7f7f1c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487eb6e74c3a64bb server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.307+0000 7f7f2a7fc640 1 -- 172.21.15.53:0/1854067163 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f1c037070 con 0x7f7f2c09e140 2024-09-22T08:14:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.307+0000 7f7f2a7fc640 1 -- 172.21.15.53:0/1854067163 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1c02ad90 con 0x7f7f2c09e140 2024-09-22T08:14:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.307+0000 7f7f2a7fc640 1 -- 172.21.15.53:0/1854067163 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f1c032590 con 0x7f7f2c09e140 2024-09-22T08:14:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.308+0000 7f7f31285640 1 -- 172.21.15.53:0/1854067163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 msgr2=0x7f7f2c12fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.308+0000 7f7f31285640 1 --2- 172.21.15.53:0/1854067163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 0x7f7f2c12fcb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009720 tx=0x7f7f1c02a110 comp rx=0 tx=0).stop 2024-09-22T08:14:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.308+0000 7f7f31285640 1 -- 172.21.15.53:0/1854067163 shutdown_connections 2024-09-22T08:14:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.308+0000 7f7f31285640 1 --2- 172.21.15.53:0/1854067163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 0x7f7f2c12fcb0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.308+0000 7f7f31285640 1 -- 172.21.15.53:0/1854067163 >> 172.21.15.53:0/1854067163 conn(0x7f7f2c06e590 msgr2=0x7f7f2c06e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.308+0000 7f7f31285640 1 -- 172.21.15.53:0/1854067163 shutdown_connections 2024-09-22T08:14:04.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.308+0000 7f7f31285640 1 -- 172.21.15.53:0/1854067163 wait complete. 2024-09-22T08:14:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.309+0000 7f7f31285640 1 Processor -- start 2024-09-22T08:14:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.309+0000 7f7f31285640 1 -- start start 2024-09-22T08:14:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.309+0000 7f7f31285640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 0x7f7f2c1c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.309+0000 7f7f31285640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c12cba0 con 0x7f7f2c09e140 2024-09-22T08:14:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.309+0000 7f7f2affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 0x7f7f2c1c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.309+0000 7f7f2affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 0x7f7f2c1c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48260/0 (socket says 172.21.15.53:48260) 2024-09-22T08:14:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.309+0000 7f7f2affd640 1 -- 172.21.15.53:0/537964704 learned_addr learned my addr 172.21.15.53:0/537964704 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.310+0000 7f7f2affd640 1 -- 172.21.15.53:0/537964704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c08f180 con 0x7f7f2c09e140 2024-09-22T08:14:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.310+0000 7f7f2affd640 1 --2- 172.21.15.53:0/537964704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 0x7f7f2c1c4670 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009840 tx=0x7f7f1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.310+0000 7f7f237fe640 1 -- 172.21.15.53:0/537964704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f1c041020 con 0x7f7f2c09e140 2024-09-22T08:14:04.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.310+0000 7f7f237fe640 1 -- 172.21.15.53:0/537964704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1c03d550 con 0x7f7f2c09e140 2024-09-22T08:14:04.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.310+0000 7f7f31285640 1 -- 172.21.15.53:0/537964704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2c08eb60 con 0x7f7f2c09e140 2024-09-22T08:14:04.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.310+0000 7f7f237fe640 1 -- 172.21.15.53:0/537964704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f1c037040 con 0x7f7f2c09e140 2024-09-22T08:14:04.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.310+0000 7f7f31285640 1 -- 172.21.15.53:0/537964704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f2c08f790 con 0x7f7f2c09e140 2024-09-22T08:14:04.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.311+0000 7f7f237fe640 1 -- 172.21.15.53:0/537964704 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7f1c044020 con 0x7f7f2c09e140 2024-09-22T08:14:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.311+0000 7f7f237fe640 1 --2- 172.21.15.53:0/537964704 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f0c03e710 0x7f7f0c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.311+0000 7f7f31285640 1 -- 172.21.15.53:0/537964704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f2c09c390 con 0x7f7f2c09e140 2024-09-22T08:14:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.311+0000 7f7f237fe640 1 -- 172.21.15.53:0/537964704 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7f1c073f40 con 0x7f7f2c09e140 2024-09-22T08:14:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.311+0000 7f7f23fff640 1 --2- 172.21.15.53:0/537964704 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f0c03e710 0x7f7f0c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:04.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.312+0000 7f7f23fff640 1 --2- 172.21.15.53:0/537964704 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f0c03e710 0x7f7f0c040bd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7f14007fd0 tx=0x7f7f14007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:04.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.316+0000 7f7f237fe640 1 -- 172.21.15.53:0/537964704 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7f2c09c390 con 0x7f7f2c09e140 2024-09-22T08:14:04.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.504+0000 7f7f31285640 1 -- 172.21.15.53:0/537964704 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f2c12fcb0 con 0x7f7f0c03e710 2024-09-22T08:14:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.515+0000 7f7f237fe640 1 -- 172.21.15.53:0/537964704 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665905 (secure 0 0 0) 0x7f7f2c12fcb0 con 0x7f7f0c03e710 2024-09-22T08:14:04.523 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:14:04.528 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:14:04.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.520+0000 7f7f31285640 1 -- 172.21.15.53:0/537964704 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f0c03e710 msgr2=0x7f7f0c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:04.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.520+0000 7f7f31285640 1 --2- 172.21.15.53:0/537964704 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f0c03e710 0x7f7f0c040bd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7f14007fd0 tx=0x7f7f14007aa0 comp rx=0 tx=0).stop 2024-09-22T08:14:04.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.520+0000 7f7f31285640 1 -- 172.21.15.53:0/537964704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 msgr2=0x7f7f2c1c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:04.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.520+0000 7f7f31285640 1 --2- 172.21.15.53:0/537964704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 0x7f7f2c1c4670 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009840 tx=0x7f7f1c0046c0 comp rx=0 tx=0).stop 2024-09-22T08:14:04.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.520+0000 7f7f31285640 1 -- 172.21.15.53:0/537964704 shutdown_connections 2024-09-22T08:14:04.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.520+0000 7f7f31285640 1 --2- 172.21.15.53:0/537964704 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f7f0c03e710 0x7f7f0c040bd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:04.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.520+0000 7f7f31285640 1 --2- 172.21.15.53:0/537964704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2c09e140 0x7f7f2c1c4670 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:04.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.520+0000 7f7f31285640 1 -- 172.21.15.53:0/537964704 >> 172.21.15.53:0/537964704 conn(0x7f7f2c06e590 msgr2=0x7f7f2c09ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:04.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.520+0000 7f7f31285640 1 -- 172.21.15.53:0/537964704 shutdown_connections 2024-09-22T08:14:04.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:04.520+0000 7f7f31285640 1 -- 172.21.15.53:0/537964704 wait complete. 2024-09-22T08:14:04.532 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-22T08:14:03.625530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5179,"num_read_kb":4721,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4564,"ondisk_log_size":4564,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144296,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343064,"statfs":{"total":386547056640,"available":386399297536,"internally_reserved":0,"allocated":2981888,"data_stored":1788188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":697,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003909"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208925+0000","last_change":"2024-09-22T08:10:43.175476+0000","last_active":"2024-09-22T08:11:23.208925+0000","last_peered":"2024-09-22T08:11:23.208925+0000","last_clean":"2024-09-22T08:11:23.208925+0000","last_became_active":"2024-09-22T08:10:43.174489+0000","last_became_peered":"2024-09-22T08:10:43.174489+0000","last_unstale":"2024-09-22T08:11:23.208925+0000","last_undegraded":"2024-09-22T08:11:23.208925+0000","last_fullsized":"2024-09-22T08:11:23.208925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:10:48.444642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037868+0000","last_change":"2024-09-22T08:10:45.180446+0000","last_active":"2024-09-22T08:11:27.037868+0000","last_peered":"2024-09-22T08:11:27.037868+0000","last_clean":"2024-09-22T08:11:27.037868+0000","last_became_active":"2024-09-22T08:10:45.179969+0000","last_became_peered":"2024-09-22T08:10:45.179969+0000","last_unstale":"2024-09-22T08:11:27.037868+0000","last_undegraded":"2024-09-22T08:11:27.037868+0000","last_fullsized":"2024-09-22T08:11:27.037868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:37.801061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223475+0000","last_change":"2024-09-22T08:10:43.187818+0000","last_active":"2024-09-22T08:11:23.223475+0000","last_peered":"2024-09-22T08:11:23.223475+0000","last_clean":"2024-09-22T08:11:23.223475+0000","last_became_active":"2024-09-22T08:10:43.187128+0000","last_became_peered":"2024-09-22T08:10:43.187128+0000","last_unstale":"2024-09-22T08:11:23.223475+0000","last_undegraded":"2024-09-22T08:11:23.223475+0000","last_fullsized":"2024-09-22T08:11:23.223475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:35.616676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210762+0000","last_change":"2024-09-22T08:10:45.170031+0000","last_active":"2024-09-22T08:11:23.210762+0000","last_peered":"2024-09-22T08:11:23.210762+0000","last_clean":"2024-09-22T08:11:23.210762+0000","last_became_active":"2024-09-22T08:10:45.169768+0000","last_became_peered":"2024-09-22T08:10:45.169768+0000","last_unstale":"2024-09-22T08:11:23.210762+0000","last_undegraded":"2024-09-22T08:11:23.210762+0000","last_fullsized":"2024-09-22T08:11:23.210762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:06.709611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.001193+0000","last_change":"2024-09-22T08:10:43.202010+0000","last_active":"2024-09-22T08:12:09.001193+0000","last_peered":"2024-09-22T08:12:09.001193+0000","last_clean":"2024-09-22T08:12:09.001193+0000","last_became_active":"2024-09-22T08:10:43.200436+0000","last_became_peered":"2024-09-22T08:10:43.200436+0000","last_unstale":"2024-09-22T08:12:09.001193+0000","last_undegraded":"2024-09-22T08:12:09.001193+0000","last_fullsized":"2024-09-22T08:12:09.001193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:53.517821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.175954+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.169110+0000","last_became_peered":"2024-09-22T08:10:45.169110+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:13.716183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.565361+0000","last_change":"2024-09-22T08:10:43.182888+0000","last_active":"2024-09-22T08:11:25.565361+0000","last_peered":"2024-09-22T08:11:25.565361+0000","last_clean":"2024-09-22T08:11:25.565361+0000","last_became_active":"2024-09-22T08:10:43.180088+0000","last_became_peered":"2024-09-22T08:10:43.180088+0000","last_unstale":"2024-09-22T08:11:25.565361+0000","last_undegraded":"2024-09-22T08:11:25.565361+0000","last_fullsized":"2024-09-22T08:11:25.565361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:17.087244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183683+0000","last_change":"2024-09-22T08:11:23.220302+0000","last_active":"2024-09-22T08:13:53.183683+0000","last_peered":"2024-09-22T08:13:53.183683+0000","last_clean":"2024-09-22T08:13:53.183683+0000","last_became_active":"2024-09-22T08:11:23.220081+0000","last_became_peered":"2024-09-22T08:11:23.220081+0000","last_unstale":"2024-09-22T08:13:53.183683+0000","last_undegraded":"2024-09-22T08:13:53.183683+0000","last_fullsized":"2024-09-22T08:13:53.183683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:33.959971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211346+0000","last_change":"2024-09-22T08:10:43.200685+0000","last_active":"2024-09-22T08:11:23.211346+0000","last_peered":"2024-09-22T08:11:23.211346+0000","last_clean":"2024-09-22T08:11:23.211346+0000","last_became_active":"2024-09-22T08:10:43.200013+0000","last_became_peered":"2024-09-22T08:10:43.200013+0000","last_unstale":"2024-09-22T08:11:23.211346+0000","last_undegraded":"2024-09-22T08:11:23.211346+0000","last_fullsized":"2024-09-22T08:11:23.211346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:43.911800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227900+0000","last_change":"2024-09-22T08:10:45.178916+0000","last_active":"2024-09-22T08:13:53.227900+0000","last_peered":"2024-09-22T08:13:53.227900+0000","last_clean":"2024-09-22T08:13:53.227900+0000","last_became_active":"2024-09-22T08:10:45.176491+0000","last_became_peered":"2024-09-22T08:10:45.176491+0000","last_unstale":"2024-09-22T08:13:53.227900+0000","last_undegraded":"2024-09-22T08:13:53.227900+0000","last_fullsized":"2024-09-22T08:13:53.227900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:10.583367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206702+0000","last_change":"2024-09-22T08:10:43.172716+0000","last_active":"2024-09-22T08:11:23.206702+0000","last_peered":"2024-09-22T08:11:23.206702+0000","last_clean":"2024-09-22T08:11:23.206702+0000","last_became_active":"2024-09-22T08:10:43.172330+0000","last_became_peered":"2024-09-22T08:10:43.172330+0000","last_unstale":"2024-09-22T08:11:23.206702+0000","last_undegraded":"2024-09-22T08:11:23.206702+0000","last_fullsized":"2024-09-22T08:11:23.206702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:17.018405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.951226+0000","last_change":"2024-09-22T08:10:45.176141+0000","last_active":"2024-09-22T08:13:52.951226+0000","last_peered":"2024-09-22T08:13:52.951226+0000","last_clean":"2024-09-22T08:13:52.951226+0000","last_became_active":"2024-09-22T08:10:45.175775+0000","last_became_peered":"2024-09-22T08:10:45.175775+0000","last_unstale":"2024-09-22T08:13:52.951226+0000","last_undegraded":"2024-09-22T08:13:52.951226+0000","last_fullsized":"2024-09-22T08:13:52.951226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:08.930275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210326+0000","last_change":"2024-09-22T08:10:43.188239+0000","last_active":"2024-09-22T08:11:23.210326+0000","last_peered":"2024-09-22T08:11:23.210326+0000","last_clean":"2024-09-22T08:11:23.210326+0000","last_became_active":"2024-09-22T08:10:43.187858+0000","last_became_peered":"2024-09-22T08:10:43.187858+0000","last_unstale":"2024-09-22T08:11:23.210326+0000","last_undegraded":"2024-09-22T08:11:23.210326+0000","last_fullsized":"2024-09-22T08:11:23.210326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:35.814525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.054945+0000","last_change":"2024-09-22T08:10:45.180145+0000","last_active":"2024-09-22T08:13:53.054945+0000","last_peered":"2024-09-22T08:13:53.054945+0000","last_clean":"2024-09-22T08:13:53.054945+0000","last_became_active":"2024-09-22T08:10:45.179870+0000","last_became_peered":"2024-09-22T08:10:45.179870+0000","last_unstale":"2024-09-22T08:13:53.054945+0000","last_undegraded":"2024-09-22T08:13:53.054945+0000","last_fullsized":"2024-09-22T08:13:53.054945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:13:33.107569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220202+0000","last_change":"2024-09-22T08:10:43.178636+0000","last_active":"2024-09-22T08:11:23.220202+0000","last_peered":"2024-09-22T08:11:23.220202+0000","last_clean":"2024-09-22T08:11:23.220202+0000","last_became_active":"2024-09-22T08:10:43.178146+0000","last_became_peered":"2024-09-22T08:10:43.178146+0000","last_unstale":"2024-09-22T08:11:23.220202+0000","last_undegraded":"2024-09-22T08:11:23.220202+0000","last_fullsized":"2024-09-22T08:11:23.220202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:37.378948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.829002+0000","last_change":"2024-09-22T08:10:45.177410+0000","last_active":"2024-09-22T08:12:08.829002+0000","last_peered":"2024-09-22T08:12:08.829002+0000","last_clean":"2024-09-22T08:12:08.829002+0000","last_became_active":"2024-09-22T08:10:45.177101+0000","last_became_peered":"2024-09-22T08:10:45.177101+0000","last_unstale":"2024-09-22T08:12:08.829002+0000","last_undegraded":"2024-09-22T08:12:08.829002+0000","last_fullsized":"2024-09-22T08:12:08.829002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:22:33.661673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828898+0000","last_change":"2024-09-22T08:10:45.170689+0000","last_active":"2024-09-22T08:12:08.828898+0000","last_peered":"2024-09-22T08:12:08.828898+0000","last_clean":"2024-09-22T08:12:08.828898+0000","last_became_active":"2024-09-22T08:10:45.169140+0000","last_became_peered":"2024-09-22T08:10:45.169140+0000","last_unstale":"2024-09-22T08:12:08.828898+0000","last_undegraded":"2024-09-22T08:12:08.828898+0000","last_fullsized":"2024-09-22T08:12:08.828898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:02.240838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.167301+0000","last_change":"2024-09-22T08:10:43.185987+0000","last_active":"2024-09-22T08:13:53.167301+0000","last_peered":"2024-09-22T08:13:53.167301+0000","last_clean":"2024-09-22T08:13:53.167301+0000","last_became_active":"2024-09-22T08:10:43.185301+0000","last_became_peered":"2024-09-22T08:10:43.185301+0000","last_unstale":"2024-09-22T08:13:53.167301+0000","last_undegraded":"2024-09-22T08:13:53.167301+0000","last_fullsized":"2024-09-22T08:13:53.167301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:21.858399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213294+0000","last_change":"2024-09-22T08:10:45.172853+0000","last_active":"2024-09-22T08:11:23.213294+0000","last_peered":"2024-09-22T08:11:23.213294+0000","last_clean":"2024-09-22T08:11:23.213294+0000","last_became_active":"2024-09-22T08:10:45.172557+0000","last_became_peered":"2024-09-22T08:10:45.172557+0000","last_unstale":"2024-09-22T08:11:23.213294+0000","last_undegraded":"2024-09-22T08:11:23.213294+0000","last_fullsized":"2024-09-22T08:11:23.213294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:38.198254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211528+0000","last_change":"2024-09-22T08:10:43.193026+0000","last_active":"2024-09-22T08:11:23.211528+0000","last_peered":"2024-09-22T08:11:23.211528+0000","last_clean":"2024-09-22T08:11:23.211528+0000","last_became_active":"2024-09-22T08:10:43.189273+0000","last_became_peered":"2024-09-22T08:10:43.189273+0000","last_unstale":"2024-09-22T08:11:23.211528+0000","last_undegraded":"2024-09-22T08:11:23.211528+0000","last_fullsized":"2024-09-22T08:11:23.211528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:52.937847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.307146+0000","last_change":"2024-09-22T08:10:45.178843+0000","last_active":"2024-09-22T08:13:53.307146+0000","last_peered":"2024-09-22T08:13:53.307146+0000","last_clean":"2024-09-22T08:13:53.307146+0000","last_became_active":"2024-09-22T08:10:45.176885+0000","last_became_peered":"2024-09-22T08:10:45.176885+0000","last_unstale":"2024-09-22T08:13:53.307146+0000","last_undegraded":"2024-09-22T08:13:53.307146+0000","last_fullsized":"2024-09-22T08:13:53.307146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:27.127106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214958+0000","last_change":"2024-09-22T08:10:43.184292+0000","last_active":"2024-09-22T08:11:23.214958+0000","last_peered":"2024-09-22T08:11:23.214958+0000","last_clean":"2024-09-22T08:11:23.214958+0000","last_became_active":"2024-09-22T08:10:43.183887+0000","last_became_peered":"2024-09-22T08:10:43.183887+0000","last_unstale":"2024-09-22T08:11:23.214958+0000","last_undegraded":"2024-09-22T08:11:23.214958+0000","last_fullsized":"2024-09-22T08:11:23.214958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:53.082618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228331+0000","last_change":"2024-09-22T08:10:45.172136+0000","last_active":"2024-09-22T08:13:53.228331+0000","last_peered":"2024-09-22T08:13:53.228331+0000","last_clean":"2024-09-22T08:13:53.228331+0000","last_became_active":"2024-09-22T08:10:45.171492+0000","last_became_peered":"2024-09-22T08:10:45.171492+0000","last_unstale":"2024-09-22T08:13:53.228331+0000","last_undegraded":"2024-09-22T08:13:53.228331+0000","last_fullsized":"2024-09-22T08:13:53.228331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:55.520692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.819194+0000","last_change":"2024-09-22T08:10:43.179557+0000","last_active":"2024-09-22T08:12:08.819194+0000","last_peered":"2024-09-22T08:12:08.819194+0000","last_clean":"2024-09-22T08:12:08.819194+0000","last_became_active":"2024-09-22T08:10:43.179133+0000","last_became_peered":"2024-09-22T08:10:43.179133+0000","last_unstale":"2024-09-22T08:12:08.819194+0000","last_undegraded":"2024-09-22T08:12:08.819194+0000","last_fullsized":"2024-09-22T08:12:08.819194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:51.687725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13,"num_write":24,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.056124+0000","last_change":"2024-09-22T08:10:45.174057+0000","last_active":"2024-09-22T08:13:53.056124+0000","last_peered":"2024-09-22T08:13:53.056124+0000","last_clean":"2024-09-22T08:13:53.056124+0000","last_became_active":"2024-09-22T08:10:45.173524+0000","last_became_peered":"2024-09-22T08:10:45.173524+0000","last_unstale":"2024-09-22T08:13:53.056124+0000","last_undegraded":"2024-09-22T08:13:53.056124+0000","last_fullsized":"2024-09-22T08:13:53.056124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:21.335898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562821+0000","last_change":"2024-09-22T08:10:43.187823+0000","last_active":"2024-09-22T08:11:25.562821+0000","last_peered":"2024-09-22T08:11:25.562821+0000","last_clean":"2024-09-22T08:11:25.562821+0000","last_became_active":"2024-09-22T08:10:43.186739+0000","last_became_peered":"2024-09-22T08:10:43.186739+0000","last_unstale":"2024-09-22T08:11:25.562821+0000","last_undegraded":"2024-09-22T08:11:25.562821+0000","last_fullsized":"2024-09-22T08:11:25.562821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:58.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037355+0000","last_change":"2024-09-22T08:10:45.172711+0000","last_active":"2024-09-22T08:11:27.037355+0000","last_peered":"2024-09-22T08:11:27.037355+0000","last_clean":"2024-09-22T08:11:27.037355+0000","last_became_active":"2024-09-22T08:10:45.170247+0000","last_became_peered":"2024-09-22T08:10:45.170247+0000","last_unstale":"2024-09-22T08:11:27.037355+0000","last_undegraded":"2024-09-22T08:11:27.037355+0000","last_fullsized":"2024-09-22T08:11:27.037355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:51.811049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562616+0000","last_change":"2024-09-22T08:10:43.191158+0000","last_active":"2024-09-22T08:11:25.562616+0000","last_peered":"2024-09-22T08:11:25.562616+0000","last_clean":"2024-09-22T08:11:25.562616+0000","last_became_active":"2024-09-22T08:10:43.190674+0000","last_became_peered":"2024-09-22T08:10:43.190674+0000","last_unstale":"2024-09-22T08:11:25.562616+0000","last_undegraded":"2024-09-22T08:11:25.562616+0000","last_fullsized":"2024-09-22T08:11:25.562616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:24.822605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.206848+0000","last_change":"2024-09-22T08:10:53.203618+0000","last_active":"2024-09-22T08:13:53.206848+0000","last_peered":"2024-09-22T08:13:53.206848+0000","last_clean":"2024-09-22T08:13:53.206848+0000","last_became_active":"2024-09-22T08:10:53.203146+0000","last_became_peered":"2024-09-22T08:10:53.203146+0000","last_unstale":"2024-09-22T08:13:53.206848+0000","last_undegraded":"2024-09-22T08:13:53.206848+0000","last_fullsized":"2024-09-22T08:13:53.206848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:09.081236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042651+0000","last_change":"2024-09-22T08:10:45.168914+0000","last_active":"2024-09-22T08:13:53.042651+0000","last_peered":"2024-09-22T08:13:53.042651+0000","last_clean":"2024-09-22T08:13:53.042651+0000","last_became_active":"2024-09-22T08:10:45.168308+0000","last_became_peered":"2024-09-22T08:10:45.168308+0000","last_unstale":"2024-09-22T08:13:53.042651+0000","last_undegraded":"2024-09-22T08:13:53.042651+0000","last_fullsized":"2024-09-22T08:13:53.042651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:33.215832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210935+0000","last_change":"2024-09-22T08:10:43.200744+0000","last_active":"2024-09-22T08:11:23.210935+0000","last_peered":"2024-09-22T08:11:23.210935+0000","last_clean":"2024-09-22T08:11:23.210935+0000","last_became_active":"2024-09-22T08:10:43.200307+0000","last_became_peered":"2024-09-22T08:10:43.200307+0000","last_unstale":"2024-09-22T08:11:23.210935+0000","last_undegraded":"2024-09-22T08:11:23.210935+0000","last_fullsized":"2024-09-22T08:11:23.210935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:05.094419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210664+0000","last_change":"2024-09-22T08:10:47.176870+0000","last_active":"2024-09-22T08:11:23.210664+0000","last_peered":"2024-09-22T08:11:23.210664+0000","last_clean":"2024-09-22T08:11:23.210664+0000","last_became_active":"2024-09-22T08:10:47.176568+0000","last_became_peered":"2024-09-22T08:10:47.176568+0000","last_unstale":"2024-09-22T08:11:23.210664+0000","last_undegraded":"2024-09-22T08:11:23.210664+0000","last_fullsized":"2024-09-22T08:11:23.210664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:55.338812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.858403+0000","last_change":"2024-09-22T08:10:49.189137+0000","last_active":"2024-09-22T08:13:59.858403+0000","last_peered":"2024-09-22T08:13:59.858403+0000","last_clean":"2024-09-22T08:13:59.858403+0000","last_became_active":"2024-09-22T08:10:49.188697+0000","last_became_peered":"2024-09-22T08:10:49.188697+0000","last_unstale":"2024-09-22T08:13:59.858403+0000","last_undegraded":"2024-09-22T08:13:59.858403+0000","last_fullsized":"2024-09-22T08:13:59.858403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:20.077797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216659+0000","last_change":"2024-09-22T08:10:51.202175+0000","last_active":"2024-09-22T08:11:23.216659+0000","last_peered":"2024-09-22T08:11:23.216659+0000","last_clean":"2024-09-22T08:11:23.216659+0000","last_became_active":"2024-09-22T08:10:51.201855+0000","last_became_peered":"2024-09-22T08:10:51.201855+0000","last_unstale":"2024-09-22T08:11:23.216659+0000","last_undegraded":"2024-09-22T08:11:23.216659+0000","last_fullsized":"2024-09-22T08:11:23.216659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'11","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.833839+0000","last_change":"2024-09-22T08:10:53.204685+0000","last_active":"2024-09-22T08:12:08.833839+0000","last_peered":"2024-09-22T08:12:08.833839+0000","last_clean":"2024-09-22T08:12:08.833839+0000","last_became_active":"2024-09-22T08:10:53.204407+0000","last_became_peered":"2024-09-22T08:10:53.204407+0000","last_unstale":"2024-09-22T08:12:08.833839+0000","last_undegraded":"2024-09-22T08:12:08.833839+0000","last_fullsized":"2024-09-22T08:12:08.833839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:07.954674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'16","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.261467+0000","last_change":"2024-09-22T08:10:45.171230+0000","last_active":"2024-09-22T08:13:53.261467+0000","last_peered":"2024-09-22T08:13:53.261467+0000","last_clean":"2024-09-22T08:13:53.261467+0000","last_became_active":"2024-09-22T08:10:45.170765+0000","last_became_peered":"2024-09-22T08:10:45.170765+0000","last_unstale":"2024-09-22T08:13:53.261467+0000","last_undegraded":"2024-09-22T08:13:53.261467+0000","last_fullsized":"2024-09-22T08:13:53.261467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:18.560588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206421+0000","last_change":"2024-09-22T08:10:43.180996+0000","last_active":"2024-09-22T08:11:23.206421+0000","last_peered":"2024-09-22T08:11:23.206421+0000","last_clean":"2024-09-22T08:11:23.206421+0000","last_became_active":"2024-09-22T08:10:43.180600+0000","last_became_peered":"2024-09-22T08:10:43.180600+0000","last_unstale":"2024-09-22T08:11:23.206421+0000","last_undegraded":"2024-09-22T08:11:23.206421+0000","last_fullsized":"2024-09-22T08:11:23.206421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:21.162231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221157+0000","last_change":"2024-09-22T08:10:47.168270+0000","last_active":"2024-09-22T08:11:23.221157+0000","last_peered":"2024-09-22T08:11:23.221157+0000","last_clean":"2024-09-22T08:11:23.221157+0000","last_became_active":"2024-09-22T08:10:47.167913+0000","last_became_peered":"2024-09-22T08:10:47.167913+0000","last_unstale":"2024-09-22T08:11:23.221157+0000","last_undegraded":"2024-09-22T08:11:23.221157+0000","last_fullsized":"2024-09-22T08:11:23.221157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:42.817181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216231+0000","last_change":"2024-09-22T08:10:49.182777+0000","last_active":"2024-09-22T08:11:23.216231+0000","last_peered":"2024-09-22T08:11:23.216231+0000","last_clean":"2024-09-22T08:11:23.216231+0000","last_became_active":"2024-09-22T08:10:49.182481+0000","last_became_peered":"2024-09-22T08:10:49.182481+0000","last_unstale":"2024-09-22T08:11:23.216231+0000","last_undegraded":"2024-09-22T08:11:23.216231+0000","last_fullsized":"2024-09-22T08:11:23.216231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:56.405074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.215699+0000","last_change":"2024-09-22T08:10:51.200151+0000","last_active":"2024-09-22T08:11:23.215699+0000","last_peered":"2024-09-22T08:11:23.215699+0000","last_clean":"2024-09-22T08:11:23.215699+0000","last_became_active":"2024-09-22T08:10:51.199837+0000","last_became_peered":"2024-09-22T08:10:51.199837+0000","last_unstale":"2024-09-22T08:11:23.215699+0000","last_undegraded":"2024-09-22T08:11:23.215699+0000","last_fullsized":"2024-09-22T08:11:23.215699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220094+0000","last_change":"2024-09-22T08:10:53.199608+0000","last_active":"2024-09-22T08:11:23.220094+0000","last_peered":"2024-09-22T08:11:23.220094+0000","last_clean":"2024-09-22T08:11:23.220094+0000","last_became_active":"2024-09-22T08:10:53.199303+0000","last_became_peered":"2024-09-22T08:10:53.199303+0000","last_unstale":"2024-09-22T08:11:23.220094+0000","last_undegraded":"2024-09-22T08:11:23.220094+0000","last_fullsized":"2024-09-22T08:11:23.220094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:27.339830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228089+0000","last_change":"2024-09-22T08:10:45.169254+0000","last_active":"2024-09-22T08:13:53.228089+0000","last_peered":"2024-09-22T08:13:53.228089+0000","last_clean":"2024-09-22T08:13:53.228089+0000","last_became_active":"2024-09-22T08:10:45.168554+0000","last_became_peered":"2024-09-22T08:10:45.168554+0000","last_unstale":"2024-09-22T08:13:53.228089+0000","last_undegraded":"2024-09-22T08:13:53.228089+0000","last_fullsized":"2024-09-22T08:13:53.228089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:25.135787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.932991+0000","last_change":"2024-09-22T08:10:43.189688+0000","last_active":"2024-09-22T08:13:52.932991+0000","last_peered":"2024-09-22T08:13:52.932991+0000","last_clean":"2024-09-22T08:13:52.932991+0000","last_became_active":"2024-09-22T08:10:43.189333+0000","last_became_peered":"2024-09-22T08:10:43.189333+0000","last_unstale":"2024-09-22T08:13:52.932991+0000","last_undegraded":"2024-09-22T08:13:52.932991+0000","last_fullsized":"2024-09-22T08:13:52.932991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:30.638919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223891+0000","last_change":"2024-09-22T08:10:47.176263+0000","last_active":"2024-09-22T08:11:23.223891+0000","last_peered":"2024-09-22T08:11:23.223891+0000","last_clean":"2024-09-22T08:11:23.223891+0000","last_became_active":"2024-09-22T08:10:47.175959+0000","last_became_peered":"2024-09-22T08:10:47.175959+0000","last_unstale":"2024-09-22T08:11:23.223891+0000","last_undegraded":"2024-09-22T08:11:23.223891+0000","last_fullsized":"2024-09-22T08:11:23.223891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:44.259414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207630+0000","last_change":"2024-09-22T08:10:49.185591+0000","last_active":"2024-09-22T08:11:23.207630+0000","last_peered":"2024-09-22T08:11:23.207630+0000","last_clean":"2024-09-22T08:11:23.207630+0000","last_became_active":"2024-09-22T08:10:49.185269+0000","last_became_peered":"2024-09-22T08:10:49.185269+0000","last_unstale":"2024-09-22T08:11:23.207630+0000","last_undegraded":"2024-09-22T08:11:23.207630+0000","last_fullsized":"2024-09-22T08:11:23.207630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.872968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.794235+0000","last_change":"2024-09-22T08:10:51.196489+0000","last_active":"2024-09-22T08:13:59.794235+0000","last_peered":"2024-09-22T08:13:59.794235+0000","last_clean":"2024-09-22T08:13:59.794235+0000","last_became_active":"2024-09-22T08:10:51.196199+0000","last_became_peered":"2024-09-22T08:10:51.196199+0000","last_unstale":"2024-09-22T08:13:59.794235+0000","last_undegraded":"2024-09-22T08:13:59.794235+0000","last_fullsized":"2024-09-22T08:13:59.794235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:26.614683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.217337+0000","last_change":"2024-09-22T08:10:53.194394+0000","last_active":"2024-09-22T08:13:53.217337+0000","last_peered":"2024-09-22T08:13:53.217337+0000","last_clean":"2024-09-22T08:13:53.217337+0000","last_became_active":"2024-09-22T08:10:53.194118+0000","last_became_peered":"2024-09-22T08:10:53.194118+0000","last_unstale":"2024-09-22T08:13:53.217337+0000","last_undegraded":"2024-09-22T08:13:53.217337+0000","last_fullsized":"2024-09-22T08:13:53.217337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:00.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.234003+0000","last_change":"2024-09-22T08:10:45.183666+0000","last_active":"2024-09-22T08:13:53.234003+0000","last_peered":"2024-09-22T08:13:53.234003+0000","last_clean":"2024-09-22T08:13:53.234003+0000","last_became_active":"2024-09-22T08:10:45.183307+0000","last_became_peered":"2024-09-22T08:10:45.183307+0000","last_unstale":"2024-09-22T08:13:53.234003+0000","last_undegraded":"2024-09-22T08:13:53.234003+0000","last_fullsized":"2024-09-22T08:13:53.234003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:58.141567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211089+0000","last_change":"2024-09-22T08:10:43.188519+0000","last_active":"2024-09-22T08:11:23.211089+0000","last_peered":"2024-09-22T08:11:23.211089+0000","last_clean":"2024-09-22T08:11:23.211089+0000","last_became_active":"2024-09-22T08:10:43.187835+0000","last_became_peered":"2024-09-22T08:10:43.187835+0000","last_unstale":"2024-09-22T08:11:23.211089+0000","last_undegraded":"2024-09-22T08:11:23.211089+0000","last_fullsized":"2024-09-22T08:11:23.211089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:29.246042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211282+0000","last_change":"2024-09-22T08:10:47.175684+0000","last_active":"2024-09-22T08:11:23.211282+0000","last_peered":"2024-09-22T08:11:23.211282+0000","last_clean":"2024-09-22T08:11:23.211282+0000","last_became_active":"2024-09-22T08:10:47.175386+0000","last_became_peered":"2024-09-22T08:10:47.175386+0000","last_unstale":"2024-09-22T08:11:23.211282+0000","last_undegraded":"2024-09-22T08:11:23.211282+0000","last_fullsized":"2024-09-22T08:11:23.211282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:48.587319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.842635+0000","last_change":"2024-09-22T08:10:49.185291+0000","last_active":"2024-09-22T08:13:59.842635+0000","last_peered":"2024-09-22T08:13:59.842635+0000","last_clean":"2024-09-22T08:13:59.842635+0000","last_became_active":"2024-09-22T08:10:49.184963+0000","last_became_peered":"2024-09-22T08:10:49.184963+0000","last_unstale":"2024-09-22T08:13:59.842635+0000","last_undegraded":"2024-09-22T08:13:59.842635+0000","last_fullsized":"2024-09-22T08:13:59.842635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:53.469586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":445,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.799214+0000","last_change":"2024-09-22T08:10:51.193999+0000","last_active":"2024-09-22T08:13:59.799214+0000","last_peered":"2024-09-22T08:13:59.799214+0000","last_clean":"2024-09-22T08:13:59.799214+0000","last_became_active":"2024-09-22T08:10:51.193678+0000","last_became_peered":"2024-09-22T08:10:51.193678+0000","last_unstale":"2024-09-22T08:13:59.799214+0000","last_undegraded":"2024-09-22T08:13:59.799214+0000","last_fullsized":"2024-09-22T08:13:59.799214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.950936+0000","last_change":"2024-09-22T08:10:45.184006+0000","last_active":"2024-09-22T08:13:52.950936+0000","last_peered":"2024-09-22T08:13:52.950936+0000","last_clean":"2024-09-22T08:13:52.950936+0000","last_became_active":"2024-09-22T08:10:45.183598+0000","last_became_peered":"2024-09-22T08:10:45.183598+0000","last_unstale":"2024-09-22T08:13:52.950936+0000","last_undegraded":"2024-09-22T08:13:52.950936+0000","last_fullsized":"2024-09-22T08:13:52.950936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:42.041157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208676+0000","last_change":"2024-09-22T08:10:43.175203+0000","last_active":"2024-09-22T08:11:23.208676+0000","last_peered":"2024-09-22T08:11:23.208676+0000","last_clean":"2024-09-22T08:11:23.208676+0000","last_became_active":"2024-09-22T08:10:43.173543+0000","last_became_peered":"2024-09-22T08:10:43.173543+0000","last_unstale":"2024-09-22T08:11:23.208676+0000","last_undegraded":"2024-09-22T08:11:23.208676+0000","last_fullsized":"2024-09-22T08:11:23.208676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:34:49.711451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212481+0000","last_change":"2024-09-22T08:10:47.176921+0000","last_active":"2024-09-22T08:11:23.212481+0000","last_peered":"2024-09-22T08:11:23.212481+0000","last_clean":"2024-09-22T08:11:23.212481+0000","last_became_active":"2024-09-22T08:10:47.176657+0000","last_became_peered":"2024-09-22T08:10:47.176657+0000","last_unstale":"2024-09-22T08:11:23.212481+0000","last_undegraded":"2024-09-22T08:11:23.212481+0000","last_fullsized":"2024-09-22T08:11:23.212481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:32.681711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'43","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.870291+0000","last_change":"2024-09-22T08:10:49.184460+0000","last_active":"2024-09-22T08:13:59.870291+0000","last_peered":"2024-09-22T08:13:59.870291+0000","last_clean":"2024-09-22T08:13:59.870291+0000","last_became_active":"2024-09-22T08:10:49.182985+0000","last_became_peered":"2024-09-22T08:10:49.182985+0000","last_unstale":"2024-09-22T08:13:59.870291+0000","last_undegraded":"2024-09-22T08:13:59.870291+0000","last_fullsized":"2024-09-22T08:13:59.870291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:56.307814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222432+0000","last_change":"2024-09-22T08:10:51.193335+0000","last_active":"2024-09-22T08:11:23.222432+0000","last_peered":"2024-09-22T08:11:23.222432+0000","last_clean":"2024-09-22T08:11:23.222432+0000","last_became_active":"2024-09-22T08:10:51.192623+0000","last_became_peered":"2024-09-22T08:10:51.192623+0000","last_unstale":"2024-09-22T08:11:23.222432+0000","last_undegraded":"2024-09-22T08:11:23.222432+0000","last_fullsized":"2024-09-22T08:11:23.222432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.835562+0000","last_change":"2024-09-22T08:10:53.198555+0000","last_active":"2024-09-22T08:12:08.835562+0000","last_peered":"2024-09-22T08:12:08.835562+0000","last_clean":"2024-09-22T08:12:08.835562+0000","last_became_active":"2024-09-22T08:10:53.198219+0000","last_became_peered":"2024-09-22T08:10:53.198219+0000","last_unstale":"2024-09-22T08:12:08.835562+0000","last_undegraded":"2024-09-22T08:12:08.835562+0000","last_fullsized":"2024-09-22T08:12:08.835562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:04.308739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213131+0000","last_change":"2024-09-22T08:10:45.172178+0000","last_active":"2024-09-22T08:11:23.213131+0000","last_peered":"2024-09-22T08:11:23.213131+0000","last_clean":"2024-09-22T08:11:23.213131+0000","last_became_active":"2024-09-22T08:10:45.171911+0000","last_became_peered":"2024-09-22T08:10:45.171911+0000","last_unstale":"2024-09-22T08:11:23.213131+0000","last_undegraded":"2024-09-22T08:11:23.213131+0000","last_fullsized":"2024-09-22T08:11:23.213131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:57.459714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210955+0000","last_change":"2024-09-22T08:10:43.193335+0000","last_active":"2024-09-22T08:11:23.210955+0000","last_peered":"2024-09-22T08:11:23.210955+0000","last_clean":"2024-09-22T08:11:23.210955+0000","last_became_active":"2024-09-22T08:10:43.189780+0000","last_became_peered":"2024-09-22T08:10:43.189780+0000","last_unstale":"2024-09-22T08:11:23.210955+0000","last_undegraded":"2024-09-22T08:11:23.210955+0000","last_fullsized":"2024-09-22T08:11:23.210955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:29.886101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220270+0000","last_change":"2024-09-22T08:10:47.177997+0000","last_active":"2024-09-22T08:11:23.220270+0000","last_peered":"2024-09-22T08:11:23.220270+0000","last_clean":"2024-09-22T08:11:23.220270+0000","last_became_active":"2024-09-22T08:10:47.177695+0000","last_became_peered":"2024-09-22T08:10:47.177695+0000","last_unstale":"2024-09-22T08:11:23.220270+0000","last_undegraded":"2024-09-22T08:11:23.220270+0000","last_fullsized":"2024-09-22T08:11:23.220270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:09.326387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.917701+0000","last_change":"2024-09-22T08:10:49.185696+0000","last_active":"2024-09-22T08:13:59.917701+0000","last_peered":"2024-09-22T08:13:59.917701+0000","last_clean":"2024-09-22T08:13:59.917701+0000","last_became_active":"2024-09-22T08:10:49.185419+0000","last_became_peered":"2024-09-22T08:10:49.185419+0000","last_unstale":"2024-09-22T08:13:59.917701+0000","last_undegraded":"2024-09-22T08:13:59.917701+0000","last_fullsized":"2024-09-22T08:13:59.917701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:57.299371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221426+0000","last_change":"2024-09-22T08:10:51.202896+0000","last_active":"2024-09-22T08:11:23.221426+0000","last_peered":"2024-09-22T08:11:23.221426+0000","last_clean":"2024-09-22T08:11:23.221426+0000","last_became_active":"2024-09-22T08:10:51.202564+0000","last_became_peered":"2024-09-22T08:10:51.202564+0000","last_unstale":"2024-09-22T08:11:23.221426+0000","last_undegraded":"2024-09-22T08:11:23.221426+0000","last_fullsized":"2024-09-22T08:11:23.221426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:58.270948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:03.306650+0000","last_change":"2024-09-22T08:10:53.196844+0000","last_active":"2024-09-22T08:12:03.306650+0000","last_peered":"2024-09-22T08:12:03.306650+0000","last_clean":"2024-09-22T08:12:03.306650+0000","last_became_active":"2024-09-22T08:10:53.196392+0000","last_became_peered":"2024-09-22T08:10:53.196392+0000","last_unstale":"2024-09-22T08:12:03.306650+0000","last_undegraded":"2024-09-22T08:12:03.306650+0000","last_fullsized":"2024-09-22T08:12:03.306650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:30.239443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207308+0000","last_change":"2024-09-22T08:10:45.177813+0000","last_active":"2024-09-22T08:11:23.207308+0000","last_peered":"2024-09-22T08:11:23.207308+0000","last_clean":"2024-09-22T08:11:23.207308+0000","last_became_active":"2024-09-22T08:10:45.177530+0000","last_became_peered":"2024-09-22T08:10:45.177530+0000","last_unstale":"2024-09-22T08:11:23.207308+0000","last_undegraded":"2024-09-22T08:11:23.207308+0000","last_fullsized":"2024-09-22T08:11:23.207308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:03.255386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213304+0000","last_change":"2024-09-22T08:10:43.202319+0000","last_active":"2024-09-22T08:11:23.213304+0000","last_peered":"2024-09-22T08:11:23.213304+0000","last_clean":"2024-09-22T08:11:23.213304+0000","last_became_active":"2024-09-22T08:10:43.201669+0000","last_became_peered":"2024-09-22T08:10:43.201669+0000","last_unstale":"2024-09-22T08:11:23.213304+0000","last_undegraded":"2024-09-22T08:11:23.213304+0000","last_fullsized":"2024-09-22T08:11:23.213304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:18.648215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221742+0000","last_change":"2024-09-22T08:10:47.177950+0000","last_active":"2024-09-22T08:11:23.221742+0000","last_peered":"2024-09-22T08:11:23.221742+0000","last_clean":"2024-09-22T08:11:23.221742+0000","last_became_active":"2024-09-22T08:10:47.177613+0000","last_became_peered":"2024-09-22T08:10:47.177613+0000","last_unstale":"2024-09-22T08:11:23.221742+0000","last_undegraded":"2024-09-22T08:11:23.221742+0000","last_fullsized":"2024-09-22T08:11:23.221742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:26.919515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'40","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.875765+0000","last_change":"2024-09-22T08:10:49.187229+0000","last_active":"2024-09-22T08:13:59.875765+0000","last_peered":"2024-09-22T08:13:59.875765+0000","last_clean":"2024-09-22T08:13:59.875765+0000","last_became_active":"2024-09-22T08:10:49.186941+0000","last_became_peered":"2024-09-22T08:10:49.186941+0000","last_unstale":"2024-09-22T08:13:59.875765+0000","last_undegraded":"2024-09-22T08:13:59.875765+0000","last_fullsized":"2024-09-22T08:13:59.875765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:28.645390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.800403+0000","last_change":"2024-09-22T08:10:51.192885+0000","last_active":"2024-09-22T08:13:59.800403+0000","last_peered":"2024-09-22T08:13:59.800403+0000","last_clean":"2024-09-22T08:13:59.800403+0000","last_became_active":"2024-09-22T08:10:51.192483+0000","last_became_peered":"2024-09-22T08:10:51.192483+0000","last_unstale":"2024-09-22T08:13:59.800403+0000","last_undegraded":"2024-09-22T08:13:59.800403+0000","last_fullsized":"2024-09-22T08:13:59.800403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:47.260805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222488+0000","last_change":"2024-09-22T08:10:53.199613+0000","last_active":"2024-09-22T08:11:23.222488+0000","last_peered":"2024-09-22T08:11:23.222488+0000","last_clean":"2024-09-22T08:11:23.222488+0000","last_became_active":"2024-09-22T08:10:53.199273+0000","last_became_peered":"2024-09-22T08:10:53.199273+0000","last_unstale":"2024-09-22T08:11:23.222488+0000","last_undegraded":"2024-09-22T08:11:23.222488+0000","last_fullsized":"2024-09-22T08:11:23.222488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:07.308140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183660+0000","last_change":"2024-09-22T08:10:45.165644+0000","last_active":"2024-09-22T08:13:53.183660+0000","last_peered":"2024-09-22T08:13:53.183660+0000","last_clean":"2024-09-22T08:13:53.183660+0000","last_became_active":"2024-09-22T08:10:45.165352+0000","last_became_peered":"2024-09-22T08:10:45.165352+0000","last_unstale":"2024-09-22T08:13:53.183660+0000","last_undegraded":"2024-09-22T08:13:53.183660+0000","last_fullsized":"2024-09-22T08:13:53.183660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:15.188589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211087+0000","last_change":"2024-09-22T08:10:43.199804+0000","last_active":"2024-09-22T08:11:23.211087+0000","last_peered":"2024-09-22T08:11:23.211087+0000","last_clean":"2024-09-22T08:11:23.211087+0000","last_became_active":"2024-09-22T08:10:43.198696+0000","last_became_peered":"2024-09-22T08:10:43.198696+0000","last_unstale":"2024-09-22T08:11:23.211087+0000","last_undegraded":"2024-09-22T08:11:23.211087+0000","last_fullsized":"2024-09-22T08:11:23.211087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:50.899075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220881+0000","last_change":"2024-09-22T08:10:47.176680+0000","last_active":"2024-09-22T08:11:23.220881+0000","last_peered":"2024-09-22T08:11:23.220881+0000","last_clean":"2024-09-22T08:11:23.220881+0000","last_became_active":"2024-09-22T08:10:47.176263+0000","last_became_peered":"2024-09-22T08:10:47.176263+0000","last_unstale":"2024-09-22T08:11:23.220881+0000","last_undegraded":"2024-09-22T08:11:23.220881+0000","last_fullsized":"2024-09-22T08:11:23.220881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:38.640214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'60","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.926835+0000","last_change":"2024-09-22T08:10:49.189658+0000","last_active":"2024-09-22T08:13:59.926835+0000","last_peered":"2024-09-22T08:13:59.926835+0000","last_clean":"2024-09-22T08:13:59.926835+0000","last_became_active":"2024-09-22T08:10:49.188724+0000","last_became_peered":"2024-09-22T08:10:49.188724+0000","last_unstale":"2024-09-22T08:13:59.926835+0000","last_undegraded":"2024-09-22T08:13:59.926835+0000","last_fullsized":"2024-09-22T08:13:59.926835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:49.620069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220087+0000","last_change":"2024-09-22T08:10:51.195268+0000","last_active":"2024-09-22T08:11:23.220087+0000","last_peered":"2024-09-22T08:11:23.220087+0000","last_clean":"2024-09-22T08:11:23.220087+0000","last_became_active":"2024-09-22T08:10:51.194937+0000","last_became_peered":"2024-09-22T08:10:51.194937+0000","last_unstale":"2024-09-22T08:11:23.220087+0000","last_undegraded":"2024-09-22T08:11:23.220087+0000","last_fullsized":"2024-09-22T08:11:23.220087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.350209+0000","last_change":"2024-09-22T08:10:53.201595+0000","last_active":"2024-09-22T08:13:53.350209+0000","last_peered":"2024-09-22T08:13:53.350209+0000","last_clean":"2024-09-22T08:13:53.350209+0000","last_became_active":"2024-09-22T08:10:53.201289+0000","last_became_peered":"2024-09-22T08:10:53.201289+0000","last_unstale":"2024-09-22T08:13:53.350209+0000","last_undegraded":"2024-09-22T08:13:53.350209+0000","last_fullsized":"2024-09-22T08:13:53.350209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:22.640385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.468134+0000","last_change":"2024-09-22T08:10:45.181031+0000","last_active":"2024-09-22T08:12:49.468134+0000","last_peered":"2024-09-22T08:12:49.468134+0000","last_clean":"2024-09-22T08:12:49.468134+0000","last_became_active":"2024-09-22T08:10:45.180762+0000","last_became_peered":"2024-09-22T08:10:45.180762+0000","last_unstale":"2024-09-22T08:12:49.468134+0000","last_undegraded":"2024-09-22T08:12:49.468134+0000","last_fullsized":"2024-09-22T08:12:49.468134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:39.170953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562819+0000","last_change":"2024-09-22T08:10:43.177974+0000","last_active":"2024-09-22T08:11:25.562819+0000","last_peered":"2024-09-22T08:11:25.562819+0000","last_clean":"2024-09-22T08:11:25.562819+0000","last_became_active":"2024-09-22T08:10:43.177202+0000","last_became_peered":"2024-09-22T08:10:43.177202+0000","last_unstale":"2024-09-22T08:11:25.562819+0000","last_undegraded":"2024-09-22T08:11:25.562819+0000","last_fullsized":"2024-09-22T08:11:25.562819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:21.858399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207951+0000","last_change":"2024-09-22T08:10:47.173920+0000","last_active":"2024-09-22T08:11:23.207951+0000","last_peered":"2024-09-22T08:11:23.207951+0000","last_clean":"2024-09-22T08:11:23.207951+0000","last_became_active":"2024-09-22T08:10:47.173636+0000","last_became_peered":"2024-09-22T08:10:47.173636+0000","last_unstale":"2024-09-22T08:11:23.207951+0000","last_undegraded":"2024-09-22T08:11:23.207951+0000","last_fullsized":"2024-09-22T08:11:23.207951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:07.844753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.929919+0000","last_change":"2024-09-22T08:10:49.175235+0000","last_active":"2024-09-22T08:13:59.929919+0000","last_peered":"2024-09-22T08:13:59.929919+0000","last_clean":"2024-09-22T08:13:59.929919+0000","last_became_active":"2024-09-22T08:10:49.174933+0000","last_became_peered":"2024-09-22T08:10:49.174933+0000","last_unstale":"2024-09-22T08:13:59.929919+0000","last_undegraded":"2024-09-22T08:13:59.929919+0000","last_fullsized":"2024-09-22T08:13:59.929919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:09.101942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212489+0000","last_change":"2024-09-22T08:10:51.195590+0000","last_active":"2024-09-22T08:11:23.212489+0000","last_peered":"2024-09-22T08:11:23.212489+0000","last_clean":"2024-09-22T08:11:23.212489+0000","last_became_active":"2024-09-22T08:10:51.195308+0000","last_became_peered":"2024-09-22T08:10:51.195308+0000","last_unstale":"2024-09-22T08:11:23.212489+0000","last_undegraded":"2024-09-22T08:11:23.212489+0000","last_fullsized":"2024-09-22T08:11:23.212489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:13.979616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584694+0000","last_change":"2024-09-22T08:10:53.201429+0000","last_active":"2024-09-22T08:12:52.584694+0000","last_peered":"2024-09-22T08:12:52.584694+0000","last_clean":"2024-09-22T08:12:52.584694+0000","last_became_active":"2024-09-22T08:10:53.200458+0000","last_became_peered":"2024-09-22T08:10:53.200458+0000","last_unstale":"2024-09-22T08:12:52.584694+0000","last_undegraded":"2024-09-22T08:12:52.584694+0000","last_fullsized":"2024-09-22T08:12:52.584694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:15.839331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:02.586743+0000","last_change":"2024-09-22T08:10:45.183532+0000","last_active":"2024-09-22T08:13:02.586743+0000","last_peered":"2024-09-22T08:13:02.586743+0000","last_clean":"2024-09-22T08:13:02.586743+0000","last_became_active":"2024-09-22T08:10:45.183258+0000","last_became_peered":"2024-09-22T08:10:45.183258+0000","last_unstale":"2024-09-22T08:13:02.586743+0000","last_undegraded":"2024-09-22T08:13:02.586743+0000","last_fullsized":"2024-09-22T08:13:02.586743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:38.687579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213355+0000","last_change":"2024-09-22T08:10:43.197491+0000","last_active":"2024-09-22T08:11:23.213355+0000","last_peered":"2024-09-22T08:11:23.213355+0000","last_clean":"2024-09-22T08:11:23.213355+0000","last_became_active":"2024-09-22T08:10:43.195959+0000","last_became_peered":"2024-09-22T08:10:43.195959+0000","last_unstale":"2024-09-22T08:11:23.213355+0000","last_undegraded":"2024-09-22T08:11:23.213355+0000","last_fullsized":"2024-09-22T08:11:23.213355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:31.630549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216166+0000","last_change":"2024-09-22T08:11:23.215294+0000","last_active":"2024-09-22T08:11:23.216166+0000","last_peered":"2024-09-22T08:11:23.216166+0000","last_clean":"2024-09-22T08:11:23.216166+0000","last_became_active":"2024-09-22T08:11:23.214959+0000","last_became_peered":"2024-09-22T08:11:23.214959+0000","last_unstale":"2024-09-22T08:11:23.216166+0000","last_undegraded":"2024-09-22T08:11:23.216166+0000","last_fullsized":"2024-09-22T08:11:23.216166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:50.116285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.908174+0000","last_change":"2024-09-22T08:10:49.181291+0000","last_active":"2024-09-22T08:13:59.908174+0000","last_peered":"2024-09-22T08:13:59.908174+0000","last_clean":"2024-09-22T08:13:59.908174+0000","last_became_active":"2024-09-22T08:10:49.180820+0000","last_became_peered":"2024-09-22T08:10:49.180820+0000","last_unstale":"2024-09-22T08:13:59.908174+0000","last_undegraded":"2024-09-22T08:13:59.908174+0000","last_fullsized":"2024-09-22T08:13:59.908174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:56.059910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":435,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.795492+0000","last_change":"2024-09-22T08:10:51.197307+0000","last_active":"2024-09-22T08:13:59.795492+0000","last_peered":"2024-09-22T08:13:59.795492+0000","last_clean":"2024-09-22T08:13:59.795492+0000","last_became_active":"2024-09-22T08:10:51.197020+0000","last_became_peered":"2024-09-22T08:10:51.197020+0000","last_unstale":"2024-09-22T08:13:59.795492+0000","last_undegraded":"2024-09-22T08:13:59.795492+0000","last_fullsized":"2024-09-22T08:13:59.795492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:39.376197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:01.585334+0000","last_change":"2024-09-22T08:10:53.192873+0000","last_active":"2024-09-22T08:13:01.585334+0000","last_peered":"2024-09-22T08:13:01.585334+0000","last_clean":"2024-09-22T08:13:01.585334+0000","last_became_active":"2024-09-22T08:10:53.192481+0000","last_became_peered":"2024-09-22T08:10:53.192481+0000","last_unstale":"2024-09-22T08:13:01.585334+0000","last_undegraded":"2024-09-22T08:13:01.585334+0000","last_fullsized":"2024-09-22T08:13:01.585334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:06.451090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183469+0000","last_change":"2024-09-22T08:10:45.173005+0000","last_active":"2024-09-22T08:13:53.183469+0000","last_peered":"2024-09-22T08:13:53.183469+0000","last_clean":"2024-09-22T08:13:53.183469+0000","last_became_active":"2024-09-22T08:10:45.172740+0000","last_became_peered":"2024-09-22T08:10:45.172740+0000","last_unstale":"2024-09-22T08:13:53.183469+0000","last_undegraded":"2024-09-22T08:13:53.183469+0000","last_fullsized":"2024-09-22T08:13:53.183469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:20.794542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212966+0000","last_change":"2024-09-22T08:10:43.195715+0000","last_active":"2024-09-22T08:11:23.212966+0000","last_peered":"2024-09-22T08:11:23.212966+0000","last_clean":"2024-09-22T08:11:23.212966+0000","last_became_active":"2024-09-22T08:10:43.195355+0000","last_became_peered":"2024-09-22T08:10:43.195355+0000","last_unstale":"2024-09-22T08:11:23.212966+0000","last_undegraded":"2024-09-22T08:11:23.212966+0000","last_fullsized":"2024-09-22T08:11:23.212966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:01.525176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":430,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.776594+0000","last_change":"2024-09-22T08:11:23.229177+0000","last_active":"2024-09-22T08:13:59.776594+0000","last_peered":"2024-09-22T08:13:59.776594+0000","last_clean":"2024-09-22T08:13:59.776594+0000","last_became_active":"2024-09-22T08:11:23.221981+0000","last_became_peered":"2024-09-22T08:11:23.221981+0000","last_unstale":"2024-09-22T08:13:59.776594+0000","last_undegraded":"2024-09-22T08:13:59.776594+0000","last_fullsized":"2024-09-22T08:13:59.776594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:00.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213610+0000","last_change":"2024-09-22T08:10:49.188917+0000","last_active":"2024-09-22T08:11:23.213610+0000","last_peered":"2024-09-22T08:11:23.213610+0000","last_clean":"2024-09-22T08:11:23.213610+0000","last_became_active":"2024-09-22T08:10:49.188444+0000","last_became_peered":"2024-09-22T08:10:49.188444+0000","last_unstale":"2024-09-22T08:11:23.213610+0000","last_undegraded":"2024-09-22T08:11:23.213610+0000","last_fullsized":"2024-09-22T08:11:23.213610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:27.352744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":472,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.796535+0000","last_change":"2024-09-22T08:10:51.197818+0000","last_active":"2024-09-22T08:13:59.796535+0000","last_peered":"2024-09-22T08:13:59.796535+0000","last_clean":"2024-09-22T08:13:59.796535+0000","last_became_active":"2024-09-22T08:10:51.197248+0000","last_became_peered":"2024-09-22T08:10:51.197248+0000","last_unstale":"2024-09-22T08:13:59.796535+0000","last_undegraded":"2024-09-22T08:13:59.796535+0000","last_fullsized":"2024-09-22T08:13:59.796535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.360311+0000","last_change":"2024-09-22T08:10:53.195875+0000","last_active":"2024-09-22T08:12:52.360311+0000","last_peered":"2024-09-22T08:12:52.360311+0000","last_clean":"2024-09-22T08:12:52.360311+0000","last_became_active":"2024-09-22T08:10:53.195539+0000","last_became_peered":"2024-09-22T08:10:53.195539+0000","last_unstale":"2024-09-22T08:12:52.360311+0000","last_undegraded":"2024-09-22T08:12:52.360311+0000","last_fullsized":"2024-09-22T08:12:52.360311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:10.933920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254832+0000","last_change":"2024-09-22T08:11:23.226070+0000","last_active":"2024-09-22T08:13:53.254832+0000","last_peered":"2024-09-22T08:13:53.254832+0000","last_clean":"2024-09-22T08:13:53.254832+0000","last_became_active":"2024-09-22T08:11:23.220943+0000","last_became_peered":"2024-09-22T08:11:23.220943+0000","last_unstale":"2024-09-22T08:13:53.254832+0000","last_undegraded":"2024-09-22T08:13:53.254832+0000","last_fullsized":"2024-09-22T08:13:53.254832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:18.981650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.249213+0000","last_change":"2024-09-22T08:10:43.198294+0000","last_active":"2024-09-22T08:13:53.249213+0000","last_peered":"2024-09-22T08:13:53.249213+0000","last_clean":"2024-09-22T08:13:53.249213+0000","last_became_active":"2024-09-22T08:10:43.196211+0000","last_became_peered":"2024-09-22T08:10:43.196211+0000","last_unstale":"2024-09-22T08:13:53.249213+0000","last_undegraded":"2024-09-22T08:13:53.249213+0000","last_fullsized":"2024-09-22T08:13:53.249213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:16.704599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211379+0000","last_change":"2024-09-22T08:10:47.177015+0000","last_active":"2024-09-22T08:11:23.211379+0000","last_peered":"2024-09-22T08:11:23.211379+0000","last_clean":"2024-09-22T08:11:23.211379+0000","last_became_active":"2024-09-22T08:10:47.176634+0000","last_became_peered":"2024-09-22T08:10:47.176634+0000","last_unstale":"2024-09-22T08:11:23.211379+0000","last_undegraded":"2024-09-22T08:11:23.211379+0000","last_fullsized":"2024-09-22T08:11:23.211379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:32.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'41","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.861199+0000","last_change":"2024-09-22T08:10:49.179447+0000","last_active":"2024-09-22T08:13:59.861199+0000","last_peered":"2024-09-22T08:13:59.861199+0000","last_clean":"2024-09-22T08:13:59.861199+0000","last_became_active":"2024-09-22T08:10:49.178942+0000","last_became_peered":"2024-09-22T08:10:49.178942+0000","last_unstale":"2024-09-22T08:13:59.861199+0000","last_undegraded":"2024-09-22T08:13:59.861199+0000","last_fullsized":"2024-09-22T08:13:59.861199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:49.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207501+0000","last_change":"2024-09-22T08:10:51.192777+0000","last_active":"2024-09-22T08:11:23.207501+0000","last_peered":"2024-09-22T08:11:23.207501+0000","last_clean":"2024-09-22T08:11:23.207501+0000","last_became_active":"2024-09-22T08:10:51.192482+0000","last_became_peered":"2024-09-22T08:10:51.192482+0000","last_unstale":"2024-09-22T08:11:23.207501+0000","last_undegraded":"2024-09-22T08:11:23.207501+0000","last_fullsized":"2024-09-22T08:11:23.207501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:39.871977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.288651+0000","last_change":"2024-09-22T08:10:53.193739+0000","last_active":"2024-09-22T08:13:53.288651+0000","last_peered":"2024-09-22T08:13:53.288651+0000","last_clean":"2024-09-22T08:13:53.288651+0000","last_became_active":"2024-09-22T08:10:53.193315+0000","last_became_peered":"2024-09-22T08:10:53.193315+0000","last_unstale":"2024-09-22T08:13:53.288651+0000","last_undegraded":"2024-09-22T08:13:53.288651+0000","last_fullsized":"2024-09-22T08:13:53.288651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:02.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.576265+0000","last_change":"2024-09-22T08:10:45.176318+0000","last_active":"2024-09-22T08:12:52.576265+0000","last_peered":"2024-09-22T08:12:52.576265+0000","last_clean":"2024-09-22T08:12:52.576265+0000","last_became_active":"2024-09-22T08:10:45.176033+0000","last_became_peered":"2024-09-22T08:10:45.176033+0000","last_unstale":"2024-09-22T08:12:52.576265+0000","last_undegraded":"2024-09-22T08:12:52.576265+0000","last_fullsized":"2024-09-22T08:12:52.576265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:16.885517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210644+0000","last_change":"2024-09-22T08:10:29.013963+0000","last_active":"2024-09-22T08:11:23.210644+0000","last_peered":"2024-09-22T08:11:23.210644+0000","last_clean":"2024-09-22T08:11:23.210644+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:11:23.210644+0000","last_undegraded":"2024-09-22T08:11:23.210644+0000","last_fullsized":"2024-09-22T08:11:23.210644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:27.897500+0000","last_clean_scrub_stamp":"2024-09-22T08:10:27.897500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:09.733603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211507+0000","last_change":"2024-09-22T08:10:35.923301+0000","last_active":"2024-09-22T08:11:23.211507+0000","last_peered":"2024-09-22T08:11:23.211507+0000","last_clean":"2024-09-22T08:11:23.211507+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:11:23.211507+0000","last_undegraded":"2024-09-22T08:11:23.211507+0000","last_fullsized":"2024-09-22T08:11:23.211507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:47.170548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.851430+0000","last_change":"2024-09-22T08:10:43.201333+0000","last_active":"2024-09-22T08:13:52.851430+0000","last_peered":"2024-09-22T08:13:52.851430+0000","last_clean":"2024-09-22T08:13:52.851430+0000","last_became_active":"2024-09-22T08:10:43.200918+0000","last_became_peered":"2024-09-22T08:10:43.200918+0000","last_unstale":"2024-09-22T08:13:52.851430+0000","last_undegraded":"2024-09-22T08:13:52.851430+0000","last_fullsized":"2024-09-22T08:13:52.851430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:56.138697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"25'1","reported_seq":221,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.767241+0000","last_change":"2024-09-22T08:10:47.176080+0000","last_active":"2024-09-22T08:13:59.767241+0000","last_peered":"2024-09-22T08:13:59.767241+0000","last_clean":"2024-09-22T08:13:59.767241+0000","last_became_active":"2024-09-22T08:10:47.175775+0000","last_became_peered":"2024-09-22T08:10:47.175775+0000","last_unstale":"2024-09-22T08:13:59.767241+0000","last_undegraded":"2024-09-22T08:13:59.767241+0000","last_fullsized":"2024-09-22T08:13:59.767241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:05.368279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.894756+0000","last_change":"2024-09-22T08:10:49.185987+0000","last_active":"2024-09-22T08:13:59.894756+0000","last_peered":"2024-09-22T08:13:59.894756+0000","last_clean":"2024-09-22T08:13:59.894756+0000","last_became_active":"2024-09-22T08:10:49.185661+0000","last_became_peered":"2024-09-22T08:10:49.185661+0000","last_unstale":"2024-09-22T08:13:59.894756+0000","last_undegraded":"2024-09-22T08:13:59.894756+0000","last_fullsized":"2024-09-22T08:13:59.894756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:08.519832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222697+0000","last_change":"2024-09-22T08:10:51.202811+0000","last_active":"2024-09-22T08:11:23.222697+0000","last_peered":"2024-09-22T08:11:23.222697+0000","last_clean":"2024-09-22T08:11:23.222697+0000","last_became_active":"2024-09-22T08:10:51.202473+0000","last_became_peered":"2024-09-22T08:10:51.202473+0000","last_unstale":"2024-09-22T08:11:23.222697+0000","last_undegraded":"2024-09-22T08:11:23.222697+0000","last_fullsized":"2024-09-22T08:11:23.222697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.556104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.266227+0000","last_change":"2024-09-22T08:10:53.192244+0000","last_active":"2024-09-22T08:13:53.266227+0000","last_peered":"2024-09-22T08:13:53.266227+0000","last_clean":"2024-09-22T08:13:53.266227+0000","last_became_active":"2024-09-22T08:10:53.191752+0000","last_became_peered":"2024-09-22T08:10:53.191752+0000","last_unstale":"2024-09-22T08:13:53.266227+0000","last_undegraded":"2024-09-22T08:13:53.266227+0000","last_fullsized":"2024-09-22T08:13:53.266227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:21.155421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183521+0000","last_change":"2024-09-22T08:10:45.167615+0000","last_active":"2024-09-22T08:13:53.183521+0000","last_peered":"2024-09-22T08:13:53.183521+0000","last_clean":"2024-09-22T08:13:53.183521+0000","last_became_active":"2024-09-22T08:10:45.167260+0000","last_became_peered":"2024-09-22T08:10:45.167260+0000","last_unstale":"2024-09-22T08:13:53.183521+0000","last_undegraded":"2024-09-22T08:13:53.183521+0000","last_fullsized":"2024-09-22T08:13:53.183521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:09.439811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209592+0000","last_change":"2024-09-22T08:10:35.922413+0000","last_active":"2024-09-22T08:11:23.209592+0000","last_peered":"2024-09-22T08:11:23.209592+0000","last_clean":"2024-09-22T08:11:23.209592+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:11:23.209592+0000","last_undegraded":"2024-09-22T08:11:23.209592+0000","last_fullsized":"2024-09-22T08:11:23.209592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:14.955260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.177638+0000","last_change":"2024-09-22T08:10:43.178602+0000","last_active":"2024-09-22T08:13:53.177638+0000","last_peered":"2024-09-22T08:13:53.177638+0000","last_clean":"2024-09-22T08:13:53.177638+0000","last_became_active":"2024-09-22T08:10:43.177928+0000","last_became_peered":"2024-09-22T08:10:43.177928+0000","last_unstale":"2024-09-22T08:13:53.177638+0000","last_undegraded":"2024-09-22T08:13:53.177638+0000","last_fullsized":"2024-09-22T08:13:53.177638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:47.867688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212854+0000","last_change":"2024-09-22T08:10:47.176700+0000","last_active":"2024-09-22T08:11:23.212854+0000","last_peered":"2024-09-22T08:11:23.212854+0000","last_clean":"2024-09-22T08:11:23.212854+0000","last_became_active":"2024-09-22T08:10:47.176402+0000","last_became_peered":"2024-09-22T08:10:47.176402+0000","last_unstale":"2024-09-22T08:11:23.212854+0000","last_undegraded":"2024-09-22T08:11:23.212854+0000","last_fullsized":"2024-09-22T08:11:23.212854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:30.271890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'284","reported_seq":501,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.921574+0000","last_change":"2024-09-22T08:10:49.186526+0000","last_active":"2024-09-22T08:13:59.921574+0000","last_peered":"2024-09-22T08:13:59.921574+0000","last_clean":"2024-09-22T08:13:59.921574+0000","last_became_active":"2024-09-22T08:10:49.186277+0000","last_became_peered":"2024-09-22T08:10:49.186277+0000","last_unstale":"2024-09-22T08:13:59.921574+0000","last_undegraded":"2024-09-22T08:13:59.921574+0000","last_fullsized":"2024-09-22T08:13:59.921574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:42.950185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210281+0000","last_change":"2024-09-22T08:10:51.198493+0000","last_active":"2024-09-22T08:11:23.210281+0000","last_peered":"2024-09-22T08:11:23.210281+0000","last_clean":"2024-09-22T08:11:23.210281+0000","last_became_active":"2024-09-22T08:10:51.196837+0000","last_became_peered":"2024-09-22T08:10:51.196837+0000","last_unstale":"2024-09-22T08:11:23.210281+0000","last_undegraded":"2024-09-22T08:11:23.210281+0000","last_fullsized":"2024-09-22T08:11:23.210281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:20.497307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.832166+0000","last_change":"2024-09-22T08:10:53.199926+0000","last_active":"2024-09-22T08:12:08.832166+0000","last_peered":"2024-09-22T08:12:08.832166+0000","last_clean":"2024-09-22T08:12:08.832166+0000","last_became_active":"2024-09-22T08:10:53.199214+0000","last_became_peered":"2024-09-22T08:10:53.199214+0000","last_unstale":"2024-09-22T08:12:08.832166+0000","last_undegraded":"2024-09-22T08:12:08.832166+0000","last_fullsized":"2024-09-22T08:12:08.832166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:35.327109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'11","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.958255+0000","last_change":"2024-09-22T08:10:45.176242+0000","last_active":"2024-09-22T08:13:52.958255+0000","last_peered":"2024-09-22T08:13:52.958255+0000","last_clean":"2024-09-22T08:13:52.958255+0000","last_became_active":"2024-09-22T08:10:45.175923+0000","last_became_peered":"2024-09-22T08:10:45.175923+0000","last_unstale":"2024-09-22T08:13:52.958255+0000","last_undegraded":"2024-09-22T08:13:52.958255+0000","last_fullsized":"2024-09-22T08:13:52.958255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:05.397239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207525+0000","last_change":"2024-09-22T08:10:36.081840+0000","last_active":"2024-09-22T08:11:23.207525+0000","last_peered":"2024-09-22T08:11:23.207525+0000","last_clean":"2024-09-22T08:11:23.207525+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:11:23.207525+0000","last_undegraded":"2024-09-22T08:11:23.207525+0000","last_fullsized":"2024-09-22T08:11:23.207525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:30.701302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.219803+0000","last_change":"2024-09-22T08:10:43.187298+0000","last_active":"2024-09-22T08:11:23.219803+0000","last_peered":"2024-09-22T08:11:23.219803+0000","last_clean":"2024-09-22T08:11:23.219803+0000","last_became_active":"2024-09-22T08:10:43.186500+0000","last_became_peered":"2024-09-22T08:10:43.186500+0000","last_unstale":"2024-09-22T08:11:23.219803+0000","last_undegraded":"2024-09-22T08:11:23.219803+0000","last_fullsized":"2024-09-22T08:11:23.219803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:05.709839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208957+0000","last_change":"2024-09-22T08:10:47.172553+0000","last_active":"2024-09-22T08:11:23.208957+0000","last_peered":"2024-09-22T08:11:23.208957+0000","last_clean":"2024-09-22T08:11:23.208957+0000","last_became_active":"2024-09-22T08:10:47.172041+0000","last_became_peered":"2024-09-22T08:10:47.172041+0000","last_unstale":"2024-09-22T08:11:23.208957+0000","last_undegraded":"2024-09-22T08:11:23.208957+0000","last_fullsized":"2024-09-22T08:11:23.208957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:29.368363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'18","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254753+0000","last_change":"2024-09-22T08:10:49.180939+0000","last_active":"2024-09-22T08:13:52.254753+0000","last_peered":"2024-09-22T08:13:52.254753+0000","last_clean":"2024-09-22T08:13:52.254753+0000","last_became_active":"2024-09-22T08:10:49.180563+0000","last_became_peered":"2024-09-22T08:10:49.180563+0000","last_unstale":"2024-09-22T08:13:52.254753+0000","last_undegraded":"2024-09-22T08:13:52.254753+0000","last_fullsized":"2024-09-22T08:13:52.254753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:39.091603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221445+0000","last_change":"2024-09-22T08:10:51.202850+0000","last_active":"2024-09-22T08:11:23.221445+0000","last_peered":"2024-09-22T08:11:23.221445+0000","last_clean":"2024-09-22T08:11:23.221445+0000","last_became_active":"2024-09-22T08:10:51.202422+0000","last_became_peered":"2024-09-22T08:10:51.202422+0000","last_unstale":"2024-09-22T08:11:23.221445+0000","last_undegraded":"2024-09-22T08:11:23.221445+0000","last_fullsized":"2024-09-22T08:11:23.221445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:08.745501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209116+0000","last_change":"2024-09-22T08:10:53.200159+0000","last_active":"2024-09-22T08:11:23.209116+0000","last_peered":"2024-09-22T08:11:23.209116+0000","last_clean":"2024-09-22T08:11:23.209116+0000","last_became_active":"2024-09-22T08:10:53.199894+0000","last_became_peered":"2024-09-22T08:10:53.199894+0000","last_unstale":"2024-09-22T08:11:23.209116+0000","last_undegraded":"2024-09-22T08:11:23.209116+0000","last_fullsized":"2024-09-22T08:11:23.209116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:07.697983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828326+0000","last_change":"2024-09-22T08:10:45.167126+0000","last_active":"2024-09-22T08:12:08.828326+0000","last_peered":"2024-09-22T08:12:08.828326+0000","last_clean":"2024-09-22T08:12:08.828326+0000","last_became_active":"2024-09-22T08:10:45.166816+0000","last_became_peered":"2024-09-22T08:10:45.166816+0000","last_unstale":"2024-09-22T08:12:08.828326+0000","last_undegraded":"2024-09-22T08:12:08.828326+0000","last_fullsized":"2024-09-22T08:12:08.828326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:52.901946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209498+0000","last_change":"2024-09-22T08:10:35.923055+0000","last_active":"2024-09-22T08:11:23.209498+0000","last_peered":"2024-09-22T08:11:23.209498+0000","last_clean":"2024-09-22T08:11:23.209498+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:11:23.209498+0000","last_undegraded":"2024-09-22T08:11:23.209498+0000","last_fullsized":"2024-09-22T08:11:23.209498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:18.937721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207661+0000","last_change":"2024-09-22T08:10:43.187474+0000","last_active":"2024-09-22T08:11:23.207661+0000","last_peered":"2024-09-22T08:11:23.207661+0000","last_clean":"2024-09-22T08:11:23.207661+0000","last_became_active":"2024-09-22T08:10:43.187103+0000","last_became_peered":"2024-09-22T08:10:43.187103+0000","last_unstale":"2024-09-22T08:11:23.207661+0000","last_undegraded":"2024-09-22T08:11:23.207661+0000","last_fullsized":"2024-09-22T08:11:23.207661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:48.594128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222126+0000","last_change":"2024-09-22T08:10:47.168792+0000","last_active":"2024-09-22T08:11:23.222126+0000","last_peered":"2024-09-22T08:11:23.222126+0000","last_clean":"2024-09-22T08:11:23.222126+0000","last_became_active":"2024-09-22T08:10:47.168480+0000","last_became_peered":"2024-09-22T08:10:47.168480+0000","last_unstale":"2024-09-22T08:11:23.222126+0000","last_undegraded":"2024-09-22T08:11:23.222126+0000","last_fullsized":"2024-09-22T08:11:23.222126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:19.091966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.586312+0000","last_change":"2024-09-22T08:10:49.185221+0000","last_active":"2024-09-22T08:13:52.586312+0000","last_peered":"2024-09-22T08:13:52.586312+0000","last_clean":"2024-09-22T08:13:52.586312+0000","last_became_active":"2024-09-22T08:10:49.184961+0000","last_became_peered":"2024-09-22T08:10:49.184961+0000","last_unstale":"2024-09-22T08:13:52.586312+0000","last_undegraded":"2024-09-22T08:13:52.586312+0000","last_fullsized":"2024-09-22T08:13:52.586312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:00.221298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213144+0000","last_change":"2024-09-22T08:10:51.195952+0000","last_active":"2024-09-22T08:11:23.213144+0000","last_peered":"2024-09-22T08:11:23.213144+0000","last_clean":"2024-09-22T08:11:23.213144+0000","last_became_active":"2024-09-22T08:10:51.195643+0000","last_became_peered":"2024-09-22T08:10:51.195643+0000","last_unstale":"2024-09-22T08:11:23.213144+0000","last_undegraded":"2024-09-22T08:11:23.213144+0000","last_fullsized":"2024-09-22T08:11:23.213144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:18.035075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.336216+0000","last_change":"2024-09-22T08:10:53.203765+0000","last_active":"2024-09-22T08:12:52.336216+0000","last_peered":"2024-09-22T08:12:52.336216+0000","last_clean":"2024-09-22T08:12:52.336216+0000","last_became_active":"2024-09-22T08:10:53.203330+0000","last_became_peered":"2024-09-22T08:10:53.203330+0000","last_unstale":"2024-09-22T08:12:52.336216+0000","last_undegraded":"2024-09-22T08:12:52.336216+0000","last_fullsized":"2024-09-22T08:12:52.336216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:46.081338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.047853+0000","last_change":"2024-09-22T08:10:45.182440+0000","last_active":"2024-09-22T08:13:53.047853+0000","last_peered":"2024-09-22T08:13:53.047853+0000","last_clean":"2024-09-22T08:13:53.047853+0000","last_became_active":"2024-09-22T08:10:45.182276+0000","last_became_peered":"2024-09-22T08:10:45.182276+0000","last_unstale":"2024-09-22T08:13:53.047853+0000","last_undegraded":"2024-09-22T08:13:53.047853+0000","last_fullsized":"2024-09-22T08:13:53.047853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:53.891115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.164200+0000","last_change":"2024-09-22T08:10:43.193611+0000","last_active":"2024-09-22T08:13:53.164200+0000","last_peered":"2024-09-22T08:13:53.164200+0000","last_clean":"2024-09-22T08:13:53.164200+0000","last_became_active":"2024-09-22T08:10:43.186175+0000","last_became_peered":"2024-09-22T08:10:43.186175+0000","last_unstale":"2024-09-22T08:13:53.164200+0000","last_undegraded":"2024-09-22T08:13:53.164200+0000","last_fullsized":"2024-09-22T08:13:53.164200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:31.708040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221346+0000","last_change":"2024-09-22T08:10:35.924829+0000","last_active":"2024-09-22T08:11:23.221346+0000","last_peered":"2024-09-22T08:11:23.221346+0000","last_clean":"2024-09-22T08:11:23.221346+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:11:23.221346+0000","last_undegraded":"2024-09-22T08:11:23.221346+0000","last_fullsized":"2024-09-22T08:11:23.221346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:15.126946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.372150+0000","last_change":"2024-09-22T08:10:47.167981+0000","last_active":"2024-09-22T08:13:53.372150+0000","last_peered":"2024-09-22T08:13:53.372150+0000","last_clean":"2024-09-22T08:13:53.372150+0000","last_became_active":"2024-09-22T08:10:47.167620+0000","last_became_peered":"2024-09-22T08:10:47.167620+0000","last_unstale":"2024-09-22T08:13:53.372150+0000","last_undegraded":"2024-09-22T08:13:53.372150+0000","last_fullsized":"2024-09-22T08:13:53.372150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:35.145384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'70","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.905259+0000","last_change":"2024-09-22T08:10:49.185023+0000","last_active":"2024-09-22T08:13:59.905259+0000","last_peered":"2024-09-22T08:13:59.905259+0000","last_clean":"2024-09-22T08:13:59.905259+0000","last_became_active":"2024-09-22T08:10:49.184753+0000","last_became_peered":"2024-09-22T08:10:49.184753+0000","last_unstale":"2024-09-22T08:13:59.905259+0000","last_undegraded":"2024-09-22T08:13:59.905259+0000","last_fullsized":"2024-09-22T08:13:59.905259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:46.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206763+0000","last_change":"2024-09-22T08:10:51.197026+0000","last_active":"2024-09-22T08:11:23.206763+0000","last_peered":"2024-09-22T08:11:23.206763+0000","last_clean":"2024-09-22T08:11:23.206763+0000","last_became_active":"2024-09-22T08:10:51.196724+0000","last_became_peered":"2024-09-22T08:10:51.196724+0000","last_unstale":"2024-09-22T08:11:23.206763+0000","last_undegraded":"2024-09-22T08:11:23.206763+0000","last_fullsized":"2024-09-22T08:11:23.206763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:06.499640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.230225+0000","last_change":"2024-09-22T08:10:53.196686+0000","last_active":"2024-09-22T08:13:53.230225+0000","last_peered":"2024-09-22T08:13:53.230225+0000","last_clean":"2024-09-22T08:13:53.230225+0000","last_became_active":"2024-09-22T08:10:53.196406+0000","last_became_peered":"2024-09-22T08:10:53.196406+0000","last_unstale":"2024-09-22T08:13:53.230225+0000","last_undegraded":"2024-09-22T08:13:53.230225+0000","last_fullsized":"2024-09-22T08:13:53.230225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:42.892968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254919+0000","last_change":"2024-09-22T08:10:45.176907+0000","last_active":"2024-09-22T08:13:53.254919+0000","last_peered":"2024-09-22T08:13:53.254919+0000","last_clean":"2024-09-22T08:13:53.254919+0000","last_became_active":"2024-09-22T08:10:45.176601+0000","last_became_peered":"2024-09-22T08:10:45.176601+0000","last_unstale":"2024-09-22T08:13:53.254919+0000","last_undegraded":"2024-09-22T08:13:53.254919+0000","last_fullsized":"2024-09-22T08:13:53.254919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:23:25.305179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.170482+0000","last_change":"2024-09-22T08:10:43.187808+0000","last_active":"2024-09-22T08:13:53.170482+0000","last_peered":"2024-09-22T08:13:53.170482+0000","last_clean":"2024-09-22T08:13:53.170482+0000","last_became_active":"2024-09-22T08:10:43.186758+0000","last_became_peered":"2024-09-22T08:10:43.186758+0000","last_unstale":"2024-09-22T08:13:53.170482+0000","last_undegraded":"2024-09-22T08:13:53.170482+0000","last_fullsized":"2024-09-22T08:13:53.170482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:23.595549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211013+0000","last_change":"2024-09-22T08:10:35.922434+0000","last_active":"2024-09-22T08:11:23.211013+0000","last_peered":"2024-09-22T08:11:23.211013+0000","last_clean":"2024-09-22T08:11:23.211013+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:11:23.211013+0000","last_undegraded":"2024-09-22T08:11:23.211013+0000","last_fullsized":"2024-09-22T08:11:23.211013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:15:36.971498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209307+0000","last_change":"2024-09-22T08:10:47.173748+0000","last_active":"2024-09-22T08:11:23.209307+0000","last_peered":"2024-09-22T08:11:23.209307+0000","last_clean":"2024-09-22T08:11:23.209307+0000","last_became_active":"2024-09-22T08:10:47.173348+0000","last_became_peered":"2024-09-22T08:10:47.173348+0000","last_unstale":"2024-09-22T08:11:23.209307+0000","last_undegraded":"2024-09-22T08:11:23.209307+0000","last_fullsized":"2024-09-22T08:11:23.209307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:18:06.081248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212964+0000","last_change":"2024-09-22T08:10:49.187453+0000","last_active":"2024-09-22T08:11:23.212964+0000","last_peered":"2024-09-22T08:11:23.212964+0000","last_clean":"2024-09-22T08:11:23.212964+0000","last_became_active":"2024-09-22T08:10:49.187184+0000","last_became_peered":"2024-09-22T08:10:49.187184+0000","last_unstale":"2024-09-22T08:11:23.212964+0000","last_undegraded":"2024-09-22T08:11:23.212964+0000","last_fullsized":"2024-09-22T08:11:23.212964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:19:08.593807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":373,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.792731+0000","last_change":"2024-09-22T08:10:51.197450+0000","last_active":"2024-09-22T08:13:59.792731+0000","last_peered":"2024-09-22T08:13:59.792731+0000","last_clean":"2024-09-22T08:13:59.792731+0000","last_became_active":"2024-09-22T08:10:51.197111+0000","last_became_peered":"2024-09-22T08:10:51.197111+0000","last_unstale":"2024-09-22T08:13:59.792731+0000","last_undegraded":"2024-09-22T08:13:59.792731+0000","last_fullsized":"2024-09-22T08:13:59.792731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212274+0000","last_change":"2024-09-22T08:10:53.200428+0000","last_active":"2024-09-22T08:11:23.212274+0000","last_peered":"2024-09-22T08:11:23.212274+0000","last_clean":"2024-09-22T08:11:23.212274+0000","last_became_active":"2024-09-22T08:10:53.199612+0000","last_became_peered":"2024-09-22T08:10:53.199612+0000","last_unstale":"2024-09-22T08:11:23.212274+0000","last_undegraded":"2024-09-22T08:11:23.212274+0000","last_fullsized":"2024-09-22T08:11:23.212274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:47.560464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.007599+0000","last_change":"2024-09-22T08:10:45.183951+0000","last_active":"2024-09-22T08:11:26.007599+0000","last_peered":"2024-09-22T08:11:26.007599+0000","last_clean":"2024-09-22T08:11:26.007599+0000","last_became_active":"2024-09-22T08:10:45.183229+0000","last_became_peered":"2024-09-22T08:10:45.183229+0000","last_unstale":"2024-09-22T08:11:26.007599+0000","last_undegraded":"2024-09-22T08:11:26.007599+0000","last_fullsized":"2024-09-22T08:11:26.007599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:03.361288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214275+0000","last_change":"2024-09-22T08:10:43.199726+0000","last_active":"2024-09-22T08:11:23.214275+0000","last_peered":"2024-09-22T08:11:23.214275+0000","last_clean":"2024-09-22T08:11:23.214275+0000","last_became_active":"2024-09-22T08:10:43.198637+0000","last_became_peered":"2024-09-22T08:10:43.198637+0000","last_unstale":"2024-09-22T08:11:23.214275+0000","last_undegraded":"2024-09-22T08:11:23.214275+0000","last_fullsized":"2024-09-22T08:11:23.214275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.086176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222838+0000","last_change":"2024-09-22T08:10:35.924894+0000","last_active":"2024-09-22T08:11:23.222838+0000","last_peered":"2024-09-22T08:11:23.222838+0000","last_clean":"2024-09-22T08:11:23.222838+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:11:23.222838+0000","last_undegraded":"2024-09-22T08:11:23.222838+0000","last_fullsized":"2024-09-22T08:11:23.222838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:31.373918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221460+0000","last_change":"2024-09-22T08:11:23.216945+0000","last_active":"2024-09-22T08:11:23.221460+0000","last_peered":"2024-09-22T08:11:23.221460+0000","last_clean":"2024-09-22T08:11:23.221460+0000","last_became_active":"2024-09-22T08:11:23.216676+0000","last_became_peered":"2024-09-22T08:11:23.216676+0000","last_unstale":"2024-09-22T08:11:23.221460+0000","last_undegraded":"2024-09-22T08:11:23.221460+0000","last_fullsized":"2024-09-22T08:11:23.221460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:46.451332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213139+0000","last_change":"2024-09-22T08:10:49.188685+0000","last_active":"2024-09-22T08:11:23.213139+0000","last_peered":"2024-09-22T08:11:23.213139+0000","last_clean":"2024-09-22T08:11:23.213139+0000","last_became_active":"2024-09-22T08:10:49.188309+0000","last_became_peered":"2024-09-22T08:10:49.188309+0000","last_unstale":"2024-09-22T08:11:23.213139+0000","last_undegraded":"2024-09-22T08:11:23.213139+0000","last_fullsized":"2024-09-22T08:11:23.213139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.497319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.797838+0000","last_change":"2024-09-22T08:10:51.193163+0000","last_active":"2024-09-22T08:13:59.797838+0000","last_peered":"2024-09-22T08:13:59.797838+0000","last_clean":"2024-09-22T08:13:59.797838+0000","last_became_active":"2024-09-22T08:10:51.192058+0000","last_became_peered":"2024-09-22T08:10:51.192058+0000","last_unstale":"2024-09-22T08:13:59.797838+0000","last_undegraded":"2024-09-22T08:13:59.797838+0000","last_fullsized":"2024-09-22T08:13:59.797838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213624+0000","last_change":"2024-09-22T08:10:53.203958+0000","last_active":"2024-09-22T08:11:23.213624+0000","last_peered":"2024-09-22T08:11:23.213624+0000","last_clean":"2024-09-22T08:11:23.213624+0000","last_became_active":"2024-09-22T08:10:53.203670+0000","last_became_peered":"2024-09-22T08:10:53.203670+0000","last_unstale":"2024-09-22T08:11:23.213624+0000","last_undegraded":"2024-09-22T08:11:23.213624+0000","last_fullsized":"2024-09-22T08:11:23.213624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:04.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'17","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.190706+0000","last_change":"2024-09-22T08:10:45.172007+0000","last_active":"2024-09-22T08:13:53.190706+0000","last_peered":"2024-09-22T08:13:53.190706+0000","last_clean":"2024-09-22T08:13:53.190706+0000","last_became_active":"2024-09-22T08:10:45.171667+0000","last_became_peered":"2024-09-22T08:10:45.171667+0000","last_unstale":"2024-09-22T08:13:53.190706+0000","last_undegraded":"2024-09-22T08:13:53.190706+0000","last_fullsized":"2024-09-22T08:13:53.190706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:31.764706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562709+0000","last_change":"2024-09-22T08:10:43.182563+0000","last_active":"2024-09-22T08:11:25.562709+0000","last_peered":"2024-09-22T08:11:25.562709+0000","last_clean":"2024-09-22T08:11:25.562709+0000","last_became_active":"2024-09-22T08:10:43.182161+0000","last_became_peered":"2024-09-22T08:10:43.182161+0000","last_unstale":"2024-09-22T08:11:25.562709+0000","last_undegraded":"2024-09-22T08:11:25.562709+0000","last_fullsized":"2024-09-22T08:11:25.562709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:48.821851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213965+0000","last_change":"2024-09-22T08:10:35.923155+0000","last_active":"2024-09-22T08:11:23.213965+0000","last_peered":"2024-09-22T08:11:23.213965+0000","last_clean":"2024-09-22T08:11:23.213965+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:11:23.213965+0000","last_undegraded":"2024-09-22T08:11:23.213965+0000","last_fullsized":"2024-09-22T08:11:23.213965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:32.905206+0000","last_clean_scrub_stamp":"2024-09-22T08:10:32.905206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:11:54.812723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209442+0000","last_change":"2024-09-22T08:10:47.174132+0000","last_active":"2024-09-22T08:11:23.209442+0000","last_peered":"2024-09-22T08:11:23.209442+0000","last_clean":"2024-09-22T08:11:23.209442+0000","last_became_active":"2024-09-22T08:10:47.172441+0000","last_became_peered":"2024-09-22T08:10:47.172441+0000","last_unstale":"2024-09-22T08:11:23.209442+0000","last_undegraded":"2024-09-22T08:11:23.209442+0000","last_fullsized":"2024-09-22T08:11:23.209442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:47.078285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.942085+0000","last_change":"2024-09-22T08:10:49.185244+0000","last_active":"2024-09-22T08:13:59.942085+0000","last_peered":"2024-09-22T08:13:59.942085+0000","last_clean":"2024-09-22T08:13:59.942085+0000","last_became_active":"2024-09-22T08:10:49.184942+0000","last_became_peered":"2024-09-22T08:10:49.184942+0000","last_unstale":"2024-09-22T08:13:59.942085+0000","last_undegraded":"2024-09-22T08:13:59.942085+0000","last_fullsized":"2024-09-22T08:13:59.942085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:53.328309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220410+0000","last_change":"2024-09-22T08:10:51.195295+0000","last_active":"2024-09-22T08:11:23.220410+0000","last_peered":"2024-09-22T08:11:23.220410+0000","last_clean":"2024-09-22T08:11:23.220410+0000","last_became_active":"2024-09-22T08:10:51.194912+0000","last_became_peered":"2024-09-22T08:10:51.194912+0000","last_unstale":"2024-09-22T08:11:23.220410+0000","last_undegraded":"2024-09-22T08:11:23.220410+0000","last_fullsized":"2024-09-22T08:11:23.220410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:22.604330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208925+0000","last_change":"2024-09-22T08:10:53.192489+0000","last_active":"2024-09-22T08:11:23.208925+0000","last_peered":"2024-09-22T08:11:23.208925+0000","last_clean":"2024-09-22T08:11:23.208925+0000","last_became_active":"2024-09-22T08:10:53.192189+0000","last_became_peered":"2024-09-22T08:10:53.192189+0000","last_unstale":"2024-09-22T08:11:23.208925+0000","last_undegraded":"2024-09-22T08:11:23.208925+0000","last_fullsized":"2024-09-22T08:11:23.208925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:14.737752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208582+0000","last_change":"2024-09-22T08:10:53.198120+0000","last_active":"2024-09-22T08:11:23.208582+0000","last_peered":"2024-09-22T08:11:23.208582+0000","last_clean":"2024-09-22T08:11:23.208582+0000","last_became_active":"2024-09-22T08:10:53.197799+0000","last_became_peered":"2024-09-22T08:10:53.197799+0000","last_unstale":"2024-09-22T08:11:23.208582+0000","last_undegraded":"2024-09-22T08:11:23.208582+0000","last_fullsized":"2024-09-22T08:11:23.208582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:55.526373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.047862+0000","last_change":"2024-09-22T08:10:45.174189+0000","last_active":"2024-09-22T08:13:53.047862+0000","last_peered":"2024-09-22T08:13:53.047862+0000","last_clean":"2024-09-22T08:13:53.047862+0000","last_became_active":"2024-09-22T08:10:45.173916+0000","last_became_peered":"2024-09-22T08:10:45.173916+0000","last_unstale":"2024-09-22T08:13:53.047862+0000","last_undegraded":"2024-09-22T08:13:53.047862+0000","last_fullsized":"2024-09-22T08:13:53.047862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:27.673736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.422254+0000","last_change":"2024-09-22T08:10:43.201372+0000","last_active":"2024-09-22T08:12:52.422254+0000","last_peered":"2024-09-22T08:12:52.422254+0000","last_clean":"2024-09-22T08:12:52.422254+0000","last_became_active":"2024-09-22T08:10:43.201007+0000","last_became_peered":"2024-09-22T08:10:43.201007+0000","last_unstale":"2024-09-22T08:12:52.422254+0000","last_undegraded":"2024-09-22T08:12:52.422254+0000","last_fullsized":"2024-09-22T08:12:52.422254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:49.200344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212648+0000","last_change":"2024-09-22T08:10:47.176086+0000","last_active":"2024-09-22T08:11:23.212648+0000","last_peered":"2024-09-22T08:11:23.212648+0000","last_clean":"2024-09-22T08:11:23.212648+0000","last_became_active":"2024-09-22T08:10:47.175524+0000","last_became_peered":"2024-09-22T08:10:47.175524+0000","last_unstale":"2024-09-22T08:11:23.212648+0000","last_undegraded":"2024-09-22T08:11:23.212648+0000","last_fullsized":"2024-09-22T08:11:23.212648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:13.592432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.873004+0000","last_change":"2024-09-22T08:10:49.186252+0000","last_active":"2024-09-22T08:13:59.873004+0000","last_peered":"2024-09-22T08:13:59.873004+0000","last_clean":"2024-09-22T08:13:59.873004+0000","last_became_active":"2024-09-22T08:10:49.185693+0000","last_became_peered":"2024-09-22T08:10:49.185693+0000","last_unstale":"2024-09-22T08:13:59.873004+0000","last_undegraded":"2024-09-22T08:13:59.873004+0000","last_fullsized":"2024-09-22T08:13:59.873004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:02.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213000+0000","last_change":"2024-09-22T08:10:51.200112+0000","last_active":"2024-09-22T08:11:23.213000+0000","last_peered":"2024-09-22T08:11:23.213000+0000","last_clean":"2024-09-22T08:11:23.213000+0000","last_became_active":"2024-09-22T08:10:51.199799+0000","last_became_peered":"2024-09-22T08:10:51.199799+0000","last_unstale":"2024-09-22T08:11:23.213000+0000","last_undegraded":"2024-09-22T08:11:23.213000+0000","last_fullsized":"2024-09-22T08:11:23.213000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:06.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'13","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.308456+0000","last_change":"2024-09-22T08:10:53.201508+0000","last_active":"2024-09-22T08:13:53.308456+0000","last_peered":"2024-09-22T08:13:53.308456+0000","last_clean":"2024-09-22T08:13:53.308456+0000","last_became_active":"2024-09-22T08:10:53.201209+0000","last_became_peered":"2024-09-22T08:10:53.201209+0000","last_unstale":"2024-09-22T08:13:53.308456+0000","last_undegraded":"2024-09-22T08:13:53.308456+0000","last_fullsized":"2024-09-22T08:13:53.308456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:20.642196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":69,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183415+0000","last_change":"2024-09-22T08:10:45.182432+0000","last_active":"2024-09-22T08:13:53.183415+0000","last_peered":"2024-09-22T08:13:53.183415+0000","last_clean":"2024-09-22T08:13:53.183415+0000","last_became_active":"2024-09-22T08:10:45.182245+0000","last_became_peered":"2024-09-22T08:10:45.182245+0000","last_unstale":"2024-09-22T08:13:53.183415+0000","last_undegraded":"2024-09-22T08:13:53.183415+0000","last_fullsized":"2024-09-22T08:13:53.183415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:33.105535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.882440+0000","last_change":"2024-09-22T08:10:43.193144+0000","last_active":"2024-09-22T08:13:52.882440+0000","last_peered":"2024-09-22T08:13:52.882440+0000","last_clean":"2024-09-22T08:13:52.882440+0000","last_became_active":"2024-09-22T08:10:43.185230+0000","last_became_peered":"2024-09-22T08:10:43.185230+0000","last_unstale":"2024-09-22T08:13:52.882440+0000","last_undegraded":"2024-09-22T08:13:52.882440+0000","last_fullsized":"2024-09-22T08:13:52.882440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:51.284672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209614+0000","last_change":"2024-09-22T08:10:47.176256+0000","last_active":"2024-09-22T08:11:23.209614+0000","last_peered":"2024-09-22T08:11:23.209614+0000","last_clean":"2024-09-22T08:11:23.209614+0000","last_became_active":"2024-09-22T08:10:47.175747+0000","last_became_peered":"2024-09-22T08:10:47.175747+0000","last_unstale":"2024-09-22T08:11:23.209614+0000","last_undegraded":"2024-09-22T08:11:23.209614+0000","last_fullsized":"2024-09-22T08:11:23.209614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:17.217421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.591034+0000","last_change":"2024-09-22T08:10:49.181276+0000","last_active":"2024-09-22T08:13:52.591034+0000","last_peered":"2024-09-22T08:13:52.591034+0000","last_clean":"2024-09-22T08:13:52.591034+0000","last_became_active":"2024-09-22T08:10:49.180921+0000","last_became_peered":"2024-09-22T08:10:49.180921+0000","last_unstale":"2024-09-22T08:13:52.591034+0000","last_undegraded":"2024-09-22T08:13:52.591034+0000","last_fullsized":"2024-09-22T08:13:52.591034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:10.724160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207132+0000","last_change":"2024-09-22T08:10:51.193254+0000","last_active":"2024-09-22T08:11:23.207132+0000","last_peered":"2024-09-22T08:11:23.207132+0000","last_clean":"2024-09-22T08:11:23.207132+0000","last_became_active":"2024-09-22T08:10:51.192989+0000","last_became_peered":"2024-09-22T08:10:51.192989+0000","last_unstale":"2024-09-22T08:11:23.207132+0000","last_undegraded":"2024-09-22T08:11:23.207132+0000","last_fullsized":"2024-09-22T08:11:23.207132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:29.015464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.008653+0000","last_change":"2024-09-22T08:10:53.193317+0000","last_active":"2024-09-22T08:12:09.008653+0000","last_peered":"2024-09-22T08:12:09.008653+0000","last_clean":"2024-09-22T08:12:09.008653+0000","last_became_active":"2024-09-22T08:10:53.192967+0000","last_became_peered":"2024-09-22T08:10:53.192967+0000","last_unstale":"2024-09-22T08:12:09.008653+0000","last_undegraded":"2024-09-22T08:12:09.008653+0000","last_fullsized":"2024-09-22T08:12:09.008653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:48.815518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.468115+0000","last_change":"2024-09-22T08:10:45.172599+0000","last_active":"2024-09-22T08:12:49.468115+0000","last_peered":"2024-09-22T08:12:49.468115+0000","last_clean":"2024-09-22T08:12:49.468115+0000","last_became_active":"2024-09-22T08:10:45.171555+0000","last_became_peered":"2024-09-22T08:10:45.171555+0000","last_unstale":"2024-09-22T08:12:49.468115+0000","last_undegraded":"2024-09-22T08:12:49.468115+0000","last_fullsized":"2024-09-22T08:12:49.468115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:27.811575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211087+0000","last_change":"2024-09-22T08:10:43.192664+0000","last_active":"2024-09-22T08:11:23.211087+0000","last_peered":"2024-09-22T08:11:23.211087+0000","last_clean":"2024-09-22T08:11:23.211087+0000","last_became_active":"2024-09-22T08:10:43.187044+0000","last_became_peered":"2024-09-22T08:10:43.187044+0000","last_unstale":"2024-09-22T08:11:23.211087+0000","last_undegraded":"2024-09-22T08:11:23.211087+0000","last_fullsized":"2024-09-22T08:11:23.211087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:51.698704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"34'4","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.766619+0000","last_change":"2024-09-22T08:10:47.178036+0000","last_active":"2024-09-22T08:13:59.766619+0000","last_peered":"2024-09-22T08:13:59.766619+0000","last_clean":"2024-09-22T08:13:59.766619+0000","last_became_active":"2024-09-22T08:10:47.177735+0000","last_became_peered":"2024-09-22T08:10:47.177735+0000","last_unstale":"2024-09-22T08:13:59.766619+0000","last_undegraded":"2024-09-22T08:13:59.766619+0000","last_fullsized":"2024-09-22T08:13:59.766619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:05.249659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.839465+0000","last_change":"2024-09-22T08:10:49.182878+0000","last_active":"2024-09-22T08:13:59.839465+0000","last_peered":"2024-09-22T08:13:59.839465+0000","last_clean":"2024-09-22T08:13:59.839465+0000","last_became_active":"2024-09-22T08:10:49.182557+0000","last_became_peered":"2024-09-22T08:10:49.182557+0000","last_unstale":"2024-09-22T08:13:59.839465+0000","last_undegraded":"2024-09-22T08:13:59.839465+0000","last_fullsized":"2024-09-22T08:13:59.839465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:37.230381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212363+0000","last_change":"2024-09-22T08:10:51.198536+0000","last_active":"2024-09-22T08:11:23.212363+0000","last_peered":"2024-09-22T08:11:23.212363+0000","last_clean":"2024-09-22T08:11:23.212363+0000","last_became_active":"2024-09-22T08:10:51.198204+0000","last_became_peered":"2024-09-22T08:10:51.198204+0000","last_unstale":"2024-09-22T08:11:23.212363+0000","last_undegraded":"2024-09-22T08:11:23.212363+0000","last_fullsized":"2024-09-22T08:11:23.212363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.041147+0000","last_change":"2024-09-22T08:10:53.200288+0000","last_active":"2024-09-22T08:11:27.041147+0000","last_peered":"2024-09-22T08:11:27.041147+0000","last_clean":"2024-09-22T08:11:27.041147+0000","last_became_active":"2024-09-22T08:10:53.199827+0000","last_became_peered":"2024-09-22T08:10:53.199827+0000","last_unstale":"2024-09-22T08:11:27.041147+0000","last_undegraded":"2024-09-22T08:11:27.041147+0000","last_fullsized":"2024-09-22T08:11:27.041147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:31.568753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209916+0000","last_change":"2024-09-22T08:10:45.184232+0000","last_active":"2024-09-22T08:11:23.209916+0000","last_peered":"2024-09-22T08:11:23.209916+0000","last_clean":"2024-09-22T08:11:23.209916+0000","last_became_active":"2024-09-22T08:10:45.183674+0000","last_became_peered":"2024-09-22T08:10:45.183674+0000","last_unstale":"2024-09-22T08:11:23.209916+0000","last_undegraded":"2024-09-22T08:11:23.209916+0000","last_fullsized":"2024-09-22T08:11:23.209916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:11.585440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216574+0000","last_change":"2024-09-22T08:10:43.185629+0000","last_active":"2024-09-22T08:11:23.216574+0000","last_peered":"2024-09-22T08:11:23.216574+0000","last_clean":"2024-09-22T08:11:23.216574+0000","last_became_active":"2024-09-22T08:10:43.184287+0000","last_became_peered":"2024-09-22T08:10:43.184287+0000","last_unstale":"2024-09-22T08:11:23.216574+0000","last_undegraded":"2024-09-22T08:11:23.216574+0000","last_fullsized":"2024-09-22T08:11:23.216574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:47.867688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209665+0000","last_change":"2024-09-22T08:10:47.173065+0000","last_active":"2024-09-22T08:11:23.209665+0000","last_peered":"2024-09-22T08:11:23.209665+0000","last_clean":"2024-09-22T08:11:23.209665+0000","last_became_active":"2024-09-22T08:10:47.172816+0000","last_became_peered":"2024-09-22T08:10:47.172816+0000","last_unstale":"2024-09-22T08:11:23.209665+0000","last_undegraded":"2024-09-22T08:11:23.209665+0000","last_fullsized":"2024-09-22T08:11:23.209665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:42.365873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.936199+0000","last_change":"2024-09-22T08:10:49.180939+0000","last_active":"2024-09-22T08:13:59.936199+0000","last_peered":"2024-09-22T08:13:59.936199+0000","last_clean":"2024-09-22T08:13:59.936199+0000","last_became_active":"2024-09-22T08:10:49.180621+0000","last_became_peered":"2024-09-22T08:10:49.180621+0000","last_unstale":"2024-09-22T08:13:59.936199+0000","last_undegraded":"2024-09-22T08:13:59.936199+0000","last_fullsized":"2024-09-22T08:13:59.936199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:10.845059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206973+0000","last_change":"2024-09-22T08:10:51.190255+0000","last_active":"2024-09-22T08:11:23.206973+0000","last_peered":"2024-09-22T08:11:23.206973+0000","last_clean":"2024-09-22T08:11:23.206973+0000","last_became_active":"2024-09-22T08:10:51.189640+0000","last_became_peered":"2024-09-22T08:10:51.189640+0000","last_unstale":"2024-09-22T08:11:23.206973+0000","last_undegraded":"2024-09-22T08:11:23.206973+0000","last_fullsized":"2024-09-22T08:11:23.206973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:01.319577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228734+0000","last_change":"2024-09-22T08:10:45.166911+0000","last_active":"2024-09-22T08:13:53.228734+0000","last_peered":"2024-09-22T08:13:53.228734+0000","last_clean":"2024-09-22T08:13:53.228734+0000","last_became_active":"2024-09-22T08:10:45.166591+0000","last_became_peered":"2024-09-22T08:10:45.166591+0000","last_unstale":"2024-09-22T08:13:53.228734+0000","last_undegraded":"2024-09-22T08:13:53.228734+0000","last_fullsized":"2024-09-22T08:13:53.228734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:01.404622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209800+0000","last_change":"2024-09-22T08:10:43.196054+0000","last_active":"2024-09-22T08:11:23.209800+0000","last_peered":"2024-09-22T08:11:23.209800+0000","last_clean":"2024-09-22T08:11:23.209800+0000","last_became_active":"2024-09-22T08:10:43.195608+0000","last_became_peered":"2024-09-22T08:10:43.195608+0000","last_unstale":"2024-09-22T08:11:23.209800+0000","last_undegraded":"2024-09-22T08:11:23.209800+0000","last_fullsized":"2024-09-22T08:11:23.209800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:24.463602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222765+0000","last_change":"2024-09-22T08:10:47.173698+0000","last_active":"2024-09-22T08:11:23.222765+0000","last_peered":"2024-09-22T08:11:23.222765+0000","last_clean":"2024-09-22T08:11:23.222765+0000","last_became_active":"2024-09-22T08:10:47.173043+0000","last_became_peered":"2024-09-22T08:10:47.173043+0000","last_unstale":"2024-09-22T08:11:23.222765+0000","last_undegraded":"2024-09-22T08:11:23.222765+0000","last_fullsized":"2024-09-22T08:11:23.222765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:50.368872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.933167+0000","last_change":"2024-09-22T08:10:49.181954+0000","last_active":"2024-09-22T08:13:59.933167+0000","last_peered":"2024-09-22T08:13:59.933167+0000","last_clean":"2024-09-22T08:13:59.933167+0000","last_became_active":"2024-09-22T08:10:49.181611+0000","last_became_peered":"2024-09-22T08:10:49.181611+0000","last_unstale":"2024-09-22T08:13:59.933167+0000","last_undegraded":"2024-09-22T08:13:59.933167+0000","last_fullsized":"2024-09-22T08:13:59.933167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:12.944824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207395+0000","last_change":"2024-09-22T08:10:51.190156+0000","last_active":"2024-09-22T08:11:23.207395+0000","last_peered":"2024-09-22T08:11:23.207395+0000","last_clean":"2024-09-22T08:11:23.207395+0000","last_became_active":"2024-09-22T08:10:51.189592+0000","last_became_peered":"2024-09-22T08:10:51.189592+0000","last_unstale":"2024-09-22T08:11:23.207395+0000","last_undegraded":"2024-09-22T08:11:23.207395+0000","last_fullsized":"2024-09-22T08:11:23.207395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:44.042635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.513524+0000","last_change":"2024-09-22T08:10:53.199349+0000","last_active":"2024-09-22T08:12:52.513524+0000","last_peered":"2024-09-22T08:12:52.513524+0000","last_clean":"2024-09-22T08:12:52.513524+0000","last_became_active":"2024-09-22T08:10:53.198999+0000","last_became_peered":"2024-09-22T08:10:53.198999+0000","last_unstale":"2024-09-22T08:12:52.513524+0000","last_undegraded":"2024-09-22T08:12:52.513524+0000","last_fullsized":"2024-09-22T08:12:52.513524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:40.998103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'22","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183552+0000","last_change":"2024-09-22T08:10:45.183697+0000","last_active":"2024-09-22T08:13:53.183552+0000","last_peered":"2024-09-22T08:13:53.183552+0000","last_clean":"2024-09-22T08:13:53.183552+0000","last_became_active":"2024-09-22T08:10:45.183173+0000","last_became_peered":"2024-09-22T08:10:45.183173+0000","last_unstale":"2024-09-22T08:13:53.183552+0000","last_undegraded":"2024-09-22T08:13:53.183552+0000","last_fullsized":"2024-09-22T08:13:53.183552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:20.651086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.564042+0000","last_change":"2024-09-22T08:10:43.178081+0000","last_active":"2024-09-22T08:11:26.564042+0000","last_peered":"2024-09-22T08:11:26.564042+0000","last_clean":"2024-09-22T08:11:26.564042+0000","last_became_active":"2024-09-22T08:10:43.177711+0000","last_became_peered":"2024-09-22T08:10:43.177711+0000","last_unstale":"2024-09-22T08:11:26.564042+0000","last_undegraded":"2024-09-22T08:11:26.564042+0000","last_fullsized":"2024-09-22T08:11:26.564042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:58.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210165+0000","last_change":"2024-09-22T08:10:47.172301+0000","last_active":"2024-09-22T08:11:23.210165+0000","last_peered":"2024-09-22T08:11:23.210165+0000","last_clean":"2024-09-22T08:11:23.210165+0000","last_became_active":"2024-09-22T08:10:47.171702+0000","last_became_peered":"2024-09-22T08:10:47.171702+0000","last_unstale":"2024-09-22T08:11:23.210165+0000","last_undegraded":"2024-09-22T08:11:23.210165+0000","last_fullsized":"2024-09-22T08:11:23.210165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.251018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.939363+0000","last_change":"2024-09-22T08:10:49.183268+0000","last_active":"2024-09-22T08:13:59.939363+0000","last_peered":"2024-09-22T08:13:59.939363+0000","last_clean":"2024-09-22T08:13:59.939363+0000","last_became_active":"2024-09-22T08:10:49.182398+0000","last_became_peered":"2024-09-22T08:10:49.182398+0000","last_unstale":"2024-09-22T08:13:59.939363+0000","last_undegraded":"2024-09-22T08:13:59.939363+0000","last_fullsized":"2024-09-22T08:13:59.939363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:20.960730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214581+0000","last_change":"2024-09-22T08:10:51.202949+0000","last_active":"2024-09-22T08:11:23.214581+0000","last_peered":"2024-09-22T08:11:23.214581+0000","last_clean":"2024-09-22T08:11:23.214581+0000","last_became_active":"2024-09-22T08:10:51.202485+0000","last_became_peered":"2024-09-22T08:10:51.202485+0000","last_unstale":"2024-09-22T08:11:23.214581+0000","last_undegraded":"2024-09-22T08:11:23.214581+0000","last_fullsized":"2024-09-22T08:11:23.214581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.969767+0000","last_change":"2024-09-22T08:10:53.202374+0000","last_active":"2024-09-22T08:13:52.969767+0000","last_peered":"2024-09-22T08:13:52.969767+0000","last_clean":"2024-09-22T08:13:52.969767+0000","last_became_active":"2024-09-22T08:10:53.201942+0000","last_became_peered":"2024-09-22T08:10:53.201942+0000","last_unstale":"2024-09-22T08:13:52.969767+0000","last_undegraded":"2024-09-22T08:13:52.969767+0000","last_fullsized":"2024-09-22T08:13:52.969767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:00.185249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.345446+0000","last_change":"2024-09-22T08:10:45.183871+0000","last_active":"2024-09-22T08:11:26.345446+0000","last_peered":"2024-09-22T08:11:26.345446+0000","last_clean":"2024-09-22T08:11:26.345446+0000","last_became_active":"2024-09-22T08:10:45.183576+0000","last_became_peered":"2024-09-22T08:10:45.183576+0000","last_unstale":"2024-09-22T08:11:26.345446+0000","last_undegraded":"2024-09-22T08:11:26.345446+0000","last_fullsized":"2024-09-22T08:11:26.345446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:50.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212748+0000","last_change":"2024-09-22T08:10:43.179376+0000","last_active":"2024-09-22T08:11:23.212748+0000","last_peered":"2024-09-22T08:11:23.212748+0000","last_clean":"2024-09-22T08:11:23.212748+0000","last_became_active":"2024-09-22T08:10:43.178403+0000","last_became_peered":"2024-09-22T08:10:43.178403+0000","last_unstale":"2024-09-22T08:11:23.212748+0000","last_undegraded":"2024-09-22T08:11:23.212748+0000","last_fullsized":"2024-09-22T08:11:23.212748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:56.538345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208266+0000","last_change":"2024-09-22T08:10:47.172371+0000","last_active":"2024-09-22T08:11:23.208266+0000","last_peered":"2024-09-22T08:11:23.208266+0000","last_clean":"2024-09-22T08:11:23.208266+0000","last_became_active":"2024-09-22T08:10:47.171973+0000","last_became_peered":"2024-09-22T08:10:47.171973+0000","last_unstale":"2024-09-22T08:11:23.208266+0000","last_undegraded":"2024-09-22T08:11:23.208266+0000","last_fullsized":"2024-09-22T08:11:23.208266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:41.035575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.884926+0000","last_change":"2024-09-22T08:10:49.185261+0000","last_active":"2024-09-22T08:13:59.884926+0000","last_peered":"2024-09-22T08:13:59.884926+0000","last_clean":"2024-09-22T08:13:59.884926+0000","last_became_active":"2024-09-22T08:10:49.184885+0000","last_became_peered":"2024-09-22T08:10:49.184885+0000","last_unstale":"2024-09-22T08:13:59.884926+0000","last_undegraded":"2024-09-22T08:13:59.884926+0000","last_fullsized":"2024-09-22T08:13:59.884926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:29.150336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222373+0000","last_change":"2024-09-22T08:10:51.194317+0000","last_active":"2024-09-22T08:11:23.222373+0000","last_peered":"2024-09-22T08:11:23.222373+0000","last_clean":"2024-09-22T08:11:23.222373+0000","last_became_active":"2024-09-22T08:10:51.193970+0000","last_became_peered":"2024-09-22T08:10:51.193970+0000","last_unstale":"2024-09-22T08:11:23.222373+0000","last_undegraded":"2024-09-22T08:11:23.222373+0000","last_fullsized":"2024-09-22T08:11:23.222373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:52.931798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.572122+0000","last_change":"2024-09-22T08:10:53.202778+0000","last_active":"2024-09-22T08:12:52.572122+0000","last_peered":"2024-09-22T08:12:52.572122+0000","last_clean":"2024-09-22T08:12:52.572122+0000","last_became_active":"2024-09-22T08:10:53.202493+0000","last_became_peered":"2024-09-22T08:10:53.202493+0000","last_unstale":"2024-09-22T08:12:52.572122+0000","last_undegraded":"2024-09-22T08:12:52.572122+0000","last_fullsized":"2024-09-22T08:12:52.572122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:44.822421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828530+0000","last_change":"2024-09-22T08:10:45.167131+0000","last_active":"2024-09-22T08:12:08.828530+0000","last_peered":"2024-09-22T08:12:08.828530+0000","last_clean":"2024-09-22T08:12:08.828530+0000","last_became_active":"2024-09-22T08:10:45.166540+0000","last_became_peered":"2024-09-22T08:10:45.166540+0000","last_unstale":"2024-09-22T08:12:08.828530+0000","last_undegraded":"2024-09-22T08:12:08.828530+0000","last_fullsized":"2024-09-22T08:12:08.828530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:51.203215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211107+0000","last_change":"2024-09-22T08:10:43.200355+0000","last_active":"2024-09-22T08:11:23.211107+0000","last_peered":"2024-09-22T08:11:23.211107+0000","last_clean":"2024-09-22T08:11:23.211107+0000","last_became_active":"2024-09-22T08:10:43.199724+0000","last_became_peered":"2024-09-22T08:10:43.199724+0000","last_unstale":"2024-09-22T08:11:23.211107+0000","last_undegraded":"2024-09-22T08:11:23.211107+0000","last_fullsized":"2024-09-22T08:11:23.211107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:25.660243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214717+0000","last_change":"2024-09-22T08:10:47.175833+0000","last_active":"2024-09-22T08:11:23.214717+0000","last_peered":"2024-09-22T08:11:23.214717+0000","last_clean":"2024-09-22T08:11:23.214717+0000","last_became_active":"2024-09-22T08:10:47.175541+0000","last_became_peered":"2024-09-22T08:10:47.175541+0000","last_unstale":"2024-09-22T08:11:23.214717+0000","last_undegraded":"2024-09-22T08:11:23.214717+0000","last_fullsized":"2024-09-22T08:11:23.214717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:17.796324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584978+0000","last_change":"2024-09-22T08:10:49.188295+0000","last_active":"2024-09-22T08:12:52.584978+0000","last_peered":"2024-09-22T08:12:52.584978+0000","last_clean":"2024-09-22T08:12:52.584978+0000","last_became_active":"2024-09-22T08:10:49.187767+0000","last_became_peered":"2024-09-22T08:10:49.187767+0000","last_unstale":"2024-09-22T08:12:52.584978+0000","last_undegraded":"2024-09-22T08:12:52.584978+0000","last_fullsized":"2024-09-22T08:12:52.584978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:02.055272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":370,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.791305+0000","last_change":"2024-09-22T08:10:51.198099+0000","last_active":"2024-09-22T08:13:59.791305+0000","last_peered":"2024-09-22T08:13:59.791305+0000","last_clean":"2024-09-22T08:13:59.791305+0000","last_became_active":"2024-09-22T08:10:51.197814+0000","last_became_peered":"2024-09-22T08:10:51.197814+0000","last_unstale":"2024-09-22T08:13:59.791305+0000","last_undegraded":"2024-09-22T08:13:59.791305+0000","last_fullsized":"2024-09-22T08:13:59.791305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.509973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209032+0000","last_change":"2024-09-22T08:10:53.200170+0000","last_active":"2024-09-22T08:11:23.209032+0000","last_peered":"2024-09-22T08:11:23.209032+0000","last_clean":"2024-09-22T08:11:23.209032+0000","last_became_active":"2024-09-22T08:10:53.199881+0000","last_became_peered":"2024-09-22T08:10:53.199881+0000","last_unstale":"2024-09-22T08:11:23.209032+0000","last_undegraded":"2024-09-22T08:11:23.209032+0000","last_fullsized":"2024-09-22T08:11:23.209032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:46.946049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208021+0000","last_change":"2024-09-22T08:10:45.166388+0000","last_active":"2024-09-22T08:11:23.208021+0000","last_peered":"2024-09-22T08:11:23.208021+0000","last_clean":"2024-09-22T08:11:23.208021+0000","last_became_active":"2024-09-22T08:10:45.166103+0000","last_became_peered":"2024-09-22T08:10:45.166103+0000","last_unstale":"2024-09-22T08:11:23.208021+0000","last_undegraded":"2024-09-22T08:11:23.208021+0000","last_fullsized":"2024-09-22T08:11:23.208021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:07.647439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.818177+0000","last_change":"2024-09-22T08:10:43.180475+0000","last_active":"2024-09-22T08:13:52.818177+0000","last_peered":"2024-09-22T08:13:52.818177+0000","last_clean":"2024-09-22T08:13:52.818177+0000","last_became_active":"2024-09-22T08:10:43.180097+0000","last_became_peered":"2024-09-22T08:10:43.180097+0000","last_unstale":"2024-09-22T08:13:52.818177+0000","last_undegraded":"2024-09-22T08:13:52.818177+0000","last_fullsized":"2024-09-22T08:13:52.818177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:37.378948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212558+0000","last_change":"2024-09-22T08:10:47.175982+0000","last_active":"2024-09-22T08:11:23.212558+0000","last_peered":"2024-09-22T08:11:23.212558+0000","last_clean":"2024-09-22T08:11:23.212558+0000","last_became_active":"2024-09-22T08:10:47.175604+0000","last_became_peered":"2024-09-22T08:10:47.175604+0000","last_unstale":"2024-09-22T08:11:23.212558+0000","last_undegraded":"2024-09-22T08:11:23.212558+0000","last_fullsized":"2024-09-22T08:11:23.212558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:15.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.911039+0000","last_change":"2024-09-22T08:10:49.176102+0000","last_active":"2024-09-22T08:13:59.911039+0000","last_peered":"2024-09-22T08:13:59.911039+0000","last_clean":"2024-09-22T08:13:59.911039+0000","last_became_active":"2024-09-22T08:10:49.175817+0000","last_became_peered":"2024-09-22T08:10:49.175817+0000","last_unstale":"2024-09-22T08:13:59.911039+0000","last_undegraded":"2024-09-22T08:13:59.911039+0000","last_fullsized":"2024-09-22T08:13:59.911039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:19.626204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.219931+0000","last_change":"2024-09-22T08:10:51.192395+0000","last_active":"2024-09-22T08:11:23.219931+0000","last_peered":"2024-09-22T08:11:23.219931+0000","last_clean":"2024-09-22T08:11:23.219931+0000","last_became_active":"2024-09-22T08:10:51.191988+0000","last_became_peered":"2024-09-22T08:10:51.191988+0000","last_unstale":"2024-09-22T08:11:23.219931+0000","last_undegraded":"2024-09-22T08:11:23.219931+0000","last_fullsized":"2024-09-22T08:11:23.219931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216778+0000","last_change":"2024-09-22T08:10:53.199421+0000","last_active":"2024-09-22T08:11:23.216778+0000","last_peered":"2024-09-22T08:11:23.216778+0000","last_clean":"2024-09-22T08:11:23.216778+0000","last_became_active":"2024-09-22T08:10:53.199158+0000","last_became_peered":"2024-09-22T08:10:53.199158+0000","last_unstale":"2024-09-22T08:11:23.216778+0000","last_undegraded":"2024-09-22T08:11:23.216778+0000","last_fullsized":"2024-09-22T08:11:23.216778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:32.896582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.005197+0000","last_change":"2024-09-22T08:10:45.165605+0000","last_active":"2024-09-22T08:11:26.005197+0000","last_peered":"2024-09-22T08:11:26.005197+0000","last_clean":"2024-09-22T08:11:26.005197+0000","last_became_active":"2024-09-22T08:10:45.165116+0000","last_became_peered":"2024-09-22T08:10:45.165116+0000","last_unstale":"2024-09-22T08:11:26.005197+0000","last_undegraded":"2024-09-22T08:11:26.005197+0000","last_fullsized":"2024-09-22T08:11:26.005197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:29.645770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211112+0000","last_change":"2024-09-22T08:10:43.202146+0000","last_active":"2024-09-22T08:11:23.211112+0000","last_peered":"2024-09-22T08:11:23.211112+0000","last_clean":"2024-09-22T08:11:23.211112+0000","last_became_active":"2024-09-22T08:10:43.201076+0000","last_became_peered":"2024-09-22T08:10:43.201076+0000","last_unstale":"2024-09-22T08:11:23.211112+0000","last_undegraded":"2024-09-22T08:11:23.211112+0000","last_fullsized":"2024-09-22T08:11:23.211112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:43.112413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208142+0000","last_change":"2024-09-22T08:10:47.173239+0000","last_active":"2024-09-22T08:11:23.208142+0000","last_peered":"2024-09-22T08:11:23.208142+0000","last_clean":"2024-09-22T08:11:23.208142+0000","last_became_active":"2024-09-22T08:10:47.172988+0000","last_became_peered":"2024-09-22T08:10:47.172988+0000","last_unstale":"2024-09-22T08:11:23.208142+0000","last_undegraded":"2024-09-22T08:11:23.208142+0000","last_fullsized":"2024-09-22T08:11:23.208142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:57.256991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.914196+0000","last_change":"2024-09-22T08:10:49.185163+0000","last_active":"2024-09-22T08:13:59.914196+0000","last_peered":"2024-09-22T08:13:59.914196+0000","last_clean":"2024-09-22T08:13:59.914196+0000","last_became_active":"2024-09-22T08:10:49.184860+0000","last_became_peered":"2024-09-22T08:10:49.184860+0000","last_unstale":"2024-09-22T08:13:59.914196+0000","last_undegraded":"2024-09-22T08:13:59.914196+0000","last_fullsized":"2024-09-22T08:13:59.914196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.255387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209254+0000","last_change":"2024-09-22T08:10:51.200556+0000","last_active":"2024-09-22T08:11:23.209254+0000","last_peered":"2024-09-22T08:11:23.209254+0000","last_clean":"2024-09-22T08:11:23.209254+0000","last_became_active":"2024-09-22T08:10:51.199870+0000","last_became_peered":"2024-09-22T08:10:51.199870+0000","last_unstale":"2024-09-22T08:11:23.209254+0000","last_undegraded":"2024-09-22T08:11:23.209254+0000","last_fullsized":"2024-09-22T08:11:23.209254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.684662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212091+0000","last_change":"2024-09-22T08:10:53.201219+0000","last_active":"2024-09-22T08:11:23.212091+0000","last_peered":"2024-09-22T08:11:23.212091+0000","last_clean":"2024-09-22T08:11:23.212091+0000","last_became_active":"2024-09-22T08:10:53.200904+0000","last_became_peered":"2024-09-22T08:10:53.200904+0000","last_unstale":"2024-09-22T08:11:23.212091+0000","last_undegraded":"2024-09-22T08:11:23.212091+0000","last_fullsized":"2024-09-22T08:11:23.212091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:58.296182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'9","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.588330+0000","last_change":"2024-09-22T08:10:45.165741+0000","last_active":"2024-09-22T08:13:12.588330+0000","last_peered":"2024-09-22T08:13:12.588330+0000","last_clean":"2024-09-22T08:13:12.588330+0000","last_became_active":"2024-09-22T08:10:45.165511+0000","last_became_peered":"2024-09-22T08:10:45.165511+0000","last_unstale":"2024-09-22T08:13:12.588330+0000","last_undegraded":"2024-09-22T08:13:12.588330+0000","last_fullsized":"2024-09-22T08:13:12.588330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:15.789333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223338+0000","last_change":"2024-09-22T08:10:43.177415+0000","last_active":"2024-09-22T08:11:23.223338+0000","last_peered":"2024-09-22T08:11:23.223338+0000","last_clean":"2024-09-22T08:11:23.223338+0000","last_became_active":"2024-09-22T08:10:43.176954+0000","last_became_peered":"2024-09-22T08:10:43.176954+0000","last_unstale":"2024-09-22T08:11:23.223338+0000","last_undegraded":"2024-09-22T08:11:23.223338+0000","last_fullsized":"2024-09-22T08:11:23.223338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:24.996283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210491+0000","last_change":"2024-09-22T08:10:47.176984+0000","last_active":"2024-09-22T08:11:23.210491+0000","last_peered":"2024-09-22T08:11:23.210491+0000","last_clean":"2024-09-22T08:11:23.210491+0000","last_became_active":"2024-09-22T08:10:47.176641+0000","last_became_peered":"2024-09-22T08:10:47.176641+0000","last_unstale":"2024-09-22T08:11:23.210491+0000","last_undegraded":"2024-09-22T08:11:23.210491+0000","last_fullsized":"2024-09-22T08:11:23.210491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:49.329521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.878567+0000","last_change":"2024-09-22T08:10:49.188256+0000","last_active":"2024-09-22T08:13:59.878567+0000","last_peered":"2024-09-22T08:13:59.878567+0000","last_clean":"2024-09-22T08:13:59.878567+0000","last_became_active":"2024-09-22T08:10:49.187467+0000","last_became_peered":"2024-09-22T08:10:49.187467+0000","last_unstale":"2024-09-22T08:13:59.878567+0000","last_undegraded":"2024-09-22T08:13:59.878567+0000","last_fullsized":"2024-09-22T08:13:59.878567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:27.242973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209400+0000","last_change":"2024-09-22T08:10:51.198209+0000","last_active":"2024-09-22T08:11:23.209400+0000","last_peered":"2024-09-22T08:11:23.209400+0000","last_clean":"2024-09-22T08:11:23.209400+0000","last_became_active":"2024-09-22T08:10:51.197942+0000","last_became_peered":"2024-09-22T08:10:51.197942+0000","last_unstale":"2024-09-22T08:11:23.209400+0000","last_undegraded":"2024-09-22T08:11:23.209400+0000","last_fullsized":"2024-09-22T08:11:23.209400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:42.833261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.573626+0000","last_change":"2024-09-22T08:10:53.204064+0000","last_active":"2024-09-22T08:12:52.573626+0000","last_peered":"2024-09-22T08:12:52.573626+0000","last_clean":"2024-09-22T08:12:52.573626+0000","last_became_active":"2024-09-22T08:10:53.203791+0000","last_became_peered":"2024-09-22T08:10:53.203791+0000","last_unstale":"2024-09-22T08:12:52.573626+0000","last_undegraded":"2024-09-22T08:12:52.573626+0000","last_fullsized":"2024-09-22T08:12:52.573626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:42.795444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042279+0000","last_change":"2024-09-22T08:10:45.164568+0000","last_active":"2024-09-22T08:13:53.042279+0000","last_peered":"2024-09-22T08:13:53.042279+0000","last_clean":"2024-09-22T08:13:53.042279+0000","last_became_active":"2024-09-22T08:10:45.163402+0000","last_became_peered":"2024-09-22T08:10:45.163402+0000","last_unstale":"2024-09-22T08:13:53.042279+0000","last_undegraded":"2024-09-22T08:13:53.042279+0000","last_fullsized":"2024-09-22T08:13:53.042279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:31.128783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216675+0000","last_change":"2024-09-22T08:10:43.185767+0000","last_active":"2024-09-22T08:11:23.216675+0000","last_peered":"2024-09-22T08:11:23.216675+0000","last_clean":"2024-09-22T08:11:23.216675+0000","last_became_active":"2024-09-22T08:10:43.184777+0000","last_became_peered":"2024-09-22T08:10:43.184777+0000","last_unstale":"2024-09-22T08:11:23.216675+0000","last_undegraded":"2024-09-22T08:11:23.216675+0000","last_fullsized":"2024-09-22T08:11:23.216675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:44.875297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.796204+0000","last_change":"2024-09-22T08:10:47.176659+0000","last_active":"2024-09-22T08:12:49.796204+0000","last_peered":"2024-09-22T08:12:49.796204+0000","last_clean":"2024-09-22T08:12:49.796204+0000","last_became_active":"2024-09-22T08:10:47.176390+0000","last_became_peered":"2024-09-22T08:10:47.176390+0000","last_unstale":"2024-09-22T08:12:49.796204+0000","last_undegraded":"2024-09-22T08:12:49.796204+0000","last_fullsized":"2024-09-22T08:12:49.796204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:24.829227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'37","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.888257+0000","last_change":"2024-09-22T08:10:49.189639+0000","last_active":"2024-09-22T08:13:59.888257+0000","last_peered":"2024-09-22T08:13:59.888257+0000","last_clean":"2024-09-22T08:13:59.888257+0000","last_became_active":"2024-09-22T08:10:49.188231+0000","last_became_peered":"2024-09-22T08:10:49.188231+0000","last_unstale":"2024-09-22T08:13:59.888257+0000","last_undegraded":"2024-09-22T08:13:59.888257+0000","last_fullsized":"2024-09-22T08:13:59.888257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:08.360453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":46,"num_read_kb":60,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221258+0000","last_change":"2024-09-22T08:10:51.202802+0000","last_active":"2024-09-22T08:11:23.221258+0000","last_peered":"2024-09-22T08:11:23.221258+0000","last_clean":"2024-09-22T08:11:23.221258+0000","last_became_active":"2024-09-22T08:10:51.202476+0000","last_became_peered":"2024-09-22T08:10:51.202476+0000","last_unstale":"2024-09-22T08:11:23.221258+0000","last_undegraded":"2024-09-22T08:11:23.221258+0000","last_fullsized":"2024-09-22T08:11:23.221258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.161803+0000","last_change":"2024-09-22T08:10:53.201417+0000","last_active":"2024-09-22T08:12:51.161803+0000","last_peered":"2024-09-22T08:12:51.161803+0000","last_clean":"2024-09-22T08:12:51.161803+0000","last_became_active":"2024-09-22T08:10:53.201125+0000","last_became_peered":"2024-09-22T08:10:53.201125+0000","last_unstale":"2024-09-22T08:12:51.161803+0000","last_undegraded":"2024-09-22T08:12:51.161803+0000","last_fullsized":"2024-09-22T08:12:51.161803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:16.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254853+0000","last_change":"2024-09-22T08:10:45.181046+0000","last_active":"2024-09-22T08:13:53.254853+0000","last_peered":"2024-09-22T08:13:53.254853+0000","last_clean":"2024-09-22T08:13:53.254853+0000","last_became_active":"2024-09-22T08:10:45.180781+0000","last_became_peered":"2024-09-22T08:10:45.180781+0000","last_unstale":"2024-09-22T08:13:53.254853+0000","last_undegraded":"2024-09-22T08:13:53.254853+0000","last_fullsized":"2024-09-22T08:13:53.254853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:50.052801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.529697+0000","last_change":"2024-09-22T08:10:43.183556+0000","last_active":"2024-09-22T08:12:52.529697+0000","last_peered":"2024-09-22T08:12:52.529697+0000","last_clean":"2024-09-22T08:12:52.529697+0000","last_became_active":"2024-09-22T08:10:43.179693+0000","last_became_peered":"2024-09-22T08:10:43.179693+0000","last_unstale":"2024-09-22T08:12:52.529697+0000","last_undegraded":"2024-09-22T08:12:52.529697+0000","last_fullsized":"2024-09-22T08:12:52.529697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:56.127185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.950213+0000","last_change":"2024-09-22T08:10:45.164763+0000","last_active":"2024-09-22T08:13:52.950213+0000","last_peered":"2024-09-22T08:13:52.950213+0000","last_clean":"2024-09-22T08:13:52.950213+0000","last_became_active":"2024-09-22T08:10:45.164406+0000","last_became_peered":"2024-09-22T08:10:45.164406+0000","last_unstale":"2024-09-22T08:13:52.950213+0000","last_undegraded":"2024-09-22T08:13:52.950213+0000","last_fullsized":"2024-09-22T08:13:52.950213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:37.404156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.557173+0000","last_change":"2024-09-22T08:10:43.178608+0000","last_active":"2024-09-22T08:11:26.557173+0000","last_peered":"2024-09-22T08:11:26.557173+0000","last_clean":"2024-09-22T08:11:26.557173+0000","last_became_active":"2024-09-22T08:10:43.178018+0000","last_became_peered":"2024-09-22T08:10:43.178018+0000","last_unstale":"2024-09-22T08:11:26.557173+0000","last_undegraded":"2024-09-22T08:11:26.557173+0000","last_fullsized":"2024-09-22T08:11:26.557173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:25.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227865+0000","last_change":"2024-09-22T08:10:45.170408+0000","last_active":"2024-09-22T08:13:53.227865+0000","last_peered":"2024-09-22T08:13:53.227865+0000","last_clean":"2024-09-22T08:13:53.227865+0000","last_became_active":"2024-09-22T08:10:45.168526+0000","last_became_peered":"2024-09-22T08:10:45.168526+0000","last_unstale":"2024-09-22T08:13:53.227865+0000","last_undegraded":"2024-09-22T08:13:53.227865+0000","last_fullsized":"2024-09-22T08:13:53.227865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:17.590758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":86,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209592+0000","last_change":"2024-09-22T08:10:43.198536+0000","last_active":"2024-09-22T08:11:23.209592+0000","last_peered":"2024-09-22T08:11:23.209592+0000","last_clean":"2024-09-22T08:11:23.209592+0000","last_became_active":"2024-09-22T08:10:43.196221+0000","last_became_peered":"2024-09-22T08:10:43.196221+0000","last_unstale":"2024-09-22T08:11:23.209592+0000","last_undegraded":"2024-09-22T08:11:23.209592+0000","last_fullsized":"2024-09-22T08:11:23.209592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:05.712585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.166823+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.166432+0000","last_became_peered":"2024-09-22T08:10:45.166432+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:07.715456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.901474+0000","last_change":"2024-09-22T08:10:43.178126+0000","last_active":"2024-09-22T08:13:59.901474+0000","last_peered":"2024-09-22T08:13:59.901474+0000","last_clean":"2024-09-22T08:13:59.901474+0000","last_became_active":"2024-09-22T08:10:43.177673+0000","last_became_peered":"2024-09-22T08:10:43.177673+0000","last_unstale":"2024-09-22T08:13:59.901474+0000","last_undegraded":"2024-09-22T08:13:59.901474+0000","last_fullsized":"2024-09-22T08:13:59.901474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:44.875297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.575693+0000","last_change":"2024-09-22T08:10:45.171880+0000","last_active":"2024-09-22T08:12:52.575693+0000","last_peered":"2024-09-22T08:12:52.575693+0000","last_clean":"2024-09-22T08:12:52.575693+0000","last_became_active":"2024-09-22T08:10:45.171476+0000","last_became_peered":"2024-09-22T08:10:45.171476+0000","last_unstale":"2024-09-22T08:12:52.575693+0000","last_undegraded":"2024-09-22T08:12:52.575693+0000","last_fullsized":"2024-09-22T08:12:52.575693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:09.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221609+0000","last_change":"2024-09-22T08:10:43.187785+0000","last_active":"2024-09-22T08:11:23.221609+0000","last_peered":"2024-09-22T08:11:23.221609+0000","last_clean":"2024-09-22T08:11:23.221609+0000","last_became_active":"2024-09-22T08:10:43.186671+0000","last_became_peered":"2024-09-22T08:10:43.186671+0000","last_unstale":"2024-09-22T08:11:23.221609+0000","last_undegraded":"2024-09-22T08:11:23.221609+0000","last_fullsized":"2024-09-22T08:11:23.221609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:34.692797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.952726+0000","last_change":"2024-09-22T08:10:45.183046+0000","last_active":"2024-09-22T08:13:52.952726+0000","last_peered":"2024-09-22T08:13:52.952726+0000","last_clean":"2024-09-22T08:13:52.952726+0000","last_became_active":"2024-09-22T08:10:45.182785+0000","last_became_peered":"2024-09-22T08:10:45.182785+0000","last_unstale":"2024-09-22T08:13:52.952726+0000","last_undegraded":"2024-09-22T08:13:52.952726+0000","last_fullsized":"2024-09-22T08:13:52.952726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:51.776555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.484272+0000","last_change":"2024-09-22T08:10:43.183177+0000","last_active":"2024-09-22T08:12:52.484272+0000","last_peered":"2024-09-22T08:12:52.484272+0000","last_clean":"2024-09-22T08:12:52.484272+0000","last_became_active":"2024-09-22T08:10:43.182824+0000","last_became_peered":"2024-09-22T08:10:43.182824+0000","last_unstale":"2024-09-22T08:12:52.484272+0000","last_undegraded":"2024-09-22T08:12:52.484272+0000","last_fullsized":"2024-09-22T08:12:52.484272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:25.723462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'25","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.263612+0000","last_change":"2024-09-22T08:10:45.175920+0000","last_active":"2024-09-22T08:13:53.263612+0000","last_peered":"2024-09-22T08:13:53.263612+0000","last_clean":"2024-09-22T08:13:53.263612+0000","last_became_active":"2024-09-22T08:10:45.175600+0000","last_became_peered":"2024-09-22T08:10:45.175600+0000","last_unstale":"2024-09-22T08:13:53.263612+0000","last_undegraded":"2024-09-22T08:13:53.263612+0000","last_fullsized":"2024-09-22T08:13:53.263612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:53.580143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211182+0000","last_change":"2024-09-22T08:10:43.183024+0000","last_active":"2024-09-22T08:11:23.211182+0000","last_peered":"2024-09-22T08:11:23.211182+0000","last_clean":"2024-09-22T08:11:23.211182+0000","last_became_active":"2024-09-22T08:10:43.179529+0000","last_became_peered":"2024-09-22T08:10:43.179529+0000","last_unstale":"2024-09-22T08:11:23.211182+0000","last_undegraded":"2024-09-22T08:11:23.211182+0000","last_fullsized":"2024-09-22T08:11:23.211182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:48:25.240566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042521+0000","last_change":"2024-09-22T08:10:45.184241+0000","last_active":"2024-09-22T08:13:53.042521+0000","last_peered":"2024-09-22T08:13:53.042521+0000","last_clean":"2024-09-22T08:13:53.042521+0000","last_became_active":"2024-09-22T08:10:45.183901+0000","last_became_peered":"2024-09-22T08:10:45.183901+0000","last_unstale":"2024-09-22T08:13:53.042521+0000","last_undegraded":"2024-09-22T08:13:53.042521+0000","last_fullsized":"2024-09-22T08:13:53.042521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:28:48.567601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.866626+0000","last_change":"2024-09-22T08:10:43.178191+0000","last_active":"2024-09-22T08:13:52.866626+0000","last_peered":"2024-09-22T08:13:52.866626+0000","last_clean":"2024-09-22T08:13:52.866626+0000","last_became_active":"2024-09-22T08:10:43.177461+0000","last_became_peered":"2024-09-22T08:10:43.177461+0000","last_unstale":"2024-09-22T08:13:52.866626+0000","last_undegraded":"2024-09-22T08:13:52.866626+0000","last_fullsized":"2024-09-22T08:13:52.866626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:55.662190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.952431+0000","last_change":"2024-09-22T08:10:45.170004+0000","last_active":"2024-09-22T08:13:52.952431+0000","last_peered":"2024-09-22T08:13:52.952431+0000","last_clean":"2024-09-22T08:13:52.952431+0000","last_became_active":"2024-09-22T08:10:45.169723+0000","last_became_peered":"2024-09-22T08:10:45.169723+0000","last_unstale":"2024-09-22T08:13:52.952431+0000","last_undegraded":"2024-09-22T08:13:52.952431+0000","last_fullsized":"2024-09-22T08:13:52.952431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:45.662588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212281+0000","last_change":"2024-09-22T08:10:43.196560+0000","last_active":"2024-09-22T08:11:23.212281+0000","last_peered":"2024-09-22T08:11:23.212281+0000","last_clean":"2024-09-22T08:11:23.212281+0000","last_became_active":"2024-09-22T08:10:43.195587+0000","last_became_peered":"2024-09-22T08:10:43.195587+0000","last_unstale":"2024-09-22T08:11:23.212281+0000","last_undegraded":"2024-09-22T08:11:23.212281+0000","last_fullsized":"2024-09-22T08:11:23.212281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:23.625176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183433+0000","last_change":"2024-09-22T08:10:45.170370+0000","last_active":"2024-09-22T08:13:53.183433+0000","last_peered":"2024-09-22T08:13:53.183433+0000","last_clean":"2024-09-22T08:13:53.183433+0000","last_became_active":"2024-09-22T08:10:45.169366+0000","last_became_peered":"2024-09-22T08:10:45.169366+0000","last_unstale":"2024-09-22T08:13:53.183433+0000","last_undegraded":"2024-09-22T08:13:53.183433+0000","last_fullsized":"2024-09-22T08:13:53.183433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.634336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.915352+0000","last_change":"2024-09-22T08:10:43.187942+0000","last_active":"2024-09-22T08:13:52.915352+0000","last_peered":"2024-09-22T08:13:52.915352+0000","last_clean":"2024-09-22T08:13:52.915352+0000","last_became_active":"2024-09-22T08:10:43.187246+0000","last_became_peered":"2024-09-22T08:10:43.187246+0000","last_unstale":"2024-09-22T08:13:52.915352+0000","last_undegraded":"2024-09-22T08:13:52.915352+0000","last_fullsized":"2024-09-22T08:13:52.915352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:56.538345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.044952+0000","last_change":"2024-09-22T08:10:45.172556+0000","last_active":"2024-09-22T08:13:53.044952+0000","last_peered":"2024-09-22T08:13:53.044952+0000","last_clean":"2024-09-22T08:13:53.044952+0000","last_became_active":"2024-09-22T08:10:45.172080+0000","last_became_peered":"2024-09-22T08:10:45.172080+0000","last_unstale":"2024-09-22T08:13:53.044952+0000","last_undegraded":"2024-09-22T08:13:53.044952+0000","last_fullsized":"2024-09-22T08:13:53.044952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:33.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213039+0000","last_change":"2024-09-22T08:10:43.179415+0000","last_active":"2024-09-22T08:11:23.213039+0000","last_peered":"2024-09-22T08:11:23.213039+0000","last_clean":"2024-09-22T08:11:23.213039+0000","last_became_active":"2024-09-22T08:10:43.178924+0000","last_became_peered":"2024-09-22T08:10:43.178924+0000","last_unstale":"2024-09-22T08:11:23.213039+0000","last_undegraded":"2024-09-22T08:11:23.213039+0000","last_fullsized":"2024-09-22T08:11:23.213039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:05.127567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'15","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.190568+0000","last_change":"2024-09-22T08:10:45.172376+0000","last_active":"2024-09-22T08:13:53.190568+0000","last_peered":"2024-09-22T08:13:53.190568+0000","last_clean":"2024-09-22T08:13:53.190568+0000","last_became_active":"2024-09-22T08:10:45.172101+0000","last_became_peered":"2024-09-22T08:10:45.172101+0000","last_unstale":"2024-09-22T08:13:53.190568+0000","last_undegraded":"2024-09-22T08:13:53.190568+0000","last_fullsized":"2024-09-22T08:13:53.190568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:42.945533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213721+0000","last_change":"2024-09-22T08:10:43.179255+0000","last_active":"2024-09-22T08:11:23.213721+0000","last_peered":"2024-09-22T08:11:23.213721+0000","last_clean":"2024-09-22T08:11:23.213721+0000","last_became_active":"2024-09-22T08:10:43.178876+0000","last_became_peered":"2024-09-22T08:10:43.178876+0000","last_unstale":"2024-09-22T08:11:23.213721+0000","last_undegraded":"2024-09-22T08:11:23.213721+0000","last_fullsized":"2024-09-22T08:11:23.213721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:40:11.526265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.829072+0000","last_change":"2024-09-22T08:10:45.180356+0000","last_active":"2024-09-22T08:12:08.829072+0000","last_peered":"2024-09-22T08:12:08.829072+0000","last_clean":"2024-09-22T08:12:08.829072+0000","last_became_active":"2024-09-22T08:10:45.180117+0000","last_became_peered":"2024-09-22T08:10:45.180117+0000","last_unstale":"2024-09-22T08:12:08.829072+0000","last_undegraded":"2024-09-22T08:12:08.829072+0000","last_fullsized":"2024-09-22T08:12:08.829072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:07.097290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211963+0000","last_change":"2024-09-22T08:10:43.196149+0000","last_active":"2024-09-22T08:11:23.211963+0000","last_peered":"2024-09-22T08:11:23.211963+0000","last_clean":"2024-09-22T08:11:23.211963+0000","last_became_active":"2024-09-22T08:10:43.195770+0000","last_became_peered":"2024-09-22T08:10:43.195770+0000","last_unstale":"2024-09-22T08:11:23.211963+0000","last_undegraded":"2024-09-22T08:11:23.211963+0000","last_fullsized":"2024-09-22T08:11:23.211963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:35.401285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183848+0000","last_change":"2024-09-22T08:10:45.180354+0000","last_active":"2024-09-22T08:13:53.183848+0000","last_peered":"2024-09-22T08:13:53.183848+0000","last_clean":"2024-09-22T08:13:53.183848+0000","last_became_active":"2024-09-22T08:10:45.180098+0000","last_became_peered":"2024-09-22T08:10:45.180098+0000","last_unstale":"2024-09-22T08:13:53.183848+0000","last_undegraded":"2024-09-22T08:13:53.183848+0000","last_fullsized":"2024-09-22T08:13:53.183848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:45.833791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213202+0000","last_change":"2024-09-22T08:10:43.202451+0000","last_active":"2024-09-22T08:11:23.213202+0000","last_peered":"2024-09-22T08:11:23.213202+0000","last_clean":"2024-09-22T08:11:23.213202+0000","last_became_active":"2024-09-22T08:10:43.201687+0000","last_became_peered":"2024-09-22T08:10:43.201687+0000","last_unstale":"2024-09-22T08:11:23.213202+0000","last_undegraded":"2024-09-22T08:11:23.213202+0000","last_fullsized":"2024-09-22T08:11:23.213202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:03.394369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037719+0000","last_change":"2024-09-22T08:11:23.222217+0000","last_active":"2024-09-22T08:11:27.037719+0000","last_peered":"2024-09-22T08:11:27.037719+0000","last_clean":"2024-09-22T08:11:27.037719+0000","last_became_active":"2024-09-22T08:11:23.215110+0000","last_became_peered":"2024-09-22T08:11:23.215110+0000","last_unstale":"2024-09-22T08:11:27.037719+0000","last_undegraded":"2024-09-22T08:11:27.037719+0000","last_fullsized":"2024-09-22T08:11:27.037719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:56.580950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.560515+0000","last_change":"2024-09-22T08:10:43.190134+0000","last_active":"2024-09-22T08:11:25.560515+0000","last_peered":"2024-09-22T08:11:25.560515+0000","last_clean":"2024-09-22T08:11:25.560515+0000","last_became_active":"2024-09-22T08:10:43.187195+0000","last_became_peered":"2024-09-22T08:10:43.187195+0000","last_unstale":"2024-09-22T08:11:25.560515+0000","last_undegraded":"2024-09-22T08:11:25.560515+0000","last_fullsized":"2024-09-22T08:11:25.560515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:28.903101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183984+0000","last_change":"2024-09-22T08:10:45.179422+0000","last_active":"2024-09-22T08:13:53.183984+0000","last_peered":"2024-09-22T08:13:53.183984+0000","last_clean":"2024-09-22T08:13:53.183984+0000","last_became_active":"2024-09-22T08:10:45.179150+0000","last_became_peered":"2024-09-22T08:10:45.179150+0000","last_unstale":"2024-09-22T08:13:53.183984+0000","last_undegraded":"2024-09-22T08:13:53.183984+0000","last_fullsized":"2024-09-22T08:13:53.183984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:32.350768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213258+0000","last_change":"2024-09-22T08:10:43.200646+0000","last_active":"2024-09-22T08:11:23.213258+0000","last_peered":"2024-09-22T08:11:23.213258+0000","last_clean":"2024-09-22T08:11:23.213258+0000","last_became_active":"2024-09-22T08:10:43.200282+0000","last_became_peered":"2024-09-22T08:10:43.200282+0000","last_unstale":"2024-09-22T08:11:23.213258+0000","last_undegraded":"2024-09-22T08:11:23.213258+0000","last_fullsized":"2024-09-22T08:11:23.213258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:40.745524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.560615+0000","last_change":"2024-09-22T08:10:43.190222+0000","last_active":"2024-09-22T08:11:26.560615+0000","last_peered":"2024-09-22T08:11:26.560615+0000","last_clean":"2024-09-22T08:11:26.560615+0000","last_became_active":"2024-09-22T08:10:43.189848+0000","last_became_peered":"2024-09-22T08:10:43.189848+0000","last_unstale":"2024-09-22T08:11:26.560615+0000","last_undegraded":"2024-09-22T08:11:26.560615+0000","last_fullsized":"2024-09-22T08:11:26.560615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:06.237724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.234367+0000","last_change":"2024-09-22T08:10:45.183685+0000","last_active":"2024-09-22T08:13:53.234367+0000","last_peered":"2024-09-22T08:13:53.234367+0000","last_clean":"2024-09-22T08:13:53.234367+0000","last_became_active":"2024-09-22T08:10:45.183407+0000","last_became_peered":"2024-09-22T08:10:45.183407+0000","last_unstale":"2024-09-22T08:13:53.234367+0000","last_undegraded":"2024-09-22T08:13:53.234367+0000","last_fullsized":"2024-09-22T08:13:53.234367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:45.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.178063+0000","last_change":"2024-09-22T08:10:43.187945+0000","last_active":"2024-09-22T08:13:53.178063+0000","last_peered":"2024-09-22T08:13:53.178063+0000","last_clean":"2024-09-22T08:13:53.178063+0000","last_became_active":"2024-09-22T08:10:43.187119+0000","last_became_peered":"2024-09-22T08:10:43.187119+0000","last_unstale":"2024-09-22T08:13:53.178063+0000","last_undegraded":"2024-09-22T08:13:53.178063+0000","last_fullsized":"2024-09-22T08:13:53.178063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:05.083470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'7","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.587845+0000","last_change":"2024-09-22T08:11:23.218926+0000","last_active":"2024-09-22T08:13:12.587845+0000","last_peered":"2024-09-22T08:13:12.587845+0000","last_clean":"2024-09-22T08:13:12.587845+0000","last_became_active":"2024-09-22T08:11:23.218693+0000","last_became_peered":"2024-09-22T08:11:23.218693+0000","last_unstale":"2024-09-22T08:13:12.587845+0000","last_undegraded":"2024-09-22T08:13:12.587845+0000","last_fullsized":"2024-09-22T08:13:12.587845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:23.796030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673008,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35820,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":483328,"data_stored":152669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673007,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":741411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673007,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1036288,"data_stored":742099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":446464,"data_stored":152009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:14:04.580 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.580 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.580 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.580 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.580 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.581 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.581 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.581 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.581 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.581 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.581 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.581 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.581 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.581 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.581 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.582 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.582 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.582 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.582 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.582 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.582 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.582 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.582 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.582 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.582 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.583 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.583 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.583 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.583 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.583 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.583 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.583 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.583 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.583 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.584 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.584 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.584 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.584 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.584 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.584 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.584 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.584 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.584 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.585 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.585 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.585 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.585 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.585 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.585 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.585 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.585 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.585 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.586 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.586 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.586 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.586 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.586 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.586 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.586 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.586 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.586 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.586 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.587 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.587 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.587 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.587 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.587 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.587 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.587 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.587 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.587 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.588 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.588 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.588 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.588 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.588 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.588 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.588 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.588 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.588 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.588 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.589 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.589 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.589 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.589 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.589 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.589 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.589 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.589 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.589 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.590 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.590 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.590 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.590 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.590 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.590 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.590 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.590 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.590 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.590 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.591 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.591 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-22T08:10:27.897500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=27, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.591 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-22T08:10:32.905206+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.591 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.591 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.591 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.591 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.591 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.591 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.592 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-22T08:10:32.905206+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.592 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.592 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.592 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.592 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.592 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.592 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.592 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-22T08:10:32.905206+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.592 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.593 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.593 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.593 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.593 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.593 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.593 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-22T08:10:32.905206+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.593 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.593 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.593 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.593 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.594 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.594 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.594 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.594 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-22T08:10:32.905206+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.594 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.594 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.594 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.594 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.594 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.595 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.595 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-22T08:10:32.905206+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.595 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.595 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.595 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.595 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.595 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.595 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.595 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-22T08:10:32.905206+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.596 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.596 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.596 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.596 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.596 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.596 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.596 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-22T08:10:32.905206+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.596 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.596 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.597 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.597 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.597 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.597 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.597 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.597 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.597 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.597 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.597 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.597 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.598 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.598 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.598 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.598 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.598 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.598 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.598 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.598 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.598 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.599 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.599 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.599 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.599 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.599 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.599 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.599 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.599 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.599 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.599 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.600 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.600 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.600 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.600 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.600 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.600 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.600 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.600 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.600 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.600 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.601 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.601 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.601 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.601 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.601 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.601 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.601 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.601 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.601 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.601 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.602 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.602 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.602 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.602 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.602 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.602 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.602 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.602 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.602 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.602 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.603 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.603 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.603 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.603 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.603 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.603 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.603 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.603 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.604 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.604 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.604 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.604 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.604 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.604 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.604 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.604 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.604 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.604 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.605 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.605 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.605 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.605 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.605 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.605 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.605 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.605 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.605 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.606 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.606 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.606 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.606 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.606 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.606 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.606 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.606 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.606 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.606 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.607 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.607 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.607 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.607 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.607 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.607 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.607 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.607 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.608 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.608 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.608 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.608 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.608 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.608 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:04.608 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:14:24.609 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:14:24.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.724+0000 7f746fd6b640 1 Processor -- start 2024-09-22T08:14:24.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.724+0000 7f746fd6b640 1 -- start start 2024-09-22T08:14:24.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.724+0000 7f746fd6b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f746806e170 0x7f746806e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:24.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.724+0000 7f746fd6b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7468071770 con 0x7f7468071e30 2024-09-22T08:14:24.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.724+0000 7f746fd6b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7468099ee0 con 0x7f746806e170 2024-09-22T08:14:24.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.724+0000 7f746db07640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f746806e170 0x7f746806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:24.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.724+0000 7f746d306640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7468071e30 0x7f7468097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56936/0 (socket says 172.21.15.53:56936) 2024-09-22T08:14:24.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.724+0000 7f746d306640 1 -- 172.21.15.53:0/1426808097 learned_addr learned my addr 172.21.15.53:0/1426808097 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:24.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.725+0000 7f746db07640 1 -- 172.21.15.53:0/1426808097 >> v1:172.21.15.53:6789/0 conn(0x7f7468071e30 legacy=0x7f7468097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:24.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.725+0000 7f746db07640 1 -- 172.21.15.53:0/1426808097 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7468072530 con 0x7f746806e170 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.725+0000 7f746db07640 1 --2- 172.21.15.53:0/1426808097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 0x7f746806e550 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7464009750 tx=0x7f746402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327c20179c4e0460 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.726+0000 7f746cb05640 1 -- 172.21.15.53:0/1426808097 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7464037070 con 0x7f746806e170 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.726+0000 7f746cb05640 1 -- 172.21.15.53:0/1426808097 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746402ad80 con 0x7f746806e170 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.726+0000 7f746cb05640 1 -- 172.21.15.53:0/1426808097 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7464032590 con 0x7f746806e170 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.726+0000 7f746fd6b640 1 -- 172.21.15.53:0/1426808097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 msgr2=0x7f746806e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.726+0000 7f746fd6b640 1 --2- 172.21.15.53:0/1426808097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 0x7f746806e550 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7464009750 tx=0x7f746402a140 comp rx=0 tx=0).stop 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.726+0000 7f746fd6b640 1 -- 172.21.15.53:0/1426808097 shutdown_connections 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.726+0000 7f746fd6b640 1 --2- 172.21.15.53:0/1426808097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 0x7f746806e550 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.726+0000 7f746fd6b640 1 -- 172.21.15.53:0/1426808097 >> 172.21.15.53:0/1426808097 conn(0x7f746809ac80 msgr2=0x7f7468098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.726+0000 7f746fd6b640 1 -- 172.21.15.53:0/1426808097 shutdown_connections 2024-09-22T08:14:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.726+0000 7f746fd6b640 1 -- 172.21.15.53:0/1426808097 wait complete. 2024-09-22T08:14:24.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.727+0000 7f746fd6b640 1 Processor -- start 2024-09-22T08:14:24.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.727+0000 7f746fd6b640 1 -- start start 2024-09-22T08:14:24.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.728+0000 7f746fd6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 0x7f746808bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:24.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.728+0000 7f746fd6b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f746806ee20 con 0x7f746806e170 2024-09-22T08:14:24.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.728+0000 7f746db07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 0x7f746808bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:24.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.728+0000 7f746db07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 0x7f746808bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49818/0 (socket says 172.21.15.53:49818) 2024-09-22T08:14:24.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.728+0000 7f746db07640 1 -- 172.21.15.53:0/3345140996 learned_addr learned my addr 172.21.15.53:0/3345140996 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:24.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.728+0000 7f746db07640 1 -- 172.21.15.53:0/3345140996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7468074170 con 0x7f746806e170 2024-09-22T08:14:24.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.728+0000 7f746db07640 1 --2- 172.21.15.53:0/3345140996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 0x7f746808bfc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7464009750 tx=0x7f74640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:24.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.728+0000 7f745e7fc640 1 -- 172.21.15.53:0/3345140996 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7464041070 con 0x7f746806e170 2024-09-22T08:14:24.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.729+0000 7f745e7fc640 1 -- 172.21.15.53:0/3345140996 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746403c590 con 0x7f746806e170 2024-09-22T08:14:24.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.729+0000 7f746fd6b640 1 -- 172.21.15.53:0/3345140996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746808d6d0 con 0x7f746806e170 2024-09-22T08:14:24.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.729+0000 7f745e7fc640 1 -- 172.21.15.53:0/3345140996 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7464037040 con 0x7f746806e170 2024-09-22T08:14:24.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.729+0000 7f746fd6b640 1 -- 172.21.15.53:0/3345140996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7468097e20 con 0x7f746806e170 2024-09-22T08:14:24.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.729+0000 7f745e7fc640 1 -- 172.21.15.53:0/3345140996 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7464044070 con 0x7f746806e170 2024-09-22T08:14:24.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.730+0000 7f746fd6b640 1 -- 172.21.15.53:0/3345140996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746806e550 con 0x7f746806e170 2024-09-22T08:14:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.730+0000 7f745e7fc640 1 --2- 172.21.15.53:0/3345140996 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f744c03e710 0x7f744c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.730+0000 7f745e7fc640 1 -- 172.21.15.53:0/3345140996 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7464074300 con 0x7f746806e170 2024-09-22T08:14:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.730+0000 7f746d306640 1 --2- 172.21.15.53:0/3345140996 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f744c03e710 0x7f744c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.731+0000 7f746d306640 1 --2- 172.21.15.53:0/3345140996 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f744c03e710 0x7f744c040bd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7458007fd0 tx=0x7f7458007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:24.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.735+0000 7f745e7fc640 1 -- 172.21.15.53:0/3345140996 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f746402ad10 con 0x7f746806e170 2024-09-22T08:14:24.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.916+0000 7f746fd6b640 1 -- 172.21.15.53:0/3345140996 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f746808e890 con 0x7f744c03e710 2024-09-22T08:14:24.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.926+0000 7f745e7fc640 1 -- 172.21.15.53:0/3345140996 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665984 (secure 0 0 0) 0x7f74580058b0 con 0x7f744c03e710 2024-09-22T08:14:24.933 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:14:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:14:24.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.932+0000 7f746fd6b640 1 -- 172.21.15.53:0/3345140996 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f744c03e710 msgr2=0x7f744c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.932+0000 7f746fd6b640 1 --2- 172.21.15.53:0/3345140996 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f744c03e710 0x7f744c040bd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7458007fd0 tx=0x7f7458007ac0 comp rx=0 tx=0).stop 2024-09-22T08:14:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.932+0000 7f746fd6b640 1 -- 172.21.15.53:0/3345140996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 msgr2=0x7f746808bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.932+0000 7f746fd6b640 1 --2- 172.21.15.53:0/3345140996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 0x7f746808bfc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7464009750 tx=0x7f74640046c0 comp rx=0 tx=0).stop 2024-09-22T08:14:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.932+0000 7f746fd6b640 1 -- 172.21.15.53:0/3345140996 shutdown_connections 2024-09-22T08:14:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.932+0000 7f746fd6b640 1 --2- 172.21.15.53:0/3345140996 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f744c03e710 0x7f744c040bd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.932+0000 7f746fd6b640 1 --2- 172.21.15.53:0/3345140996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806e170 0x7f746808bfc0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.932+0000 7f746fd6b640 1 -- 172.21.15.53:0/3345140996 >> 172.21.15.53:0/3345140996 conn(0x7f746809ac80 msgr2=0x7f746809c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.932+0000 7f746fd6b640 1 -- 172.21.15.53:0/3345140996 shutdown_connections 2024-09-22T08:14:24.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:24.932+0000 7f746fd6b640 1 -- 172.21.15.53:0/3345140996 wait complete. 2024-09-22T08:14:24.943 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-22T08:14:23.632213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5179,"num_read_kb":4721,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4568,"ondisk_log_size":4568,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148448,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338912,"statfs":{"total":386547056640,"available":386395045888,"internally_reserved":0,"allocated":2981888,"data_stored":1788188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004021"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.888299+0000","last_change":"2024-09-22T08:14:16.888299+0000","last_active":"2024-09-22T08:14:16.888299+0000","last_peered":"2024-09-22T08:14:16.888299+0000","last_clean":"2024-09-22T08:14:16.888299+0000","last_became_active":"2024-09-22T08:10:43.174489+0000","last_became_peered":"2024-09-22T08:10:43.174489+0000","last_unstale":"2024-09-22T08:14:16.888299+0000","last_undegraded":"2024-09-22T08:14:16.888299+0000","last_fullsized":"2024-09-22T08:14:16.888299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:16.888214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:16.888214+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.888214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:50.430915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037868+0000","last_change":"2024-09-22T08:10:45.180446+0000","last_active":"2024-09-22T08:11:27.037868+0000","last_peered":"2024-09-22T08:11:27.037868+0000","last_clean":"2024-09-22T08:11:27.037868+0000","last_became_active":"2024-09-22T08:10:45.179969+0000","last_became_peered":"2024-09-22T08:10:45.179969+0000","last_unstale":"2024-09-22T08:11:27.037868+0000","last_undegraded":"2024-09-22T08:11:27.037868+0000","last_fullsized":"2024-09-22T08:11:27.037868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:37.801061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.854808+0000","last_change":"2024-09-22T08:14:17.854808+0000","last_active":"2024-09-22T08:14:17.854808+0000","last_peered":"2024-09-22T08:14:17.854808+0000","last_clean":"2024-09-22T08:14:17.854808+0000","last_became_active":"2024-09-22T08:10:43.187128+0000","last_became_peered":"2024-09-22T08:10:43.187128+0000","last_unstale":"2024-09-22T08:14:17.854808+0000","last_undegraded":"2024-09-22T08:14:17.854808+0000","last_fullsized":"2024-09-22T08:14:17.854808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.854715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.854715+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.854715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:57.247272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210762+0000","last_change":"2024-09-22T08:10:45.170031+0000","last_active":"2024-09-22T08:11:23.210762+0000","last_peered":"2024-09-22T08:11:23.210762+0000","last_clean":"2024-09-22T08:11:23.210762+0000","last_became_active":"2024-09-22T08:10:45.169768+0000","last_became_peered":"2024-09-22T08:10:45.169768+0000","last_unstale":"2024-09-22T08:11:23.210762+0000","last_undegraded":"2024-09-22T08:11:23.210762+0000","last_fullsized":"2024-09-22T08:11:23.210762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:06.709611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.001193+0000","last_change":"2024-09-22T08:10:43.202010+0000","last_active":"2024-09-22T08:12:09.001193+0000","last_peered":"2024-09-22T08:12:09.001193+0000","last_clean":"2024-09-22T08:12:09.001193+0000","last_became_active":"2024-09-22T08:10:43.200436+0000","last_became_peered":"2024-09-22T08:10:43.200436+0000","last_unstale":"2024-09-22T08:12:09.001193+0000","last_undegraded":"2024-09-22T08:12:09.001193+0000","last_fullsized":"2024-09-22T08:12:09.001193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:53.517821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.175954+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.169110+0000","last_became_peered":"2024-09-22T08:10:45.169110+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:13.716183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.842211+0000","last_change":"2024-09-22T08:14:15.842211+0000","last_active":"2024-09-22T08:14:15.842211+0000","last_peered":"2024-09-22T08:14:15.842211+0000","last_clean":"2024-09-22T08:14:15.842211+0000","last_became_active":"2024-09-22T08:10:43.180088+0000","last_became_peered":"2024-09-22T08:10:43.180088+0000","last_unstale":"2024-09-22T08:14:15.842211+0000","last_undegraded":"2024-09-22T08:14:15.842211+0000","last_fullsized":"2024-09-22T08:14:15.842211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:15.842123+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:15.842123+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.842123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:45.525671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183683+0000","last_change":"2024-09-22T08:11:23.220302+0000","last_active":"2024-09-22T08:13:53.183683+0000","last_peered":"2024-09-22T08:13:53.183683+0000","last_clean":"2024-09-22T08:13:53.183683+0000","last_became_active":"2024-09-22T08:11:23.220081+0000","last_became_peered":"2024-09-22T08:11:23.220081+0000","last_unstale":"2024-09-22T08:13:53.183683+0000","last_undegraded":"2024-09-22T08:13:53.183683+0000","last_fullsized":"2024-09-22T08:13:53.183683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:07:33.959971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211346+0000","last_change":"2024-09-22T08:10:43.200685+0000","last_active":"2024-09-22T08:11:23.211346+0000","last_peered":"2024-09-22T08:11:23.211346+0000","last_clean":"2024-09-22T08:11:23.211346+0000","last_became_active":"2024-09-22T08:10:43.200013+0000","last_became_peered":"2024-09-22T08:10:43.200013+0000","last_unstale":"2024-09-22T08:11:23.211346+0000","last_undegraded":"2024-09-22T08:11:23.211346+0000","last_fullsized":"2024-09-22T08:11:23.211346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:43.911800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227900+0000","last_change":"2024-09-22T08:10:45.178916+0000","last_active":"2024-09-22T08:13:53.227900+0000","last_peered":"2024-09-22T08:13:53.227900+0000","last_clean":"2024-09-22T08:13:53.227900+0000","last_became_active":"2024-09-22T08:10:45.176491+0000","last_became_peered":"2024-09-22T08:10:45.176491+0000","last_unstale":"2024-09-22T08:13:53.227900+0000","last_undegraded":"2024-09-22T08:13:53.227900+0000","last_fullsized":"2024-09-22T08:13:53.227900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:20:10.583367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.876908+0000","last_change":"2024-09-22T08:14:17.876908+0000","last_active":"2024-09-22T08:14:17.876908+0000","last_peered":"2024-09-22T08:14:17.876908+0000","last_clean":"2024-09-22T08:14:17.876908+0000","last_became_active":"2024-09-22T08:10:43.172330+0000","last_became_peered":"2024-09-22T08:10:43.172330+0000","last_unstale":"2024-09-22T08:14:17.876908+0000","last_undegraded":"2024-09-22T08:14:17.876908+0000","last_fullsized":"2024-09-22T08:14:17.876908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.876812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.876812+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.876812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:40.745057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.951226+0000","last_change":"2024-09-22T08:10:45.176141+0000","last_active":"2024-09-22T08:13:52.951226+0000","last_peered":"2024-09-22T08:13:52.951226+0000","last_clean":"2024-09-22T08:13:52.951226+0000","last_became_active":"2024-09-22T08:10:45.175775+0000","last_became_peered":"2024-09-22T08:10:45.175775+0000","last_unstale":"2024-09-22T08:13:52.951226+0000","last_undegraded":"2024-09-22T08:13:52.951226+0000","last_fullsized":"2024-09-22T08:13:52.951226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:08.930275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210326+0000","last_change":"2024-09-22T08:10:43.188239+0000","last_active":"2024-09-22T08:11:23.210326+0000","last_peered":"2024-09-22T08:11:23.210326+0000","last_clean":"2024-09-22T08:11:23.210326+0000","last_became_active":"2024-09-22T08:10:43.187858+0000","last_became_peered":"2024-09-22T08:10:43.187858+0000","last_unstale":"2024-09-22T08:11:23.210326+0000","last_undegraded":"2024-09-22T08:11:23.210326+0000","last_fullsized":"2024-09-22T08:11:23.210326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:35.814525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.054945+0000","last_change":"2024-09-22T08:10:45.180145+0000","last_active":"2024-09-22T08:13:53.054945+0000","last_peered":"2024-09-22T08:13:53.054945+0000","last_clean":"2024-09-22T08:13:53.054945+0000","last_became_active":"2024-09-22T08:10:45.179870+0000","last_became_peered":"2024-09-22T08:10:45.179870+0000","last_unstale":"2024-09-22T08:13:53.054945+0000","last_undegraded":"2024-09-22T08:13:53.054945+0000","last_fullsized":"2024-09-22T08:13:53.054945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:13:33.107569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.896554+0000","last_change":"2024-09-22T08:14:16.896554+0000","last_active":"2024-09-22T08:14:16.896554+0000","last_peered":"2024-09-22T08:14:16.896554+0000","last_clean":"2024-09-22T08:14:16.896554+0000","last_became_active":"2024-09-22T08:10:43.178146+0000","last_became_peered":"2024-09-22T08:10:43.178146+0000","last_unstale":"2024-09-22T08:14:16.896554+0000","last_undegraded":"2024-09-22T08:14:16.896554+0000","last_fullsized":"2024-09-22T08:14:16.896554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:16.896443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:16.896443+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.896443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:40.881321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.829002+0000","last_change":"2024-09-22T08:10:45.177410+0000","last_active":"2024-09-22T08:12:08.829002+0000","last_peered":"2024-09-22T08:12:08.829002+0000","last_clean":"2024-09-22T08:12:08.829002+0000","last_became_active":"2024-09-22T08:10:45.177101+0000","last_became_peered":"2024-09-22T08:10:45.177101+0000","last_unstale":"2024-09-22T08:12:08.829002+0000","last_undegraded":"2024-09-22T08:12:08.829002+0000","last_fullsized":"2024-09-22T08:12:08.829002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:22:33.661673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828898+0000","last_change":"2024-09-22T08:10:45.170689+0000","last_active":"2024-09-22T08:12:08.828898+0000","last_peered":"2024-09-22T08:12:08.828898+0000","last_clean":"2024-09-22T08:12:08.828898+0000","last_became_active":"2024-09-22T08:10:45.169140+0000","last_became_peered":"2024-09-22T08:10:45.169140+0000","last_unstale":"2024-09-22T08:12:08.828898+0000","last_undegraded":"2024-09-22T08:12:08.828898+0000","last_fullsized":"2024-09-22T08:12:08.828898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:02.240838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.805924+0000","last_change":"2024-09-22T08:14:16.805924+0000","last_active":"2024-09-22T08:14:16.805924+0000","last_peered":"2024-09-22T08:14:16.805924+0000","last_clean":"2024-09-22T08:14:16.805924+0000","last_became_active":"2024-09-22T08:10:43.185301+0000","last_became_peered":"2024-09-22T08:10:43.185301+0000","last_unstale":"2024-09-22T08:14:16.805924+0000","last_undegraded":"2024-09-22T08:14:16.805924+0000","last_fullsized":"2024-09-22T08:14:16.805924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:16.805805+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:16.805805+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.805805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:11.575658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213294+0000","last_change":"2024-09-22T08:10:45.172853+0000","last_active":"2024-09-22T08:11:23.213294+0000","last_peered":"2024-09-22T08:11:23.213294+0000","last_clean":"2024-09-22T08:11:23.213294+0000","last_became_active":"2024-09-22T08:10:45.172557+0000","last_became_peered":"2024-09-22T08:10:45.172557+0000","last_unstale":"2024-09-22T08:11:23.213294+0000","last_undegraded":"2024-09-22T08:11:23.213294+0000","last_fullsized":"2024-09-22T08:11:23.213294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:49:38.198254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.821331+0000","last_change":"2024-09-22T08:14:14.821331+0000","last_active":"2024-09-22T08:14:14.821331+0000","last_peered":"2024-09-22T08:14:14.821331+0000","last_clean":"2024-09-22T08:14:14.821331+0000","last_became_active":"2024-09-22T08:10:43.189273+0000","last_became_peered":"2024-09-22T08:10:43.189273+0000","last_unstale":"2024-09-22T08:14:14.821331+0000","last_undegraded":"2024-09-22T08:14:14.821331+0000","last_fullsized":"2024-09-22T08:14:14.821331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:14.821242+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:14.821242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.821242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:39.122357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.307146+0000","last_change":"2024-09-22T08:10:45.178843+0000","last_active":"2024-09-22T08:13:53.307146+0000","last_peered":"2024-09-22T08:13:53.307146+0000","last_clean":"2024-09-22T08:13:53.307146+0000","last_became_active":"2024-09-22T08:10:45.176885+0000","last_became_peered":"2024-09-22T08:10:45.176885+0000","last_unstale":"2024-09-22T08:13:53.307146+0000","last_undegraded":"2024-09-22T08:13:53.307146+0000","last_fullsized":"2024-09-22T08:13:53.307146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:27.127106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.813396+0000","last_change":"2024-09-22T08:14:15.813396+0000","last_active":"2024-09-22T08:14:15.813396+0000","last_peered":"2024-09-22T08:14:15.813396+0000","last_clean":"2024-09-22T08:14:15.813396+0000","last_became_active":"2024-09-22T08:10:43.183887+0000","last_became_peered":"2024-09-22T08:10:43.183887+0000","last_unstale":"2024-09-22T08:14:15.813396+0000","last_undegraded":"2024-09-22T08:14:15.813396+0000","last_fullsized":"2024-09-22T08:14:15.813396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:15.813300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:15.813300+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.813300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:39.476435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228331+0000","last_change":"2024-09-22T08:10:45.172136+0000","last_active":"2024-09-22T08:13:53.228331+0000","last_peered":"2024-09-22T08:13:53.228331+0000","last_clean":"2024-09-22T08:13:53.228331+0000","last_became_active":"2024-09-22T08:10:45.171492+0000","last_became_peered":"2024-09-22T08:10:45.171492+0000","last_unstale":"2024-09-22T08:13:53.228331+0000","last_undegraded":"2024-09-22T08:13:53.228331+0000","last_fullsized":"2024-09-22T08:13:53.228331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:55.520692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.797115+0000","last_change":"2024-09-22T08:14:12.797115+0000","last_active":"2024-09-22T08:14:12.797115+0000","last_peered":"2024-09-22T08:14:12.797115+0000","last_clean":"2024-09-22T08:14:12.797115+0000","last_became_active":"2024-09-22T08:10:43.179133+0000","last_became_peered":"2024-09-22T08:10:43.179133+0000","last_unstale":"2024-09-22T08:14:12.797115+0000","last_undegraded":"2024-09-22T08:14:12.797115+0000","last_fullsized":"2024-09-22T08:14:12.797115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-22T08:14:12.797035+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-22T08:14:12.797035+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.797035+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:51.512160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13,"num_write":24,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.056124+0000","last_change":"2024-09-22T08:10:45.174057+0000","last_active":"2024-09-22T08:13:53.056124+0000","last_peered":"2024-09-22T08:13:53.056124+0000","last_clean":"2024-09-22T08:13:53.056124+0000","last_became_active":"2024-09-22T08:10:45.173524+0000","last_became_peered":"2024-09-22T08:10:45.173524+0000","last_unstale":"2024-09-22T08:13:53.056124+0000","last_undegraded":"2024-09-22T08:13:53.056124+0000","last_fullsized":"2024-09-22T08:13:53.056124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:21.335898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.847627+0000","last_change":"2024-09-22T08:14:15.847627+0000","last_active":"2024-09-22T08:14:15.847627+0000","last_peered":"2024-09-22T08:14:15.847627+0000","last_clean":"2024-09-22T08:14:15.847627+0000","last_became_active":"2024-09-22T08:10:43.186739+0000","last_became_peered":"2024-09-22T08:10:43.186739+0000","last_unstale":"2024-09-22T08:14:15.847627+0000","last_undegraded":"2024-09-22T08:14:15.847627+0000","last_fullsized":"2024-09-22T08:14:15.847627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:15.847522+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:15.847522+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.847522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:31.369309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037355+0000","last_change":"2024-09-22T08:10:45.172711+0000","last_active":"2024-09-22T08:11:27.037355+0000","last_peered":"2024-09-22T08:11:27.037355+0000","last_clean":"2024-09-22T08:11:27.037355+0000","last_became_active":"2024-09-22T08:10:45.170247+0000","last_became_peered":"2024-09-22T08:10:45.170247+0000","last_unstale":"2024-09-22T08:11:27.037355+0000","last_undegraded":"2024-09-22T08:11:27.037355+0000","last_fullsized":"2024-09-22T08:11:27.037355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:51.811049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:25.562616+0000","last_change":"2024-09-22T08:10:43.191158+0000","last_active":"2024-09-22T08:11:25.562616+0000","last_peered":"2024-09-22T08:11:25.562616+0000","last_clean":"2024-09-22T08:11:25.562616+0000","last_became_active":"2024-09-22T08:10:43.190674+0000","last_became_peered":"2024-09-22T08:10:43.190674+0000","last_unstale":"2024-09-22T08:11:25.562616+0000","last_undegraded":"2024-09-22T08:11:25.562616+0000","last_fullsized":"2024-09-22T08:11:25.562616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:24.822605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.206848+0000","last_change":"2024-09-22T08:10:53.203618+0000","last_active":"2024-09-22T08:13:53.206848+0000","last_peered":"2024-09-22T08:13:53.206848+0000","last_clean":"2024-09-22T08:13:53.206848+0000","last_became_active":"2024-09-22T08:10:53.203146+0000","last_became_peered":"2024-09-22T08:10:53.203146+0000","last_unstale":"2024-09-22T08:13:53.206848+0000","last_undegraded":"2024-09-22T08:13:53.206848+0000","last_fullsized":"2024-09-22T08:13:53.206848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:09.081236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042651+0000","last_change":"2024-09-22T08:10:45.168914+0000","last_active":"2024-09-22T08:13:53.042651+0000","last_peered":"2024-09-22T08:13:53.042651+0000","last_clean":"2024-09-22T08:13:53.042651+0000","last_became_active":"2024-09-22T08:10:45.168308+0000","last_became_peered":"2024-09-22T08:10:45.168308+0000","last_unstale":"2024-09-22T08:13:53.042651+0000","last_undegraded":"2024-09-22T08:13:53.042651+0000","last_fullsized":"2024-09-22T08:13:53.042651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:33.215832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.270316+0000","last_change":"2024-09-22T08:14:17.270316+0000","last_active":"2024-09-22T08:14:17.270316+0000","last_peered":"2024-09-22T08:14:17.270316+0000","last_clean":"2024-09-22T08:14:17.270316+0000","last_became_active":"2024-09-22T08:10:43.200307+0000","last_became_peered":"2024-09-22T08:10:43.200307+0000","last_unstale":"2024-09-22T08:14:17.270316+0000","last_undegraded":"2024-09-22T08:14:17.270316+0000","last_fullsized":"2024-09-22T08:14:17.270316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.270212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.270212+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.270212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:29.835254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210664+0000","last_change":"2024-09-22T08:10:47.176870+0000","last_active":"2024-09-22T08:11:23.210664+0000","last_peered":"2024-09-22T08:11:23.210664+0000","last_clean":"2024-09-22T08:11:23.210664+0000","last_became_active":"2024-09-22T08:10:47.176568+0000","last_became_peered":"2024-09-22T08:10:47.176568+0000","last_unstale":"2024-09-22T08:11:23.210664+0000","last_undegraded":"2024-09-22T08:11:23.210664+0000","last_fullsized":"2024-09-22T08:11:23.210664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:55.338812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.858403+0000","last_change":"2024-09-22T08:10:49.189137+0000","last_active":"2024-09-22T08:13:59.858403+0000","last_peered":"2024-09-22T08:13:59.858403+0000","last_clean":"2024-09-22T08:13:59.858403+0000","last_became_active":"2024-09-22T08:10:49.188697+0000","last_became_peered":"2024-09-22T08:10:49.188697+0000","last_unstale":"2024-09-22T08:13:59.858403+0000","last_undegraded":"2024-09-22T08:13:59.858403+0000","last_fullsized":"2024-09-22T08:13:59.858403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:20.077797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216659+0000","last_change":"2024-09-22T08:10:51.202175+0000","last_active":"2024-09-22T08:11:23.216659+0000","last_peered":"2024-09-22T08:11:23.216659+0000","last_clean":"2024-09-22T08:11:23.216659+0000","last_became_active":"2024-09-22T08:10:51.201855+0000","last_became_peered":"2024-09-22T08:10:51.201855+0000","last_unstale":"2024-09-22T08:11:23.216659+0000","last_undegraded":"2024-09-22T08:11:23.216659+0000","last_fullsized":"2024-09-22T08:11:23.216659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'11","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.833839+0000","last_change":"2024-09-22T08:10:53.204685+0000","last_active":"2024-09-22T08:12:08.833839+0000","last_peered":"2024-09-22T08:12:08.833839+0000","last_clean":"2024-09-22T08:12:08.833839+0000","last_became_active":"2024-09-22T08:10:53.204407+0000","last_became_peered":"2024-09-22T08:10:53.204407+0000","last_unstale":"2024-09-22T08:12:08.833839+0000","last_undegraded":"2024-09-22T08:12:08.833839+0000","last_fullsized":"2024-09-22T08:12:08.833839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:07.954674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'16","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.261467+0000","last_change":"2024-09-22T08:10:45.171230+0000","last_active":"2024-09-22T08:13:53.261467+0000","last_peered":"2024-09-22T08:13:53.261467+0000","last_clean":"2024-09-22T08:13:53.261467+0000","last_became_active":"2024-09-22T08:10:45.170765+0000","last_became_peered":"2024-09-22T08:10:45.170765+0000","last_unstale":"2024-09-22T08:13:53.261467+0000","last_undegraded":"2024-09-22T08:13:53.261467+0000","last_fullsized":"2024-09-22T08:13:53.261467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:33:18.560588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.743684+0000","last_change":"2024-09-22T08:14:08.743684+0000","last_active":"2024-09-22T08:14:08.743684+0000","last_peered":"2024-09-22T08:14:08.743684+0000","last_clean":"2024-09-22T08:14:08.743684+0000","last_became_active":"2024-09-22T08:10:43.180600+0000","last_became_peered":"2024-09-22T08:10:43.180600+0000","last_unstale":"2024-09-22T08:14:08.743684+0000","last_undegraded":"2024-09-22T08:14:08.743684+0000","last_fullsized":"2024-09-22T08:14:08.743684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.743587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.743587+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.743587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:44.284655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221157+0000","last_change":"2024-09-22T08:10:47.168270+0000","last_active":"2024-09-22T08:11:23.221157+0000","last_peered":"2024-09-22T08:11:23.221157+0000","last_clean":"2024-09-22T08:11:23.221157+0000","last_became_active":"2024-09-22T08:10:47.167913+0000","last_became_peered":"2024-09-22T08:10:47.167913+0000","last_unstale":"2024-09-22T08:11:23.221157+0000","last_undegraded":"2024-09-22T08:11:23.221157+0000","last_fullsized":"2024-09-22T08:11:23.221157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:42.817181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216231+0000","last_change":"2024-09-22T08:10:49.182777+0000","last_active":"2024-09-22T08:11:23.216231+0000","last_peered":"2024-09-22T08:11:23.216231+0000","last_clean":"2024-09-22T08:11:23.216231+0000","last_became_active":"2024-09-22T08:10:49.182481+0000","last_became_peered":"2024-09-22T08:10:49.182481+0000","last_unstale":"2024-09-22T08:11:23.216231+0000","last_undegraded":"2024-09-22T08:11:23.216231+0000","last_fullsized":"2024-09-22T08:11:23.216231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:56.405074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.215699+0000","last_change":"2024-09-22T08:10:51.200151+0000","last_active":"2024-09-22T08:11:23.215699+0000","last_peered":"2024-09-22T08:11:23.215699+0000","last_clean":"2024-09-22T08:11:23.215699+0000","last_became_active":"2024-09-22T08:10:51.199837+0000","last_became_peered":"2024-09-22T08:10:51.199837+0000","last_unstale":"2024-09-22T08:11:23.215699+0000","last_undegraded":"2024-09-22T08:11:23.215699+0000","last_fullsized":"2024-09-22T08:11:23.215699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220094+0000","last_change":"2024-09-22T08:10:53.199608+0000","last_active":"2024-09-22T08:11:23.220094+0000","last_peered":"2024-09-22T08:11:23.220094+0000","last_clean":"2024-09-22T08:11:23.220094+0000","last_became_active":"2024-09-22T08:10:53.199303+0000","last_became_peered":"2024-09-22T08:10:53.199303+0000","last_unstale":"2024-09-22T08:11:23.220094+0000","last_undegraded":"2024-09-22T08:11:23.220094+0000","last_fullsized":"2024-09-22T08:11:23.220094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:27.339830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228089+0000","last_change":"2024-09-22T08:10:45.169254+0000","last_active":"2024-09-22T08:13:53.228089+0000","last_peered":"2024-09-22T08:13:53.228089+0000","last_clean":"2024-09-22T08:13:53.228089+0000","last_became_active":"2024-09-22T08:10:45.168554+0000","last_became_peered":"2024-09-22T08:10:45.168554+0000","last_unstale":"2024-09-22T08:13:53.228089+0000","last_undegraded":"2024-09-22T08:13:53.228089+0000","last_fullsized":"2024-09-22T08:13:53.228089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:25.135787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.265298+0000","last_change":"2024-09-22T08:14:16.265298+0000","last_active":"2024-09-22T08:14:16.265298+0000","last_peered":"2024-09-22T08:14:16.265298+0000","last_clean":"2024-09-22T08:14:16.265298+0000","last_became_active":"2024-09-22T08:10:43.189333+0000","last_became_peered":"2024-09-22T08:10:43.189333+0000","last_unstale":"2024-09-22T08:14:16.265298+0000","last_undegraded":"2024-09-22T08:14:16.265298+0000","last_fullsized":"2024-09-22T08:14:16.265298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:16.265216+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:16.265216+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.265216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:42.490080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.223891+0000","last_change":"2024-09-22T08:10:47.176263+0000","last_active":"2024-09-22T08:11:23.223891+0000","last_peered":"2024-09-22T08:11:23.223891+0000","last_clean":"2024-09-22T08:11:23.223891+0000","last_became_active":"2024-09-22T08:10:47.175959+0000","last_became_peered":"2024-09-22T08:10:47.175959+0000","last_unstale":"2024-09-22T08:11:23.223891+0000","last_undegraded":"2024-09-22T08:11:23.223891+0000","last_fullsized":"2024-09-22T08:11:23.223891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:44.259414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207630+0000","last_change":"2024-09-22T08:10:49.185591+0000","last_active":"2024-09-22T08:11:23.207630+0000","last_peered":"2024-09-22T08:11:23.207630+0000","last_clean":"2024-09-22T08:11:23.207630+0000","last_became_active":"2024-09-22T08:10:49.185269+0000","last_became_peered":"2024-09-22T08:10:49.185269+0000","last_unstale":"2024-09-22T08:11:23.207630+0000","last_undegraded":"2024-09-22T08:11:23.207630+0000","last_fullsized":"2024-09-22T08:11:23.207630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.872968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.794235+0000","last_change":"2024-09-22T08:10:51.196489+0000","last_active":"2024-09-22T08:13:59.794235+0000","last_peered":"2024-09-22T08:13:59.794235+0000","last_clean":"2024-09-22T08:13:59.794235+0000","last_became_active":"2024-09-22T08:10:51.196199+0000","last_became_peered":"2024-09-22T08:10:51.196199+0000","last_unstale":"2024-09-22T08:13:59.794235+0000","last_undegraded":"2024-09-22T08:13:59.794235+0000","last_fullsized":"2024-09-22T08:13:59.794235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:26.614683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.217337+0000","last_change":"2024-09-22T08:10:53.194394+0000","last_active":"2024-09-22T08:13:53.217337+0000","last_peered":"2024-09-22T08:13:53.217337+0000","last_clean":"2024-09-22T08:13:53.217337+0000","last_became_active":"2024-09-22T08:10:53.194118+0000","last_became_peered":"2024-09-22T08:10:53.194118+0000","last_unstale":"2024-09-22T08:13:53.217337+0000","last_undegraded":"2024-09-22T08:13:53.217337+0000","last_fullsized":"2024-09-22T08:13:53.217337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:00.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.867755+0000","last_change":"2024-09-22T08:14:20.867755+0000","last_active":"2024-09-22T08:14:20.867755+0000","last_peered":"2024-09-22T08:14:20.867755+0000","last_clean":"2024-09-22T08:14:20.867755+0000","last_became_active":"2024-09-22T08:10:45.183307+0000","last_became_peered":"2024-09-22T08:10:45.183307+0000","last_unstale":"2024-09-22T08:14:20.867755+0000","last_undegraded":"2024-09-22T08:14:20.867755+0000","last_fullsized":"2024-09-22T08:14:20.867755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:20.867654+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:20.867654+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.867654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:26.987640+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.753375+0000","last_change":"2024-09-22T08:14:05.753375+0000","last_active":"2024-09-22T08:14:05.753375+0000","last_peered":"2024-09-22T08:14:05.753375+0000","last_clean":"2024-09-22T08:14:05.753375+0000","last_became_active":"2024-09-22T08:10:43.187835+0000","last_became_peered":"2024-09-22T08:10:43.187835+0000","last_unstale":"2024-09-22T08:14:05.753375+0000","last_undegraded":"2024-09-22T08:14:05.753375+0000","last_fullsized":"2024-09-22T08:14:05.753375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.753280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.753280+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.753280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:33.618928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211282+0000","last_change":"2024-09-22T08:10:47.175684+0000","last_active":"2024-09-22T08:11:23.211282+0000","last_peered":"2024-09-22T08:11:23.211282+0000","last_clean":"2024-09-22T08:11:23.211282+0000","last_became_active":"2024-09-22T08:10:47.175386+0000","last_became_peered":"2024-09-22T08:10:47.175386+0000","last_unstale":"2024-09-22T08:11:23.211282+0000","last_undegraded":"2024-09-22T08:11:23.211282+0000","last_fullsized":"2024-09-22T08:11:23.211282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:48.587319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.842635+0000","last_change":"2024-09-22T08:10:49.185291+0000","last_active":"2024-09-22T08:13:59.842635+0000","last_peered":"2024-09-22T08:13:59.842635+0000","last_clean":"2024-09-22T08:13:59.842635+0000","last_became_active":"2024-09-22T08:10:49.184963+0000","last_became_peered":"2024-09-22T08:10:49.184963+0000","last_unstale":"2024-09-22T08:13:59.842635+0000","last_undegraded":"2024-09-22T08:13:59.842635+0000","last_fullsized":"2024-09-22T08:13:59.842635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:53.469586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":445,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.799214+0000","last_change":"2024-09-22T08:10:51.193999+0000","last_active":"2024-09-22T08:13:59.799214+0000","last_peered":"2024-09-22T08:13:59.799214+0000","last_clean":"2024-09-22T08:13:59.799214+0000","last_became_active":"2024-09-22T08:10:51.193678+0000","last_became_peered":"2024-09-22T08:10:51.193678+0000","last_unstale":"2024-09-22T08:13:59.799214+0000","last_undegraded":"2024-09-22T08:13:59.799214+0000","last_fullsized":"2024-09-22T08:13:59.799214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.950936+0000","last_change":"2024-09-22T08:10:45.184006+0000","last_active":"2024-09-22T08:13:52.950936+0000","last_peered":"2024-09-22T08:13:52.950936+0000","last_clean":"2024-09-22T08:13:52.950936+0000","last_became_active":"2024-09-22T08:10:45.183598+0000","last_became_peered":"2024-09-22T08:10:45.183598+0000","last_unstale":"2024-09-22T08:13:52.950936+0000","last_undegraded":"2024-09-22T08:13:52.950936+0000","last_fullsized":"2024-09-22T08:13:52.950936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:42.041157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.780412+0000","last_change":"2024-09-22T08:14:07.780412+0000","last_active":"2024-09-22T08:14:07.780412+0000","last_peered":"2024-09-22T08:14:07.780412+0000","last_clean":"2024-09-22T08:14:07.780412+0000","last_became_active":"2024-09-22T08:10:43.173543+0000","last_became_peered":"2024-09-22T08:10:43.173543+0000","last_unstale":"2024-09-22T08:14:07.780412+0000","last_undegraded":"2024-09-22T08:14:07.780412+0000","last_fullsized":"2024-09-22T08:14:07.780412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:07.780321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:07.780321+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.780321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:56.960543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212481+0000","last_change":"2024-09-22T08:10:47.176921+0000","last_active":"2024-09-22T08:11:23.212481+0000","last_peered":"2024-09-22T08:11:23.212481+0000","last_clean":"2024-09-22T08:11:23.212481+0000","last_became_active":"2024-09-22T08:10:47.176657+0000","last_became_peered":"2024-09-22T08:10:47.176657+0000","last_unstale":"2024-09-22T08:11:23.212481+0000","last_undegraded":"2024-09-22T08:11:23.212481+0000","last_fullsized":"2024-09-22T08:11:23.212481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:32.681711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'43","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.870291+0000","last_change":"2024-09-22T08:10:49.184460+0000","last_active":"2024-09-22T08:13:59.870291+0000","last_peered":"2024-09-22T08:13:59.870291+0000","last_clean":"2024-09-22T08:13:59.870291+0000","last_became_active":"2024-09-22T08:10:49.182985+0000","last_became_peered":"2024-09-22T08:10:49.182985+0000","last_unstale":"2024-09-22T08:13:59.870291+0000","last_undegraded":"2024-09-22T08:13:59.870291+0000","last_fullsized":"2024-09-22T08:13:59.870291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:56.307814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222432+0000","last_change":"2024-09-22T08:10:51.193335+0000","last_active":"2024-09-22T08:11:23.222432+0000","last_peered":"2024-09-22T08:11:23.222432+0000","last_clean":"2024-09-22T08:11:23.222432+0000","last_became_active":"2024-09-22T08:10:51.192623+0000","last_became_peered":"2024-09-22T08:10:51.192623+0000","last_unstale":"2024-09-22T08:11:23.222432+0000","last_undegraded":"2024-09-22T08:11:23.222432+0000","last_fullsized":"2024-09-22T08:11:23.222432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.835562+0000","last_change":"2024-09-22T08:10:53.198555+0000","last_active":"2024-09-22T08:12:08.835562+0000","last_peered":"2024-09-22T08:12:08.835562+0000","last_clean":"2024-09-22T08:12:08.835562+0000","last_became_active":"2024-09-22T08:10:53.198219+0000","last_became_peered":"2024-09-22T08:10:53.198219+0000","last_unstale":"2024-09-22T08:12:08.835562+0000","last_undegraded":"2024-09-22T08:12:08.835562+0000","last_fullsized":"2024-09-22T08:12:08.835562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:04.308739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.853871+0000","last_change":"2024-09-22T08:14:20.853871+0000","last_active":"2024-09-22T08:14:20.853871+0000","last_peered":"2024-09-22T08:14:20.853871+0000","last_clean":"2024-09-22T08:14:20.853871+0000","last_became_active":"2024-09-22T08:10:45.171911+0000","last_became_peered":"2024-09-22T08:10:45.171911+0000","last_unstale":"2024-09-22T08:14:20.853871+0000","last_undegraded":"2024-09-22T08:14:20.853871+0000","last_fullsized":"2024-09-22T08:14:20.853871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:20.853779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:20.853779+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.853779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:02.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.794540+0000","last_change":"2024-09-22T08:14:06.794540+0000","last_active":"2024-09-22T08:14:06.794540+0000","last_peered":"2024-09-22T08:14:06.794540+0000","last_clean":"2024-09-22T08:14:06.794540+0000","last_became_active":"2024-09-22T08:10:43.189780+0000","last_became_peered":"2024-09-22T08:10:43.189780+0000","last_unstale":"2024-09-22T08:14:06.794540+0000","last_undegraded":"2024-09-22T08:14:06.794540+0000","last_fullsized":"2024-09-22T08:14:06.794540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:06.794440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:06.794440+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.794440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:21.869262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220270+0000","last_change":"2024-09-22T08:10:47.177997+0000","last_active":"2024-09-22T08:11:23.220270+0000","last_peered":"2024-09-22T08:11:23.220270+0000","last_clean":"2024-09-22T08:11:23.220270+0000","last_became_active":"2024-09-22T08:10:47.177695+0000","last_became_peered":"2024-09-22T08:10:47.177695+0000","last_unstale":"2024-09-22T08:11:23.220270+0000","last_undegraded":"2024-09-22T08:11:23.220270+0000","last_fullsized":"2024-09-22T08:11:23.220270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:09.326387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.917701+0000","last_change":"2024-09-22T08:10:49.185696+0000","last_active":"2024-09-22T08:13:59.917701+0000","last_peered":"2024-09-22T08:13:59.917701+0000","last_clean":"2024-09-22T08:13:59.917701+0000","last_became_active":"2024-09-22T08:10:49.185419+0000","last_became_peered":"2024-09-22T08:10:49.185419+0000","last_unstale":"2024-09-22T08:13:59.917701+0000","last_undegraded":"2024-09-22T08:13:59.917701+0000","last_fullsized":"2024-09-22T08:13:59.917701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:57.299371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221426+0000","last_change":"2024-09-22T08:10:51.202896+0000","last_active":"2024-09-22T08:11:23.221426+0000","last_peered":"2024-09-22T08:11:23.221426+0000","last_clean":"2024-09-22T08:11:23.221426+0000","last_became_active":"2024-09-22T08:10:51.202564+0000","last_became_peered":"2024-09-22T08:10:51.202564+0000","last_unstale":"2024-09-22T08:11:23.221426+0000","last_undegraded":"2024-09-22T08:11:23.221426+0000","last_fullsized":"2024-09-22T08:11:23.221426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:58.270948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:03.306650+0000","last_change":"2024-09-22T08:10:53.196844+0000","last_active":"2024-09-22T08:12:03.306650+0000","last_peered":"2024-09-22T08:12:03.306650+0000","last_clean":"2024-09-22T08:12:03.306650+0000","last_became_active":"2024-09-22T08:10:53.196392+0000","last_became_peered":"2024-09-22T08:10:53.196392+0000","last_unstale":"2024-09-22T08:12:03.306650+0000","last_undegraded":"2024-09-22T08:12:03.306650+0000","last_fullsized":"2024-09-22T08:12:03.306650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:30.239443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.834249+0000","last_change":"2024-09-22T08:14:18.834249+0000","last_active":"2024-09-22T08:14:18.834249+0000","last_peered":"2024-09-22T08:14:18.834249+0000","last_clean":"2024-09-22T08:14:18.834249+0000","last_became_active":"2024-09-22T08:10:45.177530+0000","last_became_peered":"2024-09-22T08:10:45.177530+0000","last_unstale":"2024-09-22T08:14:18.834249+0000","last_undegraded":"2024-09-22T08:14:18.834249+0000","last_fullsized":"2024-09-22T08:14:18.834249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:18.834156+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.834156+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.834156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:22.288734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.250010+0000","last_change":"2024-09-22T08:14:15.250010+0000","last_active":"2024-09-22T08:14:15.250010+0000","last_peered":"2024-09-22T08:14:15.250010+0000","last_clean":"2024-09-22T08:14:15.250010+0000","last_became_active":"2024-09-22T08:10:43.201669+0000","last_became_peered":"2024-09-22T08:10:43.201669+0000","last_unstale":"2024-09-22T08:14:15.250010+0000","last_undegraded":"2024-09-22T08:14:15.250010+0000","last_fullsized":"2024-09-22T08:14:15.250010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:15.249925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:15.249925+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.249925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:10.670160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221742+0000","last_change":"2024-09-22T08:10:47.177950+0000","last_active":"2024-09-22T08:11:23.221742+0000","last_peered":"2024-09-22T08:11:23.221742+0000","last_clean":"2024-09-22T08:11:23.221742+0000","last_became_active":"2024-09-22T08:10:47.177613+0000","last_became_peered":"2024-09-22T08:10:47.177613+0000","last_unstale":"2024-09-22T08:11:23.221742+0000","last_undegraded":"2024-09-22T08:11:23.221742+0000","last_fullsized":"2024-09-22T08:11:23.221742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:26.919515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'40","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.875765+0000","last_change":"2024-09-22T08:10:49.187229+0000","last_active":"2024-09-22T08:13:59.875765+0000","last_peered":"2024-09-22T08:13:59.875765+0000","last_clean":"2024-09-22T08:13:59.875765+0000","last_became_active":"2024-09-22T08:10:49.186941+0000","last_became_peered":"2024-09-22T08:10:49.186941+0000","last_unstale":"2024-09-22T08:13:59.875765+0000","last_undegraded":"2024-09-22T08:13:59.875765+0000","last_fullsized":"2024-09-22T08:13:59.875765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:28.645390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.800403+0000","last_change":"2024-09-22T08:10:51.192885+0000","last_active":"2024-09-22T08:13:59.800403+0000","last_peered":"2024-09-22T08:13:59.800403+0000","last_clean":"2024-09-22T08:13:59.800403+0000","last_became_active":"2024-09-22T08:10:51.192483+0000","last_became_peered":"2024-09-22T08:10:51.192483+0000","last_unstale":"2024-09-22T08:13:59.800403+0000","last_undegraded":"2024-09-22T08:13:59.800403+0000","last_fullsized":"2024-09-22T08:13:59.800403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:47.260805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222488+0000","last_change":"2024-09-22T08:10:53.199613+0000","last_active":"2024-09-22T08:11:23.222488+0000","last_peered":"2024-09-22T08:11:23.222488+0000","last_clean":"2024-09-22T08:11:23.222488+0000","last_became_active":"2024-09-22T08:10:53.199273+0000","last_became_peered":"2024-09-22T08:10:53.199273+0000","last_unstale":"2024-09-22T08:11:23.222488+0000","last_undegraded":"2024-09-22T08:11:23.222488+0000","last_fullsized":"2024-09-22T08:11:23.222488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:07.308140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.865126+0000","last_change":"2024-09-22T08:14:21.865126+0000","last_active":"2024-09-22T08:14:21.865126+0000","last_peered":"2024-09-22T08:14:21.865126+0000","last_clean":"2024-09-22T08:14:21.865126+0000","last_became_active":"2024-09-22T08:10:45.165352+0000","last_became_peered":"2024-09-22T08:10:45.165352+0000","last_unstale":"2024-09-22T08:14:21.865126+0000","last_undegraded":"2024-09-22T08:14:21.865126+0000","last_fullsized":"2024-09-22T08:14:21.865126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:21.865034+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:21.865034+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.865034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:43.503660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.210375+0000","last_change":"2024-09-22T08:14:14.210375+0000","last_active":"2024-09-22T08:14:14.210375+0000","last_peered":"2024-09-22T08:14:14.210375+0000","last_clean":"2024-09-22T08:14:14.210375+0000","last_became_active":"2024-09-22T08:10:43.198696+0000","last_became_peered":"2024-09-22T08:10:43.198696+0000","last_unstale":"2024-09-22T08:14:14.210375+0000","last_undegraded":"2024-09-22T08:14:14.210375+0000","last_fullsized":"2024-09-22T08:14:14.210375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:14.210290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:14.210290+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.210290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:59.541262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220881+0000","last_change":"2024-09-22T08:10:47.176680+0000","last_active":"2024-09-22T08:11:23.220881+0000","last_peered":"2024-09-22T08:11:23.220881+0000","last_clean":"2024-09-22T08:11:23.220881+0000","last_became_active":"2024-09-22T08:10:47.176263+0000","last_became_peered":"2024-09-22T08:10:47.176263+0000","last_unstale":"2024-09-22T08:11:23.220881+0000","last_undegraded":"2024-09-22T08:11:23.220881+0000","last_fullsized":"2024-09-22T08:11:23.220881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:38.640214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'60","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.926835+0000","last_change":"2024-09-22T08:10:49.189658+0000","last_active":"2024-09-22T08:13:59.926835+0000","last_peered":"2024-09-22T08:13:59.926835+0000","last_clean":"2024-09-22T08:13:59.926835+0000","last_became_active":"2024-09-22T08:10:49.188724+0000","last_became_peered":"2024-09-22T08:10:49.188724+0000","last_unstale":"2024-09-22T08:13:59.926835+0000","last_undegraded":"2024-09-22T08:13:59.926835+0000","last_fullsized":"2024-09-22T08:13:59.926835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:49.620069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220087+0000","last_change":"2024-09-22T08:10:51.195268+0000","last_active":"2024-09-22T08:11:23.220087+0000","last_peered":"2024-09-22T08:11:23.220087+0000","last_clean":"2024-09-22T08:11:23.220087+0000","last_became_active":"2024-09-22T08:10:51.194937+0000","last_became_peered":"2024-09-22T08:10:51.194937+0000","last_unstale":"2024-09-22T08:11:23.220087+0000","last_undegraded":"2024-09-22T08:11:23.220087+0000","last_fullsized":"2024-09-22T08:11:23.220087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.350209+0000","last_change":"2024-09-22T08:10:53.201595+0000","last_active":"2024-09-22T08:13:53.350209+0000","last_peered":"2024-09-22T08:13:53.350209+0000","last_clean":"2024-09-22T08:13:53.350209+0000","last_became_active":"2024-09-22T08:10:53.201289+0000","last_became_peered":"2024-09-22T08:10:53.201289+0000","last_unstale":"2024-09-22T08:13:53.350209+0000","last_undegraded":"2024-09-22T08:13:53.350209+0000","last_fullsized":"2024-09-22T08:13:53.350209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:22.640385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.853760+0000","last_change":"2024-09-22T08:14:19.853760+0000","last_active":"2024-09-22T08:14:19.853760+0000","last_peered":"2024-09-22T08:14:19.853760+0000","last_clean":"2024-09-22T08:14:19.853760+0000","last_became_active":"2024-09-22T08:10:45.180762+0000","last_became_peered":"2024-09-22T08:10:45.180762+0000","last_unstale":"2024-09-22T08:14:19.853760+0000","last_undegraded":"2024-09-22T08:14:19.853760+0000","last_fullsized":"2024-09-22T08:14:19.853760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:19.853672+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:19.853672+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.853672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:03.241087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.884829+0000","last_change":"2024-09-22T08:14:08.884829+0000","last_active":"2024-09-22T08:14:08.884829+0000","last_peered":"2024-09-22T08:14:08.884829+0000","last_clean":"2024-09-22T08:14:08.884829+0000","last_became_active":"2024-09-22T08:10:43.177202+0000","last_became_peered":"2024-09-22T08:10:43.177202+0000","last_unstale":"2024-09-22T08:14:08.884829+0000","last_undegraded":"2024-09-22T08:14:08.884829+0000","last_fullsized":"2024-09-22T08:14:08.884829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:08.884729+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:08.884729+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.884729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:59.041707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207951+0000","last_change":"2024-09-22T08:10:47.173920+0000","last_active":"2024-09-22T08:11:23.207951+0000","last_peered":"2024-09-22T08:11:23.207951+0000","last_clean":"2024-09-22T08:11:23.207951+0000","last_became_active":"2024-09-22T08:10:47.173636+0000","last_became_peered":"2024-09-22T08:10:47.173636+0000","last_unstale":"2024-09-22T08:11:23.207951+0000","last_undegraded":"2024-09-22T08:11:23.207951+0000","last_fullsized":"2024-09-22T08:11:23.207951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:07.844753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.929919+0000","last_change":"2024-09-22T08:10:49.175235+0000","last_active":"2024-09-22T08:13:59.929919+0000","last_peered":"2024-09-22T08:13:59.929919+0000","last_clean":"2024-09-22T08:13:59.929919+0000","last_became_active":"2024-09-22T08:10:49.174933+0000","last_became_peered":"2024-09-22T08:10:49.174933+0000","last_unstale":"2024-09-22T08:13:59.929919+0000","last_undegraded":"2024-09-22T08:13:59.929919+0000","last_fullsized":"2024-09-22T08:13:59.929919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:09.101942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212489+0000","last_change":"2024-09-22T08:10:51.195590+0000","last_active":"2024-09-22T08:11:23.212489+0000","last_peered":"2024-09-22T08:11:23.212489+0000","last_clean":"2024-09-22T08:11:23.212489+0000","last_became_active":"2024-09-22T08:10:51.195308+0000","last_became_peered":"2024-09-22T08:10:51.195308+0000","last_unstale":"2024-09-22T08:11:23.212489+0000","last_undegraded":"2024-09-22T08:11:23.212489+0000","last_fullsized":"2024-09-22T08:11:23.212489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:13.979616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584694+0000","last_change":"2024-09-22T08:10:53.201429+0000","last_active":"2024-09-22T08:12:52.584694+0000","last_peered":"2024-09-22T08:12:52.584694+0000","last_clean":"2024-09-22T08:12:52.584694+0000","last_became_active":"2024-09-22T08:10:53.200458+0000","last_became_peered":"2024-09-22T08:10:53.200458+0000","last_unstale":"2024-09-22T08:12:52.584694+0000","last_undegraded":"2024-09-22T08:12:52.584694+0000","last_fullsized":"2024-09-22T08:12:52.584694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:15.839331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:02.586743+0000","last_change":"2024-09-22T08:10:45.183532+0000","last_active":"2024-09-22T08:13:02.586743+0000","last_peered":"2024-09-22T08:13:02.586743+0000","last_clean":"2024-09-22T08:13:02.586743+0000","last_became_active":"2024-09-22T08:10:45.183258+0000","last_became_peered":"2024-09-22T08:10:45.183258+0000","last_unstale":"2024-09-22T08:13:02.586743+0000","last_undegraded":"2024-09-22T08:13:02.586743+0000","last_fullsized":"2024-09-22T08:13:02.586743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:38.687579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.213044+0000","last_change":"2024-09-22T08:14:13.213044+0000","last_active":"2024-09-22T08:14:13.213044+0000","last_peered":"2024-09-22T08:14:13.213044+0000","last_clean":"2024-09-22T08:14:13.213044+0000","last_became_active":"2024-09-22T08:10:43.195959+0000","last_became_peered":"2024-09-22T08:10:43.195959+0000","last_unstale":"2024-09-22T08:14:13.213044+0000","last_undegraded":"2024-09-22T08:14:13.213044+0000","last_fullsized":"2024-09-22T08:14:13.213044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:13.212946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:13.212946+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.212946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:31.672558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216166+0000","last_change":"2024-09-22T08:11:23.215294+0000","last_active":"2024-09-22T08:11:23.216166+0000","last_peered":"2024-09-22T08:11:23.216166+0000","last_clean":"2024-09-22T08:11:23.216166+0000","last_became_active":"2024-09-22T08:11:23.214959+0000","last_became_peered":"2024-09-22T08:11:23.214959+0000","last_unstale":"2024-09-22T08:11:23.216166+0000","last_undegraded":"2024-09-22T08:11:23.216166+0000","last_fullsized":"2024-09-22T08:11:23.216166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:50.116285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.908174+0000","last_change":"2024-09-22T08:10:49.181291+0000","last_active":"2024-09-22T08:13:59.908174+0000","last_peered":"2024-09-22T08:13:59.908174+0000","last_clean":"2024-09-22T08:13:59.908174+0000","last_became_active":"2024-09-22T08:10:49.180820+0000","last_became_peered":"2024-09-22T08:10:49.180820+0000","last_unstale":"2024-09-22T08:13:59.908174+0000","last_undegraded":"2024-09-22T08:13:59.908174+0000","last_fullsized":"2024-09-22T08:13:59.908174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:56.059910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":435,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.795492+0000","last_change":"2024-09-22T08:10:51.197307+0000","last_active":"2024-09-22T08:13:59.795492+0000","last_peered":"2024-09-22T08:13:59.795492+0000","last_clean":"2024-09-22T08:13:59.795492+0000","last_became_active":"2024-09-22T08:10:51.197020+0000","last_became_peered":"2024-09-22T08:10:51.197020+0000","last_unstale":"2024-09-22T08:13:59.795492+0000","last_undegraded":"2024-09-22T08:13:59.795492+0000","last_fullsized":"2024-09-22T08:13:59.795492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:39.376197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:01.585334+0000","last_change":"2024-09-22T08:10:53.192873+0000","last_active":"2024-09-22T08:13:01.585334+0000","last_peered":"2024-09-22T08:13:01.585334+0000","last_clean":"2024-09-22T08:13:01.585334+0000","last_became_active":"2024-09-22T08:10:53.192481+0000","last_became_peered":"2024-09-22T08:10:53.192481+0000","last_unstale":"2024-09-22T08:13:01.585334+0000","last_undegraded":"2024-09-22T08:13:01.585334+0000","last_fullsized":"2024-09-22T08:13:01.585334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:06.451090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.823199+0000","last_change":"2024-09-22T08:14:20.823199+0000","last_active":"2024-09-22T08:14:20.823199+0000","last_peered":"2024-09-22T08:14:20.823199+0000","last_clean":"2024-09-22T08:14:20.823199+0000","last_became_active":"2024-09-22T08:10:45.172740+0000","last_became_peered":"2024-09-22T08:10:45.172740+0000","last_unstale":"2024-09-22T08:14:20.823199+0000","last_undegraded":"2024-09-22T08:14:20.823199+0000","last_fullsized":"2024-09-22T08:14:20.823199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:20.823098+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:20.823098+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.823098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:35.363067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.246369+0000","last_change":"2024-09-22T08:14:12.246369+0000","last_active":"2024-09-22T08:14:12.246369+0000","last_peered":"2024-09-22T08:14:12.246369+0000","last_clean":"2024-09-22T08:14:12.246369+0000","last_became_active":"2024-09-22T08:10:43.195355+0000","last_became_peered":"2024-09-22T08:10:43.195355+0000","last_unstale":"2024-09-22T08:14:12.246369+0000","last_undegraded":"2024-09-22T08:14:12.246369+0000","last_fullsized":"2024-09-22T08:14:12.246369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:12.246281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:12.246281+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.246281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:08.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":430,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.776594+0000","last_change":"2024-09-22T08:11:23.229177+0000","last_active":"2024-09-22T08:13:59.776594+0000","last_peered":"2024-09-22T08:13:59.776594+0000","last_clean":"2024-09-22T08:13:59.776594+0000","last_became_active":"2024-09-22T08:11:23.221981+0000","last_became_peered":"2024-09-22T08:11:23.221981+0000","last_unstale":"2024-09-22T08:13:59.776594+0000","last_undegraded":"2024-09-22T08:13:59.776594+0000","last_fullsized":"2024-09-22T08:13:59.776594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:00.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213610+0000","last_change":"2024-09-22T08:10:49.188917+0000","last_active":"2024-09-22T08:11:23.213610+0000","last_peered":"2024-09-22T08:11:23.213610+0000","last_clean":"2024-09-22T08:11:23.213610+0000","last_became_active":"2024-09-22T08:10:49.188444+0000","last_became_peered":"2024-09-22T08:10:49.188444+0000","last_unstale":"2024-09-22T08:11:23.213610+0000","last_undegraded":"2024-09-22T08:11:23.213610+0000","last_fullsized":"2024-09-22T08:11:23.213610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:27.352744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":472,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.796535+0000","last_change":"2024-09-22T08:10:51.197818+0000","last_active":"2024-09-22T08:13:59.796535+0000","last_peered":"2024-09-22T08:13:59.796535+0000","last_clean":"2024-09-22T08:13:59.796535+0000","last_became_active":"2024-09-22T08:10:51.197248+0000","last_became_peered":"2024-09-22T08:10:51.197248+0000","last_unstale":"2024-09-22T08:13:59.796535+0000","last_undegraded":"2024-09-22T08:13:59.796535+0000","last_fullsized":"2024-09-22T08:13:59.796535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.360311+0000","last_change":"2024-09-22T08:10:53.195875+0000","last_active":"2024-09-22T08:12:52.360311+0000","last_peered":"2024-09-22T08:12:52.360311+0000","last_clean":"2024-09-22T08:12:52.360311+0000","last_became_active":"2024-09-22T08:10:53.195539+0000","last_became_peered":"2024-09-22T08:10:53.195539+0000","last_unstale":"2024-09-22T08:12:52.360311+0000","last_undegraded":"2024-09-22T08:12:52.360311+0000","last_fullsized":"2024-09-22T08:12:52.360311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:10.933920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.869186+0000","last_change":"2024-09-22T08:14:21.869186+0000","last_active":"2024-09-22T08:14:21.869186+0000","last_peered":"2024-09-22T08:14:21.869186+0000","last_clean":"2024-09-22T08:14:21.869186+0000","last_became_active":"2024-09-22T08:11:23.220943+0000","last_became_peered":"2024-09-22T08:11:23.220943+0000","last_unstale":"2024-09-22T08:14:21.869186+0000","last_undegraded":"2024-09-22T08:14:21.869186+0000","last_fullsized":"2024-09-22T08:14:21.869186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:21.869104+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:21.869104+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.869104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:05.409690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.271839+0000","last_change":"2024-09-22T08:14:11.271839+0000","last_active":"2024-09-22T08:14:11.271839+0000","last_peered":"2024-09-22T08:14:11.271839+0000","last_clean":"2024-09-22T08:14:11.271839+0000","last_became_active":"2024-09-22T08:10:43.196211+0000","last_became_peered":"2024-09-22T08:10:43.196211+0000","last_unstale":"2024-09-22T08:14:11.271839+0000","last_undegraded":"2024-09-22T08:14:11.271839+0000","last_fullsized":"2024-09-22T08:14:11.271839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:11.271716+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:11.271716+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.271716+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:52.551470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211379+0000","last_change":"2024-09-22T08:10:47.177015+0000","last_active":"2024-09-22T08:11:23.211379+0000","last_peered":"2024-09-22T08:11:23.211379+0000","last_clean":"2024-09-22T08:11:23.211379+0000","last_became_active":"2024-09-22T08:10:47.176634+0000","last_became_peered":"2024-09-22T08:10:47.176634+0000","last_unstale":"2024-09-22T08:11:23.211379+0000","last_undegraded":"2024-09-22T08:11:23.211379+0000","last_fullsized":"2024-09-22T08:11:23.211379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:32.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'41","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.861199+0000","last_change":"2024-09-22T08:10:49.179447+0000","last_active":"2024-09-22T08:13:59.861199+0000","last_peered":"2024-09-22T08:13:59.861199+0000","last_clean":"2024-09-22T08:13:59.861199+0000","last_became_active":"2024-09-22T08:10:49.178942+0000","last_became_peered":"2024-09-22T08:10:49.178942+0000","last_unstale":"2024-09-22T08:13:59.861199+0000","last_undegraded":"2024-09-22T08:13:59.861199+0000","last_fullsized":"2024-09-22T08:13:59.861199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:49.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207501+0000","last_change":"2024-09-22T08:10:51.192777+0000","last_active":"2024-09-22T08:11:23.207501+0000","last_peered":"2024-09-22T08:11:23.207501+0000","last_clean":"2024-09-22T08:11:23.207501+0000","last_became_active":"2024-09-22T08:10:51.192482+0000","last_became_peered":"2024-09-22T08:10:51.192482+0000","last_unstale":"2024-09-22T08:11:23.207501+0000","last_undegraded":"2024-09-22T08:11:23.207501+0000","last_fullsized":"2024-09-22T08:11:23.207501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:39.871977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.288651+0000","last_change":"2024-09-22T08:10:53.193739+0000","last_active":"2024-09-22T08:13:53.288651+0000","last_peered":"2024-09-22T08:13:53.288651+0000","last_clean":"2024-09-22T08:13:53.288651+0000","last_became_active":"2024-09-22T08:10:53.193315+0000","last_became_peered":"2024-09-22T08:10:53.193315+0000","last_unstale":"2024-09-22T08:13:53.288651+0000","last_undegraded":"2024-09-22T08:13:53.288651+0000","last_fullsized":"2024-09-22T08:13:53.288651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:02.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.576265+0000","last_change":"2024-09-22T08:10:45.176318+0000","last_active":"2024-09-22T08:12:52.576265+0000","last_peered":"2024-09-22T08:12:52.576265+0000","last_clean":"2024-09-22T08:12:52.576265+0000","last_became_active":"2024-09-22T08:10:45.176033+0000","last_became_peered":"2024-09-22T08:10:45.176033+0000","last_unstale":"2024-09-22T08:12:52.576265+0000","last_undegraded":"2024-09-22T08:12:52.576265+0000","last_fullsized":"2024-09-22T08:12:52.576265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:16.885517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":155,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.711736+0000","last_change":"2024-09-22T08:14:03.711736+0000","last_active":"2024-09-22T08:14:03.711736+0000","last_peered":"2024-09-22T08:14:03.711736+0000","last_clean":"2024-09-22T08:14:03.711736+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:14:03.711736+0000","last_undegraded":"2024-09-22T08:14:03.711736+0000","last_fullsized":"2024-09-22T08:14:03.711736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-22T08:14:03.711630+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-22T08:14:03.711630+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.711630+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:19.958877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.254389+0000","last_change":"2024-09-22T08:14:06.254389+0000","last_active":"2024-09-22T08:14:06.254389+0000","last_peered":"2024-09-22T08:14:06.254389+0000","last_clean":"2024-09-22T08:14:06.254389+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:14:06.254389+0000","last_undegraded":"2024-09-22T08:14:06.254389+0000","last_fullsized":"2024-09-22T08:14:06.254389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:06.254288+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:06.254288+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.254288+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:56.951153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.286135+0000","last_change":"2024-09-22T08:14:09.286135+0000","last_active":"2024-09-22T08:14:09.286135+0000","last_peered":"2024-09-22T08:14:09.286135+0000","last_clean":"2024-09-22T08:14:09.286135+0000","last_became_active":"2024-09-22T08:10:43.200918+0000","last_became_peered":"2024-09-22T08:10:43.200918+0000","last_unstale":"2024-09-22T08:14:09.286135+0000","last_undegraded":"2024-09-22T08:14:09.286135+0000","last_fullsized":"2024-09-22T08:14:09.286135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:09.286038+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:09.286038+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.286038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:54.829260+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"25'1","reported_seq":221,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.767241+0000","last_change":"2024-09-22T08:10:47.176080+0000","last_active":"2024-09-22T08:13:59.767241+0000","last_peered":"2024-09-22T08:13:59.767241+0000","last_clean":"2024-09-22T08:13:59.767241+0000","last_became_active":"2024-09-22T08:10:47.175775+0000","last_became_peered":"2024-09-22T08:10:47.175775+0000","last_unstale":"2024-09-22T08:13:59.767241+0000","last_undegraded":"2024-09-22T08:13:59.767241+0000","last_fullsized":"2024-09-22T08:13:59.767241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:05.368279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.894756+0000","last_change":"2024-09-22T08:10:49.185987+0000","last_active":"2024-09-22T08:13:59.894756+0000","last_peered":"2024-09-22T08:13:59.894756+0000","last_clean":"2024-09-22T08:13:59.894756+0000","last_became_active":"2024-09-22T08:10:49.185661+0000","last_became_peered":"2024-09-22T08:10:49.185661+0000","last_unstale":"2024-09-22T08:13:59.894756+0000","last_undegraded":"2024-09-22T08:13:59.894756+0000","last_fullsized":"2024-09-22T08:13:59.894756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:08.519832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222697+0000","last_change":"2024-09-22T08:10:51.202811+0000","last_active":"2024-09-22T08:11:23.222697+0000","last_peered":"2024-09-22T08:11:23.222697+0000","last_clean":"2024-09-22T08:11:23.222697+0000","last_became_active":"2024-09-22T08:10:51.202473+0000","last_became_peered":"2024-09-22T08:10:51.202473+0000","last_unstale":"2024-09-22T08:11:23.222697+0000","last_undegraded":"2024-09-22T08:11:23.222697+0000","last_fullsized":"2024-09-22T08:11:23.222697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.556104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.266227+0000","last_change":"2024-09-22T08:10:53.192244+0000","last_active":"2024-09-22T08:13:53.266227+0000","last_peered":"2024-09-22T08:13:53.266227+0000","last_clean":"2024-09-22T08:13:53.266227+0000","last_became_active":"2024-09-22T08:10:53.191752+0000","last_became_peered":"2024-09-22T08:10:53.191752+0000","last_unstale":"2024-09-22T08:13:53.266227+0000","last_undegraded":"2024-09-22T08:13:53.266227+0000","last_fullsized":"2024-09-22T08:13:53.266227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:21.155421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183521+0000","last_change":"2024-09-22T08:10:45.167615+0000","last_active":"2024-09-22T08:13:53.183521+0000","last_peered":"2024-09-22T08:13:53.183521+0000","last_clean":"2024-09-22T08:13:53.183521+0000","last_became_active":"2024-09-22T08:10:45.167260+0000","last_became_peered":"2024-09-22T08:10:45.167260+0000","last_unstale":"2024-09-22T08:13:53.183521+0000","last_undegraded":"2024-09-22T08:13:53.183521+0000","last_fullsized":"2024-09-22T08:13:53.183521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:21:09.439811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.232987+0000","last_change":"2024-09-22T08:14:05.232987+0000","last_active":"2024-09-22T08:14:05.232987+0000","last_peered":"2024-09-22T08:14:05.232987+0000","last_clean":"2024-09-22T08:14:05.232987+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:14:05.232987+0000","last_undegraded":"2024-09-22T08:14:05.232987+0000","last_fullsized":"2024-09-22T08:14:05.232987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.232899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.232899+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.232899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:33.852323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.919117+0000","last_change":"2024-09-22T08:14:07.919117+0000","last_active":"2024-09-22T08:14:07.919117+0000","last_peered":"2024-09-22T08:14:07.919117+0000","last_clean":"2024-09-22T08:14:07.919117+0000","last_became_active":"2024-09-22T08:10:43.177928+0000","last_became_peered":"2024-09-22T08:10:43.177928+0000","last_unstale":"2024-09-22T08:14:07.919117+0000","last_undegraded":"2024-09-22T08:14:07.919117+0000","last_fullsized":"2024-09-22T08:14:07.919117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:07.918996+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:07.918996+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.918996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:08.892898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212854+0000","last_change":"2024-09-22T08:10:47.176700+0000","last_active":"2024-09-22T08:11:23.212854+0000","last_peered":"2024-09-22T08:11:23.212854+0000","last_clean":"2024-09-22T08:11:23.212854+0000","last_became_active":"2024-09-22T08:10:47.176402+0000","last_became_peered":"2024-09-22T08:10:47.176402+0000","last_unstale":"2024-09-22T08:11:23.212854+0000","last_undegraded":"2024-09-22T08:11:23.212854+0000","last_fullsized":"2024-09-22T08:11:23.212854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:30.271890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'284","reported_seq":501,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.921574+0000","last_change":"2024-09-22T08:10:49.186526+0000","last_active":"2024-09-22T08:13:59.921574+0000","last_peered":"2024-09-22T08:13:59.921574+0000","last_clean":"2024-09-22T08:13:59.921574+0000","last_became_active":"2024-09-22T08:10:49.186277+0000","last_became_peered":"2024-09-22T08:10:49.186277+0000","last_unstale":"2024-09-22T08:13:59.921574+0000","last_undegraded":"2024-09-22T08:13:59.921574+0000","last_fullsized":"2024-09-22T08:13:59.921574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:42.950185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210281+0000","last_change":"2024-09-22T08:10:51.198493+0000","last_active":"2024-09-22T08:11:23.210281+0000","last_peered":"2024-09-22T08:11:23.210281+0000","last_clean":"2024-09-22T08:11:23.210281+0000","last_became_active":"2024-09-22T08:10:51.196837+0000","last_became_peered":"2024-09-22T08:10:51.196837+0000","last_unstale":"2024-09-22T08:11:23.210281+0000","last_undegraded":"2024-09-22T08:11:23.210281+0000","last_fullsized":"2024-09-22T08:11:23.210281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:20.497307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.832166+0000","last_change":"2024-09-22T08:10:53.199926+0000","last_active":"2024-09-22T08:12:08.832166+0000","last_peered":"2024-09-22T08:12:08.832166+0000","last_clean":"2024-09-22T08:12:08.832166+0000","last_became_active":"2024-09-22T08:10:53.199214+0000","last_became_peered":"2024-09-22T08:10:53.199214+0000","last_unstale":"2024-09-22T08:12:08.832166+0000","last_undegraded":"2024-09-22T08:12:08.832166+0000","last_fullsized":"2024-09-22T08:12:08.832166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:35.327109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'11","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.886625+0000","last_change":"2024-09-22T08:14:19.886625+0000","last_active":"2024-09-22T08:14:19.886625+0000","last_peered":"2024-09-22T08:14:19.886625+0000","last_clean":"2024-09-22T08:14:19.886625+0000","last_became_active":"2024-09-22T08:10:45.175923+0000","last_became_peered":"2024-09-22T08:10:45.175923+0000","last_unstale":"2024-09-22T08:14:19.886625+0000","last_undegraded":"2024-09-22T08:14:19.886625+0000","last_fullsized":"2024-09-22T08:14:19.886625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-22T08:14:19.886532+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-22T08:14:19.886532+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.886532+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:15.270799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.830583+0000","last_change":"2024-09-22T08:14:04.830583+0000","last_active":"2024-09-22T08:14:04.830583+0000","last_peered":"2024-09-22T08:14:04.830583+0000","last_clean":"2024-09-22T08:14:04.830583+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:14:04.830583+0000","last_undegraded":"2024-09-22T08:14:04.830583+0000","last_fullsized":"2024-09-22T08:14:04.830583+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:04.830494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:04.830494+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.830494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:38.025714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.991725+0000","last_change":"2024-09-22T08:14:04.991725+0000","last_active":"2024-09-22T08:14:04.991725+0000","last_peered":"2024-09-22T08:14:04.991725+0000","last_clean":"2024-09-22T08:14:04.991725+0000","last_became_active":"2024-09-22T08:10:43.186500+0000","last_became_peered":"2024-09-22T08:10:43.186500+0000","last_unstale":"2024-09-22T08:14:04.991725+0000","last_undegraded":"2024-09-22T08:14:04.991725+0000","last_fullsized":"2024-09-22T08:14:04.991725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:04.991648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:04.991648+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.991648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:45:14.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208957+0000","last_change":"2024-09-22T08:10:47.172553+0000","last_active":"2024-09-22T08:11:23.208957+0000","last_peered":"2024-09-22T08:11:23.208957+0000","last_clean":"2024-09-22T08:11:23.208957+0000","last_became_active":"2024-09-22T08:10:47.172041+0000","last_became_peered":"2024-09-22T08:10:47.172041+0000","last_unstale":"2024-09-22T08:11:23.208957+0000","last_undegraded":"2024-09-22T08:11:23.208957+0000","last_fullsized":"2024-09-22T08:11:23.208957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:29.368363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'18","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.254753+0000","last_change":"2024-09-22T08:10:49.180939+0000","last_active":"2024-09-22T08:13:52.254753+0000","last_peered":"2024-09-22T08:13:52.254753+0000","last_clean":"2024-09-22T08:13:52.254753+0000","last_became_active":"2024-09-22T08:10:49.180563+0000","last_became_peered":"2024-09-22T08:10:49.180563+0000","last_unstale":"2024-09-22T08:13:52.254753+0000","last_undegraded":"2024-09-22T08:13:52.254753+0000","last_fullsized":"2024-09-22T08:13:52.254753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:39.091603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221445+0000","last_change":"2024-09-22T08:10:51.202850+0000","last_active":"2024-09-22T08:11:23.221445+0000","last_peered":"2024-09-22T08:11:23.221445+0000","last_clean":"2024-09-22T08:11:23.221445+0000","last_became_active":"2024-09-22T08:10:51.202422+0000","last_became_peered":"2024-09-22T08:10:51.202422+0000","last_unstale":"2024-09-22T08:11:23.221445+0000","last_undegraded":"2024-09-22T08:11:23.221445+0000","last_fullsized":"2024-09-22T08:11:23.221445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:08.745501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209116+0000","last_change":"2024-09-22T08:10:53.200159+0000","last_active":"2024-09-22T08:11:23.209116+0000","last_peered":"2024-09-22T08:11:23.209116+0000","last_clean":"2024-09-22T08:11:23.209116+0000","last_became_active":"2024-09-22T08:10:53.199894+0000","last_became_peered":"2024-09-22T08:10:53.199894+0000","last_unstale":"2024-09-22T08:11:23.209116+0000","last_undegraded":"2024-09-22T08:11:23.209116+0000","last_fullsized":"2024-09-22T08:11:23.209116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:07.697983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.862623+0000","last_change":"2024-09-22T08:14:18.862623+0000","last_active":"2024-09-22T08:14:18.862623+0000","last_peered":"2024-09-22T08:14:18.862623+0000","last_clean":"2024-09-22T08:14:18.862623+0000","last_became_active":"2024-09-22T08:10:45.166816+0000","last_became_peered":"2024-09-22T08:10:45.166816+0000","last_unstale":"2024-09-22T08:14:18.862623+0000","last_undegraded":"2024-09-22T08:14:18.862623+0000","last_fullsized":"2024-09-22T08:14:18.862623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:18.862531+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:18.862531+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.862531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:02.403117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.269311+0000","last_change":"2024-09-22T08:14:04.269311+0000","last_active":"2024-09-22T08:14:04.269311+0000","last_peered":"2024-09-22T08:14:04.269311+0000","last_clean":"2024-09-22T08:14:04.269311+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:14:04.269311+0000","last_undegraded":"2024-09-22T08:14:04.269311+0000","last_fullsized":"2024-09-22T08:14:04.269311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:14:04.269206+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:14:04.269206+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.269206+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:50.609384+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.798946+0000","last_change":"2024-09-22T08:14:03.798946+0000","last_active":"2024-09-22T08:14:03.798946+0000","last_peered":"2024-09-22T08:14:03.798946+0000","last_clean":"2024-09-22T08:14:03.798946+0000","last_became_active":"2024-09-22T08:10:43.187103+0000","last_became_peered":"2024-09-22T08:10:43.187103+0000","last_unstale":"2024-09-22T08:14:03.798946+0000","last_undegraded":"2024-09-22T08:14:03.798946+0000","last_fullsized":"2024-09-22T08:14:03.798946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:03.798857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:03.798857+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.798857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:24.946857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222126+0000","last_change":"2024-09-22T08:10:47.168792+0000","last_active":"2024-09-22T08:11:23.222126+0000","last_peered":"2024-09-22T08:11:23.222126+0000","last_clean":"2024-09-22T08:11:23.222126+0000","last_became_active":"2024-09-22T08:10:47.168480+0000","last_became_peered":"2024-09-22T08:10:47.168480+0000","last_unstale":"2024-09-22T08:11:23.222126+0000","last_undegraded":"2024-09-22T08:11:23.222126+0000","last_fullsized":"2024-09-22T08:11:23.222126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:19.091966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.586312+0000","last_change":"2024-09-22T08:10:49.185221+0000","last_active":"2024-09-22T08:13:52.586312+0000","last_peered":"2024-09-22T08:13:52.586312+0000","last_clean":"2024-09-22T08:13:52.586312+0000","last_became_active":"2024-09-22T08:10:49.184961+0000","last_became_peered":"2024-09-22T08:10:49.184961+0000","last_unstale":"2024-09-22T08:13:52.586312+0000","last_undegraded":"2024-09-22T08:13:52.586312+0000","last_fullsized":"2024-09-22T08:13:52.586312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:00.221298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213144+0000","last_change":"2024-09-22T08:10:51.195952+0000","last_active":"2024-09-22T08:11:23.213144+0000","last_peered":"2024-09-22T08:11:23.213144+0000","last_clean":"2024-09-22T08:11:23.213144+0000","last_became_active":"2024-09-22T08:10:51.195643+0000","last_became_peered":"2024-09-22T08:10:51.195643+0000","last_unstale":"2024-09-22T08:11:23.213144+0000","last_undegraded":"2024-09-22T08:11:23.213144+0000","last_fullsized":"2024-09-22T08:11:23.213144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:18.035075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.336216+0000","last_change":"2024-09-22T08:10:53.203765+0000","last_active":"2024-09-22T08:12:52.336216+0000","last_peered":"2024-09-22T08:12:52.336216+0000","last_clean":"2024-09-22T08:12:52.336216+0000","last_became_active":"2024-09-22T08:10:53.203330+0000","last_became_peered":"2024-09-22T08:10:53.203330+0000","last_unstale":"2024-09-22T08:12:52.336216+0000","last_undegraded":"2024-09-22T08:12:52.336216+0000","last_fullsized":"2024-09-22T08:12:52.336216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:46.081338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.790672+0000","last_change":"2024-09-22T08:14:17.790672+0000","last_active":"2024-09-22T08:14:17.790672+0000","last_peered":"2024-09-22T08:14:17.790672+0000","last_clean":"2024-09-22T08:14:17.790672+0000","last_became_active":"2024-09-22T08:10:45.182276+0000","last_became_peered":"2024-09-22T08:10:45.182276+0000","last_unstale":"2024-09-22T08:14:17.790672+0000","last_undegraded":"2024-09-22T08:14:17.790672+0000","last_fullsized":"2024-09-22T08:14:17.790672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:17.790565+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:17.790565+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.790565+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:25.799618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.787504+0000","last_change":"2024-09-22T08:14:05.787504+0000","last_active":"2024-09-22T08:14:05.787504+0000","last_peered":"2024-09-22T08:14:05.787504+0000","last_clean":"2024-09-22T08:14:05.787504+0000","last_became_active":"2024-09-22T08:10:43.186175+0000","last_became_peered":"2024-09-22T08:10:43.186175+0000","last_unstale":"2024-09-22T08:14:05.787504+0000","last_undegraded":"2024-09-22T08:14:05.787504+0000","last_fullsized":"2024-09-22T08:14:05.787504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:05.787417+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:05.787417+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.787417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:42.384319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.983783+0000","last_change":"2024-09-22T08:14:03.983783+0000","last_active":"2024-09-22T08:14:03.983783+0000","last_peered":"2024-09-22T08:14:03.983783+0000","last_clean":"2024-09-22T08:14:03.983783+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:14:03.983783+0000","last_undegraded":"2024-09-22T08:14:03.983783+0000","last_fullsized":"2024-09-22T08:14:03.983783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:03.983713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:03.983713+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.983713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:58.921961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.372150+0000","last_change":"2024-09-22T08:10:47.167981+0000","last_active":"2024-09-22T08:13:53.372150+0000","last_peered":"2024-09-22T08:13:53.372150+0000","last_clean":"2024-09-22T08:13:53.372150+0000","last_became_active":"2024-09-22T08:10:47.167620+0000","last_became_peered":"2024-09-22T08:10:47.167620+0000","last_unstale":"2024-09-22T08:13:53.372150+0000","last_undegraded":"2024-09-22T08:13:53.372150+0000","last_fullsized":"2024-09-22T08:13:53.372150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:35.145384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'70","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.905259+0000","last_change":"2024-09-22T08:10:49.185023+0000","last_active":"2024-09-22T08:13:59.905259+0000","last_peered":"2024-09-22T08:13:59.905259+0000","last_clean":"2024-09-22T08:13:59.905259+0000","last_became_active":"2024-09-22T08:10:49.184753+0000","last_became_peered":"2024-09-22T08:10:49.184753+0000","last_unstale":"2024-09-22T08:13:59.905259+0000","last_undegraded":"2024-09-22T08:13:59.905259+0000","last_fullsized":"2024-09-22T08:13:59.905259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:46.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206763+0000","last_change":"2024-09-22T08:10:51.197026+0000","last_active":"2024-09-22T08:11:23.206763+0000","last_peered":"2024-09-22T08:11:23.206763+0000","last_clean":"2024-09-22T08:11:23.206763+0000","last_became_active":"2024-09-22T08:10:51.196724+0000","last_became_peered":"2024-09-22T08:10:51.196724+0000","last_unstale":"2024-09-22T08:11:23.206763+0000","last_undegraded":"2024-09-22T08:11:23.206763+0000","last_fullsized":"2024-09-22T08:11:23.206763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:06.499640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.230225+0000","last_change":"2024-09-22T08:10:53.196686+0000","last_active":"2024-09-22T08:13:53.230225+0000","last_peered":"2024-09-22T08:13:53.230225+0000","last_clean":"2024-09-22T08:13:53.230225+0000","last_became_active":"2024-09-22T08:10:53.196406+0000","last_became_peered":"2024-09-22T08:10:53.196406+0000","last_unstale":"2024-09-22T08:13:53.230225+0000","last_undegraded":"2024-09-22T08:13:53.230225+0000","last_fullsized":"2024-09-22T08:13:53.230225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:42.892968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.830904+0000","last_change":"2024-09-22T08:14:18.830904+0000","last_active":"2024-09-22T08:14:18.830904+0000","last_peered":"2024-09-22T08:14:18.830904+0000","last_clean":"2024-09-22T08:14:18.830904+0000","last_became_active":"2024-09-22T08:10:45.176601+0000","last_became_peered":"2024-09-22T08:10:45.176601+0000","last_unstale":"2024-09-22T08:14:18.830904+0000","last_undegraded":"2024-09-22T08:14:18.830904+0000","last_fullsized":"2024-09-22T08:14:18.830904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:18.830805+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.830805+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.830805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:34.352591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.951005+0000","last_change":"2024-09-22T08:14:06.951005+0000","last_active":"2024-09-22T08:14:06.951005+0000","last_peered":"2024-09-22T08:14:06.951005+0000","last_clean":"2024-09-22T08:14:06.951005+0000","last_became_active":"2024-09-22T08:10:43.186758+0000","last_became_peered":"2024-09-22T08:10:43.186758+0000","last_unstale":"2024-09-22T08:14:06.951005+0000","last_undegraded":"2024-09-22T08:14:06.951005+0000","last_fullsized":"2024-09-22T08:14:06.951005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:06.950903+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:06.950903+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.950903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:00.975454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.240026+0000","last_change":"2024-09-22T08:14:08.240026+0000","last_active":"2024-09-22T08:14:08.240026+0000","last_peered":"2024-09-22T08:14:08.240026+0000","last_clean":"2024-09-22T08:14:08.240026+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:14:08.240026+0000","last_undegraded":"2024-09-22T08:14:08.240026+0000","last_fullsized":"2024-09-22T08:14:08.240026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.239939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.239939+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.239939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:30.468689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209307+0000","last_change":"2024-09-22T08:10:47.173748+0000","last_active":"2024-09-22T08:11:23.209307+0000","last_peered":"2024-09-22T08:11:23.209307+0000","last_clean":"2024-09-22T08:11:23.209307+0000","last_became_active":"2024-09-22T08:10:47.173348+0000","last_became_peered":"2024-09-22T08:10:47.173348+0000","last_unstale":"2024-09-22T08:11:23.209307+0000","last_undegraded":"2024-09-22T08:11:23.209307+0000","last_fullsized":"2024-09-22T08:11:23.209307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:18:06.081248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212964+0000","last_change":"2024-09-22T08:10:49.187453+0000","last_active":"2024-09-22T08:11:23.212964+0000","last_peered":"2024-09-22T08:11:23.212964+0000","last_clean":"2024-09-22T08:11:23.212964+0000","last_became_active":"2024-09-22T08:10:49.187184+0000","last_became_peered":"2024-09-22T08:10:49.187184+0000","last_unstale":"2024-09-22T08:11:23.212964+0000","last_undegraded":"2024-09-22T08:11:23.212964+0000","last_fullsized":"2024-09-22T08:11:23.212964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:19:08.593807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":373,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.792731+0000","last_change":"2024-09-22T08:10:51.197450+0000","last_active":"2024-09-22T08:13:59.792731+0000","last_peered":"2024-09-22T08:13:59.792731+0000","last_clean":"2024-09-22T08:13:59.792731+0000","last_became_active":"2024-09-22T08:10:51.197111+0000","last_became_peered":"2024-09-22T08:10:51.197111+0000","last_unstale":"2024-09-22T08:13:59.792731+0000","last_undegraded":"2024-09-22T08:13:59.792731+0000","last_fullsized":"2024-09-22T08:13:59.792731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212274+0000","last_change":"2024-09-22T08:10:53.200428+0000","last_active":"2024-09-22T08:11:23.212274+0000","last_peered":"2024-09-22T08:11:23.212274+0000","last_clean":"2024-09-22T08:11:23.212274+0000","last_became_active":"2024-09-22T08:10:53.199612+0000","last_became_peered":"2024-09-22T08:10:53.199612+0000","last_unstale":"2024-09-22T08:11:23.212274+0000","last_undegraded":"2024-09-22T08:11:23.212274+0000","last_fullsized":"2024-09-22T08:11:23.212274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:47.560464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.007599+0000","last_change":"2024-09-22T08:10:45.183951+0000","last_active":"2024-09-22T08:11:26.007599+0000","last_peered":"2024-09-22T08:11:26.007599+0000","last_clean":"2024-09-22T08:11:26.007599+0000","last_became_active":"2024-09-22T08:10:45.183229+0000","last_became_peered":"2024-09-22T08:10:45.183229+0000","last_unstale":"2024-09-22T08:11:26.007599+0000","last_undegraded":"2024-09-22T08:11:26.007599+0000","last_fullsized":"2024-09-22T08:11:26.007599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:39:03.361288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.315191+0000","last_change":"2024-09-22T08:14:10.315191+0000","last_active":"2024-09-22T08:14:10.315191+0000","last_peered":"2024-09-22T08:14:10.315191+0000","last_clean":"2024-09-22T08:14:10.315191+0000","last_became_active":"2024-09-22T08:10:43.198637+0000","last_became_peered":"2024-09-22T08:10:43.198637+0000","last_unstale":"2024-09-22T08:14:10.315191+0000","last_undegraded":"2024-09-22T08:14:10.315191+0000","last_fullsized":"2024-09-22T08:14:10.315191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:10.315107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:10.315107+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.315107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:31.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:02.966909+0000","last_change":"2024-09-22T08:14:02.966909+0000","last_active":"2024-09-22T08:14:02.966909+0000","last_peered":"2024-09-22T08:14:02.966909+0000","last_clean":"2024-09-22T08:14:02.966909+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:14:02.966909+0000","last_undegraded":"2024-09-22T08:14:02.966909+0000","last_fullsized":"2024-09-22T08:14:02.966909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:02.966839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:02.966839+0000","last_clean_scrub_stamp":"2024-09-22T08:14:02.966839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:08.371695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221460+0000","last_change":"2024-09-22T08:11:23.216945+0000","last_active":"2024-09-22T08:11:23.221460+0000","last_peered":"2024-09-22T08:11:23.221460+0000","last_clean":"2024-09-22T08:11:23.221460+0000","last_became_active":"2024-09-22T08:11:23.216676+0000","last_became_peered":"2024-09-22T08:11:23.216676+0000","last_unstale":"2024-09-22T08:11:23.221460+0000","last_undegraded":"2024-09-22T08:11:23.221460+0000","last_fullsized":"2024-09-22T08:11:23.221460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:46.451332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213139+0000","last_change":"2024-09-22T08:10:49.188685+0000","last_active":"2024-09-22T08:11:23.213139+0000","last_peered":"2024-09-22T08:11:23.213139+0000","last_clean":"2024-09-22T08:11:23.213139+0000","last_became_active":"2024-09-22T08:10:49.188309+0000","last_became_peered":"2024-09-22T08:10:49.188309+0000","last_unstale":"2024-09-22T08:11:23.213139+0000","last_undegraded":"2024-09-22T08:11:23.213139+0000","last_fullsized":"2024-09-22T08:11:23.213139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.497319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.797838+0000","last_change":"2024-09-22T08:10:51.193163+0000","last_active":"2024-09-22T08:13:59.797838+0000","last_peered":"2024-09-22T08:13:59.797838+0000","last_clean":"2024-09-22T08:13:59.797838+0000","last_became_active":"2024-09-22T08:10:51.192058+0000","last_became_peered":"2024-09-22T08:10:51.192058+0000","last_unstale":"2024-09-22T08:13:59.797838+0000","last_undegraded":"2024-09-22T08:13:59.797838+0000","last_fullsized":"2024-09-22T08:13:59.797838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213624+0000","last_change":"2024-09-22T08:10:53.203958+0000","last_active":"2024-09-22T08:11:23.213624+0000","last_peered":"2024-09-22T08:11:23.213624+0000","last_clean":"2024-09-22T08:11:23.213624+0000","last_became_active":"2024-09-22T08:10:53.203670+0000","last_became_peered":"2024-09-22T08:10:53.203670+0000","last_unstale":"2024-09-22T08:11:23.213624+0000","last_undegraded":"2024-09-22T08:11:23.213624+0000","last_fullsized":"2024-09-22T08:11:23.213624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:04.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'17","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.858415+0000","last_change":"2024-09-22T08:14:19.858415+0000","last_active":"2024-09-22T08:14:19.858415+0000","last_peered":"2024-09-22T08:14:19.858415+0000","last_clean":"2024-09-22T08:14:19.858415+0000","last_became_active":"2024-09-22T08:10:45.171667+0000","last_became_peered":"2024-09-22T08:10:45.171667+0000","last_unstale":"2024-09-22T08:14:19.858415+0000","last_undegraded":"2024-09-22T08:14:19.858415+0000","last_fullsized":"2024-09-22T08:14:19.858415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-22T08:14:19.858328+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-22T08:14:19.858328+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.858328+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:20.434578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.704581+0000","last_change":"2024-09-22T08:14:04.704581+0000","last_active":"2024-09-22T08:14:04.704581+0000","last_peered":"2024-09-22T08:14:04.704581+0000","last_clean":"2024-09-22T08:14:04.704581+0000","last_became_active":"2024-09-22T08:10:43.182161+0000","last_became_peered":"2024-09-22T08:10:43.182161+0000","last_unstale":"2024-09-22T08:14:04.704581+0000","last_undegraded":"2024-09-22T08:14:04.704581+0000","last_fullsized":"2024-09-22T08:14:04.704581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:04.704488+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:04.704488+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.704488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:26.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.215210+0000","last_change":"2024-09-22T08:14:07.215210+0000","last_active":"2024-09-22T08:14:07.215210+0000","last_peered":"2024-09-22T08:14:07.215210+0000","last_clean":"2024-09-22T08:14:07.215210+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:14:07.215210+0000","last_undegraded":"2024-09-22T08:14:07.215210+0000","last_fullsized":"2024-09-22T08:14:07.215210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:07.215094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:07.215094+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.215094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:24.079988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209442+0000","last_change":"2024-09-22T08:10:47.174132+0000","last_active":"2024-09-22T08:11:23.209442+0000","last_peered":"2024-09-22T08:11:23.209442+0000","last_clean":"2024-09-22T08:11:23.209442+0000","last_became_active":"2024-09-22T08:10:47.172441+0000","last_became_peered":"2024-09-22T08:10:47.172441+0000","last_unstale":"2024-09-22T08:11:23.209442+0000","last_undegraded":"2024-09-22T08:11:23.209442+0000","last_fullsized":"2024-09-22T08:11:23.209442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:47.078285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.942085+0000","last_change":"2024-09-22T08:10:49.185244+0000","last_active":"2024-09-22T08:13:59.942085+0000","last_peered":"2024-09-22T08:13:59.942085+0000","last_clean":"2024-09-22T08:13:59.942085+0000","last_became_active":"2024-09-22T08:10:49.184942+0000","last_became_peered":"2024-09-22T08:10:49.184942+0000","last_unstale":"2024-09-22T08:13:59.942085+0000","last_undegraded":"2024-09-22T08:13:59.942085+0000","last_fullsized":"2024-09-22T08:13:59.942085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:53.328309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220410+0000","last_change":"2024-09-22T08:10:51.195295+0000","last_active":"2024-09-22T08:11:23.220410+0000","last_peered":"2024-09-22T08:11:23.220410+0000","last_clean":"2024-09-22T08:11:23.220410+0000","last_became_active":"2024-09-22T08:10:51.194912+0000","last_became_peered":"2024-09-22T08:10:51.194912+0000","last_unstale":"2024-09-22T08:11:23.220410+0000","last_undegraded":"2024-09-22T08:11:23.220410+0000","last_fullsized":"2024-09-22T08:11:23.220410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:22.604330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208925+0000","last_change":"2024-09-22T08:10:53.192489+0000","last_active":"2024-09-22T08:11:23.208925+0000","last_peered":"2024-09-22T08:11:23.208925+0000","last_clean":"2024-09-22T08:11:23.208925+0000","last_became_active":"2024-09-22T08:10:53.192189+0000","last_became_peered":"2024-09-22T08:10:53.192189+0000","last_unstale":"2024-09-22T08:11:23.208925+0000","last_undegraded":"2024-09-22T08:11:23.208925+0000","last_fullsized":"2024-09-22T08:11:23.208925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:14.737752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208582+0000","last_change":"2024-09-22T08:10:53.198120+0000","last_active":"2024-09-22T08:11:23.208582+0000","last_peered":"2024-09-22T08:11:23.208582+0000","last_clean":"2024-09-22T08:11:23.208582+0000","last_became_active":"2024-09-22T08:10:53.197799+0000","last_became_peered":"2024-09-22T08:10:53.197799+0000","last_unstale":"2024-09-22T08:11:23.208582+0000","last_undegraded":"2024-09-22T08:11:23.208582+0000","last_fullsized":"2024-09-22T08:11:23.208582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:55.526373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.047862+0000","last_change":"2024-09-22T08:10:45.174189+0000","last_active":"2024-09-22T08:13:53.047862+0000","last_peered":"2024-09-22T08:13:53.047862+0000","last_clean":"2024-09-22T08:13:53.047862+0000","last_became_active":"2024-09-22T08:10:45.173916+0000","last_became_peered":"2024-09-22T08:10:45.173916+0000","last_unstale":"2024-09-22T08:13:53.047862+0000","last_undegraded":"2024-09-22T08:13:53.047862+0000","last_fullsized":"2024-09-22T08:13:53.047862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:27.673736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.225254+0000","last_change":"2024-09-22T08:14:18.225254+0000","last_active":"2024-09-22T08:14:18.225254+0000","last_peered":"2024-09-22T08:14:18.225254+0000","last_clean":"2024-09-22T08:14:18.225254+0000","last_became_active":"2024-09-22T08:10:43.201007+0000","last_became_peered":"2024-09-22T08:10:43.201007+0000","last_unstale":"2024-09-22T08:14:18.225254+0000","last_undegraded":"2024-09-22T08:14:18.225254+0000","last_fullsized":"2024-09-22T08:14:18.225254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:18.225171+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.225171+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.225171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:48.896171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212648+0000","last_change":"2024-09-22T08:10:47.176086+0000","last_active":"2024-09-22T08:11:23.212648+0000","last_peered":"2024-09-22T08:11:23.212648+0000","last_clean":"2024-09-22T08:11:23.212648+0000","last_became_active":"2024-09-22T08:10:47.175524+0000","last_became_peered":"2024-09-22T08:10:47.175524+0000","last_unstale":"2024-09-22T08:11:23.212648+0000","last_undegraded":"2024-09-22T08:11:23.212648+0000","last_fullsized":"2024-09-22T08:11:23.212648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:13.592432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.873004+0000","last_change":"2024-09-22T08:10:49.186252+0000","last_active":"2024-09-22T08:13:59.873004+0000","last_peered":"2024-09-22T08:13:59.873004+0000","last_clean":"2024-09-22T08:13:59.873004+0000","last_became_active":"2024-09-22T08:10:49.185693+0000","last_became_peered":"2024-09-22T08:10:49.185693+0000","last_unstale":"2024-09-22T08:13:59.873004+0000","last_undegraded":"2024-09-22T08:13:59.873004+0000","last_fullsized":"2024-09-22T08:13:59.873004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:02.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213000+0000","last_change":"2024-09-22T08:10:51.200112+0000","last_active":"2024-09-22T08:11:23.213000+0000","last_peered":"2024-09-22T08:11:23.213000+0000","last_clean":"2024-09-22T08:11:23.213000+0000","last_became_active":"2024-09-22T08:10:51.199799+0000","last_became_peered":"2024-09-22T08:10:51.199799+0000","last_unstale":"2024-09-22T08:11:23.213000+0000","last_undegraded":"2024-09-22T08:11:23.213000+0000","last_fullsized":"2024-09-22T08:11:23.213000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:06.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'13","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.308456+0000","last_change":"2024-09-22T08:10:53.201508+0000","last_active":"2024-09-22T08:13:53.308456+0000","last_peered":"2024-09-22T08:13:53.308456+0000","last_clean":"2024-09-22T08:13:53.308456+0000","last_became_active":"2024-09-22T08:10:53.201209+0000","last_became_peered":"2024-09-22T08:10:53.201209+0000","last_unstale":"2024-09-22T08:13:53.308456+0000","last_undegraded":"2024-09-22T08:13:53.308456+0000","last_fullsized":"2024-09-22T08:13:53.308456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:20.642196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":69,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183415+0000","last_change":"2024-09-22T08:10:45.182432+0000","last_active":"2024-09-22T08:13:53.183415+0000","last_peered":"2024-09-22T08:13:53.183415+0000","last_clean":"2024-09-22T08:13:53.183415+0000","last_became_active":"2024-09-22T08:10:45.182245+0000","last_became_peered":"2024-09-22T08:10:45.182245+0000","last_unstale":"2024-09-22T08:13:53.183415+0000","last_undegraded":"2024-09-22T08:13:53.183415+0000","last_fullsized":"2024-09-22T08:13:53.183415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:33.105535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.706396+0000","last_change":"2024-09-22T08:14:10.706396+0000","last_active":"2024-09-22T08:14:10.706396+0000","last_peered":"2024-09-22T08:14:10.706396+0000","last_clean":"2024-09-22T08:14:10.706396+0000","last_became_active":"2024-09-22T08:10:43.185230+0000","last_became_peered":"2024-09-22T08:10:43.185230+0000","last_unstale":"2024-09-22T08:14:10.706396+0000","last_undegraded":"2024-09-22T08:14:10.706396+0000","last_fullsized":"2024-09-22T08:14:10.706396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:10.706291+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:10.706291+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.706291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:16.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209614+0000","last_change":"2024-09-22T08:10:47.176256+0000","last_active":"2024-09-22T08:11:23.209614+0000","last_peered":"2024-09-22T08:11:23.209614+0000","last_clean":"2024-09-22T08:11:23.209614+0000","last_became_active":"2024-09-22T08:10:47.175747+0000","last_became_peered":"2024-09-22T08:10:47.175747+0000","last_unstale":"2024-09-22T08:11:23.209614+0000","last_undegraded":"2024-09-22T08:11:23.209614+0000","last_fullsized":"2024-09-22T08:11:23.209614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:17.217421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.591034+0000","last_change":"2024-09-22T08:10:49.181276+0000","last_active":"2024-09-22T08:13:52.591034+0000","last_peered":"2024-09-22T08:13:52.591034+0000","last_clean":"2024-09-22T08:13:52.591034+0000","last_became_active":"2024-09-22T08:10:49.180921+0000","last_became_peered":"2024-09-22T08:10:49.180921+0000","last_unstale":"2024-09-22T08:13:52.591034+0000","last_undegraded":"2024-09-22T08:13:52.591034+0000","last_fullsized":"2024-09-22T08:13:52.591034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:10.724160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207132+0000","last_change":"2024-09-22T08:10:51.193254+0000","last_active":"2024-09-22T08:11:23.207132+0000","last_peered":"2024-09-22T08:11:23.207132+0000","last_clean":"2024-09-22T08:11:23.207132+0000","last_became_active":"2024-09-22T08:10:51.192989+0000","last_became_peered":"2024-09-22T08:10:51.192989+0000","last_unstale":"2024-09-22T08:11:23.207132+0000","last_undegraded":"2024-09-22T08:11:23.207132+0000","last_fullsized":"2024-09-22T08:11:23.207132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:29.015464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.008653+0000","last_change":"2024-09-22T08:10:53.193317+0000","last_active":"2024-09-22T08:12:09.008653+0000","last_peered":"2024-09-22T08:12:09.008653+0000","last_clean":"2024-09-22T08:12:09.008653+0000","last_became_active":"2024-09-22T08:10:53.192967+0000","last_became_peered":"2024-09-22T08:10:53.192967+0000","last_unstale":"2024-09-22T08:12:09.008653+0000","last_undegraded":"2024-09-22T08:12:09.008653+0000","last_fullsized":"2024-09-22T08:12:09.008653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:48.815518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.468115+0000","last_change":"2024-09-22T08:10:45.172599+0000","last_active":"2024-09-22T08:12:49.468115+0000","last_peered":"2024-09-22T08:12:49.468115+0000","last_clean":"2024-09-22T08:12:49.468115+0000","last_became_active":"2024-09-22T08:10:45.171555+0000","last_became_peered":"2024-09-22T08:10:45.171555+0000","last_unstale":"2024-09-22T08:12:49.468115+0000","last_undegraded":"2024-09-22T08:12:49.468115+0000","last_fullsized":"2024-09-22T08:12:49.468115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:27.811575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.741592+0000","last_change":"2024-09-22T08:14:09.741592+0000","last_active":"2024-09-22T08:14:09.741592+0000","last_peered":"2024-09-22T08:14:09.741592+0000","last_clean":"2024-09-22T08:14:09.741592+0000","last_became_active":"2024-09-22T08:10:43.187044+0000","last_became_peered":"2024-09-22T08:10:43.187044+0000","last_unstale":"2024-09-22T08:14:09.741592+0000","last_undegraded":"2024-09-22T08:14:09.741592+0000","last_fullsized":"2024-09-22T08:14:09.741592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:09.741505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:09.741505+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.741505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:51.031430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"34'4","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.766619+0000","last_change":"2024-09-22T08:10:47.178036+0000","last_active":"2024-09-22T08:13:59.766619+0000","last_peered":"2024-09-22T08:13:59.766619+0000","last_clean":"2024-09-22T08:13:59.766619+0000","last_became_active":"2024-09-22T08:10:47.177735+0000","last_became_peered":"2024-09-22T08:10:47.177735+0000","last_unstale":"2024-09-22T08:13:59.766619+0000","last_undegraded":"2024-09-22T08:13:59.766619+0000","last_fullsized":"2024-09-22T08:13:59.766619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:05.249659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.839465+0000","last_change":"2024-09-22T08:10:49.182878+0000","last_active":"2024-09-22T08:13:59.839465+0000","last_peered":"2024-09-22T08:13:59.839465+0000","last_clean":"2024-09-22T08:13:59.839465+0000","last_became_active":"2024-09-22T08:10:49.182557+0000","last_became_peered":"2024-09-22T08:10:49.182557+0000","last_unstale":"2024-09-22T08:13:59.839465+0000","last_undegraded":"2024-09-22T08:13:59.839465+0000","last_fullsized":"2024-09-22T08:13:59.839465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:37.230381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212363+0000","last_change":"2024-09-22T08:10:51.198536+0000","last_active":"2024-09-22T08:11:23.212363+0000","last_peered":"2024-09-22T08:11:23.212363+0000","last_clean":"2024-09-22T08:11:23.212363+0000","last_became_active":"2024-09-22T08:10:51.198204+0000","last_became_peered":"2024-09-22T08:10:51.198204+0000","last_unstale":"2024-09-22T08:11:23.212363+0000","last_undegraded":"2024-09-22T08:11:23.212363+0000","last_fullsized":"2024-09-22T08:11:23.212363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.041147+0000","last_change":"2024-09-22T08:10:53.200288+0000","last_active":"2024-09-22T08:11:27.041147+0000","last_peered":"2024-09-22T08:11:27.041147+0000","last_clean":"2024-09-22T08:11:27.041147+0000","last_became_active":"2024-09-22T08:10:53.199827+0000","last_became_peered":"2024-09-22T08:10:53.199827+0000","last_unstale":"2024-09-22T08:11:27.041147+0000","last_undegraded":"2024-09-22T08:11:27.041147+0000","last_fullsized":"2024-09-22T08:11:27.041147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:31.568753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209916+0000","last_change":"2024-09-22T08:10:45.184232+0000","last_active":"2024-09-22T08:11:23.209916+0000","last_peered":"2024-09-22T08:11:23.209916+0000","last_clean":"2024-09-22T08:11:23.209916+0000","last_became_active":"2024-09-22T08:10:45.183674+0000","last_became_peered":"2024-09-22T08:10:45.183674+0000","last_unstale":"2024-09-22T08:11:23.209916+0000","last_undegraded":"2024-09-22T08:11:23.209916+0000","last_fullsized":"2024-09-22T08:11:23.209916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:11.585440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.769770+0000","last_change":"2024-09-22T08:14:06.769770+0000","last_active":"2024-09-22T08:14:06.769770+0000","last_peered":"2024-09-22T08:14:06.769770+0000","last_clean":"2024-09-22T08:14:06.769770+0000","last_became_active":"2024-09-22T08:10:43.184287+0000","last_became_peered":"2024-09-22T08:10:43.184287+0000","last_unstale":"2024-09-22T08:14:06.769770+0000","last_undegraded":"2024-09-22T08:14:06.769770+0000","last_fullsized":"2024-09-22T08:14:06.769770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:06.769651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:06.769651+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.769651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:24.233361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209665+0000","last_change":"2024-09-22T08:10:47.173065+0000","last_active":"2024-09-22T08:11:23.209665+0000","last_peered":"2024-09-22T08:11:23.209665+0000","last_clean":"2024-09-22T08:11:23.209665+0000","last_became_active":"2024-09-22T08:10:47.172816+0000","last_became_peered":"2024-09-22T08:10:47.172816+0000","last_unstale":"2024-09-22T08:11:23.209665+0000","last_undegraded":"2024-09-22T08:11:23.209665+0000","last_fullsized":"2024-09-22T08:11:23.209665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:42.365873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.936199+0000","last_change":"2024-09-22T08:10:49.180939+0000","last_active":"2024-09-22T08:13:59.936199+0000","last_peered":"2024-09-22T08:13:59.936199+0000","last_clean":"2024-09-22T08:13:59.936199+0000","last_became_active":"2024-09-22T08:10:49.180621+0000","last_became_peered":"2024-09-22T08:10:49.180621+0000","last_unstale":"2024-09-22T08:13:59.936199+0000","last_undegraded":"2024-09-22T08:13:59.936199+0000","last_fullsized":"2024-09-22T08:13:59.936199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:10.845059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206973+0000","last_change":"2024-09-22T08:10:51.190255+0000","last_active":"2024-09-22T08:11:23.206973+0000","last_peered":"2024-09-22T08:11:23.206973+0000","last_clean":"2024-09-22T08:11:23.206973+0000","last_became_active":"2024-09-22T08:10:51.189640+0000","last_became_peered":"2024-09-22T08:10:51.189640+0000","last_unstale":"2024-09-22T08:11:23.206973+0000","last_undegraded":"2024-09-22T08:11:23.206973+0000","last_fullsized":"2024-09-22T08:11:23.206973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:01.319577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228734+0000","last_change":"2024-09-22T08:10:45.166911+0000","last_active":"2024-09-22T08:13:53.228734+0000","last_peered":"2024-09-22T08:13:53.228734+0000","last_clean":"2024-09-22T08:13:53.228734+0000","last_became_active":"2024-09-22T08:10:45.166591+0000","last_became_peered":"2024-09-22T08:10:45.166591+0000","last_unstale":"2024-09-22T08:13:53.228734+0000","last_undegraded":"2024-09-22T08:13:53.228734+0000","last_fullsized":"2024-09-22T08:13:53.228734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:01.404622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.239338+0000","last_change":"2024-09-22T08:14:19.239338+0000","last_active":"2024-09-22T08:14:19.239338+0000","last_peered":"2024-09-22T08:14:19.239338+0000","last_clean":"2024-09-22T08:14:19.239338+0000","last_became_active":"2024-09-22T08:10:43.195608+0000","last_became_peered":"2024-09-22T08:10:43.195608+0000","last_unstale":"2024-09-22T08:14:19.239338+0000","last_undegraded":"2024-09-22T08:14:19.239338+0000","last_fullsized":"2024-09-22T08:14:19.239338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:19.239245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:19.239245+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.239245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.221139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222765+0000","last_change":"2024-09-22T08:10:47.173698+0000","last_active":"2024-09-22T08:11:23.222765+0000","last_peered":"2024-09-22T08:11:23.222765+0000","last_clean":"2024-09-22T08:11:23.222765+0000","last_became_active":"2024-09-22T08:10:47.173043+0000","last_became_peered":"2024-09-22T08:10:47.173043+0000","last_unstale":"2024-09-22T08:11:23.222765+0000","last_undegraded":"2024-09-22T08:11:23.222765+0000","last_fullsized":"2024-09-22T08:11:23.222765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:50.368872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.933167+0000","last_change":"2024-09-22T08:10:49.181954+0000","last_active":"2024-09-22T08:13:59.933167+0000","last_peered":"2024-09-22T08:13:59.933167+0000","last_clean":"2024-09-22T08:13:59.933167+0000","last_became_active":"2024-09-22T08:10:49.181611+0000","last_became_peered":"2024-09-22T08:10:49.181611+0000","last_unstale":"2024-09-22T08:13:59.933167+0000","last_undegraded":"2024-09-22T08:13:59.933167+0000","last_fullsized":"2024-09-22T08:13:59.933167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:12.944824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207395+0000","last_change":"2024-09-22T08:10:51.190156+0000","last_active":"2024-09-22T08:11:23.207395+0000","last_peered":"2024-09-22T08:11:23.207395+0000","last_clean":"2024-09-22T08:11:23.207395+0000","last_became_active":"2024-09-22T08:10:51.189592+0000","last_became_peered":"2024-09-22T08:10:51.189592+0000","last_unstale":"2024-09-22T08:11:23.207395+0000","last_undegraded":"2024-09-22T08:11:23.207395+0000","last_fullsized":"2024-09-22T08:11:23.207395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:44.042635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.513524+0000","last_change":"2024-09-22T08:10:53.199349+0000","last_active":"2024-09-22T08:12:52.513524+0000","last_peered":"2024-09-22T08:12:52.513524+0000","last_clean":"2024-09-22T08:12:52.513524+0000","last_became_active":"2024-09-22T08:10:53.198999+0000","last_became_peered":"2024-09-22T08:10:53.198999+0000","last_unstale":"2024-09-22T08:12:52.513524+0000","last_undegraded":"2024-09-22T08:12:52.513524+0000","last_fullsized":"2024-09-22T08:12:52.513524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:40.998103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'22","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183552+0000","last_change":"2024-09-22T08:10:45.183697+0000","last_active":"2024-09-22T08:13:53.183552+0000","last_peered":"2024-09-22T08:13:53.183552+0000","last_clean":"2024-09-22T08:13:53.183552+0000","last_became_active":"2024-09-22T08:10:45.183173+0000","last_became_peered":"2024-09-22T08:10:45.183173+0000","last_unstale":"2024-09-22T08:13:53.183552+0000","last_undegraded":"2024-09-22T08:13:53.183552+0000","last_fullsized":"2024-09-22T08:13:53.183552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:20.651086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.818995+0000","last_change":"2024-09-22T08:14:07.818995+0000","last_active":"2024-09-22T08:14:07.818995+0000","last_peered":"2024-09-22T08:14:07.818995+0000","last_clean":"2024-09-22T08:14:07.818995+0000","last_became_active":"2024-09-22T08:10:43.177711+0000","last_became_peered":"2024-09-22T08:10:43.177711+0000","last_unstale":"2024-09-22T08:14:07.818995+0000","last_undegraded":"2024-09-22T08:14:07.818995+0000","last_fullsized":"2024-09-22T08:14:07.818995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:07.818910+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:07.818910+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.818910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:11.966919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210165+0000","last_change":"2024-09-22T08:10:47.172301+0000","last_active":"2024-09-22T08:11:23.210165+0000","last_peered":"2024-09-22T08:11:23.210165+0000","last_clean":"2024-09-22T08:11:23.210165+0000","last_became_active":"2024-09-22T08:10:47.171702+0000","last_became_peered":"2024-09-22T08:10:47.171702+0000","last_unstale":"2024-09-22T08:11:23.210165+0000","last_undegraded":"2024-09-22T08:11:23.210165+0000","last_fullsized":"2024-09-22T08:11:23.210165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.251018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.939363+0000","last_change":"2024-09-22T08:10:49.183268+0000","last_active":"2024-09-22T08:13:59.939363+0000","last_peered":"2024-09-22T08:13:59.939363+0000","last_clean":"2024-09-22T08:13:59.939363+0000","last_became_active":"2024-09-22T08:10:49.182398+0000","last_became_peered":"2024-09-22T08:10:49.182398+0000","last_unstale":"2024-09-22T08:13:59.939363+0000","last_undegraded":"2024-09-22T08:13:59.939363+0000","last_fullsized":"2024-09-22T08:13:59.939363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:20.960730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214581+0000","last_change":"2024-09-22T08:10:51.202949+0000","last_active":"2024-09-22T08:11:23.214581+0000","last_peered":"2024-09-22T08:11:23.214581+0000","last_clean":"2024-09-22T08:11:23.214581+0000","last_became_active":"2024-09-22T08:10:51.202485+0000","last_became_peered":"2024-09-22T08:10:51.202485+0000","last_unstale":"2024-09-22T08:11:23.214581+0000","last_undegraded":"2024-09-22T08:11:23.214581+0000","last_fullsized":"2024-09-22T08:11:23.214581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.969767+0000","last_change":"2024-09-22T08:10:53.202374+0000","last_active":"2024-09-22T08:13:52.969767+0000","last_peered":"2024-09-22T08:13:52.969767+0000","last_clean":"2024-09-22T08:13:52.969767+0000","last_became_active":"2024-09-22T08:10:53.201942+0000","last_became_peered":"2024-09-22T08:10:53.201942+0000","last_unstale":"2024-09-22T08:13:52.969767+0000","last_undegraded":"2024-09-22T08:13:52.969767+0000","last_fullsized":"2024-09-22T08:13:52.969767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:00.185249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.345446+0000","last_change":"2024-09-22T08:10:45.183871+0000","last_active":"2024-09-22T08:11:26.345446+0000","last_peered":"2024-09-22T08:11:26.345446+0000","last_clean":"2024-09-22T08:11:26.345446+0000","last_became_active":"2024-09-22T08:10:45.183576+0000","last_became_peered":"2024-09-22T08:10:45.183576+0000","last_unstale":"2024-09-22T08:11:26.345446+0000","last_undegraded":"2024-09-22T08:11:26.345446+0000","last_fullsized":"2024-09-22T08:11:26.345446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:25:50.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.778888+0000","last_change":"2024-09-22T08:14:08.778888+0000","last_active":"2024-09-22T08:14:08.778888+0000","last_peered":"2024-09-22T08:14:08.778888+0000","last_clean":"2024-09-22T08:14:08.778888+0000","last_became_active":"2024-09-22T08:10:43.178403+0000","last_became_peered":"2024-09-22T08:10:43.178403+0000","last_unstale":"2024-09-22T08:14:08.778888+0000","last_undegraded":"2024-09-22T08:14:08.778888+0000","last_fullsized":"2024-09-22T08:14:08.778888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.778788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.778788+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.778788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:11.516811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208266+0000","last_change":"2024-09-22T08:10:47.172371+0000","last_active":"2024-09-22T08:11:23.208266+0000","last_peered":"2024-09-22T08:11:23.208266+0000","last_clean":"2024-09-22T08:11:23.208266+0000","last_became_active":"2024-09-22T08:10:47.171973+0000","last_became_peered":"2024-09-22T08:10:47.171973+0000","last_unstale":"2024-09-22T08:11:23.208266+0000","last_undegraded":"2024-09-22T08:11:23.208266+0000","last_fullsized":"2024-09-22T08:11:23.208266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:41.035575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.884926+0000","last_change":"2024-09-22T08:10:49.185261+0000","last_active":"2024-09-22T08:13:59.884926+0000","last_peered":"2024-09-22T08:13:59.884926+0000","last_clean":"2024-09-22T08:13:59.884926+0000","last_became_active":"2024-09-22T08:10:49.184885+0000","last_became_peered":"2024-09-22T08:10:49.184885+0000","last_unstale":"2024-09-22T08:13:59.884926+0000","last_undegraded":"2024-09-22T08:13:59.884926+0000","last_fullsized":"2024-09-22T08:13:59.884926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:29.150336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222373+0000","last_change":"2024-09-22T08:10:51.194317+0000","last_active":"2024-09-22T08:11:23.222373+0000","last_peered":"2024-09-22T08:11:23.222373+0000","last_clean":"2024-09-22T08:11:23.222373+0000","last_became_active":"2024-09-22T08:10:51.193970+0000","last_became_peered":"2024-09-22T08:10:51.193970+0000","last_unstale":"2024-09-22T08:11:23.222373+0000","last_undegraded":"2024-09-22T08:11:23.222373+0000","last_fullsized":"2024-09-22T08:11:23.222373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:52.931798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.572122+0000","last_change":"2024-09-22T08:10:53.202778+0000","last_active":"2024-09-22T08:12:52.572122+0000","last_peered":"2024-09-22T08:12:52.572122+0000","last_clean":"2024-09-22T08:12:52.572122+0000","last_became_active":"2024-09-22T08:10:53.202493+0000","last_became_peered":"2024-09-22T08:10:53.202493+0000","last_unstale":"2024-09-22T08:12:52.572122+0000","last_undegraded":"2024-09-22T08:12:52.572122+0000","last_fullsized":"2024-09-22T08:12:52.572122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:44.822421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828530+0000","last_change":"2024-09-22T08:10:45.167131+0000","last_active":"2024-09-22T08:12:08.828530+0000","last_peered":"2024-09-22T08:12:08.828530+0000","last_clean":"2024-09-22T08:12:08.828530+0000","last_became_active":"2024-09-22T08:10:45.166540+0000","last_became_peered":"2024-09-22T08:10:45.166540+0000","last_unstale":"2024-09-22T08:12:08.828530+0000","last_undegraded":"2024-09-22T08:12:08.828530+0000","last_fullsized":"2024-09-22T08:12:08.828530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:12:51.203215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.228380+0000","last_change":"2024-09-22T08:14:20.228380+0000","last_active":"2024-09-22T08:14:20.228380+0000","last_peered":"2024-09-22T08:14:20.228380+0000","last_clean":"2024-09-22T08:14:20.228380+0000","last_became_active":"2024-09-22T08:10:43.199724+0000","last_became_peered":"2024-09-22T08:10:43.199724+0000","last_unstale":"2024-09-22T08:14:20.228380+0000","last_undegraded":"2024-09-22T08:14:20.228380+0000","last_fullsized":"2024-09-22T08:14:20.228380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:20.228266+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:20.228266+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.228266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:39.492150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214717+0000","last_change":"2024-09-22T08:10:47.175833+0000","last_active":"2024-09-22T08:11:23.214717+0000","last_peered":"2024-09-22T08:11:23.214717+0000","last_clean":"2024-09-22T08:11:23.214717+0000","last_became_active":"2024-09-22T08:10:47.175541+0000","last_became_peered":"2024-09-22T08:10:47.175541+0000","last_unstale":"2024-09-22T08:11:23.214717+0000","last_undegraded":"2024-09-22T08:11:23.214717+0000","last_fullsized":"2024-09-22T08:11:23.214717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:17.796324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584978+0000","last_change":"2024-09-22T08:10:49.188295+0000","last_active":"2024-09-22T08:12:52.584978+0000","last_peered":"2024-09-22T08:12:52.584978+0000","last_clean":"2024-09-22T08:12:52.584978+0000","last_became_active":"2024-09-22T08:10:49.187767+0000","last_became_peered":"2024-09-22T08:10:49.187767+0000","last_unstale":"2024-09-22T08:12:52.584978+0000","last_undegraded":"2024-09-22T08:12:52.584978+0000","last_fullsized":"2024-09-22T08:12:52.584978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:02.055272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":370,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.791305+0000","last_change":"2024-09-22T08:10:51.198099+0000","last_active":"2024-09-22T08:13:59.791305+0000","last_peered":"2024-09-22T08:13:59.791305+0000","last_clean":"2024-09-22T08:13:59.791305+0000","last_became_active":"2024-09-22T08:10:51.197814+0000","last_became_peered":"2024-09-22T08:10:51.197814+0000","last_unstale":"2024-09-22T08:13:59.791305+0000","last_undegraded":"2024-09-22T08:13:59.791305+0000","last_fullsized":"2024-09-22T08:13:59.791305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.509973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209032+0000","last_change":"2024-09-22T08:10:53.200170+0000","last_active":"2024-09-22T08:11:23.209032+0000","last_peered":"2024-09-22T08:11:23.209032+0000","last_clean":"2024-09-22T08:11:23.209032+0000","last_became_active":"2024-09-22T08:10:53.199881+0000","last_became_peered":"2024-09-22T08:10:53.199881+0000","last_unstale":"2024-09-22T08:11:23.209032+0000","last_undegraded":"2024-09-22T08:11:23.209032+0000","last_fullsized":"2024-09-22T08:11:23.209032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:46.946049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208021+0000","last_change":"2024-09-22T08:10:45.166388+0000","last_active":"2024-09-22T08:11:23.208021+0000","last_peered":"2024-09-22T08:11:23.208021+0000","last_clean":"2024-09-22T08:11:23.208021+0000","last_became_active":"2024-09-22T08:10:45.166103+0000","last_became_peered":"2024-09-22T08:10:45.166103+0000","last_unstale":"2024-09-22T08:11:23.208021+0000","last_undegraded":"2024-09-22T08:11:23.208021+0000","last_fullsized":"2024-09-22T08:11:23.208021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:07.647439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.769326+0000","last_change":"2024-09-22T08:14:10.769326+0000","last_active":"2024-09-22T08:14:10.769326+0000","last_peered":"2024-09-22T08:14:10.769326+0000","last_clean":"2024-09-22T08:14:10.769326+0000","last_became_active":"2024-09-22T08:10:43.180097+0000","last_became_peered":"2024-09-22T08:10:43.180097+0000","last_unstale":"2024-09-22T08:14:10.769326+0000","last_undegraded":"2024-09-22T08:14:10.769326+0000","last_fullsized":"2024-09-22T08:14:10.769326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:10.769243+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:10.769243+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.769243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:28.728155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212558+0000","last_change":"2024-09-22T08:10:47.175982+0000","last_active":"2024-09-22T08:11:23.212558+0000","last_peered":"2024-09-22T08:11:23.212558+0000","last_clean":"2024-09-22T08:11:23.212558+0000","last_became_active":"2024-09-22T08:10:47.175604+0000","last_became_peered":"2024-09-22T08:10:47.175604+0000","last_unstale":"2024-09-22T08:11:23.212558+0000","last_undegraded":"2024-09-22T08:11:23.212558+0000","last_fullsized":"2024-09-22T08:11:23.212558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:15.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.911039+0000","last_change":"2024-09-22T08:10:49.176102+0000","last_active":"2024-09-22T08:13:59.911039+0000","last_peered":"2024-09-22T08:13:59.911039+0000","last_clean":"2024-09-22T08:13:59.911039+0000","last_became_active":"2024-09-22T08:10:49.175817+0000","last_became_peered":"2024-09-22T08:10:49.175817+0000","last_unstale":"2024-09-22T08:13:59.911039+0000","last_undegraded":"2024-09-22T08:13:59.911039+0000","last_fullsized":"2024-09-22T08:13:59.911039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:19.626204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.219931+0000","last_change":"2024-09-22T08:10:51.192395+0000","last_active":"2024-09-22T08:11:23.219931+0000","last_peered":"2024-09-22T08:11:23.219931+0000","last_clean":"2024-09-22T08:11:23.219931+0000","last_became_active":"2024-09-22T08:10:51.191988+0000","last_became_peered":"2024-09-22T08:10:51.191988+0000","last_unstale":"2024-09-22T08:11:23.219931+0000","last_undegraded":"2024-09-22T08:11:23.219931+0000","last_fullsized":"2024-09-22T08:11:23.219931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216778+0000","last_change":"2024-09-22T08:10:53.199421+0000","last_active":"2024-09-22T08:11:23.216778+0000","last_peered":"2024-09-22T08:11:23.216778+0000","last_clean":"2024-09-22T08:11:23.216778+0000","last_became_active":"2024-09-22T08:10:53.199158+0000","last_became_peered":"2024-09-22T08:10:53.199158+0000","last_unstale":"2024-09-22T08:11:23.216778+0000","last_undegraded":"2024-09-22T08:11:23.216778+0000","last_fullsized":"2024-09-22T08:11:23.216778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:32.896582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.005197+0000","last_change":"2024-09-22T08:10:45.165605+0000","last_active":"2024-09-22T08:11:26.005197+0000","last_peered":"2024-09-22T08:11:26.005197+0000","last_clean":"2024-09-22T08:11:26.005197+0000","last_became_active":"2024-09-22T08:10:45.165116+0000","last_became_peered":"2024-09-22T08:10:45.165116+0000","last_unstale":"2024-09-22T08:11:26.005197+0000","last_undegraded":"2024-09-22T08:11:26.005197+0000","last_fullsized":"2024-09-22T08:11:26.005197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:29.645770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.266509+0000","last_change":"2024-09-22T08:14:21.266509+0000","last_active":"2024-09-22T08:14:21.266509+0000","last_peered":"2024-09-22T08:14:21.266509+0000","last_clean":"2024-09-22T08:14:21.266509+0000","last_became_active":"2024-09-22T08:10:43.201076+0000","last_became_peered":"2024-09-22T08:10:43.201076+0000","last_unstale":"2024-09-22T08:14:21.266509+0000","last_undegraded":"2024-09-22T08:14:21.266509+0000","last_fullsized":"2024-09-22T08:14:21.266509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:21.266407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:21.266407+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.266407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:15.619690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208142+0000","last_change":"2024-09-22T08:10:47.173239+0000","last_active":"2024-09-22T08:11:23.208142+0000","last_peered":"2024-09-22T08:11:23.208142+0000","last_clean":"2024-09-22T08:11:23.208142+0000","last_became_active":"2024-09-22T08:10:47.172988+0000","last_became_peered":"2024-09-22T08:10:47.172988+0000","last_unstale":"2024-09-22T08:11:23.208142+0000","last_undegraded":"2024-09-22T08:11:23.208142+0000","last_fullsized":"2024-09-22T08:11:23.208142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:57.256991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.914196+0000","last_change":"2024-09-22T08:10:49.185163+0000","last_active":"2024-09-22T08:13:59.914196+0000","last_peered":"2024-09-22T08:13:59.914196+0000","last_clean":"2024-09-22T08:13:59.914196+0000","last_became_active":"2024-09-22T08:10:49.184860+0000","last_became_peered":"2024-09-22T08:10:49.184860+0000","last_unstale":"2024-09-22T08:13:59.914196+0000","last_undegraded":"2024-09-22T08:13:59.914196+0000","last_fullsized":"2024-09-22T08:13:59.914196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.255387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209254+0000","last_change":"2024-09-22T08:10:51.200556+0000","last_active":"2024-09-22T08:11:23.209254+0000","last_peered":"2024-09-22T08:11:23.209254+0000","last_clean":"2024-09-22T08:11:23.209254+0000","last_became_active":"2024-09-22T08:10:51.199870+0000","last_became_peered":"2024-09-22T08:10:51.199870+0000","last_unstale":"2024-09-22T08:11:23.209254+0000","last_undegraded":"2024-09-22T08:11:23.209254+0000","last_fullsized":"2024-09-22T08:11:23.209254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.684662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212091+0000","last_change":"2024-09-22T08:10:53.201219+0000","last_active":"2024-09-22T08:11:23.212091+0000","last_peered":"2024-09-22T08:11:23.212091+0000","last_clean":"2024-09-22T08:11:23.212091+0000","last_became_active":"2024-09-22T08:10:53.200904+0000","last_became_peered":"2024-09-22T08:10:53.200904+0000","last_unstale":"2024-09-22T08:11:23.212091+0000","last_undegraded":"2024-09-22T08:11:23.212091+0000","last_fullsized":"2024-09-22T08:11:23.212091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:58.296182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'9","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.588330+0000","last_change":"2024-09-22T08:10:45.165741+0000","last_active":"2024-09-22T08:13:12.588330+0000","last_peered":"2024-09-22T08:13:12.588330+0000","last_clean":"2024-09-22T08:13:12.588330+0000","last_became_active":"2024-09-22T08:10:45.165511+0000","last_became_peered":"2024-09-22T08:10:45.165511+0000","last_unstale":"2024-09-22T08:13:12.588330+0000","last_undegraded":"2024-09-22T08:13:12.588330+0000","last_fullsized":"2024-09-22T08:13:12.588330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:15.789333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.982672+0000","last_change":"2024-09-22T08:14:05.982672+0000","last_active":"2024-09-22T08:14:05.982672+0000","last_peered":"2024-09-22T08:14:05.982672+0000","last_clean":"2024-09-22T08:14:05.982672+0000","last_became_active":"2024-09-22T08:10:43.176954+0000","last_became_peered":"2024-09-22T08:10:43.176954+0000","last_unstale":"2024-09-22T08:14:05.982672+0000","last_undegraded":"2024-09-22T08:14:05.982672+0000","last_fullsized":"2024-09-22T08:14:05.982672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.982575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.982575+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.982575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:15.153255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210491+0000","last_change":"2024-09-22T08:10:47.176984+0000","last_active":"2024-09-22T08:11:23.210491+0000","last_peered":"2024-09-22T08:11:23.210491+0000","last_clean":"2024-09-22T08:11:23.210491+0000","last_became_active":"2024-09-22T08:10:47.176641+0000","last_became_peered":"2024-09-22T08:10:47.176641+0000","last_unstale":"2024-09-22T08:11:23.210491+0000","last_undegraded":"2024-09-22T08:11:23.210491+0000","last_fullsized":"2024-09-22T08:11:23.210491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:49.329521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.878567+0000","last_change":"2024-09-22T08:10:49.188256+0000","last_active":"2024-09-22T08:13:59.878567+0000","last_peered":"2024-09-22T08:13:59.878567+0000","last_clean":"2024-09-22T08:13:59.878567+0000","last_became_active":"2024-09-22T08:10:49.187467+0000","last_became_peered":"2024-09-22T08:10:49.187467+0000","last_unstale":"2024-09-22T08:13:59.878567+0000","last_undegraded":"2024-09-22T08:13:59.878567+0000","last_fullsized":"2024-09-22T08:13:59.878567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:27.242973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209400+0000","last_change":"2024-09-22T08:10:51.198209+0000","last_active":"2024-09-22T08:11:23.209400+0000","last_peered":"2024-09-22T08:11:23.209400+0000","last_clean":"2024-09-22T08:11:23.209400+0000","last_became_active":"2024-09-22T08:10:51.197942+0000","last_became_peered":"2024-09-22T08:10:51.197942+0000","last_unstale":"2024-09-22T08:11:23.209400+0000","last_undegraded":"2024-09-22T08:11:23.209400+0000","last_fullsized":"2024-09-22T08:11:23.209400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:42.833261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.573626+0000","last_change":"2024-09-22T08:10:53.204064+0000","last_active":"2024-09-22T08:12:52.573626+0000","last_peered":"2024-09-22T08:12:52.573626+0000","last_clean":"2024-09-22T08:12:52.573626+0000","last_became_active":"2024-09-22T08:10:53.203791+0000","last_became_peered":"2024-09-22T08:10:53.203791+0000","last_unstale":"2024-09-22T08:12:52.573626+0000","last_undegraded":"2024-09-22T08:12:52.573626+0000","last_fullsized":"2024-09-22T08:12:52.573626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:42.795444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042279+0000","last_change":"2024-09-22T08:10:45.164568+0000","last_active":"2024-09-22T08:13:53.042279+0000","last_peered":"2024-09-22T08:13:53.042279+0000","last_clean":"2024-09-22T08:13:53.042279+0000","last_became_active":"2024-09-22T08:10:45.163402+0000","last_became_peered":"2024-09-22T08:10:45.163402+0000","last_unstale":"2024-09-22T08:13:53.042279+0000","last_undegraded":"2024-09-22T08:13:53.042279+0000","last_fullsized":"2024-09-22T08:13:53.042279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:31.128783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.746483+0000","last_change":"2024-09-22T08:14:09.746483+0000","last_active":"2024-09-22T08:14:09.746483+0000","last_peered":"2024-09-22T08:14:09.746483+0000","last_clean":"2024-09-22T08:14:09.746483+0000","last_became_active":"2024-09-22T08:10:43.184777+0000","last_became_peered":"2024-09-22T08:10:43.184777+0000","last_unstale":"2024-09-22T08:14:09.746483+0000","last_undegraded":"2024-09-22T08:14:09.746483+0000","last_fullsized":"2024-09-22T08:14:09.746483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:09.746395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:09.746395+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.746395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:20.482133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.796204+0000","last_change":"2024-09-22T08:10:47.176659+0000","last_active":"2024-09-22T08:12:49.796204+0000","last_peered":"2024-09-22T08:12:49.796204+0000","last_clean":"2024-09-22T08:12:49.796204+0000","last_became_active":"2024-09-22T08:10:47.176390+0000","last_became_peered":"2024-09-22T08:10:47.176390+0000","last_unstale":"2024-09-22T08:12:49.796204+0000","last_undegraded":"2024-09-22T08:12:49.796204+0000","last_fullsized":"2024-09-22T08:12:49.796204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:24.829227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'37","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.888257+0000","last_change":"2024-09-22T08:10:49.189639+0000","last_active":"2024-09-22T08:13:59.888257+0000","last_peered":"2024-09-22T08:13:59.888257+0000","last_clean":"2024-09-22T08:13:59.888257+0000","last_became_active":"2024-09-22T08:10:49.188231+0000","last_became_peered":"2024-09-22T08:10:49.188231+0000","last_unstale":"2024-09-22T08:13:59.888257+0000","last_undegraded":"2024-09-22T08:13:59.888257+0000","last_fullsized":"2024-09-22T08:13:59.888257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:08.360453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":46,"num_read_kb":60,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221258+0000","last_change":"2024-09-22T08:10:51.202802+0000","last_active":"2024-09-22T08:11:23.221258+0000","last_peered":"2024-09-22T08:11:23.221258+0000","last_clean":"2024-09-22T08:11:23.221258+0000","last_became_active":"2024-09-22T08:10:51.202476+0000","last_became_peered":"2024-09-22T08:10:51.202476+0000","last_unstale":"2024-09-22T08:11:23.221258+0000","last_undegraded":"2024-09-22T08:11:23.221258+0000","last_fullsized":"2024-09-22T08:11:23.221258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.161803+0000","last_change":"2024-09-22T08:10:53.201417+0000","last_active":"2024-09-22T08:12:51.161803+0000","last_peered":"2024-09-22T08:12:51.161803+0000","last_clean":"2024-09-22T08:12:51.161803+0000","last_became_active":"2024-09-22T08:10:53.201125+0000","last_became_peered":"2024-09-22T08:10:53.201125+0000","last_unstale":"2024-09-22T08:12:51.161803+0000","last_undegraded":"2024-09-22T08:12:51.161803+0000","last_fullsized":"2024-09-22T08:12:51.161803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:16.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254853+0000","last_change":"2024-09-22T08:10:45.181046+0000","last_active":"2024-09-22T08:13:53.254853+0000","last_peered":"2024-09-22T08:13:53.254853+0000","last_clean":"2024-09-22T08:13:53.254853+0000","last_became_active":"2024-09-22T08:10:45.180781+0000","last_became_peered":"2024-09-22T08:10:45.180781+0000","last_unstale":"2024-09-22T08:13:53.254853+0000","last_undegraded":"2024-09-22T08:13:53.254853+0000","last_fullsized":"2024-09-22T08:13:53.254853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:50.052801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.826597+0000","last_change":"2024-09-22T08:14:13.826597+0000","last_active":"2024-09-22T08:14:13.826597+0000","last_peered":"2024-09-22T08:14:13.826597+0000","last_clean":"2024-09-22T08:14:13.826597+0000","last_became_active":"2024-09-22T08:10:43.179693+0000","last_became_peered":"2024-09-22T08:10:43.179693+0000","last_unstale":"2024-09-22T08:14:13.826597+0000","last_undegraded":"2024-09-22T08:14:13.826597+0000","last_fullsized":"2024-09-22T08:14:13.826597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:13.826510+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:13.826510+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.826510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:05.210216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.950213+0000","last_change":"2024-09-22T08:10:45.164763+0000","last_active":"2024-09-22T08:13:52.950213+0000","last_peered":"2024-09-22T08:13:52.950213+0000","last_clean":"2024-09-22T08:13:52.950213+0000","last_became_active":"2024-09-22T08:10:45.164406+0000","last_became_peered":"2024-09-22T08:10:45.164406+0000","last_unstale":"2024-09-22T08:13:52.950213+0000","last_undegraded":"2024-09-22T08:13:52.950213+0000","last_fullsized":"2024-09-22T08:13:52.950213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:37.404156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.893552+0000","last_change":"2024-09-22T08:14:09.893552+0000","last_active":"2024-09-22T08:14:09.893552+0000","last_peered":"2024-09-22T08:14:09.893552+0000","last_clean":"2024-09-22T08:14:09.893552+0000","last_became_active":"2024-09-22T08:10:43.178018+0000","last_became_peered":"2024-09-22T08:10:43.178018+0000","last_unstale":"2024-09-22T08:14:09.893552+0000","last_undegraded":"2024-09-22T08:14:09.893552+0000","last_fullsized":"2024-09-22T08:14:09.893552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:09.893443+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:09.893443+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.893443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:14.018138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227865+0000","last_change":"2024-09-22T08:10:45.170408+0000","last_active":"2024-09-22T08:13:53.227865+0000","last_peered":"2024-09-22T08:13:53.227865+0000","last_clean":"2024-09-22T08:13:53.227865+0000","last_became_active":"2024-09-22T08:10:45.168526+0000","last_became_peered":"2024-09-22T08:10:45.168526+0000","last_unstale":"2024-09-22T08:13:53.227865+0000","last_undegraded":"2024-09-22T08:13:53.227865+0000","last_fullsized":"2024-09-22T08:13:53.227865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:17.590758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":86,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209592+0000","last_change":"2024-09-22T08:10:43.198536+0000","last_active":"2024-09-22T08:11:23.209592+0000","last_peered":"2024-09-22T08:11:23.209592+0000","last_clean":"2024-09-22T08:11:23.209592+0000","last_became_active":"2024-09-22T08:10:43.196221+0000","last_became_peered":"2024-09-22T08:10:43.196221+0000","last_unstale":"2024-09-22T08:11:23.209592+0000","last_undegraded":"2024-09-22T08:11:23.209592+0000","last_fullsized":"2024-09-22T08:11:23.209592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:05.712585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.166823+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.166432+0000","last_became_peered":"2024-09-22T08:10:45.166432+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:07.715456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.902014+0000","last_change":"2024-09-22T08:14:10.902014+0000","last_active":"2024-09-22T08:14:10.902014+0000","last_peered":"2024-09-22T08:14:10.902014+0000","last_clean":"2024-09-22T08:14:10.902014+0000","last_became_active":"2024-09-22T08:10:43.177673+0000","last_became_peered":"2024-09-22T08:10:43.177673+0000","last_unstale":"2024-09-22T08:14:10.902014+0000","last_undegraded":"2024-09-22T08:14:10.902014+0000","last_fullsized":"2024-09-22T08:14:10.902014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:10.901926+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:10.901926+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.901926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:49.460312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.575693+0000","last_change":"2024-09-22T08:10:45.171880+0000","last_active":"2024-09-22T08:12:52.575693+0000","last_peered":"2024-09-22T08:12:52.575693+0000","last_clean":"2024-09-22T08:12:52.575693+0000","last_became_active":"2024-09-22T08:10:45.171476+0000","last_became_peered":"2024-09-22T08:10:45.171476+0000","last_unstale":"2024-09-22T08:12:52.575693+0000","last_undegraded":"2024-09-22T08:12:52.575693+0000","last_fullsized":"2024-09-22T08:12:52.575693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:09.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.868565+0000","last_change":"2024-09-22T08:14:11.868565+0000","last_active":"2024-09-22T08:14:11.868565+0000","last_peered":"2024-09-22T08:14:11.868565+0000","last_clean":"2024-09-22T08:14:11.868565+0000","last_became_active":"2024-09-22T08:10:43.186671+0000","last_became_peered":"2024-09-22T08:10:43.186671+0000","last_unstale":"2024-09-22T08:14:11.868565+0000","last_undegraded":"2024-09-22T08:14:11.868565+0000","last_fullsized":"2024-09-22T08:14:11.868565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:11.868472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:11.868472+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.868472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:04.057150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.952726+0000","last_change":"2024-09-22T08:10:45.183046+0000","last_active":"2024-09-22T08:13:52.952726+0000","last_peered":"2024-09-22T08:13:52.952726+0000","last_clean":"2024-09-22T08:13:52.952726+0000","last_became_active":"2024-09-22T08:10:45.182785+0000","last_became_peered":"2024-09-22T08:10:45.182785+0000","last_unstale":"2024-09-22T08:13:52.952726+0000","last_undegraded":"2024-09-22T08:13:52.952726+0000","last_fullsized":"2024-09-22T08:13:52.952726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:51.776555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.814682+0000","last_change":"2024-09-22T08:14:11.814682+0000","last_active":"2024-09-22T08:14:11.814682+0000","last_peered":"2024-09-22T08:14:11.814682+0000","last_clean":"2024-09-22T08:14:11.814682+0000","last_became_active":"2024-09-22T08:10:43.182824+0000","last_became_peered":"2024-09-22T08:10:43.182824+0000","last_unstale":"2024-09-22T08:14:11.814682+0000","last_undegraded":"2024-09-22T08:14:11.814682+0000","last_fullsized":"2024-09-22T08:14:11.814682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:11.814594+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:11.814594+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.814594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:06.053818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'25","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.263612+0000","last_change":"2024-09-22T08:10:45.175920+0000","last_active":"2024-09-22T08:13:53.263612+0000","last_peered":"2024-09-22T08:13:53.263612+0000","last_clean":"2024-09-22T08:13:53.263612+0000","last_became_active":"2024-09-22T08:10:45.175600+0000","last_became_peered":"2024-09-22T08:10:45.175600+0000","last_unstale":"2024-09-22T08:13:53.263612+0000","last_undegraded":"2024-09-22T08:13:53.263612+0000","last_fullsized":"2024-09-22T08:13:53.263612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:53.580143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.753775+0000","last_change":"2024-09-22T08:14:11.753775+0000","last_active":"2024-09-22T08:14:11.753775+0000","last_peered":"2024-09-22T08:14:11.753775+0000","last_clean":"2024-09-22T08:14:11.753775+0000","last_became_active":"2024-09-22T08:10:43.179529+0000","last_became_peered":"2024-09-22T08:10:43.179529+0000","last_unstale":"2024-09-22T08:14:11.753775+0000","last_undegraded":"2024-09-22T08:14:11.753775+0000","last_fullsized":"2024-09-22T08:14:11.753775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:11.753682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:11.753682+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.753682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:24.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.042521+0000","last_change":"2024-09-22T08:10:45.184241+0000","last_active":"2024-09-22T08:13:53.042521+0000","last_peered":"2024-09-22T08:13:53.042521+0000","last_clean":"2024-09-22T08:13:53.042521+0000","last_became_active":"2024-09-22T08:10:45.183901+0000","last_became_peered":"2024-09-22T08:10:45.183901+0000","last_unstale":"2024-09-22T08:13:53.042521+0000","last_undegraded":"2024-09-22T08:13:53.042521+0000","last_fullsized":"2024-09-22T08:13:53.042521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:28:48.567601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.880179+0000","last_change":"2024-09-22T08:14:12.880179+0000","last_active":"2024-09-22T08:14:12.880179+0000","last_peered":"2024-09-22T08:14:12.880179+0000","last_clean":"2024-09-22T08:14:12.880179+0000","last_became_active":"2024-09-22T08:10:43.177461+0000","last_became_peered":"2024-09-22T08:10:43.177461+0000","last_unstale":"2024-09-22T08:14:12.880179+0000","last_undegraded":"2024-09-22T08:14:12.880179+0000","last_fullsized":"2024-09-22T08:14:12.880179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:12.880088+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:12.880088+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.880088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:57.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.952431+0000","last_change":"2024-09-22T08:10:45.170004+0000","last_active":"2024-09-22T08:13:52.952431+0000","last_peered":"2024-09-22T08:13:52.952431+0000","last_clean":"2024-09-22T08:13:52.952431+0000","last_became_active":"2024-09-22T08:10:45.169723+0000","last_became_peered":"2024-09-22T08:10:45.169723+0000","last_unstale":"2024-09-22T08:13:52.952431+0000","last_undegraded":"2024-09-22T08:13:52.952431+0000","last_fullsized":"2024-09-22T08:13:52.952431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:45.662588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.234089+0000","last_change":"2024-09-22T08:14:22.234089+0000","last_active":"2024-09-22T08:14:22.234089+0000","last_peered":"2024-09-22T08:14:22.234089+0000","last_clean":"2024-09-22T08:14:22.234089+0000","last_became_active":"2024-09-22T08:10:43.195587+0000","last_became_peered":"2024-09-22T08:10:43.195587+0000","last_unstale":"2024-09-22T08:14:22.234089+0000","last_undegraded":"2024-09-22T08:14:22.234089+0000","last_fullsized":"2024-09-22T08:14:22.234089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:22.234003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:22.234003+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.234003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:20.685742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183433+0000","last_change":"2024-09-22T08:10:45.170370+0000","last_active":"2024-09-22T08:13:53.183433+0000","last_peered":"2024-09-22T08:13:53.183433+0000","last_clean":"2024-09-22T08:13:53.183433+0000","last_became_active":"2024-09-22T08:10:45.169366+0000","last_became_peered":"2024-09-22T08:10:45.169366+0000","last_unstale":"2024-09-22T08:13:53.183433+0000","last_undegraded":"2024-09-22T08:13:53.183433+0000","last_fullsized":"2024-09-22T08:13:53.183433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.634336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.867652+0000","last_change":"2024-09-22T08:14:13.867652+0000","last_active":"2024-09-22T08:14:13.867652+0000","last_peered":"2024-09-22T08:14:13.867652+0000","last_clean":"2024-09-22T08:14:13.867652+0000","last_became_active":"2024-09-22T08:10:43.187246+0000","last_became_peered":"2024-09-22T08:10:43.187246+0000","last_unstale":"2024-09-22T08:14:13.867652+0000","last_undegraded":"2024-09-22T08:14:13.867652+0000","last_fullsized":"2024-09-22T08:14:13.867652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:13.867567+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:13.867567+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.867567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:08.637420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.044952+0000","last_change":"2024-09-22T08:10:45.172556+0000","last_active":"2024-09-22T08:13:53.044952+0000","last_peered":"2024-09-22T08:13:53.044952+0000","last_clean":"2024-09-22T08:13:53.044952+0000","last_became_active":"2024-09-22T08:10:45.172080+0000","last_became_peered":"2024-09-22T08:10:45.172080+0000","last_unstale":"2024-09-22T08:13:53.044952+0000","last_undegraded":"2024-09-22T08:13:53.044952+0000","last_fullsized":"2024-09-22T08:13:53.044952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:33.633420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.765941+0000","last_change":"2024-09-22T08:14:14.765941+0000","last_active":"2024-09-22T08:14:14.765941+0000","last_peered":"2024-09-22T08:14:14.765941+0000","last_clean":"2024-09-22T08:14:14.765941+0000","last_became_active":"2024-09-22T08:10:43.178924+0000","last_became_peered":"2024-09-22T08:10:43.178924+0000","last_unstale":"2024-09-22T08:14:14.765941+0000","last_undegraded":"2024-09-22T08:14:14.765941+0000","last_fullsized":"2024-09-22T08:14:14.765941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:14.765846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:14.765846+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.765846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:42.012438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'15","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.190568+0000","last_change":"2024-09-22T08:10:45.172376+0000","last_active":"2024-09-22T08:13:53.190568+0000","last_peered":"2024-09-22T08:13:53.190568+0000","last_clean":"2024-09-22T08:13:53.190568+0000","last_became_active":"2024-09-22T08:10:45.172101+0000","last_became_peered":"2024-09-22T08:10:45.172101+0000","last_unstale":"2024-09-22T08:13:53.190568+0000","last_undegraded":"2024-09-22T08:13:53.190568+0000","last_fullsized":"2024-09-22T08:13:53.190568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:42.945533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.756790+0000","last_change":"2024-09-22T08:14:13.756790+0000","last_active":"2024-09-22T08:14:13.756790+0000","last_peered":"2024-09-22T08:14:13.756790+0000","last_clean":"2024-09-22T08:14:13.756790+0000","last_became_active":"2024-09-22T08:10:43.178876+0000","last_became_peered":"2024-09-22T08:10:43.178876+0000","last_unstale":"2024-09-22T08:14:13.756790+0000","last_undegraded":"2024-09-22T08:14:13.756790+0000","last_fullsized":"2024-09-22T08:14:13.756790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:13.756688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:13.756688+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.756688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:05.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.829072+0000","last_change":"2024-09-22T08:10:45.180356+0000","last_active":"2024-09-22T08:12:08.829072+0000","last_peered":"2024-09-22T08:12:08.829072+0000","last_clean":"2024-09-22T08:12:08.829072+0000","last_became_active":"2024-09-22T08:10:45.180117+0000","last_became_peered":"2024-09-22T08:10:45.180117+0000","last_unstale":"2024-09-22T08:12:08.829072+0000","last_undegraded":"2024-09-22T08:12:08.829072+0000","last_fullsized":"2024-09-22T08:12:08.829072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:07.097290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211963+0000","last_change":"2024-09-22T08:10:43.196149+0000","last_active":"2024-09-22T08:11:23.211963+0000","last_peered":"2024-09-22T08:11:23.211963+0000","last_clean":"2024-09-22T08:11:23.211963+0000","last_became_active":"2024-09-22T08:10:43.195770+0000","last_became_peered":"2024-09-22T08:10:43.195770+0000","last_unstale":"2024-09-22T08:11:23.211963+0000","last_undegraded":"2024-09-22T08:11:23.211963+0000","last_fullsized":"2024-09-22T08:11:23.211963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:35.401285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183848+0000","last_change":"2024-09-22T08:10:45.180354+0000","last_active":"2024-09-22T08:13:53.183848+0000","last_peered":"2024-09-22T08:13:53.183848+0000","last_clean":"2024-09-22T08:13:53.183848+0000","last_became_active":"2024-09-22T08:10:45.180098+0000","last_became_peered":"2024-09-22T08:10:45.180098+0000","last_unstale":"2024-09-22T08:13:53.183848+0000","last_undegraded":"2024-09-22T08:13:53.183848+0000","last_fullsized":"2024-09-22T08:13:53.183848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:45.833791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213202+0000","last_change":"2024-09-22T08:10:43.202451+0000","last_active":"2024-09-22T08:11:23.213202+0000","last_peered":"2024-09-22T08:11:23.213202+0000","last_clean":"2024-09-22T08:11:23.213202+0000","last_became_active":"2024-09-22T08:10:43.201687+0000","last_became_peered":"2024-09-22T08:10:43.201687+0000","last_unstale":"2024-09-22T08:11:23.213202+0000","last_undegraded":"2024-09-22T08:11:23.213202+0000","last_fullsized":"2024-09-22T08:11:23.213202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:03.394369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.037719+0000","last_change":"2024-09-22T08:11:23.222217+0000","last_active":"2024-09-22T08:11:27.037719+0000","last_peered":"2024-09-22T08:11:27.037719+0000","last_clean":"2024-09-22T08:11:27.037719+0000","last_became_active":"2024-09-22T08:11:23.215110+0000","last_became_peered":"2024-09-22T08:11:23.215110+0000","last_unstale":"2024-09-22T08:11:27.037719+0000","last_undegraded":"2024-09-22T08:11:27.037719+0000","last_fullsized":"2024-09-22T08:11:27.037719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:56.580950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.790672+0000","last_change":"2024-09-22T08:14:12.790672+0000","last_active":"2024-09-22T08:14:12.790672+0000","last_peered":"2024-09-22T08:14:12.790672+0000","last_clean":"2024-09-22T08:14:12.790672+0000","last_became_active":"2024-09-22T08:10:43.187195+0000","last_became_peered":"2024-09-22T08:10:43.187195+0000","last_unstale":"2024-09-22T08:14:12.790672+0000","last_undegraded":"2024-09-22T08:14:12.790672+0000","last_fullsized":"2024-09-22T08:14:12.790672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:12.790570+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:12.790570+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.790570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:57.729020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183984+0000","last_change":"2024-09-22T08:10:45.179422+0000","last_active":"2024-09-22T08:13:53.183984+0000","last_peered":"2024-09-22T08:13:53.183984+0000","last_clean":"2024-09-22T08:13:53.183984+0000","last_became_active":"2024-09-22T08:10:45.179150+0000","last_became_peered":"2024-09-22T08:10:45.179150+0000","last_unstale":"2024-09-22T08:13:53.183984+0000","last_undegraded":"2024-09-22T08:13:53.183984+0000","last_fullsized":"2024-09-22T08:13:53.183984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:16:32.350768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213258+0000","last_change":"2024-09-22T08:10:43.200646+0000","last_active":"2024-09-22T08:11:23.213258+0000","last_peered":"2024-09-22T08:11:23.213258+0000","last_clean":"2024-09-22T08:11:23.213258+0000","last_became_active":"2024-09-22T08:10:43.200282+0000","last_became_peered":"2024-09-22T08:10:43.200282+0000","last_unstale":"2024-09-22T08:11:23.213258+0000","last_undegraded":"2024-09-22T08:11:23.213258+0000","last_fullsized":"2024-09-22T08:11:23.213258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:40.745524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:26.560615+0000","last_change":"2024-09-22T08:10:43.190222+0000","last_active":"2024-09-22T08:11:26.560615+0000","last_peered":"2024-09-22T08:11:26.560615+0000","last_clean":"2024-09-22T08:11:26.560615+0000","last_became_active":"2024-09-22T08:10:43.189848+0000","last_became_peered":"2024-09-22T08:10:43.189848+0000","last_unstale":"2024-09-22T08:11:26.560615+0000","last_undegraded":"2024-09-22T08:11:26.560615+0000","last_fullsized":"2024-09-22T08:11:26.560615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:42.145023+0000","last_clean_scrub_stamp":"2024-09-22T08:10:42.145023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:06.237724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.234367+0000","last_change":"2024-09-22T08:10:45.183685+0000","last_active":"2024-09-22T08:13:53.234367+0000","last_peered":"2024-09-22T08:13:53.234367+0000","last_clean":"2024-09-22T08:13:53.234367+0000","last_became_active":"2024-09-22T08:10:45.183407+0000","last_became_peered":"2024-09-22T08:10:45.183407+0000","last_unstale":"2024-09-22T08:13:53.234367+0000","last_undegraded":"2024-09-22T08:13:53.234367+0000","last_fullsized":"2024-09-22T08:13:53.234367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:45.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.836700+0000","last_change":"2024-09-22T08:14:14.836700+0000","last_active":"2024-09-22T08:14:14.836700+0000","last_peered":"2024-09-22T08:14:14.836700+0000","last_clean":"2024-09-22T08:14:14.836700+0000","last_became_active":"2024-09-22T08:10:43.187119+0000","last_became_peered":"2024-09-22T08:10:43.187119+0000","last_unstale":"2024-09-22T08:14:14.836700+0000","last_undegraded":"2024-09-22T08:14:14.836700+0000","last_fullsized":"2024-09-22T08:14:14.836700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:14.836597+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:14.836597+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.836597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:22.845650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'7","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:12.587845+0000","last_change":"2024-09-22T08:11:23.218926+0000","last_active":"2024-09-22T08:13:12.587845+0000","last_peered":"2024-09-22T08:13:12.587845+0000","last_clean":"2024-09-22T08:13:12.587845+0000","last_became_active":"2024-09-22T08:11:23.218693+0000","last_became_peered":"2024-09-22T08:11:23.218693+0000","last_unstale":"2024-09-22T08:13:12.587845+0000","last_undegraded":"2024-09-22T08:13:12.587845+0000","last_fullsized":"2024-09-22T08:13:12.587845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:27:23.796030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673012,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":741411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1036288,"data_stored":742099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":152009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:14:24.953 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.953 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.953 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.953 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.953 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.953 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.953 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.953 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.954 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.954 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.954 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.954 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.954 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.954 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.954 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.954 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.954 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.955 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.955 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.955 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.955 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.955 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.955 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.955 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.955 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.955 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.956 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.956 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.956 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.956 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.956 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.956 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.956 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.956 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.956 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.956 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.957 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.957 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.957 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.957 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.957 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.957 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.957 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.957 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.957 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.958 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.958 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.958 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.958 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.958 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.958 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.958 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.958 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.958 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.959 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.959 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.959 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.959 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.959 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.959 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.959 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.959 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.960 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.960 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.960 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.960 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.960 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.960 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.960 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.960 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.960 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.960 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.961 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.961 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.961 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.961 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.961 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.961 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.961 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.961 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.961 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.962 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.962 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.962 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.962 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.962 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.962 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.962 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.962 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.963 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.963 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.963 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.963 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.963 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.963 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.963 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.963 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.963 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.963 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.964 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.964 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.964 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.964 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.964 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.964 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.964 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.964 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.964 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.964 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.965 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.965 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.965 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.965 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.965 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.965 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.965 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.965 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.965 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.965 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.966 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.966 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.966 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.966 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.966 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.966 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.966 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.966 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.966 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.966 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.967 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.967 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.967 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.967 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.967 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.967 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.967 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.967 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.967 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.967 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.968 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.968 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.968 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.968 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.968 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.968 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.968 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.968 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.968 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.968 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.969 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.969 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.969 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.969 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.969 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.969 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.969 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.969 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.969 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.969 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.970 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.970 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.970 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.970 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.970 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.970 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.970 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.970 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.970 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.971 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.971 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.971 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.971 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.971 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.971 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.971 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.971 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.971 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.972 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.972 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.972 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.972 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.972 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.972 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.972 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.972 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.972 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.973 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-22T08:10:42.145023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=42, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.973 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.973 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:24.973 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:14:44.973 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:14:45.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.086+0000 7f31b79ad640 1 Processor -- start 2024-09-22T08:14:45.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.086+0000 7f31b79ad640 1 -- start start 2024-09-22T08:14:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.087+0000 7f31b79ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f31b006fd70 0x7f31b0131660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.087+0000 7f31b79ad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b0099ee0 con 0x7f31b006f280 2024-09-22T08:14:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.087+0000 7f31b79ad640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f31b0070d00 con 0x7f31b006fd70 2024-09-22T08:14:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.087+0000 7f31b5749640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f31b006f280 0x7f31b006f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40394/0 (socket says 172.21.15.53:40394) 2024-09-22T08:14:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.087+0000 7f31b5749640 1 -- 172.21.15.53:0/1555165418 learned_addr learned my addr 172.21.15.53:0/1555165418 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:14:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.087+0000 7f31b4f48640 1 --2- 172.21.15.53:0/1555165418 >> v2:172.21.15.53:3300/0 conn(0x7f31b006fd70 0x7f31b0131660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.087+0000 7f31a7fff640 1 -- 172.21.15.53:0/1555165418 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432607194 0 0) 0x7f31b0099ee0 con 0x7f31b006f280 2024-09-22T08:14:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.087+0000 7f31a7fff640 1 -- 172.21.15.53:0/1555165418 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f319c003520 con 0x7f31b006f280 2024-09-22T08:14:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.087+0000 7f31b4f48640 1 -- 172.21.15.53:0/1555165418 >> v1:172.21.15.53:6789/0 conn(0x7f31b006f280 legacy=0x7f31b006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.087+0000 7f31b4f48640 1 -- 172.21.15.53:0/1555165418 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b0070f40 con 0x7f31b006fd70 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.088+0000 7f31b4f48640 1 --2- 172.21.15.53:0/1555165418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006fd70 0x7f31b0131660 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009720 tx=0x7f31a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbadb742c52dbf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.088+0000 7f31a7fff640 1 -- 172.21.15.53:0/1555165418 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0037070 con 0x7f31b006fd70 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.088+0000 7f31a7fff640 1 -- 172.21.15.53:0/1555165418 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a002ad90 con 0x7f31b006fd70 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.088+0000 7f31a7fff640 1 -- 172.21.15.53:0/1555165418 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0032590 con 0x7f31b006fd70 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.089+0000 7f31b79ad640 1 -- 172.21.15.53:0/1555165418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006fd70 msgr2=0x7f31b0131660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.089+0000 7f31b79ad640 1 --2- 172.21.15.53:0/1555165418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006fd70 0x7f31b0131660 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009720 tx=0x7f31a002a110 comp rx=0 tx=0).stop 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.089+0000 7f31b79ad640 1 -- 172.21.15.53:0/1555165418 shutdown_connections 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.089+0000 7f31b79ad640 1 --2- 172.21.15.53:0/1555165418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006fd70 0x7f31b0131660 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.089+0000 7f31b79ad640 1 -- 172.21.15.53:0/1555165418 >> 172.21.15.53:0/1555165418 conn(0x7f31b009ac80 msgr2=0x7f31b0098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.089+0000 7f31b79ad640 1 -- 172.21.15.53:0/1555165418 shutdown_connections 2024-09-22T08:14:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.089+0000 7f31b79ad640 1 -- 172.21.15.53:0/1555165418 wait complete. 2024-09-22T08:14:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.090+0000 7f31b79ad640 1 Processor -- start 2024-09-22T08:14:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.090+0000 7f31b79ad640 1 -- start start 2024-09-22T08:14:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.090+0000 7f31b79ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006f280 0x7f31b01c2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.090+0000 7f31b79ad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31b0131d20 con 0x7f31b006f280 2024-09-22T08:14:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.090+0000 7f31b5749640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006f280 0x7f31b01c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.090+0000 7f31b5749640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006f280 0x7f31b01c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56596/0 (socket says 172.21.15.53:56596) 2024-09-22T08:14:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.090+0000 7f31b5749640 1 -- 172.21.15.53:0/431282564 learned_addr learned my addr 172.21.15.53:0/431282564 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:14:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.091+0000 7f31b5749640 1 -- 172.21.15.53:0/431282564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b0073fb0 con 0x7f31b006f280 2024-09-22T08:14:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.091+0000 7f31b5749640 1 --2- 172.21.15.53:0/431282564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006f280 0x7f31b01c2050 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00cb40 tx=0x7f31ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:45.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.091+0000 7f31a5ffb640 1 -- 172.21.15.53:0/431282564 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ac00ab50 con 0x7f31b006f280 2024-09-22T08:14:45.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.091+0000 7f31a5ffb640 1 -- 172.21.15.53:0/431282564 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ac00acf0 con 0x7f31b006f280 2024-09-22T08:14:45.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.091+0000 7f31b79ad640 1 -- 172.21.15.53:0/431282564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b0127840 con 0x7f31b006f280 2024-09-22T08:14:45.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.091+0000 7f31a5ffb640 1 -- 172.21.15.53:0/431282564 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ac012530 con 0x7f31b006f280 2024-09-22T08:14:45.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.091+0000 7f31b79ad640 1 -- 172.21.15.53:0/431282564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b0128470 con 0x7f31b006f280 2024-09-22T08:14:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.092+0000 7f31a5ffb640 1 -- 172.21.15.53:0/431282564 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f31ac0126d0 con 0x7f31b006f280 2024-09-22T08:14:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.092+0000 7f31b79ad640 1 -- 172.21.15.53:0/431282564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b006f660 con 0x7f31b006f280 2024-09-22T08:14:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.092+0000 7f31a5ffb640 1 --2- 172.21.15.53:0/431282564 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f319403e710 0x7f3194040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:14:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.092+0000 7f31a5ffb640 1 -- 172.21.15.53:0/431282564 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f31ac053f00 con 0x7f31b006f280 2024-09-22T08:14:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.093+0000 7f31b4f48640 1 --2- 172.21.15.53:0/431282564 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f319403e710 0x7f3194040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:14:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.093+0000 7f31b4f48640 1 --2- 172.21.15.53:0/431282564 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f319403e710 0x7f3194040bd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009720 tx=0x7f31a002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:14:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.097+0000 7f31a5ffb640 1 -- 172.21.15.53:0/431282564 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f31b0073fb0 con 0x7f31b006f280 2024-09-22T08:14:45.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.284+0000 7f31b79ad640 1 -- 172.21.15.53:0/431282564 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31b0127e10 con 0x7f319403e710 2024-09-22T08:14:45.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.294+0000 7f31a5ffb640 1 -- 172.21.15.53:0/431282564 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666156 (secure 0 0 0) 0x7f31b0127e10 con 0x7f319403e710 2024-09-22T08:14:45.303 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:14:45.308 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:14:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.299+0000 7f31b79ad640 1 -- 172.21.15.53:0/431282564 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f319403e710 msgr2=0x7f3194040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.299+0000 7f31b79ad640 1 --2- 172.21.15.53:0/431282564 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f319403e710 0x7f3194040bd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009720 tx=0x7f31a002e000 comp rx=0 tx=0).stop 2024-09-22T08:14:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.299+0000 7f31b79ad640 1 -- 172.21.15.53:0/431282564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006f280 msgr2=0x7f31b01c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:14:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.299+0000 7f31b79ad640 1 --2- 172.21.15.53:0/431282564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006f280 0x7f31b01c2050 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00cb40 tx=0x7f31ac00a060 comp rx=0 tx=0).stop 2024-09-22T08:14:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.299+0000 7f31b79ad640 1 -- 172.21.15.53:0/431282564 shutdown_connections 2024-09-22T08:14:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.299+0000 7f31b79ad640 1 --2- 172.21.15.53:0/431282564 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f319403e710 0x7f3194040bd0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.299+0000 7f31b79ad640 1 --2- 172.21.15.53:0/431282564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31b006f280 0x7f31b01c2050 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:14:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.299+0000 7f31b79ad640 1 -- 172.21.15.53:0/431282564 >> 172.21.15.53:0/431282564 conn(0x7f31b009ac80 msgr2=0x7f31b0071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:14:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.299+0000 7f31b79ad640 1 -- 172.21.15.53:0/431282564 shutdown_connections 2024-09-22T08:14:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:14:45.299+0000 7f31b79ad640 1 -- 172.21.15.53:0/431282564 wait complete. 2024-09-22T08:14:45.312 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-22T08:14:43.639497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5179,"num_read_kb":4721,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":630,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4624,"ondisk_log_size":4624,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148448,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338912,"statfs":{"total":386547056640,"available":386395045888,"internally_reserved":0,"allocated":2981888,"data_stored":1788188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":630,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004599"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.888299+0000","last_change":"2024-09-22T08:14:16.888299+0000","last_active":"2024-09-22T08:14:16.888299+0000","last_peered":"2024-09-22T08:14:16.888299+0000","last_clean":"2024-09-22T08:14:16.888299+0000","last_became_active":"2024-09-22T08:10:43.174489+0000","last_became_peered":"2024-09-22T08:10:43.174489+0000","last_unstale":"2024-09-22T08:14:16.888299+0000","last_undegraded":"2024-09-22T08:14:16.888299+0000","last_fullsized":"2024-09-22T08:14:16.888299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:16.888214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:16.888214+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.888214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:50.430915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.772962+0000","last_change":"2024-09-22T08:14:35.772962+0000","last_active":"2024-09-22T08:14:35.772962+0000","last_peered":"2024-09-22T08:14:35.772962+0000","last_clean":"2024-09-22T08:14:35.772962+0000","last_became_active":"2024-09-22T08:10:45.179969+0000","last_became_peered":"2024-09-22T08:10:45.179969+0000","last_unstale":"2024-09-22T08:14:35.772962+0000","last_undegraded":"2024-09-22T08:14:35.772962+0000","last_fullsized":"2024-09-22T08:14:35.772962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:35.772871+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:35.772871+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.772871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:40.663120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.854808+0000","last_change":"2024-09-22T08:14:17.854808+0000","last_active":"2024-09-22T08:14:17.854808+0000","last_peered":"2024-09-22T08:14:17.854808+0000","last_clean":"2024-09-22T08:14:17.854808+0000","last_became_active":"2024-09-22T08:10:43.187128+0000","last_became_peered":"2024-09-22T08:10:43.187128+0000","last_unstale":"2024-09-22T08:14:17.854808+0000","last_undegraded":"2024-09-22T08:14:17.854808+0000","last_fullsized":"2024-09-22T08:14:17.854808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.854715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.854715+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.854715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:57.247272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210762+0000","last_change":"2024-09-22T08:10:45.170031+0000","last_active":"2024-09-22T08:11:23.210762+0000","last_peered":"2024-09-22T08:11:23.210762+0000","last_clean":"2024-09-22T08:11:23.210762+0000","last_became_active":"2024-09-22T08:10:45.169768+0000","last_became_peered":"2024-09-22T08:10:45.169768+0000","last_unstale":"2024-09-22T08:11:23.210762+0000","last_undegraded":"2024-09-22T08:11:23.210762+0000","last_fullsized":"2024-09-22T08:11:23.210762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:06.709611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.201010+0000","last_change":"2024-09-22T08:14:31.201010+0000","last_active":"2024-09-22T08:14:31.201010+0000","last_peered":"2024-09-22T08:14:31.201010+0000","last_clean":"2024-09-22T08:14:31.201010+0000","last_became_active":"2024-09-22T08:10:43.200436+0000","last_became_peered":"2024-09-22T08:10:43.200436+0000","last_unstale":"2024-09-22T08:14:31.201010+0000","last_undegraded":"2024-09-22T08:14:31.201010+0000","last_fullsized":"2024-09-22T08:14:31.201010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.200921+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.200921+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.200921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:27.278821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.254858+0000","last_change":"2024-09-22T08:10:45.175954+0000","last_active":"2024-09-22T08:13:53.254858+0000","last_peered":"2024-09-22T08:13:53.254858+0000","last_clean":"2024-09-22T08:13:53.254858+0000","last_became_active":"2024-09-22T08:10:45.169110+0000","last_became_peered":"2024-09-22T08:10:45.169110+0000","last_unstale":"2024-09-22T08:13:53.254858+0000","last_undegraded":"2024-09-22T08:13:53.254858+0000","last_fullsized":"2024-09-22T08:13:53.254858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:13.716183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.842269+0000","last_change":"2024-09-22T08:14:15.842211+0000","last_active":"2024-09-22T08:14:15.842269+0000","last_peered":"2024-09-22T08:14:15.842269+0000","last_clean":"2024-09-22T08:14:15.842269+0000","last_became_active":"2024-09-22T08:10:43.180088+0000","last_became_peered":"2024-09-22T08:10:43.180088+0000","last_unstale":"2024-09-22T08:14:15.842269+0000","last_undegraded":"2024-09-22T08:14:15.842269+0000","last_fullsized":"2024-09-22T08:14:15.842269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:15.842123+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:15.842123+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.842123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:45.525671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.022431+0000","last_change":"2024-09-22T08:14:32.022431+0000","last_active":"2024-09-22T08:14:32.022431+0000","last_peered":"2024-09-22T08:14:32.022431+0000","last_clean":"2024-09-22T08:14:32.022431+0000","last_became_active":"2024-09-22T08:11:23.220081+0000","last_became_peered":"2024-09-22T08:11:23.220081+0000","last_unstale":"2024-09-22T08:14:32.022431+0000","last_undegraded":"2024-09-22T08:14:32.022431+0000","last_fullsized":"2024-09-22T08:14:32.022431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:32.022345+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:32.022345+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.022345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:29.472018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.226178+0000","last_change":"2024-09-22T08:14:30.226178+0000","last_active":"2024-09-22T08:14:30.226178+0000","last_peered":"2024-09-22T08:14:30.226178+0000","last_clean":"2024-09-22T08:14:30.226178+0000","last_became_active":"2024-09-22T08:10:43.200013+0000","last_became_peered":"2024-09-22T08:10:43.200013+0000","last_unstale":"2024-09-22T08:14:30.226178+0000","last_undegraded":"2024-09-22T08:14:30.226178+0000","last_fullsized":"2024-09-22T08:14:30.226178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:30.226084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:30.226084+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.226084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:55.632963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.722804+0000","last_change":"2024-09-22T08:14:34.722804+0000","last_active":"2024-09-22T08:14:34.722804+0000","last_peered":"2024-09-22T08:14:34.722804+0000","last_clean":"2024-09-22T08:14:34.722804+0000","last_became_active":"2024-09-22T08:10:45.176491+0000","last_became_peered":"2024-09-22T08:10:45.176491+0000","last_unstale":"2024-09-22T08:14:34.722804+0000","last_undegraded":"2024-09-22T08:14:34.722804+0000","last_fullsized":"2024-09-22T08:14:34.722804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:34.722708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:34.722708+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.722708+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:38.943762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.876908+0000","last_change":"2024-09-22T08:14:17.876908+0000","last_active":"2024-09-22T08:14:17.876908+0000","last_peered":"2024-09-22T08:14:17.876908+0000","last_clean":"2024-09-22T08:14:17.876908+0000","last_became_active":"2024-09-22T08:10:43.172330+0000","last_became_peered":"2024-09-22T08:10:43.172330+0000","last_unstale":"2024-09-22T08:14:17.876908+0000","last_undegraded":"2024-09-22T08:14:17.876908+0000","last_fullsized":"2024-09-22T08:14:17.876908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.876812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.876812+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.876812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:40.745057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.951226+0000","last_change":"2024-09-22T08:10:45.176141+0000","last_active":"2024-09-22T08:13:52.951226+0000","last_peered":"2024-09-22T08:13:52.951226+0000","last_clean":"2024-09-22T08:13:52.951226+0000","last_became_active":"2024-09-22T08:10:45.175775+0000","last_became_peered":"2024-09-22T08:10:45.175775+0000","last_unstale":"2024-09-22T08:13:52.951226+0000","last_undegraded":"2024-09-22T08:13:52.951226+0000","last_fullsized":"2024-09-22T08:13:52.951226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:08.930275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.213597+0000","last_change":"2024-09-22T08:14:28.213597+0000","last_active":"2024-09-22T08:14:28.213597+0000","last_peered":"2024-09-22T08:14:28.213597+0000","last_clean":"2024-09-22T08:14:28.213597+0000","last_became_active":"2024-09-22T08:10:43.187858+0000","last_became_peered":"2024-09-22T08:10:43.187858+0000","last_unstale":"2024-09-22T08:14:28.213597+0000","last_undegraded":"2024-09-22T08:14:28.213597+0000","last_fullsized":"2024-09-22T08:14:28.213597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:28.213514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:28.213514+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.213514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:21.439787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.959963+0000","last_change":"2024-09-22T08:14:28.959963+0000","last_active":"2024-09-22T08:14:28.959963+0000","last_peered":"2024-09-22T08:14:28.959963+0000","last_clean":"2024-09-22T08:14:28.959963+0000","last_became_active":"2024-09-22T08:10:45.179870+0000","last_became_peered":"2024-09-22T08:10:45.179870+0000","last_unstale":"2024-09-22T08:14:28.959963+0000","last_undegraded":"2024-09-22T08:14:28.959963+0000","last_fullsized":"2024-09-22T08:14:28.959963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:28.959878+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:28.959878+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.959878+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:57:09.248946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.896554+0000","last_change":"2024-09-22T08:14:16.896554+0000","last_active":"2024-09-22T08:14:16.896554+0000","last_peered":"2024-09-22T08:14:16.896554+0000","last_clean":"2024-09-22T08:14:16.896554+0000","last_became_active":"2024-09-22T08:10:43.178146+0000","last_became_peered":"2024-09-22T08:10:43.178146+0000","last_unstale":"2024-09-22T08:14:16.896554+0000","last_undegraded":"2024-09-22T08:14:16.896554+0000","last_fullsized":"2024-09-22T08:14:16.896554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:16.896443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:16.896443+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.896443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:40.881321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.986942+0000","last_change":"2024-09-22T08:14:29.986942+0000","last_active":"2024-09-22T08:14:29.986942+0000","last_peered":"2024-09-22T08:14:29.986942+0000","last_clean":"2024-09-22T08:14:29.986942+0000","last_became_active":"2024-09-22T08:10:45.177101+0000","last_became_peered":"2024-09-22T08:10:45.177101+0000","last_unstale":"2024-09-22T08:14:29.986942+0000","last_undegraded":"2024-09-22T08:14:29.986942+0000","last_fullsized":"2024-09-22T08:14:29.986942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:29.986860+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:29.986860+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.986860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:26.079898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.828898+0000","last_change":"2024-09-22T08:10:45.170689+0000","last_active":"2024-09-22T08:12:08.828898+0000","last_peered":"2024-09-22T08:12:08.828898+0000","last_clean":"2024-09-22T08:12:08.828898+0000","last_became_active":"2024-09-22T08:10:45.169140+0000","last_became_peered":"2024-09-22T08:10:45.169140+0000","last_unstale":"2024-09-22T08:12:08.828898+0000","last_undegraded":"2024-09-22T08:12:08.828898+0000","last_fullsized":"2024-09-22T08:12:08.828898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:02.240838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.805924+0000","last_change":"2024-09-22T08:14:16.805924+0000","last_active":"2024-09-22T08:14:16.805924+0000","last_peered":"2024-09-22T08:14:16.805924+0000","last_clean":"2024-09-22T08:14:16.805924+0000","last_became_active":"2024-09-22T08:10:43.185301+0000","last_became_peered":"2024-09-22T08:10:43.185301+0000","last_unstale":"2024-09-22T08:14:16.805924+0000","last_undegraded":"2024-09-22T08:14:16.805924+0000","last_fullsized":"2024-09-22T08:14:16.805924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:16.805805+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:16.805805+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.805805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:11.575658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.829126+0000","last_change":"2024-09-22T08:14:29.829126+0000","last_active":"2024-09-22T08:14:29.829126+0000","last_peered":"2024-09-22T08:14:29.829126+0000","last_clean":"2024-09-22T08:14:29.829126+0000","last_became_active":"2024-09-22T08:10:45.172557+0000","last_became_peered":"2024-09-22T08:10:45.172557+0000","last_unstale":"2024-09-22T08:14:29.829126+0000","last_undegraded":"2024-09-22T08:14:29.829126+0000","last_fullsized":"2024-09-22T08:14:29.829126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:29.829030+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:29.829030+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.829030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:18.653579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.821331+0000","last_change":"2024-09-22T08:14:14.821331+0000","last_active":"2024-09-22T08:14:14.821331+0000","last_peered":"2024-09-22T08:14:14.821331+0000","last_clean":"2024-09-22T08:14:14.821331+0000","last_became_active":"2024-09-22T08:10:43.189273+0000","last_became_peered":"2024-09-22T08:10:43.189273+0000","last_unstale":"2024-09-22T08:14:14.821331+0000","last_undegraded":"2024-09-22T08:14:14.821331+0000","last_fullsized":"2024-09-22T08:14:14.821331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:14.821242+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:14.821242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.821242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:39.122357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.726995+0000","last_change":"2024-09-22T08:14:36.726995+0000","last_active":"2024-09-22T08:14:36.726995+0000","last_peered":"2024-09-22T08:14:36.726995+0000","last_clean":"2024-09-22T08:14:36.726995+0000","last_became_active":"2024-09-22T08:10:45.176885+0000","last_became_peered":"2024-09-22T08:10:45.176885+0000","last_unstale":"2024-09-22T08:14:36.726995+0000","last_undegraded":"2024-09-22T08:14:36.726995+0000","last_fullsized":"2024-09-22T08:14:36.726995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:36.726901+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:36.726901+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.726901+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:42.806466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.813396+0000","last_change":"2024-09-22T08:14:15.813396+0000","last_active":"2024-09-22T08:14:15.813396+0000","last_peered":"2024-09-22T08:14:15.813396+0000","last_clean":"2024-09-22T08:14:15.813396+0000","last_became_active":"2024-09-22T08:10:43.183887+0000","last_became_peered":"2024-09-22T08:10:43.183887+0000","last_unstale":"2024-09-22T08:14:15.813396+0000","last_undegraded":"2024-09-22T08:14:15.813396+0000","last_fullsized":"2024-09-22T08:14:15.813396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:15.813300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:15.813300+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.813300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:39.476435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.998449+0000","last_change":"2024-09-22T08:14:28.998449+0000","last_active":"2024-09-22T08:14:28.998449+0000","last_peered":"2024-09-22T08:14:28.998449+0000","last_clean":"2024-09-22T08:14:28.998449+0000","last_became_active":"2024-09-22T08:10:45.171492+0000","last_became_peered":"2024-09-22T08:10:45.171492+0000","last_unstale":"2024-09-22T08:14:28.998449+0000","last_undegraded":"2024-09-22T08:14:28.998449+0000","last_fullsized":"2024-09-22T08:14:28.998449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:28.998358+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:28.998358+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.998358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:54.381452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.797115+0000","last_change":"2024-09-22T08:14:12.797115+0000","last_active":"2024-09-22T08:14:12.797115+0000","last_peered":"2024-09-22T08:14:12.797115+0000","last_clean":"2024-09-22T08:14:12.797115+0000","last_became_active":"2024-09-22T08:10:43.179133+0000","last_became_peered":"2024-09-22T08:10:43.179133+0000","last_unstale":"2024-09-22T08:14:12.797115+0000","last_undegraded":"2024-09-22T08:14:12.797115+0000","last_fullsized":"2024-09-22T08:14:12.797115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-22T08:14:12.797035+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-22T08:14:12.797035+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.797035+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:51.512160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13,"num_write":24,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.927145+0000","last_change":"2024-09-22T08:14:27.927145+0000","last_active":"2024-09-22T08:14:27.927145+0000","last_peered":"2024-09-22T08:14:27.927145+0000","last_clean":"2024-09-22T08:14:27.927145+0000","last_became_active":"2024-09-22T08:10:45.173524+0000","last_became_peered":"2024-09-22T08:10:45.173524+0000","last_unstale":"2024-09-22T08:14:27.927145+0000","last_undegraded":"2024-09-22T08:14:27.927145+0000","last_fullsized":"2024-09-22T08:14:27.927145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:27.927054+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:27.927054+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.927054+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:21.773609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.847627+0000","last_change":"2024-09-22T08:14:15.847627+0000","last_active":"2024-09-22T08:14:15.847627+0000","last_peered":"2024-09-22T08:14:15.847627+0000","last_clean":"2024-09-22T08:14:15.847627+0000","last_became_active":"2024-09-22T08:10:43.186739+0000","last_became_peered":"2024-09-22T08:10:43.186739+0000","last_unstale":"2024-09-22T08:14:15.847627+0000","last_undegraded":"2024-09-22T08:14:15.847627+0000","last_fullsized":"2024-09-22T08:14:15.847627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:15.847522+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:15.847522+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.847522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:31.369309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.813445+0000","last_change":"2024-09-22T08:14:31.813445+0000","last_active":"2024-09-22T08:14:31.813445+0000","last_peered":"2024-09-22T08:14:31.813445+0000","last_clean":"2024-09-22T08:14:31.813445+0000","last_became_active":"2024-09-22T08:10:45.170247+0000","last_became_peered":"2024-09-22T08:10:45.170247+0000","last_unstale":"2024-09-22T08:14:31.813445+0000","last_undegraded":"2024-09-22T08:14:31.813445+0000","last_fullsized":"2024-09-22T08:14:31.813445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.813353+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.813353+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.813353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:57.196447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.204535+0000","last_change":"2024-09-22T08:14:29.204535+0000","last_active":"2024-09-22T08:14:29.204535+0000","last_peered":"2024-09-22T08:14:29.204535+0000","last_clean":"2024-09-22T08:14:29.204535+0000","last_became_active":"2024-09-22T08:10:43.190674+0000","last_became_peered":"2024-09-22T08:10:43.190674+0000","last_unstale":"2024-09-22T08:14:29.204535+0000","last_undegraded":"2024-09-22T08:14:29.204535+0000","last_fullsized":"2024-09-22T08:14:29.204535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:29.204435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:29.204435+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.204435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:48.655553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.206848+0000","last_change":"2024-09-22T08:10:53.203618+0000","last_active":"2024-09-22T08:13:53.206848+0000","last_peered":"2024-09-22T08:13:53.206848+0000","last_clean":"2024-09-22T08:13:53.206848+0000","last_became_active":"2024-09-22T08:10:53.203146+0000","last_became_peered":"2024-09-22T08:10:53.203146+0000","last_unstale":"2024-09-22T08:13:53.206848+0000","last_undegraded":"2024-09-22T08:13:53.206848+0000","last_fullsized":"2024-09-22T08:13:53.206848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:09.081236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.063669+0000","last_change":"2024-09-22T08:14:38.063669+0000","last_active":"2024-09-22T08:14:38.063669+0000","last_peered":"2024-09-22T08:14:38.063669+0000","last_clean":"2024-09-22T08:14:38.063669+0000","last_became_active":"2024-09-22T08:10:45.168308+0000","last_became_peered":"2024-09-22T08:10:45.168308+0000","last_unstale":"2024-09-22T08:14:38.063669+0000","last_undegraded":"2024-09-22T08:14:38.063669+0000","last_fullsized":"2024-09-22T08:14:38.063669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:38.063566+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:38.063566+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.063566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:58.873201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.270316+0000","last_change":"2024-09-22T08:14:17.270316+0000","last_active":"2024-09-22T08:14:17.270316+0000","last_peered":"2024-09-22T08:14:17.270316+0000","last_clean":"2024-09-22T08:14:17.270316+0000","last_became_active":"2024-09-22T08:10:43.200307+0000","last_became_peered":"2024-09-22T08:10:43.200307+0000","last_unstale":"2024-09-22T08:14:17.270316+0000","last_undegraded":"2024-09-22T08:14:17.270316+0000","last_fullsized":"2024-09-22T08:14:17.270316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.270212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.270212+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.270212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:29.835254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210664+0000","last_change":"2024-09-22T08:10:47.176870+0000","last_active":"2024-09-22T08:11:23.210664+0000","last_peered":"2024-09-22T08:11:23.210664+0000","last_clean":"2024-09-22T08:11:23.210664+0000","last_became_active":"2024-09-22T08:10:47.176568+0000","last_became_peered":"2024-09-22T08:10:47.176568+0000","last_unstale":"2024-09-22T08:11:23.210664+0000","last_undegraded":"2024-09-22T08:11:23.210664+0000","last_fullsized":"2024-09-22T08:11:23.210664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:37:55.338812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.858403+0000","last_change":"2024-09-22T08:10:49.189137+0000","last_active":"2024-09-22T08:13:59.858403+0000","last_peered":"2024-09-22T08:13:59.858403+0000","last_clean":"2024-09-22T08:13:59.858403+0000","last_became_active":"2024-09-22T08:10:49.188697+0000","last_became_peered":"2024-09-22T08:10:49.188697+0000","last_unstale":"2024-09-22T08:13:59.858403+0000","last_undegraded":"2024-09-22T08:13:59.858403+0000","last_fullsized":"2024-09-22T08:13:59.858403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:20.077797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216659+0000","last_change":"2024-09-22T08:10:51.202175+0000","last_active":"2024-09-22T08:11:23.216659+0000","last_peered":"2024-09-22T08:11:23.216659+0000","last_clean":"2024-09-22T08:11:23.216659+0000","last_became_active":"2024-09-22T08:10:51.201855+0000","last_became_peered":"2024-09-22T08:10:51.201855+0000","last_unstale":"2024-09-22T08:11:23.216659+0000","last_undegraded":"2024-09-22T08:11:23.216659+0000","last_fullsized":"2024-09-22T08:11:23.216659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'11","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.833839+0000","last_change":"2024-09-22T08:10:53.204685+0000","last_active":"2024-09-22T08:12:08.833839+0000","last_peered":"2024-09-22T08:12:08.833839+0000","last_clean":"2024-09-22T08:12:08.833839+0000","last_became_active":"2024-09-22T08:10:53.204407+0000","last_became_peered":"2024-09-22T08:10:53.204407+0000","last_unstale":"2024-09-22T08:12:08.833839+0000","last_undegraded":"2024-09-22T08:12:08.833839+0000","last_fullsized":"2024-09-22T08:12:08.833839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:07.954674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'16","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.067176+0000","last_change":"2024-09-22T08:14:39.067176+0000","last_active":"2024-09-22T08:14:39.067176+0000","last_peered":"2024-09-22T08:14:39.067176+0000","last_clean":"2024-09-22T08:14:39.067176+0000","last_became_active":"2024-09-22T08:10:45.170765+0000","last_became_peered":"2024-09-22T08:10:45.170765+0000","last_unstale":"2024-09-22T08:14:39.067176+0000","last_undegraded":"2024-09-22T08:14:39.067176+0000","last_fullsized":"2024-09-22T08:14:39.067176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-22T08:14:39.067085+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-22T08:14:39.067085+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.067085+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:09.486443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.743684+0000","last_change":"2024-09-22T08:14:08.743684+0000","last_active":"2024-09-22T08:14:08.743684+0000","last_peered":"2024-09-22T08:14:08.743684+0000","last_clean":"2024-09-22T08:14:08.743684+0000","last_became_active":"2024-09-22T08:10:43.180600+0000","last_became_peered":"2024-09-22T08:10:43.180600+0000","last_unstale":"2024-09-22T08:14:08.743684+0000","last_undegraded":"2024-09-22T08:14:08.743684+0000","last_fullsized":"2024-09-22T08:14:08.743684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.743587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.743587+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.743587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:44.284655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.913847+0000","last_change":"2024-09-22T08:14:36.913847+0000","last_active":"2024-09-22T08:14:36.913847+0000","last_peered":"2024-09-22T08:14:36.913847+0000","last_clean":"2024-09-22T08:14:36.913847+0000","last_became_active":"2024-09-22T08:10:47.167913+0000","last_became_peered":"2024-09-22T08:10:47.167913+0000","last_unstale":"2024-09-22T08:14:36.913847+0000","last_undegraded":"2024-09-22T08:14:36.913847+0000","last_fullsized":"2024-09-22T08:14:36.913847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:36.913756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:36.913756+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.913756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:18.021625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216231+0000","last_change":"2024-09-22T08:10:49.182777+0000","last_active":"2024-09-22T08:11:23.216231+0000","last_peered":"2024-09-22T08:11:23.216231+0000","last_clean":"2024-09-22T08:11:23.216231+0000","last_became_active":"2024-09-22T08:10:49.182481+0000","last_became_peered":"2024-09-22T08:10:49.182481+0000","last_unstale":"2024-09-22T08:11:23.216231+0000","last_undegraded":"2024-09-22T08:11:23.216231+0000","last_fullsized":"2024-09-22T08:11:23.216231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:56.405074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.215699+0000","last_change":"2024-09-22T08:10:51.200151+0000","last_active":"2024-09-22T08:11:23.215699+0000","last_peered":"2024-09-22T08:11:23.215699+0000","last_clean":"2024-09-22T08:11:23.215699+0000","last_became_active":"2024-09-22T08:10:51.199837+0000","last_became_peered":"2024-09-22T08:10:51.199837+0000","last_unstale":"2024-09-22T08:11:23.215699+0000","last_undegraded":"2024-09-22T08:11:23.215699+0000","last_fullsized":"2024-09-22T08:11:23.215699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220094+0000","last_change":"2024-09-22T08:10:53.199608+0000","last_active":"2024-09-22T08:11:23.220094+0000","last_peered":"2024-09-22T08:11:23.220094+0000","last_clean":"2024-09-22T08:11:23.220094+0000","last_became_active":"2024-09-22T08:10:53.199303+0000","last_became_peered":"2024-09-22T08:10:53.199303+0000","last_unstale":"2024-09-22T08:11:23.220094+0000","last_undegraded":"2024-09-22T08:11:23.220094+0000","last_fullsized":"2024-09-22T08:11:23.220094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:27.339830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.101518+0000","last_change":"2024-09-22T08:14:40.101518+0000","last_active":"2024-09-22T08:14:40.101518+0000","last_peered":"2024-09-22T08:14:40.101518+0000","last_clean":"2024-09-22T08:14:40.101518+0000","last_became_active":"2024-09-22T08:10:45.168554+0000","last_became_peered":"2024-09-22T08:10:45.168554+0000","last_unstale":"2024-09-22T08:14:40.101518+0000","last_undegraded":"2024-09-22T08:14:40.101518+0000","last_fullsized":"2024-09-22T08:14:40.101518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:40.101418+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:40.101418+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.101418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:35.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.265298+0000","last_change":"2024-09-22T08:14:16.265298+0000","last_active":"2024-09-22T08:14:16.265298+0000","last_peered":"2024-09-22T08:14:16.265298+0000","last_clean":"2024-09-22T08:14:16.265298+0000","last_became_active":"2024-09-22T08:10:43.189333+0000","last_became_peered":"2024-09-22T08:10:43.189333+0000","last_unstale":"2024-09-22T08:14:16.265298+0000","last_undegraded":"2024-09-22T08:14:16.265298+0000","last_fullsized":"2024-09-22T08:14:16.265298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:16.265216+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:16.265216+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.265216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:42.490080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.937678+0000","last_change":"2024-09-22T08:14:37.937678+0000","last_active":"2024-09-22T08:14:37.937678+0000","last_peered":"2024-09-22T08:14:37.937678+0000","last_clean":"2024-09-22T08:14:37.937678+0000","last_became_active":"2024-09-22T08:10:47.175959+0000","last_became_peered":"2024-09-22T08:10:47.175959+0000","last_unstale":"2024-09-22T08:14:37.937678+0000","last_undegraded":"2024-09-22T08:14:37.937678+0000","last_fullsized":"2024-09-22T08:14:37.937678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:37.937584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:37.937584+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.937584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:19.341899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207630+0000","last_change":"2024-09-22T08:10:49.185591+0000","last_active":"2024-09-22T08:11:23.207630+0000","last_peered":"2024-09-22T08:11:23.207630+0000","last_clean":"2024-09-22T08:11:23.207630+0000","last_became_active":"2024-09-22T08:10:49.185269+0000","last_became_peered":"2024-09-22T08:10:49.185269+0000","last_unstale":"2024-09-22T08:11:23.207630+0000","last_undegraded":"2024-09-22T08:11:23.207630+0000","last_fullsized":"2024-09-22T08:11:23.207630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:49.872968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.794235+0000","last_change":"2024-09-22T08:10:51.196489+0000","last_active":"2024-09-22T08:13:59.794235+0000","last_peered":"2024-09-22T08:13:59.794235+0000","last_clean":"2024-09-22T08:13:59.794235+0000","last_became_active":"2024-09-22T08:10:51.196199+0000","last_became_peered":"2024-09-22T08:10:51.196199+0000","last_unstale":"2024-09-22T08:13:59.794235+0000","last_undegraded":"2024-09-22T08:13:59.794235+0000","last_fullsized":"2024-09-22T08:13:59.794235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:26.614683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.217337+0000","last_change":"2024-09-22T08:10:53.194394+0000","last_active":"2024-09-22T08:13:53.217337+0000","last_peered":"2024-09-22T08:13:53.217337+0000","last_clean":"2024-09-22T08:13:53.217337+0000","last_became_active":"2024-09-22T08:10:53.194118+0000","last_became_peered":"2024-09-22T08:10:53.194118+0000","last_unstale":"2024-09-22T08:13:53.217337+0000","last_undegraded":"2024-09-22T08:13:53.217337+0000","last_fullsized":"2024-09-22T08:13:53.217337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:00.285903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.867755+0000","last_change":"2024-09-22T08:14:20.867755+0000","last_active":"2024-09-22T08:14:20.867755+0000","last_peered":"2024-09-22T08:14:20.867755+0000","last_clean":"2024-09-22T08:14:20.867755+0000","last_became_active":"2024-09-22T08:10:45.183307+0000","last_became_peered":"2024-09-22T08:10:45.183307+0000","last_unstale":"2024-09-22T08:14:20.867755+0000","last_undegraded":"2024-09-22T08:14:20.867755+0000","last_fullsized":"2024-09-22T08:14:20.867755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:20.867654+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:20.867654+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.867654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:26.987640+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.753375+0000","last_change":"2024-09-22T08:14:05.753375+0000","last_active":"2024-09-22T08:14:05.753375+0000","last_peered":"2024-09-22T08:14:05.753375+0000","last_clean":"2024-09-22T08:14:05.753375+0000","last_became_active":"2024-09-22T08:10:43.187835+0000","last_became_peered":"2024-09-22T08:10:43.187835+0000","last_unstale":"2024-09-22T08:14:05.753375+0000","last_undegraded":"2024-09-22T08:14:05.753375+0000","last_fullsized":"2024-09-22T08:14:05.753375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.753280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.753280+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.753280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:33.618928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211282+0000","last_change":"2024-09-22T08:10:47.175684+0000","last_active":"2024-09-22T08:11:23.211282+0000","last_peered":"2024-09-22T08:11:23.211282+0000","last_clean":"2024-09-22T08:11:23.211282+0000","last_became_active":"2024-09-22T08:10:47.175386+0000","last_became_peered":"2024-09-22T08:10:47.175386+0000","last_unstale":"2024-09-22T08:11:23.211282+0000","last_undegraded":"2024-09-22T08:11:23.211282+0000","last_fullsized":"2024-09-22T08:11:23.211282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:02:48.587319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.842635+0000","last_change":"2024-09-22T08:10:49.185291+0000","last_active":"2024-09-22T08:13:59.842635+0000","last_peered":"2024-09-22T08:13:59.842635+0000","last_clean":"2024-09-22T08:13:59.842635+0000","last_became_active":"2024-09-22T08:10:49.184963+0000","last_became_peered":"2024-09-22T08:10:49.184963+0000","last_unstale":"2024-09-22T08:13:59.842635+0000","last_undegraded":"2024-09-22T08:13:59.842635+0000","last_fullsized":"2024-09-22T08:13:59.842635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:53.469586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":445,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.799214+0000","last_change":"2024-09-22T08:10:51.193999+0000","last_active":"2024-09-22T08:13:59.799214+0000","last_peered":"2024-09-22T08:13:59.799214+0000","last_clean":"2024-09-22T08:13:59.799214+0000","last_became_active":"2024-09-22T08:10:51.193678+0000","last_became_peered":"2024-09-22T08:10:51.193678+0000","last_unstale":"2024-09-22T08:13:59.799214+0000","last_undegraded":"2024-09-22T08:13:59.799214+0000","last_fullsized":"2024-09-22T08:13:59.799214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:48.665863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.079772+0000","last_change":"2024-09-22T08:14:35.079772+0000","last_active":"2024-09-22T08:14:35.079772+0000","last_peered":"2024-09-22T08:14:35.079772+0000","last_clean":"2024-09-22T08:14:35.079772+0000","last_became_active":"2024-09-22T08:10:45.183598+0000","last_became_peered":"2024-09-22T08:10:45.183598+0000","last_unstale":"2024-09-22T08:14:35.079772+0000","last_undegraded":"2024-09-22T08:14:35.079772+0000","last_fullsized":"2024-09-22T08:14:35.079772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:35.079690+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:35.079690+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.079690+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:13.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.780412+0000","last_change":"2024-09-22T08:14:07.780412+0000","last_active":"2024-09-22T08:14:07.780412+0000","last_peered":"2024-09-22T08:14:07.780412+0000","last_clean":"2024-09-22T08:14:07.780412+0000","last_became_active":"2024-09-22T08:10:43.173543+0000","last_became_peered":"2024-09-22T08:10:43.173543+0000","last_unstale":"2024-09-22T08:14:07.780412+0000","last_undegraded":"2024-09-22T08:14:07.780412+0000","last_fullsized":"2024-09-22T08:14:07.780412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:07.780321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:07.780321+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.780321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:56.960543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.761582+0000","last_change":"2024-09-22T08:14:38.761582+0000","last_active":"2024-09-22T08:14:38.761582+0000","last_peered":"2024-09-22T08:14:38.761582+0000","last_clean":"2024-09-22T08:14:38.761582+0000","last_became_active":"2024-09-22T08:10:47.176657+0000","last_became_peered":"2024-09-22T08:10:47.176657+0000","last_unstale":"2024-09-22T08:14:38.761582+0000","last_undegraded":"2024-09-22T08:14:38.761582+0000","last_fullsized":"2024-09-22T08:14:38.761582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:38.761498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:38.761498+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.761498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:54.171137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.965752+0000","last_change":"2024-09-22T08:14:38.965752+0000","last_active":"2024-09-22T08:14:38.965752+0000","last_peered":"2024-09-22T08:14:38.965752+0000","last_clean":"2024-09-22T08:14:38.965752+0000","last_became_active":"2024-09-22T08:10:49.182985+0000","last_became_peered":"2024-09-22T08:10:49.182985+0000","last_unstale":"2024-09-22T08:14:38.965752+0000","last_undegraded":"2024-09-22T08:14:38.965752+0000","last_fullsized":"2024-09-22T08:14:38.965752+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-22T08:14:38.965657+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-22T08:14:38.965657+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.965657+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:27.222048+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222432+0000","last_change":"2024-09-22T08:10:51.193335+0000","last_active":"2024-09-22T08:11:23.222432+0000","last_peered":"2024-09-22T08:11:23.222432+0000","last_clean":"2024-09-22T08:11:23.222432+0000","last_became_active":"2024-09-22T08:10:51.192623+0000","last_became_peered":"2024-09-22T08:10:51.192623+0000","last_unstale":"2024-09-22T08:11:23.222432+0000","last_undegraded":"2024-09-22T08:11:23.222432+0000","last_fullsized":"2024-09-22T08:11:23.222432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.835562+0000","last_change":"2024-09-22T08:10:53.198555+0000","last_active":"2024-09-22T08:12:08.835562+0000","last_peered":"2024-09-22T08:12:08.835562+0000","last_clean":"2024-09-22T08:12:08.835562+0000","last_became_active":"2024-09-22T08:10:53.198219+0000","last_became_peered":"2024-09-22T08:10:53.198219+0000","last_unstale":"2024-09-22T08:12:08.835562+0000","last_undegraded":"2024-09-22T08:12:08.835562+0000","last_fullsized":"2024-09-22T08:12:08.835562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:04.308739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.853871+0000","last_change":"2024-09-22T08:14:20.853871+0000","last_active":"2024-09-22T08:14:20.853871+0000","last_peered":"2024-09-22T08:14:20.853871+0000","last_clean":"2024-09-22T08:14:20.853871+0000","last_became_active":"2024-09-22T08:10:45.171911+0000","last_became_peered":"2024-09-22T08:10:45.171911+0000","last_unstale":"2024-09-22T08:14:20.853871+0000","last_undegraded":"2024-09-22T08:14:20.853871+0000","last_fullsized":"2024-09-22T08:14:20.853871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:20.853779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:20.853779+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.853779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:02.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.794540+0000","last_change":"2024-09-22T08:14:06.794540+0000","last_active":"2024-09-22T08:14:06.794540+0000","last_peered":"2024-09-22T08:14:06.794540+0000","last_clean":"2024-09-22T08:14:06.794540+0000","last_became_active":"2024-09-22T08:10:43.189780+0000","last_became_peered":"2024-09-22T08:10:43.189780+0000","last_unstale":"2024-09-22T08:14:06.794540+0000","last_undegraded":"2024-09-22T08:14:06.794540+0000","last_fullsized":"2024-09-22T08:14:06.794540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:06.794440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:06.794440+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.794440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:21.869262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.016936+0000","last_change":"2024-09-22T08:14:33.016936+0000","last_active":"2024-09-22T08:14:33.016936+0000","last_peered":"2024-09-22T08:14:33.016936+0000","last_clean":"2024-09-22T08:14:33.016936+0000","last_became_active":"2024-09-22T08:10:47.177695+0000","last_became_peered":"2024-09-22T08:10:47.177695+0000","last_unstale":"2024-09-22T08:14:33.016936+0000","last_undegraded":"2024-09-22T08:14:33.016936+0000","last_fullsized":"2024-09-22T08:14:33.016936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:33.016843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:33.016843+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.016843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:37.907092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.917701+0000","last_change":"2024-09-22T08:10:49.185696+0000","last_active":"2024-09-22T08:13:59.917701+0000","last_peered":"2024-09-22T08:13:59.917701+0000","last_clean":"2024-09-22T08:13:59.917701+0000","last_became_active":"2024-09-22T08:10:49.185419+0000","last_became_peered":"2024-09-22T08:10:49.185419+0000","last_unstale":"2024-09-22T08:13:59.917701+0000","last_undegraded":"2024-09-22T08:13:59.917701+0000","last_fullsized":"2024-09-22T08:13:59.917701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:57.299371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221426+0000","last_change":"2024-09-22T08:10:51.202896+0000","last_active":"2024-09-22T08:11:23.221426+0000","last_peered":"2024-09-22T08:11:23.221426+0000","last_clean":"2024-09-22T08:11:23.221426+0000","last_became_active":"2024-09-22T08:10:51.202564+0000","last_became_peered":"2024-09-22T08:10:51.202564+0000","last_unstale":"2024-09-22T08:11:23.221426+0000","last_undegraded":"2024-09-22T08:11:23.221426+0000","last_fullsized":"2024-09-22T08:11:23.221426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:58.270948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:03.306650+0000","last_change":"2024-09-22T08:10:53.196844+0000","last_active":"2024-09-22T08:12:03.306650+0000","last_peered":"2024-09-22T08:12:03.306650+0000","last_clean":"2024-09-22T08:12:03.306650+0000","last_became_active":"2024-09-22T08:10:53.196392+0000","last_became_peered":"2024-09-22T08:10:53.196392+0000","last_unstale":"2024-09-22T08:12:03.306650+0000","last_undegraded":"2024-09-22T08:12:03.306650+0000","last_fullsized":"2024-09-22T08:12:03.306650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:30.239443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.834249+0000","last_change":"2024-09-22T08:14:18.834249+0000","last_active":"2024-09-22T08:14:18.834249+0000","last_peered":"2024-09-22T08:14:18.834249+0000","last_clean":"2024-09-22T08:14:18.834249+0000","last_became_active":"2024-09-22T08:10:45.177530+0000","last_became_peered":"2024-09-22T08:10:45.177530+0000","last_unstale":"2024-09-22T08:14:18.834249+0000","last_undegraded":"2024-09-22T08:14:18.834249+0000","last_fullsized":"2024-09-22T08:14:18.834249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:18.834156+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.834156+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.834156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:22.288734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.250010+0000","last_change":"2024-09-22T08:14:15.250010+0000","last_active":"2024-09-22T08:14:15.250010+0000","last_peered":"2024-09-22T08:14:15.250010+0000","last_clean":"2024-09-22T08:14:15.250010+0000","last_became_active":"2024-09-22T08:10:43.201669+0000","last_became_peered":"2024-09-22T08:10:43.201669+0000","last_unstale":"2024-09-22T08:14:15.250010+0000","last_undegraded":"2024-09-22T08:14:15.250010+0000","last_fullsized":"2024-09-22T08:14:15.250010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:15.249925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:15.249925+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.249925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:10.670160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.960461+0000","last_change":"2024-09-22T08:14:35.960461+0000","last_active":"2024-09-22T08:14:35.960461+0000","last_peered":"2024-09-22T08:14:35.960461+0000","last_clean":"2024-09-22T08:14:35.960461+0000","last_became_active":"2024-09-22T08:10:47.177613+0000","last_became_peered":"2024-09-22T08:10:47.177613+0000","last_unstale":"2024-09-22T08:14:35.960461+0000","last_undegraded":"2024-09-22T08:14:35.960461+0000","last_fullsized":"2024-09-22T08:14:35.960461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:35.960358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:35.960358+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.960358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:11.564682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'40","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.875765+0000","last_change":"2024-09-22T08:10:49.187229+0000","last_active":"2024-09-22T08:13:59.875765+0000","last_peered":"2024-09-22T08:13:59.875765+0000","last_clean":"2024-09-22T08:13:59.875765+0000","last_became_active":"2024-09-22T08:10:49.186941+0000","last_became_peered":"2024-09-22T08:10:49.186941+0000","last_unstale":"2024-09-22T08:13:59.875765+0000","last_undegraded":"2024-09-22T08:13:59.875765+0000","last_fullsized":"2024-09-22T08:13:59.875765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:28.645390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.800403+0000","last_change":"2024-09-22T08:10:51.192885+0000","last_active":"2024-09-22T08:13:59.800403+0000","last_peered":"2024-09-22T08:13:59.800403+0000","last_clean":"2024-09-22T08:13:59.800403+0000","last_became_active":"2024-09-22T08:10:51.192483+0000","last_became_peered":"2024-09-22T08:10:51.192483+0000","last_unstale":"2024-09-22T08:13:59.800403+0000","last_undegraded":"2024-09-22T08:13:59.800403+0000","last_fullsized":"2024-09-22T08:13:59.800403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:47.260805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222488+0000","last_change":"2024-09-22T08:10:53.199613+0000","last_active":"2024-09-22T08:11:23.222488+0000","last_peered":"2024-09-22T08:11:23.222488+0000","last_clean":"2024-09-22T08:11:23.222488+0000","last_became_active":"2024-09-22T08:10:53.199273+0000","last_became_peered":"2024-09-22T08:10:53.199273+0000","last_unstale":"2024-09-22T08:11:23.222488+0000","last_undegraded":"2024-09-22T08:11:23.222488+0000","last_fullsized":"2024-09-22T08:11:23.222488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:45:07.308140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.865126+0000","last_change":"2024-09-22T08:14:21.865126+0000","last_active":"2024-09-22T08:14:21.865126+0000","last_peered":"2024-09-22T08:14:21.865126+0000","last_clean":"2024-09-22T08:14:21.865126+0000","last_became_active":"2024-09-22T08:10:45.165352+0000","last_became_peered":"2024-09-22T08:10:45.165352+0000","last_unstale":"2024-09-22T08:14:21.865126+0000","last_undegraded":"2024-09-22T08:14:21.865126+0000","last_fullsized":"2024-09-22T08:14:21.865126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:21.865034+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:21.865034+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.865034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:43.503660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.210375+0000","last_change":"2024-09-22T08:14:14.210375+0000","last_active":"2024-09-22T08:14:14.210375+0000","last_peered":"2024-09-22T08:14:14.210375+0000","last_clean":"2024-09-22T08:14:14.210375+0000","last_became_active":"2024-09-22T08:10:43.198696+0000","last_became_peered":"2024-09-22T08:10:43.198696+0000","last_unstale":"2024-09-22T08:14:14.210375+0000","last_undegraded":"2024-09-22T08:14:14.210375+0000","last_fullsized":"2024-09-22T08:14:14.210375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:14.210290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:14.210290+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.210290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:59.541262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.990891+0000","last_change":"2024-09-22T08:14:34.990891+0000","last_active":"2024-09-22T08:14:34.990891+0000","last_peered":"2024-09-22T08:14:34.990891+0000","last_clean":"2024-09-22T08:14:34.990891+0000","last_became_active":"2024-09-22T08:10:47.176263+0000","last_became_peered":"2024-09-22T08:10:47.176263+0000","last_unstale":"2024-09-22T08:14:34.990891+0000","last_undegraded":"2024-09-22T08:14:34.990891+0000","last_fullsized":"2024-09-22T08:14:34.990891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:34.990797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:34.990797+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.990797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:43.649921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'60","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.926835+0000","last_change":"2024-09-22T08:10:49.189658+0000","last_active":"2024-09-22T08:13:59.926835+0000","last_peered":"2024-09-22T08:13:59.926835+0000","last_clean":"2024-09-22T08:13:59.926835+0000","last_became_active":"2024-09-22T08:10:49.188724+0000","last_became_peered":"2024-09-22T08:10:49.188724+0000","last_unstale":"2024-09-22T08:13:59.926835+0000","last_undegraded":"2024-09-22T08:13:59.926835+0000","last_fullsized":"2024-09-22T08:13:59.926835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:49.620069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220087+0000","last_change":"2024-09-22T08:10:51.195268+0000","last_active":"2024-09-22T08:11:23.220087+0000","last_peered":"2024-09-22T08:11:23.220087+0000","last_clean":"2024-09-22T08:11:23.220087+0000","last_became_active":"2024-09-22T08:10:51.194937+0000","last_became_peered":"2024-09-22T08:10:51.194937+0000","last_unstale":"2024-09-22T08:11:23.220087+0000","last_undegraded":"2024-09-22T08:11:23.220087+0000","last_fullsized":"2024-09-22T08:11:23.220087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.350209+0000","last_change":"2024-09-22T08:10:53.201595+0000","last_active":"2024-09-22T08:13:53.350209+0000","last_peered":"2024-09-22T08:13:53.350209+0000","last_clean":"2024-09-22T08:13:53.350209+0000","last_became_active":"2024-09-22T08:10:53.201289+0000","last_became_peered":"2024-09-22T08:10:53.201289+0000","last_unstale":"2024-09-22T08:13:53.350209+0000","last_undegraded":"2024-09-22T08:13:53.350209+0000","last_fullsized":"2024-09-22T08:13:53.350209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:22.640385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.853760+0000","last_change":"2024-09-22T08:14:19.853760+0000","last_active":"2024-09-22T08:14:19.853760+0000","last_peered":"2024-09-22T08:14:19.853760+0000","last_clean":"2024-09-22T08:14:19.853760+0000","last_became_active":"2024-09-22T08:10:45.180762+0000","last_became_peered":"2024-09-22T08:10:45.180762+0000","last_unstale":"2024-09-22T08:14:19.853760+0000","last_undegraded":"2024-09-22T08:14:19.853760+0000","last_fullsized":"2024-09-22T08:14:19.853760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:19.853672+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:19.853672+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.853672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:03.241087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.884829+0000","last_change":"2024-09-22T08:14:08.884829+0000","last_active":"2024-09-22T08:14:08.884829+0000","last_peered":"2024-09-22T08:14:08.884829+0000","last_clean":"2024-09-22T08:14:08.884829+0000","last_became_active":"2024-09-22T08:10:43.177202+0000","last_became_peered":"2024-09-22T08:10:43.177202+0000","last_unstale":"2024-09-22T08:14:08.884829+0000","last_undegraded":"2024-09-22T08:14:08.884829+0000","last_fullsized":"2024-09-22T08:14:08.884829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:08.884729+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:08.884729+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.884729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:59.041707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.999246+0000","last_change":"2024-09-22T08:14:33.999246+0000","last_active":"2024-09-22T08:14:33.999246+0000","last_peered":"2024-09-22T08:14:33.999246+0000","last_clean":"2024-09-22T08:14:33.999246+0000","last_became_active":"2024-09-22T08:10:47.173636+0000","last_became_peered":"2024-09-22T08:10:47.173636+0000","last_unstale":"2024-09-22T08:14:33.999246+0000","last_undegraded":"2024-09-22T08:14:33.999246+0000","last_fullsized":"2024-09-22T08:14:33.999246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:33.999162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:33.999162+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.999162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:41.349638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.929919+0000","last_change":"2024-09-22T08:10:49.175235+0000","last_active":"2024-09-22T08:13:59.929919+0000","last_peered":"2024-09-22T08:13:59.929919+0000","last_clean":"2024-09-22T08:13:59.929919+0000","last_became_active":"2024-09-22T08:10:49.174933+0000","last_became_peered":"2024-09-22T08:10:49.174933+0000","last_unstale":"2024-09-22T08:13:59.929919+0000","last_undegraded":"2024-09-22T08:13:59.929919+0000","last_fullsized":"2024-09-22T08:13:59.929919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:09.101942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212489+0000","last_change":"2024-09-22T08:10:51.195590+0000","last_active":"2024-09-22T08:11:23.212489+0000","last_peered":"2024-09-22T08:11:23.212489+0000","last_clean":"2024-09-22T08:11:23.212489+0000","last_became_active":"2024-09-22T08:10:51.195308+0000","last_became_peered":"2024-09-22T08:10:51.195308+0000","last_unstale":"2024-09-22T08:11:23.212489+0000","last_undegraded":"2024-09-22T08:11:23.212489+0000","last_fullsized":"2024-09-22T08:11:23.212489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:13.979616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584694+0000","last_change":"2024-09-22T08:10:53.201429+0000","last_active":"2024-09-22T08:12:52.584694+0000","last_peered":"2024-09-22T08:12:52.584694+0000","last_clean":"2024-09-22T08:12:52.584694+0000","last_became_active":"2024-09-22T08:10:53.200458+0000","last_became_peered":"2024-09-22T08:10:53.200458+0000","last_unstale":"2024-09-22T08:12:52.584694+0000","last_undegraded":"2024-09-22T08:12:52.584694+0000","last_fullsized":"2024-09-22T08:12:52.584694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:15.839331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.126687+0000","last_change":"2024-09-22T08:14:36.126687+0000","last_active":"2024-09-22T08:14:36.126687+0000","last_peered":"2024-09-22T08:14:36.126687+0000","last_clean":"2024-09-22T08:14:36.126687+0000","last_became_active":"2024-09-22T08:10:45.183258+0000","last_became_peered":"2024-09-22T08:10:45.183258+0000","last_unstale":"2024-09-22T08:14:36.126687+0000","last_undegraded":"2024-09-22T08:14:36.126687+0000","last_fullsized":"2024-09-22T08:14:36.126687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:36.126603+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:36.126603+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.126603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:16.874250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.213044+0000","last_change":"2024-09-22T08:14:13.213044+0000","last_active":"2024-09-22T08:14:13.213044+0000","last_peered":"2024-09-22T08:14:13.213044+0000","last_clean":"2024-09-22T08:14:13.213044+0000","last_became_active":"2024-09-22T08:10:43.195959+0000","last_became_peered":"2024-09-22T08:10:43.195959+0000","last_unstale":"2024-09-22T08:14:13.213044+0000","last_undegraded":"2024-09-22T08:14:13.213044+0000","last_fullsized":"2024-09-22T08:14:13.213044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:13.212946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:13.212946+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.212946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:31.672558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.984929+0000","last_change":"2024-09-22T08:14:32.984929+0000","last_active":"2024-09-22T08:14:32.984929+0000","last_peered":"2024-09-22T08:14:32.984929+0000","last_clean":"2024-09-22T08:14:32.984929+0000","last_became_active":"2024-09-22T08:11:23.214959+0000","last_became_peered":"2024-09-22T08:11:23.214959+0000","last_unstale":"2024-09-22T08:14:32.984929+0000","last_undegraded":"2024-09-22T08:14:32.984929+0000","last_fullsized":"2024-09-22T08:14:32.984929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:32.984850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:32.984850+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.984850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:17.763676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.908174+0000","last_change":"2024-09-22T08:10:49.181291+0000","last_active":"2024-09-22T08:13:59.908174+0000","last_peered":"2024-09-22T08:13:59.908174+0000","last_clean":"2024-09-22T08:13:59.908174+0000","last_became_active":"2024-09-22T08:10:49.180820+0000","last_became_peered":"2024-09-22T08:10:49.180820+0000","last_unstale":"2024-09-22T08:13:59.908174+0000","last_undegraded":"2024-09-22T08:13:59.908174+0000","last_fullsized":"2024-09-22T08:13:59.908174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:56.059910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":435,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.795492+0000","last_change":"2024-09-22T08:10:51.197307+0000","last_active":"2024-09-22T08:13:59.795492+0000","last_peered":"2024-09-22T08:13:59.795492+0000","last_clean":"2024-09-22T08:13:59.795492+0000","last_became_active":"2024-09-22T08:10:51.197020+0000","last_became_peered":"2024-09-22T08:10:51.197020+0000","last_unstale":"2024-09-22T08:13:59.795492+0000","last_undegraded":"2024-09-22T08:13:59.795492+0000","last_fullsized":"2024-09-22T08:13:59.795492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:39.376197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:01.585334+0000","last_change":"2024-09-22T08:10:53.192873+0000","last_active":"2024-09-22T08:13:01.585334+0000","last_peered":"2024-09-22T08:13:01.585334+0000","last_clean":"2024-09-22T08:13:01.585334+0000","last_became_active":"2024-09-22T08:10:53.192481+0000","last_became_peered":"2024-09-22T08:10:53.192481+0000","last_unstale":"2024-09-22T08:13:01.585334+0000","last_undegraded":"2024-09-22T08:13:01.585334+0000","last_fullsized":"2024-09-22T08:13:01.585334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:06.451090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.823199+0000","last_change":"2024-09-22T08:14:20.823199+0000","last_active":"2024-09-22T08:14:20.823199+0000","last_peered":"2024-09-22T08:14:20.823199+0000","last_clean":"2024-09-22T08:14:20.823199+0000","last_became_active":"2024-09-22T08:10:45.172740+0000","last_became_peered":"2024-09-22T08:10:45.172740+0000","last_unstale":"2024-09-22T08:14:20.823199+0000","last_undegraded":"2024-09-22T08:14:20.823199+0000","last_fullsized":"2024-09-22T08:14:20.823199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:20.823098+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:20.823098+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.823098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:35.363067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.246369+0000","last_change":"2024-09-22T08:14:12.246369+0000","last_active":"2024-09-22T08:14:12.246369+0000","last_peered":"2024-09-22T08:14:12.246369+0000","last_clean":"2024-09-22T08:14:12.246369+0000","last_became_active":"2024-09-22T08:10:43.195355+0000","last_became_peered":"2024-09-22T08:10:43.195355+0000","last_unstale":"2024-09-22T08:14:12.246369+0000","last_undegraded":"2024-09-22T08:14:12.246369+0000","last_fullsized":"2024-09-22T08:14:12.246369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:12.246281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:12.246281+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.246281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:08.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":440,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.770164+0000","last_change":"2024-09-22T08:14:39.770164+0000","last_active":"2024-09-22T08:14:39.770164+0000","last_peered":"2024-09-22T08:14:39.770164+0000","last_clean":"2024-09-22T08:14:39.770164+0000","last_became_active":"2024-09-22T08:11:23.221981+0000","last_became_peered":"2024-09-22T08:11:23.221981+0000","last_unstale":"2024-09-22T08:14:39.770164+0000","last_undegraded":"2024-09-22T08:14:39.770164+0000","last_fullsized":"2024-09-22T08:14:39.770164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:39.770060+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:39.770060+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.770060+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:20.877929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213610+0000","last_change":"2024-09-22T08:10:49.188917+0000","last_active":"2024-09-22T08:11:23.213610+0000","last_peered":"2024-09-22T08:11:23.213610+0000","last_clean":"2024-09-22T08:11:23.213610+0000","last_became_active":"2024-09-22T08:10:49.188444+0000","last_became_peered":"2024-09-22T08:10:49.188444+0000","last_unstale":"2024-09-22T08:11:23.213610+0000","last_undegraded":"2024-09-22T08:11:23.213610+0000","last_fullsized":"2024-09-22T08:11:23.213610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:27.352744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":472,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.796535+0000","last_change":"2024-09-22T08:10:51.197818+0000","last_active":"2024-09-22T08:13:59.796535+0000","last_peered":"2024-09-22T08:13:59.796535+0000","last_clean":"2024-09-22T08:13:59.796535+0000","last_became_active":"2024-09-22T08:10:51.197248+0000","last_became_peered":"2024-09-22T08:10:51.197248+0000","last_unstale":"2024-09-22T08:13:59.796535+0000","last_undegraded":"2024-09-22T08:13:59.796535+0000","last_fullsized":"2024-09-22T08:13:59.796535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:17.585398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.360311+0000","last_change":"2024-09-22T08:10:53.195875+0000","last_active":"2024-09-22T08:12:52.360311+0000","last_peered":"2024-09-22T08:12:52.360311+0000","last_clean":"2024-09-22T08:12:52.360311+0000","last_became_active":"2024-09-22T08:10:53.195539+0000","last_became_peered":"2024-09-22T08:10:53.195539+0000","last_unstale":"2024-09-22T08:12:52.360311+0000","last_undegraded":"2024-09-22T08:12:52.360311+0000","last_fullsized":"2024-09-22T08:12:52.360311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:13:10.933920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.869186+0000","last_change":"2024-09-22T08:14:21.869186+0000","last_active":"2024-09-22T08:14:21.869186+0000","last_peered":"2024-09-22T08:14:21.869186+0000","last_clean":"2024-09-22T08:14:21.869186+0000","last_became_active":"2024-09-22T08:11:23.220943+0000","last_became_peered":"2024-09-22T08:11:23.220943+0000","last_unstale":"2024-09-22T08:14:21.869186+0000","last_undegraded":"2024-09-22T08:14:21.869186+0000","last_fullsized":"2024-09-22T08:14:21.869186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:21.869104+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:21.869104+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.869104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:05.409690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.271839+0000","last_change":"2024-09-22T08:14:11.271839+0000","last_active":"2024-09-22T08:14:11.271839+0000","last_peered":"2024-09-22T08:14:11.271839+0000","last_clean":"2024-09-22T08:14:11.271839+0000","last_became_active":"2024-09-22T08:10:43.196211+0000","last_became_peered":"2024-09-22T08:10:43.196211+0000","last_unstale":"2024-09-22T08:14:11.271839+0000","last_undegraded":"2024-09-22T08:14:11.271839+0000","last_fullsized":"2024-09-22T08:14:11.271839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:11.271716+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:11.271716+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.271716+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:52.551470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.211379+0000","last_change":"2024-09-22T08:10:47.177015+0000","last_active":"2024-09-22T08:11:23.211379+0000","last_peered":"2024-09-22T08:11:23.211379+0000","last_clean":"2024-09-22T08:11:23.211379+0000","last_became_active":"2024-09-22T08:10:47.176634+0000","last_became_peered":"2024-09-22T08:10:47.176634+0000","last_unstale":"2024-09-22T08:11:23.211379+0000","last_undegraded":"2024-09-22T08:11:23.211379+0000","last_fullsized":"2024-09-22T08:11:23.211379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:38:32.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'41","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.861199+0000","last_change":"2024-09-22T08:10:49.179447+0000","last_active":"2024-09-22T08:13:59.861199+0000","last_peered":"2024-09-22T08:13:59.861199+0000","last_clean":"2024-09-22T08:13:59.861199+0000","last_became_active":"2024-09-22T08:10:49.178942+0000","last_became_peered":"2024-09-22T08:10:49.178942+0000","last_unstale":"2024-09-22T08:13:59.861199+0000","last_undegraded":"2024-09-22T08:13:59.861199+0000","last_fullsized":"2024-09-22T08:13:59.861199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:49.042833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207501+0000","last_change":"2024-09-22T08:10:51.192777+0000","last_active":"2024-09-22T08:11:23.207501+0000","last_peered":"2024-09-22T08:11:23.207501+0000","last_clean":"2024-09-22T08:11:23.207501+0000","last_became_active":"2024-09-22T08:10:51.192482+0000","last_became_peered":"2024-09-22T08:10:51.192482+0000","last_unstale":"2024-09-22T08:11:23.207501+0000","last_undegraded":"2024-09-22T08:11:23.207501+0000","last_fullsized":"2024-09-22T08:11:23.207501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:39.871977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.288651+0000","last_change":"2024-09-22T08:10:53.193739+0000","last_active":"2024-09-22T08:13:53.288651+0000","last_peered":"2024-09-22T08:13:53.288651+0000","last_clean":"2024-09-22T08:13:53.288651+0000","last_became_active":"2024-09-22T08:10:53.193315+0000","last_became_peered":"2024-09-22T08:10:53.193315+0000","last_unstale":"2024-09-22T08:13:53.288651+0000","last_undegraded":"2024-09-22T08:13:53.288651+0000","last_fullsized":"2024-09-22T08:13:53.288651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:02.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.149878+0000","last_change":"2024-09-22T08:14:33.149878+0000","last_active":"2024-09-22T08:14:33.149878+0000","last_peered":"2024-09-22T08:14:33.149878+0000","last_clean":"2024-09-22T08:14:33.149878+0000","last_became_active":"2024-09-22T08:10:45.176033+0000","last_became_peered":"2024-09-22T08:10:45.176033+0000","last_unstale":"2024-09-22T08:14:33.149878+0000","last_undegraded":"2024-09-22T08:14:33.149878+0000","last_fullsized":"2024-09-22T08:14:33.149878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:33.149785+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:33.149785+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.149785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:44.391078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.711837+0000","last_change":"2024-09-22T08:14:03.711736+0000","last_active":"2024-09-22T08:14:03.711837+0000","last_peered":"2024-09-22T08:14:03.711837+0000","last_clean":"2024-09-22T08:14:03.711837+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:14:03.711837+0000","last_undegraded":"2024-09-22T08:14:03.711837+0000","last_fullsized":"2024-09-22T08:14:03.711837+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-22T08:14:03.711630+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-22T08:14:03.711630+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.711630+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:19.958877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.254389+0000","last_change":"2024-09-22T08:14:06.254389+0000","last_active":"2024-09-22T08:14:06.254389+0000","last_peered":"2024-09-22T08:14:06.254389+0000","last_clean":"2024-09-22T08:14:06.254389+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:14:06.254389+0000","last_undegraded":"2024-09-22T08:14:06.254389+0000","last_fullsized":"2024-09-22T08:14:06.254389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:06.254288+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:06.254288+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.254288+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:56.951153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.286135+0000","last_change":"2024-09-22T08:14:09.286135+0000","last_active":"2024-09-22T08:14:09.286135+0000","last_peered":"2024-09-22T08:14:09.286135+0000","last_clean":"2024-09-22T08:14:09.286135+0000","last_became_active":"2024-09-22T08:10:43.200918+0000","last_became_peered":"2024-09-22T08:10:43.200918+0000","last_unstale":"2024-09-22T08:14:09.286135+0000","last_undegraded":"2024-09-22T08:14:09.286135+0000","last_fullsized":"2024-09-22T08:14:09.286135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:09.286038+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:09.286038+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.286038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:54.829260+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.769086+0000","last_change":"2024-09-22T08:14:37.769086+0000","last_active":"2024-09-22T08:14:37.769086+0000","last_peered":"2024-09-22T08:14:37.769086+0000","last_clean":"2024-09-22T08:14:37.769086+0000","last_became_active":"2024-09-22T08:10:47.175775+0000","last_became_peered":"2024-09-22T08:10:47.175775+0000","last_unstale":"2024-09-22T08:14:37.769086+0000","last_undegraded":"2024-09-22T08:14:37.769086+0000","last_fullsized":"2024-09-22T08:14:37.769086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:37.769007+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:37.769007+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.769007+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:46.451261+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.894756+0000","last_change":"2024-09-22T08:10:49.185987+0000","last_active":"2024-09-22T08:13:59.894756+0000","last_peered":"2024-09-22T08:13:59.894756+0000","last_clean":"2024-09-22T08:13:59.894756+0000","last_became_active":"2024-09-22T08:10:49.185661+0000","last_became_peered":"2024-09-22T08:10:49.185661+0000","last_unstale":"2024-09-22T08:13:59.894756+0000","last_undegraded":"2024-09-22T08:13:59.894756+0000","last_fullsized":"2024-09-22T08:13:59.894756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:08.519832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222697+0000","last_change":"2024-09-22T08:10:51.202811+0000","last_active":"2024-09-22T08:11:23.222697+0000","last_peered":"2024-09-22T08:11:23.222697+0000","last_clean":"2024-09-22T08:11:23.222697+0000","last_became_active":"2024-09-22T08:10:51.202473+0000","last_became_peered":"2024-09-22T08:10:51.202473+0000","last_unstale":"2024-09-22T08:11:23.222697+0000","last_undegraded":"2024-09-22T08:11:23.222697+0000","last_fullsized":"2024-09-22T08:11:23.222697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:15.556104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.266227+0000","last_change":"2024-09-22T08:10:53.192244+0000","last_active":"2024-09-22T08:13:53.266227+0000","last_peered":"2024-09-22T08:13:53.266227+0000","last_clean":"2024-09-22T08:13:53.266227+0000","last_became_active":"2024-09-22T08:10:53.191752+0000","last_became_peered":"2024-09-22T08:10:53.191752+0000","last_unstale":"2024-09-22T08:13:53.266227+0000","last_undegraded":"2024-09-22T08:13:53.266227+0000","last_fullsized":"2024-09-22T08:13:53.266227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:21.155421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.106915+0000","last_change":"2024-09-22T08:14:34.106915+0000","last_active":"2024-09-22T08:14:34.106915+0000","last_peered":"2024-09-22T08:14:34.106915+0000","last_clean":"2024-09-22T08:14:34.106915+0000","last_became_active":"2024-09-22T08:10:45.167260+0000","last_became_peered":"2024-09-22T08:10:45.167260+0000","last_unstale":"2024-09-22T08:14:34.106915+0000","last_undegraded":"2024-09-22T08:14:34.106915+0000","last_fullsized":"2024-09-22T08:14:34.106915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:34.106788+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:34.106788+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.106788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:08.423619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.233041+0000","last_change":"2024-09-22T08:14:05.232987+0000","last_active":"2024-09-22T08:14:05.233041+0000","last_peered":"2024-09-22T08:14:05.233041+0000","last_clean":"2024-09-22T08:14:05.233041+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:14:05.233041+0000","last_undegraded":"2024-09-22T08:14:05.233041+0000","last_fullsized":"2024-09-22T08:14:05.233041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.232899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.232899+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.232899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:33.852323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.919117+0000","last_change":"2024-09-22T08:14:07.919117+0000","last_active":"2024-09-22T08:14:07.919117+0000","last_peered":"2024-09-22T08:14:07.919117+0000","last_clean":"2024-09-22T08:14:07.919117+0000","last_became_active":"2024-09-22T08:10:43.177928+0000","last_became_peered":"2024-09-22T08:10:43.177928+0000","last_unstale":"2024-09-22T08:14:07.919117+0000","last_undegraded":"2024-09-22T08:14:07.919117+0000","last_fullsized":"2024-09-22T08:14:07.919117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:07.918996+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:07.918996+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.918996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:08.892898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212854+0000","last_change":"2024-09-22T08:10:47.176700+0000","last_active":"2024-09-22T08:11:23.212854+0000","last_peered":"2024-09-22T08:11:23.212854+0000","last_clean":"2024-09-22T08:11:23.212854+0000","last_became_active":"2024-09-22T08:10:47.176402+0000","last_became_peered":"2024-09-22T08:10:47.176402+0000","last_unstale":"2024-09-22T08:11:23.212854+0000","last_undegraded":"2024-09-22T08:11:23.212854+0000","last_fullsized":"2024-09-22T08:11:23.212854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:30.271890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'284","reported_seq":501,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.921574+0000","last_change":"2024-09-22T08:10:49.186526+0000","last_active":"2024-09-22T08:13:59.921574+0000","last_peered":"2024-09-22T08:13:59.921574+0000","last_clean":"2024-09-22T08:13:59.921574+0000","last_became_active":"2024-09-22T08:10:49.186277+0000","last_became_peered":"2024-09-22T08:10:49.186277+0000","last_unstale":"2024-09-22T08:13:59.921574+0000","last_undegraded":"2024-09-22T08:13:59.921574+0000","last_fullsized":"2024-09-22T08:13:59.921574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:42.950185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.210281+0000","last_change":"2024-09-22T08:10:51.198493+0000","last_active":"2024-09-22T08:11:23.210281+0000","last_peered":"2024-09-22T08:11:23.210281+0000","last_clean":"2024-09-22T08:11:23.210281+0000","last_became_active":"2024-09-22T08:10:51.196837+0000","last_became_peered":"2024-09-22T08:10:51.196837+0000","last_unstale":"2024-09-22T08:11:23.210281+0000","last_undegraded":"2024-09-22T08:11:23.210281+0000","last_fullsized":"2024-09-22T08:11:23.210281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:20.497307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.832166+0000","last_change":"2024-09-22T08:10:53.199926+0000","last_active":"2024-09-22T08:12:08.832166+0000","last_peered":"2024-09-22T08:12:08.832166+0000","last_clean":"2024-09-22T08:12:08.832166+0000","last_became_active":"2024-09-22T08:10:53.199214+0000","last_became_peered":"2024-09-22T08:10:53.199214+0000","last_unstale":"2024-09-22T08:12:08.832166+0000","last_undegraded":"2024-09-22T08:12:08.832166+0000","last_fullsized":"2024-09-22T08:12:08.832166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:35.327109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'11","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.886625+0000","last_change":"2024-09-22T08:14:19.886625+0000","last_active":"2024-09-22T08:14:19.886625+0000","last_peered":"2024-09-22T08:14:19.886625+0000","last_clean":"2024-09-22T08:14:19.886625+0000","last_became_active":"2024-09-22T08:10:45.175923+0000","last_became_peered":"2024-09-22T08:10:45.175923+0000","last_unstale":"2024-09-22T08:14:19.886625+0000","last_undegraded":"2024-09-22T08:14:19.886625+0000","last_fullsized":"2024-09-22T08:14:19.886625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-22T08:14:19.886532+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-22T08:14:19.886532+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.886532+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:15.270799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.830583+0000","last_change":"2024-09-22T08:14:04.830583+0000","last_active":"2024-09-22T08:14:04.830583+0000","last_peered":"2024-09-22T08:14:04.830583+0000","last_clean":"2024-09-22T08:14:04.830583+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:14:04.830583+0000","last_undegraded":"2024-09-22T08:14:04.830583+0000","last_fullsized":"2024-09-22T08:14:04.830583+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:04.830494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:04.830494+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.830494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:38.025714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.991725+0000","last_change":"2024-09-22T08:14:04.991725+0000","last_active":"2024-09-22T08:14:04.991725+0000","last_peered":"2024-09-22T08:14:04.991725+0000","last_clean":"2024-09-22T08:14:04.991725+0000","last_became_active":"2024-09-22T08:10:43.186500+0000","last_became_peered":"2024-09-22T08:10:43.186500+0000","last_unstale":"2024-09-22T08:14:04.991725+0000","last_undegraded":"2024-09-22T08:14:04.991725+0000","last_fullsized":"2024-09-22T08:14:04.991725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:04.991648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:04.991648+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.991648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:45:14.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.012137+0000","last_change":"2024-09-22T08:14:31.012137+0000","last_active":"2024-09-22T08:14:31.012137+0000","last_peered":"2024-09-22T08:14:31.012137+0000","last_clean":"2024-09-22T08:14:31.012137+0000","last_became_active":"2024-09-22T08:10:47.172041+0000","last_became_peered":"2024-09-22T08:10:47.172041+0000","last_unstale":"2024-09-22T08:14:31.012137+0000","last_undegraded":"2024-09-22T08:14:31.012137+0000","last_fullsized":"2024-09-22T08:14:31.012137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.012055+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.012055+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.012055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:05.593483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'26","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.939132+0000","last_change":"2024-09-22T08:14:39.939132+0000","last_active":"2024-09-22T08:14:39.939132+0000","last_peered":"2024-09-22T08:14:39.939132+0000","last_clean":"2024-09-22T08:14:39.939132+0000","last_became_active":"2024-09-22T08:10:49.180563+0000","last_became_peered":"2024-09-22T08:10:49.180563+0000","last_unstale":"2024-09-22T08:14:39.939132+0000","last_undegraded":"2024-09-22T08:14:39.939132+0000","last_fullsized":"2024-09-22T08:14:39.939132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-22T08:14:39.939028+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-22T08:14:39.939028+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.939028+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:27.487187+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221445+0000","last_change":"2024-09-22T08:10:51.202850+0000","last_active":"2024-09-22T08:11:23.221445+0000","last_peered":"2024-09-22T08:11:23.221445+0000","last_clean":"2024-09-22T08:11:23.221445+0000","last_became_active":"2024-09-22T08:10:51.202422+0000","last_became_peered":"2024-09-22T08:10:51.202422+0000","last_unstale":"2024-09-22T08:11:23.221445+0000","last_undegraded":"2024-09-22T08:11:23.221445+0000","last_fullsized":"2024-09-22T08:11:23.221445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:08.745501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209116+0000","last_change":"2024-09-22T08:10:53.200159+0000","last_active":"2024-09-22T08:11:23.209116+0000","last_peered":"2024-09-22T08:11:23.209116+0000","last_clean":"2024-09-22T08:11:23.209116+0000","last_became_active":"2024-09-22T08:10:53.199894+0000","last_became_peered":"2024-09-22T08:10:53.199894+0000","last_unstale":"2024-09-22T08:11:23.209116+0000","last_undegraded":"2024-09-22T08:11:23.209116+0000","last_fullsized":"2024-09-22T08:11:23.209116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:07.697983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.862623+0000","last_change":"2024-09-22T08:14:18.862623+0000","last_active":"2024-09-22T08:14:18.862623+0000","last_peered":"2024-09-22T08:14:18.862623+0000","last_clean":"2024-09-22T08:14:18.862623+0000","last_became_active":"2024-09-22T08:10:45.166816+0000","last_became_peered":"2024-09-22T08:10:45.166816+0000","last_unstale":"2024-09-22T08:14:18.862623+0000","last_undegraded":"2024-09-22T08:14:18.862623+0000","last_fullsized":"2024-09-22T08:14:18.862623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:18.862531+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:18.862531+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.862531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:02.403117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.269311+0000","last_change":"2024-09-22T08:14:04.269311+0000","last_active":"2024-09-22T08:14:04.269311+0000","last_peered":"2024-09-22T08:14:04.269311+0000","last_clean":"2024-09-22T08:14:04.269311+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:14:04.269311+0000","last_undegraded":"2024-09-22T08:14:04.269311+0000","last_fullsized":"2024-09-22T08:14:04.269311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:14:04.269206+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:14:04.269206+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.269206+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:50.609384+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.798946+0000","last_change":"2024-09-22T08:14:03.798946+0000","last_active":"2024-09-22T08:14:03.798946+0000","last_peered":"2024-09-22T08:14:03.798946+0000","last_clean":"2024-09-22T08:14:03.798946+0000","last_became_active":"2024-09-22T08:10:43.187103+0000","last_became_peered":"2024-09-22T08:10:43.187103+0000","last_unstale":"2024-09-22T08:14:03.798946+0000","last_undegraded":"2024-09-22T08:14:03.798946+0000","last_fullsized":"2024-09-22T08:14:03.798946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:03.798857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:03.798857+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.798857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:24.946857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.030496+0000","last_change":"2024-09-22T08:14:32.030496+0000","last_active":"2024-09-22T08:14:32.030496+0000","last_peered":"2024-09-22T08:14:32.030496+0000","last_clean":"2024-09-22T08:14:32.030496+0000","last_became_active":"2024-09-22T08:10:47.168480+0000","last_became_peered":"2024-09-22T08:10:47.168480+0000","last_unstale":"2024-09-22T08:14:32.030496+0000","last_undegraded":"2024-09-22T08:14:32.030496+0000","last_fullsized":"2024-09-22T08:14:32.030496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:32.030385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:32.030385+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.030385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:36.251439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.586312+0000","last_change":"2024-09-22T08:10:49.185221+0000","last_active":"2024-09-22T08:13:52.586312+0000","last_peered":"2024-09-22T08:13:52.586312+0000","last_clean":"2024-09-22T08:13:52.586312+0000","last_became_active":"2024-09-22T08:10:49.184961+0000","last_became_peered":"2024-09-22T08:10:49.184961+0000","last_unstale":"2024-09-22T08:13:52.586312+0000","last_undegraded":"2024-09-22T08:13:52.586312+0000","last_fullsized":"2024-09-22T08:13:52.586312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:38:00.221298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213144+0000","last_change":"2024-09-22T08:10:51.195952+0000","last_active":"2024-09-22T08:11:23.213144+0000","last_peered":"2024-09-22T08:11:23.213144+0000","last_clean":"2024-09-22T08:11:23.213144+0000","last_became_active":"2024-09-22T08:10:51.195643+0000","last_became_peered":"2024-09-22T08:10:51.195643+0000","last_unstale":"2024-09-22T08:11:23.213144+0000","last_undegraded":"2024-09-22T08:11:23.213144+0000","last_fullsized":"2024-09-22T08:11:23.213144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:18.035075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.336216+0000","last_change":"2024-09-22T08:10:53.203765+0000","last_active":"2024-09-22T08:12:52.336216+0000","last_peered":"2024-09-22T08:12:52.336216+0000","last_clean":"2024-09-22T08:12:52.336216+0000","last_became_active":"2024-09-22T08:10:53.203330+0000","last_became_peered":"2024-09-22T08:10:53.203330+0000","last_unstale":"2024-09-22T08:12:52.336216+0000","last_undegraded":"2024-09-22T08:12:52.336216+0000","last_fullsized":"2024-09-22T08:12:52.336216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:46.081338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.790672+0000","last_change":"2024-09-22T08:14:17.790672+0000","last_active":"2024-09-22T08:14:17.790672+0000","last_peered":"2024-09-22T08:14:17.790672+0000","last_clean":"2024-09-22T08:14:17.790672+0000","last_became_active":"2024-09-22T08:10:45.182276+0000","last_became_peered":"2024-09-22T08:10:45.182276+0000","last_unstale":"2024-09-22T08:14:17.790672+0000","last_undegraded":"2024-09-22T08:14:17.790672+0000","last_fullsized":"2024-09-22T08:14:17.790672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:17.790565+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:17.790565+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.790565+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:25.799618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.787504+0000","last_change":"2024-09-22T08:14:05.787504+0000","last_active":"2024-09-22T08:14:05.787504+0000","last_peered":"2024-09-22T08:14:05.787504+0000","last_clean":"2024-09-22T08:14:05.787504+0000","last_became_active":"2024-09-22T08:10:43.186175+0000","last_became_peered":"2024-09-22T08:10:43.186175+0000","last_unstale":"2024-09-22T08:14:05.787504+0000","last_undegraded":"2024-09-22T08:14:05.787504+0000","last_fullsized":"2024-09-22T08:14:05.787504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:05.787417+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:05.787417+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.787417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:42.384319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.983783+0000","last_change":"2024-09-22T08:14:03.983783+0000","last_active":"2024-09-22T08:14:03.983783+0000","last_peered":"2024-09-22T08:14:03.983783+0000","last_clean":"2024-09-22T08:14:03.983783+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:14:03.983783+0000","last_undegraded":"2024-09-22T08:14:03.983783+0000","last_fullsized":"2024-09-22T08:14:03.983783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:03.983713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:03.983713+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.983713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:58.921961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.015250+0000","last_change":"2024-09-22T08:14:34.015250+0000","last_active":"2024-09-22T08:14:34.015250+0000","last_peered":"2024-09-22T08:14:34.015250+0000","last_clean":"2024-09-22T08:14:34.015250+0000","last_became_active":"2024-09-22T08:10:47.167620+0000","last_became_peered":"2024-09-22T08:10:47.167620+0000","last_unstale":"2024-09-22T08:14:34.015250+0000","last_undegraded":"2024-09-22T08:14:34.015250+0000","last_fullsized":"2024-09-22T08:14:34.015250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:34.015156+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:34.015156+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.015156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:40.094721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'79","reported_seq":155,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.033421+0000","last_change":"2024-09-22T08:14:40.033421+0000","last_active":"2024-09-22T08:14:40.033421+0000","last_peered":"2024-09-22T08:14:40.033421+0000","last_clean":"2024-09-22T08:14:40.033421+0000","last_became_active":"2024-09-22T08:10:49.184753+0000","last_became_peered":"2024-09-22T08:10:49.184753+0000","last_unstale":"2024-09-22T08:14:40.033421+0000","last_undegraded":"2024-09-22T08:14:40.033421+0000","last_fullsized":"2024-09-22T08:14:40.033421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'79","last_scrub_stamp":"2024-09-22T08:14:40.033261+0000","last_deep_scrub":"34'79","last_deep_scrub_stamp":"2024-09-22T08:14:40.033261+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.033261+0000","objects_scrubbed":9,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:08.329565+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206763+0000","last_change":"2024-09-22T08:10:51.197026+0000","last_active":"2024-09-22T08:11:23.206763+0000","last_peered":"2024-09-22T08:11:23.206763+0000","last_clean":"2024-09-22T08:11:23.206763+0000","last_became_active":"2024-09-22T08:10:51.196724+0000","last_became_peered":"2024-09-22T08:10:51.196724+0000","last_unstale":"2024-09-22T08:11:23.206763+0000","last_undegraded":"2024-09-22T08:11:23.206763+0000","last_fullsized":"2024-09-22T08:11:23.206763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:14:06.499640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.230225+0000","last_change":"2024-09-22T08:10:53.196686+0000","last_active":"2024-09-22T08:13:53.230225+0000","last_peered":"2024-09-22T08:13:53.230225+0000","last_clean":"2024-09-22T08:13:53.230225+0000","last_became_active":"2024-09-22T08:10:53.196406+0000","last_became_peered":"2024-09-22T08:10:53.196406+0000","last_unstale":"2024-09-22T08:13:53.230225+0000","last_undegraded":"2024-09-22T08:13:53.230225+0000","last_fullsized":"2024-09-22T08:13:53.230225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:42.892968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.830904+0000","last_change":"2024-09-22T08:14:18.830904+0000","last_active":"2024-09-22T08:14:18.830904+0000","last_peered":"2024-09-22T08:14:18.830904+0000","last_clean":"2024-09-22T08:14:18.830904+0000","last_became_active":"2024-09-22T08:10:45.176601+0000","last_became_peered":"2024-09-22T08:10:45.176601+0000","last_unstale":"2024-09-22T08:14:18.830904+0000","last_undegraded":"2024-09-22T08:14:18.830904+0000","last_fullsized":"2024-09-22T08:14:18.830904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:18.830805+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.830805+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.830805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:34.352591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.951005+0000","last_change":"2024-09-22T08:14:06.951005+0000","last_active":"2024-09-22T08:14:06.951005+0000","last_peered":"2024-09-22T08:14:06.951005+0000","last_clean":"2024-09-22T08:14:06.951005+0000","last_became_active":"2024-09-22T08:10:43.186758+0000","last_became_peered":"2024-09-22T08:10:43.186758+0000","last_unstale":"2024-09-22T08:14:06.951005+0000","last_undegraded":"2024-09-22T08:14:06.951005+0000","last_fullsized":"2024-09-22T08:14:06.951005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:06.950903+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:06.950903+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.950903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:00.975454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.240026+0000","last_change":"2024-09-22T08:14:08.240026+0000","last_active":"2024-09-22T08:14:08.240026+0000","last_peered":"2024-09-22T08:14:08.240026+0000","last_clean":"2024-09-22T08:14:08.240026+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:14:08.240026+0000","last_undegraded":"2024-09-22T08:14:08.240026+0000","last_fullsized":"2024-09-22T08:14:08.240026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.239939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.239939+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.239939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:30.468689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209307+0000","last_change":"2024-09-22T08:10:47.173748+0000","last_active":"2024-09-22T08:11:23.209307+0000","last_peered":"2024-09-22T08:11:23.209307+0000","last_clean":"2024-09-22T08:11:23.209307+0000","last_became_active":"2024-09-22T08:10:47.173348+0000","last_became_peered":"2024-09-22T08:10:47.173348+0000","last_unstale":"2024-09-22T08:11:23.209307+0000","last_undegraded":"2024-09-22T08:11:23.209307+0000","last_fullsized":"2024-09-22T08:11:23.209307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:18:06.081248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212964+0000","last_change":"2024-09-22T08:10:49.187453+0000","last_active":"2024-09-22T08:11:23.212964+0000","last_peered":"2024-09-22T08:11:23.212964+0000","last_clean":"2024-09-22T08:11:23.212964+0000","last_became_active":"2024-09-22T08:10:49.187184+0000","last_became_peered":"2024-09-22T08:10:49.187184+0000","last_unstale":"2024-09-22T08:11:23.212964+0000","last_undegraded":"2024-09-22T08:11:23.212964+0000","last_fullsized":"2024-09-22T08:11:23.212964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:19:08.593807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":373,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.792731+0000","last_change":"2024-09-22T08:10:51.197450+0000","last_active":"2024-09-22T08:13:59.792731+0000","last_peered":"2024-09-22T08:13:59.792731+0000","last_clean":"2024-09-22T08:13:59.792731+0000","last_became_active":"2024-09-22T08:10:51.197111+0000","last_became_peered":"2024-09-22T08:10:51.197111+0000","last_unstale":"2024-09-22T08:13:59.792731+0000","last_undegraded":"2024-09-22T08:13:59.792731+0000","last_fullsized":"2024-09-22T08:13:59.792731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:12.937571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212274+0000","last_change":"2024-09-22T08:10:53.200428+0000","last_active":"2024-09-22T08:11:23.212274+0000","last_peered":"2024-09-22T08:11:23.212274+0000","last_clean":"2024-09-22T08:11:23.212274+0000","last_became_active":"2024-09-22T08:10:53.199612+0000","last_became_peered":"2024-09-22T08:10:53.199612+0000","last_unstale":"2024-09-22T08:11:23.212274+0000","last_undegraded":"2024-09-22T08:11:23.212274+0000","last_fullsized":"2024-09-22T08:11:23.212274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:47.560464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.199399+0000","last_change":"2024-09-22T08:14:32.199399+0000","last_active":"2024-09-22T08:14:32.199399+0000","last_peered":"2024-09-22T08:14:32.199399+0000","last_clean":"2024-09-22T08:14:32.199399+0000","last_became_active":"2024-09-22T08:10:45.183229+0000","last_became_peered":"2024-09-22T08:10:45.183229+0000","last_unstale":"2024-09-22T08:14:32.199399+0000","last_undegraded":"2024-09-22T08:14:32.199399+0000","last_fullsized":"2024-09-22T08:14:32.199399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:32.199294+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:32.199294+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.199294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:42.593819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.315191+0000","last_change":"2024-09-22T08:14:10.315191+0000","last_active":"2024-09-22T08:14:10.315191+0000","last_peered":"2024-09-22T08:14:10.315191+0000","last_clean":"2024-09-22T08:14:10.315191+0000","last_became_active":"2024-09-22T08:10:43.198637+0000","last_became_peered":"2024-09-22T08:10:43.198637+0000","last_unstale":"2024-09-22T08:14:10.315191+0000","last_undegraded":"2024-09-22T08:14:10.315191+0000","last_fullsized":"2024-09-22T08:14:10.315191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:10.315107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:10.315107+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.315107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:31.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:02.966909+0000","last_change":"2024-09-22T08:14:02.966909+0000","last_active":"2024-09-22T08:14:02.966909+0000","last_peered":"2024-09-22T08:14:02.966909+0000","last_clean":"2024-09-22T08:14:02.966909+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:14:02.966909+0000","last_undegraded":"2024-09-22T08:14:02.966909+0000","last_fullsized":"2024-09-22T08:14:02.966909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:02.966839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:02.966839+0000","last_clean_scrub_stamp":"2024-09-22T08:14:02.966839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:08.371695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221460+0000","last_change":"2024-09-22T08:11:23.216945+0000","last_active":"2024-09-22T08:11:23.221460+0000","last_peered":"2024-09-22T08:11:23.221460+0000","last_clean":"2024-09-22T08:11:23.221460+0000","last_became_active":"2024-09-22T08:11:23.216676+0000","last_became_peered":"2024-09-22T08:11:23.216676+0000","last_unstale":"2024-09-22T08:11:23.221460+0000","last_undegraded":"2024-09-22T08:11:23.221460+0000","last_fullsized":"2024-09-22T08:11:23.221460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:27:46.451332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213139+0000","last_change":"2024-09-22T08:10:49.188685+0000","last_active":"2024-09-22T08:11:23.213139+0000","last_peered":"2024-09-22T08:11:23.213139+0000","last_clean":"2024-09-22T08:11:23.213139+0000","last_became_active":"2024-09-22T08:10:49.188309+0000","last_became_peered":"2024-09-22T08:10:49.188309+0000","last_unstale":"2024-09-22T08:11:23.213139+0000","last_undegraded":"2024-09-22T08:11:23.213139+0000","last_fullsized":"2024-09-22T08:11:23.213139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:54.497319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.797838+0000","last_change":"2024-09-22T08:10:51.193163+0000","last_active":"2024-09-22T08:13:59.797838+0000","last_peered":"2024-09-22T08:13:59.797838+0000","last_clean":"2024-09-22T08:13:59.797838+0000","last_became_active":"2024-09-22T08:10:51.192058+0000","last_became_peered":"2024-09-22T08:10:51.192058+0000","last_unstale":"2024-09-22T08:13:59.797838+0000","last_undegraded":"2024-09-22T08:13:59.797838+0000","last_fullsized":"2024-09-22T08:13:59.797838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213624+0000","last_change":"2024-09-22T08:10:53.203958+0000","last_active":"2024-09-22T08:11:23.213624+0000","last_peered":"2024-09-22T08:11:23.213624+0000","last_clean":"2024-09-22T08:11:23.213624+0000","last_became_active":"2024-09-22T08:10:53.203670+0000","last_became_peered":"2024-09-22T08:10:53.203670+0000","last_unstale":"2024-09-22T08:11:23.213624+0000","last_undegraded":"2024-09-22T08:11:23.213624+0000","last_fullsized":"2024-09-22T08:11:23.213624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:04.571706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'17","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.858415+0000","last_change":"2024-09-22T08:14:19.858415+0000","last_active":"2024-09-22T08:14:19.858415+0000","last_peered":"2024-09-22T08:14:19.858415+0000","last_clean":"2024-09-22T08:14:19.858415+0000","last_became_active":"2024-09-22T08:10:45.171667+0000","last_became_peered":"2024-09-22T08:10:45.171667+0000","last_unstale":"2024-09-22T08:14:19.858415+0000","last_undegraded":"2024-09-22T08:14:19.858415+0000","last_fullsized":"2024-09-22T08:14:19.858415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-22T08:14:19.858328+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-22T08:14:19.858328+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.858328+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:20.434578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.704581+0000","last_change":"2024-09-22T08:14:04.704581+0000","last_active":"2024-09-22T08:14:04.704581+0000","last_peered":"2024-09-22T08:14:04.704581+0000","last_clean":"2024-09-22T08:14:04.704581+0000","last_became_active":"2024-09-22T08:10:43.182161+0000","last_became_peered":"2024-09-22T08:10:43.182161+0000","last_unstale":"2024-09-22T08:14:04.704581+0000","last_undegraded":"2024-09-22T08:14:04.704581+0000","last_fullsized":"2024-09-22T08:14:04.704581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:04.704488+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:04.704488+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.704488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:26.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.215210+0000","last_change":"2024-09-22T08:14:07.215210+0000","last_active":"2024-09-22T08:14:07.215210+0000","last_peered":"2024-09-22T08:14:07.215210+0000","last_clean":"2024-09-22T08:14:07.215210+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:14:07.215210+0000","last_undegraded":"2024-09-22T08:14:07.215210+0000","last_fullsized":"2024-09-22T08:14:07.215210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:07.215094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:07.215094+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.215094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:24.079988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209442+0000","last_change":"2024-09-22T08:10:47.174132+0000","last_active":"2024-09-22T08:11:23.209442+0000","last_peered":"2024-09-22T08:11:23.209442+0000","last_clean":"2024-09-22T08:11:23.209442+0000","last_became_active":"2024-09-22T08:10:47.172441+0000","last_became_peered":"2024-09-22T08:10:47.172441+0000","last_unstale":"2024-09-22T08:11:23.209442+0000","last_undegraded":"2024-09-22T08:11:23.209442+0000","last_fullsized":"2024-09-22T08:11:23.209442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:47.078285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'99","reported_seq":192,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.903978+0000","last_change":"2024-09-22T08:14:40.903978+0000","last_active":"2024-09-22T08:14:40.903978+0000","last_peered":"2024-09-22T08:14:40.903978+0000","last_clean":"2024-09-22T08:14:40.903978+0000","last_became_active":"2024-09-22T08:10:49.184942+0000","last_became_peered":"2024-09-22T08:10:49.184942+0000","last_unstale":"2024-09-22T08:14:40.903978+0000","last_undegraded":"2024-09-22T08:14:40.903978+0000","last_fullsized":"2024-09-22T08:14:40.903978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'99","last_scrub_stamp":"2024-09-22T08:14:40.903848+0000","last_deep_scrub":"34'99","last_deep_scrub_stamp":"2024-09-22T08:14:40.903848+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.903848+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:07.358495+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.220410+0000","last_change":"2024-09-22T08:10:51.195295+0000","last_active":"2024-09-22T08:11:23.220410+0000","last_peered":"2024-09-22T08:11:23.220410+0000","last_clean":"2024-09-22T08:11:23.220410+0000","last_became_active":"2024-09-22T08:10:51.194912+0000","last_became_peered":"2024-09-22T08:10:51.194912+0000","last_unstale":"2024-09-22T08:11:23.220410+0000","last_undegraded":"2024-09-22T08:11:23.220410+0000","last_fullsized":"2024-09-22T08:11:23.220410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:22.604330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208925+0000","last_change":"2024-09-22T08:10:53.192489+0000","last_active":"2024-09-22T08:11:23.208925+0000","last_peered":"2024-09-22T08:11:23.208925+0000","last_clean":"2024-09-22T08:11:23.208925+0000","last_became_active":"2024-09-22T08:10:53.192189+0000","last_became_peered":"2024-09-22T08:10:53.192189+0000","last_unstale":"2024-09-22T08:11:23.208925+0000","last_undegraded":"2024-09-22T08:11:23.208925+0000","last_fullsized":"2024-09-22T08:11:23.208925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:14.737752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.208582+0000","last_change":"2024-09-22T08:10:53.198120+0000","last_active":"2024-09-22T08:11:23.208582+0000","last_peered":"2024-09-22T08:11:23.208582+0000","last_clean":"2024-09-22T08:11:23.208582+0000","last_became_active":"2024-09-22T08:10:53.197799+0000","last_became_peered":"2024-09-22T08:10:53.197799+0000","last_unstale":"2024-09-22T08:11:23.208582+0000","last_undegraded":"2024-09-22T08:11:23.208582+0000","last_fullsized":"2024-09-22T08:11:23.208582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:55.526373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.911762+0000","last_change":"2024-09-22T08:14:22.911762+0000","last_active":"2024-09-22T08:14:22.911762+0000","last_peered":"2024-09-22T08:14:22.911762+0000","last_clean":"2024-09-22T08:14:22.911762+0000","last_became_active":"2024-09-22T08:10:45.173916+0000","last_became_peered":"2024-09-22T08:10:45.173916+0000","last_unstale":"2024-09-22T08:14:22.911762+0000","last_undegraded":"2024-09-22T08:14:22.911762+0000","last_fullsized":"2024-09-22T08:14:22.911762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:22.911670+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:22.911670+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.911670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:48.789223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.225254+0000","last_change":"2024-09-22T08:14:18.225254+0000","last_active":"2024-09-22T08:14:18.225254+0000","last_peered":"2024-09-22T08:14:18.225254+0000","last_clean":"2024-09-22T08:14:18.225254+0000","last_became_active":"2024-09-22T08:10:43.201007+0000","last_became_peered":"2024-09-22T08:10:43.201007+0000","last_unstale":"2024-09-22T08:14:18.225254+0000","last_undegraded":"2024-09-22T08:14:18.225254+0000","last_fullsized":"2024-09-22T08:14:18.225254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:18.225171+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.225171+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.225171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:48.896171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.812893+0000","last_change":"2024-09-22T08:14:40.812893+0000","last_active":"2024-09-22T08:14:40.812893+0000","last_peered":"2024-09-22T08:14:40.812893+0000","last_clean":"2024-09-22T08:14:40.812893+0000","last_became_active":"2024-09-22T08:10:47.175524+0000","last_became_peered":"2024-09-22T08:10:47.175524+0000","last_unstale":"2024-09-22T08:14:40.812893+0000","last_undegraded":"2024-09-22T08:14:40.812893+0000","last_fullsized":"2024-09-22T08:14:40.812893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:40.812810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:40.812810+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.812810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:50.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.873004+0000","last_change":"2024-09-22T08:10:49.186252+0000","last_active":"2024-09-22T08:13:59.873004+0000","last_peered":"2024-09-22T08:13:59.873004+0000","last_clean":"2024-09-22T08:13:59.873004+0000","last_became_active":"2024-09-22T08:10:49.185693+0000","last_became_peered":"2024-09-22T08:10:49.185693+0000","last_unstale":"2024-09-22T08:13:59.873004+0000","last_undegraded":"2024-09-22T08:13:59.873004+0000","last_fullsized":"2024-09-22T08:13:59.873004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:02.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213000+0000","last_change":"2024-09-22T08:10:51.200112+0000","last_active":"2024-09-22T08:11:23.213000+0000","last_peered":"2024-09-22T08:11:23.213000+0000","last_clean":"2024-09-22T08:11:23.213000+0000","last_became_active":"2024-09-22T08:10:51.199799+0000","last_became_peered":"2024-09-22T08:10:51.199799+0000","last_unstale":"2024-09-22T08:11:23.213000+0000","last_undegraded":"2024-09-22T08:11:23.213000+0000","last_fullsized":"2024-09-22T08:11:23.213000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:06.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'13","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.308456+0000","last_change":"2024-09-22T08:10:53.201508+0000","last_active":"2024-09-22T08:13:53.308456+0000","last_peered":"2024-09-22T08:13:53.308456+0000","last_clean":"2024-09-22T08:13:53.308456+0000","last_became_active":"2024-09-22T08:10:53.201209+0000","last_became_peered":"2024-09-22T08:10:53.201209+0000","last_unstale":"2024-09-22T08:13:53.308456+0000","last_undegraded":"2024-09-22T08:13:53.308456+0000","last_fullsized":"2024-09-22T08:13:53.308456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:20.642196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":69,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'12","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.885259+0000","last_change":"2024-09-22T08:14:22.885259+0000","last_active":"2024-09-22T08:14:22.885259+0000","last_peered":"2024-09-22T08:14:22.885259+0000","last_clean":"2024-09-22T08:14:22.885259+0000","last_became_active":"2024-09-22T08:10:45.182245+0000","last_became_peered":"2024-09-22T08:10:45.182245+0000","last_unstale":"2024-09-22T08:14:22.885259+0000","last_undegraded":"2024-09-22T08:14:22.885259+0000","last_fullsized":"2024-09-22T08:14:22.885259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:22.885177+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:22.885177+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.885177+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:18.269445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.706396+0000","last_change":"2024-09-22T08:14:10.706396+0000","last_active":"2024-09-22T08:14:10.706396+0000","last_peered":"2024-09-22T08:14:10.706396+0000","last_clean":"2024-09-22T08:14:10.706396+0000","last_became_active":"2024-09-22T08:10:43.185230+0000","last_became_peered":"2024-09-22T08:10:43.185230+0000","last_unstale":"2024-09-22T08:14:10.706396+0000","last_undegraded":"2024-09-22T08:14:10.706396+0000","last_fullsized":"2024-09-22T08:14:10.706396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:10.706291+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:10.706291+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.706291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:16.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209614+0000","last_change":"2024-09-22T08:10:47.176256+0000","last_active":"2024-09-22T08:11:23.209614+0000","last_peered":"2024-09-22T08:11:23.209614+0000","last_clean":"2024-09-22T08:11:23.209614+0000","last_became_active":"2024-09-22T08:10:47.175747+0000","last_became_peered":"2024-09-22T08:10:47.175747+0000","last_unstale":"2024-09-22T08:11:23.209614+0000","last_undegraded":"2024-09-22T08:11:23.209614+0000","last_fullsized":"2024-09-22T08:11:23.209614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:15:17.217421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.041367+0000","last_change":"2024-09-22T08:14:41.041367+0000","last_active":"2024-09-22T08:14:41.041367+0000","last_peered":"2024-09-22T08:14:41.041367+0000","last_clean":"2024-09-22T08:14:41.041367+0000","last_became_active":"2024-09-22T08:10:49.180921+0000","last_became_peered":"2024-09-22T08:10:49.180921+0000","last_unstale":"2024-09-22T08:14:41.041367+0000","last_undegraded":"2024-09-22T08:14:41.041367+0000","last_fullsized":"2024-09-22T08:14:41.041367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:41.041241+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:41.041241+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.041241+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:34.720660+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207132+0000","last_change":"2024-09-22T08:10:51.193254+0000","last_active":"2024-09-22T08:11:23.207132+0000","last_peered":"2024-09-22T08:11:23.207132+0000","last_clean":"2024-09-22T08:11:23.207132+0000","last_became_active":"2024-09-22T08:10:51.192989+0000","last_became_peered":"2024-09-22T08:10:51.192989+0000","last_unstale":"2024-09-22T08:11:23.207132+0000","last_undegraded":"2024-09-22T08:11:23.207132+0000","last_fullsized":"2024-09-22T08:11:23.207132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:29.015464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:09.008653+0000","last_change":"2024-09-22T08:10:53.193317+0000","last_active":"2024-09-22T08:12:09.008653+0000","last_peered":"2024-09-22T08:12:09.008653+0000","last_clean":"2024-09-22T08:12:09.008653+0000","last_became_active":"2024-09-22T08:10:53.192967+0000","last_became_peered":"2024-09-22T08:10:53.192967+0000","last_unstale":"2024-09-22T08:12:09.008653+0000","last_undegraded":"2024-09-22T08:12:09.008653+0000","last_fullsized":"2024-09-22T08:12:09.008653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:48.815518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.890489+0000","last_change":"2024-09-22T08:14:25.890489+0000","last_active":"2024-09-22T08:14:25.890489+0000","last_peered":"2024-09-22T08:14:25.890489+0000","last_clean":"2024-09-22T08:14:25.890489+0000","last_became_active":"2024-09-22T08:10:45.171555+0000","last_became_peered":"2024-09-22T08:10:45.171555+0000","last_unstale":"2024-09-22T08:14:25.890489+0000","last_undegraded":"2024-09-22T08:14:25.890489+0000","last_fullsized":"2024-09-22T08:14:25.890489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:25.890395+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:25.890395+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.890395+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:37.923633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.741592+0000","last_change":"2024-09-22T08:14:09.741592+0000","last_active":"2024-09-22T08:14:09.741592+0000","last_peered":"2024-09-22T08:14:09.741592+0000","last_clean":"2024-09-22T08:14:09.741592+0000","last_became_active":"2024-09-22T08:10:43.187044+0000","last_became_peered":"2024-09-22T08:10:43.187044+0000","last_unstale":"2024-09-22T08:14:09.741592+0000","last_undegraded":"2024-09-22T08:14:09.741592+0000","last_fullsized":"2024-09-22T08:14:09.741592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:09.741505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:09.741505+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.741505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:51.031430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.006667+0000","last_change":"2024-09-22T08:14:35.006667+0000","last_active":"2024-09-22T08:14:35.006667+0000","last_peered":"2024-09-22T08:14:35.006667+0000","last_clean":"2024-09-22T08:14:35.006667+0000","last_became_active":"2024-09-22T08:10:47.177735+0000","last_became_peered":"2024-09-22T08:10:47.177735+0000","last_unstale":"2024-09-22T08:14:35.006667+0000","last_undegraded":"2024-09-22T08:14:35.006667+0000","last_fullsized":"2024-09-22T08:14:35.006667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:35.006578+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:35.006578+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.006578+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:46.461347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.839465+0000","last_change":"2024-09-22T08:10:49.182878+0000","last_active":"2024-09-22T08:13:59.839465+0000","last_peered":"2024-09-22T08:13:59.839465+0000","last_clean":"2024-09-22T08:13:59.839465+0000","last_became_active":"2024-09-22T08:10:49.182557+0000","last_became_peered":"2024-09-22T08:10:49.182557+0000","last_unstale":"2024-09-22T08:13:59.839465+0000","last_undegraded":"2024-09-22T08:13:59.839465+0000","last_fullsized":"2024-09-22T08:13:59.839465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:37.230381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212363+0000","last_change":"2024-09-22T08:10:51.198536+0000","last_active":"2024-09-22T08:11:23.212363+0000","last_peered":"2024-09-22T08:11:23.212363+0000","last_clean":"2024-09-22T08:11:23.212363+0000","last_became_active":"2024-09-22T08:10:51.198204+0000","last_became_peered":"2024-09-22T08:10:51.198204+0000","last_unstale":"2024-09-22T08:11:23.212363+0000","last_undegraded":"2024-09-22T08:11:23.212363+0000","last_fullsized":"2024-09-22T08:11:23.212363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:20.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.041147+0000","last_change":"2024-09-22T08:10:53.200288+0000","last_active":"2024-09-22T08:11:27.041147+0000","last_peered":"2024-09-22T08:11:27.041147+0000","last_clean":"2024-09-22T08:11:27.041147+0000","last_became_active":"2024-09-22T08:10:53.199827+0000","last_became_peered":"2024-09-22T08:10:53.199827+0000","last_unstale":"2024-09-22T08:11:27.041147+0000","last_undegraded":"2024-09-22T08:11:27.041147+0000","last_fullsized":"2024-09-22T08:11:27.041147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:31.568753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.086499+0000","last_change":"2024-09-22T08:14:37.086499+0000","last_active":"2024-09-22T08:14:37.086499+0000","last_peered":"2024-09-22T08:14:37.086499+0000","last_clean":"2024-09-22T08:14:37.086499+0000","last_became_active":"2024-09-22T08:10:45.183674+0000","last_became_peered":"2024-09-22T08:10:45.183674+0000","last_unstale":"2024-09-22T08:14:37.086499+0000","last_undegraded":"2024-09-22T08:14:37.086499+0000","last_fullsized":"2024-09-22T08:14:37.086499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:37.086391+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:37.086391+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.086391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:29.610650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.769770+0000","last_change":"2024-09-22T08:14:06.769770+0000","last_active":"2024-09-22T08:14:06.769770+0000","last_peered":"2024-09-22T08:14:06.769770+0000","last_clean":"2024-09-22T08:14:06.769770+0000","last_became_active":"2024-09-22T08:10:43.184287+0000","last_became_peered":"2024-09-22T08:10:43.184287+0000","last_unstale":"2024-09-22T08:14:06.769770+0000","last_undegraded":"2024-09-22T08:14:06.769770+0000","last_fullsized":"2024-09-22T08:14:06.769770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:06.769651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:06.769651+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.769651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:24.233361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209665+0000","last_change":"2024-09-22T08:10:47.173065+0000","last_active":"2024-09-22T08:11:23.209665+0000","last_peered":"2024-09-22T08:11:23.209665+0000","last_clean":"2024-09-22T08:11:23.209665+0000","last_became_active":"2024-09-22T08:10:47.172816+0000","last_became_peered":"2024-09-22T08:10:47.172816+0000","last_unstale":"2024-09-22T08:11:23.209665+0000","last_undegraded":"2024-09-22T08:11:23.209665+0000","last_fullsized":"2024-09-22T08:11:23.209665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:42.365873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.916067+0000","last_change":"2024-09-22T08:14:41.916067+0000","last_active":"2024-09-22T08:14:41.916067+0000","last_peered":"2024-09-22T08:14:41.916067+0000","last_clean":"2024-09-22T08:14:41.916067+0000","last_became_active":"2024-09-22T08:10:49.180621+0000","last_became_peered":"2024-09-22T08:10:49.180621+0000","last_unstale":"2024-09-22T08:14:41.916067+0000","last_undegraded":"2024-09-22T08:14:41.916067+0000","last_fullsized":"2024-09-22T08:14:41.916067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-22T08:14:41.915971+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-22T08:14:41.915971+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.915971+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:26.481785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.206973+0000","last_change":"2024-09-22T08:10:51.190255+0000","last_active":"2024-09-22T08:11:23.206973+0000","last_peered":"2024-09-22T08:11:23.206973+0000","last_clean":"2024-09-22T08:11:23.206973+0000","last_became_active":"2024-09-22T08:10:51.189640+0000","last_became_peered":"2024-09-22T08:10:51.189640+0000","last_unstale":"2024-09-22T08:11:23.206973+0000","last_undegraded":"2024-09-22T08:11:23.206973+0000","last_fullsized":"2024-09-22T08:11:23.206973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:38:01.319577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.228734+0000","last_change":"2024-09-22T08:10:45.166911+0000","last_active":"2024-09-22T08:13:53.228734+0000","last_peered":"2024-09-22T08:13:53.228734+0000","last_clean":"2024-09-22T08:13:53.228734+0000","last_became_active":"2024-09-22T08:10:45.166591+0000","last_became_peered":"2024-09-22T08:10:45.166591+0000","last_unstale":"2024-09-22T08:13:53.228734+0000","last_undegraded":"2024-09-22T08:13:53.228734+0000","last_fullsized":"2024-09-22T08:13:53.228734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:01.404622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.239338+0000","last_change":"2024-09-22T08:14:19.239338+0000","last_active":"2024-09-22T08:14:19.239338+0000","last_peered":"2024-09-22T08:14:19.239338+0000","last_clean":"2024-09-22T08:14:19.239338+0000","last_became_active":"2024-09-22T08:10:43.195608+0000","last_became_peered":"2024-09-22T08:10:43.195608+0000","last_unstale":"2024-09-22T08:14:19.239338+0000","last_undegraded":"2024-09-22T08:14:19.239338+0000","last_fullsized":"2024-09-22T08:14:19.239338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:19.239245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:19.239245+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.239245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.221139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.986434+0000","last_change":"2024-09-22T08:14:38.986434+0000","last_active":"2024-09-22T08:14:38.986434+0000","last_peered":"2024-09-22T08:14:38.986434+0000","last_clean":"2024-09-22T08:14:38.986434+0000","last_became_active":"2024-09-22T08:10:47.173043+0000","last_became_peered":"2024-09-22T08:10:47.173043+0000","last_unstale":"2024-09-22T08:14:38.986434+0000","last_undegraded":"2024-09-22T08:14:38.986434+0000","last_fullsized":"2024-09-22T08:14:38.986434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:38.986348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:38.986348+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.986348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:44.350224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.933167+0000","last_change":"2024-09-22T08:10:49.181954+0000","last_active":"2024-09-22T08:13:59.933167+0000","last_peered":"2024-09-22T08:13:59.933167+0000","last_clean":"2024-09-22T08:13:59.933167+0000","last_became_active":"2024-09-22T08:10:49.181611+0000","last_became_peered":"2024-09-22T08:10:49.181611+0000","last_unstale":"2024-09-22T08:13:59.933167+0000","last_undegraded":"2024-09-22T08:13:59.933167+0000","last_fullsized":"2024-09-22T08:13:59.933167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:21:12.944824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.207395+0000","last_change":"2024-09-22T08:10:51.190156+0000","last_active":"2024-09-22T08:11:23.207395+0000","last_peered":"2024-09-22T08:11:23.207395+0000","last_clean":"2024-09-22T08:11:23.207395+0000","last_became_active":"2024-09-22T08:10:51.189592+0000","last_became_peered":"2024-09-22T08:10:51.189592+0000","last_unstale":"2024-09-22T08:11:23.207395+0000","last_undegraded":"2024-09-22T08:11:23.207395+0000","last_fullsized":"2024-09-22T08:11:23.207395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:44.042635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.513524+0000","last_change":"2024-09-22T08:10:53.199349+0000","last_active":"2024-09-22T08:12:52.513524+0000","last_peered":"2024-09-22T08:12:52.513524+0000","last_clean":"2024-09-22T08:12:52.513524+0000","last_became_active":"2024-09-22T08:10:53.198999+0000","last_became_peered":"2024-09-22T08:10:53.198999+0000","last_unstale":"2024-09-22T08:12:52.513524+0000","last_undegraded":"2024-09-22T08:12:52.513524+0000","last_fullsized":"2024-09-22T08:12:52.513524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:40.998103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'22","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.900868+0000","last_change":"2024-09-22T08:14:22.900868+0000","last_active":"2024-09-22T08:14:22.900868+0000","last_peered":"2024-09-22T08:14:22.900868+0000","last_clean":"2024-09-22T08:14:22.900868+0000","last_became_active":"2024-09-22T08:10:45.183173+0000","last_became_peered":"2024-09-22T08:10:45.183173+0000","last_unstale":"2024-09-22T08:14:22.900868+0000","last_undegraded":"2024-09-22T08:14:22.900868+0000","last_fullsized":"2024-09-22T08:14:22.900868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-22T08:14:22.900782+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-22T08:14:22.900782+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.900782+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:29.628187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.818995+0000","last_change":"2024-09-22T08:14:07.818995+0000","last_active":"2024-09-22T08:14:07.818995+0000","last_peered":"2024-09-22T08:14:07.818995+0000","last_clean":"2024-09-22T08:14:07.818995+0000","last_became_active":"2024-09-22T08:10:43.177711+0000","last_became_peered":"2024-09-22T08:10:43.177711+0000","last_unstale":"2024-09-22T08:14:07.818995+0000","last_undegraded":"2024-09-22T08:14:07.818995+0000","last_fullsized":"2024-09-22T08:14:07.818995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:07.818910+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:07.818910+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.818910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:11.966919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.941323+0000","last_change":"2024-09-22T08:14:37.941323+0000","last_active":"2024-09-22T08:14:37.941323+0000","last_peered":"2024-09-22T08:14:37.941323+0000","last_clean":"2024-09-22T08:14:37.941323+0000","last_became_active":"2024-09-22T08:10:47.171702+0000","last_became_peered":"2024-09-22T08:10:47.171702+0000","last_unstale":"2024-09-22T08:14:37.941323+0000","last_undegraded":"2024-09-22T08:14:37.941323+0000","last_fullsized":"2024-09-22T08:14:37.941323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:37.941178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:37.941178+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.941178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:08.673150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.939363+0000","last_change":"2024-09-22T08:10:49.183268+0000","last_active":"2024-09-22T08:13:59.939363+0000","last_peered":"2024-09-22T08:13:59.939363+0000","last_clean":"2024-09-22T08:13:59.939363+0000","last_became_active":"2024-09-22T08:10:49.182398+0000","last_became_peered":"2024-09-22T08:10:49.182398+0000","last_unstale":"2024-09-22T08:13:59.939363+0000","last_undegraded":"2024-09-22T08:13:59.939363+0000","last_fullsized":"2024-09-22T08:13:59.939363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:20.960730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214581+0000","last_change":"2024-09-22T08:10:51.202949+0000","last_active":"2024-09-22T08:11:23.214581+0000","last_peered":"2024-09-22T08:11:23.214581+0000","last_clean":"2024-09-22T08:11:23.214581+0000","last_became_active":"2024-09-22T08:10:51.202485+0000","last_became_peered":"2024-09-22T08:10:51.202485+0000","last_unstale":"2024-09-22T08:11:23.214581+0000","last_undegraded":"2024-09-22T08:11:23.214581+0000","last_fullsized":"2024-09-22T08:11:23.214581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.969767+0000","last_change":"2024-09-22T08:10:53.202374+0000","last_active":"2024-09-22T08:13:52.969767+0000","last_peered":"2024-09-22T08:13:52.969767+0000","last_clean":"2024-09-22T08:13:52.969767+0000","last_became_active":"2024-09-22T08:10:53.201942+0000","last_became_peered":"2024-09-22T08:10:53.201942+0000","last_unstale":"2024-09-22T08:13:52.969767+0000","last_undegraded":"2024-09-22T08:13:52.969767+0000","last_fullsized":"2024-09-22T08:13:52.969767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:00.185249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.078202+0000","last_change":"2024-09-22T08:14:42.078202+0000","last_active":"2024-09-22T08:14:42.078202+0000","last_peered":"2024-09-22T08:14:42.078202+0000","last_clean":"2024-09-22T08:14:42.078202+0000","last_became_active":"2024-09-22T08:10:45.183576+0000","last_became_peered":"2024-09-22T08:10:45.183576+0000","last_unstale":"2024-09-22T08:14:42.078202+0000","last_undegraded":"2024-09-22T08:14:42.078202+0000","last_fullsized":"2024-09-22T08:14:42.078202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:42.078116+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:42.078116+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.078116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:21.619510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.778888+0000","last_change":"2024-09-22T08:14:08.778888+0000","last_active":"2024-09-22T08:14:08.778888+0000","last_peered":"2024-09-22T08:14:08.778888+0000","last_clean":"2024-09-22T08:14:08.778888+0000","last_became_active":"2024-09-22T08:10:43.178403+0000","last_became_peered":"2024-09-22T08:10:43.178403+0000","last_unstale":"2024-09-22T08:14:08.778888+0000","last_undegraded":"2024-09-22T08:14:08.778888+0000","last_fullsized":"2024-09-22T08:14:08.778888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.778788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.778788+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.778788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:11.516811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.941306+0000","last_change":"2024-09-22T08:14:36.941306+0000","last_active":"2024-09-22T08:14:36.941306+0000","last_peered":"2024-09-22T08:14:36.941306+0000","last_clean":"2024-09-22T08:14:36.941306+0000","last_became_active":"2024-09-22T08:10:47.171973+0000","last_became_peered":"2024-09-22T08:10:47.171973+0000","last_unstale":"2024-09-22T08:14:36.941306+0000","last_undegraded":"2024-09-22T08:14:36.941306+0000","last_fullsized":"2024-09-22T08:14:36.941306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:36.941191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:36.941191+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.941191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:39.832853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.884926+0000","last_change":"2024-09-22T08:10:49.185261+0000","last_active":"2024-09-22T08:13:59.884926+0000","last_peered":"2024-09-22T08:13:59.884926+0000","last_clean":"2024-09-22T08:13:59.884926+0000","last_became_active":"2024-09-22T08:10:49.184885+0000","last_became_peered":"2024-09-22T08:10:49.184885+0000","last_unstale":"2024-09-22T08:13:59.884926+0000","last_undegraded":"2024-09-22T08:13:59.884926+0000","last_fullsized":"2024-09-22T08:13:59.884926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:29.150336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.222373+0000","last_change":"2024-09-22T08:10:51.194317+0000","last_active":"2024-09-22T08:11:23.222373+0000","last_peered":"2024-09-22T08:11:23.222373+0000","last_clean":"2024-09-22T08:11:23.222373+0000","last_became_active":"2024-09-22T08:10:51.193970+0000","last_became_peered":"2024-09-22T08:10:51.193970+0000","last_unstale":"2024-09-22T08:11:23.222373+0000","last_undegraded":"2024-09-22T08:11:23.222373+0000","last_fullsized":"2024-09-22T08:11:23.222373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:52.931798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.572122+0000","last_change":"2024-09-22T08:10:53.202778+0000","last_active":"2024-09-22T08:12:52.572122+0000","last_peered":"2024-09-22T08:12:52.572122+0000","last_clean":"2024-09-22T08:12:52.572122+0000","last_became_active":"2024-09-22T08:10:53.202493+0000","last_became_peered":"2024-09-22T08:10:53.202493+0000","last_unstale":"2024-09-22T08:12:52.572122+0000","last_undegraded":"2024-09-22T08:12:52.572122+0000","last_fullsized":"2024-09-22T08:12:52.572122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:44.822421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.900963+0000","last_change":"2024-09-22T08:14:21.900963+0000","last_active":"2024-09-22T08:14:21.900963+0000","last_peered":"2024-09-22T08:14:21.900963+0000","last_clean":"2024-09-22T08:14:21.900963+0000","last_became_active":"2024-09-22T08:10:45.166540+0000","last_became_peered":"2024-09-22T08:10:45.166540+0000","last_unstale":"2024-09-22T08:14:21.900963+0000","last_undegraded":"2024-09-22T08:14:21.900963+0000","last_fullsized":"2024-09-22T08:14:21.900963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:21.900884+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:21.900884+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.900884+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:18.177848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.228380+0000","last_change":"2024-09-22T08:14:20.228380+0000","last_active":"2024-09-22T08:14:20.228380+0000","last_peered":"2024-09-22T08:14:20.228380+0000","last_clean":"2024-09-22T08:14:20.228380+0000","last_became_active":"2024-09-22T08:10:43.199724+0000","last_became_peered":"2024-09-22T08:10:43.199724+0000","last_unstale":"2024-09-22T08:14:20.228380+0000","last_undegraded":"2024-09-22T08:14:20.228380+0000","last_fullsized":"2024-09-22T08:14:20.228380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:20.228266+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:20.228266+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.228266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:39.492150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.214717+0000","last_change":"2024-09-22T08:10:47.175833+0000","last_active":"2024-09-22T08:11:23.214717+0000","last_peered":"2024-09-22T08:11:23.214717+0000","last_clean":"2024-09-22T08:11:23.214717+0000","last_became_active":"2024-09-22T08:10:47.175541+0000","last_became_peered":"2024-09-22T08:10:47.175541+0000","last_unstale":"2024-09-22T08:11:23.214717+0000","last_undegraded":"2024-09-22T08:11:23.214717+0000","last_fullsized":"2024-09-22T08:11:23.214717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:49:17.796324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.584978+0000","last_change":"2024-09-22T08:10:49.188295+0000","last_active":"2024-09-22T08:12:52.584978+0000","last_peered":"2024-09-22T08:12:52.584978+0000","last_clean":"2024-09-22T08:12:52.584978+0000","last_became_active":"2024-09-22T08:10:49.187767+0000","last_became_peered":"2024-09-22T08:10:49.187767+0000","last_unstale":"2024-09-22T08:12:52.584978+0000","last_undegraded":"2024-09-22T08:12:52.584978+0000","last_fullsized":"2024-09-22T08:12:52.584978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:02.055272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":370,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.791305+0000","last_change":"2024-09-22T08:10:51.198099+0000","last_active":"2024-09-22T08:13:59.791305+0000","last_peered":"2024-09-22T08:13:59.791305+0000","last_clean":"2024-09-22T08:13:59.791305+0000","last_became_active":"2024-09-22T08:10:51.197814+0000","last_became_peered":"2024-09-22T08:10:51.197814+0000","last_unstale":"2024-09-22T08:13:59.791305+0000","last_undegraded":"2024-09-22T08:13:59.791305+0000","last_fullsized":"2024-09-22T08:13:59.791305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:40.509973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209032+0000","last_change":"2024-09-22T08:10:53.200170+0000","last_active":"2024-09-22T08:11:23.209032+0000","last_peered":"2024-09-22T08:11:23.209032+0000","last_clean":"2024-09-22T08:11:23.209032+0000","last_became_active":"2024-09-22T08:10:53.199881+0000","last_became_peered":"2024-09-22T08:10:53.199881+0000","last_unstale":"2024-09-22T08:11:23.209032+0000","last_undegraded":"2024-09-22T08:11:23.209032+0000","last_fullsized":"2024-09-22T08:11:23.209032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:46.946049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.934421+0000","last_change":"2024-09-22T08:14:25.934421+0000","last_active":"2024-09-22T08:14:25.934421+0000","last_peered":"2024-09-22T08:14:25.934421+0000","last_clean":"2024-09-22T08:14:25.934421+0000","last_became_active":"2024-09-22T08:10:45.166103+0000","last_became_peered":"2024-09-22T08:10:45.166103+0000","last_unstale":"2024-09-22T08:14:25.934421+0000","last_undegraded":"2024-09-22T08:14:25.934421+0000","last_fullsized":"2024-09-22T08:14:25.934421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:25.934299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:25.934299+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.934299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:29.868493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.769326+0000","last_change":"2024-09-22T08:14:10.769326+0000","last_active":"2024-09-22T08:14:10.769326+0000","last_peered":"2024-09-22T08:14:10.769326+0000","last_clean":"2024-09-22T08:14:10.769326+0000","last_became_active":"2024-09-22T08:10:43.180097+0000","last_became_peered":"2024-09-22T08:10:43.180097+0000","last_unstale":"2024-09-22T08:14:10.769326+0000","last_undegraded":"2024-09-22T08:14:10.769326+0000","last_fullsized":"2024-09-22T08:14:10.769326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:10.769243+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:10.769243+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.769243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:28.728155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212558+0000","last_change":"2024-09-22T08:10:47.175982+0000","last_active":"2024-09-22T08:11:23.212558+0000","last_peered":"2024-09-22T08:11:23.212558+0000","last_clean":"2024-09-22T08:11:23.212558+0000","last_became_active":"2024-09-22T08:10:47.175604+0000","last_became_peered":"2024-09-22T08:10:47.175604+0000","last_unstale":"2024-09-22T08:11:23.212558+0000","last_undegraded":"2024-09-22T08:11:23.212558+0000","last_fullsized":"2024-09-22T08:11:23.212558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:15.650731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.911039+0000","last_change":"2024-09-22T08:10:49.176102+0000","last_active":"2024-09-22T08:13:59.911039+0000","last_peered":"2024-09-22T08:13:59.911039+0000","last_clean":"2024-09-22T08:13:59.911039+0000","last_became_active":"2024-09-22T08:10:49.175817+0000","last_became_peered":"2024-09-22T08:10:49.175817+0000","last_unstale":"2024-09-22T08:13:59.911039+0000","last_undegraded":"2024-09-22T08:13:59.911039+0000","last_fullsized":"2024-09-22T08:13:59.911039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:27:19.626204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.219931+0000","last_change":"2024-09-22T08:10:51.192395+0000","last_active":"2024-09-22T08:11:23.219931+0000","last_peered":"2024-09-22T08:11:23.219931+0000","last_clean":"2024-09-22T08:11:23.219931+0000","last_became_active":"2024-09-22T08:10:51.191988+0000","last_became_peered":"2024-09-22T08:10:51.191988+0000","last_unstale":"2024-09-22T08:11:23.219931+0000","last_undegraded":"2024-09-22T08:11:23.219931+0000","last_fullsized":"2024-09-22T08:11:23.219931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:22:08.008376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216778+0000","last_change":"2024-09-22T08:10:53.199421+0000","last_active":"2024-09-22T08:11:23.216778+0000","last_peered":"2024-09-22T08:11:23.216778+0000","last_clean":"2024-09-22T08:11:23.216778+0000","last_became_active":"2024-09-22T08:10:53.199158+0000","last_became_peered":"2024-09-22T08:10:53.199158+0000","last_unstale":"2024-09-22T08:11:23.216778+0000","last_undegraded":"2024-09-22T08:11:23.216778+0000","last_fullsized":"2024-09-22T08:11:23.216778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:32.896582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.886211+0000","last_change":"2024-09-22T08:14:23.886211+0000","last_active":"2024-09-22T08:14:23.886211+0000","last_peered":"2024-09-22T08:14:23.886211+0000","last_clean":"2024-09-22T08:14:23.886211+0000","last_became_active":"2024-09-22T08:10:45.165116+0000","last_became_peered":"2024-09-22T08:10:45.165116+0000","last_unstale":"2024-09-22T08:14:23.886211+0000","last_undegraded":"2024-09-22T08:14:23.886211+0000","last_fullsized":"2024-09-22T08:14:23.886211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:23.886075+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:23.886075+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.886075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:31.053533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.266509+0000","last_change":"2024-09-22T08:14:21.266509+0000","last_active":"2024-09-22T08:14:21.266509+0000","last_peered":"2024-09-22T08:14:21.266509+0000","last_clean":"2024-09-22T08:14:21.266509+0000","last_became_active":"2024-09-22T08:10:43.201076+0000","last_became_peered":"2024-09-22T08:10:43.201076+0000","last_unstale":"2024-09-22T08:14:21.266509+0000","last_undegraded":"2024-09-22T08:14:21.266509+0000","last_fullsized":"2024-09-22T08:14:21.266509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:21.266407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:21.266407+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.266407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:15.619690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.961799+0000","last_change":"2024-09-22T08:14:35.961799+0000","last_active":"2024-09-22T08:14:35.961799+0000","last_peered":"2024-09-22T08:14:35.961799+0000","last_clean":"2024-09-22T08:14:35.961799+0000","last_became_active":"2024-09-22T08:10:47.172988+0000","last_became_peered":"2024-09-22T08:10:47.172988+0000","last_unstale":"2024-09-22T08:14:35.961799+0000","last_undegraded":"2024-09-22T08:14:35.961799+0000","last_fullsized":"2024-09-22T08:14:35.961799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:35.961689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:35.961689+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.961689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:47.596270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.914196+0000","last_change":"2024-09-22T08:10:49.185163+0000","last_active":"2024-09-22T08:13:59.914196+0000","last_peered":"2024-09-22T08:13:59.914196+0000","last_clean":"2024-09-22T08:13:59.914196+0000","last_became_active":"2024-09-22T08:10:49.184860+0000","last_became_peered":"2024-09-22T08:10:49.184860+0000","last_unstale":"2024-09-22T08:13:59.914196+0000","last_undegraded":"2024-09-22T08:13:59.914196+0000","last_fullsized":"2024-09-22T08:13:59.914196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:09:06.255387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209254+0000","last_change":"2024-09-22T08:10:51.200556+0000","last_active":"2024-09-22T08:11:23.209254+0000","last_peered":"2024-09-22T08:11:23.209254+0000","last_clean":"2024-09-22T08:11:23.209254+0000","last_became_active":"2024-09-22T08:10:51.199870+0000","last_became_peered":"2024-09-22T08:10:51.199870+0000","last_unstale":"2024-09-22T08:11:23.209254+0000","last_undegraded":"2024-09-22T08:11:23.209254+0000","last_fullsized":"2024-09-22T08:11:23.209254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.684662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212091+0000","last_change":"2024-09-22T08:10:53.201219+0000","last_active":"2024-09-22T08:11:23.212091+0000","last_peered":"2024-09-22T08:11:23.212091+0000","last_clean":"2024-09-22T08:11:23.212091+0000","last_became_active":"2024-09-22T08:10:53.200904+0000","last_became_peered":"2024-09-22T08:10:53.200904+0000","last_unstale":"2024-09-22T08:11:23.212091+0000","last_undegraded":"2024-09-22T08:11:23.212091+0000","last_fullsized":"2024-09-22T08:11:23.212091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:58.296182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.113489+0000","last_change":"2024-09-22T08:14:41.113489+0000","last_active":"2024-09-22T08:14:41.113489+0000","last_peered":"2024-09-22T08:14:41.113489+0000","last_clean":"2024-09-22T08:14:41.113489+0000","last_became_active":"2024-09-22T08:10:45.165511+0000","last_became_peered":"2024-09-22T08:10:45.165511+0000","last_unstale":"2024-09-22T08:14:41.113489+0000","last_undegraded":"2024-09-22T08:14:41.113489+0000","last_fullsized":"2024-09-22T08:14:41.113489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:41.113388+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:41.113388+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.113388+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:08.634130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.982672+0000","last_change":"2024-09-22T08:14:05.982672+0000","last_active":"2024-09-22T08:14:05.982672+0000","last_peered":"2024-09-22T08:14:05.982672+0000","last_clean":"2024-09-22T08:14:05.982672+0000","last_became_active":"2024-09-22T08:10:43.176954+0000","last_became_peered":"2024-09-22T08:10:43.176954+0000","last_unstale":"2024-09-22T08:14:05.982672+0000","last_undegraded":"2024-09-22T08:14:05.982672+0000","last_fullsized":"2024-09-22T08:14:05.982672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.982575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.982575+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.982575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:15.153255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.835539+0000","last_change":"2024-09-22T08:14:41.835539+0000","last_active":"2024-09-22T08:14:41.835539+0000","last_peered":"2024-09-22T08:14:41.835539+0000","last_clean":"2024-09-22T08:14:41.835539+0000","last_became_active":"2024-09-22T08:10:47.176641+0000","last_became_peered":"2024-09-22T08:10:47.176641+0000","last_unstale":"2024-09-22T08:14:41.835539+0000","last_undegraded":"2024-09-22T08:14:41.835539+0000","last_fullsized":"2024-09-22T08:14:41.835539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:41.835433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:41.835433+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.835433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:24.123944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.878567+0000","last_change":"2024-09-22T08:10:49.188256+0000","last_active":"2024-09-22T08:13:59.878567+0000","last_peered":"2024-09-22T08:13:59.878567+0000","last_clean":"2024-09-22T08:13:59.878567+0000","last_became_active":"2024-09-22T08:10:49.187467+0000","last_became_peered":"2024-09-22T08:10:49.187467+0000","last_unstale":"2024-09-22T08:13:59.878567+0000","last_undegraded":"2024-09-22T08:13:59.878567+0000","last_fullsized":"2024-09-22T08:13:59.878567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:27.242973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209400+0000","last_change":"2024-09-22T08:10:51.198209+0000","last_active":"2024-09-22T08:11:23.209400+0000","last_peered":"2024-09-22T08:11:23.209400+0000","last_clean":"2024-09-22T08:11:23.209400+0000","last_became_active":"2024-09-22T08:10:51.197942+0000","last_became_peered":"2024-09-22T08:10:51.197942+0000","last_unstale":"2024-09-22T08:11:23.209400+0000","last_undegraded":"2024-09-22T08:11:23.209400+0000","last_fullsized":"2024-09-22T08:11:23.209400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:42.833261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.573626+0000","last_change":"2024-09-22T08:10:53.204064+0000","last_active":"2024-09-22T08:12:52.573626+0000","last_peered":"2024-09-22T08:12:52.573626+0000","last_clean":"2024-09-22T08:12:52.573626+0000","last_became_active":"2024-09-22T08:10:53.203791+0000","last_became_peered":"2024-09-22T08:10:53.203791+0000","last_unstale":"2024-09-22T08:12:52.573626+0000","last_undegraded":"2024-09-22T08:12:52.573626+0000","last_fullsized":"2024-09-22T08:12:52.573626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:42.795444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.887707+0000","last_change":"2024-09-22T08:14:24.887707+0000","last_active":"2024-09-22T08:14:24.887707+0000","last_peered":"2024-09-22T08:14:24.887707+0000","last_clean":"2024-09-22T08:14:24.887707+0000","last_became_active":"2024-09-22T08:10:45.163402+0000","last_became_peered":"2024-09-22T08:10:45.163402+0000","last_unstale":"2024-09-22T08:14:24.887707+0000","last_undegraded":"2024-09-22T08:14:24.887707+0000","last_fullsized":"2024-09-22T08:14:24.887707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:24.887588+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:24.887588+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.887588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:50.926457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.746483+0000","last_change":"2024-09-22T08:14:09.746483+0000","last_active":"2024-09-22T08:14:09.746483+0000","last_peered":"2024-09-22T08:14:09.746483+0000","last_clean":"2024-09-22T08:14:09.746483+0000","last_became_active":"2024-09-22T08:10:43.184777+0000","last_became_peered":"2024-09-22T08:10:43.184777+0000","last_unstale":"2024-09-22T08:14:09.746483+0000","last_undegraded":"2024-09-22T08:14:09.746483+0000","last_fullsized":"2024-09-22T08:14:09.746483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:09.746395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:09.746395+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.746395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:20.482133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:49.796204+0000","last_change":"2024-09-22T08:10:47.176659+0000","last_active":"2024-09-22T08:12:49.796204+0000","last_peered":"2024-09-22T08:12:49.796204+0000","last_clean":"2024-09-22T08:12:49.796204+0000","last_became_active":"2024-09-22T08:10:47.176390+0000","last_became_peered":"2024-09-22T08:10:47.176390+0000","last_unstale":"2024-09-22T08:12:49.796204+0000","last_undegraded":"2024-09-22T08:12:49.796204+0000","last_fullsized":"2024-09-22T08:12:49.796204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:46.154885+0000","last_clean_scrub_stamp":"2024-09-22T08:10:46.154885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:24.829227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'37","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.888257+0000","last_change":"2024-09-22T08:10:49.189639+0000","last_active":"2024-09-22T08:13:59.888257+0000","last_peered":"2024-09-22T08:13:59.888257+0000","last_clean":"2024-09-22T08:13:59.888257+0000","last_became_active":"2024-09-22T08:10:49.188231+0000","last_became_peered":"2024-09-22T08:10:49.188231+0000","last_unstale":"2024-09-22T08:13:59.888257+0000","last_undegraded":"2024-09-22T08:13:59.888257+0000","last_fullsized":"2024-09-22T08:13:59.888257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:08.360453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":46,"num_read_kb":60,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221258+0000","last_change":"2024-09-22T08:10:51.202802+0000","last_active":"2024-09-22T08:11:23.221258+0000","last_peered":"2024-09-22T08:11:23.221258+0000","last_clean":"2024-09-22T08:11:23.221258+0000","last_became_active":"2024-09-22T08:10:51.202476+0000","last_became_peered":"2024-09-22T08:10:51.202476+0000","last_unstale":"2024-09-22T08:11:23.221258+0000","last_undegraded":"2024-09-22T08:11:23.221258+0000","last_fullsized":"2024-09-22T08:11:23.221258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.161803+0000","last_change":"2024-09-22T08:10:53.201417+0000","last_active":"2024-09-22T08:12:51.161803+0000","last_peered":"2024-09-22T08:12:51.161803+0000","last_clean":"2024-09-22T08:12:51.161803+0000","last_became_active":"2024-09-22T08:10:53.201125+0000","last_became_peered":"2024-09-22T08:10:53.201125+0000","last_unstale":"2024-09-22T08:12:51.161803+0000","last_undegraded":"2024-09-22T08:12:51.161803+0000","last_fullsized":"2024-09-22T08:12:51.161803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:16.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.837624+0000","last_change":"2024-09-22T08:14:24.837624+0000","last_active":"2024-09-22T08:14:24.837624+0000","last_peered":"2024-09-22T08:14:24.837624+0000","last_clean":"2024-09-22T08:14:24.837624+0000","last_became_active":"2024-09-22T08:10:45.180781+0000","last_became_peered":"2024-09-22T08:10:45.180781+0000","last_unstale":"2024-09-22T08:14:24.837624+0000","last_undegraded":"2024-09-22T08:14:24.837624+0000","last_fullsized":"2024-09-22T08:14:24.837624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:24.837547+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:24.837547+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.837547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:21.114510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.826597+0000","last_change":"2024-09-22T08:14:13.826597+0000","last_active":"2024-09-22T08:14:13.826597+0000","last_peered":"2024-09-22T08:14:13.826597+0000","last_clean":"2024-09-22T08:14:13.826597+0000","last_became_active":"2024-09-22T08:10:43.179693+0000","last_became_peered":"2024-09-22T08:10:43.179693+0000","last_unstale":"2024-09-22T08:14:13.826597+0000","last_undegraded":"2024-09-22T08:14:13.826597+0000","last_fullsized":"2024-09-22T08:14:13.826597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:13.826510+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:13.826510+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.826510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:05.210216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'12","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.978947+0000","last_change":"2024-09-22T08:14:27.978947+0000","last_active":"2024-09-22T08:14:27.978947+0000","last_peered":"2024-09-22T08:14:27.978947+0000","last_clean":"2024-09-22T08:14:27.978947+0000","last_became_active":"2024-09-22T08:10:45.164406+0000","last_became_peered":"2024-09-22T08:10:45.164406+0000","last_unstale":"2024-09-22T08:14:27.978947+0000","last_undegraded":"2024-09-22T08:14:27.978947+0000","last_fullsized":"2024-09-22T08:14:27.978947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:27.978856+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:27.978856+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.978856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:45.929432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.893552+0000","last_change":"2024-09-22T08:14:09.893552+0000","last_active":"2024-09-22T08:14:09.893552+0000","last_peered":"2024-09-22T08:14:09.893552+0000","last_clean":"2024-09-22T08:14:09.893552+0000","last_became_active":"2024-09-22T08:10:43.178018+0000","last_became_peered":"2024-09-22T08:10:43.178018+0000","last_unstale":"2024-09-22T08:14:09.893552+0000","last_undegraded":"2024-09-22T08:14:09.893552+0000","last_fullsized":"2024-09-22T08:14:09.893552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:09.893443+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:09.893443+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.893443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:14.018138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.227865+0000","last_change":"2024-09-22T08:10:45.170408+0000","last_active":"2024-09-22T08:13:53.227865+0000","last_peered":"2024-09-22T08:13:53.227865+0000","last_clean":"2024-09-22T08:13:53.227865+0000","last_became_active":"2024-09-22T08:10:45.168526+0000","last_became_peered":"2024-09-22T08:10:45.168526+0000","last_unstale":"2024-09-22T08:13:53.227865+0000","last_undegraded":"2024-09-22T08:13:53.227865+0000","last_fullsized":"2024-09-22T08:13:53.227865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:17.590758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":86,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.197132+0000","last_change":"2024-09-22T08:14:23.197132+0000","last_active":"2024-09-22T08:14:23.197132+0000","last_peered":"2024-09-22T08:14:23.197132+0000","last_clean":"2024-09-22T08:14:23.197132+0000","last_became_active":"2024-09-22T08:10:43.196221+0000","last_became_peered":"2024-09-22T08:10:43.196221+0000","last_unstale":"2024-09-22T08:14:23.197132+0000","last_undegraded":"2024-09-22T08:14:23.197132+0000","last_fullsized":"2024-09-22T08:14:23.197132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:23.197048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:23.197048+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.197048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:53.693927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.927351+0000","last_change":"2024-09-22T08:14:24.927351+0000","last_active":"2024-09-22T08:14:24.927351+0000","last_peered":"2024-09-22T08:14:24.927351+0000","last_clean":"2024-09-22T08:14:24.927351+0000","last_became_active":"2024-09-22T08:10:45.166432+0000","last_became_peered":"2024-09-22T08:10:45.166432+0000","last_unstale":"2024-09-22T08:14:24.927351+0000","last_undegraded":"2024-09-22T08:14:24.927351+0000","last_fullsized":"2024-09-22T08:14:24.927351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:24.927242+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:24.927242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.927242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:25.223688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.902014+0000","last_change":"2024-09-22T08:14:10.902014+0000","last_active":"2024-09-22T08:14:10.902014+0000","last_peered":"2024-09-22T08:14:10.902014+0000","last_clean":"2024-09-22T08:14:10.902014+0000","last_became_active":"2024-09-22T08:10:43.177673+0000","last_became_peered":"2024-09-22T08:10:43.177673+0000","last_unstale":"2024-09-22T08:14:10.902014+0000","last_undegraded":"2024-09-22T08:14:10.902014+0000","last_fullsized":"2024-09-22T08:14:10.902014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:10.901926+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:10.901926+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.901926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:49.460312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.933779+0000","last_change":"2024-09-22T08:14:26.933779+0000","last_active":"2024-09-22T08:14:26.933779+0000","last_peered":"2024-09-22T08:14:26.933779+0000","last_clean":"2024-09-22T08:14:26.933779+0000","last_became_active":"2024-09-22T08:10:45.171476+0000","last_became_peered":"2024-09-22T08:10:45.171476+0000","last_unstale":"2024-09-22T08:14:26.933779+0000","last_undegraded":"2024-09-22T08:14:26.933779+0000","last_fullsized":"2024-09-22T08:14:26.933779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:26.933687+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:26.933687+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.933687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:15.758235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.868565+0000","last_change":"2024-09-22T08:14:11.868565+0000","last_active":"2024-09-22T08:14:11.868565+0000","last_peered":"2024-09-22T08:14:11.868565+0000","last_clean":"2024-09-22T08:14:11.868565+0000","last_became_active":"2024-09-22T08:10:43.186671+0000","last_became_peered":"2024-09-22T08:10:43.186671+0000","last_unstale":"2024-09-22T08:14:11.868565+0000","last_undegraded":"2024-09-22T08:14:11.868565+0000","last_fullsized":"2024-09-22T08:14:11.868565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:11.868472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:11.868472+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.868472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:04.057150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.851300+0000","last_change":"2024-09-22T08:14:23.851300+0000","last_active":"2024-09-22T08:14:23.851300+0000","last_peered":"2024-09-22T08:14:23.851300+0000","last_clean":"2024-09-22T08:14:23.851300+0000","last_became_active":"2024-09-22T08:10:45.182785+0000","last_became_peered":"2024-09-22T08:10:45.182785+0000","last_unstale":"2024-09-22T08:14:23.851300+0000","last_undegraded":"2024-09-22T08:14:23.851300+0000","last_fullsized":"2024-09-22T08:14:23.851300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:23.851213+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:23.851213+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.851213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:29.971199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.814682+0000","last_change":"2024-09-22T08:14:11.814682+0000","last_active":"2024-09-22T08:14:11.814682+0000","last_peered":"2024-09-22T08:14:11.814682+0000","last_clean":"2024-09-22T08:14:11.814682+0000","last_became_active":"2024-09-22T08:10:43.182824+0000","last_became_peered":"2024-09-22T08:10:43.182824+0000","last_unstale":"2024-09-22T08:14:11.814682+0000","last_undegraded":"2024-09-22T08:14:11.814682+0000","last_fullsized":"2024-09-22T08:14:11.814682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:11.814594+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:11.814594+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.814594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:06.053818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'26","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.938699+0000","last_change":"2024-09-22T08:14:23.938699+0000","last_active":"2024-09-22T08:14:23.938699+0000","last_peered":"2024-09-22T08:14:23.938699+0000","last_clean":"2024-09-22T08:14:23.938699+0000","last_became_active":"2024-09-22T08:10:45.175600+0000","last_became_peered":"2024-09-22T08:10:45.175600+0000","last_unstale":"2024-09-22T08:14:23.938699+0000","last_undegraded":"2024-09-22T08:14:23.938699+0000","last_fullsized":"2024-09-22T08:14:23.938699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-22T08:14:23.938616+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-22T08:14:23.938616+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.938616+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:29.442181+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.753775+0000","last_change":"2024-09-22T08:14:11.753775+0000","last_active":"2024-09-22T08:14:11.753775+0000","last_peered":"2024-09-22T08:14:11.753775+0000","last_clean":"2024-09-22T08:14:11.753775+0000","last_became_active":"2024-09-22T08:10:43.179529+0000","last_became_peered":"2024-09-22T08:10:43.179529+0000","last_unstale":"2024-09-22T08:14:11.753775+0000","last_undegraded":"2024-09-22T08:14:11.753775+0000","last_fullsized":"2024-09-22T08:14:11.753775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:11.753682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:11.753682+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.753682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:24.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.798299+0000","last_change":"2024-09-22T08:14:25.798299+0000","last_active":"2024-09-22T08:14:25.798299+0000","last_peered":"2024-09-22T08:14:25.798299+0000","last_clean":"2024-09-22T08:14:25.798299+0000","last_became_active":"2024-09-22T08:10:45.183901+0000","last_became_peered":"2024-09-22T08:10:45.183901+0000","last_unstale":"2024-09-22T08:14:25.798299+0000","last_undegraded":"2024-09-22T08:14:25.798299+0000","last_fullsized":"2024-09-22T08:14:25.798299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:25.798179+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:25.798179+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.798179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:32.525584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.880179+0000","last_change":"2024-09-22T08:14:12.880179+0000","last_active":"2024-09-22T08:14:12.880179+0000","last_peered":"2024-09-22T08:14:12.880179+0000","last_clean":"2024-09-22T08:14:12.880179+0000","last_became_active":"2024-09-22T08:10:43.177461+0000","last_became_peered":"2024-09-22T08:10:43.177461+0000","last_unstale":"2024-09-22T08:14:12.880179+0000","last_undegraded":"2024-09-22T08:14:12.880179+0000","last_fullsized":"2024-09-22T08:14:12.880179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:12.880088+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:12.880088+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.880088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:57.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'14","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.796120+0000","last_change":"2024-09-22T08:14:28.796120+0000","last_active":"2024-09-22T08:14:28.796120+0000","last_peered":"2024-09-22T08:14:28.796120+0000","last_clean":"2024-09-22T08:14:28.796120+0000","last_became_active":"2024-09-22T08:10:45.169723+0000","last_became_peered":"2024-09-22T08:10:45.169723+0000","last_unstale":"2024-09-22T08:14:28.796120+0000","last_undegraded":"2024-09-22T08:14:28.796120+0000","last_fullsized":"2024-09-22T08:14:28.796120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:28.796011+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:28.796011+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.796011+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:40.829249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.234089+0000","last_change":"2024-09-22T08:14:22.234089+0000","last_active":"2024-09-22T08:14:22.234089+0000","last_peered":"2024-09-22T08:14:22.234089+0000","last_clean":"2024-09-22T08:14:22.234089+0000","last_became_active":"2024-09-22T08:10:43.195587+0000","last_became_peered":"2024-09-22T08:10:43.195587+0000","last_unstale":"2024-09-22T08:14:22.234089+0000","last_undegraded":"2024-09-22T08:14:22.234089+0000","last_fullsized":"2024-09-22T08:14:22.234089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:22.234003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:22.234003+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.234003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:20.685742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.183433+0000","last_change":"2024-09-22T08:10:45.170370+0000","last_active":"2024-09-22T08:13:53.183433+0000","last_peered":"2024-09-22T08:13:53.183433+0000","last_clean":"2024-09-22T08:13:53.183433+0000","last_became_active":"2024-09-22T08:10:45.169366+0000","last_became_peered":"2024-09-22T08:10:45.169366+0000","last_unstale":"2024-09-22T08:13:53.183433+0000","last_undegraded":"2024-09-22T08:13:53.183433+0000","last_fullsized":"2024-09-22T08:13:53.183433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:44.147894+0000","last_clean_scrub_stamp":"2024-09-22T08:10:44.147894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.634336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.867652+0000","last_change":"2024-09-22T08:14:13.867652+0000","last_active":"2024-09-22T08:14:13.867652+0000","last_peered":"2024-09-22T08:14:13.867652+0000","last_clean":"2024-09-22T08:14:13.867652+0000","last_became_active":"2024-09-22T08:10:43.187246+0000","last_became_peered":"2024-09-22T08:10:43.187246+0000","last_unstale":"2024-09-22T08:14:13.867652+0000","last_undegraded":"2024-09-22T08:14:13.867652+0000","last_fullsized":"2024-09-22T08:14:13.867652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:13.867567+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:13.867567+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.867567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:08.637420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.014166+0000","last_change":"2024-09-22T08:14:30.014166+0000","last_active":"2024-09-22T08:14:30.014166+0000","last_peered":"2024-09-22T08:14:30.014166+0000","last_clean":"2024-09-22T08:14:30.014166+0000","last_became_active":"2024-09-22T08:10:45.172080+0000","last_became_peered":"2024-09-22T08:10:45.172080+0000","last_unstale":"2024-09-22T08:14:30.014166+0000","last_undegraded":"2024-09-22T08:14:30.014166+0000","last_fullsized":"2024-09-22T08:14:30.014166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:30.014084+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:30.014084+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.014084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:11.302015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.765941+0000","last_change":"2024-09-22T08:14:14.765941+0000","last_active":"2024-09-22T08:14:14.765941+0000","last_peered":"2024-09-22T08:14:14.765941+0000","last_clean":"2024-09-22T08:14:14.765941+0000","last_became_active":"2024-09-22T08:10:43.178924+0000","last_became_peered":"2024-09-22T08:10:43.178924+0000","last_unstale":"2024-09-22T08:14:14.765941+0000","last_undegraded":"2024-09-22T08:14:14.765941+0000","last_fullsized":"2024-09-22T08:14:14.765941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:14.765846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:14.765846+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.765846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:42.012438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'16","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.826514+0000","last_change":"2024-09-22T08:14:30.826514+0000","last_active":"2024-09-22T08:14:30.826514+0000","last_peered":"2024-09-22T08:14:30.826514+0000","last_clean":"2024-09-22T08:14:30.826514+0000","last_became_active":"2024-09-22T08:10:45.172101+0000","last_became_peered":"2024-09-22T08:10:45.172101+0000","last_unstale":"2024-09-22T08:14:30.826514+0000","last_undegraded":"2024-09-22T08:14:30.826514+0000","last_fullsized":"2024-09-22T08:14:30.826514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-22T08:14:30.826439+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-22T08:14:30.826439+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.826439+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:48.777015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.756790+0000","last_change":"2024-09-22T08:14:13.756790+0000","last_active":"2024-09-22T08:14:13.756790+0000","last_peered":"2024-09-22T08:14:13.756790+0000","last_clean":"2024-09-22T08:14:13.756790+0000","last_became_active":"2024-09-22T08:10:43.178876+0000","last_became_peered":"2024-09-22T08:10:43.178876+0000","last_unstale":"2024-09-22T08:14:13.756790+0000","last_undegraded":"2024-09-22T08:14:13.756790+0000","last_fullsized":"2024-09-22T08:14:13.756790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:13.756688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:13.756688+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.756688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:05.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.790763+0000","last_change":"2024-09-22T08:14:27.790763+0000","last_active":"2024-09-22T08:14:27.790763+0000","last_peered":"2024-09-22T08:14:27.790763+0000","last_clean":"2024-09-22T08:14:27.790763+0000","last_became_active":"2024-09-22T08:10:45.180117+0000","last_became_peered":"2024-09-22T08:10:45.180117+0000","last_unstale":"2024-09-22T08:14:27.790763+0000","last_undegraded":"2024-09-22T08:14:27.790763+0000","last_fullsized":"2024-09-22T08:14:27.790763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:27.790679+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:27.790679+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.790679+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:28.087125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.212034+0000","last_change":"2024-09-22T08:14:24.212034+0000","last_active":"2024-09-22T08:14:24.212034+0000","last_peered":"2024-09-22T08:14:24.212034+0000","last_clean":"2024-09-22T08:14:24.212034+0000","last_became_active":"2024-09-22T08:10:43.195770+0000","last_became_peered":"2024-09-22T08:10:43.195770+0000","last_unstale":"2024-09-22T08:14:24.212034+0000","last_undegraded":"2024-09-22T08:14:24.212034+0000","last_fullsized":"2024-09-22T08:14:24.212034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:24.211938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:24.211938+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.211938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:35.988551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.741067+0000","last_change":"2024-09-22T08:14:33.741067+0000","last_active":"2024-09-22T08:14:33.741067+0000","last_peered":"2024-09-22T08:14:33.741067+0000","last_clean":"2024-09-22T08:14:33.741067+0000","last_became_active":"2024-09-22T08:10:45.180098+0000","last_became_peered":"2024-09-22T08:10:45.180098+0000","last_unstale":"2024-09-22T08:14:33.741067+0000","last_undegraded":"2024-09-22T08:14:33.741067+0000","last_fullsized":"2024-09-22T08:14:33.741067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:33.740986+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:33.740986+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.740986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:54.421474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.262115+0000","last_change":"2024-09-22T08:14:25.262115+0000","last_active":"2024-09-22T08:14:25.262115+0000","last_peered":"2024-09-22T08:14:25.262115+0000","last_clean":"2024-09-22T08:14:25.262115+0000","last_became_active":"2024-09-22T08:10:43.201687+0000","last_became_peered":"2024-09-22T08:10:43.201687+0000","last_unstale":"2024-09-22T08:14:25.262115+0000","last_undegraded":"2024-09-22T08:14:25.262115+0000","last_fullsized":"2024-09-22T08:14:25.262115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:25.262020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:25.262020+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.262020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:12.187326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.929258+0000","last_change":"2024-09-22T08:14:26.929258+0000","last_active":"2024-09-22T08:14:26.929258+0000","last_peered":"2024-09-22T08:14:26.929258+0000","last_clean":"2024-09-22T08:14:26.929258+0000","last_became_active":"2024-09-22T08:11:23.215110+0000","last_became_peered":"2024-09-22T08:11:23.215110+0000","last_unstale":"2024-09-22T08:14:26.929258+0000","last_undegraded":"2024-09-22T08:14:26.929258+0000","last_fullsized":"2024-09-22T08:14:26.929258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:26.929163+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:26.929163+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.929163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:29.392032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.790672+0000","last_change":"2024-09-22T08:14:12.790672+0000","last_active":"2024-09-22T08:14:12.790672+0000","last_peered":"2024-09-22T08:14:12.790672+0000","last_clean":"2024-09-22T08:14:12.790672+0000","last_became_active":"2024-09-22T08:10:43.187195+0000","last_became_peered":"2024-09-22T08:10:43.187195+0000","last_unstale":"2024-09-22T08:14:12.790672+0000","last_undegraded":"2024-09-22T08:14:12.790672+0000","last_fullsized":"2024-09-22T08:14:12.790672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:12.790570+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:12.790570+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.790570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:57.729020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.829887+0000","last_change":"2024-09-22T08:14:26.829887+0000","last_active":"2024-09-22T08:14:26.829887+0000","last_peered":"2024-09-22T08:14:26.829887+0000","last_clean":"2024-09-22T08:14:26.829887+0000","last_became_active":"2024-09-22T08:10:45.179150+0000","last_became_peered":"2024-09-22T08:10:45.179150+0000","last_unstale":"2024-09-22T08:14:26.829887+0000","last_undegraded":"2024-09-22T08:14:26.829887+0000","last_fullsized":"2024-09-22T08:14:26.829887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:26.829765+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:26.829765+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.829765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:32.333330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.213227+0000","last_change":"2024-09-22T08:14:26.213227+0000","last_active":"2024-09-22T08:14:26.213227+0000","last_peered":"2024-09-22T08:14:26.213227+0000","last_clean":"2024-09-22T08:14:26.213227+0000","last_became_active":"2024-09-22T08:10:43.200282+0000","last_became_peered":"2024-09-22T08:10:43.200282+0000","last_unstale":"2024-09-22T08:14:26.213227+0000","last_undegraded":"2024-09-22T08:14:26.213227+0000","last_fullsized":"2024-09-22T08:14:26.213227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:26.213130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:26.213130+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.213130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:57.522386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.216341+0000","last_change":"2024-09-22T08:14:27.216341+0000","last_active":"2024-09-22T08:14:27.216341+0000","last_peered":"2024-09-22T08:14:27.216341+0000","last_clean":"2024-09-22T08:14:27.216341+0000","last_became_active":"2024-09-22T08:10:43.189848+0000","last_became_peered":"2024-09-22T08:10:43.189848+0000","last_unstale":"2024-09-22T08:14:27.216341+0000","last_undegraded":"2024-09-22T08:14:27.216341+0000","last_fullsized":"2024-09-22T08:14:27.216341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:27.216242+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:27.216242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.216242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:35.518662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.009987+0000","last_change":"2024-09-22T08:14:31.009987+0000","last_active":"2024-09-22T08:14:31.009987+0000","last_peered":"2024-09-22T08:14:31.009987+0000","last_clean":"2024-09-22T08:14:31.009987+0000","last_became_active":"2024-09-22T08:10:45.183407+0000","last_became_peered":"2024-09-22T08:10:45.183407+0000","last_unstale":"2024-09-22T08:14:31.009987+0000","last_undegraded":"2024-09-22T08:14:31.009987+0000","last_fullsized":"2024-09-22T08:14:31.009987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:31.009901+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:31.009901+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.009901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:51.690389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.836700+0000","last_change":"2024-09-22T08:14:14.836700+0000","last_active":"2024-09-22T08:14:14.836700+0000","last_peered":"2024-09-22T08:14:14.836700+0000","last_clean":"2024-09-22T08:14:14.836700+0000","last_became_active":"2024-09-22T08:10:43.187119+0000","last_became_peered":"2024-09-22T08:10:43.187119+0000","last_unstale":"2024-09-22T08:14:14.836700+0000","last_undegraded":"2024-09-22T08:14:14.836700+0000","last_fullsized":"2024-09-22T08:14:14.836700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:14.836597+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:14.836597+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.836597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:22.845650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.769697+0000","last_change":"2024-09-22T08:14:32.769697+0000","last_active":"2024-09-22T08:14:32.769697+0000","last_peered":"2024-09-22T08:14:32.769697+0000","last_clean":"2024-09-22T08:14:32.769697+0000","last_became_active":"2024-09-22T08:11:23.218693+0000","last_became_peered":"2024-09-22T08:11:23.218693+0000","last_unstale":"2024-09-22T08:14:32.769697+0000","last_undegraded":"2024-09-22T08:14:32.769697+0000","last_fullsized":"2024-09-22T08:14:32.769697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:32.769617+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:32.769617+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.769617+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:14.057548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":630,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1415,"ondisk_log_size":1415,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673016,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673015,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":741411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673015,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1036288,"data_stored":742099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":152009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:14:45.322 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.322 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.322 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.323 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.323 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.323 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.323 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.323 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.323 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.324 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.324 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.324 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.324 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.324 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.324 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.324 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.324 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.324 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.325 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.325 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.325 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.325 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.325 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.325 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.325 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.325 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.326 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.326 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.326 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.326 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.326 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.326 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.326 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.326 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.327 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.327 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.327 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.327 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.327 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.327 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.327 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.327 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.328 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.328 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.328 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.328 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.328 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.328 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.328 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.328 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.329 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.329 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.329 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.329 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.329 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.329 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.329 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.330 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.330 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.330 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.330 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.330 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.330 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.330 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.330 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.331 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.331 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.331 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.331 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.331 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.331 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.331 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.331 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.331 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.332 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.332 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.332 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.332 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.332 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.332 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.332 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.332 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.333 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.333 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.333 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.333 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.333 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.333 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.333 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.333 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.333 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.334 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.334 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.334 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.334 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.334 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.334 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.334 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.334 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.334 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.335 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.335 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.335 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.335 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:10:46.154885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=46, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.335 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.335 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.335 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.335 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.336 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-22T08:10:44.147894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:14:45.336 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:15:05.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:15:05.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.451+0000 7f36555fb640 1 Processor -- start 2024-09-22T08:15:05.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.451+0000 7f36555fb640 1 -- start start 2024-09-22T08:15:05.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.451+0000 7f36555fb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3650071e30 0x7f3650132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:05.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.451+0000 7f36555fb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3650071770 con 0x7f365006e170 2024-09-22T08:15:05.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.452+0000 7f36555fb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3650099ee0 con 0x7f3650071e30 2024-09-22T08:15:05.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.452+0000 7f364effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f365006e170 0x7f365006e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50422/0 (socket says 172.21.15.53:50422) 2024-09-22T08:15:05.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.452+0000 7f364effd640 1 -- 172.21.15.53:0/2278191254 learned_addr learned my addr 172.21.15.53:0/2278191254 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:15:05.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.452+0000 7f364e7fc640 1 --2- 172.21.15.53:0/2278191254 >> v2:172.21.15.53:3300/0 conn(0x7f3650071e30 0x7f3650132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:05.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.452+0000 7f364dffb640 1 -- 172.21.15.53:0/2278191254 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155901298 0 0) 0x7f3650071770 con 0x7f365006e170 2024-09-22T08:15:05.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.452+0000 7f364dffb640 1 -- 172.21.15.53:0/2278191254 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3638003520 con 0x7f365006e170 2024-09-22T08:15:05.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.452+0000 7f364e7fc640 1 -- 172.21.15.53:0/2278191254 >> v1:172.21.15.53:6789/0 conn(0x7f365006e170 legacy=0x7f365006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:05.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.452+0000 7f364e7fc640 1 -- 172.21.15.53:0/2278191254 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3650072530 con 0x7f3650071e30 2024-09-22T08:15:05.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.453+0000 7f364e7fc640 1 --2- 172.21.15.53:0/2278191254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3650071e30 0x7f3650132790 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3644009dc0 tx=0x7f364402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af54df451ce0a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:05.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.453+0000 7f364dffb640 1 -- 172.21.15.53:0/2278191254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3644007670 con 0x7f3650071e30 2024-09-22T08:15:05.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.453+0000 7f364dffb640 1 -- 172.21.15.53:0/2278191254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644007810 con 0x7f3650071e30 2024-09-22T08:15:05.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.453+0000 7f364dffb640 1 -- 172.21.15.53:0/2278191254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3644007af0 con 0x7f3650071e30 2024-09-22T08:15:05.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.453+0000 7f36555fb640 1 -- 172.21.15.53:0/2278191254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3650071e30 msgr2=0x7f3650132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:05.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.453+0000 7f36555fb640 1 --2- 172.21.15.53:0/2278191254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3650071e30 0x7f3650132790 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3644009dc0 tx=0x7f364402a6a0 comp rx=0 tx=0).stop 2024-09-22T08:15:05.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.453+0000 7f36555fb640 1 -- 172.21.15.53:0/2278191254 shutdown_connections 2024-09-22T08:15:05.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.453+0000 7f36555fb640 1 --2- 172.21.15.53:0/2278191254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3650071e30 0x7f3650132790 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:05.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.453+0000 7f36555fb640 1 -- 172.21.15.53:0/2278191254 >> 172.21.15.53:0/2278191254 conn(0x7f365009ac80 msgr2=0x7f3650098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:15:05.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.454+0000 7f36555fb640 1 -- 172.21.15.53:0/2278191254 shutdown_connections 2024-09-22T08:15:05.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.454+0000 7f36555fb640 1 -- 172.21.15.53:0/2278191254 wait complete. 2024-09-22T08:15:05.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.455+0000 7f36555fb640 1 Processor -- start 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.455+0000 7f36555fb640 1 -- start start 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.455+0000 7f36555fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365006e170 0x7f365006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.455+0000 7f36555fb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f365006ee70 con 0x7f365006e170 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.455+0000 7f364effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365006e170 0x7f365006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.455+0000 7f364effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365006e170 0x7f365006f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41636/0 (socket says 172.21.15.53:41636) 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.455+0000 7f364effd640 1 -- 172.21.15.53:0/3929263507 learned_addr learned my addr 172.21.15.53:0/3929263507 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.455+0000 7f364effd640 1 -- 172.21.15.53:0/3929263507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365012a730 con 0x7f365006e170 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.456+0000 7f364effd640 1 --2- 172.21.15.53:0/3929263507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365006e170 0x7f365006f280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f364000c480 tx=0x7f364000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.456+0000 7f36377fe640 1 -- 172.21.15.53:0/3929263507 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3640017070 con 0x7f365006e170 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.456+0000 7f36377fe640 1 -- 172.21.15.53:0/3929263507 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3640005cd0 con 0x7f365006e170 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.456+0000 7f36377fe640 1 -- 172.21.15.53:0/3929263507 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3640007200 con 0x7f365006e170 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.456+0000 7f36555fb640 1 -- 172.21.15.53:0/3929263507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365008cb00 con 0x7f365006e170 2024-09-22T08:15:05.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.456+0000 7f36555fb640 1 -- 172.21.15.53:0/3929263507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365006f9a0 con 0x7f365006e170 2024-09-22T08:15:05.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.457+0000 7f36377fe640 1 -- 172.21.15.53:0/3929263507 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f364001a070 con 0x7f365006e170 2024-09-22T08:15:05.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.457+0000 7f36377fe640 1 --2- 172.21.15.53:0/3929263507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f363c03e710 0x7f363c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:05.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.457+0000 7f36555fb640 1 -- 172.21.15.53:0/3929263507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3650070bd0 con 0x7f365006e170 2024-09-22T08:15:05.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.457+0000 7f36377fe640 1 -- 172.21.15.53:0/3929263507 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3640052b00 con 0x7f365006e170 2024-09-22T08:15:05.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.457+0000 7f364e7fc640 1 --2- 172.21.15.53:0/3929263507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f363c03e710 0x7f363c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:05.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.458+0000 7f364e7fc640 1 --2- 172.21.15.53:0/3929263507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f363c03e710 0x7f363c040bd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3644034000 tx=0x7f364402f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:05.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.462+0000 7f36377fe640 1 -- 172.21.15.53:0/3929263507 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f364001bdc0 con 0x7f365006e170 2024-09-22T08:15:05.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.645+0000 7f36555fb640 1 -- 172.21.15.53:0/3929263507 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f365008c700 con 0x7f363c03e710 2024-09-22T08:15:05.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.656+0000 7f36377fe640 1 -- 172.21.15.53:0/3929263507 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666184 (secure 0 0 0) 0x7f3644007540 con 0x7f363c03e710 2024-09-22T08:15:05.663 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:15:05.669 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:15:05.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.661+0000 7f36555fb640 1 -- 172.21.15.53:0/3929263507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f363c03e710 msgr2=0x7f363c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:05.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.661+0000 7f36555fb640 1 --2- 172.21.15.53:0/3929263507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f363c03e710 0x7f363c040bd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3644034000 tx=0x7f364402f000 comp rx=0 tx=0).stop 2024-09-22T08:15:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.661+0000 7f36555fb640 1 -- 172.21.15.53:0/3929263507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365006e170 msgr2=0x7f365006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.661+0000 7f36555fb640 1 --2- 172.21.15.53:0/3929263507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365006e170 0x7f365006f280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f364000c480 tx=0x7f364000c940 comp rx=0 tx=0).stop 2024-09-22T08:15:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.661+0000 7f36555fb640 1 -- 172.21.15.53:0/3929263507 shutdown_connections 2024-09-22T08:15:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.661+0000 7f36555fb640 1 --2- 172.21.15.53:0/3929263507 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f363c03e710 0x7f363c040bd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.661+0000 7f36555fb640 1 --2- 172.21.15.53:0/3929263507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365006e170 0x7f365006f280 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.661+0000 7f36555fb640 1 -- 172.21.15.53:0/3929263507 >> 172.21.15.53:0/3929263507 conn(0x7f365009ac80 msgr2=0x7f365012e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:15:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.661+0000 7f36555fb640 1 -- 172.21.15.53:0/3929263507 shutdown_connections 2024-09-22T08:15:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:05.661+0000 7f36555fb640 1 -- 172.21.15.53:0/3929263507 wait complete. 2024-09-22T08:15:05.672 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-22T08:15:03.646469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5179,"num_read_kb":4721,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1899,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4737,"ondisk_log_size":4737,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1788188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":563,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004140"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.888353+0000","last_change":"2024-09-22T08:14:16.888299+0000","last_active":"2024-09-22T08:14:16.888353+0000","last_peered":"2024-09-22T08:14:16.888353+0000","last_clean":"2024-09-22T08:14:16.888353+0000","last_became_active":"2024-09-22T08:10:43.174489+0000","last_became_peered":"2024-09-22T08:10:43.174489+0000","last_unstale":"2024-09-22T08:14:16.888353+0000","last_undegraded":"2024-09-22T08:14:16.888353+0000","last_fullsized":"2024-09-22T08:14:16.888353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:16.888214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:16.888214+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.888214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:50.430915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.772962+0000","last_change":"2024-09-22T08:14:35.772962+0000","last_active":"2024-09-22T08:14:35.772962+0000","last_peered":"2024-09-22T08:14:35.772962+0000","last_clean":"2024-09-22T08:14:35.772962+0000","last_became_active":"2024-09-22T08:10:45.179969+0000","last_became_peered":"2024-09-22T08:10:45.179969+0000","last_unstale":"2024-09-22T08:14:35.772962+0000","last_undegraded":"2024-09-22T08:14:35.772962+0000","last_fullsized":"2024-09-22T08:14:35.772962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:35.772871+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:35.772871+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.772871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:40.663120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.854875+0000","last_change":"2024-09-22T08:14:17.854808+0000","last_active":"2024-09-22T08:14:17.854875+0000","last_peered":"2024-09-22T08:14:17.854875+0000","last_clean":"2024-09-22T08:14:17.854875+0000","last_became_active":"2024-09-22T08:10:43.187128+0000","last_became_peered":"2024-09-22T08:10:43.187128+0000","last_unstale":"2024-09-22T08:14:17.854875+0000","last_undegraded":"2024-09-22T08:14:17.854875+0000","last_fullsized":"2024-09-22T08:14:17.854875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.854715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.854715+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.854715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:57.247272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.994355+0000","last_change":"2024-09-22T08:14:45.994355+0000","last_active":"2024-09-22T08:14:45.994355+0000","last_peered":"2024-09-22T08:14:45.994355+0000","last_clean":"2024-09-22T08:14:45.994355+0000","last_became_active":"2024-09-22T08:10:45.169768+0000","last_became_peered":"2024-09-22T08:10:45.169768+0000","last_unstale":"2024-09-22T08:14:45.994355+0000","last_undegraded":"2024-09-22T08:14:45.994355+0000","last_fullsized":"2024-09-22T08:14:45.994355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:45.994266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:45.994266+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.994266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:43.216896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.201078+0000","last_change":"2024-09-22T08:14:31.201010+0000","last_active":"2024-09-22T08:14:31.201078+0000","last_peered":"2024-09-22T08:14:31.201078+0000","last_clean":"2024-09-22T08:14:31.201078+0000","last_became_active":"2024-09-22T08:10:43.200436+0000","last_became_peered":"2024-09-22T08:10:43.200436+0000","last_unstale":"2024-09-22T08:14:31.201078+0000","last_undegraded":"2024-09-22T08:14:31.201078+0000","last_fullsized":"2024-09-22T08:14:31.201078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.200921+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.200921+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.200921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:27.278821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.014314+0000","last_change":"2024-09-22T08:14:48.014314+0000","last_active":"2024-09-22T08:14:48.014314+0000","last_peered":"2024-09-22T08:14:48.014314+0000","last_clean":"2024-09-22T08:14:48.014314+0000","last_became_active":"2024-09-22T08:10:45.169110+0000","last_became_peered":"2024-09-22T08:10:45.169110+0000","last_unstale":"2024-09-22T08:14:48.014314+0000","last_undegraded":"2024-09-22T08:14:48.014314+0000","last_fullsized":"2024-09-22T08:14:48.014314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:48.014208+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:48.014208+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.014208+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:55.791447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.842269+0000","last_change":"2024-09-22T08:14:15.842211+0000","last_active":"2024-09-22T08:14:15.842269+0000","last_peered":"2024-09-22T08:14:15.842269+0000","last_clean":"2024-09-22T08:14:15.842269+0000","last_became_active":"2024-09-22T08:10:43.180088+0000","last_became_peered":"2024-09-22T08:10:43.180088+0000","last_unstale":"2024-09-22T08:14:15.842269+0000","last_undegraded":"2024-09-22T08:14:15.842269+0000","last_fullsized":"2024-09-22T08:14:15.842269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:15.842123+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:15.842123+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.842123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:45.525671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.022431+0000","last_change":"2024-09-22T08:14:32.022431+0000","last_active":"2024-09-22T08:14:32.022431+0000","last_peered":"2024-09-22T08:14:32.022431+0000","last_clean":"2024-09-22T08:14:32.022431+0000","last_became_active":"2024-09-22T08:11:23.220081+0000","last_became_peered":"2024-09-22T08:11:23.220081+0000","last_unstale":"2024-09-22T08:14:32.022431+0000","last_undegraded":"2024-09-22T08:14:32.022431+0000","last_fullsized":"2024-09-22T08:14:32.022431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:32.022345+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:32.022345+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.022345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:29.472018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.226178+0000","last_change":"2024-09-22T08:14:30.226178+0000","last_active":"2024-09-22T08:14:30.226178+0000","last_peered":"2024-09-22T08:14:30.226178+0000","last_clean":"2024-09-22T08:14:30.226178+0000","last_became_active":"2024-09-22T08:10:43.200013+0000","last_became_peered":"2024-09-22T08:10:43.200013+0000","last_unstale":"2024-09-22T08:14:30.226178+0000","last_undegraded":"2024-09-22T08:14:30.226178+0000","last_fullsized":"2024-09-22T08:14:30.226178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:30.226084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:30.226084+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.226084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:55.632963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.722868+0000","last_change":"2024-09-22T08:14:34.722804+0000","last_active":"2024-09-22T08:14:34.722868+0000","last_peered":"2024-09-22T08:14:34.722868+0000","last_clean":"2024-09-22T08:14:34.722868+0000","last_became_active":"2024-09-22T08:10:45.176491+0000","last_became_peered":"2024-09-22T08:10:45.176491+0000","last_unstale":"2024-09-22T08:14:34.722868+0000","last_undegraded":"2024-09-22T08:14:34.722868+0000","last_fullsized":"2024-09-22T08:14:34.722868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:34.722708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:34.722708+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.722708+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:38.943762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.876908+0000","last_change":"2024-09-22T08:14:17.876908+0000","last_active":"2024-09-22T08:14:17.876908+0000","last_peered":"2024-09-22T08:14:17.876908+0000","last_clean":"2024-09-22T08:14:17.876908+0000","last_became_active":"2024-09-22T08:10:43.172330+0000","last_became_peered":"2024-09-22T08:10:43.172330+0000","last_unstale":"2024-09-22T08:14:17.876908+0000","last_undegraded":"2024-09-22T08:14:17.876908+0000","last_fullsized":"2024-09-22T08:14:17.876908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.876812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.876812+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.876812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:40.745057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:50.044313+0000","last_change":"2024-09-22T08:14:50.044221+0000","last_active":"2024-09-22T08:14:50.044313+0000","last_peered":"2024-09-22T08:14:50.044313+0000","last_clean":"2024-09-22T08:14:50.044313+0000","last_became_active":"2024-09-22T08:10:45.175775+0000","last_became_peered":"2024-09-22T08:10:45.175775+0000","last_unstale":"2024-09-22T08:14:50.044313+0000","last_undegraded":"2024-09-22T08:14:50.044313+0000","last_fullsized":"2024-09-22T08:14:50.044313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:50.044107+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:50.044107+0000","last_clean_scrub_stamp":"2024-09-22T08:14:50.044107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:02.834856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.213597+0000","last_change":"2024-09-22T08:14:28.213597+0000","last_active":"2024-09-22T08:14:28.213597+0000","last_peered":"2024-09-22T08:14:28.213597+0000","last_clean":"2024-09-22T08:14:28.213597+0000","last_became_active":"2024-09-22T08:10:43.187858+0000","last_became_peered":"2024-09-22T08:10:43.187858+0000","last_unstale":"2024-09-22T08:14:28.213597+0000","last_undegraded":"2024-09-22T08:14:28.213597+0000","last_fullsized":"2024-09-22T08:14:28.213597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:28.213514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:28.213514+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.213514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:21.439787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.960016+0000","last_change":"2024-09-22T08:14:28.959963+0000","last_active":"2024-09-22T08:14:28.960016+0000","last_peered":"2024-09-22T08:14:28.960016+0000","last_clean":"2024-09-22T08:14:28.960016+0000","last_became_active":"2024-09-22T08:10:45.179870+0000","last_became_peered":"2024-09-22T08:10:45.179870+0000","last_unstale":"2024-09-22T08:14:28.960016+0000","last_undegraded":"2024-09-22T08:14:28.960016+0000","last_fullsized":"2024-09-22T08:14:28.960016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:28.959878+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:28.959878+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.959878+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:57:09.248946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.896554+0000","last_change":"2024-09-22T08:14:16.896554+0000","last_active":"2024-09-22T08:14:16.896554+0000","last_peered":"2024-09-22T08:14:16.896554+0000","last_clean":"2024-09-22T08:14:16.896554+0000","last_became_active":"2024-09-22T08:10:43.178146+0000","last_became_peered":"2024-09-22T08:10:43.178146+0000","last_unstale":"2024-09-22T08:14:16.896554+0000","last_undegraded":"2024-09-22T08:14:16.896554+0000","last_fullsized":"2024-09-22T08:14:16.896554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:16.896443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:16.896443+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.896443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:40.881321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.986998+0000","last_change":"2024-09-22T08:14:29.986942+0000","last_active":"2024-09-22T08:14:29.986998+0000","last_peered":"2024-09-22T08:14:29.986998+0000","last_clean":"2024-09-22T08:14:29.986998+0000","last_became_active":"2024-09-22T08:10:45.177101+0000","last_became_peered":"2024-09-22T08:10:45.177101+0000","last_unstale":"2024-09-22T08:14:29.986998+0000","last_undegraded":"2024-09-22T08:14:29.986998+0000","last_fullsized":"2024-09-22T08:14:29.986998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:29.986860+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:29.986860+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.986860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:26.079898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.978156+0000","last_change":"2024-09-22T08:14:46.978156+0000","last_active":"2024-09-22T08:14:46.978156+0000","last_peered":"2024-09-22T08:14:46.978156+0000","last_clean":"2024-09-22T08:14:46.978156+0000","last_became_active":"2024-09-22T08:10:45.169140+0000","last_became_peered":"2024-09-22T08:10:45.169140+0000","last_unstale":"2024-09-22T08:14:46.978156+0000","last_undegraded":"2024-09-22T08:14:46.978156+0000","last_fullsized":"2024-09-22T08:14:46.978156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:46.978074+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:46.978074+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.978074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:33.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.805924+0000","last_change":"2024-09-22T08:14:16.805924+0000","last_active":"2024-09-22T08:14:16.805924+0000","last_peered":"2024-09-22T08:14:16.805924+0000","last_clean":"2024-09-22T08:14:16.805924+0000","last_became_active":"2024-09-22T08:10:43.185301+0000","last_became_peered":"2024-09-22T08:10:43.185301+0000","last_unstale":"2024-09-22T08:14:16.805924+0000","last_undegraded":"2024-09-22T08:14:16.805924+0000","last_fullsized":"2024-09-22T08:14:16.805924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:16.805805+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:16.805805+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.805805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:11.575658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.829126+0000","last_change":"2024-09-22T08:14:29.829126+0000","last_active":"2024-09-22T08:14:29.829126+0000","last_peered":"2024-09-22T08:14:29.829126+0000","last_clean":"2024-09-22T08:14:29.829126+0000","last_became_active":"2024-09-22T08:10:45.172557+0000","last_became_peered":"2024-09-22T08:10:45.172557+0000","last_unstale":"2024-09-22T08:14:29.829126+0000","last_undegraded":"2024-09-22T08:14:29.829126+0000","last_fullsized":"2024-09-22T08:14:29.829126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:29.829030+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:29.829030+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.829030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:18.653579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.821331+0000","last_change":"2024-09-22T08:14:14.821331+0000","last_active":"2024-09-22T08:14:14.821331+0000","last_peered":"2024-09-22T08:14:14.821331+0000","last_clean":"2024-09-22T08:14:14.821331+0000","last_became_active":"2024-09-22T08:10:43.189273+0000","last_became_peered":"2024-09-22T08:10:43.189273+0000","last_unstale":"2024-09-22T08:14:14.821331+0000","last_undegraded":"2024-09-22T08:14:14.821331+0000","last_fullsized":"2024-09-22T08:14:14.821331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:14.821242+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:14.821242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.821242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:39.122357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.726995+0000","last_change":"2024-09-22T08:14:36.726995+0000","last_active":"2024-09-22T08:14:36.726995+0000","last_peered":"2024-09-22T08:14:36.726995+0000","last_clean":"2024-09-22T08:14:36.726995+0000","last_became_active":"2024-09-22T08:10:45.176885+0000","last_became_peered":"2024-09-22T08:10:45.176885+0000","last_unstale":"2024-09-22T08:14:36.726995+0000","last_undegraded":"2024-09-22T08:14:36.726995+0000","last_fullsized":"2024-09-22T08:14:36.726995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:36.726901+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:36.726901+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.726901+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:42.806466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.813396+0000","last_change":"2024-09-22T08:14:15.813396+0000","last_active":"2024-09-22T08:14:15.813396+0000","last_peered":"2024-09-22T08:14:15.813396+0000","last_clean":"2024-09-22T08:14:15.813396+0000","last_became_active":"2024-09-22T08:10:43.183887+0000","last_became_peered":"2024-09-22T08:10:43.183887+0000","last_unstale":"2024-09-22T08:14:15.813396+0000","last_undegraded":"2024-09-22T08:14:15.813396+0000","last_fullsized":"2024-09-22T08:14:15.813396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:15.813300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:15.813300+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.813300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:39.476435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.998449+0000","last_change":"2024-09-22T08:14:28.998449+0000","last_active":"2024-09-22T08:14:28.998449+0000","last_peered":"2024-09-22T08:14:28.998449+0000","last_clean":"2024-09-22T08:14:28.998449+0000","last_became_active":"2024-09-22T08:10:45.171492+0000","last_became_peered":"2024-09-22T08:10:45.171492+0000","last_unstale":"2024-09-22T08:14:28.998449+0000","last_undegraded":"2024-09-22T08:14:28.998449+0000","last_fullsized":"2024-09-22T08:14:28.998449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:28.998358+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:28.998358+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.998358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:54.381452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.797115+0000","last_change":"2024-09-22T08:14:12.797115+0000","last_active":"2024-09-22T08:14:12.797115+0000","last_peered":"2024-09-22T08:14:12.797115+0000","last_clean":"2024-09-22T08:14:12.797115+0000","last_became_active":"2024-09-22T08:10:43.179133+0000","last_became_peered":"2024-09-22T08:10:43.179133+0000","last_unstale":"2024-09-22T08:14:12.797115+0000","last_undegraded":"2024-09-22T08:14:12.797115+0000","last_fullsized":"2024-09-22T08:14:12.797115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-22T08:14:12.797035+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-22T08:14:12.797035+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.797035+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:51.512160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13,"num_write":24,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.927145+0000","last_change":"2024-09-22T08:14:27.927145+0000","last_active":"2024-09-22T08:14:27.927145+0000","last_peered":"2024-09-22T08:14:27.927145+0000","last_clean":"2024-09-22T08:14:27.927145+0000","last_became_active":"2024-09-22T08:10:45.173524+0000","last_became_peered":"2024-09-22T08:10:45.173524+0000","last_unstale":"2024-09-22T08:14:27.927145+0000","last_undegraded":"2024-09-22T08:14:27.927145+0000","last_fullsized":"2024-09-22T08:14:27.927145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:27.927054+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:27.927054+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.927054+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:21.773609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.847627+0000","last_change":"2024-09-22T08:14:15.847627+0000","last_active":"2024-09-22T08:14:15.847627+0000","last_peered":"2024-09-22T08:14:15.847627+0000","last_clean":"2024-09-22T08:14:15.847627+0000","last_became_active":"2024-09-22T08:10:43.186739+0000","last_became_peered":"2024-09-22T08:10:43.186739+0000","last_unstale":"2024-09-22T08:14:15.847627+0000","last_undegraded":"2024-09-22T08:14:15.847627+0000","last_fullsized":"2024-09-22T08:14:15.847627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:15.847522+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:15.847522+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.847522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:31.369309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.813445+0000","last_change":"2024-09-22T08:14:31.813445+0000","last_active":"2024-09-22T08:14:31.813445+0000","last_peered":"2024-09-22T08:14:31.813445+0000","last_clean":"2024-09-22T08:14:31.813445+0000","last_became_active":"2024-09-22T08:10:45.170247+0000","last_became_peered":"2024-09-22T08:10:45.170247+0000","last_unstale":"2024-09-22T08:14:31.813445+0000","last_undegraded":"2024-09-22T08:14:31.813445+0000","last_fullsized":"2024-09-22T08:14:31.813445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.813353+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.813353+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.813353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:57.196447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.204535+0000","last_change":"2024-09-22T08:14:29.204535+0000","last_active":"2024-09-22T08:14:29.204535+0000","last_peered":"2024-09-22T08:14:29.204535+0000","last_clean":"2024-09-22T08:14:29.204535+0000","last_became_active":"2024-09-22T08:10:43.190674+0000","last_became_peered":"2024-09-22T08:10:43.190674+0000","last_unstale":"2024-09-22T08:14:29.204535+0000","last_undegraded":"2024-09-22T08:14:29.204535+0000","last_fullsized":"2024-09-22T08:14:29.204535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:29.204435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:29.204435+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.204435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:48.655553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.206848+0000","last_change":"2024-09-22T08:10:53.203618+0000","last_active":"2024-09-22T08:13:53.206848+0000","last_peered":"2024-09-22T08:13:53.206848+0000","last_clean":"2024-09-22T08:13:53.206848+0000","last_became_active":"2024-09-22T08:10:53.203146+0000","last_became_peered":"2024-09-22T08:10:53.203146+0000","last_unstale":"2024-09-22T08:13:53.206848+0000","last_undegraded":"2024-09-22T08:13:53.206848+0000","last_fullsized":"2024-09-22T08:13:53.206848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:09.081236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.063669+0000","last_change":"2024-09-22T08:14:38.063669+0000","last_active":"2024-09-22T08:14:38.063669+0000","last_peered":"2024-09-22T08:14:38.063669+0000","last_clean":"2024-09-22T08:14:38.063669+0000","last_became_active":"2024-09-22T08:10:45.168308+0000","last_became_peered":"2024-09-22T08:10:45.168308+0000","last_unstale":"2024-09-22T08:14:38.063669+0000","last_undegraded":"2024-09-22T08:14:38.063669+0000","last_fullsized":"2024-09-22T08:14:38.063669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:38.063566+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:38.063566+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.063566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:58.873201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.270316+0000","last_change":"2024-09-22T08:14:17.270316+0000","last_active":"2024-09-22T08:14:17.270316+0000","last_peered":"2024-09-22T08:14:17.270316+0000","last_clean":"2024-09-22T08:14:17.270316+0000","last_became_active":"2024-09-22T08:10:43.200307+0000","last_became_peered":"2024-09-22T08:10:43.200307+0000","last_unstale":"2024-09-22T08:14:17.270316+0000","last_undegraded":"2024-09-22T08:14:17.270316+0000","last_fullsized":"2024-09-22T08:14:17.270316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.270212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.270212+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.270212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:29.835254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.034206+0000","last_change":"2024-09-22T08:14:57.034206+0000","last_active":"2024-09-22T08:14:57.034206+0000","last_peered":"2024-09-22T08:14:57.034206+0000","last_clean":"2024-09-22T08:14:57.034206+0000","last_became_active":"2024-09-22T08:10:47.176568+0000","last_became_peered":"2024-09-22T08:10:47.176568+0000","last_unstale":"2024-09-22T08:14:57.034206+0000","last_undegraded":"2024-09-22T08:14:57.034206+0000","last_fullsized":"2024-09-22T08:14:57.034206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:57.034089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:57.034089+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.034089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:08.818189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.858403+0000","last_change":"2024-09-22T08:10:49.189137+0000","last_active":"2024-09-22T08:13:59.858403+0000","last_peered":"2024-09-22T08:13:59.858403+0000","last_clean":"2024-09-22T08:13:59.858403+0000","last_became_active":"2024-09-22T08:10:49.188697+0000","last_became_peered":"2024-09-22T08:10:49.188697+0000","last_unstale":"2024-09-22T08:13:59.858403+0000","last_undegraded":"2024-09-22T08:13:59.858403+0000","last_fullsized":"2024-09-22T08:13:59.858403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:20.077797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.023727+0000","last_change":"2024-09-22T08:14:57.023727+0000","last_active":"2024-09-22T08:14:57.023727+0000","last_peered":"2024-09-22T08:14:57.023727+0000","last_clean":"2024-09-22T08:14:57.023727+0000","last_became_active":"2024-09-22T08:10:51.201855+0000","last_became_peered":"2024-09-22T08:10:51.201855+0000","last_unstale":"2024-09-22T08:14:57.023727+0000","last_undegraded":"2024-09-22T08:14:57.023727+0000","last_fullsized":"2024-09-22T08:14:57.023727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:57.023611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:57.023611+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.023611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:01.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'11","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:08.833839+0000","last_change":"2024-09-22T08:10:53.204685+0000","last_active":"2024-09-22T08:12:08.833839+0000","last_peered":"2024-09-22T08:12:08.833839+0000","last_clean":"2024-09-22T08:12:08.833839+0000","last_became_active":"2024-09-22T08:10:53.204407+0000","last_became_peered":"2024-09-22T08:10:53.204407+0000","last_unstale":"2024-09-22T08:12:08.833839+0000","last_undegraded":"2024-09-22T08:12:08.833839+0000","last_fullsized":"2024-09-22T08:12:08.833839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:07.954674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'16","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.067176+0000","last_change":"2024-09-22T08:14:39.067176+0000","last_active":"2024-09-22T08:14:39.067176+0000","last_peered":"2024-09-22T08:14:39.067176+0000","last_clean":"2024-09-22T08:14:39.067176+0000","last_became_active":"2024-09-22T08:10:45.170765+0000","last_became_peered":"2024-09-22T08:10:45.170765+0000","last_unstale":"2024-09-22T08:14:39.067176+0000","last_undegraded":"2024-09-22T08:14:39.067176+0000","last_fullsized":"2024-09-22T08:14:39.067176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-22T08:14:39.067085+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-22T08:14:39.067085+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.067085+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:09.486443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.743684+0000","last_change":"2024-09-22T08:14:08.743684+0000","last_active":"2024-09-22T08:14:08.743684+0000","last_peered":"2024-09-22T08:14:08.743684+0000","last_clean":"2024-09-22T08:14:08.743684+0000","last_became_active":"2024-09-22T08:10:43.180600+0000","last_became_peered":"2024-09-22T08:10:43.180600+0000","last_unstale":"2024-09-22T08:14:08.743684+0000","last_undegraded":"2024-09-22T08:14:08.743684+0000","last_fullsized":"2024-09-22T08:14:08.743684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.743587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.743587+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.743587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:44.284655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.913847+0000","last_change":"2024-09-22T08:14:36.913847+0000","last_active":"2024-09-22T08:14:36.913847+0000","last_peered":"2024-09-22T08:14:36.913847+0000","last_clean":"2024-09-22T08:14:36.913847+0000","last_became_active":"2024-09-22T08:10:47.167913+0000","last_became_peered":"2024-09-22T08:10:47.167913+0000","last_unstale":"2024-09-22T08:14:36.913847+0000","last_undegraded":"2024-09-22T08:14:36.913847+0000","last_fullsized":"2024-09-22T08:14:36.913847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:36.913756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:36.913756+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.913756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:18.021625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.961384+0000","last_change":"2024-09-22T08:14:49.961384+0000","last_active":"2024-09-22T08:14:49.961384+0000","last_peered":"2024-09-22T08:14:49.961384+0000","last_clean":"2024-09-22T08:14:49.961384+0000","last_became_active":"2024-09-22T08:10:49.182481+0000","last_became_peered":"2024-09-22T08:10:49.182481+0000","last_unstale":"2024-09-22T08:14:49.961384+0000","last_undegraded":"2024-09-22T08:14:49.961384+0000","last_fullsized":"2024-09-22T08:14:49.961384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-22T08:14:49.961281+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-22T08:14:49.961281+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.961281+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:00.050565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.023182+0000","last_change":"2024-09-22T08:14:55.023182+0000","last_active":"2024-09-22T08:14:55.023182+0000","last_peered":"2024-09-22T08:14:55.023182+0000","last_clean":"2024-09-22T08:14:55.023182+0000","last_became_active":"2024-09-22T08:10:51.199837+0000","last_became_peered":"2024-09-22T08:10:51.199837+0000","last_unstale":"2024-09-22T08:14:55.023182+0000","last_undegraded":"2024-09-22T08:14:55.023182+0000","last_fullsized":"2024-09-22T08:14:55.023182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.023064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.023064+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.023064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:11.887959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:00.056833+0000","last_change":"2024-09-22T08:15:00.056833+0000","last_active":"2024-09-22T08:15:00.056833+0000","last_peered":"2024-09-22T08:15:00.056833+0000","last_clean":"2024-09-22T08:15:00.056833+0000","last_became_active":"2024-09-22T08:10:53.199303+0000","last_became_peered":"2024-09-22T08:10:53.199303+0000","last_unstale":"2024-09-22T08:15:00.056833+0000","last_undegraded":"2024-09-22T08:15:00.056833+0000","last_fullsized":"2024-09-22T08:15:00.056833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:15:00.056727+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:15:00.056727+0000","last_clean_scrub_stamp":"2024-09-22T08:15:00.056727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:55.476963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.101518+0000","last_change":"2024-09-22T08:14:40.101518+0000","last_active":"2024-09-22T08:14:40.101518+0000","last_peered":"2024-09-22T08:14:40.101518+0000","last_clean":"2024-09-22T08:14:40.101518+0000","last_became_active":"2024-09-22T08:10:45.168554+0000","last_became_peered":"2024-09-22T08:10:45.168554+0000","last_unstale":"2024-09-22T08:14:40.101518+0000","last_undegraded":"2024-09-22T08:14:40.101518+0000","last_fullsized":"2024-09-22T08:14:40.101518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:40.101418+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:40.101418+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.101418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:35.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.265298+0000","last_change":"2024-09-22T08:14:16.265298+0000","last_active":"2024-09-22T08:14:16.265298+0000","last_peered":"2024-09-22T08:14:16.265298+0000","last_clean":"2024-09-22T08:14:16.265298+0000","last_became_active":"2024-09-22T08:10:43.189333+0000","last_became_peered":"2024-09-22T08:10:43.189333+0000","last_unstale":"2024-09-22T08:14:16.265298+0000","last_undegraded":"2024-09-22T08:14:16.265298+0000","last_fullsized":"2024-09-22T08:14:16.265298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:16.265216+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:16.265216+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.265216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:42.490080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.937678+0000","last_change":"2024-09-22T08:14:37.937678+0000","last_active":"2024-09-22T08:14:37.937678+0000","last_peered":"2024-09-22T08:14:37.937678+0000","last_clean":"2024-09-22T08:14:37.937678+0000","last_became_active":"2024-09-22T08:10:47.175959+0000","last_became_peered":"2024-09-22T08:10:47.175959+0000","last_unstale":"2024-09-22T08:14:37.937678+0000","last_undegraded":"2024-09-22T08:14:37.937678+0000","last_fullsized":"2024-09-22T08:14:37.937678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:37.937584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:37.937584+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.937584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:19.341899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.886512+0000","last_change":"2024-09-22T08:14:42.886512+0000","last_active":"2024-09-22T08:14:42.886512+0000","last_peered":"2024-09-22T08:14:42.886512+0000","last_clean":"2024-09-22T08:14:42.886512+0000","last_became_active":"2024-09-22T08:10:49.185269+0000","last_became_peered":"2024-09-22T08:10:49.185269+0000","last_unstale":"2024-09-22T08:14:42.886512+0000","last_undegraded":"2024-09-22T08:14:42.886512+0000","last_fullsized":"2024-09-22T08:14:42.886512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-22T08:14:42.886419+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-22T08:14:42.886419+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.886419+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:26.711598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.794235+0000","last_change":"2024-09-22T08:10:51.196489+0000","last_active":"2024-09-22T08:13:59.794235+0000","last_peered":"2024-09-22T08:13:59.794235+0000","last_clean":"2024-09-22T08:13:59.794235+0000","last_became_active":"2024-09-22T08:10:51.196199+0000","last_became_peered":"2024-09-22T08:10:51.196199+0000","last_unstale":"2024-09-22T08:13:59.794235+0000","last_undegraded":"2024-09-22T08:13:59.794235+0000","last_fullsized":"2024-09-22T08:13:59.794235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:26.614683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.997415+0000","last_change":"2024-09-22T08:14:56.997415+0000","last_active":"2024-09-22T08:14:56.997415+0000","last_peered":"2024-09-22T08:14:56.997415+0000","last_clean":"2024-09-22T08:14:56.997415+0000","last_became_active":"2024-09-22T08:10:53.194118+0000","last_became_peered":"2024-09-22T08:10:53.194118+0000","last_unstale":"2024-09-22T08:14:56.997415+0000","last_undegraded":"2024-09-22T08:14:56.997415+0000","last_fullsized":"2024-09-22T08:14:56.997415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:56.997317+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:56.997317+0000","last_clean_scrub_stamp":"2024-09-22T08:14:56.997317+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:24.120944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.867755+0000","last_change":"2024-09-22T08:14:20.867755+0000","last_active":"2024-09-22T08:14:20.867755+0000","last_peered":"2024-09-22T08:14:20.867755+0000","last_clean":"2024-09-22T08:14:20.867755+0000","last_became_active":"2024-09-22T08:10:45.183307+0000","last_became_peered":"2024-09-22T08:10:45.183307+0000","last_unstale":"2024-09-22T08:14:20.867755+0000","last_undegraded":"2024-09-22T08:14:20.867755+0000","last_fullsized":"2024-09-22T08:14:20.867755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:20.867654+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:20.867654+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.867654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:26.987640+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.753375+0000","last_change":"2024-09-22T08:14:05.753375+0000","last_active":"2024-09-22T08:14:05.753375+0000","last_peered":"2024-09-22T08:14:05.753375+0000","last_clean":"2024-09-22T08:14:05.753375+0000","last_became_active":"2024-09-22T08:10:43.187835+0000","last_became_peered":"2024-09-22T08:10:43.187835+0000","last_unstale":"2024-09-22T08:14:05.753375+0000","last_undegraded":"2024-09-22T08:14:05.753375+0000","last_fullsized":"2024-09-22T08:14:05.753375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.753280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.753280+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.753280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:33.618928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:59.113419+0000","last_change":"2024-09-22T08:14:59.113419+0000","last_active":"2024-09-22T08:14:59.113419+0000","last_peered":"2024-09-22T08:14:59.113419+0000","last_clean":"2024-09-22T08:14:59.113419+0000","last_became_active":"2024-09-22T08:10:47.175386+0000","last_became_peered":"2024-09-22T08:10:47.175386+0000","last_unstale":"2024-09-22T08:14:59.113419+0000","last_undegraded":"2024-09-22T08:14:59.113419+0000","last_fullsized":"2024-09-22T08:14:59.113419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:59.113282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:59.113282+0000","last_clean_scrub_stamp":"2024-09-22T08:14:59.113282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:28.790957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.905429+0000","last_change":"2024-09-22T08:14:43.905429+0000","last_active":"2024-09-22T08:14:43.905429+0000","last_peered":"2024-09-22T08:14:43.905429+0000","last_clean":"2024-09-22T08:14:43.905429+0000","last_became_active":"2024-09-22T08:10:49.184963+0000","last_became_peered":"2024-09-22T08:10:49.184963+0000","last_unstale":"2024-09-22T08:14:43.905429+0000","last_undegraded":"2024-09-22T08:14:43.905429+0000","last_fullsized":"2024-09-22T08:14:43.905429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-22T08:14:43.905303+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-22T08:14:43.905303+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.905303+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:27.963120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":454,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.166710+0000","last_change":"2024-09-22T08:14:51.166710+0000","last_active":"2024-09-22T08:14:51.166710+0000","last_peered":"2024-09-22T08:14:51.166710+0000","last_clean":"2024-09-22T08:14:51.166710+0000","last_became_active":"2024-09-22T08:10:51.193678+0000","last_became_peered":"2024-09-22T08:10:51.193678+0000","last_unstale":"2024-09-22T08:14:51.166710+0000","last_undegraded":"2024-09-22T08:14:51.166710+0000","last_fullsized":"2024-09-22T08:14:51.166710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:51.166621+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:51.166621+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.166621+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:08.031516+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.079772+0000","last_change":"2024-09-22T08:14:35.079772+0000","last_active":"2024-09-22T08:14:35.079772+0000","last_peered":"2024-09-22T08:14:35.079772+0000","last_clean":"2024-09-22T08:14:35.079772+0000","last_became_active":"2024-09-22T08:10:45.183598+0000","last_became_peered":"2024-09-22T08:10:45.183598+0000","last_unstale":"2024-09-22T08:14:35.079772+0000","last_undegraded":"2024-09-22T08:14:35.079772+0000","last_fullsized":"2024-09-22T08:14:35.079772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:35.079690+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:35.079690+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.079690+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:13.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.780412+0000","last_change":"2024-09-22T08:14:07.780412+0000","last_active":"2024-09-22T08:14:07.780412+0000","last_peered":"2024-09-22T08:14:07.780412+0000","last_clean":"2024-09-22T08:14:07.780412+0000","last_became_active":"2024-09-22T08:10:43.173543+0000","last_became_peered":"2024-09-22T08:10:43.173543+0000","last_unstale":"2024-09-22T08:14:07.780412+0000","last_undegraded":"2024-09-22T08:14:07.780412+0000","last_fullsized":"2024-09-22T08:14:07.780412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:07.780321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:07.780321+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.780321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:56.960543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.761582+0000","last_change":"2024-09-22T08:14:38.761582+0000","last_active":"2024-09-22T08:14:38.761582+0000","last_peered":"2024-09-22T08:14:38.761582+0000","last_clean":"2024-09-22T08:14:38.761582+0000","last_became_active":"2024-09-22T08:10:47.176657+0000","last_became_peered":"2024-09-22T08:10:47.176657+0000","last_unstale":"2024-09-22T08:14:38.761582+0000","last_undegraded":"2024-09-22T08:14:38.761582+0000","last_fullsized":"2024-09-22T08:14:38.761582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:38.761498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:38.761498+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.761498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:54.171137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.965752+0000","last_change":"2024-09-22T08:14:38.965752+0000","last_active":"2024-09-22T08:14:38.965752+0000","last_peered":"2024-09-22T08:14:38.965752+0000","last_clean":"2024-09-22T08:14:38.965752+0000","last_became_active":"2024-09-22T08:10:49.182985+0000","last_became_peered":"2024-09-22T08:10:49.182985+0000","last_unstale":"2024-09-22T08:14:38.965752+0000","last_undegraded":"2024-09-22T08:14:38.965752+0000","last_fullsized":"2024-09-22T08:14:38.965752+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-22T08:14:38.965657+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-22T08:14:38.965657+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.965657+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:27.222048+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:59.092679+0000","last_change":"2024-09-22T08:14:59.092679+0000","last_active":"2024-09-22T08:14:59.092679+0000","last_peered":"2024-09-22T08:14:59.092679+0000","last_clean":"2024-09-22T08:14:59.092679+0000","last_became_active":"2024-09-22T08:10:51.192623+0000","last_became_peered":"2024-09-22T08:10:51.192623+0000","last_unstale":"2024-09-22T08:14:59.092679+0000","last_undegraded":"2024-09-22T08:14:59.092679+0000","last_fullsized":"2024-09-22T08:14:59.092679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:59.092577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:59.092577+0000","last_clean_scrub_stamp":"2024-09-22T08:14:59.092577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:52.851825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.000633+0000","last_change":"2024-09-22T08:14:54.000565+0000","last_active":"2024-09-22T08:14:54.000633+0000","last_peered":"2024-09-22T08:14:54.000633+0000","last_clean":"2024-09-22T08:14:54.000633+0000","last_became_active":"2024-09-22T08:10:53.198219+0000","last_became_peered":"2024-09-22T08:10:53.198219+0000","last_unstale":"2024-09-22T08:14:54.000633+0000","last_undegraded":"2024-09-22T08:14:54.000633+0000","last_fullsized":"2024-09-22T08:14:54.000633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:54.000480+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:54.000480+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.000480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:12.877456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.853871+0000","last_change":"2024-09-22T08:14:20.853871+0000","last_active":"2024-09-22T08:14:20.853871+0000","last_peered":"2024-09-22T08:14:20.853871+0000","last_clean":"2024-09-22T08:14:20.853871+0000","last_became_active":"2024-09-22T08:10:45.171911+0000","last_became_peered":"2024-09-22T08:10:45.171911+0000","last_unstale":"2024-09-22T08:14:20.853871+0000","last_undegraded":"2024-09-22T08:14:20.853871+0000","last_fullsized":"2024-09-22T08:14:20.853871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:20.853779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:20.853779+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.853779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:02.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.794540+0000","last_change":"2024-09-22T08:14:06.794540+0000","last_active":"2024-09-22T08:14:06.794540+0000","last_peered":"2024-09-22T08:14:06.794540+0000","last_clean":"2024-09-22T08:14:06.794540+0000","last_became_active":"2024-09-22T08:10:43.189780+0000","last_became_peered":"2024-09-22T08:10:43.189780+0000","last_unstale":"2024-09-22T08:14:06.794540+0000","last_undegraded":"2024-09-22T08:14:06.794540+0000","last_fullsized":"2024-09-22T08:14:06.794540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:06.794440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:06.794440+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.794440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:21.869262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.016936+0000","last_change":"2024-09-22T08:14:33.016936+0000","last_active":"2024-09-22T08:14:33.016936+0000","last_peered":"2024-09-22T08:14:33.016936+0000","last_clean":"2024-09-22T08:14:33.016936+0000","last_became_active":"2024-09-22T08:10:47.177695+0000","last_became_peered":"2024-09-22T08:10:47.177695+0000","last_unstale":"2024-09-22T08:14:33.016936+0000","last_undegraded":"2024-09-22T08:14:33.016936+0000","last_fullsized":"2024-09-22T08:14:33.016936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:33.016843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:33.016843+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.016843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:37.907092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.917701+0000","last_change":"2024-09-22T08:10:49.185696+0000","last_active":"2024-09-22T08:13:59.917701+0000","last_peered":"2024-09-22T08:13:59.917701+0000","last_clean":"2024-09-22T08:13:59.917701+0000","last_became_active":"2024-09-22T08:10:49.185419+0000","last_became_peered":"2024-09-22T08:10:49.185419+0000","last_unstale":"2024-09-22T08:13:59.917701+0000","last_undegraded":"2024-09-22T08:13:59.917701+0000","last_fullsized":"2024-09-22T08:13:59.917701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:44:57.299371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:50.121942+0000","last_change":"2024-09-22T08:14:50.121942+0000","last_active":"2024-09-22T08:14:50.121942+0000","last_peered":"2024-09-22T08:14:50.121942+0000","last_clean":"2024-09-22T08:14:50.121942+0000","last_became_active":"2024-09-22T08:10:51.202564+0000","last_became_peered":"2024-09-22T08:10:51.202564+0000","last_unstale":"2024-09-22T08:14:50.121942+0000","last_undegraded":"2024-09-22T08:14:50.121942+0000","last_fullsized":"2024-09-22T08:14:50.121942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:50.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:50.121854+0000","last_clean_scrub_stamp":"2024-09-22T08:14:50.121854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:40.818719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:59.065099+0000","last_change":"2024-09-22T08:14:59.065044+0000","last_active":"2024-09-22T08:14:59.065099+0000","last_peered":"2024-09-22T08:14:59.065099+0000","last_clean":"2024-09-22T08:14:59.065099+0000","last_became_active":"2024-09-22T08:10:53.196392+0000","last_became_peered":"2024-09-22T08:10:53.196392+0000","last_unstale":"2024-09-22T08:14:59.065099+0000","last_undegraded":"2024-09-22T08:14:59.065099+0000","last_fullsized":"2024-09-22T08:14:59.065099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:59.064959+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:59.064959+0000","last_clean_scrub_stamp":"2024-09-22T08:14:59.064959+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:41.394956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.834249+0000","last_change":"2024-09-22T08:14:18.834249+0000","last_active":"2024-09-22T08:14:18.834249+0000","last_peered":"2024-09-22T08:14:18.834249+0000","last_clean":"2024-09-22T08:14:18.834249+0000","last_became_active":"2024-09-22T08:10:45.177530+0000","last_became_peered":"2024-09-22T08:10:45.177530+0000","last_unstale":"2024-09-22T08:14:18.834249+0000","last_undegraded":"2024-09-22T08:14:18.834249+0000","last_fullsized":"2024-09-22T08:14:18.834249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:18.834156+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.834156+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.834156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:22.288734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.250010+0000","last_change":"2024-09-22T08:14:15.250010+0000","last_active":"2024-09-22T08:14:15.250010+0000","last_peered":"2024-09-22T08:14:15.250010+0000","last_clean":"2024-09-22T08:14:15.250010+0000","last_became_active":"2024-09-22T08:10:43.201669+0000","last_became_peered":"2024-09-22T08:10:43.201669+0000","last_unstale":"2024-09-22T08:14:15.250010+0000","last_undegraded":"2024-09-22T08:14:15.250010+0000","last_fullsized":"2024-09-22T08:14:15.250010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:15.249925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:15.249925+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.249925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:10.670160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.960461+0000","last_change":"2024-09-22T08:14:35.960461+0000","last_active":"2024-09-22T08:14:35.960461+0000","last_peered":"2024-09-22T08:14:35.960461+0000","last_clean":"2024-09-22T08:14:35.960461+0000","last_became_active":"2024-09-22T08:10:47.177613+0000","last_became_peered":"2024-09-22T08:10:47.177613+0000","last_unstale":"2024-09-22T08:14:35.960461+0000","last_undegraded":"2024-09-22T08:14:35.960461+0000","last_fullsized":"2024-09-22T08:14:35.960461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:35.960358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:35.960358+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.960358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:11.564682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'47","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:02.127853+0000","last_change":"2024-09-22T08:15:02.127853+0000","last_active":"2024-09-22T08:15:02.127853+0000","last_peered":"2024-09-22T08:15:02.127853+0000","last_clean":"2024-09-22T08:15:02.127853+0000","last_became_active":"2024-09-22T08:10:49.186941+0000","last_became_peered":"2024-09-22T08:10:49.186941+0000","last_unstale":"2024-09-22T08:15:02.127853+0000","last_undegraded":"2024-09-22T08:15:02.127853+0000","last_fullsized":"2024-09-22T08:15:02.127853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-22T08:15:02.127734+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-22T08:15:02.127734+0000","last_clean_scrub_stamp":"2024-09-22T08:15:02.127734+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:09.059423+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.146275+0000","last_change":"2024-09-22T08:14:53.146275+0000","last_active":"2024-09-22T08:14:53.146275+0000","last_peered":"2024-09-22T08:14:53.146275+0000","last_clean":"2024-09-22T08:14:53.146275+0000","last_became_active":"2024-09-22T08:10:51.192483+0000","last_became_peered":"2024-09-22T08:10:51.192483+0000","last_unstale":"2024-09-22T08:14:53.146275+0000","last_undegraded":"2024-09-22T08:14:53.146275+0000","last_fullsized":"2024-09-22T08:14:53.146275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:53.146179+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:53.146179+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.146179+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:32:57.244656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.059149+0000","last_change":"2024-09-22T08:14:56.059149+0000","last_active":"2024-09-22T08:14:56.059149+0000","last_peered":"2024-09-22T08:14:56.059149+0000","last_clean":"2024-09-22T08:14:56.059149+0000","last_became_active":"2024-09-22T08:10:53.199273+0000","last_became_peered":"2024-09-22T08:10:53.199273+0000","last_unstale":"2024-09-22T08:14:56.059149+0000","last_undegraded":"2024-09-22T08:14:56.059149+0000","last_fullsized":"2024-09-22T08:14:56.059149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:56.059064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:56.059064+0000","last_clean_scrub_stamp":"2024-09-22T08:14:56.059064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:00.654786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.865126+0000","last_change":"2024-09-22T08:14:21.865126+0000","last_active":"2024-09-22T08:14:21.865126+0000","last_peered":"2024-09-22T08:14:21.865126+0000","last_clean":"2024-09-22T08:14:21.865126+0000","last_became_active":"2024-09-22T08:10:45.165352+0000","last_became_peered":"2024-09-22T08:10:45.165352+0000","last_unstale":"2024-09-22T08:14:21.865126+0000","last_undegraded":"2024-09-22T08:14:21.865126+0000","last_fullsized":"2024-09-22T08:14:21.865126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:21.865034+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:21.865034+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.865034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:43.503660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.210375+0000","last_change":"2024-09-22T08:14:14.210375+0000","last_active":"2024-09-22T08:14:14.210375+0000","last_peered":"2024-09-22T08:14:14.210375+0000","last_clean":"2024-09-22T08:14:14.210375+0000","last_became_active":"2024-09-22T08:10:43.198696+0000","last_became_peered":"2024-09-22T08:10:43.198696+0000","last_unstale":"2024-09-22T08:14:14.210375+0000","last_undegraded":"2024-09-22T08:14:14.210375+0000","last_fullsized":"2024-09-22T08:14:14.210375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:14.210290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:14.210290+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.210290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:59.541262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.990891+0000","last_change":"2024-09-22T08:14:34.990891+0000","last_active":"2024-09-22T08:14:34.990891+0000","last_peered":"2024-09-22T08:14:34.990891+0000","last_clean":"2024-09-22T08:14:34.990891+0000","last_became_active":"2024-09-22T08:10:47.176263+0000","last_became_peered":"2024-09-22T08:10:47.176263+0000","last_unstale":"2024-09-22T08:14:34.990891+0000","last_undegraded":"2024-09-22T08:14:34.990891+0000","last_fullsized":"2024-09-22T08:14:34.990891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:34.990797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:34.990797+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.990797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:43.649921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'60","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.926835+0000","last_change":"2024-09-22T08:10:49.189658+0000","last_active":"2024-09-22T08:13:59.926835+0000","last_peered":"2024-09-22T08:13:59.926835+0000","last_clean":"2024-09-22T08:13:59.926835+0000","last_became_active":"2024-09-22T08:10:49.188724+0000","last_became_peered":"2024-09-22T08:10:49.188724+0000","last_unstale":"2024-09-22T08:13:59.926835+0000","last_undegraded":"2024-09-22T08:13:59.926835+0000","last_fullsized":"2024-09-22T08:13:59.926835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:49.620069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.089869+0000","last_change":"2024-09-22T08:14:49.089869+0000","last_active":"2024-09-22T08:14:49.089869+0000","last_peered":"2024-09-22T08:14:49.089869+0000","last_clean":"2024-09-22T08:14:49.089869+0000","last_became_active":"2024-09-22T08:10:51.194937+0000","last_became_peered":"2024-09-22T08:10:51.194937+0000","last_unstale":"2024-09-22T08:14:49.089869+0000","last_undegraded":"2024-09-22T08:14:49.089869+0000","last_fullsized":"2024-09-22T08:14:49.089869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:49.089786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:49.089786+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.089786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:54.560881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:58.054267+0000","last_change":"2024-09-22T08:14:58.054267+0000","last_active":"2024-09-22T08:14:58.054267+0000","last_peered":"2024-09-22T08:14:58.054267+0000","last_clean":"2024-09-22T08:14:58.054267+0000","last_became_active":"2024-09-22T08:10:53.201289+0000","last_became_peered":"2024-09-22T08:10:53.201289+0000","last_unstale":"2024-09-22T08:14:58.054267+0000","last_undegraded":"2024-09-22T08:14:58.054267+0000","last_fullsized":"2024-09-22T08:14:58.054267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-22T08:14:58.054158+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-22T08:14:58.054158+0000","last_clean_scrub_stamp":"2024-09-22T08:14:58.054158+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:17.183240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.853760+0000","last_change":"2024-09-22T08:14:19.853760+0000","last_active":"2024-09-22T08:14:19.853760+0000","last_peered":"2024-09-22T08:14:19.853760+0000","last_clean":"2024-09-22T08:14:19.853760+0000","last_became_active":"2024-09-22T08:10:45.180762+0000","last_became_peered":"2024-09-22T08:10:45.180762+0000","last_unstale":"2024-09-22T08:14:19.853760+0000","last_undegraded":"2024-09-22T08:14:19.853760+0000","last_fullsized":"2024-09-22T08:14:19.853760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:19.853672+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:19.853672+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.853672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:03.241087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.884829+0000","last_change":"2024-09-22T08:14:08.884829+0000","last_active":"2024-09-22T08:14:08.884829+0000","last_peered":"2024-09-22T08:14:08.884829+0000","last_clean":"2024-09-22T08:14:08.884829+0000","last_became_active":"2024-09-22T08:10:43.177202+0000","last_became_peered":"2024-09-22T08:10:43.177202+0000","last_unstale":"2024-09-22T08:14:08.884829+0000","last_undegraded":"2024-09-22T08:14:08.884829+0000","last_fullsized":"2024-09-22T08:14:08.884829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:08.884729+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:08.884729+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.884729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:59.041707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.999246+0000","last_change":"2024-09-22T08:14:33.999246+0000","last_active":"2024-09-22T08:14:33.999246+0000","last_peered":"2024-09-22T08:14:33.999246+0000","last_clean":"2024-09-22T08:14:33.999246+0000","last_became_active":"2024-09-22T08:10:47.173636+0000","last_became_peered":"2024-09-22T08:10:47.173636+0000","last_unstale":"2024-09-22T08:14:33.999246+0000","last_undegraded":"2024-09-22T08:14:33.999246+0000","last_fullsized":"2024-09-22T08:14:33.999246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:33.999162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:33.999162+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.999162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:41.349638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.922308+0000","last_change":"2024-09-22T08:14:48.922308+0000","last_active":"2024-09-22T08:14:48.922308+0000","last_peered":"2024-09-22T08:14:48.922308+0000","last_clean":"2024-09-22T08:14:48.922308+0000","last_became_active":"2024-09-22T08:10:49.174933+0000","last_became_peered":"2024-09-22T08:10:49.174933+0000","last_unstale":"2024-09-22T08:14:48.922308+0000","last_undegraded":"2024-09-22T08:14:48.922308+0000","last_fullsized":"2024-09-22T08:14:48.922308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-22T08:14:48.922229+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-22T08:14:48.922229+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.922229+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:23.058385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212489+0000","last_change":"2024-09-22T08:10:51.195590+0000","last_active":"2024-09-22T08:11:23.212489+0000","last_peered":"2024-09-22T08:11:23.212489+0000","last_clean":"2024-09-22T08:11:23.212489+0000","last_became_active":"2024-09-22T08:10:51.195308+0000","last_became_peered":"2024-09-22T08:10:51.195308+0000","last_unstale":"2024-09-22T08:11:23.212489+0000","last_undegraded":"2024-09-22T08:11:23.212489+0000","last_fullsized":"2024-09-22T08:11:23.212489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:43:13.979616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.310164+0000","last_change":"2024-09-22T08:10:53.201429+0000","last_active":"2024-09-22T08:13:53.310164+0000","last_peered":"2024-09-22T08:13:53.310164+0000","last_clean":"2024-09-22T08:13:53.310164+0000","last_became_active":"2024-09-22T08:10:53.200458+0000","last_became_peered":"2024-09-22T08:10:53.200458+0000","last_unstale":"2024-09-22T08:13:53.310164+0000","last_undegraded":"2024-09-22T08:13:53.310164+0000","last_fullsized":"2024-09-22T08:13:53.310164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.126687+0000","last_change":"2024-09-22T08:14:36.126687+0000","last_active":"2024-09-22T08:14:36.126687+0000","last_peered":"2024-09-22T08:14:36.126687+0000","last_clean":"2024-09-22T08:14:36.126687+0000","last_became_active":"2024-09-22T08:10:45.183258+0000","last_became_peered":"2024-09-22T08:10:45.183258+0000","last_unstale":"2024-09-22T08:14:36.126687+0000","last_undegraded":"2024-09-22T08:14:36.126687+0000","last_fullsized":"2024-09-22T08:14:36.126687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:36.126603+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:36.126603+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.126603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:16.874250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.213102+0000","last_change":"2024-09-22T08:14:13.213044+0000","last_active":"2024-09-22T08:14:13.213102+0000","last_peered":"2024-09-22T08:14:13.213102+0000","last_clean":"2024-09-22T08:14:13.213102+0000","last_became_active":"2024-09-22T08:10:43.195959+0000","last_became_peered":"2024-09-22T08:10:43.195959+0000","last_unstale":"2024-09-22T08:14:13.213102+0000","last_undegraded":"2024-09-22T08:14:13.213102+0000","last_fullsized":"2024-09-22T08:14:13.213102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:13.212946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:13.212946+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.212946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:31.672558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.984929+0000","last_change":"2024-09-22T08:14:32.984929+0000","last_active":"2024-09-22T08:14:32.984929+0000","last_peered":"2024-09-22T08:14:32.984929+0000","last_clean":"2024-09-22T08:14:32.984929+0000","last_became_active":"2024-09-22T08:11:23.214959+0000","last_became_peered":"2024-09-22T08:11:23.214959+0000","last_unstale":"2024-09-22T08:14:32.984929+0000","last_undegraded":"2024-09-22T08:14:32.984929+0000","last_fullsized":"2024-09-22T08:14:32.984929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:32.984850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:32.984850+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.984850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:17.763676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.862572+0000","last_change":"2024-09-22T08:14:44.862572+0000","last_active":"2024-09-22T08:14:44.862572+0000","last_peered":"2024-09-22T08:14:44.862572+0000","last_clean":"2024-09-22T08:14:44.862572+0000","last_became_active":"2024-09-22T08:10:49.180820+0000","last_became_peered":"2024-09-22T08:10:49.180820+0000","last_unstale":"2024-09-22T08:14:44.862572+0000","last_undegraded":"2024-09-22T08:14:44.862572+0000","last_fullsized":"2024-09-22T08:14:44.862572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-22T08:14:44.862457+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-22T08:14:44.862457+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.862457+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:18.655635+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":444,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:47.876449+0000","last_change":"2024-09-22T08:14:47.876449+0000","last_active":"2024-09-22T08:14:47.876449+0000","last_peered":"2024-09-22T08:14:47.876449+0000","last_clean":"2024-09-22T08:14:47.876449+0000","last_became_active":"2024-09-22T08:10:51.197020+0000","last_became_peered":"2024-09-22T08:10:51.197020+0000","last_unstale":"2024-09-22T08:14:47.876449+0000","last_undegraded":"2024-09-22T08:14:47.876449+0000","last_fullsized":"2024-09-22T08:14:47.876449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:47.876366+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:47.876366+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.876366+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:15.274449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:01.585334+0000","last_change":"2024-09-22T08:10:53.192873+0000","last_active":"2024-09-22T08:13:01.585334+0000","last_peered":"2024-09-22T08:13:01.585334+0000","last_clean":"2024-09-22T08:13:01.585334+0000","last_became_active":"2024-09-22T08:10:53.192481+0000","last_became_peered":"2024-09-22T08:10:53.192481+0000","last_unstale":"2024-09-22T08:13:01.585334+0000","last_undegraded":"2024-09-22T08:13:01.585334+0000","last_fullsized":"2024-09-22T08:13:01.585334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:06.451090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.823199+0000","last_change":"2024-09-22T08:14:20.823199+0000","last_active":"2024-09-22T08:14:20.823199+0000","last_peered":"2024-09-22T08:14:20.823199+0000","last_clean":"2024-09-22T08:14:20.823199+0000","last_became_active":"2024-09-22T08:10:45.172740+0000","last_became_peered":"2024-09-22T08:10:45.172740+0000","last_unstale":"2024-09-22T08:14:20.823199+0000","last_undegraded":"2024-09-22T08:14:20.823199+0000","last_fullsized":"2024-09-22T08:14:20.823199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:20.823098+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:20.823098+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.823098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:35.363067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.246430+0000","last_change":"2024-09-22T08:14:12.246369+0000","last_active":"2024-09-22T08:14:12.246430+0000","last_peered":"2024-09-22T08:14:12.246430+0000","last_clean":"2024-09-22T08:14:12.246430+0000","last_became_active":"2024-09-22T08:10:43.195355+0000","last_became_peered":"2024-09-22T08:10:43.195355+0000","last_unstale":"2024-09-22T08:14:12.246430+0000","last_undegraded":"2024-09-22T08:14:12.246430+0000","last_fullsized":"2024-09-22T08:14:12.246430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:12.246281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:12.246281+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.246281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:08.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":440,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.770164+0000","last_change":"2024-09-22T08:14:39.770164+0000","last_active":"2024-09-22T08:14:39.770164+0000","last_peered":"2024-09-22T08:14:39.770164+0000","last_clean":"2024-09-22T08:14:39.770164+0000","last_became_active":"2024-09-22T08:11:23.221981+0000","last_became_peered":"2024-09-22T08:11:23.221981+0000","last_unstale":"2024-09-22T08:14:39.770164+0000","last_undegraded":"2024-09-22T08:14:39.770164+0000","last_fullsized":"2024-09-22T08:14:39.770164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:39.770060+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:39.770060+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.770060+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:20.877929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213610+0000","last_change":"2024-09-22T08:10:49.188917+0000","last_active":"2024-09-22T08:11:23.213610+0000","last_peered":"2024-09-22T08:11:23.213610+0000","last_clean":"2024-09-22T08:11:23.213610+0000","last_became_active":"2024-09-22T08:10:49.188444+0000","last_became_peered":"2024-09-22T08:10:49.188444+0000","last_unstale":"2024-09-22T08:11:23.213610+0000","last_undegraded":"2024-09-22T08:11:23.213610+0000","last_fullsized":"2024-09-22T08:11:23.213610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:27.352744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":481,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:52.962171+0000","last_change":"2024-09-22T08:14:52.962171+0000","last_active":"2024-09-22T08:14:52.962171+0000","last_peered":"2024-09-22T08:14:52.962171+0000","last_clean":"2024-09-22T08:14:52.962171+0000","last_became_active":"2024-09-22T08:10:51.197248+0000","last_became_peered":"2024-09-22T08:10:51.197248+0000","last_unstale":"2024-09-22T08:14:52.962171+0000","last_undegraded":"2024-09-22T08:14:52.962171+0000","last_fullsized":"2024-09-22T08:14:52.962171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:52.962065+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:52.962065+0000","last_clean_scrub_stamp":"2024-09-22T08:14:52.962065+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:58.433161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.044843+0000","last_change":"2024-09-22T08:14:53.044767+0000","last_active":"2024-09-22T08:14:53.044843+0000","last_peered":"2024-09-22T08:14:53.044843+0000","last_clean":"2024-09-22T08:14:53.044843+0000","last_became_active":"2024-09-22T08:10:53.195539+0000","last_became_peered":"2024-09-22T08:10:53.195539+0000","last_unstale":"2024-09-22T08:14:53.044843+0000","last_undegraded":"2024-09-22T08:14:53.044843+0000","last_fullsized":"2024-09-22T08:14:53.044843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:53.044634+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:53.044634+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.044634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:54.663936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.869186+0000","last_change":"2024-09-22T08:14:21.869186+0000","last_active":"2024-09-22T08:14:21.869186+0000","last_peered":"2024-09-22T08:14:21.869186+0000","last_clean":"2024-09-22T08:14:21.869186+0000","last_became_active":"2024-09-22T08:11:23.220943+0000","last_became_peered":"2024-09-22T08:11:23.220943+0000","last_unstale":"2024-09-22T08:14:21.869186+0000","last_undegraded":"2024-09-22T08:14:21.869186+0000","last_fullsized":"2024-09-22T08:14:21.869186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:21.869104+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:21.869104+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.869104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:05.409690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.271932+0000","last_change":"2024-09-22T08:14:11.271839+0000","last_active":"2024-09-22T08:14:11.271932+0000","last_peered":"2024-09-22T08:14:11.271932+0000","last_clean":"2024-09-22T08:14:11.271932+0000","last_became_active":"2024-09-22T08:10:43.196211+0000","last_became_peered":"2024-09-22T08:10:43.196211+0000","last_unstale":"2024-09-22T08:14:11.271932+0000","last_undegraded":"2024-09-22T08:14:11.271932+0000","last_fullsized":"2024-09-22T08:14:11.271932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:11.271716+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:11.271716+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.271716+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:52.551470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.066212+0000","last_change":"2024-09-22T08:14:54.066212+0000","last_active":"2024-09-22T08:14:54.066212+0000","last_peered":"2024-09-22T08:14:54.066212+0000","last_clean":"2024-09-22T08:14:54.066212+0000","last_became_active":"2024-09-22T08:10:47.176634+0000","last_became_peered":"2024-09-22T08:10:47.176634+0000","last_unstale":"2024-09-22T08:14:54.066212+0000","last_undegraded":"2024-09-22T08:14:54.066212+0000","last_fullsized":"2024-09-22T08:14:54.066212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:54.066126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:54.066126+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.066126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:30.827664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:47.903630+0000","last_change":"2024-09-22T08:14:47.903630+0000","last_active":"2024-09-22T08:14:47.903630+0000","last_peered":"2024-09-22T08:14:47.903630+0000","last_clean":"2024-09-22T08:14:47.903630+0000","last_became_active":"2024-09-22T08:10:49.178942+0000","last_became_peered":"2024-09-22T08:10:49.178942+0000","last_unstale":"2024-09-22T08:14:47.903630+0000","last_undegraded":"2024-09-22T08:14:47.903630+0000","last_fullsized":"2024-09-22T08:14:47.903630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-22T08:14:47.903541+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-22T08:14:47.903541+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.903541+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:01.767431+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.886816+0000","last_change":"2024-09-22T08:14:46.886816+0000","last_active":"2024-09-22T08:14:46.886816+0000","last_peered":"2024-09-22T08:14:46.886816+0000","last_clean":"2024-09-22T08:14:46.886816+0000","last_became_active":"2024-09-22T08:10:51.192482+0000","last_became_peered":"2024-09-22T08:10:51.192482+0000","last_unstale":"2024-09-22T08:14:46.886816+0000","last_undegraded":"2024-09-22T08:14:46.886816+0000","last_fullsized":"2024-09-22T08:14:46.886816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:46.886720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:46.886720+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.886720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:57.047573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:58.018821+0000","last_change":"2024-09-22T08:14:58.018748+0000","last_active":"2024-09-22T08:14:58.018821+0000","last_peered":"2024-09-22T08:14:58.018821+0000","last_clean":"2024-09-22T08:14:58.018821+0000","last_became_active":"2024-09-22T08:10:53.193315+0000","last_became_peered":"2024-09-22T08:10:53.193315+0000","last_unstale":"2024-09-22T08:14:58.018821+0000","last_undegraded":"2024-09-22T08:14:58.018821+0000","last_fullsized":"2024-09-22T08:14:58.018821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-22T08:14:58.018659+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-22T08:14:58.018659+0000","last_clean_scrub_stamp":"2024-09-22T08:14:58.018659+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:43.561882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.149945+0000","last_change":"2024-09-22T08:14:33.149878+0000","last_active":"2024-09-22T08:14:33.149945+0000","last_peered":"2024-09-22T08:14:33.149945+0000","last_clean":"2024-09-22T08:14:33.149945+0000","last_became_active":"2024-09-22T08:10:45.176033+0000","last_became_peered":"2024-09-22T08:10:45.176033+0000","last_unstale":"2024-09-22T08:14:33.149945+0000","last_undegraded":"2024-09-22T08:14:33.149945+0000","last_fullsized":"2024-09-22T08:14:33.149945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:33.149785+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:33.149785+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.149785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:44.391078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.711837+0000","last_change":"2024-09-22T08:14:03.711736+0000","last_active":"2024-09-22T08:14:03.711837+0000","last_peered":"2024-09-22T08:14:03.711837+0000","last_clean":"2024-09-22T08:14:03.711837+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:14:03.711837+0000","last_undegraded":"2024-09-22T08:14:03.711837+0000","last_fullsized":"2024-09-22T08:14:03.711837+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-22T08:14:03.711630+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-22T08:14:03.711630+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.711630+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:19.958877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.254456+0000","last_change":"2024-09-22T08:14:06.254389+0000","last_active":"2024-09-22T08:14:06.254456+0000","last_peered":"2024-09-22T08:14:06.254456+0000","last_clean":"2024-09-22T08:14:06.254456+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:14:06.254456+0000","last_undegraded":"2024-09-22T08:14:06.254456+0000","last_fullsized":"2024-09-22T08:14:06.254456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:06.254288+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:06.254288+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.254288+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:56.951153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.286225+0000","last_change":"2024-09-22T08:14:09.286135+0000","last_active":"2024-09-22T08:14:09.286225+0000","last_peered":"2024-09-22T08:14:09.286225+0000","last_clean":"2024-09-22T08:14:09.286225+0000","last_became_active":"2024-09-22T08:10:43.200918+0000","last_became_peered":"2024-09-22T08:10:43.200918+0000","last_unstale":"2024-09-22T08:14:09.286225+0000","last_undegraded":"2024-09-22T08:14:09.286225+0000","last_fullsized":"2024-09-22T08:14:09.286225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:09.286038+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:09.286038+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.286038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:54.829260+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.769140+0000","last_change":"2024-09-22T08:14:37.769086+0000","last_active":"2024-09-22T08:14:37.769140+0000","last_peered":"2024-09-22T08:14:37.769140+0000","last_clean":"2024-09-22T08:14:37.769140+0000","last_became_active":"2024-09-22T08:10:47.175775+0000","last_became_peered":"2024-09-22T08:10:47.175775+0000","last_unstale":"2024-09-22T08:14:37.769140+0000","last_undegraded":"2024-09-22T08:14:37.769140+0000","last_fullsized":"2024-09-22T08:14:37.769140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:37.769007+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:37.769007+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.769007+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:46.451261+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:01.141769+0000","last_change":"2024-09-22T08:15:01.141769+0000","last_active":"2024-09-22T08:15:01.141769+0000","last_peered":"2024-09-22T08:15:01.141769+0000","last_clean":"2024-09-22T08:15:01.141769+0000","last_became_active":"2024-09-22T08:10:49.185661+0000","last_became_peered":"2024-09-22T08:10:49.185661+0000","last_unstale":"2024-09-22T08:15:01.141769+0000","last_undegraded":"2024-09-22T08:15:01.141769+0000","last_fullsized":"2024-09-22T08:15:01.141769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-22T08:15:01.141660+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-22T08:15:01.141660+0000","last_clean_scrub_stamp":"2024-09-22T08:15:01.141660+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:30.650587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:47.089175+0000","last_change":"2024-09-22T08:14:47.089175+0000","last_active":"2024-09-22T08:14:47.089175+0000","last_peered":"2024-09-22T08:14:47.089175+0000","last_clean":"2024-09-22T08:14:47.089175+0000","last_became_active":"2024-09-22T08:10:51.202473+0000","last_became_peered":"2024-09-22T08:10:51.202473+0000","last_unstale":"2024-09-22T08:14:47.089175+0000","last_undegraded":"2024-09-22T08:14:47.089175+0000","last_fullsized":"2024-09-22T08:14:47.089175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:47.089085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:47.089085+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.089085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:26.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.973341+0000","last_change":"2024-09-22T08:14:54.973341+0000","last_active":"2024-09-22T08:14:54.973341+0000","last_peered":"2024-09-22T08:14:54.973341+0000","last_clean":"2024-09-22T08:14:54.973341+0000","last_became_active":"2024-09-22T08:10:53.191752+0000","last_became_peered":"2024-09-22T08:10:53.191752+0000","last_unstale":"2024-09-22T08:14:54.973341+0000","last_undegraded":"2024-09-22T08:14:54.973341+0000","last_fullsized":"2024-09-22T08:14:54.973341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-09-22T08:14:54.973252+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-09-22T08:14:54.973252+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.973252+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:54.213924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.106915+0000","last_change":"2024-09-22T08:14:34.106915+0000","last_active":"2024-09-22T08:14:34.106915+0000","last_peered":"2024-09-22T08:14:34.106915+0000","last_clean":"2024-09-22T08:14:34.106915+0000","last_became_active":"2024-09-22T08:10:45.167260+0000","last_became_peered":"2024-09-22T08:10:45.167260+0000","last_unstale":"2024-09-22T08:14:34.106915+0000","last_undegraded":"2024-09-22T08:14:34.106915+0000","last_fullsized":"2024-09-22T08:14:34.106915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:34.106788+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:34.106788+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.106788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:08.423619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.233041+0000","last_change":"2024-09-22T08:14:05.232987+0000","last_active":"2024-09-22T08:14:05.233041+0000","last_peered":"2024-09-22T08:14:05.233041+0000","last_clean":"2024-09-22T08:14:05.233041+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:14:05.233041+0000","last_undegraded":"2024-09-22T08:14:05.233041+0000","last_fullsized":"2024-09-22T08:14:05.233041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.232899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.232899+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.232899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:33.852323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.919211+0000","last_change":"2024-09-22T08:14:07.919117+0000","last_active":"2024-09-22T08:14:07.919211+0000","last_peered":"2024-09-22T08:14:07.919211+0000","last_clean":"2024-09-22T08:14:07.919211+0000","last_became_active":"2024-09-22T08:10:43.177928+0000","last_became_peered":"2024-09-22T08:10:43.177928+0000","last_unstale":"2024-09-22T08:14:07.919211+0000","last_undegraded":"2024-09-22T08:14:07.919211+0000","last_fullsized":"2024-09-22T08:14:07.919211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:07.918996+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:07.918996+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.918996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:08.892898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.019667+0000","last_change":"2024-09-22T08:14:53.019667+0000","last_active":"2024-09-22T08:14:53.019667+0000","last_peered":"2024-09-22T08:14:53.019667+0000","last_clean":"2024-09-22T08:14:53.019667+0000","last_became_active":"2024-09-22T08:10:47.176402+0000","last_became_peered":"2024-09-22T08:10:47.176402+0000","last_unstale":"2024-09-22T08:14:53.019667+0000","last_undegraded":"2024-09-22T08:14:53.019667+0000","last_fullsized":"2024-09-22T08:14:53.019667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.019534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.019534+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.019534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:05.290331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'294","reported_seq":520,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.857343+0000","last_change":"2024-09-22T08:14:46.857281+0000","last_active":"2024-09-22T08:14:46.857343+0000","last_peered":"2024-09-22T08:14:46.857343+0000","last_clean":"2024-09-22T08:14:46.857343+0000","last_became_active":"2024-09-22T08:10:49.186277+0000","last_became_peered":"2024-09-22T08:10:49.186277+0000","last_unstale":"2024-09-22T08:14:46.857343+0000","last_undegraded":"2024-09-22T08:14:46.857343+0000","last_fullsized":"2024-09-22T08:14:46.857343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'294","last_scrub_stamp":"2024-09-22T08:14:46.857180+0000","last_deep_scrub":"34'294","last_deep_scrub_stamp":"2024-09-22T08:14:46.857180+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.857180+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:00.503752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:57.585748+0000","last_change":"2024-09-22T08:10:51.198493+0000","last_active":"2024-09-22T08:12:57.585748+0000","last_peered":"2024-09-22T08:12:57.585748+0000","last_clean":"2024-09-22T08:12:57.585748+0000","last_became_active":"2024-09-22T08:10:51.196837+0000","last_became_peered":"2024-09-22T08:10:51.196837+0000","last_unstale":"2024-09-22T08:12:57.585748+0000","last_undegraded":"2024-09-22T08:12:57.585748+0000","last_fullsized":"2024-09-22T08:12:57.585748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:01.068213+0000","last_change":"2024-09-22T08:15:01.068213+0000","last_active":"2024-09-22T08:15:01.068213+0000","last_peered":"2024-09-22T08:15:01.068213+0000","last_clean":"2024-09-22T08:15:01.068213+0000","last_became_active":"2024-09-22T08:10:53.199214+0000","last_became_peered":"2024-09-22T08:10:53.199214+0000","last_unstale":"2024-09-22T08:15:01.068213+0000","last_undegraded":"2024-09-22T08:15:01.068213+0000","last_fullsized":"2024-09-22T08:15:01.068213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:15:01.068128+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:15:01.068128+0000","last_clean_scrub_stamp":"2024-09-22T08:15:01.068128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:02:12.262963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'11","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.886625+0000","last_change":"2024-09-22T08:14:19.886625+0000","last_active":"2024-09-22T08:14:19.886625+0000","last_peered":"2024-09-22T08:14:19.886625+0000","last_clean":"2024-09-22T08:14:19.886625+0000","last_became_active":"2024-09-22T08:10:45.175923+0000","last_became_peered":"2024-09-22T08:10:45.175923+0000","last_unstale":"2024-09-22T08:14:19.886625+0000","last_undegraded":"2024-09-22T08:14:19.886625+0000","last_fullsized":"2024-09-22T08:14:19.886625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-22T08:14:19.886532+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-22T08:14:19.886532+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.886532+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:15.270799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.830645+0000","last_change":"2024-09-22T08:14:04.830583+0000","last_active":"2024-09-22T08:14:04.830645+0000","last_peered":"2024-09-22T08:14:04.830645+0000","last_clean":"2024-09-22T08:14:04.830645+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:14:04.830645+0000","last_undegraded":"2024-09-22T08:14:04.830645+0000","last_fullsized":"2024-09-22T08:14:04.830645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:04.830494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:04.830494+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.830494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:38.025714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.991784+0000","last_change":"2024-09-22T08:14:04.991725+0000","last_active":"2024-09-22T08:14:04.991784+0000","last_peered":"2024-09-22T08:14:04.991784+0000","last_clean":"2024-09-22T08:14:04.991784+0000","last_became_active":"2024-09-22T08:10:43.186500+0000","last_became_peered":"2024-09-22T08:10:43.186500+0000","last_unstale":"2024-09-22T08:14:04.991784+0000","last_undegraded":"2024-09-22T08:14:04.991784+0000","last_fullsized":"2024-09-22T08:14:04.991784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:04.991648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:04.991648+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.991648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:45:14.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.012137+0000","last_change":"2024-09-22T08:14:31.012137+0000","last_active":"2024-09-22T08:14:31.012137+0000","last_peered":"2024-09-22T08:14:31.012137+0000","last_clean":"2024-09-22T08:14:31.012137+0000","last_became_active":"2024-09-22T08:10:47.172041+0000","last_became_peered":"2024-09-22T08:10:47.172041+0000","last_unstale":"2024-09-22T08:14:31.012137+0000","last_undegraded":"2024-09-22T08:14:31.012137+0000","last_fullsized":"2024-09-22T08:14:31.012137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.012055+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.012055+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.012055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:05.593483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'26","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.939185+0000","last_change":"2024-09-22T08:14:39.939132+0000","last_active":"2024-09-22T08:14:39.939185+0000","last_peered":"2024-09-22T08:14:39.939185+0000","last_clean":"2024-09-22T08:14:39.939185+0000","last_became_active":"2024-09-22T08:10:49.180563+0000","last_became_peered":"2024-09-22T08:10:49.180563+0000","last_unstale":"2024-09-22T08:14:39.939185+0000","last_undegraded":"2024-09-22T08:14:39.939185+0000","last_fullsized":"2024-09-22T08:14:39.939185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-22T08:14:39.939028+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-22T08:14:39.939028+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.939028+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:27.487187+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.104229+0000","last_change":"2024-09-22T08:14:48.104144+0000","last_active":"2024-09-22T08:14:48.104229+0000","last_peered":"2024-09-22T08:14:48.104229+0000","last_clean":"2024-09-22T08:14:48.104229+0000","last_became_active":"2024-09-22T08:10:51.202422+0000","last_became_peered":"2024-09-22T08:10:51.202422+0000","last_unstale":"2024-09-22T08:14:48.104229+0000","last_undegraded":"2024-09-22T08:14:48.104229+0000","last_fullsized":"2024-09-22T08:14:48.104229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:48.104065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:48.104065+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.104065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:38.165541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209116+0000","last_change":"2024-09-22T08:10:53.200159+0000","last_active":"2024-09-22T08:11:23.209116+0000","last_peered":"2024-09-22T08:11:23.209116+0000","last_clean":"2024-09-22T08:11:23.209116+0000","last_became_active":"2024-09-22T08:10:53.199894+0000","last_became_peered":"2024-09-22T08:10:53.199894+0000","last_unstale":"2024-09-22T08:11:23.209116+0000","last_undegraded":"2024-09-22T08:11:23.209116+0000","last_fullsized":"2024-09-22T08:11:23.209116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:07.697983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.862687+0000","last_change":"2024-09-22T08:14:18.862623+0000","last_active":"2024-09-22T08:14:18.862687+0000","last_peered":"2024-09-22T08:14:18.862687+0000","last_clean":"2024-09-22T08:14:18.862687+0000","last_became_active":"2024-09-22T08:10:45.166816+0000","last_became_peered":"2024-09-22T08:10:45.166816+0000","last_unstale":"2024-09-22T08:14:18.862687+0000","last_undegraded":"2024-09-22T08:14:18.862687+0000","last_fullsized":"2024-09-22T08:14:18.862687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:18.862531+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:18.862531+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.862531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:02.403117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.269417+0000","last_change":"2024-09-22T08:14:04.269311+0000","last_active":"2024-09-22T08:14:04.269417+0000","last_peered":"2024-09-22T08:14:04.269417+0000","last_clean":"2024-09-22T08:14:04.269417+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:14:04.269417+0000","last_undegraded":"2024-09-22T08:14:04.269417+0000","last_fullsized":"2024-09-22T08:14:04.269417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:14:04.269206+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:14:04.269206+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.269206+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:50.609384+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.799010+0000","last_change":"2024-09-22T08:14:03.798946+0000","last_active":"2024-09-22T08:14:03.799010+0000","last_peered":"2024-09-22T08:14:03.799010+0000","last_clean":"2024-09-22T08:14:03.799010+0000","last_became_active":"2024-09-22T08:10:43.187103+0000","last_became_peered":"2024-09-22T08:10:43.187103+0000","last_unstale":"2024-09-22T08:14:03.799010+0000","last_undegraded":"2024-09-22T08:14:03.799010+0000","last_fullsized":"2024-09-22T08:14:03.799010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:03.798857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:03.798857+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.798857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:24.946857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.030556+0000","last_change":"2024-09-22T08:14:32.030496+0000","last_active":"2024-09-22T08:14:32.030556+0000","last_peered":"2024-09-22T08:14:32.030556+0000","last_clean":"2024-09-22T08:14:32.030556+0000","last_became_active":"2024-09-22T08:10:47.168480+0000","last_became_peered":"2024-09-22T08:10:47.168480+0000","last_unstale":"2024-09-22T08:14:32.030556+0000","last_undegraded":"2024-09-22T08:14:32.030556+0000","last_fullsized":"2024-09-22T08:14:32.030556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:32.030385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:32.030385+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.030385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:36.251439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:00.139646+0000","last_change":"2024-09-22T08:15:00.139646+0000","last_active":"2024-09-22T08:15:00.139646+0000","last_peered":"2024-09-22T08:15:00.139646+0000","last_clean":"2024-09-22T08:15:00.139646+0000","last_became_active":"2024-09-22T08:10:49.184961+0000","last_became_peered":"2024-09-22T08:10:49.184961+0000","last_unstale":"2024-09-22T08:15:00.139646+0000","last_undegraded":"2024-09-22T08:15:00.139646+0000","last_fullsized":"2024-09-22T08:15:00.139646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-22T08:15:00.139531+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-22T08:15:00.139531+0000","last_clean_scrub_stamp":"2024-09-22T08:15:00.139531+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:34.103957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213144+0000","last_change":"2024-09-22T08:10:51.195952+0000","last_active":"2024-09-22T08:11:23.213144+0000","last_peered":"2024-09-22T08:11:23.213144+0000","last_clean":"2024-09-22T08:11:23.213144+0000","last_became_active":"2024-09-22T08:10:51.195643+0000","last_became_peered":"2024-09-22T08:10:51.195643+0000","last_unstale":"2024-09-22T08:11:23.213144+0000","last_undegraded":"2024-09-22T08:11:23.213144+0000","last_fullsized":"2024-09-22T08:11:23.213144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:58:18.035075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:00.026186+0000","last_change":"2024-09-22T08:15:00.026186+0000","last_active":"2024-09-22T08:15:00.026186+0000","last_peered":"2024-09-22T08:15:00.026186+0000","last_clean":"2024-09-22T08:15:00.026186+0000","last_became_active":"2024-09-22T08:10:53.203330+0000","last_became_peered":"2024-09-22T08:10:53.203330+0000","last_unstale":"2024-09-22T08:15:00.026186+0000","last_undegraded":"2024-09-22T08:15:00.026186+0000","last_fullsized":"2024-09-22T08:15:00.026186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:15:00.026100+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:15:00.026100+0000","last_clean_scrub_stamp":"2024-09-22T08:15:00.026100+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:04.621822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.790753+0000","last_change":"2024-09-22T08:14:17.790672+0000","last_active":"2024-09-22T08:14:17.790753+0000","last_peered":"2024-09-22T08:14:17.790753+0000","last_clean":"2024-09-22T08:14:17.790753+0000","last_became_active":"2024-09-22T08:10:45.182276+0000","last_became_peered":"2024-09-22T08:10:45.182276+0000","last_unstale":"2024-09-22T08:14:17.790753+0000","last_undegraded":"2024-09-22T08:14:17.790753+0000","last_fullsized":"2024-09-22T08:14:17.790753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:17.790565+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:17.790565+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.790565+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:25.799618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.787575+0000","last_change":"2024-09-22T08:14:05.787504+0000","last_active":"2024-09-22T08:14:05.787575+0000","last_peered":"2024-09-22T08:14:05.787575+0000","last_clean":"2024-09-22T08:14:05.787575+0000","last_became_active":"2024-09-22T08:10:43.186175+0000","last_became_peered":"2024-09-22T08:10:43.186175+0000","last_unstale":"2024-09-22T08:14:05.787575+0000","last_undegraded":"2024-09-22T08:14:05.787575+0000","last_fullsized":"2024-09-22T08:14:05.787575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:05.787417+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:05.787417+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.787417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:42.384319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.983831+0000","last_change":"2024-09-22T08:14:03.983783+0000","last_active":"2024-09-22T08:14:03.983831+0000","last_peered":"2024-09-22T08:14:03.983831+0000","last_clean":"2024-09-22T08:14:03.983831+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:14:03.983831+0000","last_undegraded":"2024-09-22T08:14:03.983831+0000","last_fullsized":"2024-09-22T08:14:03.983831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:03.983713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:03.983713+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.983713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:58.921961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.015306+0000","last_change":"2024-09-22T08:14:34.015250+0000","last_active":"2024-09-22T08:14:34.015306+0000","last_peered":"2024-09-22T08:14:34.015306+0000","last_clean":"2024-09-22T08:14:34.015306+0000","last_became_active":"2024-09-22T08:10:47.167620+0000","last_became_peered":"2024-09-22T08:10:47.167620+0000","last_unstale":"2024-09-22T08:14:34.015306+0000","last_undegraded":"2024-09-22T08:14:34.015306+0000","last_fullsized":"2024-09-22T08:14:34.015306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:34.015156+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:34.015156+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.015156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:40.094721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'79","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.033522+0000","last_change":"2024-09-22T08:14:40.033421+0000","last_active":"2024-09-22T08:14:40.033522+0000","last_peered":"2024-09-22T08:14:40.033522+0000","last_clean":"2024-09-22T08:14:40.033522+0000","last_became_active":"2024-09-22T08:10:49.184753+0000","last_became_peered":"2024-09-22T08:10:49.184753+0000","last_unstale":"2024-09-22T08:14:40.033522+0000","last_undegraded":"2024-09-22T08:14:40.033522+0000","last_fullsized":"2024-09-22T08:14:40.033522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'79","last_scrub_stamp":"2024-09-22T08:14:40.033261+0000","last_deep_scrub":"34'79","last_deep_scrub_stamp":"2024-09-22T08:14:40.033261+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.033261+0000","objects_scrubbed":9,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:08.329565+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.865327+0000","last_change":"2024-09-22T08:14:45.865265+0000","last_active":"2024-09-22T08:14:45.865327+0000","last_peered":"2024-09-22T08:14:45.865327+0000","last_clean":"2024-09-22T08:14:45.865327+0000","last_became_active":"2024-09-22T08:10:51.196724+0000","last_became_peered":"2024-09-22T08:10:51.196724+0000","last_unstale":"2024-09-22T08:14:45.865327+0000","last_undegraded":"2024-09-22T08:14:45.865327+0000","last_fullsized":"2024-09-22T08:14:45.865327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:45.865172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:45.865172+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.865172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:03.500814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.036807+0000","last_change":"2024-09-22T08:14:57.036807+0000","last_active":"2024-09-22T08:14:57.036807+0000","last_peered":"2024-09-22T08:14:57.036807+0000","last_clean":"2024-09-22T08:14:57.036807+0000","last_became_active":"2024-09-22T08:10:53.196406+0000","last_became_peered":"2024-09-22T08:10:53.196406+0000","last_unstale":"2024-09-22T08:14:57.036807+0000","last_undegraded":"2024-09-22T08:14:57.036807+0000","last_fullsized":"2024-09-22T08:14:57.036807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-22T08:14:57.036723+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-22T08:14:57.036723+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.036723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:02:08.231558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.830960+0000","last_change":"2024-09-22T08:14:18.830904+0000","last_active":"2024-09-22T08:14:18.830960+0000","last_peered":"2024-09-22T08:14:18.830960+0000","last_clean":"2024-09-22T08:14:18.830960+0000","last_became_active":"2024-09-22T08:10:45.176601+0000","last_became_peered":"2024-09-22T08:10:45.176601+0000","last_unstale":"2024-09-22T08:14:18.830960+0000","last_undegraded":"2024-09-22T08:14:18.830960+0000","last_fullsized":"2024-09-22T08:14:18.830960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:18.830805+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.830805+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.830805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:34.352591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.951111+0000","last_change":"2024-09-22T08:14:06.951005+0000","last_active":"2024-09-22T08:14:06.951111+0000","last_peered":"2024-09-22T08:14:06.951111+0000","last_clean":"2024-09-22T08:14:06.951111+0000","last_became_active":"2024-09-22T08:10:43.186758+0000","last_became_peered":"2024-09-22T08:10:43.186758+0000","last_unstale":"2024-09-22T08:14:06.951111+0000","last_undegraded":"2024-09-22T08:14:06.951111+0000","last_fullsized":"2024-09-22T08:14:06.951111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:06.950903+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:06.950903+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.950903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:00.975454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.240086+0000","last_change":"2024-09-22T08:14:08.240026+0000","last_active":"2024-09-22T08:14:08.240086+0000","last_peered":"2024-09-22T08:14:08.240086+0000","last_clean":"2024-09-22T08:14:08.240086+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:14:08.240086+0000","last_undegraded":"2024-09-22T08:14:08.240086+0000","last_fullsized":"2024-09-22T08:14:08.240086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.239939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.239939+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.239939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:30.468689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:52.058236+0000","last_change":"2024-09-22T08:14:52.058180+0000","last_active":"2024-09-22T08:14:52.058236+0000","last_peered":"2024-09-22T08:14:52.058236+0000","last_clean":"2024-09-22T08:14:52.058236+0000","last_became_active":"2024-09-22T08:10:47.173348+0000","last_became_peered":"2024-09-22T08:10:47.173348+0000","last_unstale":"2024-09-22T08:14:52.058236+0000","last_undegraded":"2024-09-22T08:14:52.058236+0000","last_fullsized":"2024-09-22T08:14:52.058236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:52.058080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:52.058080+0000","last_clean_scrub_stamp":"2024-09-22T08:14:52.058080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:37.500789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.847583+0000","last_change":"2024-09-22T08:14:44.847529+0000","last_active":"2024-09-22T08:14:44.847583+0000","last_peered":"2024-09-22T08:14:44.847583+0000","last_clean":"2024-09-22T08:14:44.847583+0000","last_became_active":"2024-09-22T08:10:49.187184+0000","last_became_peered":"2024-09-22T08:10:49.187184+0000","last_unstale":"2024-09-22T08:14:44.847583+0000","last_undegraded":"2024-09-22T08:14:44.847583+0000","last_fullsized":"2024-09-22T08:14:44.847583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-22T08:14:44.847434+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-22T08:14:44.847434+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.847434+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:38.526852+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.958335+0000","last_change":"2024-09-22T08:14:51.958279+0000","last_active":"2024-09-22T08:14:51.958335+0000","last_peered":"2024-09-22T08:14:51.958335+0000","last_clean":"2024-09-22T08:14:51.958335+0000","last_became_active":"2024-09-22T08:10:51.197111+0000","last_became_peered":"2024-09-22T08:10:51.197111+0000","last_unstale":"2024-09-22T08:14:51.958335+0000","last_undegraded":"2024-09-22T08:14:51.958335+0000","last_fullsized":"2024-09-22T08:14:51.958335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:51.958172+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:51.958172+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.958172+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:42.019648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212274+0000","last_change":"2024-09-22T08:10:53.200428+0000","last_active":"2024-09-22T08:11:23.212274+0000","last_peered":"2024-09-22T08:11:23.212274+0000","last_clean":"2024-09-22T08:11:23.212274+0000","last_became_active":"2024-09-22T08:10:53.199612+0000","last_became_peered":"2024-09-22T08:10:53.199612+0000","last_unstale":"2024-09-22T08:11:23.212274+0000","last_undegraded":"2024-09-22T08:11:23.212274+0000","last_fullsized":"2024-09-22T08:11:23.212274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:47.560464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.199484+0000","last_change":"2024-09-22T08:14:32.199399+0000","last_active":"2024-09-22T08:14:32.199484+0000","last_peered":"2024-09-22T08:14:32.199484+0000","last_clean":"2024-09-22T08:14:32.199484+0000","last_became_active":"2024-09-22T08:10:45.183229+0000","last_became_peered":"2024-09-22T08:10:45.183229+0000","last_unstale":"2024-09-22T08:14:32.199484+0000","last_undegraded":"2024-09-22T08:14:32.199484+0000","last_fullsized":"2024-09-22T08:14:32.199484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:32.199294+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:32.199294+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.199294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:42.593819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.315254+0000","last_change":"2024-09-22T08:14:10.315191+0000","last_active":"2024-09-22T08:14:10.315254+0000","last_peered":"2024-09-22T08:14:10.315254+0000","last_clean":"2024-09-22T08:14:10.315254+0000","last_became_active":"2024-09-22T08:10:43.198637+0000","last_became_peered":"2024-09-22T08:10:43.198637+0000","last_unstale":"2024-09-22T08:14:10.315254+0000","last_undegraded":"2024-09-22T08:14:10.315254+0000","last_fullsized":"2024-09-22T08:14:10.315254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:10.315107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:10.315107+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.315107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:31.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:02.966971+0000","last_change":"2024-09-22T08:14:02.966909+0000","last_active":"2024-09-22T08:14:02.966971+0000","last_peered":"2024-09-22T08:14:02.966971+0000","last_clean":"2024-09-22T08:14:02.966971+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:14:02.966971+0000","last_undegraded":"2024-09-22T08:14:02.966971+0000","last_fullsized":"2024-09-22T08:14:02.966971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:02.966839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:02.966839+0000","last_clean_scrub_stamp":"2024-09-22T08:14:02.966839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:08.371695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.061262+0000","last_change":"2024-09-22T08:14:51.061185+0000","last_active":"2024-09-22T08:14:51.061262+0000","last_peered":"2024-09-22T08:14:51.061262+0000","last_clean":"2024-09-22T08:14:51.061262+0000","last_became_active":"2024-09-22T08:11:23.216676+0000","last_became_peered":"2024-09-22T08:11:23.216676+0000","last_unstale":"2024-09-22T08:14:51.061262+0000","last_undegraded":"2024-09-22T08:14:51.061262+0000","last_fullsized":"2024-09-22T08:14:51.061262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:51.061100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:51.061100+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.061100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:02.961951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:58.087045+0000","last_change":"2024-09-22T08:14:58.086988+0000","last_active":"2024-09-22T08:14:58.087045+0000","last_peered":"2024-09-22T08:14:58.087045+0000","last_clean":"2024-09-22T08:14:58.087045+0000","last_became_active":"2024-09-22T08:10:49.188309+0000","last_became_peered":"2024-09-22T08:10:49.188309+0000","last_unstale":"2024-09-22T08:14:58.087045+0000","last_undegraded":"2024-09-22T08:14:58.087045+0000","last_fullsized":"2024-09-22T08:14:58.087045+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-22T08:14:58.086893+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-22T08:14:58.086893+0000","last_clean_scrub_stamp":"2024-09-22T08:14:58.086893+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:44.496314+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.105970+0000","last_change":"2024-09-22T08:14:45.105923+0000","last_active":"2024-09-22T08:14:45.105970+0000","last_peered":"2024-09-22T08:14:45.105970+0000","last_clean":"2024-09-22T08:14:45.105970+0000","last_became_active":"2024-09-22T08:10:51.192058+0000","last_became_peered":"2024-09-22T08:10:51.192058+0000","last_unstale":"2024-09-22T08:14:45.105970+0000","last_undegraded":"2024-09-22T08:14:45.105970+0000","last_fullsized":"2024-09-22T08:14:45.105970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:45.105854+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:45.105854+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.105854+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:19.242010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:02.067750+0000","last_change":"2024-09-22T08:15:02.067750+0000","last_active":"2024-09-22T08:15:02.067750+0000","last_peered":"2024-09-22T08:15:02.067750+0000","last_clean":"2024-09-22T08:15:02.067750+0000","last_became_active":"2024-09-22T08:10:53.203670+0000","last_became_peered":"2024-09-22T08:10:53.203670+0000","last_unstale":"2024-09-22T08:15:02.067750+0000","last_undegraded":"2024-09-22T08:15:02.067750+0000","last_fullsized":"2024-09-22T08:15:02.067750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:15:02.067649+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:15:02.067649+0000","last_clean_scrub_stamp":"2024-09-22T08:15:02.067649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:21.196732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'17","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.858477+0000","last_change":"2024-09-22T08:14:19.858415+0000","last_active":"2024-09-22T08:14:19.858477+0000","last_peered":"2024-09-22T08:14:19.858477+0000","last_clean":"2024-09-22T08:14:19.858477+0000","last_became_active":"2024-09-22T08:10:45.171667+0000","last_became_peered":"2024-09-22T08:10:45.171667+0000","last_unstale":"2024-09-22T08:14:19.858477+0000","last_undegraded":"2024-09-22T08:14:19.858477+0000","last_fullsized":"2024-09-22T08:14:19.858477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-22T08:14:19.858328+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-22T08:14:19.858328+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.858328+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:20.434578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.704638+0000","last_change":"2024-09-22T08:14:04.704581+0000","last_active":"2024-09-22T08:14:04.704638+0000","last_peered":"2024-09-22T08:14:04.704638+0000","last_clean":"2024-09-22T08:14:04.704638+0000","last_became_active":"2024-09-22T08:10:43.182161+0000","last_became_peered":"2024-09-22T08:10:43.182161+0000","last_unstale":"2024-09-22T08:14:04.704638+0000","last_undegraded":"2024-09-22T08:14:04.704638+0000","last_fullsized":"2024-09-22T08:14:04.704638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:04.704488+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:04.704488+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.704488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:26.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.215265+0000","last_change":"2024-09-22T08:14:07.215210+0000","last_active":"2024-09-22T08:14:07.215265+0000","last_peered":"2024-09-22T08:14:07.215265+0000","last_clean":"2024-09-22T08:14:07.215265+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:14:07.215265+0000","last_undegraded":"2024-09-22T08:14:07.215265+0000","last_fullsized":"2024-09-22T08:14:07.215265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:07.215094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:07.215094+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.215094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:24.079988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.032150+0000","last_change":"2024-09-22T08:14:49.032150+0000","last_active":"2024-09-22T08:14:49.032150+0000","last_peered":"2024-09-22T08:14:49.032150+0000","last_clean":"2024-09-22T08:14:49.032150+0000","last_became_active":"2024-09-22T08:10:47.172441+0000","last_became_peered":"2024-09-22T08:10:47.172441+0000","last_unstale":"2024-09-22T08:14:49.032150+0000","last_undegraded":"2024-09-22T08:14:49.032150+0000","last_fullsized":"2024-09-22T08:14:49.032150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:49.032018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:49.032018+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.032018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:39.744849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'99","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.904053+0000","last_change":"2024-09-22T08:14:40.903978+0000","last_active":"2024-09-22T08:14:40.904053+0000","last_peered":"2024-09-22T08:14:40.904053+0000","last_clean":"2024-09-22T08:14:40.904053+0000","last_became_active":"2024-09-22T08:10:49.184942+0000","last_became_peered":"2024-09-22T08:10:49.184942+0000","last_unstale":"2024-09-22T08:14:40.904053+0000","last_undegraded":"2024-09-22T08:14:40.904053+0000","last_fullsized":"2024-09-22T08:14:40.904053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'99","last_scrub_stamp":"2024-09-22T08:14:40.903848+0000","last_deep_scrub":"34'99","last_deep_scrub_stamp":"2024-09-22T08:14:40.903848+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.903848+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:07.358495+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.127662+0000","last_change":"2024-09-22T08:14:46.127575+0000","last_active":"2024-09-22T08:14:46.127662+0000","last_peered":"2024-09-22T08:14:46.127662+0000","last_clean":"2024-09-22T08:14:46.127662+0000","last_became_active":"2024-09-22T08:10:51.194912+0000","last_became_peered":"2024-09-22T08:10:51.194912+0000","last_unstale":"2024-09-22T08:14:46.127662+0000","last_undegraded":"2024-09-22T08:14:46.127662+0000","last_fullsized":"2024-09-22T08:14:46.127662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:46.127459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:46.127459+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.127459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:56.216743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.977006+0000","last_change":"2024-09-22T08:14:55.977006+0000","last_active":"2024-09-22T08:14:55.977006+0000","last_peered":"2024-09-22T08:14:55.977006+0000","last_clean":"2024-09-22T08:14:55.977006+0000","last_became_active":"2024-09-22T08:10:53.192189+0000","last_became_peered":"2024-09-22T08:10:53.192189+0000","last_unstale":"2024-09-22T08:14:55.977006+0000","last_undegraded":"2024-09-22T08:14:55.977006+0000","last_fullsized":"2024-09-22T08:14:55.977006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.976887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.976887+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.976887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:39.042717+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.959017+0000","last_change":"2024-09-22T08:14:57.958918+0000","last_active":"2024-09-22T08:14:57.959017+0000","last_peered":"2024-09-22T08:14:57.959017+0000","last_clean":"2024-09-22T08:14:57.959017+0000","last_became_active":"2024-09-22T08:10:53.197799+0000","last_became_peered":"2024-09-22T08:10:53.197799+0000","last_unstale":"2024-09-22T08:14:57.959017+0000","last_undegraded":"2024-09-22T08:14:57.959017+0000","last_fullsized":"2024-09-22T08:14:57.959017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:57.958818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:57.958818+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.958818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:32:50.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.911762+0000","last_change":"2024-09-22T08:14:22.911762+0000","last_active":"2024-09-22T08:14:22.911762+0000","last_peered":"2024-09-22T08:14:22.911762+0000","last_clean":"2024-09-22T08:14:22.911762+0000","last_became_active":"2024-09-22T08:10:45.173916+0000","last_became_peered":"2024-09-22T08:10:45.173916+0000","last_unstale":"2024-09-22T08:14:22.911762+0000","last_undegraded":"2024-09-22T08:14:22.911762+0000","last_fullsized":"2024-09-22T08:14:22.911762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:22.911670+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:22.911670+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.911670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:48.789223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.225254+0000","last_change":"2024-09-22T08:14:18.225254+0000","last_active":"2024-09-22T08:14:18.225254+0000","last_peered":"2024-09-22T08:14:18.225254+0000","last_clean":"2024-09-22T08:14:18.225254+0000","last_became_active":"2024-09-22T08:10:43.201007+0000","last_became_peered":"2024-09-22T08:10:43.201007+0000","last_unstale":"2024-09-22T08:14:18.225254+0000","last_undegraded":"2024-09-22T08:14:18.225254+0000","last_fullsized":"2024-09-22T08:14:18.225254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:18.225171+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.225171+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.225171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:48.896171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.812893+0000","last_change":"2024-09-22T08:14:40.812893+0000","last_active":"2024-09-22T08:14:40.812893+0000","last_peered":"2024-09-22T08:14:40.812893+0000","last_clean":"2024-09-22T08:14:40.812893+0000","last_became_active":"2024-09-22T08:10:47.175524+0000","last_became_peered":"2024-09-22T08:10:47.175524+0000","last_unstale":"2024-09-22T08:14:40.812893+0000","last_undegraded":"2024-09-22T08:14:40.812893+0000","last_fullsized":"2024-09-22T08:14:40.812893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:40.812810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:40.812810+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.812810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:50.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.873004+0000","last_change":"2024-09-22T08:10:49.186252+0000","last_active":"2024-09-22T08:13:59.873004+0000","last_peered":"2024-09-22T08:13:59.873004+0000","last_clean":"2024-09-22T08:13:59.873004+0000","last_became_active":"2024-09-22T08:10:49.185693+0000","last_became_peered":"2024-09-22T08:10:49.185693+0000","last_unstale":"2024-09-22T08:13:59.873004+0000","last_undegraded":"2024-09-22T08:13:59.873004+0000","last_fullsized":"2024-09-22T08:13:59.873004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:02.680927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.213000+0000","last_change":"2024-09-22T08:10:51.200112+0000","last_active":"2024-09-22T08:11:23.213000+0000","last_peered":"2024-09-22T08:11:23.213000+0000","last_clean":"2024-09-22T08:11:23.213000+0000","last_became_active":"2024-09-22T08:10:51.199799+0000","last_became_peered":"2024-09-22T08:10:51.199799+0000","last_unstale":"2024-09-22T08:11:23.213000+0000","last_undegraded":"2024-09-22T08:11:23.213000+0000","last_fullsized":"2024-09-22T08:11:23.213000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:06.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'13","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:53.361980+0000","last_change":"2024-09-22T08:10:53.201508+0000","last_active":"2024-09-22T08:13:53.361980+0000","last_peered":"2024-09-22T08:13:53.361980+0000","last_clean":"2024-09-22T08:13:53.361980+0000","last_became_active":"2024-09-22T08:10:53.201209+0000","last_became_peered":"2024-09-22T08:10:53.201209+0000","last_unstale":"2024-09-22T08:13:53.361980+0000","last_undegraded":"2024-09-22T08:13:53.361980+0000","last_fullsized":"2024-09-22T08:13:53.361980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":69,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'12","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.885259+0000","last_change":"2024-09-22T08:14:22.885259+0000","last_active":"2024-09-22T08:14:22.885259+0000","last_peered":"2024-09-22T08:14:22.885259+0000","last_clean":"2024-09-22T08:14:22.885259+0000","last_became_active":"2024-09-22T08:10:45.182245+0000","last_became_peered":"2024-09-22T08:10:45.182245+0000","last_unstale":"2024-09-22T08:14:22.885259+0000","last_undegraded":"2024-09-22T08:14:22.885259+0000","last_fullsized":"2024-09-22T08:14:22.885259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:22.885177+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:22.885177+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.885177+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:18.269445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.706396+0000","last_change":"2024-09-22T08:14:10.706396+0000","last_active":"2024-09-22T08:14:10.706396+0000","last_peered":"2024-09-22T08:14:10.706396+0000","last_clean":"2024-09-22T08:14:10.706396+0000","last_became_active":"2024-09-22T08:10:43.185230+0000","last_became_peered":"2024-09-22T08:10:43.185230+0000","last_unstale":"2024-09-22T08:14:10.706396+0000","last_undegraded":"2024-09-22T08:14:10.706396+0000","last_fullsized":"2024-09-22T08:14:10.706396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:10.706291+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:10.706291+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.706291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:16.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.030787+0000","last_change":"2024-09-22T08:14:56.030787+0000","last_active":"2024-09-22T08:14:56.030787+0000","last_peered":"2024-09-22T08:14:56.030787+0000","last_clean":"2024-09-22T08:14:56.030787+0000","last_became_active":"2024-09-22T08:10:47.175747+0000","last_became_peered":"2024-09-22T08:10:47.175747+0000","last_unstale":"2024-09-22T08:14:56.030787+0000","last_undegraded":"2024-09-22T08:14:56.030787+0000","last_fullsized":"2024-09-22T08:14:56.030787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:56.030708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:56.030708+0000","last_clean_scrub_stamp":"2024-09-22T08:14:56.030708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:19.490689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.041367+0000","last_change":"2024-09-22T08:14:41.041367+0000","last_active":"2024-09-22T08:14:41.041367+0000","last_peered":"2024-09-22T08:14:41.041367+0000","last_clean":"2024-09-22T08:14:41.041367+0000","last_became_active":"2024-09-22T08:10:49.180921+0000","last_became_peered":"2024-09-22T08:10:49.180921+0000","last_unstale":"2024-09-22T08:14:41.041367+0000","last_undegraded":"2024-09-22T08:14:41.041367+0000","last_fullsized":"2024-09-22T08:14:41.041367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:41.041241+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:41.041241+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.041241+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:34.720660+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.923262+0000","last_change":"2024-09-22T08:14:48.923262+0000","last_active":"2024-09-22T08:14:48.923262+0000","last_peered":"2024-09-22T08:14:48.923262+0000","last_clean":"2024-09-22T08:14:48.923262+0000","last_became_active":"2024-09-22T08:10:51.192989+0000","last_became_peered":"2024-09-22T08:10:51.192989+0000","last_unstale":"2024-09-22T08:14:48.923262+0000","last_undegraded":"2024-09-22T08:14:48.923262+0000","last_fullsized":"2024-09-22T08:14:48.923262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:48.923162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:48.923162+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.923162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:34.528022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:01.097179+0000","last_change":"2024-09-22T08:15:01.097179+0000","last_active":"2024-09-22T08:15:01.097179+0000","last_peered":"2024-09-22T08:15:01.097179+0000","last_clean":"2024-09-22T08:15:01.097179+0000","last_became_active":"2024-09-22T08:10:53.192967+0000","last_became_peered":"2024-09-22T08:10:53.192967+0000","last_unstale":"2024-09-22T08:15:01.097179+0000","last_undegraded":"2024-09-22T08:15:01.097179+0000","last_fullsized":"2024-09-22T08:15:01.097179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:15:01.097092+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:15:01.097092+0000","last_clean_scrub_stamp":"2024-09-22T08:15:01.097092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:15.265735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.890489+0000","last_change":"2024-09-22T08:14:25.890489+0000","last_active":"2024-09-22T08:14:25.890489+0000","last_peered":"2024-09-22T08:14:25.890489+0000","last_clean":"2024-09-22T08:14:25.890489+0000","last_became_active":"2024-09-22T08:10:45.171555+0000","last_became_peered":"2024-09-22T08:10:45.171555+0000","last_unstale":"2024-09-22T08:14:25.890489+0000","last_undegraded":"2024-09-22T08:14:25.890489+0000","last_fullsized":"2024-09-22T08:14:25.890489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:25.890395+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:25.890395+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.890395+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:37.923633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.741592+0000","last_change":"2024-09-22T08:14:09.741592+0000","last_active":"2024-09-22T08:14:09.741592+0000","last_peered":"2024-09-22T08:14:09.741592+0000","last_clean":"2024-09-22T08:14:09.741592+0000","last_became_active":"2024-09-22T08:10:43.187044+0000","last_became_peered":"2024-09-22T08:10:43.187044+0000","last_unstale":"2024-09-22T08:14:09.741592+0000","last_undegraded":"2024-09-22T08:14:09.741592+0000","last_fullsized":"2024-09-22T08:14:09.741592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:09.741505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:09.741505+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.741505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:51.031430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.006667+0000","last_change":"2024-09-22T08:14:35.006667+0000","last_active":"2024-09-22T08:14:35.006667+0000","last_peered":"2024-09-22T08:14:35.006667+0000","last_clean":"2024-09-22T08:14:35.006667+0000","last_became_active":"2024-09-22T08:10:47.177735+0000","last_became_peered":"2024-09-22T08:10:47.177735+0000","last_unstale":"2024-09-22T08:14:35.006667+0000","last_undegraded":"2024-09-22T08:14:35.006667+0000","last_fullsized":"2024-09-22T08:14:35.006667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:35.006578+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:35.006578+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.006578+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:46.461347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.083581+0000","last_change":"2024-09-22T08:14:43.083581+0000","last_active":"2024-09-22T08:14:43.083581+0000","last_peered":"2024-09-22T08:14:43.083581+0000","last_clean":"2024-09-22T08:14:43.083581+0000","last_became_active":"2024-09-22T08:10:49.182557+0000","last_became_peered":"2024-09-22T08:10:49.182557+0000","last_unstale":"2024-09-22T08:14:43.083581+0000","last_undegraded":"2024-09-22T08:14:43.083581+0000","last_fullsized":"2024-09-22T08:14:43.083581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-22T08:14:43.083449+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-22T08:14:43.083449+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.083449+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:56.730021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.993720+0000","last_change":"2024-09-22T08:14:53.993720+0000","last_active":"2024-09-22T08:14:53.993720+0000","last_peered":"2024-09-22T08:14:53.993720+0000","last_clean":"2024-09-22T08:14:53.993720+0000","last_became_active":"2024-09-22T08:10:51.198204+0000","last_became_peered":"2024-09-22T08:10:51.198204+0000","last_unstale":"2024-09-22T08:14:53.993720+0000","last_undegraded":"2024-09-22T08:14:53.993720+0000","last_fullsized":"2024-09-22T08:14:53.993720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.993609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.993609+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.993609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:44.690474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.041147+0000","last_change":"2024-09-22T08:10:53.200288+0000","last_active":"2024-09-22T08:11:27.041147+0000","last_peered":"2024-09-22T08:11:27.041147+0000","last_clean":"2024-09-22T08:11:27.041147+0000","last_became_active":"2024-09-22T08:10:53.199827+0000","last_became_peered":"2024-09-22T08:10:53.199827+0000","last_unstale":"2024-09-22T08:11:27.041147+0000","last_undegraded":"2024-09-22T08:11:27.041147+0000","last_fullsized":"2024-09-22T08:11:27.041147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:31.568753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.086499+0000","last_change":"2024-09-22T08:14:37.086499+0000","last_active":"2024-09-22T08:14:37.086499+0000","last_peered":"2024-09-22T08:14:37.086499+0000","last_clean":"2024-09-22T08:14:37.086499+0000","last_became_active":"2024-09-22T08:10:45.183674+0000","last_became_peered":"2024-09-22T08:10:45.183674+0000","last_unstale":"2024-09-22T08:14:37.086499+0000","last_undegraded":"2024-09-22T08:14:37.086499+0000","last_fullsized":"2024-09-22T08:14:37.086499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:37.086391+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:37.086391+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.086391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:29.610650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.769770+0000","last_change":"2024-09-22T08:14:06.769770+0000","last_active":"2024-09-22T08:14:06.769770+0000","last_peered":"2024-09-22T08:14:06.769770+0000","last_clean":"2024-09-22T08:14:06.769770+0000","last_became_active":"2024-09-22T08:10:43.184287+0000","last_became_peered":"2024-09-22T08:10:43.184287+0000","last_unstale":"2024-09-22T08:14:06.769770+0000","last_undegraded":"2024-09-22T08:14:06.769770+0000","last_fullsized":"2024-09-22T08:14:06.769770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:06.769651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:06.769651+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.769651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:24.233361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.038776+0000","last_change":"2024-09-22T08:14:55.038776+0000","last_active":"2024-09-22T08:14:55.038776+0000","last_peered":"2024-09-22T08:14:55.038776+0000","last_clean":"2024-09-22T08:14:55.038776+0000","last_became_active":"2024-09-22T08:10:47.172816+0000","last_became_peered":"2024-09-22T08:10:47.172816+0000","last_unstale":"2024-09-22T08:14:55.038776+0000","last_undegraded":"2024-09-22T08:14:55.038776+0000","last_fullsized":"2024-09-22T08:14:55.038776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.038699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.038699+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.038699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:17.212237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.916067+0000","last_change":"2024-09-22T08:14:41.916067+0000","last_active":"2024-09-22T08:14:41.916067+0000","last_peered":"2024-09-22T08:14:41.916067+0000","last_clean":"2024-09-22T08:14:41.916067+0000","last_became_active":"2024-09-22T08:10:49.180621+0000","last_became_peered":"2024-09-22T08:10:49.180621+0000","last_unstale":"2024-09-22T08:14:41.916067+0000","last_undegraded":"2024-09-22T08:14:41.916067+0000","last_fullsized":"2024-09-22T08:14:41.916067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-22T08:14:41.915971+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-22T08:14:41.915971+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.915971+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:26.481785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.971832+0000","last_change":"2024-09-22T08:14:49.971832+0000","last_active":"2024-09-22T08:14:49.971832+0000","last_peered":"2024-09-22T08:14:49.971832+0000","last_clean":"2024-09-22T08:14:49.971832+0000","last_became_active":"2024-09-22T08:10:51.189640+0000","last_became_peered":"2024-09-22T08:10:51.189640+0000","last_unstale":"2024-09-22T08:14:49.971832+0000","last_undegraded":"2024-09-22T08:14:49.971832+0000","last_fullsized":"2024-09-22T08:14:49.971832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:49.971734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:49.971734+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.971734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:59.141108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.053777+0000","last_change":"2024-09-22T08:14:43.053723+0000","last_active":"2024-09-22T08:14:43.053777+0000","last_peered":"2024-09-22T08:14:43.053777+0000","last_clean":"2024-09-22T08:14:43.053777+0000","last_became_active":"2024-09-22T08:10:45.166591+0000","last_became_peered":"2024-09-22T08:10:45.166591+0000","last_unstale":"2024-09-22T08:14:43.053777+0000","last_undegraded":"2024-09-22T08:14:43.053777+0000","last_fullsized":"2024-09-22T08:14:43.053777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:43.053643+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:43.053643+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.053643+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:54.611177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.239338+0000","last_change":"2024-09-22T08:14:19.239338+0000","last_active":"2024-09-22T08:14:19.239338+0000","last_peered":"2024-09-22T08:14:19.239338+0000","last_clean":"2024-09-22T08:14:19.239338+0000","last_became_active":"2024-09-22T08:10:43.195608+0000","last_became_peered":"2024-09-22T08:10:43.195608+0000","last_unstale":"2024-09-22T08:14:19.239338+0000","last_undegraded":"2024-09-22T08:14:19.239338+0000","last_fullsized":"2024-09-22T08:14:19.239338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:19.239245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:19.239245+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.239245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.221139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.986507+0000","last_change":"2024-09-22T08:14:38.986434+0000","last_active":"2024-09-22T08:14:38.986507+0000","last_peered":"2024-09-22T08:14:38.986507+0000","last_clean":"2024-09-22T08:14:38.986507+0000","last_became_active":"2024-09-22T08:10:47.173043+0000","last_became_peered":"2024-09-22T08:10:47.173043+0000","last_unstale":"2024-09-22T08:14:38.986507+0000","last_undegraded":"2024-09-22T08:14:38.986507+0000","last_fullsized":"2024-09-22T08:14:38.986507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:38.986348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:38.986348+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.986348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:44.350224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'67","reported_seq":140,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.113790+0000","last_change":"2024-09-22T08:14:44.113790+0000","last_active":"2024-09-22T08:14:44.113790+0000","last_peered":"2024-09-22T08:14:44.113790+0000","last_clean":"2024-09-22T08:14:44.113790+0000","last_became_active":"2024-09-22T08:10:49.181611+0000","last_became_peered":"2024-09-22T08:10:49.181611+0000","last_unstale":"2024-09-22T08:14:44.113790+0000","last_undegraded":"2024-09-22T08:14:44.113790+0000","last_fullsized":"2024-09-22T08:14:44.113790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'67","last_scrub_stamp":"2024-09-22T08:14:44.113701+0000","last_deep_scrub":"34'67","last_deep_scrub_stamp":"2024-09-22T08:14:44.113701+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.113701+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:57.977591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:50.991575+0000","last_change":"2024-09-22T08:14:50.991575+0000","last_active":"2024-09-22T08:14:50.991575+0000","last_peered":"2024-09-22T08:14:50.991575+0000","last_clean":"2024-09-22T08:14:50.991575+0000","last_became_active":"2024-09-22T08:10:51.189592+0000","last_became_peered":"2024-09-22T08:10:51.189592+0000","last_unstale":"2024-09-22T08:14:50.991575+0000","last_undegraded":"2024-09-22T08:14:50.991575+0000","last_fullsized":"2024-09-22T08:14:50.991575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:50.991487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:50.991487+0000","last_clean_scrub_stamp":"2024-09-22T08:14:50.991487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:00.870180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.513524+0000","last_change":"2024-09-22T08:10:53.199349+0000","last_active":"2024-09-22T08:12:52.513524+0000","last_peered":"2024-09-22T08:12:52.513524+0000","last_clean":"2024-09-22T08:12:52.513524+0000","last_became_active":"2024-09-22T08:10:53.198999+0000","last_became_peered":"2024-09-22T08:10:53.198999+0000","last_unstale":"2024-09-22T08:12:52.513524+0000","last_undegraded":"2024-09-22T08:12:52.513524+0000","last_fullsized":"2024-09-22T08:12:52.513524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:40.998103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'22","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.900925+0000","last_change":"2024-09-22T08:14:22.900868+0000","last_active":"2024-09-22T08:14:22.900925+0000","last_peered":"2024-09-22T08:14:22.900925+0000","last_clean":"2024-09-22T08:14:22.900925+0000","last_became_active":"2024-09-22T08:10:45.183173+0000","last_became_peered":"2024-09-22T08:10:45.183173+0000","last_unstale":"2024-09-22T08:14:22.900925+0000","last_undegraded":"2024-09-22T08:14:22.900925+0000","last_fullsized":"2024-09-22T08:14:22.900925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-22T08:14:22.900782+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-22T08:14:22.900782+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.900782+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:29.628187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.818995+0000","last_change":"2024-09-22T08:14:07.818995+0000","last_active":"2024-09-22T08:14:07.818995+0000","last_peered":"2024-09-22T08:14:07.818995+0000","last_clean":"2024-09-22T08:14:07.818995+0000","last_became_active":"2024-09-22T08:10:43.177711+0000","last_became_peered":"2024-09-22T08:10:43.177711+0000","last_unstale":"2024-09-22T08:14:07.818995+0000","last_undegraded":"2024-09-22T08:14:07.818995+0000","last_fullsized":"2024-09-22T08:14:07.818995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:07.818910+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:07.818910+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.818910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:11.966919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.941417+0000","last_change":"2024-09-22T08:14:37.941323+0000","last_active":"2024-09-22T08:14:37.941417+0000","last_peered":"2024-09-22T08:14:37.941417+0000","last_clean":"2024-09-22T08:14:37.941417+0000","last_became_active":"2024-09-22T08:10:47.171702+0000","last_became_peered":"2024-09-22T08:10:47.171702+0000","last_unstale":"2024-09-22T08:14:37.941417+0000","last_undegraded":"2024-09-22T08:14:37.941417+0000","last_fullsized":"2024-09-22T08:14:37.941417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:37.941178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:37.941178+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.941178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:08.673150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.939363+0000","last_change":"2024-09-22T08:10:49.183268+0000","last_active":"2024-09-22T08:13:59.939363+0000","last_peered":"2024-09-22T08:13:59.939363+0000","last_clean":"2024-09-22T08:13:59.939363+0000","last_became_active":"2024-09-22T08:10:49.182398+0000","last_became_peered":"2024-09-22T08:10:49.182398+0000","last_unstale":"2024-09-22T08:13:59.939363+0000","last_undegraded":"2024-09-22T08:13:59.939363+0000","last_fullsized":"2024-09-22T08:13:59.939363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:20.960730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.991517+0000","last_change":"2024-09-22T08:14:55.991517+0000","last_active":"2024-09-22T08:14:55.991517+0000","last_peered":"2024-09-22T08:14:55.991517+0000","last_clean":"2024-09-22T08:14:55.991517+0000","last_became_active":"2024-09-22T08:10:51.202485+0000","last_became_peered":"2024-09-22T08:10:51.202485+0000","last_unstale":"2024-09-22T08:14:55.991517+0000","last_undegraded":"2024-09-22T08:14:55.991517+0000","last_fullsized":"2024-09-22T08:14:55.991517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.991428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.991428+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.991428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:55.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.969767+0000","last_change":"2024-09-22T08:10:53.202374+0000","last_active":"2024-09-22T08:13:52.969767+0000","last_peered":"2024-09-22T08:13:52.969767+0000","last_clean":"2024-09-22T08:13:52.969767+0000","last_became_active":"2024-09-22T08:10:53.201942+0000","last_became_peered":"2024-09-22T08:10:53.201942+0000","last_unstale":"2024-09-22T08:13:52.969767+0000","last_undegraded":"2024-09-22T08:13:52.969767+0000","last_fullsized":"2024-09-22T08:13:52.969767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:00.185249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.078202+0000","last_change":"2024-09-22T08:14:42.078202+0000","last_active":"2024-09-22T08:14:42.078202+0000","last_peered":"2024-09-22T08:14:42.078202+0000","last_clean":"2024-09-22T08:14:42.078202+0000","last_became_active":"2024-09-22T08:10:45.183576+0000","last_became_peered":"2024-09-22T08:10:45.183576+0000","last_unstale":"2024-09-22T08:14:42.078202+0000","last_undegraded":"2024-09-22T08:14:42.078202+0000","last_fullsized":"2024-09-22T08:14:42.078202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:42.078116+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:42.078116+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.078116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:21.619510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.778888+0000","last_change":"2024-09-22T08:14:08.778888+0000","last_active":"2024-09-22T08:14:08.778888+0000","last_peered":"2024-09-22T08:14:08.778888+0000","last_clean":"2024-09-22T08:14:08.778888+0000","last_became_active":"2024-09-22T08:10:43.178403+0000","last_became_peered":"2024-09-22T08:10:43.178403+0000","last_unstale":"2024-09-22T08:14:08.778888+0000","last_undegraded":"2024-09-22T08:14:08.778888+0000","last_fullsized":"2024-09-22T08:14:08.778888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.778788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.778788+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.778788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:11.516811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.941306+0000","last_change":"2024-09-22T08:14:36.941306+0000","last_active":"2024-09-22T08:14:36.941306+0000","last_peered":"2024-09-22T08:14:36.941306+0000","last_clean":"2024-09-22T08:14:36.941306+0000","last_became_active":"2024-09-22T08:10:47.171973+0000","last_became_peered":"2024-09-22T08:10:47.171973+0000","last_unstale":"2024-09-22T08:14:36.941306+0000","last_undegraded":"2024-09-22T08:14:36.941306+0000","last_fullsized":"2024-09-22T08:14:36.941306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:36.941191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:36.941191+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.941191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:39.832853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.127443+0000","last_change":"2024-09-22T08:14:54.127324+0000","last_active":"2024-09-22T08:14:54.127443+0000","last_peered":"2024-09-22T08:14:54.127443+0000","last_clean":"2024-09-22T08:14:54.127443+0000","last_became_active":"2024-09-22T08:10:49.184885+0000","last_became_peered":"2024-09-22T08:10:49.184885+0000","last_unstale":"2024-09-22T08:14:54.127443+0000","last_undegraded":"2024-09-22T08:14:54.127443+0000","last_fullsized":"2024-09-22T08:14:54.127443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-22T08:14:54.127209+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-22T08:14:54.127209+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.127209+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:39.670431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.082126+0000","last_change":"2024-09-22T08:14:55.082126+0000","last_active":"2024-09-22T08:14:55.082126+0000","last_peered":"2024-09-22T08:14:55.082126+0000","last_clean":"2024-09-22T08:14:55.082126+0000","last_became_active":"2024-09-22T08:10:51.193970+0000","last_became_peered":"2024-09-22T08:10:51.193970+0000","last_unstale":"2024-09-22T08:14:55.082126+0000","last_undegraded":"2024-09-22T08:14:55.082126+0000","last_fullsized":"2024-09-22T08:14:55.082126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.082033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.082033+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.082033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:37.412029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.572122+0000","last_change":"2024-09-22T08:10:53.202778+0000","last_active":"2024-09-22T08:12:52.572122+0000","last_peered":"2024-09-22T08:12:52.572122+0000","last_clean":"2024-09-22T08:12:52.572122+0000","last_became_active":"2024-09-22T08:10:53.202493+0000","last_became_peered":"2024-09-22T08:10:53.202493+0000","last_unstale":"2024-09-22T08:12:52.572122+0000","last_undegraded":"2024-09-22T08:12:52.572122+0000","last_fullsized":"2024-09-22T08:12:52.572122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:44.822421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.900963+0000","last_change":"2024-09-22T08:14:21.900963+0000","last_active":"2024-09-22T08:14:21.900963+0000","last_peered":"2024-09-22T08:14:21.900963+0000","last_clean":"2024-09-22T08:14:21.900963+0000","last_became_active":"2024-09-22T08:10:45.166540+0000","last_became_peered":"2024-09-22T08:10:45.166540+0000","last_unstale":"2024-09-22T08:14:21.900963+0000","last_undegraded":"2024-09-22T08:14:21.900963+0000","last_fullsized":"2024-09-22T08:14:21.900963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:21.900884+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:21.900884+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.900884+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:18.177848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.228380+0000","last_change":"2024-09-22T08:14:20.228380+0000","last_active":"2024-09-22T08:14:20.228380+0000","last_peered":"2024-09-22T08:14:20.228380+0000","last_clean":"2024-09-22T08:14:20.228380+0000","last_became_active":"2024-09-22T08:10:43.199724+0000","last_became_peered":"2024-09-22T08:10:43.199724+0000","last_unstale":"2024-09-22T08:14:20.228380+0000","last_undegraded":"2024-09-22T08:14:20.228380+0000","last_fullsized":"2024-09-22T08:14:20.228380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:20.228266+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:20.228266+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.228266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:39.492150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.892749+0000","last_change":"2024-09-22T08:14:45.892749+0000","last_active":"2024-09-22T08:14:45.892749+0000","last_peered":"2024-09-22T08:14:45.892749+0000","last_clean":"2024-09-22T08:14:45.892749+0000","last_became_active":"2024-09-22T08:10:47.175541+0000","last_became_peered":"2024-09-22T08:10:47.175541+0000","last_unstale":"2024-09-22T08:14:45.892749+0000","last_undegraded":"2024-09-22T08:14:45.892749+0000","last_fullsized":"2024-09-22T08:14:45.892749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:45.892628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:45.892628+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.892628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:55.127242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.960508+0000","last_change":"2024-09-22T08:10:49.188295+0000","last_active":"2024-09-22T08:13:52.960508+0000","last_peered":"2024-09-22T08:13:52.960508+0000","last_clean":"2024-09-22T08:13:52.960508+0000","last_became_active":"2024-09-22T08:10:49.187767+0000","last_became_peered":"2024-09-22T08:10:49.187767+0000","last_unstale":"2024-09-22T08:13:52.960508+0000","last_undegraded":"2024-09-22T08:13:52.960508+0000","last_fullsized":"2024-09-22T08:13:52.960508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":380,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.999494+0000","last_change":"2024-09-22T08:14:51.999420+0000","last_active":"2024-09-22T08:14:51.999494+0000","last_peered":"2024-09-22T08:14:51.999494+0000","last_clean":"2024-09-22T08:14:51.999494+0000","last_became_active":"2024-09-22T08:10:51.197814+0000","last_became_peered":"2024-09-22T08:10:51.197814+0000","last_unstale":"2024-09-22T08:14:51.999494+0000","last_undegraded":"2024-09-22T08:14:51.999494+0000","last_fullsized":"2024-09-22T08:14:51.999494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:51.999327+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:51.999327+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.999327+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:39:55.424693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209032+0000","last_change":"2024-09-22T08:10:53.200170+0000","last_active":"2024-09-22T08:11:23.209032+0000","last_peered":"2024-09-22T08:11:23.209032+0000","last_clean":"2024-09-22T08:11:23.209032+0000","last_became_active":"2024-09-22T08:10:53.199881+0000","last_became_peered":"2024-09-22T08:10:53.199881+0000","last_unstale":"2024-09-22T08:11:23.209032+0000","last_undegraded":"2024-09-22T08:11:23.209032+0000","last_fullsized":"2024-09-22T08:11:23.209032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:46.946049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.934421+0000","last_change":"2024-09-22T08:14:25.934421+0000","last_active":"2024-09-22T08:14:25.934421+0000","last_peered":"2024-09-22T08:14:25.934421+0000","last_clean":"2024-09-22T08:14:25.934421+0000","last_became_active":"2024-09-22T08:10:45.166103+0000","last_became_peered":"2024-09-22T08:10:45.166103+0000","last_unstale":"2024-09-22T08:14:25.934421+0000","last_undegraded":"2024-09-22T08:14:25.934421+0000","last_fullsized":"2024-09-22T08:14:25.934421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:25.934299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:25.934299+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.934299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:29.868493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.769326+0000","last_change":"2024-09-22T08:14:10.769326+0000","last_active":"2024-09-22T08:14:10.769326+0000","last_peered":"2024-09-22T08:14:10.769326+0000","last_clean":"2024-09-22T08:14:10.769326+0000","last_became_active":"2024-09-22T08:10:43.180097+0000","last_became_peered":"2024-09-22T08:10:43.180097+0000","last_unstale":"2024-09-22T08:14:10.769326+0000","last_undegraded":"2024-09-22T08:14:10.769326+0000","last_fullsized":"2024-09-22T08:14:10.769326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:10.769243+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:10.769243+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.769243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:28.728155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.842396+0000","last_change":"2024-09-22T08:14:43.842396+0000","last_active":"2024-09-22T08:14:43.842396+0000","last_peered":"2024-09-22T08:14:43.842396+0000","last_clean":"2024-09-22T08:14:43.842396+0000","last_became_active":"2024-09-22T08:10:47.175604+0000","last_became_peered":"2024-09-22T08:10:47.175604+0000","last_unstale":"2024-09-22T08:14:43.842396+0000","last_undegraded":"2024-09-22T08:14:43.842396+0000","last_fullsized":"2024-09-22T08:14:43.842396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:43.842274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:43.842274+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.842274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:12.138578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.003144+0000","last_change":"2024-09-22T08:14:51.003144+0000","last_active":"2024-09-22T08:14:51.003144+0000","last_peered":"2024-09-22T08:14:51.003144+0000","last_clean":"2024-09-22T08:14:51.003144+0000","last_became_active":"2024-09-22T08:10:49.175817+0000","last_became_peered":"2024-09-22T08:10:49.175817+0000","last_unstale":"2024-09-22T08:14:51.003144+0000","last_undegraded":"2024-09-22T08:14:51.003144+0000","last_fullsized":"2024-09-22T08:14:51.003144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-22T08:14:51.003046+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-22T08:14:51.003046+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.003046+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:30.056044+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:52.177853+0000","last_change":"2024-09-22T08:14:52.177853+0000","last_active":"2024-09-22T08:14:52.177853+0000","last_peered":"2024-09-22T08:14:52.177853+0000","last_clean":"2024-09-22T08:14:52.177853+0000","last_became_active":"2024-09-22T08:10:51.191988+0000","last_became_peered":"2024-09-22T08:10:51.191988+0000","last_unstale":"2024-09-22T08:14:52.177853+0000","last_undegraded":"2024-09-22T08:14:52.177853+0000","last_fullsized":"2024-09-22T08:14:52.177853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:52.177773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:52.177773+0000","last_clean_scrub_stamp":"2024-09-22T08:14:52.177773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:51.750443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.216778+0000","last_change":"2024-09-22T08:10:53.199421+0000","last_active":"2024-09-22T08:11:23.216778+0000","last_peered":"2024-09-22T08:11:23.216778+0000","last_clean":"2024-09-22T08:11:23.216778+0000","last_became_active":"2024-09-22T08:10:53.199158+0000","last_became_peered":"2024-09-22T08:10:53.199158+0000","last_unstale":"2024-09-22T08:11:23.216778+0000","last_undegraded":"2024-09-22T08:11:23.216778+0000","last_fullsized":"2024-09-22T08:11:23.216778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:32.896582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.886211+0000","last_change":"2024-09-22T08:14:23.886211+0000","last_active":"2024-09-22T08:14:23.886211+0000","last_peered":"2024-09-22T08:14:23.886211+0000","last_clean":"2024-09-22T08:14:23.886211+0000","last_became_active":"2024-09-22T08:10:45.165116+0000","last_became_peered":"2024-09-22T08:10:45.165116+0000","last_unstale":"2024-09-22T08:14:23.886211+0000","last_undegraded":"2024-09-22T08:14:23.886211+0000","last_fullsized":"2024-09-22T08:14:23.886211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:23.886075+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:23.886075+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.886075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:31.053533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.266509+0000","last_change":"2024-09-22T08:14:21.266509+0000","last_active":"2024-09-22T08:14:21.266509+0000","last_peered":"2024-09-22T08:14:21.266509+0000","last_clean":"2024-09-22T08:14:21.266509+0000","last_became_active":"2024-09-22T08:10:43.201076+0000","last_became_peered":"2024-09-22T08:10:43.201076+0000","last_unstale":"2024-09-22T08:14:21.266509+0000","last_undegraded":"2024-09-22T08:14:21.266509+0000","last_fullsized":"2024-09-22T08:14:21.266509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:21.266407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:21.266407+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.266407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:15.619690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.961799+0000","last_change":"2024-09-22T08:14:35.961799+0000","last_active":"2024-09-22T08:14:35.961799+0000","last_peered":"2024-09-22T08:14:35.961799+0000","last_clean":"2024-09-22T08:14:35.961799+0000","last_became_active":"2024-09-22T08:10:47.172988+0000","last_became_peered":"2024-09-22T08:10:47.172988+0000","last_unstale":"2024-09-22T08:14:35.961799+0000","last_undegraded":"2024-09-22T08:14:35.961799+0000","last_fullsized":"2024-09-22T08:14:35.961799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:35.961689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:35.961689+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.961689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:47.596270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'38","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.073721+0000","last_change":"2024-09-22T08:14:42.073721+0000","last_active":"2024-09-22T08:14:42.073721+0000","last_peered":"2024-09-22T08:14:42.073721+0000","last_clean":"2024-09-22T08:14:42.073721+0000","last_became_active":"2024-09-22T08:10:49.184860+0000","last_became_peered":"2024-09-22T08:10:49.184860+0000","last_unstale":"2024-09-22T08:14:42.073721+0000","last_undegraded":"2024-09-22T08:14:42.073721+0000","last_fullsized":"2024-09-22T08:14:42.073721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-22T08:14:42.073617+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-22T08:14:42.073617+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.073617+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:51.308231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209254+0000","last_change":"2024-09-22T08:10:51.200556+0000","last_active":"2024-09-22T08:11:23.209254+0000","last_peered":"2024-09-22T08:11:23.209254+0000","last_clean":"2024-09-22T08:11:23.209254+0000","last_became_active":"2024-09-22T08:10:51.199870+0000","last_became_peered":"2024-09-22T08:10:51.199870+0000","last_unstale":"2024-09-22T08:11:23.209254+0000","last_undegraded":"2024-09-22T08:11:23.209254+0000","last_fullsized":"2024-09-22T08:11:23.209254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:14.684662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212091+0000","last_change":"2024-09-22T08:10:53.201219+0000","last_active":"2024-09-22T08:11:23.212091+0000","last_peered":"2024-09-22T08:11:23.212091+0000","last_clean":"2024-09-22T08:11:23.212091+0000","last_became_active":"2024-09-22T08:10:53.200904+0000","last_became_peered":"2024-09-22T08:10:53.200904+0000","last_unstale":"2024-09-22T08:11:23.212091+0000","last_undegraded":"2024-09-22T08:11:23.212091+0000","last_fullsized":"2024-09-22T08:11:23.212091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:58.296182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.113489+0000","last_change":"2024-09-22T08:14:41.113489+0000","last_active":"2024-09-22T08:14:41.113489+0000","last_peered":"2024-09-22T08:14:41.113489+0000","last_clean":"2024-09-22T08:14:41.113489+0000","last_became_active":"2024-09-22T08:10:45.165511+0000","last_became_peered":"2024-09-22T08:10:45.165511+0000","last_unstale":"2024-09-22T08:14:41.113489+0000","last_undegraded":"2024-09-22T08:14:41.113489+0000","last_fullsized":"2024-09-22T08:14:41.113489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:41.113388+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:41.113388+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.113388+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:08.634130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.982787+0000","last_change":"2024-09-22T08:14:05.982672+0000","last_active":"2024-09-22T08:14:05.982787+0000","last_peered":"2024-09-22T08:14:05.982787+0000","last_clean":"2024-09-22T08:14:05.982787+0000","last_became_active":"2024-09-22T08:10:43.176954+0000","last_became_peered":"2024-09-22T08:10:43.176954+0000","last_unstale":"2024-09-22T08:14:05.982787+0000","last_undegraded":"2024-09-22T08:14:05.982787+0000","last_fullsized":"2024-09-22T08:14:05.982787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.982575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.982575+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.982575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:15.153255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.835539+0000","last_change":"2024-09-22T08:14:41.835539+0000","last_active":"2024-09-22T08:14:41.835539+0000","last_peered":"2024-09-22T08:14:41.835539+0000","last_clean":"2024-09-22T08:14:41.835539+0000","last_became_active":"2024-09-22T08:10:47.176641+0000","last_became_peered":"2024-09-22T08:10:47.176641+0000","last_unstale":"2024-09-22T08:14:41.835539+0000","last_undegraded":"2024-09-22T08:14:41.835539+0000","last_fullsized":"2024-09-22T08:14:41.835539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:41.835433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:41.835433+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.835433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:24.123944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.878567+0000","last_change":"2024-09-22T08:10:49.188256+0000","last_active":"2024-09-22T08:13:59.878567+0000","last_peered":"2024-09-22T08:13:59.878567+0000","last_clean":"2024-09-22T08:13:59.878567+0000","last_became_active":"2024-09-22T08:10:49.187467+0000","last_became_peered":"2024-09-22T08:10:49.187467+0000","last_unstale":"2024-09-22T08:13:59.878567+0000","last_undegraded":"2024-09-22T08:13:59.878567+0000","last_fullsized":"2024-09-22T08:13:59.878567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:01:27.242973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.209400+0000","last_change":"2024-09-22T08:10:51.198209+0000","last_active":"2024-09-22T08:11:23.209400+0000","last_peered":"2024-09-22T08:11:23.209400+0000","last_clean":"2024-09-22T08:11:23.209400+0000","last_became_active":"2024-09-22T08:10:51.197942+0000","last_became_peered":"2024-09-22T08:10:51.197942+0000","last_unstale":"2024-09-22T08:11:23.209400+0000","last_undegraded":"2024-09-22T08:11:23.209400+0000","last_fullsized":"2024-09-22T08:11:23.209400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:42.833261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.573626+0000","last_change":"2024-09-22T08:10:53.204064+0000","last_active":"2024-09-22T08:12:52.573626+0000","last_peered":"2024-09-22T08:12:52.573626+0000","last_clean":"2024-09-22T08:12:52.573626+0000","last_became_active":"2024-09-22T08:10:53.203791+0000","last_became_peered":"2024-09-22T08:10:53.203791+0000","last_unstale":"2024-09-22T08:12:52.573626+0000","last_undegraded":"2024-09-22T08:12:52.573626+0000","last_fullsized":"2024-09-22T08:12:52.573626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:42.795444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.887707+0000","last_change":"2024-09-22T08:14:24.887707+0000","last_active":"2024-09-22T08:14:24.887707+0000","last_peered":"2024-09-22T08:14:24.887707+0000","last_clean":"2024-09-22T08:14:24.887707+0000","last_became_active":"2024-09-22T08:10:45.163402+0000","last_became_peered":"2024-09-22T08:10:45.163402+0000","last_unstale":"2024-09-22T08:14:24.887707+0000","last_undegraded":"2024-09-22T08:14:24.887707+0000","last_fullsized":"2024-09-22T08:14:24.887707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:24.887588+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:24.887588+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.887588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:50.926457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.746542+0000","last_change":"2024-09-22T08:14:09.746483+0000","last_active":"2024-09-22T08:14:09.746542+0000","last_peered":"2024-09-22T08:14:09.746542+0000","last_clean":"2024-09-22T08:14:09.746542+0000","last_became_active":"2024-09-22T08:10:43.184777+0000","last_became_peered":"2024-09-22T08:10:43.184777+0000","last_unstale":"2024-09-22T08:14:09.746542+0000","last_undegraded":"2024-09-22T08:14:09.746542+0000","last_fullsized":"2024-09-22T08:14:09.746542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:09.746395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:09.746395+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.746395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:20.482133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.848918+0000","last_change":"2024-09-22T08:14:42.848918+0000","last_active":"2024-09-22T08:14:42.848918+0000","last_peered":"2024-09-22T08:14:42.848918+0000","last_clean":"2024-09-22T08:14:42.848918+0000","last_became_active":"2024-09-22T08:10:47.176390+0000","last_became_peered":"2024-09-22T08:10:47.176390+0000","last_unstale":"2024-09-22T08:14:42.848918+0000","last_undegraded":"2024-09-22T08:14:42.848918+0000","last_fullsized":"2024-09-22T08:14:42.848918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:14:42.848840+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:14:42.848840+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.848840+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:48.212716+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'37","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:59.888257+0000","last_change":"2024-09-22T08:10:49.189639+0000","last_active":"2024-09-22T08:13:59.888257+0000","last_peered":"2024-09-22T08:13:59.888257+0000","last_clean":"2024-09-22T08:13:59.888257+0000","last_became_active":"2024-09-22T08:10:49.188231+0000","last_became_peered":"2024-09-22T08:10:49.188231+0000","last_unstale":"2024-09-22T08:13:59.888257+0000","last_undegraded":"2024-09-22T08:13:59.888257+0000","last_fullsized":"2024-09-22T08:13:59.888257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:48.162443+0000","last_clean_scrub_stamp":"2024-09-22T08:10:48.162443+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:08.360453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":46,"num_read_kb":60,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.221258+0000","last_change":"2024-09-22T08:10:51.202802+0000","last_active":"2024-09-22T08:11:23.221258+0000","last_peered":"2024-09-22T08:11:23.221258+0000","last_clean":"2024-09-22T08:11:23.221258+0000","last_became_active":"2024-09-22T08:10:51.202476+0000","last_became_peered":"2024-09-22T08:10:51.202476+0000","last_unstale":"2024-09-22T08:11:23.221258+0000","last_undegraded":"2024-09-22T08:11:23.221258+0000","last_fullsized":"2024-09-22T08:11:23.221258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:50.169427+0000","last_clean_scrub_stamp":"2024-09-22T08:10:50.169427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:10.977792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.161803+0000","last_change":"2024-09-22T08:10:53.201417+0000","last_active":"2024-09-22T08:12:51.161803+0000","last_peered":"2024-09-22T08:12:51.161803+0000","last_clean":"2024-09-22T08:12:51.161803+0000","last_became_active":"2024-09-22T08:10:53.201125+0000","last_became_peered":"2024-09-22T08:10:53.201125+0000","last_unstale":"2024-09-22T08:12:51.161803+0000","last_undegraded":"2024-09-22T08:12:51.161803+0000","last_fullsized":"2024-09-22T08:12:51.161803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:16.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.837624+0000","last_change":"2024-09-22T08:14:24.837624+0000","last_active":"2024-09-22T08:14:24.837624+0000","last_peered":"2024-09-22T08:14:24.837624+0000","last_clean":"2024-09-22T08:14:24.837624+0000","last_became_active":"2024-09-22T08:10:45.180781+0000","last_became_peered":"2024-09-22T08:10:45.180781+0000","last_unstale":"2024-09-22T08:14:24.837624+0000","last_undegraded":"2024-09-22T08:14:24.837624+0000","last_fullsized":"2024-09-22T08:14:24.837624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:24.837547+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:24.837547+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.837547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:21.114510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.826654+0000","last_change":"2024-09-22T08:14:13.826597+0000","last_active":"2024-09-22T08:14:13.826654+0000","last_peered":"2024-09-22T08:14:13.826654+0000","last_clean":"2024-09-22T08:14:13.826654+0000","last_became_active":"2024-09-22T08:10:43.179693+0000","last_became_peered":"2024-09-22T08:10:43.179693+0000","last_unstale":"2024-09-22T08:14:13.826654+0000","last_undegraded":"2024-09-22T08:14:13.826654+0000","last_fullsized":"2024-09-22T08:14:13.826654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:13.826510+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:13.826510+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.826510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:05.210216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'12","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.978947+0000","last_change":"2024-09-22T08:14:27.978947+0000","last_active":"2024-09-22T08:14:27.978947+0000","last_peered":"2024-09-22T08:14:27.978947+0000","last_clean":"2024-09-22T08:14:27.978947+0000","last_became_active":"2024-09-22T08:10:45.164406+0000","last_became_peered":"2024-09-22T08:10:45.164406+0000","last_unstale":"2024-09-22T08:14:27.978947+0000","last_undegraded":"2024-09-22T08:14:27.978947+0000","last_fullsized":"2024-09-22T08:14:27.978947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:27.978856+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:27.978856+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.978856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:45.929432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.893610+0000","last_change":"2024-09-22T08:14:09.893552+0000","last_active":"2024-09-22T08:14:09.893610+0000","last_peered":"2024-09-22T08:14:09.893610+0000","last_clean":"2024-09-22T08:14:09.893610+0000","last_became_active":"2024-09-22T08:10:43.178018+0000","last_became_peered":"2024-09-22T08:10:43.178018+0000","last_unstale":"2024-09-22T08:14:09.893610+0000","last_undegraded":"2024-09-22T08:14:09.893610+0000","last_fullsized":"2024-09-22T08:14:09.893610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:09.893443+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:09.893443+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.893443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:14.018138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.073922+0000","last_change":"2024-09-22T08:14:44.073922+0000","last_active":"2024-09-22T08:14:44.073922+0000","last_peered":"2024-09-22T08:14:44.073922+0000","last_clean":"2024-09-22T08:14:44.073922+0000","last_became_active":"2024-09-22T08:10:45.168526+0000","last_became_peered":"2024-09-22T08:10:45.168526+0000","last_unstale":"2024-09-22T08:14:44.073922+0000","last_undegraded":"2024-09-22T08:14:44.073922+0000","last_fullsized":"2024-09-22T08:14:44.073922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-22T08:14:44.073838+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-22T08:14:44.073838+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.073838+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:01.253414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":86,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.197189+0000","last_change":"2024-09-22T08:14:23.197132+0000","last_active":"2024-09-22T08:14:23.197189+0000","last_peered":"2024-09-22T08:14:23.197189+0000","last_clean":"2024-09-22T08:14:23.197189+0000","last_became_active":"2024-09-22T08:10:43.196221+0000","last_became_peered":"2024-09-22T08:10:43.196221+0000","last_unstale":"2024-09-22T08:14:23.197189+0000","last_undegraded":"2024-09-22T08:14:23.197189+0000","last_fullsized":"2024-09-22T08:14:23.197189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:23.197048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:23.197048+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.197048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:53.693927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.927351+0000","last_change":"2024-09-22T08:14:24.927351+0000","last_active":"2024-09-22T08:14:24.927351+0000","last_peered":"2024-09-22T08:14:24.927351+0000","last_clean":"2024-09-22T08:14:24.927351+0000","last_became_active":"2024-09-22T08:10:45.166432+0000","last_became_peered":"2024-09-22T08:10:45.166432+0000","last_unstale":"2024-09-22T08:14:24.927351+0000","last_undegraded":"2024-09-22T08:14:24.927351+0000","last_fullsized":"2024-09-22T08:14:24.927351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:24.927242+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:24.927242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.927242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:25.223688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.902076+0000","last_change":"2024-09-22T08:14:10.902014+0000","last_active":"2024-09-22T08:14:10.902076+0000","last_peered":"2024-09-22T08:14:10.902076+0000","last_clean":"2024-09-22T08:14:10.902076+0000","last_became_active":"2024-09-22T08:10:43.177673+0000","last_became_peered":"2024-09-22T08:10:43.177673+0000","last_unstale":"2024-09-22T08:14:10.902076+0000","last_undegraded":"2024-09-22T08:14:10.902076+0000","last_fullsized":"2024-09-22T08:14:10.902076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:10.901926+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:10.901926+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.901926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:49.460312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.933843+0000","last_change":"2024-09-22T08:14:26.933779+0000","last_active":"2024-09-22T08:14:26.933843+0000","last_peered":"2024-09-22T08:14:26.933843+0000","last_clean":"2024-09-22T08:14:26.933843+0000","last_became_active":"2024-09-22T08:10:45.171476+0000","last_became_peered":"2024-09-22T08:10:45.171476+0000","last_unstale":"2024-09-22T08:14:26.933843+0000","last_undegraded":"2024-09-22T08:14:26.933843+0000","last_fullsized":"2024-09-22T08:14:26.933843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:26.933687+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:26.933687+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.933687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:15.758235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.868565+0000","last_change":"2024-09-22T08:14:11.868565+0000","last_active":"2024-09-22T08:14:11.868565+0000","last_peered":"2024-09-22T08:14:11.868565+0000","last_clean":"2024-09-22T08:14:11.868565+0000","last_became_active":"2024-09-22T08:10:43.186671+0000","last_became_peered":"2024-09-22T08:10:43.186671+0000","last_unstale":"2024-09-22T08:14:11.868565+0000","last_undegraded":"2024-09-22T08:14:11.868565+0000","last_fullsized":"2024-09-22T08:14:11.868565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:11.868472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:11.868472+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.868472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:04.057150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.851369+0000","last_change":"2024-09-22T08:14:23.851300+0000","last_active":"2024-09-22T08:14:23.851369+0000","last_peered":"2024-09-22T08:14:23.851369+0000","last_clean":"2024-09-22T08:14:23.851369+0000","last_became_active":"2024-09-22T08:10:45.182785+0000","last_became_peered":"2024-09-22T08:10:45.182785+0000","last_unstale":"2024-09-22T08:14:23.851369+0000","last_undegraded":"2024-09-22T08:14:23.851369+0000","last_fullsized":"2024-09-22T08:14:23.851369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:23.851213+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:23.851213+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.851213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:29.971199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.814747+0000","last_change":"2024-09-22T08:14:11.814682+0000","last_active":"2024-09-22T08:14:11.814747+0000","last_peered":"2024-09-22T08:14:11.814747+0000","last_clean":"2024-09-22T08:14:11.814747+0000","last_became_active":"2024-09-22T08:10:43.182824+0000","last_became_peered":"2024-09-22T08:10:43.182824+0000","last_unstale":"2024-09-22T08:14:11.814747+0000","last_undegraded":"2024-09-22T08:14:11.814747+0000","last_fullsized":"2024-09-22T08:14:11.814747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:11.814594+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:11.814594+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.814594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:06.053818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'26","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.938771+0000","last_change":"2024-09-22T08:14:23.938699+0000","last_active":"2024-09-22T08:14:23.938771+0000","last_peered":"2024-09-22T08:14:23.938771+0000","last_clean":"2024-09-22T08:14:23.938771+0000","last_became_active":"2024-09-22T08:10:45.175600+0000","last_became_peered":"2024-09-22T08:10:45.175600+0000","last_unstale":"2024-09-22T08:14:23.938771+0000","last_undegraded":"2024-09-22T08:14:23.938771+0000","last_fullsized":"2024-09-22T08:14:23.938771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-22T08:14:23.938616+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-22T08:14:23.938616+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.938616+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:29.442181+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.753854+0000","last_change":"2024-09-22T08:14:11.753775+0000","last_active":"2024-09-22T08:14:11.753854+0000","last_peered":"2024-09-22T08:14:11.753854+0000","last_clean":"2024-09-22T08:14:11.753854+0000","last_became_active":"2024-09-22T08:10:43.179529+0000","last_became_peered":"2024-09-22T08:10:43.179529+0000","last_unstale":"2024-09-22T08:14:11.753854+0000","last_undegraded":"2024-09-22T08:14:11.753854+0000","last_fullsized":"2024-09-22T08:14:11.753854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:11.753682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:11.753682+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.753682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:24.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.798396+0000","last_change":"2024-09-22T08:14:25.798299+0000","last_active":"2024-09-22T08:14:25.798396+0000","last_peered":"2024-09-22T08:14:25.798396+0000","last_clean":"2024-09-22T08:14:25.798396+0000","last_became_active":"2024-09-22T08:10:45.183901+0000","last_became_peered":"2024-09-22T08:10:45.183901+0000","last_unstale":"2024-09-22T08:14:25.798396+0000","last_undegraded":"2024-09-22T08:14:25.798396+0000","last_fullsized":"2024-09-22T08:14:25.798396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:25.798179+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:25.798179+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.798179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:32.525584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.880179+0000","last_change":"2024-09-22T08:14:12.880179+0000","last_active":"2024-09-22T08:14:12.880179+0000","last_peered":"2024-09-22T08:14:12.880179+0000","last_clean":"2024-09-22T08:14:12.880179+0000","last_became_active":"2024-09-22T08:10:43.177461+0000","last_became_peered":"2024-09-22T08:10:43.177461+0000","last_unstale":"2024-09-22T08:14:12.880179+0000","last_undegraded":"2024-09-22T08:14:12.880179+0000","last_fullsized":"2024-09-22T08:14:12.880179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:12.880088+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:12.880088+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.880088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:57.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'14","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.796120+0000","last_change":"2024-09-22T08:14:28.796120+0000","last_active":"2024-09-22T08:14:28.796120+0000","last_peered":"2024-09-22T08:14:28.796120+0000","last_clean":"2024-09-22T08:14:28.796120+0000","last_became_active":"2024-09-22T08:10:45.169723+0000","last_became_peered":"2024-09-22T08:10:45.169723+0000","last_unstale":"2024-09-22T08:14:28.796120+0000","last_undegraded":"2024-09-22T08:14:28.796120+0000","last_fullsized":"2024-09-22T08:14:28.796120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:28.796011+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:28.796011+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.796011+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:40.829249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.234157+0000","last_change":"2024-09-22T08:14:22.234089+0000","last_active":"2024-09-22T08:14:22.234157+0000","last_peered":"2024-09-22T08:14:22.234157+0000","last_clean":"2024-09-22T08:14:22.234157+0000","last_became_active":"2024-09-22T08:10:43.195587+0000","last_became_peered":"2024-09-22T08:10:43.195587+0000","last_unstale":"2024-09-22T08:14:22.234157+0000","last_undegraded":"2024-09-22T08:14:22.234157+0000","last_fullsized":"2024-09-22T08:14:22.234157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:22.234003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:22.234003+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.234003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:20.685742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.026749+0000","last_change":"2024-09-22T08:14:45.026749+0000","last_active":"2024-09-22T08:14:45.026749+0000","last_peered":"2024-09-22T08:14:45.026749+0000","last_clean":"2024-09-22T08:14:45.026749+0000","last_became_active":"2024-09-22T08:10:45.169366+0000","last_became_peered":"2024-09-22T08:10:45.169366+0000","last_unstale":"2024-09-22T08:14:45.026749+0000","last_undegraded":"2024-09-22T08:14:45.026749+0000","last_fullsized":"2024-09-22T08:14:45.026749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:45.026672+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:45.026672+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.026672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:07.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.867652+0000","last_change":"2024-09-22T08:14:13.867652+0000","last_active":"2024-09-22T08:14:13.867652+0000","last_peered":"2024-09-22T08:14:13.867652+0000","last_clean":"2024-09-22T08:14:13.867652+0000","last_became_active":"2024-09-22T08:10:43.187246+0000","last_became_peered":"2024-09-22T08:10:43.187246+0000","last_unstale":"2024-09-22T08:14:13.867652+0000","last_undegraded":"2024-09-22T08:14:13.867652+0000","last_fullsized":"2024-09-22T08:14:13.867652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:13.867567+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:13.867567+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.867567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:08.637420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.014166+0000","last_change":"2024-09-22T08:14:30.014166+0000","last_active":"2024-09-22T08:14:30.014166+0000","last_peered":"2024-09-22T08:14:30.014166+0000","last_clean":"2024-09-22T08:14:30.014166+0000","last_became_active":"2024-09-22T08:10:45.172080+0000","last_became_peered":"2024-09-22T08:10:45.172080+0000","last_unstale":"2024-09-22T08:14:30.014166+0000","last_undegraded":"2024-09-22T08:14:30.014166+0000","last_fullsized":"2024-09-22T08:14:30.014166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:30.014084+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:30.014084+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.014084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:11.302015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.765941+0000","last_change":"2024-09-22T08:14:14.765941+0000","last_active":"2024-09-22T08:14:14.765941+0000","last_peered":"2024-09-22T08:14:14.765941+0000","last_clean":"2024-09-22T08:14:14.765941+0000","last_became_active":"2024-09-22T08:10:43.178924+0000","last_became_peered":"2024-09-22T08:10:43.178924+0000","last_unstale":"2024-09-22T08:14:14.765941+0000","last_undegraded":"2024-09-22T08:14:14.765941+0000","last_fullsized":"2024-09-22T08:14:14.765941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:14.765846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:14.765846+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.765846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:42.012438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'16","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.826514+0000","last_change":"2024-09-22T08:14:30.826514+0000","last_active":"2024-09-22T08:14:30.826514+0000","last_peered":"2024-09-22T08:14:30.826514+0000","last_clean":"2024-09-22T08:14:30.826514+0000","last_became_active":"2024-09-22T08:10:45.172101+0000","last_became_peered":"2024-09-22T08:10:45.172101+0000","last_unstale":"2024-09-22T08:14:30.826514+0000","last_undegraded":"2024-09-22T08:14:30.826514+0000","last_fullsized":"2024-09-22T08:14:30.826514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-22T08:14:30.826439+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-22T08:14:30.826439+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.826439+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:48.777015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.756790+0000","last_change":"2024-09-22T08:14:13.756790+0000","last_active":"2024-09-22T08:14:13.756790+0000","last_peered":"2024-09-22T08:14:13.756790+0000","last_clean":"2024-09-22T08:14:13.756790+0000","last_became_active":"2024-09-22T08:10:43.178876+0000","last_became_peered":"2024-09-22T08:10:43.178876+0000","last_unstale":"2024-09-22T08:14:13.756790+0000","last_undegraded":"2024-09-22T08:14:13.756790+0000","last_fullsized":"2024-09-22T08:14:13.756790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:13.756688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:13.756688+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.756688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:05.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.790763+0000","last_change":"2024-09-22T08:14:27.790763+0000","last_active":"2024-09-22T08:14:27.790763+0000","last_peered":"2024-09-22T08:14:27.790763+0000","last_clean":"2024-09-22T08:14:27.790763+0000","last_became_active":"2024-09-22T08:10:45.180117+0000","last_became_peered":"2024-09-22T08:10:45.180117+0000","last_unstale":"2024-09-22T08:14:27.790763+0000","last_undegraded":"2024-09-22T08:14:27.790763+0000","last_fullsized":"2024-09-22T08:14:27.790763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:27.790679+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:27.790679+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.790679+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:28.087125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.212034+0000","last_change":"2024-09-22T08:14:24.212034+0000","last_active":"2024-09-22T08:14:24.212034+0000","last_peered":"2024-09-22T08:14:24.212034+0000","last_clean":"2024-09-22T08:14:24.212034+0000","last_became_active":"2024-09-22T08:10:43.195770+0000","last_became_peered":"2024-09-22T08:10:43.195770+0000","last_unstale":"2024-09-22T08:14:24.212034+0000","last_undegraded":"2024-09-22T08:14:24.212034+0000","last_fullsized":"2024-09-22T08:14:24.212034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:24.211938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:24.211938+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.211938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:35.988551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.741067+0000","last_change":"2024-09-22T08:14:33.741067+0000","last_active":"2024-09-22T08:14:33.741067+0000","last_peered":"2024-09-22T08:14:33.741067+0000","last_clean":"2024-09-22T08:14:33.741067+0000","last_became_active":"2024-09-22T08:10:45.180098+0000","last_became_peered":"2024-09-22T08:10:45.180098+0000","last_unstale":"2024-09-22T08:14:33.741067+0000","last_undegraded":"2024-09-22T08:14:33.741067+0000","last_fullsized":"2024-09-22T08:14:33.741067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:33.740986+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:33.740986+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.740986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:54.421474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.262115+0000","last_change":"2024-09-22T08:14:25.262115+0000","last_active":"2024-09-22T08:14:25.262115+0000","last_peered":"2024-09-22T08:14:25.262115+0000","last_clean":"2024-09-22T08:14:25.262115+0000","last_became_active":"2024-09-22T08:10:43.201687+0000","last_became_peered":"2024-09-22T08:10:43.201687+0000","last_unstale":"2024-09-22T08:14:25.262115+0000","last_undegraded":"2024-09-22T08:14:25.262115+0000","last_fullsized":"2024-09-22T08:14:25.262115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:25.262020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:25.262020+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.262020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:12.187326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.929258+0000","last_change":"2024-09-22T08:14:26.929258+0000","last_active":"2024-09-22T08:14:26.929258+0000","last_peered":"2024-09-22T08:14:26.929258+0000","last_clean":"2024-09-22T08:14:26.929258+0000","last_became_active":"2024-09-22T08:11:23.215110+0000","last_became_peered":"2024-09-22T08:11:23.215110+0000","last_unstale":"2024-09-22T08:14:26.929258+0000","last_undegraded":"2024-09-22T08:14:26.929258+0000","last_fullsized":"2024-09-22T08:14:26.929258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:26.929163+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:26.929163+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.929163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:29.392032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.790672+0000","last_change":"2024-09-22T08:14:12.790672+0000","last_active":"2024-09-22T08:14:12.790672+0000","last_peered":"2024-09-22T08:14:12.790672+0000","last_clean":"2024-09-22T08:14:12.790672+0000","last_became_active":"2024-09-22T08:10:43.187195+0000","last_became_peered":"2024-09-22T08:10:43.187195+0000","last_unstale":"2024-09-22T08:14:12.790672+0000","last_undegraded":"2024-09-22T08:14:12.790672+0000","last_fullsized":"2024-09-22T08:14:12.790672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:12.790570+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:12.790570+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.790570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:57.729020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.829887+0000","last_change":"2024-09-22T08:14:26.829887+0000","last_active":"2024-09-22T08:14:26.829887+0000","last_peered":"2024-09-22T08:14:26.829887+0000","last_clean":"2024-09-22T08:14:26.829887+0000","last_became_active":"2024-09-22T08:10:45.179150+0000","last_became_peered":"2024-09-22T08:10:45.179150+0000","last_unstale":"2024-09-22T08:14:26.829887+0000","last_undegraded":"2024-09-22T08:14:26.829887+0000","last_fullsized":"2024-09-22T08:14:26.829887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:26.829765+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:26.829765+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.829765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:32.333330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.213227+0000","last_change":"2024-09-22T08:14:26.213227+0000","last_active":"2024-09-22T08:14:26.213227+0000","last_peered":"2024-09-22T08:14:26.213227+0000","last_clean":"2024-09-22T08:14:26.213227+0000","last_became_active":"2024-09-22T08:10:43.200282+0000","last_became_peered":"2024-09-22T08:10:43.200282+0000","last_unstale":"2024-09-22T08:14:26.213227+0000","last_undegraded":"2024-09-22T08:14:26.213227+0000","last_fullsized":"2024-09-22T08:14:26.213227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:26.213130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:26.213130+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.213130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:57.522386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.216341+0000","last_change":"2024-09-22T08:14:27.216341+0000","last_active":"2024-09-22T08:14:27.216341+0000","last_peered":"2024-09-22T08:14:27.216341+0000","last_clean":"2024-09-22T08:14:27.216341+0000","last_became_active":"2024-09-22T08:10:43.189848+0000","last_became_peered":"2024-09-22T08:10:43.189848+0000","last_unstale":"2024-09-22T08:14:27.216341+0000","last_undegraded":"2024-09-22T08:14:27.216341+0000","last_fullsized":"2024-09-22T08:14:27.216341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:27.216242+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:27.216242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.216242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:35.518662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.009987+0000","last_change":"2024-09-22T08:14:31.009987+0000","last_active":"2024-09-22T08:14:31.009987+0000","last_peered":"2024-09-22T08:14:31.009987+0000","last_clean":"2024-09-22T08:14:31.009987+0000","last_became_active":"2024-09-22T08:10:45.183407+0000","last_became_peered":"2024-09-22T08:10:45.183407+0000","last_unstale":"2024-09-22T08:14:31.009987+0000","last_undegraded":"2024-09-22T08:14:31.009987+0000","last_fullsized":"2024-09-22T08:14:31.009987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:31.009901+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:31.009901+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.009901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:51.690389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.836700+0000","last_change":"2024-09-22T08:14:14.836700+0000","last_active":"2024-09-22T08:14:14.836700+0000","last_peered":"2024-09-22T08:14:14.836700+0000","last_clean":"2024-09-22T08:14:14.836700+0000","last_became_active":"2024-09-22T08:10:43.187119+0000","last_became_peered":"2024-09-22T08:10:43.187119+0000","last_unstale":"2024-09-22T08:14:14.836700+0000","last_undegraded":"2024-09-22T08:14:14.836700+0000","last_fullsized":"2024-09-22T08:14:14.836700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:14.836597+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:14.836597+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.836597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:22.845650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.769697+0000","last_change":"2024-09-22T08:14:32.769697+0000","last_active":"2024-09-22T08:14:32.769697+0000","last_peered":"2024-09-22T08:14:32.769697+0000","last_clean":"2024-09-22T08:14:32.769697+0000","last_became_active":"2024-09-22T08:11:23.218693+0000","last_became_peered":"2024-09-22T08:11:23.218693+0000","last_unstale":"2024-09-22T08:14:32.769697+0000","last_undegraded":"2024-09-22T08:14:32.769697+0000","last_fullsized":"2024-09-22T08:14:32.769697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:32.769617+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:32.769617+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.769617+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:14.057548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1515,"ondisk_log_size":1515,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673019,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":741411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673019,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1036288,"data_stored":742099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":446464,"data_stored":152009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:15:05.681 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.681 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.682 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.682 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.682 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.682 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.683 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.683 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.683 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.683 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.683 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.684 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.684 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.684 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.684 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.685 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.685 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.685 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.685 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.686 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.686 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.686 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.686 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.686 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.687 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.687 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.687 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.687 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.687 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.687 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.687 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:10:48.162443+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=48, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.687 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:10:50.169427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=50, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.688 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:05.688 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:15:25.689 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:15:25.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.803+0000 7fbc8c670640 1 Processor -- start 2024-09-22T08:15:25.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.803+0000 7fbc8c670640 1 -- start start 2024-09-22T08:15:25.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.804+0000 7fbc8c670640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc8406e8e0 0x7fbc8406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:25.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.804+0000 7fbc8c670640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc8406ff50 con 0x7fbc8406f200 2024-09-22T08:15:25.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.804+0000 7fbc8c670640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbc84099c10 con 0x7fbc8406e8e0 2024-09-22T08:15:25.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.804+0000 7fbc8a40c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc8406e8e0 0x7fbc8406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:25.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.804+0000 7fbc89c0b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbc8406f200 0x7fbc8412f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53016/0 (socket says 172.21.15.53:53016) 2024-09-22T08:15:25.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.804+0000 7fbc89c0b640 1 -- 172.21.15.53:0/1831576611 learned_addr learned my addr 172.21.15.53:0/1831576611 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:15:25.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.804+0000 7fbc8a40c640 1 -- 172.21.15.53:0/1831576611 >> v1:172.21.15.53:6789/0 conn(0x7fbc8406f200 legacy=0x7fbc8412f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:25.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.805+0000 7fbc8a40c640 1 -- 172.21.15.53:0/1831576611 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc84099710 con 0x7fbc8406e8e0 2024-09-22T08:15:25.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.805+0000 7fbc8a40c640 1 --2- 172.21.15.53:0/1831576611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 0x7fbc8406ecc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009720 tx=0x7fbc8002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21bcb40350d4462 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:25.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.805+0000 7fbc8940a640 1 -- 172.21.15.53:0/1831576611 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc80037070 con 0x7fbc8406e8e0 2024-09-22T08:15:25.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.805+0000 7fbc8940a640 1 -- 172.21.15.53:0/1831576611 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc8002ae20 con 0x7fbc8406e8e0 2024-09-22T08:15:25.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.805+0000 7fbc8940a640 1 -- 172.21.15.53:0/1831576611 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc80032590 con 0x7fbc8406e8e0 2024-09-22T08:15:25.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.806+0000 7fbc8c670640 1 -- 172.21.15.53:0/1831576611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 msgr2=0x7fbc8406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:25.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.806+0000 7fbc8c670640 1 --2- 172.21.15.53:0/1831576611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 0x7fbc8406ecc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009720 tx=0x7fbc8002a1a0 comp rx=0 tx=0).stop 2024-09-22T08:15:25.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.806+0000 7fbc8c670640 1 -- 172.21.15.53:0/1831576611 shutdown_connections 2024-09-22T08:15:25.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.806+0000 7fbc8c670640 1 --2- 172.21.15.53:0/1831576611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 0x7fbc8406ecc0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:25.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.806+0000 7fbc8c670640 1 -- 172.21.15.53:0/1831576611 >> 172.21.15.53:0/1831576611 conn(0x7fbc840a01c0 msgr2=0x7fbc840a05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:15:25.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.806+0000 7fbc8c670640 1 -- 172.21.15.53:0/1831576611 shutdown_connections 2024-09-22T08:15:25.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.806+0000 7fbc8c670640 1 -- 172.21.15.53:0/1831576611 wait complete. 2024-09-22T08:15:25.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.807+0000 7fbc8c670640 1 Processor -- start 2024-09-22T08:15:25.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.807+0000 7fbc8c670640 1 -- start start 2024-09-22T08:15:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.807+0000 7fbc8c670640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 0x7fbc841c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.807+0000 7fbc8c670640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbc841300f0 con 0x7fbc8406e8e0 2024-09-22T08:15:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.807+0000 7fbc8a40c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 0x7fbc841c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.808+0000 7fbc8a40c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 0x7fbc841c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35160/0 (socket says 172.21.15.53:35160) 2024-09-22T08:15:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.808+0000 7fbc8a40c640 1 -- 172.21.15.53:0/3749313406 learned_addr learned my addr 172.21.15.53:0/3749313406 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:15:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.808+0000 7fbc8a40c640 1 -- 172.21.15.53:0/3749313406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8408ea60 con 0x7fbc8406e8e0 2024-09-22T08:15:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.808+0000 7fbc8a40c640 1 --2- 172.21.15.53:0/3749313406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 0x7fbc841c4780 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbc8002a1e0 tx=0x7fbc800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.808+0000 7fbc7affd640 1 -- 172.21.15.53:0/3749313406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc80042070 con 0x7fbc8406e8e0 2024-09-22T08:15:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.808+0000 7fbc7affd640 1 -- 172.21.15.53:0/3749313406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc8003e590 con 0x7fbc8406e8e0 2024-09-22T08:15:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.808+0000 7fbc8c670640 1 -- 172.21.15.53:0/3749313406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8408f4b0 con 0x7fbc8406e8e0 2024-09-22T08:15:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.808+0000 7fbc7affd640 1 -- 172.21.15.53:0/3749313406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc80037040 con 0x7fbc8406e8e0 2024-09-22T08:15:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.808+0000 7fbc8c670640 1 -- 172.21.15.53:0/3749313406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc841c4ea0 con 0x7fbc8406e8e0 2024-09-22T08:15:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.809+0000 7fbc7affd640 1 -- 172.21.15.53:0/3749313406 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbc80045070 con 0x7fbc8406e8e0 2024-09-22T08:15:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.809+0000 7fbc7affd640 1 --2- 172.21.15.53:0/3749313406 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbc6803e740 0x7fbc68040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.809+0000 7fbc8c670640 1 -- 172.21.15.53:0/3749313406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc8408e380 con 0x7fbc8406e8e0 2024-09-22T08:15:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.809+0000 7fbc7affd640 1 -- 172.21.15.53:0/3749313406 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbc80074300 con 0x7fbc8406e8e0 2024-09-22T08:15:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.810+0000 7fbc89c0b640 1 --2- 172.21.15.53:0/3749313406 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbc6803e740 0x7fbc68040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.810+0000 7fbc89c0b640 1 --2- 172.21.15.53:0/3749313406 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbc6803e740 0x7fbc68040c00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbc74007fd0 tx=0x7fbc74007aa0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:25.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.814+0000 7fbc7affd640 1 -- 172.21.15.53:0/3749313406 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbc8003c430 con 0x7fbc8406e8e0 2024-09-22T08:15:25.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:25.998+0000 7fbc8c670640 1 -- 172.21.15.53:0/3749313406 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc84129f90 con 0x7fbc6803e740 2024-09-22T08:15:26.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.009+0000 7fbc7affd640 1 -- 172.21.15.53:0/3749313406 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666367 (secure 0 0 0) 0x7fbc740058b0 con 0x7fbc6803e740 2024-09-22T08:15:26.016 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:15:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:15:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.014+0000 7fbc8c670640 1 -- 172.21.15.53:0/3749313406 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbc6803e740 msgr2=0x7fbc68040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.014+0000 7fbc8c670640 1 --2- 172.21.15.53:0/3749313406 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbc6803e740 0x7fbc68040c00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbc74007fd0 tx=0x7fbc74007aa0 comp rx=0 tx=0).stop 2024-09-22T08:15:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.014+0000 7fbc8c670640 1 -- 172.21.15.53:0/3749313406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 msgr2=0x7fbc841c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.014+0000 7fbc8c670640 1 --2- 172.21.15.53:0/3749313406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 0x7fbc841c4780 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbc8002a1e0 tx=0x7fbc800046c0 comp rx=0 tx=0).stop 2024-09-22T08:15:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.014+0000 7fbc8c670640 1 -- 172.21.15.53:0/3749313406 shutdown_connections 2024-09-22T08:15:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.014+0000 7fbc8c670640 1 --2- 172.21.15.53:0/3749313406 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7fbc6803e740 0x7fbc68040c00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.014+0000 7fbc8c670640 1 --2- 172.21.15.53:0/3749313406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc8406e8e0 0x7fbc841c4780 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.014+0000 7fbc8c670640 1 -- 172.21.15.53:0/3749313406 >> 172.21.15.53:0/3749313406 conn(0x7fbc840a01c0 msgr2=0x7fbc8409dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:15:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.014+0000 7fbc8c670640 1 -- 172.21.15.53:0/3749313406 shutdown_connections 2024-09-22T08:15:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:26.014+0000 7fbc8c670640 1 -- 172.21.15.53:0/3749313406 wait complete. 2024-09-22T08:15:26.025 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-22T08:15:25.661918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5179,"num_read_kb":4721,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4784,"ondisk_log_size":4784,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156768,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330592,"statfs":{"total":386547056640,"available":386386526208,"internally_reserved":0,"allocated":2981888,"data_stored":1788188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004278"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.888353+0000","last_change":"2024-09-22T08:14:16.888299+0000","last_active":"2024-09-22T08:14:16.888353+0000","last_peered":"2024-09-22T08:14:16.888353+0000","last_clean":"2024-09-22T08:14:16.888353+0000","last_became_active":"2024-09-22T08:10:43.174489+0000","last_became_peered":"2024-09-22T08:10:43.174489+0000","last_unstale":"2024-09-22T08:14:16.888353+0000","last_undegraded":"2024-09-22T08:14:16.888353+0000","last_fullsized":"2024-09-22T08:14:16.888353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:16.888214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:16.888214+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.888214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:50.430915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.772962+0000","last_change":"2024-09-22T08:14:35.772962+0000","last_active":"2024-09-22T08:14:35.772962+0000","last_peered":"2024-09-22T08:14:35.772962+0000","last_clean":"2024-09-22T08:14:35.772962+0000","last_became_active":"2024-09-22T08:10:45.179969+0000","last_became_peered":"2024-09-22T08:10:45.179969+0000","last_unstale":"2024-09-22T08:14:35.772962+0000","last_undegraded":"2024-09-22T08:14:35.772962+0000","last_fullsized":"2024-09-22T08:14:35.772962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:35.772871+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:35.772871+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.772871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:40.663120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.854875+0000","last_change":"2024-09-22T08:14:17.854808+0000","last_active":"2024-09-22T08:14:17.854875+0000","last_peered":"2024-09-22T08:14:17.854875+0000","last_clean":"2024-09-22T08:14:17.854875+0000","last_became_active":"2024-09-22T08:10:43.187128+0000","last_became_peered":"2024-09-22T08:10:43.187128+0000","last_unstale":"2024-09-22T08:14:17.854875+0000","last_undegraded":"2024-09-22T08:14:17.854875+0000","last_fullsized":"2024-09-22T08:14:17.854875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.854715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.854715+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.854715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:57.247272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.994355+0000","last_change":"2024-09-22T08:14:45.994355+0000","last_active":"2024-09-22T08:14:45.994355+0000","last_peered":"2024-09-22T08:14:45.994355+0000","last_clean":"2024-09-22T08:14:45.994355+0000","last_became_active":"2024-09-22T08:10:45.169768+0000","last_became_peered":"2024-09-22T08:10:45.169768+0000","last_unstale":"2024-09-22T08:14:45.994355+0000","last_undegraded":"2024-09-22T08:14:45.994355+0000","last_fullsized":"2024-09-22T08:14:45.994355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:45.994266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:45.994266+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.994266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:43.216896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.201078+0000","last_change":"2024-09-22T08:14:31.201010+0000","last_active":"2024-09-22T08:14:31.201078+0000","last_peered":"2024-09-22T08:14:31.201078+0000","last_clean":"2024-09-22T08:14:31.201078+0000","last_became_active":"2024-09-22T08:10:43.200436+0000","last_became_peered":"2024-09-22T08:10:43.200436+0000","last_unstale":"2024-09-22T08:14:31.201078+0000","last_undegraded":"2024-09-22T08:14:31.201078+0000","last_fullsized":"2024-09-22T08:14:31.201078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.200921+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.200921+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.200921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:27.278821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.014314+0000","last_change":"2024-09-22T08:14:48.014314+0000","last_active":"2024-09-22T08:14:48.014314+0000","last_peered":"2024-09-22T08:14:48.014314+0000","last_clean":"2024-09-22T08:14:48.014314+0000","last_became_active":"2024-09-22T08:10:45.169110+0000","last_became_peered":"2024-09-22T08:10:45.169110+0000","last_unstale":"2024-09-22T08:14:48.014314+0000","last_undegraded":"2024-09-22T08:14:48.014314+0000","last_fullsized":"2024-09-22T08:14:48.014314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:48.014208+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:48.014208+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.014208+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:55.791447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.842269+0000","last_change":"2024-09-22T08:14:15.842211+0000","last_active":"2024-09-22T08:14:15.842269+0000","last_peered":"2024-09-22T08:14:15.842269+0000","last_clean":"2024-09-22T08:14:15.842269+0000","last_became_active":"2024-09-22T08:10:43.180088+0000","last_became_peered":"2024-09-22T08:10:43.180088+0000","last_unstale":"2024-09-22T08:14:15.842269+0000","last_undegraded":"2024-09-22T08:14:15.842269+0000","last_fullsized":"2024-09-22T08:14:15.842269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:15.842123+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:15.842123+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.842123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:45.525671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.022431+0000","last_change":"2024-09-22T08:14:32.022431+0000","last_active":"2024-09-22T08:14:32.022431+0000","last_peered":"2024-09-22T08:14:32.022431+0000","last_clean":"2024-09-22T08:14:32.022431+0000","last_became_active":"2024-09-22T08:11:23.220081+0000","last_became_peered":"2024-09-22T08:11:23.220081+0000","last_unstale":"2024-09-22T08:14:32.022431+0000","last_undegraded":"2024-09-22T08:14:32.022431+0000","last_fullsized":"2024-09-22T08:14:32.022431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:32.022345+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:32.022345+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.022345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:29.472018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.226178+0000","last_change":"2024-09-22T08:14:30.226178+0000","last_active":"2024-09-22T08:14:30.226178+0000","last_peered":"2024-09-22T08:14:30.226178+0000","last_clean":"2024-09-22T08:14:30.226178+0000","last_became_active":"2024-09-22T08:10:43.200013+0000","last_became_peered":"2024-09-22T08:10:43.200013+0000","last_unstale":"2024-09-22T08:14:30.226178+0000","last_undegraded":"2024-09-22T08:14:30.226178+0000","last_fullsized":"2024-09-22T08:14:30.226178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:30.226084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:30.226084+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.226084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:55.632963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.722868+0000","last_change":"2024-09-22T08:14:34.722804+0000","last_active":"2024-09-22T08:14:34.722868+0000","last_peered":"2024-09-22T08:14:34.722868+0000","last_clean":"2024-09-22T08:14:34.722868+0000","last_became_active":"2024-09-22T08:10:45.176491+0000","last_became_peered":"2024-09-22T08:10:45.176491+0000","last_unstale":"2024-09-22T08:14:34.722868+0000","last_undegraded":"2024-09-22T08:14:34.722868+0000","last_fullsized":"2024-09-22T08:14:34.722868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:34.722708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:34.722708+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.722708+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:38.943762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.876908+0000","last_change":"2024-09-22T08:14:17.876908+0000","last_active":"2024-09-22T08:14:17.876908+0000","last_peered":"2024-09-22T08:14:17.876908+0000","last_clean":"2024-09-22T08:14:17.876908+0000","last_became_active":"2024-09-22T08:10:43.172330+0000","last_became_peered":"2024-09-22T08:10:43.172330+0000","last_unstale":"2024-09-22T08:14:17.876908+0000","last_undegraded":"2024-09-22T08:14:17.876908+0000","last_fullsized":"2024-09-22T08:14:17.876908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.876812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.876812+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.876812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:40.745057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:50.044313+0000","last_change":"2024-09-22T08:14:50.044221+0000","last_active":"2024-09-22T08:14:50.044313+0000","last_peered":"2024-09-22T08:14:50.044313+0000","last_clean":"2024-09-22T08:14:50.044313+0000","last_became_active":"2024-09-22T08:10:45.175775+0000","last_became_peered":"2024-09-22T08:10:45.175775+0000","last_unstale":"2024-09-22T08:14:50.044313+0000","last_undegraded":"2024-09-22T08:14:50.044313+0000","last_fullsized":"2024-09-22T08:14:50.044313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:50.044107+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:50.044107+0000","last_clean_scrub_stamp":"2024-09-22T08:14:50.044107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:02.834856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.213597+0000","last_change":"2024-09-22T08:14:28.213597+0000","last_active":"2024-09-22T08:14:28.213597+0000","last_peered":"2024-09-22T08:14:28.213597+0000","last_clean":"2024-09-22T08:14:28.213597+0000","last_became_active":"2024-09-22T08:10:43.187858+0000","last_became_peered":"2024-09-22T08:10:43.187858+0000","last_unstale":"2024-09-22T08:14:28.213597+0000","last_undegraded":"2024-09-22T08:14:28.213597+0000","last_fullsized":"2024-09-22T08:14:28.213597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:28.213514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:28.213514+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.213514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:21.439787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.960016+0000","last_change":"2024-09-22T08:14:28.959963+0000","last_active":"2024-09-22T08:14:28.960016+0000","last_peered":"2024-09-22T08:14:28.960016+0000","last_clean":"2024-09-22T08:14:28.960016+0000","last_became_active":"2024-09-22T08:10:45.179870+0000","last_became_peered":"2024-09-22T08:10:45.179870+0000","last_unstale":"2024-09-22T08:14:28.960016+0000","last_undegraded":"2024-09-22T08:14:28.960016+0000","last_fullsized":"2024-09-22T08:14:28.960016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:28.959878+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:28.959878+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.959878+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:57:09.248946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.896554+0000","last_change":"2024-09-22T08:14:16.896554+0000","last_active":"2024-09-22T08:14:16.896554+0000","last_peered":"2024-09-22T08:14:16.896554+0000","last_clean":"2024-09-22T08:14:16.896554+0000","last_became_active":"2024-09-22T08:10:43.178146+0000","last_became_peered":"2024-09-22T08:10:43.178146+0000","last_unstale":"2024-09-22T08:14:16.896554+0000","last_undegraded":"2024-09-22T08:14:16.896554+0000","last_fullsized":"2024-09-22T08:14:16.896554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:16.896443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:16.896443+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.896443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:40.881321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.986998+0000","last_change":"2024-09-22T08:14:29.986942+0000","last_active":"2024-09-22T08:14:29.986998+0000","last_peered":"2024-09-22T08:14:29.986998+0000","last_clean":"2024-09-22T08:14:29.986998+0000","last_became_active":"2024-09-22T08:10:45.177101+0000","last_became_peered":"2024-09-22T08:10:45.177101+0000","last_unstale":"2024-09-22T08:14:29.986998+0000","last_undegraded":"2024-09-22T08:14:29.986998+0000","last_fullsized":"2024-09-22T08:14:29.986998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:29.986860+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:29.986860+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.986860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:26.079898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.978156+0000","last_change":"2024-09-22T08:14:46.978156+0000","last_active":"2024-09-22T08:14:46.978156+0000","last_peered":"2024-09-22T08:14:46.978156+0000","last_clean":"2024-09-22T08:14:46.978156+0000","last_became_active":"2024-09-22T08:10:45.169140+0000","last_became_peered":"2024-09-22T08:10:45.169140+0000","last_unstale":"2024-09-22T08:14:46.978156+0000","last_undegraded":"2024-09-22T08:14:46.978156+0000","last_fullsized":"2024-09-22T08:14:46.978156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:46.978074+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:46.978074+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.978074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:33.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.805924+0000","last_change":"2024-09-22T08:14:16.805924+0000","last_active":"2024-09-22T08:14:16.805924+0000","last_peered":"2024-09-22T08:14:16.805924+0000","last_clean":"2024-09-22T08:14:16.805924+0000","last_became_active":"2024-09-22T08:10:43.185301+0000","last_became_peered":"2024-09-22T08:10:43.185301+0000","last_unstale":"2024-09-22T08:14:16.805924+0000","last_undegraded":"2024-09-22T08:14:16.805924+0000","last_fullsized":"2024-09-22T08:14:16.805924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:16.805805+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:16.805805+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.805805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:11.575658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.829126+0000","last_change":"2024-09-22T08:14:29.829126+0000","last_active":"2024-09-22T08:14:29.829126+0000","last_peered":"2024-09-22T08:14:29.829126+0000","last_clean":"2024-09-22T08:14:29.829126+0000","last_became_active":"2024-09-22T08:10:45.172557+0000","last_became_peered":"2024-09-22T08:10:45.172557+0000","last_unstale":"2024-09-22T08:14:29.829126+0000","last_undegraded":"2024-09-22T08:14:29.829126+0000","last_fullsized":"2024-09-22T08:14:29.829126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:29.829030+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:29.829030+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.829030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:18.653579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.821331+0000","last_change":"2024-09-22T08:14:14.821331+0000","last_active":"2024-09-22T08:14:14.821331+0000","last_peered":"2024-09-22T08:14:14.821331+0000","last_clean":"2024-09-22T08:14:14.821331+0000","last_became_active":"2024-09-22T08:10:43.189273+0000","last_became_peered":"2024-09-22T08:10:43.189273+0000","last_unstale":"2024-09-22T08:14:14.821331+0000","last_undegraded":"2024-09-22T08:14:14.821331+0000","last_fullsized":"2024-09-22T08:14:14.821331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:14.821242+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:14.821242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.821242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:39.122357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.726995+0000","last_change":"2024-09-22T08:14:36.726995+0000","last_active":"2024-09-22T08:14:36.726995+0000","last_peered":"2024-09-22T08:14:36.726995+0000","last_clean":"2024-09-22T08:14:36.726995+0000","last_became_active":"2024-09-22T08:10:45.176885+0000","last_became_peered":"2024-09-22T08:10:45.176885+0000","last_unstale":"2024-09-22T08:14:36.726995+0000","last_undegraded":"2024-09-22T08:14:36.726995+0000","last_fullsized":"2024-09-22T08:14:36.726995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:36.726901+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:36.726901+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.726901+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:42.806466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.813396+0000","last_change":"2024-09-22T08:14:15.813396+0000","last_active":"2024-09-22T08:14:15.813396+0000","last_peered":"2024-09-22T08:14:15.813396+0000","last_clean":"2024-09-22T08:14:15.813396+0000","last_became_active":"2024-09-22T08:10:43.183887+0000","last_became_peered":"2024-09-22T08:10:43.183887+0000","last_unstale":"2024-09-22T08:14:15.813396+0000","last_undegraded":"2024-09-22T08:14:15.813396+0000","last_fullsized":"2024-09-22T08:14:15.813396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:15.813300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:15.813300+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.813300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:39.476435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.998449+0000","last_change":"2024-09-22T08:14:28.998449+0000","last_active":"2024-09-22T08:14:28.998449+0000","last_peered":"2024-09-22T08:14:28.998449+0000","last_clean":"2024-09-22T08:14:28.998449+0000","last_became_active":"2024-09-22T08:10:45.171492+0000","last_became_peered":"2024-09-22T08:10:45.171492+0000","last_unstale":"2024-09-22T08:14:28.998449+0000","last_undegraded":"2024-09-22T08:14:28.998449+0000","last_fullsized":"2024-09-22T08:14:28.998449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:28.998358+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:28.998358+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.998358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:54.381452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.797115+0000","last_change":"2024-09-22T08:14:12.797115+0000","last_active":"2024-09-22T08:14:12.797115+0000","last_peered":"2024-09-22T08:14:12.797115+0000","last_clean":"2024-09-22T08:14:12.797115+0000","last_became_active":"2024-09-22T08:10:43.179133+0000","last_became_peered":"2024-09-22T08:10:43.179133+0000","last_unstale":"2024-09-22T08:14:12.797115+0000","last_undegraded":"2024-09-22T08:14:12.797115+0000","last_fullsized":"2024-09-22T08:14:12.797115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-22T08:14:12.797035+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-22T08:14:12.797035+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.797035+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:51.512160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13,"num_write":24,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.927145+0000","last_change":"2024-09-22T08:14:27.927145+0000","last_active":"2024-09-22T08:14:27.927145+0000","last_peered":"2024-09-22T08:14:27.927145+0000","last_clean":"2024-09-22T08:14:27.927145+0000","last_became_active":"2024-09-22T08:10:45.173524+0000","last_became_peered":"2024-09-22T08:10:45.173524+0000","last_unstale":"2024-09-22T08:14:27.927145+0000","last_undegraded":"2024-09-22T08:14:27.927145+0000","last_fullsized":"2024-09-22T08:14:27.927145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:27.927054+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:27.927054+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.927054+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:21.773609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.847627+0000","last_change":"2024-09-22T08:14:15.847627+0000","last_active":"2024-09-22T08:14:15.847627+0000","last_peered":"2024-09-22T08:14:15.847627+0000","last_clean":"2024-09-22T08:14:15.847627+0000","last_became_active":"2024-09-22T08:10:43.186739+0000","last_became_peered":"2024-09-22T08:10:43.186739+0000","last_unstale":"2024-09-22T08:14:15.847627+0000","last_undegraded":"2024-09-22T08:14:15.847627+0000","last_fullsized":"2024-09-22T08:14:15.847627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:15.847522+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:15.847522+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.847522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:31.369309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.813445+0000","last_change":"2024-09-22T08:14:31.813445+0000","last_active":"2024-09-22T08:14:31.813445+0000","last_peered":"2024-09-22T08:14:31.813445+0000","last_clean":"2024-09-22T08:14:31.813445+0000","last_became_active":"2024-09-22T08:10:45.170247+0000","last_became_peered":"2024-09-22T08:10:45.170247+0000","last_unstale":"2024-09-22T08:14:31.813445+0000","last_undegraded":"2024-09-22T08:14:31.813445+0000","last_fullsized":"2024-09-22T08:14:31.813445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.813353+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.813353+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.813353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:57.196447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.204624+0000","last_change":"2024-09-22T08:14:29.204535+0000","last_active":"2024-09-22T08:14:29.204624+0000","last_peered":"2024-09-22T08:14:29.204624+0000","last_clean":"2024-09-22T08:14:29.204624+0000","last_became_active":"2024-09-22T08:10:43.190674+0000","last_became_peered":"2024-09-22T08:10:43.190674+0000","last_unstale":"2024-09-22T08:14:29.204624+0000","last_undegraded":"2024-09-22T08:14:29.204624+0000","last_fullsized":"2024-09-22T08:14:29.204624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:29.204435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:29.204435+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.204435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:48.655553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:04.067951+0000","last_change":"2024-09-22T08:15:04.067951+0000","last_active":"2024-09-22T08:15:04.067951+0000","last_peered":"2024-09-22T08:15:04.067951+0000","last_clean":"2024-09-22T08:15:04.067951+0000","last_became_active":"2024-09-22T08:10:53.203146+0000","last_became_peered":"2024-09-22T08:10:53.203146+0000","last_unstale":"2024-09-22T08:15:04.067951+0000","last_undegraded":"2024-09-22T08:15:04.067951+0000","last_fullsized":"2024-09-22T08:15:04.067951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-22T08:15:04.067862+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-22T08:15:04.067862+0000","last_clean_scrub_stamp":"2024-09-22T08:15:04.067862+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:59.488098+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.063669+0000","last_change":"2024-09-22T08:14:38.063669+0000","last_active":"2024-09-22T08:14:38.063669+0000","last_peered":"2024-09-22T08:14:38.063669+0000","last_clean":"2024-09-22T08:14:38.063669+0000","last_became_active":"2024-09-22T08:10:45.168308+0000","last_became_peered":"2024-09-22T08:10:45.168308+0000","last_unstale":"2024-09-22T08:14:38.063669+0000","last_undegraded":"2024-09-22T08:14:38.063669+0000","last_fullsized":"2024-09-22T08:14:38.063669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:38.063566+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:38.063566+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.063566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:58.873201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.270406+0000","last_change":"2024-09-22T08:14:17.270316+0000","last_active":"2024-09-22T08:14:17.270406+0000","last_peered":"2024-09-22T08:14:17.270406+0000","last_clean":"2024-09-22T08:14:17.270406+0000","last_became_active":"2024-09-22T08:10:43.200307+0000","last_became_peered":"2024-09-22T08:10:43.200307+0000","last_unstale":"2024-09-22T08:14:17.270406+0000","last_undegraded":"2024-09-22T08:14:17.270406+0000","last_fullsized":"2024-09-22T08:14:17.270406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.270212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.270212+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.270212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:29.835254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.034206+0000","last_change":"2024-09-22T08:14:57.034206+0000","last_active":"2024-09-22T08:14:57.034206+0000","last_peered":"2024-09-22T08:14:57.034206+0000","last_clean":"2024-09-22T08:14:57.034206+0000","last_became_active":"2024-09-22T08:10:47.176568+0000","last_became_peered":"2024-09-22T08:10:47.176568+0000","last_unstale":"2024-09-22T08:14:57.034206+0000","last_undegraded":"2024-09-22T08:14:57.034206+0000","last_fullsized":"2024-09-22T08:14:57.034206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:57.034089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:57.034089+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.034089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:08.818189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:07.141075+0000","last_change":"2024-09-22T08:15:07.141075+0000","last_active":"2024-09-22T08:15:07.141075+0000","last_peered":"2024-09-22T08:15:07.141075+0000","last_clean":"2024-09-22T08:15:07.141075+0000","last_became_active":"2024-09-22T08:10:49.188697+0000","last_became_peered":"2024-09-22T08:10:49.188697+0000","last_unstale":"2024-09-22T08:15:07.141075+0000","last_undegraded":"2024-09-22T08:15:07.141075+0000","last_fullsized":"2024-09-22T08:15:07.141075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-22T08:15:07.140983+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-22T08:15:07.140983+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.140983+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:52.455481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.023727+0000","last_change":"2024-09-22T08:14:57.023727+0000","last_active":"2024-09-22T08:14:57.023727+0000","last_peered":"2024-09-22T08:14:57.023727+0000","last_clean":"2024-09-22T08:14:57.023727+0000","last_became_active":"2024-09-22T08:10:51.201855+0000","last_became_peered":"2024-09-22T08:10:51.201855+0000","last_unstale":"2024-09-22T08:14:57.023727+0000","last_undegraded":"2024-09-22T08:14:57.023727+0000","last_fullsized":"2024-09-22T08:14:57.023727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:57.023611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:57.023611+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.023611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:01.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:05.063827+0000","last_change":"2024-09-22T08:15:05.063827+0000","last_active":"2024-09-22T08:15:05.063827+0000","last_peered":"2024-09-22T08:15:05.063827+0000","last_clean":"2024-09-22T08:15:05.063827+0000","last_became_active":"2024-09-22T08:10:53.204407+0000","last_became_peered":"2024-09-22T08:10:53.204407+0000","last_unstale":"2024-09-22T08:15:05.063827+0000","last_undegraded":"2024-09-22T08:15:05.063827+0000","last_fullsized":"2024-09-22T08:15:05.063827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-22T08:15:05.063718+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-22T08:15:05.063718+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.063718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:19.232361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'16","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.067176+0000","last_change":"2024-09-22T08:14:39.067176+0000","last_active":"2024-09-22T08:14:39.067176+0000","last_peered":"2024-09-22T08:14:39.067176+0000","last_clean":"2024-09-22T08:14:39.067176+0000","last_became_active":"2024-09-22T08:10:45.170765+0000","last_became_peered":"2024-09-22T08:10:45.170765+0000","last_unstale":"2024-09-22T08:14:39.067176+0000","last_undegraded":"2024-09-22T08:14:39.067176+0000","last_fullsized":"2024-09-22T08:14:39.067176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-22T08:14:39.067085+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-22T08:14:39.067085+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.067085+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:09.486443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.743753+0000","last_change":"2024-09-22T08:14:08.743684+0000","last_active":"2024-09-22T08:14:08.743753+0000","last_peered":"2024-09-22T08:14:08.743753+0000","last_clean":"2024-09-22T08:14:08.743753+0000","last_became_active":"2024-09-22T08:10:43.180600+0000","last_became_peered":"2024-09-22T08:10:43.180600+0000","last_unstale":"2024-09-22T08:14:08.743753+0000","last_undegraded":"2024-09-22T08:14:08.743753+0000","last_fullsized":"2024-09-22T08:14:08.743753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.743587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.743587+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.743587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:44.284655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.913847+0000","last_change":"2024-09-22T08:14:36.913847+0000","last_active":"2024-09-22T08:14:36.913847+0000","last_peered":"2024-09-22T08:14:36.913847+0000","last_clean":"2024-09-22T08:14:36.913847+0000","last_became_active":"2024-09-22T08:10:47.167913+0000","last_became_peered":"2024-09-22T08:10:47.167913+0000","last_unstale":"2024-09-22T08:14:36.913847+0000","last_undegraded":"2024-09-22T08:14:36.913847+0000","last_fullsized":"2024-09-22T08:14:36.913847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:36.913756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:36.913756+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.913756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:18.021625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.961384+0000","last_change":"2024-09-22T08:14:49.961384+0000","last_active":"2024-09-22T08:14:49.961384+0000","last_peered":"2024-09-22T08:14:49.961384+0000","last_clean":"2024-09-22T08:14:49.961384+0000","last_became_active":"2024-09-22T08:10:49.182481+0000","last_became_peered":"2024-09-22T08:10:49.182481+0000","last_unstale":"2024-09-22T08:14:49.961384+0000","last_undegraded":"2024-09-22T08:14:49.961384+0000","last_fullsized":"2024-09-22T08:14:49.961384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-22T08:14:49.961281+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-22T08:14:49.961281+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.961281+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:00.050565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.023182+0000","last_change":"2024-09-22T08:14:55.023182+0000","last_active":"2024-09-22T08:14:55.023182+0000","last_peered":"2024-09-22T08:14:55.023182+0000","last_clean":"2024-09-22T08:14:55.023182+0000","last_became_active":"2024-09-22T08:10:51.199837+0000","last_became_peered":"2024-09-22T08:10:51.199837+0000","last_unstale":"2024-09-22T08:14:55.023182+0000","last_undegraded":"2024-09-22T08:14:55.023182+0000","last_fullsized":"2024-09-22T08:14:55.023182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.023064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.023064+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.023064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:11.887959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:00.056833+0000","last_change":"2024-09-22T08:15:00.056833+0000","last_active":"2024-09-22T08:15:00.056833+0000","last_peered":"2024-09-22T08:15:00.056833+0000","last_clean":"2024-09-22T08:15:00.056833+0000","last_became_active":"2024-09-22T08:10:53.199303+0000","last_became_peered":"2024-09-22T08:10:53.199303+0000","last_unstale":"2024-09-22T08:15:00.056833+0000","last_undegraded":"2024-09-22T08:15:00.056833+0000","last_fullsized":"2024-09-22T08:15:00.056833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:15:00.056727+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:15:00.056727+0000","last_clean_scrub_stamp":"2024-09-22T08:15:00.056727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:55.476963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.101518+0000","last_change":"2024-09-22T08:14:40.101518+0000","last_active":"2024-09-22T08:14:40.101518+0000","last_peered":"2024-09-22T08:14:40.101518+0000","last_clean":"2024-09-22T08:14:40.101518+0000","last_became_active":"2024-09-22T08:10:45.168554+0000","last_became_peered":"2024-09-22T08:10:45.168554+0000","last_unstale":"2024-09-22T08:14:40.101518+0000","last_undegraded":"2024-09-22T08:14:40.101518+0000","last_fullsized":"2024-09-22T08:14:40.101518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:40.101418+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:40.101418+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.101418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:35.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.265364+0000","last_change":"2024-09-22T08:14:16.265298+0000","last_active":"2024-09-22T08:14:16.265364+0000","last_peered":"2024-09-22T08:14:16.265364+0000","last_clean":"2024-09-22T08:14:16.265364+0000","last_became_active":"2024-09-22T08:10:43.189333+0000","last_became_peered":"2024-09-22T08:10:43.189333+0000","last_unstale":"2024-09-22T08:14:16.265364+0000","last_undegraded":"2024-09-22T08:14:16.265364+0000","last_fullsized":"2024-09-22T08:14:16.265364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:16.265216+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:16.265216+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.265216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:42.490080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.937678+0000","last_change":"2024-09-22T08:14:37.937678+0000","last_active":"2024-09-22T08:14:37.937678+0000","last_peered":"2024-09-22T08:14:37.937678+0000","last_clean":"2024-09-22T08:14:37.937678+0000","last_became_active":"2024-09-22T08:10:47.175959+0000","last_became_peered":"2024-09-22T08:10:47.175959+0000","last_unstale":"2024-09-22T08:14:37.937678+0000","last_undegraded":"2024-09-22T08:14:37.937678+0000","last_fullsized":"2024-09-22T08:14:37.937678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:37.937584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:37.937584+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.937584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:19.341899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.886512+0000","last_change":"2024-09-22T08:14:42.886512+0000","last_active":"2024-09-22T08:14:42.886512+0000","last_peered":"2024-09-22T08:14:42.886512+0000","last_clean":"2024-09-22T08:14:42.886512+0000","last_became_active":"2024-09-22T08:10:49.185269+0000","last_became_peered":"2024-09-22T08:10:49.185269+0000","last_unstale":"2024-09-22T08:14:42.886512+0000","last_undegraded":"2024-09-22T08:14:42.886512+0000","last_fullsized":"2024-09-22T08:14:42.886512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-22T08:14:42.886419+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-22T08:14:42.886419+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.886419+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:26.711598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:16.000632+0000","last_change":"2024-09-22T08:15:16.000632+0000","last_active":"2024-09-22T08:15:16.000632+0000","last_peered":"2024-09-22T08:15:16.000632+0000","last_clean":"2024-09-22T08:15:16.000632+0000","last_became_active":"2024-09-22T08:10:51.196199+0000","last_became_peered":"2024-09-22T08:10:51.196199+0000","last_unstale":"2024-09-22T08:15:16.000632+0000","last_undegraded":"2024-09-22T08:15:16.000632+0000","last_fullsized":"2024-09-22T08:15:16.000632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:15:16.000539+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:15:16.000539+0000","last_clean_scrub_stamp":"2024-09-22T08:15:16.000539+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:36.890358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.997415+0000","last_change":"2024-09-22T08:14:56.997415+0000","last_active":"2024-09-22T08:14:56.997415+0000","last_peered":"2024-09-22T08:14:56.997415+0000","last_clean":"2024-09-22T08:14:56.997415+0000","last_became_active":"2024-09-22T08:10:53.194118+0000","last_became_peered":"2024-09-22T08:10:53.194118+0000","last_unstale":"2024-09-22T08:14:56.997415+0000","last_undegraded":"2024-09-22T08:14:56.997415+0000","last_fullsized":"2024-09-22T08:14:56.997415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:56.997317+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:56.997317+0000","last_clean_scrub_stamp":"2024-09-22T08:14:56.997317+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:24.120944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.867755+0000","last_change":"2024-09-22T08:14:20.867755+0000","last_active":"2024-09-22T08:14:20.867755+0000","last_peered":"2024-09-22T08:14:20.867755+0000","last_clean":"2024-09-22T08:14:20.867755+0000","last_became_active":"2024-09-22T08:10:45.183307+0000","last_became_peered":"2024-09-22T08:10:45.183307+0000","last_unstale":"2024-09-22T08:14:20.867755+0000","last_undegraded":"2024-09-22T08:14:20.867755+0000","last_fullsized":"2024-09-22T08:14:20.867755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:20.867654+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:20.867654+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.867654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:26.987640+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.753445+0000","last_change":"2024-09-22T08:14:05.753375+0000","last_active":"2024-09-22T08:14:05.753445+0000","last_peered":"2024-09-22T08:14:05.753445+0000","last_clean":"2024-09-22T08:14:05.753445+0000","last_became_active":"2024-09-22T08:10:43.187835+0000","last_became_peered":"2024-09-22T08:10:43.187835+0000","last_unstale":"2024-09-22T08:14:05.753445+0000","last_undegraded":"2024-09-22T08:14:05.753445+0000","last_fullsized":"2024-09-22T08:14:05.753445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.753280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.753280+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.753280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:33.618928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:59.113419+0000","last_change":"2024-09-22T08:14:59.113419+0000","last_active":"2024-09-22T08:14:59.113419+0000","last_peered":"2024-09-22T08:14:59.113419+0000","last_clean":"2024-09-22T08:14:59.113419+0000","last_became_active":"2024-09-22T08:10:47.175386+0000","last_became_peered":"2024-09-22T08:10:47.175386+0000","last_unstale":"2024-09-22T08:14:59.113419+0000","last_undegraded":"2024-09-22T08:14:59.113419+0000","last_fullsized":"2024-09-22T08:14:59.113419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:59.113282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:59.113282+0000","last_clean_scrub_stamp":"2024-09-22T08:14:59.113282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:28.790957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.905429+0000","last_change":"2024-09-22T08:14:43.905429+0000","last_active":"2024-09-22T08:14:43.905429+0000","last_peered":"2024-09-22T08:14:43.905429+0000","last_clean":"2024-09-22T08:14:43.905429+0000","last_became_active":"2024-09-22T08:10:49.184963+0000","last_became_peered":"2024-09-22T08:10:49.184963+0000","last_unstale":"2024-09-22T08:14:43.905429+0000","last_undegraded":"2024-09-22T08:14:43.905429+0000","last_fullsized":"2024-09-22T08:14:43.905429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-22T08:14:43.905303+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-22T08:14:43.905303+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.905303+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:27.963120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":454,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.166710+0000","last_change":"2024-09-22T08:14:51.166710+0000","last_active":"2024-09-22T08:14:51.166710+0000","last_peered":"2024-09-22T08:14:51.166710+0000","last_clean":"2024-09-22T08:14:51.166710+0000","last_became_active":"2024-09-22T08:10:51.193678+0000","last_became_peered":"2024-09-22T08:10:51.193678+0000","last_unstale":"2024-09-22T08:14:51.166710+0000","last_undegraded":"2024-09-22T08:14:51.166710+0000","last_fullsized":"2024-09-22T08:14:51.166710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:51.166621+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:51.166621+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.166621+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:08.031516+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.079839+0000","last_change":"2024-09-22T08:14:35.079772+0000","last_active":"2024-09-22T08:14:35.079839+0000","last_peered":"2024-09-22T08:14:35.079839+0000","last_clean":"2024-09-22T08:14:35.079839+0000","last_became_active":"2024-09-22T08:10:45.183598+0000","last_became_peered":"2024-09-22T08:10:45.183598+0000","last_unstale":"2024-09-22T08:14:35.079839+0000","last_undegraded":"2024-09-22T08:14:35.079839+0000","last_fullsized":"2024-09-22T08:14:35.079839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:35.079690+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:35.079690+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.079690+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:13.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.780468+0000","last_change":"2024-09-22T08:14:07.780412+0000","last_active":"2024-09-22T08:14:07.780468+0000","last_peered":"2024-09-22T08:14:07.780468+0000","last_clean":"2024-09-22T08:14:07.780468+0000","last_became_active":"2024-09-22T08:10:43.173543+0000","last_became_peered":"2024-09-22T08:10:43.173543+0000","last_unstale":"2024-09-22T08:14:07.780468+0000","last_undegraded":"2024-09-22T08:14:07.780468+0000","last_fullsized":"2024-09-22T08:14:07.780468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:07.780321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:07.780321+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.780321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:56.960543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.761635+0000","last_change":"2024-09-22T08:14:38.761582+0000","last_active":"2024-09-22T08:14:38.761635+0000","last_peered":"2024-09-22T08:14:38.761635+0000","last_clean":"2024-09-22T08:14:38.761635+0000","last_became_active":"2024-09-22T08:10:47.176657+0000","last_became_peered":"2024-09-22T08:10:47.176657+0000","last_unstale":"2024-09-22T08:14:38.761635+0000","last_undegraded":"2024-09-22T08:14:38.761635+0000","last_fullsized":"2024-09-22T08:14:38.761635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:38.761498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:38.761498+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.761498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:54.171137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.965815+0000","last_change":"2024-09-22T08:14:38.965752+0000","last_active":"2024-09-22T08:14:38.965815+0000","last_peered":"2024-09-22T08:14:38.965815+0000","last_clean":"2024-09-22T08:14:38.965815+0000","last_became_active":"2024-09-22T08:10:49.182985+0000","last_became_peered":"2024-09-22T08:10:49.182985+0000","last_unstale":"2024-09-22T08:14:38.965815+0000","last_undegraded":"2024-09-22T08:14:38.965815+0000","last_fullsized":"2024-09-22T08:14:38.965815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-22T08:14:38.965657+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-22T08:14:38.965657+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.965657+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:27.222048+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:59.092732+0000","last_change":"2024-09-22T08:14:59.092679+0000","last_active":"2024-09-22T08:14:59.092732+0000","last_peered":"2024-09-22T08:14:59.092732+0000","last_clean":"2024-09-22T08:14:59.092732+0000","last_became_active":"2024-09-22T08:10:51.192623+0000","last_became_peered":"2024-09-22T08:10:51.192623+0000","last_unstale":"2024-09-22T08:14:59.092732+0000","last_undegraded":"2024-09-22T08:14:59.092732+0000","last_fullsized":"2024-09-22T08:14:59.092732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:59.092577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:59.092577+0000","last_clean_scrub_stamp":"2024-09-22T08:14:59.092577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:52.851825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.000633+0000","last_change":"2024-09-22T08:14:54.000565+0000","last_active":"2024-09-22T08:14:54.000633+0000","last_peered":"2024-09-22T08:14:54.000633+0000","last_clean":"2024-09-22T08:14:54.000633+0000","last_became_active":"2024-09-22T08:10:53.198219+0000","last_became_peered":"2024-09-22T08:10:53.198219+0000","last_unstale":"2024-09-22T08:14:54.000633+0000","last_undegraded":"2024-09-22T08:14:54.000633+0000","last_fullsized":"2024-09-22T08:14:54.000633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:54.000480+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:54.000480+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.000480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:12.877456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.853916+0000","last_change":"2024-09-22T08:14:20.853871+0000","last_active":"2024-09-22T08:14:20.853916+0000","last_peered":"2024-09-22T08:14:20.853916+0000","last_clean":"2024-09-22T08:14:20.853916+0000","last_became_active":"2024-09-22T08:10:45.171911+0000","last_became_peered":"2024-09-22T08:10:45.171911+0000","last_unstale":"2024-09-22T08:14:20.853916+0000","last_undegraded":"2024-09-22T08:14:20.853916+0000","last_fullsized":"2024-09-22T08:14:20.853916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:20.853779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:20.853779+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.853779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:02.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.794591+0000","last_change":"2024-09-22T08:14:06.794540+0000","last_active":"2024-09-22T08:14:06.794591+0000","last_peered":"2024-09-22T08:14:06.794591+0000","last_clean":"2024-09-22T08:14:06.794591+0000","last_became_active":"2024-09-22T08:10:43.189780+0000","last_became_peered":"2024-09-22T08:10:43.189780+0000","last_unstale":"2024-09-22T08:14:06.794591+0000","last_undegraded":"2024-09-22T08:14:06.794591+0000","last_fullsized":"2024-09-22T08:14:06.794591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:06.794440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:06.794440+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.794440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:21.869262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.017023+0000","last_change":"2024-09-22T08:14:33.016936+0000","last_active":"2024-09-22T08:14:33.017023+0000","last_peered":"2024-09-22T08:14:33.017023+0000","last_clean":"2024-09-22T08:14:33.017023+0000","last_became_active":"2024-09-22T08:10:47.177695+0000","last_became_peered":"2024-09-22T08:10:47.177695+0000","last_unstale":"2024-09-22T08:14:33.017023+0000","last_undegraded":"2024-09-22T08:14:33.017023+0000","last_fullsized":"2024-09-22T08:14:33.017023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:33.016843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:33.016843+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.016843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:37.907092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:04.126384+0000","last_change":"2024-09-22T08:15:04.126276+0000","last_active":"2024-09-22T08:15:04.126384+0000","last_peered":"2024-09-22T08:15:04.126384+0000","last_clean":"2024-09-22T08:15:04.126384+0000","last_became_active":"2024-09-22T08:10:49.185419+0000","last_became_peered":"2024-09-22T08:10:49.185419+0000","last_unstale":"2024-09-22T08:15:04.126384+0000","last_undegraded":"2024-09-22T08:15:04.126384+0000","last_fullsized":"2024-09-22T08:15:04.126384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-22T08:15:04.126166+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-22T08:15:04.126166+0000","last_clean_scrub_stamp":"2024-09-22T08:15:04.126166+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:29.312403+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:50.122002+0000","last_change":"2024-09-22T08:14:50.121942+0000","last_active":"2024-09-22T08:14:50.122002+0000","last_peered":"2024-09-22T08:14:50.122002+0000","last_clean":"2024-09-22T08:14:50.122002+0000","last_became_active":"2024-09-22T08:10:51.202564+0000","last_became_peered":"2024-09-22T08:10:51.202564+0000","last_unstale":"2024-09-22T08:14:50.122002+0000","last_undegraded":"2024-09-22T08:14:50.122002+0000","last_fullsized":"2024-09-22T08:14:50.122002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:50.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:50.121854+0000","last_clean_scrub_stamp":"2024-09-22T08:14:50.121854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:40.818719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:59.065099+0000","last_change":"2024-09-22T08:14:59.065044+0000","last_active":"2024-09-22T08:14:59.065099+0000","last_peered":"2024-09-22T08:14:59.065099+0000","last_clean":"2024-09-22T08:14:59.065099+0000","last_became_active":"2024-09-22T08:10:53.196392+0000","last_became_peered":"2024-09-22T08:10:53.196392+0000","last_unstale":"2024-09-22T08:14:59.065099+0000","last_undegraded":"2024-09-22T08:14:59.065099+0000","last_fullsized":"2024-09-22T08:14:59.065099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:59.064959+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:59.064959+0000","last_clean_scrub_stamp":"2024-09-22T08:14:59.064959+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:41.394956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.834343+0000","last_change":"2024-09-22T08:14:18.834249+0000","last_active":"2024-09-22T08:14:18.834343+0000","last_peered":"2024-09-22T08:14:18.834343+0000","last_clean":"2024-09-22T08:14:18.834343+0000","last_became_active":"2024-09-22T08:10:45.177530+0000","last_became_peered":"2024-09-22T08:10:45.177530+0000","last_unstale":"2024-09-22T08:14:18.834343+0000","last_undegraded":"2024-09-22T08:14:18.834343+0000","last_fullsized":"2024-09-22T08:14:18.834343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:18.834156+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.834156+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.834156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:22.288734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.250060+0000","last_change":"2024-09-22T08:14:15.250010+0000","last_active":"2024-09-22T08:14:15.250060+0000","last_peered":"2024-09-22T08:14:15.250060+0000","last_clean":"2024-09-22T08:14:15.250060+0000","last_became_active":"2024-09-22T08:10:43.201669+0000","last_became_peered":"2024-09-22T08:10:43.201669+0000","last_unstale":"2024-09-22T08:14:15.250060+0000","last_undegraded":"2024-09-22T08:14:15.250060+0000","last_fullsized":"2024-09-22T08:14:15.250060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:15.249925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:15.249925+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.249925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:10.670160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.960554+0000","last_change":"2024-09-22T08:14:35.960461+0000","last_active":"2024-09-22T08:14:35.960554+0000","last_peered":"2024-09-22T08:14:35.960554+0000","last_clean":"2024-09-22T08:14:35.960554+0000","last_became_active":"2024-09-22T08:10:47.177613+0000","last_became_peered":"2024-09-22T08:10:47.177613+0000","last_unstale":"2024-09-22T08:14:35.960554+0000","last_undegraded":"2024-09-22T08:14:35.960554+0000","last_fullsized":"2024-09-22T08:14:35.960554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:35.960358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:35.960358+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.960358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:11.564682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'47","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:02.127912+0000","last_change":"2024-09-22T08:15:02.127853+0000","last_active":"2024-09-22T08:15:02.127912+0000","last_peered":"2024-09-22T08:15:02.127912+0000","last_clean":"2024-09-22T08:15:02.127912+0000","last_became_active":"2024-09-22T08:10:49.186941+0000","last_became_peered":"2024-09-22T08:10:49.186941+0000","last_unstale":"2024-09-22T08:15:02.127912+0000","last_undegraded":"2024-09-22T08:15:02.127912+0000","last_fullsized":"2024-09-22T08:15:02.127912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-22T08:15:02.127734+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-22T08:15:02.127734+0000","last_clean_scrub_stamp":"2024-09-22T08:15:02.127734+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:09.059423+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":362,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.146395+0000","last_change":"2024-09-22T08:14:53.146275+0000","last_active":"2024-09-22T08:14:53.146395+0000","last_peered":"2024-09-22T08:14:53.146395+0000","last_clean":"2024-09-22T08:14:53.146395+0000","last_became_active":"2024-09-22T08:10:51.192483+0000","last_became_peered":"2024-09-22T08:10:51.192483+0000","last_unstale":"2024-09-22T08:14:53.146395+0000","last_undegraded":"2024-09-22T08:14:53.146395+0000","last_fullsized":"2024-09-22T08:14:53.146395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:53.146179+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:53.146179+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.146179+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:32:57.244656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.059212+0000","last_change":"2024-09-22T08:14:56.059149+0000","last_active":"2024-09-22T08:14:56.059212+0000","last_peered":"2024-09-22T08:14:56.059212+0000","last_clean":"2024-09-22T08:14:56.059212+0000","last_became_active":"2024-09-22T08:10:53.199273+0000","last_became_peered":"2024-09-22T08:10:53.199273+0000","last_unstale":"2024-09-22T08:14:56.059212+0000","last_undegraded":"2024-09-22T08:14:56.059212+0000","last_fullsized":"2024-09-22T08:14:56.059212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:56.059064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:56.059064+0000","last_clean_scrub_stamp":"2024-09-22T08:14:56.059064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:00.654786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.865187+0000","last_change":"2024-09-22T08:14:21.865126+0000","last_active":"2024-09-22T08:14:21.865187+0000","last_peered":"2024-09-22T08:14:21.865187+0000","last_clean":"2024-09-22T08:14:21.865187+0000","last_became_active":"2024-09-22T08:10:45.165352+0000","last_became_peered":"2024-09-22T08:10:45.165352+0000","last_unstale":"2024-09-22T08:14:21.865187+0000","last_undegraded":"2024-09-22T08:14:21.865187+0000","last_fullsized":"2024-09-22T08:14:21.865187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:21.865034+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:21.865034+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.865034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:43.503660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.210451+0000","last_change":"2024-09-22T08:14:14.210375+0000","last_active":"2024-09-22T08:14:14.210451+0000","last_peered":"2024-09-22T08:14:14.210451+0000","last_clean":"2024-09-22T08:14:14.210451+0000","last_became_active":"2024-09-22T08:10:43.198696+0000","last_became_peered":"2024-09-22T08:10:43.198696+0000","last_unstale":"2024-09-22T08:14:14.210451+0000","last_undegraded":"2024-09-22T08:14:14.210451+0000","last_fullsized":"2024-09-22T08:14:14.210451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:14.210290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:14.210290+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.210290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:59.541262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.990964+0000","last_change":"2024-09-22T08:14:34.990891+0000","last_active":"2024-09-22T08:14:34.990964+0000","last_peered":"2024-09-22T08:14:34.990964+0000","last_clean":"2024-09-22T08:14:34.990964+0000","last_became_active":"2024-09-22T08:10:47.176263+0000","last_became_peered":"2024-09-22T08:10:47.176263+0000","last_unstale":"2024-09-22T08:14:34.990964+0000","last_undegraded":"2024-09-22T08:14:34.990964+0000","last_fullsized":"2024-09-22T08:14:34.990964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:34.990797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:34.990797+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.990797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:43.649921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'65","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:03.077823+0000","last_change":"2024-09-22T08:15:03.077746+0000","last_active":"2024-09-22T08:15:03.077823+0000","last_peered":"2024-09-22T08:15:03.077823+0000","last_clean":"2024-09-22T08:15:03.077823+0000","last_became_active":"2024-09-22T08:10:49.188724+0000","last_became_peered":"2024-09-22T08:10:49.188724+0000","last_unstale":"2024-09-22T08:15:03.077823+0000","last_undegraded":"2024-09-22T08:15:03.077823+0000","last_fullsized":"2024-09-22T08:15:03.077823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-22T08:15:03.077656+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-22T08:15:03.077656+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.077656+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:55.842521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.089931+0000","last_change":"2024-09-22T08:14:49.089869+0000","last_active":"2024-09-22T08:14:49.089931+0000","last_peered":"2024-09-22T08:14:49.089931+0000","last_clean":"2024-09-22T08:14:49.089931+0000","last_became_active":"2024-09-22T08:10:51.194937+0000","last_became_peered":"2024-09-22T08:10:51.194937+0000","last_unstale":"2024-09-22T08:14:49.089931+0000","last_undegraded":"2024-09-22T08:14:49.089931+0000","last_fullsized":"2024-09-22T08:14:49.089931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:49.089786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:49.089786+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.089786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:54.560881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:58.054362+0000","last_change":"2024-09-22T08:14:58.054267+0000","last_active":"2024-09-22T08:14:58.054362+0000","last_peered":"2024-09-22T08:14:58.054362+0000","last_clean":"2024-09-22T08:14:58.054362+0000","last_became_active":"2024-09-22T08:10:53.201289+0000","last_became_peered":"2024-09-22T08:10:53.201289+0000","last_unstale":"2024-09-22T08:14:58.054362+0000","last_undegraded":"2024-09-22T08:14:58.054362+0000","last_fullsized":"2024-09-22T08:14:58.054362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-22T08:14:58.054158+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-22T08:14:58.054158+0000","last_clean_scrub_stamp":"2024-09-22T08:14:58.054158+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:17.183240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.853822+0000","last_change":"2024-09-22T08:14:19.853760+0000","last_active":"2024-09-22T08:14:19.853822+0000","last_peered":"2024-09-22T08:14:19.853822+0000","last_clean":"2024-09-22T08:14:19.853822+0000","last_became_active":"2024-09-22T08:10:45.180762+0000","last_became_peered":"2024-09-22T08:10:45.180762+0000","last_unstale":"2024-09-22T08:14:19.853822+0000","last_undegraded":"2024-09-22T08:14:19.853822+0000","last_fullsized":"2024-09-22T08:14:19.853822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:19.853672+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:19.853672+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.853672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:03.241087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.884907+0000","last_change":"2024-09-22T08:14:08.884829+0000","last_active":"2024-09-22T08:14:08.884907+0000","last_peered":"2024-09-22T08:14:08.884907+0000","last_clean":"2024-09-22T08:14:08.884907+0000","last_became_active":"2024-09-22T08:10:43.177202+0000","last_became_peered":"2024-09-22T08:10:43.177202+0000","last_unstale":"2024-09-22T08:14:08.884907+0000","last_undegraded":"2024-09-22T08:14:08.884907+0000","last_fullsized":"2024-09-22T08:14:08.884907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:08.884729+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:08.884729+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.884729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:59.041707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.999315+0000","last_change":"2024-09-22T08:14:33.999246+0000","last_active":"2024-09-22T08:14:33.999315+0000","last_peered":"2024-09-22T08:14:33.999315+0000","last_clean":"2024-09-22T08:14:33.999315+0000","last_became_active":"2024-09-22T08:10:47.173636+0000","last_became_peered":"2024-09-22T08:10:47.173636+0000","last_unstale":"2024-09-22T08:14:33.999315+0000","last_undegraded":"2024-09-22T08:14:33.999315+0000","last_fullsized":"2024-09-22T08:14:33.999315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:33.999162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:33.999162+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.999162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:41.349638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.922367+0000","last_change":"2024-09-22T08:14:48.922308+0000","last_active":"2024-09-22T08:14:48.922367+0000","last_peered":"2024-09-22T08:14:48.922367+0000","last_clean":"2024-09-22T08:14:48.922367+0000","last_became_active":"2024-09-22T08:10:49.174933+0000","last_became_peered":"2024-09-22T08:10:49.174933+0000","last_unstale":"2024-09-22T08:14:48.922367+0000","last_undegraded":"2024-09-22T08:14:48.922367+0000","last_fullsized":"2024-09-22T08:14:48.922367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-22T08:14:48.922229+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-22T08:14:48.922229+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.922229+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:23.058385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:14.009205+0000","last_change":"2024-09-22T08:15:14.009118+0000","last_active":"2024-09-22T08:15:14.009205+0000","last_peered":"2024-09-22T08:15:14.009205+0000","last_clean":"2024-09-22T08:15:14.009205+0000","last_became_active":"2024-09-22T08:10:51.195308+0000","last_became_peered":"2024-09-22T08:10:51.195308+0000","last_unstale":"2024-09-22T08:15:14.009205+0000","last_undegraded":"2024-09-22T08:15:14.009205+0000","last_fullsized":"2024-09-22T08:15:14.009205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:14.009028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:14.009028+0000","last_clean_scrub_stamp":"2024-09-22T08:15:14.009028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:21.854266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:19.054552+0000","last_change":"2024-09-22T08:15:19.054552+0000","last_active":"2024-09-22T08:15:19.054552+0000","last_peered":"2024-09-22T08:15:19.054552+0000","last_clean":"2024-09-22T08:15:19.054552+0000","last_became_active":"2024-09-22T08:10:53.200458+0000","last_became_peered":"2024-09-22T08:10:53.200458+0000","last_unstale":"2024-09-22T08:15:19.054552+0000","last_undegraded":"2024-09-22T08:15:19.054552+0000","last_fullsized":"2024-09-22T08:15:19.054552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:15:19.054466+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:15:19.054466+0000","last_clean_scrub_stamp":"2024-09-22T08:15:19.054466+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:11.316383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.126752+0000","last_change":"2024-09-22T08:14:36.126687+0000","last_active":"2024-09-22T08:14:36.126752+0000","last_peered":"2024-09-22T08:14:36.126752+0000","last_clean":"2024-09-22T08:14:36.126752+0000","last_became_active":"2024-09-22T08:10:45.183258+0000","last_became_peered":"2024-09-22T08:10:45.183258+0000","last_unstale":"2024-09-22T08:14:36.126752+0000","last_undegraded":"2024-09-22T08:14:36.126752+0000","last_fullsized":"2024-09-22T08:14:36.126752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:36.126603+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:36.126603+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.126603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:16.874250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.213102+0000","last_change":"2024-09-22T08:14:13.213044+0000","last_active":"2024-09-22T08:14:13.213102+0000","last_peered":"2024-09-22T08:14:13.213102+0000","last_clean":"2024-09-22T08:14:13.213102+0000","last_became_active":"2024-09-22T08:10:43.195959+0000","last_became_peered":"2024-09-22T08:10:43.195959+0000","last_unstale":"2024-09-22T08:14:13.213102+0000","last_undegraded":"2024-09-22T08:14:13.213102+0000","last_fullsized":"2024-09-22T08:14:13.213102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:13.212946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:13.212946+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.212946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:31.672558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.984929+0000","last_change":"2024-09-22T08:14:32.984929+0000","last_active":"2024-09-22T08:14:32.984929+0000","last_peered":"2024-09-22T08:14:32.984929+0000","last_clean":"2024-09-22T08:14:32.984929+0000","last_became_active":"2024-09-22T08:11:23.214959+0000","last_became_peered":"2024-09-22T08:11:23.214959+0000","last_unstale":"2024-09-22T08:14:32.984929+0000","last_undegraded":"2024-09-22T08:14:32.984929+0000","last_fullsized":"2024-09-22T08:14:32.984929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:32.984850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:32.984850+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.984850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:17.763676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.862646+0000","last_change":"2024-09-22T08:14:44.862572+0000","last_active":"2024-09-22T08:14:44.862646+0000","last_peered":"2024-09-22T08:14:44.862646+0000","last_clean":"2024-09-22T08:14:44.862646+0000","last_became_active":"2024-09-22T08:10:49.180820+0000","last_became_peered":"2024-09-22T08:10:49.180820+0000","last_unstale":"2024-09-22T08:14:44.862646+0000","last_undegraded":"2024-09-22T08:14:44.862646+0000","last_fullsized":"2024-09-22T08:14:44.862646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-22T08:14:44.862457+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-22T08:14:44.862457+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.862457+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:18.655635+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":445,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:47.876515+0000","last_change":"2024-09-22T08:14:47.876449+0000","last_active":"2024-09-22T08:14:47.876515+0000","last_peered":"2024-09-22T08:14:47.876515+0000","last_clean":"2024-09-22T08:14:47.876515+0000","last_became_active":"2024-09-22T08:10:51.197020+0000","last_became_peered":"2024-09-22T08:10:51.197020+0000","last_unstale":"2024-09-22T08:14:47.876515+0000","last_undegraded":"2024-09-22T08:14:47.876515+0000","last_fullsized":"2024-09-22T08:14:47.876515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:47.876366+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:47.876366+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.876366+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:15.274449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:02.104794+0000","last_change":"2024-09-22T08:15:02.104703+0000","last_active":"2024-09-22T08:15:02.104794+0000","last_peered":"2024-09-22T08:15:02.104794+0000","last_clean":"2024-09-22T08:15:02.104794+0000","last_became_active":"2024-09-22T08:10:53.192481+0000","last_became_peered":"2024-09-22T08:10:53.192481+0000","last_unstale":"2024-09-22T08:15:02.104794+0000","last_undegraded":"2024-09-22T08:15:02.104794+0000","last_fullsized":"2024-09-22T08:15:02.104794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-22T08:15:02.104580+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-22T08:15:02.104580+0000","last_clean_scrub_stamp":"2024-09-22T08:15:02.104580+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:14.669621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.823265+0000","last_change":"2024-09-22T08:14:20.823199+0000","last_active":"2024-09-22T08:14:20.823265+0000","last_peered":"2024-09-22T08:14:20.823265+0000","last_clean":"2024-09-22T08:14:20.823265+0000","last_became_active":"2024-09-22T08:10:45.172740+0000","last_became_peered":"2024-09-22T08:10:45.172740+0000","last_unstale":"2024-09-22T08:14:20.823265+0000","last_undegraded":"2024-09-22T08:14:20.823265+0000","last_fullsized":"2024-09-22T08:14:20.823265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:20.823098+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:20.823098+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.823098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:35.363067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.246430+0000","last_change":"2024-09-22T08:14:12.246369+0000","last_active":"2024-09-22T08:14:12.246430+0000","last_peered":"2024-09-22T08:14:12.246430+0000","last_clean":"2024-09-22T08:14:12.246430+0000","last_became_active":"2024-09-22T08:10:43.195355+0000","last_became_peered":"2024-09-22T08:10:43.195355+0000","last_unstale":"2024-09-22T08:14:12.246430+0000","last_undegraded":"2024-09-22T08:14:12.246430+0000","last_fullsized":"2024-09-22T08:14:12.246430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:12.246281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:12.246281+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.246281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:08.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.770224+0000","last_change":"2024-09-22T08:14:39.770164+0000","last_active":"2024-09-22T08:14:39.770224+0000","last_peered":"2024-09-22T08:14:39.770224+0000","last_clean":"2024-09-22T08:14:39.770224+0000","last_became_active":"2024-09-22T08:11:23.221981+0000","last_became_peered":"2024-09-22T08:11:23.221981+0000","last_unstale":"2024-09-22T08:14:39.770224+0000","last_undegraded":"2024-09-22T08:14:39.770224+0000","last_fullsized":"2024-09-22T08:14:39.770224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:39.770060+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:39.770060+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.770060+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:20.877929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:05.138302+0000","last_change":"2024-09-22T08:15:05.138247+0000","last_active":"2024-09-22T08:15:05.138302+0000","last_peered":"2024-09-22T08:15:05.138302+0000","last_clean":"2024-09-22T08:15:05.138302+0000","last_became_active":"2024-09-22T08:10:49.188444+0000","last_became_peered":"2024-09-22T08:10:49.188444+0000","last_unstale":"2024-09-22T08:15:05.138302+0000","last_undegraded":"2024-09-22T08:15:05.138302+0000","last_fullsized":"2024-09-22T08:15:05.138302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-22T08:15:05.138148+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-22T08:15:05.138148+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.138148+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:45:27.459588+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":482,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:52.962238+0000","last_change":"2024-09-22T08:14:52.962171+0000","last_active":"2024-09-22T08:14:52.962238+0000","last_peered":"2024-09-22T08:14:52.962238+0000","last_clean":"2024-09-22T08:14:52.962238+0000","last_became_active":"2024-09-22T08:10:51.197248+0000","last_became_peered":"2024-09-22T08:10:51.197248+0000","last_unstale":"2024-09-22T08:14:52.962238+0000","last_undegraded":"2024-09-22T08:14:52.962238+0000","last_fullsized":"2024-09-22T08:14:52.962238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:52.962065+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:52.962065+0000","last_clean_scrub_stamp":"2024-09-22T08:14:52.962065+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:58.433161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.044843+0000","last_change":"2024-09-22T08:14:53.044767+0000","last_active":"2024-09-22T08:14:53.044843+0000","last_peered":"2024-09-22T08:14:53.044843+0000","last_clean":"2024-09-22T08:14:53.044843+0000","last_became_active":"2024-09-22T08:10:53.195539+0000","last_became_peered":"2024-09-22T08:10:53.195539+0000","last_unstale":"2024-09-22T08:14:53.044843+0000","last_undegraded":"2024-09-22T08:14:53.044843+0000","last_fullsized":"2024-09-22T08:14:53.044843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:53.044634+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:53.044634+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.044634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:54.663936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.869251+0000","last_change":"2024-09-22T08:14:21.869186+0000","last_active":"2024-09-22T08:14:21.869251+0000","last_peered":"2024-09-22T08:14:21.869251+0000","last_clean":"2024-09-22T08:14:21.869251+0000","last_became_active":"2024-09-22T08:11:23.220943+0000","last_became_peered":"2024-09-22T08:11:23.220943+0000","last_unstale":"2024-09-22T08:14:21.869251+0000","last_undegraded":"2024-09-22T08:14:21.869251+0000","last_fullsized":"2024-09-22T08:14:21.869251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:21.869104+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:21.869104+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.869104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:05.409690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.271932+0000","last_change":"2024-09-22T08:14:11.271839+0000","last_active":"2024-09-22T08:14:11.271932+0000","last_peered":"2024-09-22T08:14:11.271932+0000","last_clean":"2024-09-22T08:14:11.271932+0000","last_became_active":"2024-09-22T08:10:43.196211+0000","last_became_peered":"2024-09-22T08:10:43.196211+0000","last_unstale":"2024-09-22T08:14:11.271932+0000","last_undegraded":"2024-09-22T08:14:11.271932+0000","last_fullsized":"2024-09-22T08:14:11.271932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:11.271716+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:11.271716+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.271716+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:52.551470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.066265+0000","last_change":"2024-09-22T08:14:54.066212+0000","last_active":"2024-09-22T08:14:54.066265+0000","last_peered":"2024-09-22T08:14:54.066265+0000","last_clean":"2024-09-22T08:14:54.066265+0000","last_became_active":"2024-09-22T08:10:47.176634+0000","last_became_peered":"2024-09-22T08:10:47.176634+0000","last_unstale":"2024-09-22T08:14:54.066265+0000","last_undegraded":"2024-09-22T08:14:54.066265+0000","last_fullsized":"2024-09-22T08:14:54.066265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:54.066126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:54.066126+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.066126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:30.827664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:47.903689+0000","last_change":"2024-09-22T08:14:47.903630+0000","last_active":"2024-09-22T08:14:47.903689+0000","last_peered":"2024-09-22T08:14:47.903689+0000","last_clean":"2024-09-22T08:14:47.903689+0000","last_became_active":"2024-09-22T08:10:49.178942+0000","last_became_peered":"2024-09-22T08:10:49.178942+0000","last_unstale":"2024-09-22T08:14:47.903689+0000","last_undegraded":"2024-09-22T08:14:47.903689+0000","last_fullsized":"2024-09-22T08:14:47.903689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-22T08:14:47.903541+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-22T08:14:47.903541+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.903541+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:01.767431+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.886874+0000","last_change":"2024-09-22T08:14:46.886816+0000","last_active":"2024-09-22T08:14:46.886874+0000","last_peered":"2024-09-22T08:14:46.886874+0000","last_clean":"2024-09-22T08:14:46.886874+0000","last_became_active":"2024-09-22T08:10:51.192482+0000","last_became_peered":"2024-09-22T08:10:51.192482+0000","last_unstale":"2024-09-22T08:14:46.886874+0000","last_undegraded":"2024-09-22T08:14:46.886874+0000","last_fullsized":"2024-09-22T08:14:46.886874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:46.886720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:46.886720+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.886720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:57.047573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:58.018821+0000","last_change":"2024-09-22T08:14:58.018748+0000","last_active":"2024-09-22T08:14:58.018821+0000","last_peered":"2024-09-22T08:14:58.018821+0000","last_clean":"2024-09-22T08:14:58.018821+0000","last_became_active":"2024-09-22T08:10:53.193315+0000","last_became_peered":"2024-09-22T08:10:53.193315+0000","last_unstale":"2024-09-22T08:14:58.018821+0000","last_undegraded":"2024-09-22T08:14:58.018821+0000","last_fullsized":"2024-09-22T08:14:58.018821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-22T08:14:58.018659+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-22T08:14:58.018659+0000","last_clean_scrub_stamp":"2024-09-22T08:14:58.018659+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:43.561882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.149945+0000","last_change":"2024-09-22T08:14:33.149878+0000","last_active":"2024-09-22T08:14:33.149945+0000","last_peered":"2024-09-22T08:14:33.149945+0000","last_clean":"2024-09-22T08:14:33.149945+0000","last_became_active":"2024-09-22T08:10:45.176033+0000","last_became_peered":"2024-09-22T08:10:45.176033+0000","last_unstale":"2024-09-22T08:14:33.149945+0000","last_undegraded":"2024-09-22T08:14:33.149945+0000","last_fullsized":"2024-09-22T08:14:33.149945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:33.149785+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:33.149785+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.149785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:44.391078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.711837+0000","last_change":"2024-09-22T08:14:03.711736+0000","last_active":"2024-09-22T08:14:03.711837+0000","last_peered":"2024-09-22T08:14:03.711837+0000","last_clean":"2024-09-22T08:14:03.711837+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:14:03.711837+0000","last_undegraded":"2024-09-22T08:14:03.711837+0000","last_fullsized":"2024-09-22T08:14:03.711837+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-22T08:14:03.711630+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-22T08:14:03.711630+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.711630+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:19.958877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.254456+0000","last_change":"2024-09-22T08:14:06.254389+0000","last_active":"2024-09-22T08:14:06.254456+0000","last_peered":"2024-09-22T08:14:06.254456+0000","last_clean":"2024-09-22T08:14:06.254456+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:14:06.254456+0000","last_undegraded":"2024-09-22T08:14:06.254456+0000","last_fullsized":"2024-09-22T08:14:06.254456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:06.254288+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:06.254288+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.254288+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:56.951153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.286225+0000","last_change":"2024-09-22T08:14:09.286135+0000","last_active":"2024-09-22T08:14:09.286225+0000","last_peered":"2024-09-22T08:14:09.286225+0000","last_clean":"2024-09-22T08:14:09.286225+0000","last_became_active":"2024-09-22T08:10:43.200918+0000","last_became_peered":"2024-09-22T08:10:43.200918+0000","last_unstale":"2024-09-22T08:14:09.286225+0000","last_undegraded":"2024-09-22T08:14:09.286225+0000","last_fullsized":"2024-09-22T08:14:09.286225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:09.286038+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:09.286038+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.286038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:54.829260+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.769140+0000","last_change":"2024-09-22T08:14:37.769086+0000","last_active":"2024-09-22T08:14:37.769140+0000","last_peered":"2024-09-22T08:14:37.769140+0000","last_clean":"2024-09-22T08:14:37.769140+0000","last_became_active":"2024-09-22T08:10:47.175775+0000","last_became_peered":"2024-09-22T08:10:47.175775+0000","last_unstale":"2024-09-22T08:14:37.769140+0000","last_undegraded":"2024-09-22T08:14:37.769140+0000","last_fullsized":"2024-09-22T08:14:37.769140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:37.769007+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:37.769007+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.769007+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:46.451261+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:01.141834+0000","last_change":"2024-09-22T08:15:01.141769+0000","last_active":"2024-09-22T08:15:01.141834+0000","last_peered":"2024-09-22T08:15:01.141834+0000","last_clean":"2024-09-22T08:15:01.141834+0000","last_became_active":"2024-09-22T08:10:49.185661+0000","last_became_peered":"2024-09-22T08:10:49.185661+0000","last_unstale":"2024-09-22T08:15:01.141834+0000","last_undegraded":"2024-09-22T08:15:01.141834+0000","last_fullsized":"2024-09-22T08:15:01.141834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-22T08:15:01.141660+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-22T08:15:01.141660+0000","last_clean_scrub_stamp":"2024-09-22T08:15:01.141660+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:30.650587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:47.089256+0000","last_change":"2024-09-22T08:14:47.089175+0000","last_active":"2024-09-22T08:14:47.089256+0000","last_peered":"2024-09-22T08:14:47.089256+0000","last_clean":"2024-09-22T08:14:47.089256+0000","last_became_active":"2024-09-22T08:10:51.202473+0000","last_became_peered":"2024-09-22T08:10:51.202473+0000","last_unstale":"2024-09-22T08:14:47.089256+0000","last_undegraded":"2024-09-22T08:14:47.089256+0000","last_fullsized":"2024-09-22T08:14:47.089256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:47.089085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:47.089085+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.089085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:26.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":172,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.973413+0000","last_change":"2024-09-22T08:14:54.973341+0000","last_active":"2024-09-22T08:14:54.973413+0000","last_peered":"2024-09-22T08:14:54.973413+0000","last_clean":"2024-09-22T08:14:54.973413+0000","last_became_active":"2024-09-22T08:10:53.191752+0000","last_became_peered":"2024-09-22T08:10:53.191752+0000","last_unstale":"2024-09-22T08:14:54.973413+0000","last_undegraded":"2024-09-22T08:14:54.973413+0000","last_fullsized":"2024-09-22T08:14:54.973413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-09-22T08:14:54.973252+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-09-22T08:14:54.973252+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.973252+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:54.213924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.106995+0000","last_change":"2024-09-22T08:14:34.106915+0000","last_active":"2024-09-22T08:14:34.106995+0000","last_peered":"2024-09-22T08:14:34.106995+0000","last_clean":"2024-09-22T08:14:34.106995+0000","last_became_active":"2024-09-22T08:10:45.167260+0000","last_became_peered":"2024-09-22T08:10:45.167260+0000","last_unstale":"2024-09-22T08:14:34.106995+0000","last_undegraded":"2024-09-22T08:14:34.106995+0000","last_fullsized":"2024-09-22T08:14:34.106995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:34.106788+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:34.106788+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.106788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:08.423619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.233041+0000","last_change":"2024-09-22T08:14:05.232987+0000","last_active":"2024-09-22T08:14:05.233041+0000","last_peered":"2024-09-22T08:14:05.233041+0000","last_clean":"2024-09-22T08:14:05.233041+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:14:05.233041+0000","last_undegraded":"2024-09-22T08:14:05.233041+0000","last_fullsized":"2024-09-22T08:14:05.233041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.232899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.232899+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.232899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:33.852323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.919211+0000","last_change":"2024-09-22T08:14:07.919117+0000","last_active":"2024-09-22T08:14:07.919211+0000","last_peered":"2024-09-22T08:14:07.919211+0000","last_clean":"2024-09-22T08:14:07.919211+0000","last_became_active":"2024-09-22T08:10:43.177928+0000","last_became_peered":"2024-09-22T08:10:43.177928+0000","last_unstale":"2024-09-22T08:14:07.919211+0000","last_undegraded":"2024-09-22T08:14:07.919211+0000","last_fullsized":"2024-09-22T08:14:07.919211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:07.918996+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:07.918996+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.918996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:08.892898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.019752+0000","last_change":"2024-09-22T08:14:53.019667+0000","last_active":"2024-09-22T08:14:53.019752+0000","last_peered":"2024-09-22T08:14:53.019752+0000","last_clean":"2024-09-22T08:14:53.019752+0000","last_became_active":"2024-09-22T08:10:47.176402+0000","last_became_peered":"2024-09-22T08:10:47.176402+0000","last_unstale":"2024-09-22T08:14:53.019752+0000","last_undegraded":"2024-09-22T08:14:53.019752+0000","last_fullsized":"2024-09-22T08:14:53.019752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.019534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.019534+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.019534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:05.290331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'294","reported_seq":520,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.857343+0000","last_change":"2024-09-22T08:14:46.857281+0000","last_active":"2024-09-22T08:14:46.857343+0000","last_peered":"2024-09-22T08:14:46.857343+0000","last_clean":"2024-09-22T08:14:46.857343+0000","last_became_active":"2024-09-22T08:10:49.186277+0000","last_became_peered":"2024-09-22T08:10:49.186277+0000","last_unstale":"2024-09-22T08:14:46.857343+0000","last_undegraded":"2024-09-22T08:14:46.857343+0000","last_fullsized":"2024-09-22T08:14:46.857343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'294","last_scrub_stamp":"2024-09-22T08:14:46.857180+0000","last_deep_scrub":"34'294","last_deep_scrub_stamp":"2024-09-22T08:14:46.857180+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.857180+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:00.503752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:12.028952+0000","last_change":"2024-09-22T08:15:12.028952+0000","last_active":"2024-09-22T08:15:12.028952+0000","last_peered":"2024-09-22T08:15:12.028952+0000","last_clean":"2024-09-22T08:15:12.028952+0000","last_became_active":"2024-09-22T08:10:51.196837+0000","last_became_peered":"2024-09-22T08:10:51.196837+0000","last_unstale":"2024-09-22T08:15:12.028952+0000","last_undegraded":"2024-09-22T08:15:12.028952+0000","last_fullsized":"2024-09-22T08:15:12.028952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:12.028870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:12.028870+0000","last_clean_scrub_stamp":"2024-09-22T08:15:12.028870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:25:23.644284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:01.068279+0000","last_change":"2024-09-22T08:15:01.068213+0000","last_active":"2024-09-22T08:15:01.068279+0000","last_peered":"2024-09-22T08:15:01.068279+0000","last_clean":"2024-09-22T08:15:01.068279+0000","last_became_active":"2024-09-22T08:10:53.199214+0000","last_became_peered":"2024-09-22T08:10:53.199214+0000","last_unstale":"2024-09-22T08:15:01.068279+0000","last_undegraded":"2024-09-22T08:15:01.068279+0000","last_fullsized":"2024-09-22T08:15:01.068279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:15:01.068128+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:15:01.068128+0000","last_clean_scrub_stamp":"2024-09-22T08:15:01.068128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:02:12.262963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'11","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.886692+0000","last_change":"2024-09-22T08:14:19.886625+0000","last_active":"2024-09-22T08:14:19.886692+0000","last_peered":"2024-09-22T08:14:19.886692+0000","last_clean":"2024-09-22T08:14:19.886692+0000","last_became_active":"2024-09-22T08:10:45.175923+0000","last_became_peered":"2024-09-22T08:10:45.175923+0000","last_unstale":"2024-09-22T08:14:19.886692+0000","last_undegraded":"2024-09-22T08:14:19.886692+0000","last_fullsized":"2024-09-22T08:14:19.886692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-22T08:14:19.886532+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-22T08:14:19.886532+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.886532+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:15.270799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.830645+0000","last_change":"2024-09-22T08:14:04.830583+0000","last_active":"2024-09-22T08:14:04.830645+0000","last_peered":"2024-09-22T08:14:04.830645+0000","last_clean":"2024-09-22T08:14:04.830645+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:14:04.830645+0000","last_undegraded":"2024-09-22T08:14:04.830645+0000","last_fullsized":"2024-09-22T08:14:04.830645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:04.830494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:04.830494+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.830494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:38.025714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.991784+0000","last_change":"2024-09-22T08:14:04.991725+0000","last_active":"2024-09-22T08:14:04.991784+0000","last_peered":"2024-09-22T08:14:04.991784+0000","last_clean":"2024-09-22T08:14:04.991784+0000","last_became_active":"2024-09-22T08:10:43.186500+0000","last_became_peered":"2024-09-22T08:10:43.186500+0000","last_unstale":"2024-09-22T08:14:04.991784+0000","last_undegraded":"2024-09-22T08:14:04.991784+0000","last_fullsized":"2024-09-22T08:14:04.991784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:04.991648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:04.991648+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.991648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:45:14.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.012200+0000","last_change":"2024-09-22T08:14:31.012137+0000","last_active":"2024-09-22T08:14:31.012200+0000","last_peered":"2024-09-22T08:14:31.012200+0000","last_clean":"2024-09-22T08:14:31.012200+0000","last_became_active":"2024-09-22T08:10:47.172041+0000","last_became_peered":"2024-09-22T08:10:47.172041+0000","last_unstale":"2024-09-22T08:14:31.012200+0000","last_undegraded":"2024-09-22T08:14:31.012200+0000","last_fullsized":"2024-09-22T08:14:31.012200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.012055+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.012055+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.012055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:05.593483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'26","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.939185+0000","last_change":"2024-09-22T08:14:39.939132+0000","last_active":"2024-09-22T08:14:39.939185+0000","last_peered":"2024-09-22T08:14:39.939185+0000","last_clean":"2024-09-22T08:14:39.939185+0000","last_became_active":"2024-09-22T08:10:49.180563+0000","last_became_peered":"2024-09-22T08:10:49.180563+0000","last_unstale":"2024-09-22T08:14:39.939185+0000","last_undegraded":"2024-09-22T08:14:39.939185+0000","last_fullsized":"2024-09-22T08:14:39.939185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-22T08:14:39.939028+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-22T08:14:39.939028+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.939028+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:27.487187+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.104229+0000","last_change":"2024-09-22T08:14:48.104144+0000","last_active":"2024-09-22T08:14:48.104229+0000","last_peered":"2024-09-22T08:14:48.104229+0000","last_clean":"2024-09-22T08:14:48.104229+0000","last_became_active":"2024-09-22T08:10:51.202422+0000","last_became_peered":"2024-09-22T08:10:51.202422+0000","last_unstale":"2024-09-22T08:14:48.104229+0000","last_undegraded":"2024-09-22T08:14:48.104229+0000","last_fullsized":"2024-09-22T08:14:48.104229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:48.104065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:48.104065+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.104065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:38.165541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:20.075768+0000","last_change":"2024-09-22T08:15:20.075711+0000","last_active":"2024-09-22T08:15:20.075768+0000","last_peered":"2024-09-22T08:15:20.075768+0000","last_clean":"2024-09-22T08:15:20.075768+0000","last_became_active":"2024-09-22T08:10:53.199894+0000","last_became_peered":"2024-09-22T08:10:53.199894+0000","last_unstale":"2024-09-22T08:15:20.075768+0000","last_undegraded":"2024-09-22T08:15:20.075768+0000","last_fullsized":"2024-09-22T08:15:20.075768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:20.075619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:20.075619+0000","last_clean_scrub_stamp":"2024-09-22T08:15:20.075619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:11.727804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.862687+0000","last_change":"2024-09-22T08:14:18.862623+0000","last_active":"2024-09-22T08:14:18.862687+0000","last_peered":"2024-09-22T08:14:18.862687+0000","last_clean":"2024-09-22T08:14:18.862687+0000","last_became_active":"2024-09-22T08:10:45.166816+0000","last_became_peered":"2024-09-22T08:10:45.166816+0000","last_unstale":"2024-09-22T08:14:18.862687+0000","last_undegraded":"2024-09-22T08:14:18.862687+0000","last_fullsized":"2024-09-22T08:14:18.862687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:18.862531+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:18.862531+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.862531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:02.403117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.269417+0000","last_change":"2024-09-22T08:14:04.269311+0000","last_active":"2024-09-22T08:14:04.269417+0000","last_peered":"2024-09-22T08:14:04.269417+0000","last_clean":"2024-09-22T08:14:04.269417+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:14:04.269417+0000","last_undegraded":"2024-09-22T08:14:04.269417+0000","last_fullsized":"2024-09-22T08:14:04.269417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:14:04.269206+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:14:04.269206+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.269206+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:50.609384+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.799010+0000","last_change":"2024-09-22T08:14:03.798946+0000","last_active":"2024-09-22T08:14:03.799010+0000","last_peered":"2024-09-22T08:14:03.799010+0000","last_clean":"2024-09-22T08:14:03.799010+0000","last_became_active":"2024-09-22T08:10:43.187103+0000","last_became_peered":"2024-09-22T08:10:43.187103+0000","last_unstale":"2024-09-22T08:14:03.799010+0000","last_undegraded":"2024-09-22T08:14:03.799010+0000","last_fullsized":"2024-09-22T08:14:03.799010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:03.798857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:03.798857+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.798857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:24.946857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.030556+0000","last_change":"2024-09-22T08:14:32.030496+0000","last_active":"2024-09-22T08:14:32.030556+0000","last_peered":"2024-09-22T08:14:32.030556+0000","last_clean":"2024-09-22T08:14:32.030556+0000","last_became_active":"2024-09-22T08:10:47.168480+0000","last_became_peered":"2024-09-22T08:10:47.168480+0000","last_unstale":"2024-09-22T08:14:32.030556+0000","last_undegraded":"2024-09-22T08:14:32.030556+0000","last_fullsized":"2024-09-22T08:14:32.030556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:32.030385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:32.030385+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.030385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:36.251439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'21","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:00.139702+0000","last_change":"2024-09-22T08:15:00.139646+0000","last_active":"2024-09-22T08:15:00.139702+0000","last_peered":"2024-09-22T08:15:00.139702+0000","last_clean":"2024-09-22T08:15:00.139702+0000","last_became_active":"2024-09-22T08:10:49.184961+0000","last_became_peered":"2024-09-22T08:10:49.184961+0000","last_unstale":"2024-09-22T08:15:00.139702+0000","last_undegraded":"2024-09-22T08:15:00.139702+0000","last_fullsized":"2024-09-22T08:15:00.139702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-22T08:15:00.139531+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-22T08:15:00.139531+0000","last_clean_scrub_stamp":"2024-09-22T08:15:00.139531+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:34.103957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:13.040441+0000","last_change":"2024-09-22T08:15:13.040441+0000","last_active":"2024-09-22T08:15:13.040441+0000","last_peered":"2024-09-22T08:15:13.040441+0000","last_clean":"2024-09-22T08:15:13.040441+0000","last_became_active":"2024-09-22T08:10:51.195643+0000","last_became_peered":"2024-09-22T08:10:51.195643+0000","last_unstale":"2024-09-22T08:15:13.040441+0000","last_undegraded":"2024-09-22T08:15:13.040441+0000","last_fullsized":"2024-09-22T08:15:13.040441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.040340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.040340+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.040340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:00.026258+0000","last_change":"2024-09-22T08:15:00.026186+0000","last_active":"2024-09-22T08:15:00.026258+0000","last_peered":"2024-09-22T08:15:00.026258+0000","last_clean":"2024-09-22T08:15:00.026258+0000","last_became_active":"2024-09-22T08:10:53.203330+0000","last_became_peered":"2024-09-22T08:10:53.203330+0000","last_unstale":"2024-09-22T08:15:00.026258+0000","last_undegraded":"2024-09-22T08:15:00.026258+0000","last_fullsized":"2024-09-22T08:15:00.026258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:15:00.026100+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:15:00.026100+0000","last_clean_scrub_stamp":"2024-09-22T08:15:00.026100+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:04.621822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.790753+0000","last_change":"2024-09-22T08:14:17.790672+0000","last_active":"2024-09-22T08:14:17.790753+0000","last_peered":"2024-09-22T08:14:17.790753+0000","last_clean":"2024-09-22T08:14:17.790753+0000","last_became_active":"2024-09-22T08:10:45.182276+0000","last_became_peered":"2024-09-22T08:10:45.182276+0000","last_unstale":"2024-09-22T08:14:17.790753+0000","last_undegraded":"2024-09-22T08:14:17.790753+0000","last_fullsized":"2024-09-22T08:14:17.790753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:17.790565+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:17.790565+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.790565+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:25.799618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.787575+0000","last_change":"2024-09-22T08:14:05.787504+0000","last_active":"2024-09-22T08:14:05.787575+0000","last_peered":"2024-09-22T08:14:05.787575+0000","last_clean":"2024-09-22T08:14:05.787575+0000","last_became_active":"2024-09-22T08:10:43.186175+0000","last_became_peered":"2024-09-22T08:10:43.186175+0000","last_unstale":"2024-09-22T08:14:05.787575+0000","last_undegraded":"2024-09-22T08:14:05.787575+0000","last_fullsized":"2024-09-22T08:14:05.787575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:05.787417+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:05.787417+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.787417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:42.384319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.983831+0000","last_change":"2024-09-22T08:14:03.983783+0000","last_active":"2024-09-22T08:14:03.983831+0000","last_peered":"2024-09-22T08:14:03.983831+0000","last_clean":"2024-09-22T08:14:03.983831+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:14:03.983831+0000","last_undegraded":"2024-09-22T08:14:03.983831+0000","last_fullsized":"2024-09-22T08:14:03.983831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:03.983713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:03.983713+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.983713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:58.921961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.015306+0000","last_change":"2024-09-22T08:14:34.015250+0000","last_active":"2024-09-22T08:14:34.015306+0000","last_peered":"2024-09-22T08:14:34.015306+0000","last_clean":"2024-09-22T08:14:34.015306+0000","last_became_active":"2024-09-22T08:10:47.167620+0000","last_became_peered":"2024-09-22T08:10:47.167620+0000","last_unstale":"2024-09-22T08:14:34.015306+0000","last_undegraded":"2024-09-22T08:14:34.015306+0000","last_fullsized":"2024-09-22T08:14:34.015306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:34.015156+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:34.015156+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.015156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:40.094721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'79","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.033522+0000","last_change":"2024-09-22T08:14:40.033421+0000","last_active":"2024-09-22T08:14:40.033522+0000","last_peered":"2024-09-22T08:14:40.033522+0000","last_clean":"2024-09-22T08:14:40.033522+0000","last_became_active":"2024-09-22T08:10:49.184753+0000","last_became_peered":"2024-09-22T08:10:49.184753+0000","last_unstale":"2024-09-22T08:14:40.033522+0000","last_undegraded":"2024-09-22T08:14:40.033522+0000","last_fullsized":"2024-09-22T08:14:40.033522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'79","last_scrub_stamp":"2024-09-22T08:14:40.033261+0000","last_deep_scrub":"34'79","last_deep_scrub_stamp":"2024-09-22T08:14:40.033261+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.033261+0000","objects_scrubbed":9,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:08.329565+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.865327+0000","last_change":"2024-09-22T08:14:45.865265+0000","last_active":"2024-09-22T08:14:45.865327+0000","last_peered":"2024-09-22T08:14:45.865327+0000","last_clean":"2024-09-22T08:14:45.865327+0000","last_became_active":"2024-09-22T08:10:51.196724+0000","last_became_peered":"2024-09-22T08:10:51.196724+0000","last_unstale":"2024-09-22T08:14:45.865327+0000","last_undegraded":"2024-09-22T08:14:45.865327+0000","last_fullsized":"2024-09-22T08:14:45.865327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:45.865172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:45.865172+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.865172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:03.500814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.036807+0000","last_change":"2024-09-22T08:14:57.036807+0000","last_active":"2024-09-22T08:14:57.036807+0000","last_peered":"2024-09-22T08:14:57.036807+0000","last_clean":"2024-09-22T08:14:57.036807+0000","last_became_active":"2024-09-22T08:10:53.196406+0000","last_became_peered":"2024-09-22T08:10:53.196406+0000","last_unstale":"2024-09-22T08:14:57.036807+0000","last_undegraded":"2024-09-22T08:14:57.036807+0000","last_fullsized":"2024-09-22T08:14:57.036807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-22T08:14:57.036723+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-22T08:14:57.036723+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.036723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:02:08.231558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.830960+0000","last_change":"2024-09-22T08:14:18.830904+0000","last_active":"2024-09-22T08:14:18.830960+0000","last_peered":"2024-09-22T08:14:18.830960+0000","last_clean":"2024-09-22T08:14:18.830960+0000","last_became_active":"2024-09-22T08:10:45.176601+0000","last_became_peered":"2024-09-22T08:10:45.176601+0000","last_unstale":"2024-09-22T08:14:18.830960+0000","last_undegraded":"2024-09-22T08:14:18.830960+0000","last_fullsized":"2024-09-22T08:14:18.830960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:18.830805+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.830805+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.830805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:34.352591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.951111+0000","last_change":"2024-09-22T08:14:06.951005+0000","last_active":"2024-09-22T08:14:06.951111+0000","last_peered":"2024-09-22T08:14:06.951111+0000","last_clean":"2024-09-22T08:14:06.951111+0000","last_became_active":"2024-09-22T08:10:43.186758+0000","last_became_peered":"2024-09-22T08:10:43.186758+0000","last_unstale":"2024-09-22T08:14:06.951111+0000","last_undegraded":"2024-09-22T08:14:06.951111+0000","last_fullsized":"2024-09-22T08:14:06.951111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:06.950903+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:06.950903+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.950903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:00.975454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.240086+0000","last_change":"2024-09-22T08:14:08.240026+0000","last_active":"2024-09-22T08:14:08.240086+0000","last_peered":"2024-09-22T08:14:08.240086+0000","last_clean":"2024-09-22T08:14:08.240086+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:14:08.240086+0000","last_undegraded":"2024-09-22T08:14:08.240086+0000","last_fullsized":"2024-09-22T08:14:08.240086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.239939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.239939+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.239939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:30.468689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:52.058236+0000","last_change":"2024-09-22T08:14:52.058180+0000","last_active":"2024-09-22T08:14:52.058236+0000","last_peered":"2024-09-22T08:14:52.058236+0000","last_clean":"2024-09-22T08:14:52.058236+0000","last_became_active":"2024-09-22T08:10:47.173348+0000","last_became_peered":"2024-09-22T08:10:47.173348+0000","last_unstale":"2024-09-22T08:14:52.058236+0000","last_undegraded":"2024-09-22T08:14:52.058236+0000","last_fullsized":"2024-09-22T08:14:52.058236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:52.058080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:52.058080+0000","last_clean_scrub_stamp":"2024-09-22T08:14:52.058080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:37.500789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.847583+0000","last_change":"2024-09-22T08:14:44.847529+0000","last_active":"2024-09-22T08:14:44.847583+0000","last_peered":"2024-09-22T08:14:44.847583+0000","last_clean":"2024-09-22T08:14:44.847583+0000","last_became_active":"2024-09-22T08:10:49.187184+0000","last_became_peered":"2024-09-22T08:10:49.187184+0000","last_unstale":"2024-09-22T08:14:44.847583+0000","last_undegraded":"2024-09-22T08:14:44.847583+0000","last_fullsized":"2024-09-22T08:14:44.847583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-22T08:14:44.847434+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-22T08:14:44.847434+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.847434+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:38.526852+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.958335+0000","last_change":"2024-09-22T08:14:51.958279+0000","last_active":"2024-09-22T08:14:51.958335+0000","last_peered":"2024-09-22T08:14:51.958335+0000","last_clean":"2024-09-22T08:14:51.958335+0000","last_became_active":"2024-09-22T08:10:51.197111+0000","last_became_peered":"2024-09-22T08:10:51.197111+0000","last_unstale":"2024-09-22T08:14:51.958335+0000","last_undegraded":"2024-09-22T08:14:51.958335+0000","last_fullsized":"2024-09-22T08:14:51.958335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:51.958172+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:51.958172+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.958172+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:42.019648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:07.587722+0000","last_change":"2024-09-22T08:10:53.200428+0000","last_active":"2024-09-22T08:13:07.587722+0000","last_peered":"2024-09-22T08:13:07.587722+0000","last_clean":"2024-09-22T08:13:07.587722+0000","last_became_active":"2024-09-22T08:10:53.199612+0000","last_became_peered":"2024-09-22T08:10:53.199612+0000","last_unstale":"2024-09-22T08:13:07.587722+0000","last_undegraded":"2024-09-22T08:13:07.587722+0000","last_fullsized":"2024-09-22T08:13:07.587722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.199484+0000","last_change":"2024-09-22T08:14:32.199399+0000","last_active":"2024-09-22T08:14:32.199484+0000","last_peered":"2024-09-22T08:14:32.199484+0000","last_clean":"2024-09-22T08:14:32.199484+0000","last_became_active":"2024-09-22T08:10:45.183229+0000","last_became_peered":"2024-09-22T08:10:45.183229+0000","last_unstale":"2024-09-22T08:14:32.199484+0000","last_undegraded":"2024-09-22T08:14:32.199484+0000","last_fullsized":"2024-09-22T08:14:32.199484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:32.199294+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:32.199294+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.199294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:42.593819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.315254+0000","last_change":"2024-09-22T08:14:10.315191+0000","last_active":"2024-09-22T08:14:10.315254+0000","last_peered":"2024-09-22T08:14:10.315254+0000","last_clean":"2024-09-22T08:14:10.315254+0000","last_became_active":"2024-09-22T08:10:43.198637+0000","last_became_peered":"2024-09-22T08:10:43.198637+0000","last_unstale":"2024-09-22T08:14:10.315254+0000","last_undegraded":"2024-09-22T08:14:10.315254+0000","last_fullsized":"2024-09-22T08:14:10.315254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:10.315107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:10.315107+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.315107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:31.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:02.966971+0000","last_change":"2024-09-22T08:14:02.966909+0000","last_active":"2024-09-22T08:14:02.966971+0000","last_peered":"2024-09-22T08:14:02.966971+0000","last_clean":"2024-09-22T08:14:02.966971+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:14:02.966971+0000","last_undegraded":"2024-09-22T08:14:02.966971+0000","last_fullsized":"2024-09-22T08:14:02.966971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:02.966839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:02.966839+0000","last_clean_scrub_stamp":"2024-09-22T08:14:02.966839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:08.371695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.061262+0000","last_change":"2024-09-22T08:14:51.061185+0000","last_active":"2024-09-22T08:14:51.061262+0000","last_peered":"2024-09-22T08:14:51.061262+0000","last_clean":"2024-09-22T08:14:51.061262+0000","last_became_active":"2024-09-22T08:11:23.216676+0000","last_became_peered":"2024-09-22T08:11:23.216676+0000","last_unstale":"2024-09-22T08:14:51.061262+0000","last_undegraded":"2024-09-22T08:14:51.061262+0000","last_fullsized":"2024-09-22T08:14:51.061262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:51.061100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:51.061100+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.061100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:02.961951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:58.087045+0000","last_change":"2024-09-22T08:14:58.086988+0000","last_active":"2024-09-22T08:14:58.087045+0000","last_peered":"2024-09-22T08:14:58.087045+0000","last_clean":"2024-09-22T08:14:58.087045+0000","last_became_active":"2024-09-22T08:10:49.188309+0000","last_became_peered":"2024-09-22T08:10:49.188309+0000","last_unstale":"2024-09-22T08:14:58.087045+0000","last_undegraded":"2024-09-22T08:14:58.087045+0000","last_fullsized":"2024-09-22T08:14:58.087045+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-22T08:14:58.086893+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-22T08:14:58.086893+0000","last_clean_scrub_stamp":"2024-09-22T08:14:58.086893+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:44.496314+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.105970+0000","last_change":"2024-09-22T08:14:45.105923+0000","last_active":"2024-09-22T08:14:45.105970+0000","last_peered":"2024-09-22T08:14:45.105970+0000","last_clean":"2024-09-22T08:14:45.105970+0000","last_became_active":"2024-09-22T08:10:51.192058+0000","last_became_peered":"2024-09-22T08:10:51.192058+0000","last_unstale":"2024-09-22T08:14:45.105970+0000","last_undegraded":"2024-09-22T08:14:45.105970+0000","last_fullsized":"2024-09-22T08:14:45.105970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:45.105854+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:45.105854+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.105854+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:19.242010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:02.067863+0000","last_change":"2024-09-22T08:15:02.067750+0000","last_active":"2024-09-22T08:15:02.067863+0000","last_peered":"2024-09-22T08:15:02.067863+0000","last_clean":"2024-09-22T08:15:02.067863+0000","last_became_active":"2024-09-22T08:10:53.203670+0000","last_became_peered":"2024-09-22T08:10:53.203670+0000","last_unstale":"2024-09-22T08:15:02.067863+0000","last_undegraded":"2024-09-22T08:15:02.067863+0000","last_fullsized":"2024-09-22T08:15:02.067863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:15:02.067649+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:15:02.067649+0000","last_clean_scrub_stamp":"2024-09-22T08:15:02.067649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:21.196732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'17","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.858477+0000","last_change":"2024-09-22T08:14:19.858415+0000","last_active":"2024-09-22T08:14:19.858477+0000","last_peered":"2024-09-22T08:14:19.858477+0000","last_clean":"2024-09-22T08:14:19.858477+0000","last_became_active":"2024-09-22T08:10:45.171667+0000","last_became_peered":"2024-09-22T08:10:45.171667+0000","last_unstale":"2024-09-22T08:14:19.858477+0000","last_undegraded":"2024-09-22T08:14:19.858477+0000","last_fullsized":"2024-09-22T08:14:19.858477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-22T08:14:19.858328+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-22T08:14:19.858328+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.858328+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:20.434578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.704638+0000","last_change":"2024-09-22T08:14:04.704581+0000","last_active":"2024-09-22T08:14:04.704638+0000","last_peered":"2024-09-22T08:14:04.704638+0000","last_clean":"2024-09-22T08:14:04.704638+0000","last_became_active":"2024-09-22T08:10:43.182161+0000","last_became_peered":"2024-09-22T08:10:43.182161+0000","last_unstale":"2024-09-22T08:14:04.704638+0000","last_undegraded":"2024-09-22T08:14:04.704638+0000","last_fullsized":"2024-09-22T08:14:04.704638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:04.704488+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:04.704488+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.704488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:26.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.215265+0000","last_change":"2024-09-22T08:14:07.215210+0000","last_active":"2024-09-22T08:14:07.215265+0000","last_peered":"2024-09-22T08:14:07.215265+0000","last_clean":"2024-09-22T08:14:07.215265+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:14:07.215265+0000","last_undegraded":"2024-09-22T08:14:07.215265+0000","last_fullsized":"2024-09-22T08:14:07.215265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:07.215094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:07.215094+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.215094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:24.079988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.032150+0000","last_change":"2024-09-22T08:14:49.032150+0000","last_active":"2024-09-22T08:14:49.032150+0000","last_peered":"2024-09-22T08:14:49.032150+0000","last_clean":"2024-09-22T08:14:49.032150+0000","last_became_active":"2024-09-22T08:10:47.172441+0000","last_became_peered":"2024-09-22T08:10:47.172441+0000","last_unstale":"2024-09-22T08:14:49.032150+0000","last_undegraded":"2024-09-22T08:14:49.032150+0000","last_fullsized":"2024-09-22T08:14:49.032150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:49.032018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:49.032018+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.032018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:39.744849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'99","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.904053+0000","last_change":"2024-09-22T08:14:40.903978+0000","last_active":"2024-09-22T08:14:40.904053+0000","last_peered":"2024-09-22T08:14:40.904053+0000","last_clean":"2024-09-22T08:14:40.904053+0000","last_became_active":"2024-09-22T08:10:49.184942+0000","last_became_peered":"2024-09-22T08:10:49.184942+0000","last_unstale":"2024-09-22T08:14:40.904053+0000","last_undegraded":"2024-09-22T08:14:40.904053+0000","last_fullsized":"2024-09-22T08:14:40.904053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'99","last_scrub_stamp":"2024-09-22T08:14:40.903848+0000","last_deep_scrub":"34'99","last_deep_scrub_stamp":"2024-09-22T08:14:40.903848+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.903848+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:07.358495+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.127662+0000","last_change":"2024-09-22T08:14:46.127575+0000","last_active":"2024-09-22T08:14:46.127662+0000","last_peered":"2024-09-22T08:14:46.127662+0000","last_clean":"2024-09-22T08:14:46.127662+0000","last_became_active":"2024-09-22T08:10:51.194912+0000","last_became_peered":"2024-09-22T08:10:51.194912+0000","last_unstale":"2024-09-22T08:14:46.127662+0000","last_undegraded":"2024-09-22T08:14:46.127662+0000","last_fullsized":"2024-09-22T08:14:46.127662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:46.127459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:46.127459+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.127459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:56.216743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.977114+0000","last_change":"2024-09-22T08:14:55.977006+0000","last_active":"2024-09-22T08:14:55.977114+0000","last_peered":"2024-09-22T08:14:55.977114+0000","last_clean":"2024-09-22T08:14:55.977114+0000","last_became_active":"2024-09-22T08:10:53.192189+0000","last_became_peered":"2024-09-22T08:10:53.192189+0000","last_unstale":"2024-09-22T08:14:55.977114+0000","last_undegraded":"2024-09-22T08:14:55.977114+0000","last_fullsized":"2024-09-22T08:14:55.977114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.976887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.976887+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.976887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:39.042717+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.959017+0000","last_change":"2024-09-22T08:14:57.958918+0000","last_active":"2024-09-22T08:14:57.959017+0000","last_peered":"2024-09-22T08:14:57.959017+0000","last_clean":"2024-09-22T08:14:57.959017+0000","last_became_active":"2024-09-22T08:10:53.197799+0000","last_became_peered":"2024-09-22T08:10:53.197799+0000","last_unstale":"2024-09-22T08:14:57.959017+0000","last_undegraded":"2024-09-22T08:14:57.959017+0000","last_fullsized":"2024-09-22T08:14:57.959017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:57.958818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:57.958818+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.958818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:32:50.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.911762+0000","last_change":"2024-09-22T08:14:22.911762+0000","last_active":"2024-09-22T08:14:22.911762+0000","last_peered":"2024-09-22T08:14:22.911762+0000","last_clean":"2024-09-22T08:14:22.911762+0000","last_became_active":"2024-09-22T08:10:45.173916+0000","last_became_peered":"2024-09-22T08:10:45.173916+0000","last_unstale":"2024-09-22T08:14:22.911762+0000","last_undegraded":"2024-09-22T08:14:22.911762+0000","last_fullsized":"2024-09-22T08:14:22.911762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:22.911670+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:22.911670+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.911670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:48.789223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.225320+0000","last_change":"2024-09-22T08:14:18.225254+0000","last_active":"2024-09-22T08:14:18.225320+0000","last_peered":"2024-09-22T08:14:18.225320+0000","last_clean":"2024-09-22T08:14:18.225320+0000","last_became_active":"2024-09-22T08:10:43.201007+0000","last_became_peered":"2024-09-22T08:10:43.201007+0000","last_unstale":"2024-09-22T08:14:18.225320+0000","last_undegraded":"2024-09-22T08:14:18.225320+0000","last_fullsized":"2024-09-22T08:14:18.225320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:18.225171+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.225171+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.225171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:48.896171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.812893+0000","last_change":"2024-09-22T08:14:40.812893+0000","last_active":"2024-09-22T08:14:40.812893+0000","last_peered":"2024-09-22T08:14:40.812893+0000","last_clean":"2024-09-22T08:14:40.812893+0000","last_became_active":"2024-09-22T08:10:47.175524+0000","last_became_peered":"2024-09-22T08:10:47.175524+0000","last_unstale":"2024-09-22T08:14:40.812893+0000","last_undegraded":"2024-09-22T08:14:40.812893+0000","last_fullsized":"2024-09-22T08:14:40.812893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:40.812810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:40.812810+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.812810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:50.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'40","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:06.128454+0000","last_change":"2024-09-22T08:15:06.128454+0000","last_active":"2024-09-22T08:15:06.128454+0000","last_peered":"2024-09-22T08:15:06.128454+0000","last_clean":"2024-09-22T08:15:06.128454+0000","last_became_active":"2024-09-22T08:10:49.185693+0000","last_became_peered":"2024-09-22T08:10:49.185693+0000","last_unstale":"2024-09-22T08:15:06.128454+0000","last_undegraded":"2024-09-22T08:15:06.128454+0000","last_fullsized":"2024-09-22T08:15:06.128454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-22T08:15:06.128366+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-22T08:15:06.128366+0000","last_clean_scrub_stamp":"2024-09-22T08:15:06.128366+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:56.570804+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:14.970812+0000","last_change":"2024-09-22T08:15:14.970812+0000","last_active":"2024-09-22T08:15:14.970812+0000","last_peered":"2024-09-22T08:15:14.970812+0000","last_clean":"2024-09-22T08:15:14.970812+0000","last_became_active":"2024-09-22T08:10:51.199799+0000","last_became_peered":"2024-09-22T08:10:51.199799+0000","last_unstale":"2024-09-22T08:15:14.970812+0000","last_undegraded":"2024-09-22T08:15:14.970812+0000","last_fullsized":"2024-09-22T08:15:14.970812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:14.970699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:14.970699+0000","last_clean_scrub_stamp":"2024-09-22T08:15:14.970699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:21.254528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'14","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:04.034975+0000","last_change":"2024-09-22T08:15:04.034975+0000","last_active":"2024-09-22T08:15:04.034975+0000","last_peered":"2024-09-22T08:15:04.034975+0000","last_clean":"2024-09-22T08:15:04.034975+0000","last_became_active":"2024-09-22T08:10:53.201209+0000","last_became_peered":"2024-09-22T08:10:53.201209+0000","last_unstale":"2024-09-22T08:15:04.034975+0000","last_undegraded":"2024-09-22T08:15:04.034975+0000","last_fullsized":"2024-09-22T08:15:04.034975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:15:04.034870+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:15:04.034870+0000","last_clean_scrub_stamp":"2024-09-22T08:15:04.034870+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:48.016764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":69,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'12","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.885259+0000","last_change":"2024-09-22T08:14:22.885259+0000","last_active":"2024-09-22T08:14:22.885259+0000","last_peered":"2024-09-22T08:14:22.885259+0000","last_clean":"2024-09-22T08:14:22.885259+0000","last_became_active":"2024-09-22T08:10:45.182245+0000","last_became_peered":"2024-09-22T08:10:45.182245+0000","last_unstale":"2024-09-22T08:14:22.885259+0000","last_undegraded":"2024-09-22T08:14:22.885259+0000","last_fullsized":"2024-09-22T08:14:22.885259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:22.885177+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:22.885177+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.885177+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:18.269445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.706396+0000","last_change":"2024-09-22T08:14:10.706396+0000","last_active":"2024-09-22T08:14:10.706396+0000","last_peered":"2024-09-22T08:14:10.706396+0000","last_clean":"2024-09-22T08:14:10.706396+0000","last_became_active":"2024-09-22T08:10:43.185230+0000","last_became_peered":"2024-09-22T08:10:43.185230+0000","last_unstale":"2024-09-22T08:14:10.706396+0000","last_undegraded":"2024-09-22T08:14:10.706396+0000","last_fullsized":"2024-09-22T08:14:10.706396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:10.706291+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:10.706291+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.706291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:16.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.030787+0000","last_change":"2024-09-22T08:14:56.030787+0000","last_active":"2024-09-22T08:14:56.030787+0000","last_peered":"2024-09-22T08:14:56.030787+0000","last_clean":"2024-09-22T08:14:56.030787+0000","last_became_active":"2024-09-22T08:10:47.175747+0000","last_became_peered":"2024-09-22T08:10:47.175747+0000","last_unstale":"2024-09-22T08:14:56.030787+0000","last_undegraded":"2024-09-22T08:14:56.030787+0000","last_fullsized":"2024-09-22T08:14:56.030787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:56.030708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:56.030708+0000","last_clean_scrub_stamp":"2024-09-22T08:14:56.030708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:19.490689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.041367+0000","last_change":"2024-09-22T08:14:41.041367+0000","last_active":"2024-09-22T08:14:41.041367+0000","last_peered":"2024-09-22T08:14:41.041367+0000","last_clean":"2024-09-22T08:14:41.041367+0000","last_became_active":"2024-09-22T08:10:49.180921+0000","last_became_peered":"2024-09-22T08:10:49.180921+0000","last_unstale":"2024-09-22T08:14:41.041367+0000","last_undegraded":"2024-09-22T08:14:41.041367+0000","last_fullsized":"2024-09-22T08:14:41.041367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:41.041241+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:41.041241+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.041241+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:34.720660+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.923262+0000","last_change":"2024-09-22T08:14:48.923262+0000","last_active":"2024-09-22T08:14:48.923262+0000","last_peered":"2024-09-22T08:14:48.923262+0000","last_clean":"2024-09-22T08:14:48.923262+0000","last_became_active":"2024-09-22T08:10:51.192989+0000","last_became_peered":"2024-09-22T08:10:51.192989+0000","last_unstale":"2024-09-22T08:14:48.923262+0000","last_undegraded":"2024-09-22T08:14:48.923262+0000","last_fullsized":"2024-09-22T08:14:48.923262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:48.923162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:48.923162+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.923162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:34.528022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:01.097179+0000","last_change":"2024-09-22T08:15:01.097179+0000","last_active":"2024-09-22T08:15:01.097179+0000","last_peered":"2024-09-22T08:15:01.097179+0000","last_clean":"2024-09-22T08:15:01.097179+0000","last_became_active":"2024-09-22T08:10:53.192967+0000","last_became_peered":"2024-09-22T08:10:53.192967+0000","last_unstale":"2024-09-22T08:15:01.097179+0000","last_undegraded":"2024-09-22T08:15:01.097179+0000","last_fullsized":"2024-09-22T08:15:01.097179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:15:01.097092+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:15:01.097092+0000","last_clean_scrub_stamp":"2024-09-22T08:15:01.097092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:15.265735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.890489+0000","last_change":"2024-09-22T08:14:25.890489+0000","last_active":"2024-09-22T08:14:25.890489+0000","last_peered":"2024-09-22T08:14:25.890489+0000","last_clean":"2024-09-22T08:14:25.890489+0000","last_became_active":"2024-09-22T08:10:45.171555+0000","last_became_peered":"2024-09-22T08:10:45.171555+0000","last_unstale":"2024-09-22T08:14:25.890489+0000","last_undegraded":"2024-09-22T08:14:25.890489+0000","last_fullsized":"2024-09-22T08:14:25.890489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:25.890395+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:25.890395+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.890395+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:37.923633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.741592+0000","last_change":"2024-09-22T08:14:09.741592+0000","last_active":"2024-09-22T08:14:09.741592+0000","last_peered":"2024-09-22T08:14:09.741592+0000","last_clean":"2024-09-22T08:14:09.741592+0000","last_became_active":"2024-09-22T08:10:43.187044+0000","last_became_peered":"2024-09-22T08:10:43.187044+0000","last_unstale":"2024-09-22T08:14:09.741592+0000","last_undegraded":"2024-09-22T08:14:09.741592+0000","last_fullsized":"2024-09-22T08:14:09.741592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:09.741505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:09.741505+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.741505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:51.031430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.006667+0000","last_change":"2024-09-22T08:14:35.006667+0000","last_active":"2024-09-22T08:14:35.006667+0000","last_peered":"2024-09-22T08:14:35.006667+0000","last_clean":"2024-09-22T08:14:35.006667+0000","last_became_active":"2024-09-22T08:10:47.177735+0000","last_became_peered":"2024-09-22T08:10:47.177735+0000","last_unstale":"2024-09-22T08:14:35.006667+0000","last_undegraded":"2024-09-22T08:14:35.006667+0000","last_fullsized":"2024-09-22T08:14:35.006667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:35.006578+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:35.006578+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.006578+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:46.461347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.083581+0000","last_change":"2024-09-22T08:14:43.083581+0000","last_active":"2024-09-22T08:14:43.083581+0000","last_peered":"2024-09-22T08:14:43.083581+0000","last_clean":"2024-09-22T08:14:43.083581+0000","last_became_active":"2024-09-22T08:10:49.182557+0000","last_became_peered":"2024-09-22T08:10:49.182557+0000","last_unstale":"2024-09-22T08:14:43.083581+0000","last_undegraded":"2024-09-22T08:14:43.083581+0000","last_fullsized":"2024-09-22T08:14:43.083581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-22T08:14:43.083449+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-22T08:14:43.083449+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.083449+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:56.730021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.993720+0000","last_change":"2024-09-22T08:14:53.993720+0000","last_active":"2024-09-22T08:14:53.993720+0000","last_peered":"2024-09-22T08:14:53.993720+0000","last_clean":"2024-09-22T08:14:53.993720+0000","last_became_active":"2024-09-22T08:10:51.198204+0000","last_became_peered":"2024-09-22T08:10:51.198204+0000","last_unstale":"2024-09-22T08:14:53.993720+0000","last_undegraded":"2024-09-22T08:14:53.993720+0000","last_fullsized":"2024-09-22T08:14:53.993720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.993609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.993609+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.993609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:44.690474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:27.041147+0000","last_change":"2024-09-22T08:10:53.200288+0000","last_active":"2024-09-22T08:11:27.041147+0000","last_peered":"2024-09-22T08:11:27.041147+0000","last_clean":"2024-09-22T08:11:27.041147+0000","last_became_active":"2024-09-22T08:10:53.199827+0000","last_became_peered":"2024-09-22T08:10:53.199827+0000","last_unstale":"2024-09-22T08:11:27.041147+0000","last_undegraded":"2024-09-22T08:11:27.041147+0000","last_fullsized":"2024-09-22T08:11:27.041147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:31.568753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.086499+0000","last_change":"2024-09-22T08:14:37.086499+0000","last_active":"2024-09-22T08:14:37.086499+0000","last_peered":"2024-09-22T08:14:37.086499+0000","last_clean":"2024-09-22T08:14:37.086499+0000","last_became_active":"2024-09-22T08:10:45.183674+0000","last_became_peered":"2024-09-22T08:10:45.183674+0000","last_unstale":"2024-09-22T08:14:37.086499+0000","last_undegraded":"2024-09-22T08:14:37.086499+0000","last_fullsized":"2024-09-22T08:14:37.086499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:37.086391+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:37.086391+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.086391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:29.610650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.769770+0000","last_change":"2024-09-22T08:14:06.769770+0000","last_active":"2024-09-22T08:14:06.769770+0000","last_peered":"2024-09-22T08:14:06.769770+0000","last_clean":"2024-09-22T08:14:06.769770+0000","last_became_active":"2024-09-22T08:10:43.184287+0000","last_became_peered":"2024-09-22T08:10:43.184287+0000","last_unstale":"2024-09-22T08:14:06.769770+0000","last_undegraded":"2024-09-22T08:14:06.769770+0000","last_fullsized":"2024-09-22T08:14:06.769770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:06.769651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:06.769651+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.769651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:24.233361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.038776+0000","last_change":"2024-09-22T08:14:55.038776+0000","last_active":"2024-09-22T08:14:55.038776+0000","last_peered":"2024-09-22T08:14:55.038776+0000","last_clean":"2024-09-22T08:14:55.038776+0000","last_became_active":"2024-09-22T08:10:47.172816+0000","last_became_peered":"2024-09-22T08:10:47.172816+0000","last_unstale":"2024-09-22T08:14:55.038776+0000","last_undegraded":"2024-09-22T08:14:55.038776+0000","last_fullsized":"2024-09-22T08:14:55.038776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.038699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.038699+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.038699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:17.212237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.916067+0000","last_change":"2024-09-22T08:14:41.916067+0000","last_active":"2024-09-22T08:14:41.916067+0000","last_peered":"2024-09-22T08:14:41.916067+0000","last_clean":"2024-09-22T08:14:41.916067+0000","last_became_active":"2024-09-22T08:10:49.180621+0000","last_became_peered":"2024-09-22T08:10:49.180621+0000","last_unstale":"2024-09-22T08:14:41.916067+0000","last_undegraded":"2024-09-22T08:14:41.916067+0000","last_fullsized":"2024-09-22T08:14:41.916067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-22T08:14:41.915971+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-22T08:14:41.915971+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.915971+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:26.481785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.971832+0000","last_change":"2024-09-22T08:14:49.971832+0000","last_active":"2024-09-22T08:14:49.971832+0000","last_peered":"2024-09-22T08:14:49.971832+0000","last_clean":"2024-09-22T08:14:49.971832+0000","last_became_active":"2024-09-22T08:10:51.189640+0000","last_became_peered":"2024-09-22T08:10:51.189640+0000","last_unstale":"2024-09-22T08:14:49.971832+0000","last_undegraded":"2024-09-22T08:14:49.971832+0000","last_fullsized":"2024-09-22T08:14:49.971832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:49.971734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:49.971734+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.971734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:59.141108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.053777+0000","last_change":"2024-09-22T08:14:43.053723+0000","last_active":"2024-09-22T08:14:43.053777+0000","last_peered":"2024-09-22T08:14:43.053777+0000","last_clean":"2024-09-22T08:14:43.053777+0000","last_became_active":"2024-09-22T08:10:45.166591+0000","last_became_peered":"2024-09-22T08:10:45.166591+0000","last_unstale":"2024-09-22T08:14:43.053777+0000","last_undegraded":"2024-09-22T08:14:43.053777+0000","last_fullsized":"2024-09-22T08:14:43.053777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:43.053643+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:43.053643+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.053643+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:54.611177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.239338+0000","last_change":"2024-09-22T08:14:19.239338+0000","last_active":"2024-09-22T08:14:19.239338+0000","last_peered":"2024-09-22T08:14:19.239338+0000","last_clean":"2024-09-22T08:14:19.239338+0000","last_became_active":"2024-09-22T08:10:43.195608+0000","last_became_peered":"2024-09-22T08:10:43.195608+0000","last_unstale":"2024-09-22T08:14:19.239338+0000","last_undegraded":"2024-09-22T08:14:19.239338+0000","last_fullsized":"2024-09-22T08:14:19.239338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:19.239245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:19.239245+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.239245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.221139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.986507+0000","last_change":"2024-09-22T08:14:38.986434+0000","last_active":"2024-09-22T08:14:38.986507+0000","last_peered":"2024-09-22T08:14:38.986507+0000","last_clean":"2024-09-22T08:14:38.986507+0000","last_became_active":"2024-09-22T08:10:47.173043+0000","last_became_peered":"2024-09-22T08:10:47.173043+0000","last_unstale":"2024-09-22T08:14:38.986507+0000","last_undegraded":"2024-09-22T08:14:38.986507+0000","last_fullsized":"2024-09-22T08:14:38.986507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:38.986348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:38.986348+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.986348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:44.350224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'67","reported_seq":140,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.113790+0000","last_change":"2024-09-22T08:14:44.113790+0000","last_active":"2024-09-22T08:14:44.113790+0000","last_peered":"2024-09-22T08:14:44.113790+0000","last_clean":"2024-09-22T08:14:44.113790+0000","last_became_active":"2024-09-22T08:10:49.181611+0000","last_became_peered":"2024-09-22T08:10:49.181611+0000","last_unstale":"2024-09-22T08:14:44.113790+0000","last_undegraded":"2024-09-22T08:14:44.113790+0000","last_fullsized":"2024-09-22T08:14:44.113790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'67","last_scrub_stamp":"2024-09-22T08:14:44.113701+0000","last_deep_scrub":"34'67","last_deep_scrub_stamp":"2024-09-22T08:14:44.113701+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.113701+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:57.977591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:50.991575+0000","last_change":"2024-09-22T08:14:50.991575+0000","last_active":"2024-09-22T08:14:50.991575+0000","last_peered":"2024-09-22T08:14:50.991575+0000","last_clean":"2024-09-22T08:14:50.991575+0000","last_became_active":"2024-09-22T08:10:51.189592+0000","last_became_peered":"2024-09-22T08:10:51.189592+0000","last_unstale":"2024-09-22T08:14:50.991575+0000","last_undegraded":"2024-09-22T08:14:50.991575+0000","last_fullsized":"2024-09-22T08:14:50.991575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:50.991487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:50.991487+0000","last_clean_scrub_stamp":"2024-09-22T08:14:50.991487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:00.870180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:05.044996+0000","last_change":"2024-09-22T08:15:05.044996+0000","last_active":"2024-09-22T08:15:05.044996+0000","last_peered":"2024-09-22T08:15:05.044996+0000","last_clean":"2024-09-22T08:15:05.044996+0000","last_became_active":"2024-09-22T08:10:53.198999+0000","last_became_peered":"2024-09-22T08:10:53.198999+0000","last_unstale":"2024-09-22T08:15:05.044996+0000","last_undegraded":"2024-09-22T08:15:05.044996+0000","last_fullsized":"2024-09-22T08:15:05.044996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:15:05.044897+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:15:05.044897+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.044897+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:24.308782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'22","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.900925+0000","last_change":"2024-09-22T08:14:22.900868+0000","last_active":"2024-09-22T08:14:22.900925+0000","last_peered":"2024-09-22T08:14:22.900925+0000","last_clean":"2024-09-22T08:14:22.900925+0000","last_became_active":"2024-09-22T08:10:45.183173+0000","last_became_peered":"2024-09-22T08:10:45.183173+0000","last_unstale":"2024-09-22T08:14:22.900925+0000","last_undegraded":"2024-09-22T08:14:22.900925+0000","last_fullsized":"2024-09-22T08:14:22.900925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-22T08:14:22.900782+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-22T08:14:22.900782+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.900782+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:29.628187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.818995+0000","last_change":"2024-09-22T08:14:07.818995+0000","last_active":"2024-09-22T08:14:07.818995+0000","last_peered":"2024-09-22T08:14:07.818995+0000","last_clean":"2024-09-22T08:14:07.818995+0000","last_became_active":"2024-09-22T08:10:43.177711+0000","last_became_peered":"2024-09-22T08:10:43.177711+0000","last_unstale":"2024-09-22T08:14:07.818995+0000","last_undegraded":"2024-09-22T08:14:07.818995+0000","last_fullsized":"2024-09-22T08:14:07.818995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:07.818910+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:07.818910+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.818910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:11.966919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.941417+0000","last_change":"2024-09-22T08:14:37.941323+0000","last_active":"2024-09-22T08:14:37.941417+0000","last_peered":"2024-09-22T08:14:37.941417+0000","last_clean":"2024-09-22T08:14:37.941417+0000","last_became_active":"2024-09-22T08:10:47.171702+0000","last_became_peered":"2024-09-22T08:10:47.171702+0000","last_unstale":"2024-09-22T08:14:37.941417+0000","last_undegraded":"2024-09-22T08:14:37.941417+0000","last_fullsized":"2024-09-22T08:14:37.941417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:37.941178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:37.941178+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.941178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:08.673150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:10.094334+0000","last_change":"2024-09-22T08:15:10.094334+0000","last_active":"2024-09-22T08:15:10.094334+0000","last_peered":"2024-09-22T08:15:10.094334+0000","last_clean":"2024-09-22T08:15:10.094334+0000","last_became_active":"2024-09-22T08:10:49.182398+0000","last_became_peered":"2024-09-22T08:10:49.182398+0000","last_unstale":"2024-09-22T08:15:10.094334+0000","last_undegraded":"2024-09-22T08:15:10.094334+0000","last_fullsized":"2024-09-22T08:15:10.094334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-22T08:15:10.094227+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-22T08:15:10.094227+0000","last_clean_scrub_stamp":"2024-09-22T08:15:10.094227+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:14.589649+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.991517+0000","last_change":"2024-09-22T08:14:55.991517+0000","last_active":"2024-09-22T08:14:55.991517+0000","last_peered":"2024-09-22T08:14:55.991517+0000","last_clean":"2024-09-22T08:14:55.991517+0000","last_became_active":"2024-09-22T08:10:51.202485+0000","last_became_peered":"2024-09-22T08:10:51.202485+0000","last_unstale":"2024-09-22T08:14:55.991517+0000","last_undegraded":"2024-09-22T08:14:55.991517+0000","last_fullsized":"2024-09-22T08:14:55.991517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.991428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.991428+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.991428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:55.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:13:52.969767+0000","last_change":"2024-09-22T08:10:53.202374+0000","last_active":"2024-09-22T08:13:52.969767+0000","last_peered":"2024-09-22T08:13:52.969767+0000","last_clean":"2024-09-22T08:13:52.969767+0000","last_became_active":"2024-09-22T08:10:53.201942+0000","last_became_peered":"2024-09-22T08:10:53.201942+0000","last_unstale":"2024-09-22T08:13:52.969767+0000","last_undegraded":"2024-09-22T08:13:52.969767+0000","last_fullsized":"2024-09-22T08:13:52.969767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:00.185249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.078202+0000","last_change":"2024-09-22T08:14:42.078202+0000","last_active":"2024-09-22T08:14:42.078202+0000","last_peered":"2024-09-22T08:14:42.078202+0000","last_clean":"2024-09-22T08:14:42.078202+0000","last_became_active":"2024-09-22T08:10:45.183576+0000","last_became_peered":"2024-09-22T08:10:45.183576+0000","last_unstale":"2024-09-22T08:14:42.078202+0000","last_undegraded":"2024-09-22T08:14:42.078202+0000","last_fullsized":"2024-09-22T08:14:42.078202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:42.078116+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:42.078116+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.078116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:21.619510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.778888+0000","last_change":"2024-09-22T08:14:08.778888+0000","last_active":"2024-09-22T08:14:08.778888+0000","last_peered":"2024-09-22T08:14:08.778888+0000","last_clean":"2024-09-22T08:14:08.778888+0000","last_became_active":"2024-09-22T08:10:43.178403+0000","last_became_peered":"2024-09-22T08:10:43.178403+0000","last_unstale":"2024-09-22T08:14:08.778888+0000","last_undegraded":"2024-09-22T08:14:08.778888+0000","last_fullsized":"2024-09-22T08:14:08.778888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.778788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.778788+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.778788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:11.516811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.941306+0000","last_change":"2024-09-22T08:14:36.941306+0000","last_active":"2024-09-22T08:14:36.941306+0000","last_peered":"2024-09-22T08:14:36.941306+0000","last_clean":"2024-09-22T08:14:36.941306+0000","last_became_active":"2024-09-22T08:10:47.171973+0000","last_became_peered":"2024-09-22T08:10:47.171973+0000","last_unstale":"2024-09-22T08:14:36.941306+0000","last_undegraded":"2024-09-22T08:14:36.941306+0000","last_fullsized":"2024-09-22T08:14:36.941306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:36.941191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:36.941191+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.941191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:39.832853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.127443+0000","last_change":"2024-09-22T08:14:54.127324+0000","last_active":"2024-09-22T08:14:54.127443+0000","last_peered":"2024-09-22T08:14:54.127443+0000","last_clean":"2024-09-22T08:14:54.127443+0000","last_became_active":"2024-09-22T08:10:49.184885+0000","last_became_peered":"2024-09-22T08:10:49.184885+0000","last_unstale":"2024-09-22T08:14:54.127443+0000","last_undegraded":"2024-09-22T08:14:54.127443+0000","last_fullsized":"2024-09-22T08:14:54.127443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-22T08:14:54.127209+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-22T08:14:54.127209+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.127209+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:39.670431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.082126+0000","last_change":"2024-09-22T08:14:55.082126+0000","last_active":"2024-09-22T08:14:55.082126+0000","last_peered":"2024-09-22T08:14:55.082126+0000","last_clean":"2024-09-22T08:14:55.082126+0000","last_became_active":"2024-09-22T08:10:51.193970+0000","last_became_peered":"2024-09-22T08:10:51.193970+0000","last_unstale":"2024-09-22T08:14:55.082126+0000","last_undegraded":"2024-09-22T08:14:55.082126+0000","last_fullsized":"2024-09-22T08:14:55.082126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.082033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.082033+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.082033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:37.412029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:21.075413+0000","last_change":"2024-09-22T08:15:21.075413+0000","last_active":"2024-09-22T08:15:21.075413+0000","last_peered":"2024-09-22T08:15:21.075413+0000","last_clean":"2024-09-22T08:15:21.075413+0000","last_became_active":"2024-09-22T08:10:53.202493+0000","last_became_peered":"2024-09-22T08:10:53.202493+0000","last_unstale":"2024-09-22T08:15:21.075413+0000","last_undegraded":"2024-09-22T08:15:21.075413+0000","last_fullsized":"2024-09-22T08:15:21.075413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:15:21.075333+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:15:21.075333+0000","last_clean_scrub_stamp":"2024-09-22T08:15:21.075333+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:41.270670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.900963+0000","last_change":"2024-09-22T08:14:21.900963+0000","last_active":"2024-09-22T08:14:21.900963+0000","last_peered":"2024-09-22T08:14:21.900963+0000","last_clean":"2024-09-22T08:14:21.900963+0000","last_became_active":"2024-09-22T08:10:45.166540+0000","last_became_peered":"2024-09-22T08:10:45.166540+0000","last_unstale":"2024-09-22T08:14:21.900963+0000","last_undegraded":"2024-09-22T08:14:21.900963+0000","last_fullsized":"2024-09-22T08:14:21.900963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:21.900884+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:21.900884+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.900884+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:18.177848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.228380+0000","last_change":"2024-09-22T08:14:20.228380+0000","last_active":"2024-09-22T08:14:20.228380+0000","last_peered":"2024-09-22T08:14:20.228380+0000","last_clean":"2024-09-22T08:14:20.228380+0000","last_became_active":"2024-09-22T08:10:43.199724+0000","last_became_peered":"2024-09-22T08:10:43.199724+0000","last_unstale":"2024-09-22T08:14:20.228380+0000","last_undegraded":"2024-09-22T08:14:20.228380+0000","last_fullsized":"2024-09-22T08:14:20.228380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:20.228266+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:20.228266+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.228266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:39.492150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.892749+0000","last_change":"2024-09-22T08:14:45.892749+0000","last_active":"2024-09-22T08:14:45.892749+0000","last_peered":"2024-09-22T08:14:45.892749+0000","last_clean":"2024-09-22T08:14:45.892749+0000","last_became_active":"2024-09-22T08:10:47.175541+0000","last_became_peered":"2024-09-22T08:10:47.175541+0000","last_unstale":"2024-09-22T08:14:45.892749+0000","last_undegraded":"2024-09-22T08:14:45.892749+0000","last_fullsized":"2024-09-22T08:14:45.892749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:45.892628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:45.892628+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.892628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:55.127242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:11.072125+0000","last_change":"2024-09-22T08:15:11.072125+0000","last_active":"2024-09-22T08:15:11.072125+0000","last_peered":"2024-09-22T08:15:11.072125+0000","last_clean":"2024-09-22T08:15:11.072125+0000","last_became_active":"2024-09-22T08:10:49.187767+0000","last_became_peered":"2024-09-22T08:10:49.187767+0000","last_unstale":"2024-09-22T08:15:11.072125+0000","last_undegraded":"2024-09-22T08:15:11.072125+0000","last_fullsized":"2024-09-22T08:15:11.072125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-22T08:15:11.072037+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-22T08:15:11.072037+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.072037+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:49:57.456055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":380,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.999494+0000","last_change":"2024-09-22T08:14:51.999420+0000","last_active":"2024-09-22T08:14:51.999494+0000","last_peered":"2024-09-22T08:14:51.999494+0000","last_clean":"2024-09-22T08:14:51.999494+0000","last_became_active":"2024-09-22T08:10:51.197814+0000","last_became_peered":"2024-09-22T08:10:51.197814+0000","last_unstale":"2024-09-22T08:14:51.999494+0000","last_undegraded":"2024-09-22T08:14:51.999494+0000","last_fullsized":"2024-09-22T08:14:51.999494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:51.999327+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:51.999327+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.999327+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:39:55.424693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:22.071381+0000","last_change":"2024-09-22T08:15:22.071381+0000","last_active":"2024-09-22T08:15:22.071381+0000","last_peered":"2024-09-22T08:15:22.071381+0000","last_clean":"2024-09-22T08:15:22.071381+0000","last_became_active":"2024-09-22T08:10:53.199881+0000","last_became_peered":"2024-09-22T08:10:53.199881+0000","last_unstale":"2024-09-22T08:15:22.071381+0000","last_undegraded":"2024-09-22T08:15:22.071381+0000","last_fullsized":"2024-09-22T08:15:22.071381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:22.071290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:22.071290+0000","last_clean_scrub_stamp":"2024-09-22T08:15:22.071290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:18.465072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.934421+0000","last_change":"2024-09-22T08:14:25.934421+0000","last_active":"2024-09-22T08:14:25.934421+0000","last_peered":"2024-09-22T08:14:25.934421+0000","last_clean":"2024-09-22T08:14:25.934421+0000","last_became_active":"2024-09-22T08:10:45.166103+0000","last_became_peered":"2024-09-22T08:10:45.166103+0000","last_unstale":"2024-09-22T08:14:25.934421+0000","last_undegraded":"2024-09-22T08:14:25.934421+0000","last_fullsized":"2024-09-22T08:14:25.934421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:25.934299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:25.934299+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.934299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:29.868493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.769326+0000","last_change":"2024-09-22T08:14:10.769326+0000","last_active":"2024-09-22T08:14:10.769326+0000","last_peered":"2024-09-22T08:14:10.769326+0000","last_clean":"2024-09-22T08:14:10.769326+0000","last_became_active":"2024-09-22T08:10:43.180097+0000","last_became_peered":"2024-09-22T08:10:43.180097+0000","last_unstale":"2024-09-22T08:14:10.769326+0000","last_undegraded":"2024-09-22T08:14:10.769326+0000","last_fullsized":"2024-09-22T08:14:10.769326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:10.769243+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:10.769243+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.769243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:28.728155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.842396+0000","last_change":"2024-09-22T08:14:43.842396+0000","last_active":"2024-09-22T08:14:43.842396+0000","last_peered":"2024-09-22T08:14:43.842396+0000","last_clean":"2024-09-22T08:14:43.842396+0000","last_became_active":"2024-09-22T08:10:47.175604+0000","last_became_peered":"2024-09-22T08:10:47.175604+0000","last_unstale":"2024-09-22T08:14:43.842396+0000","last_undegraded":"2024-09-22T08:14:43.842396+0000","last_fullsized":"2024-09-22T08:14:43.842396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:43.842274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:43.842274+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.842274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:12.138578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.003144+0000","last_change":"2024-09-22T08:14:51.003144+0000","last_active":"2024-09-22T08:14:51.003144+0000","last_peered":"2024-09-22T08:14:51.003144+0000","last_clean":"2024-09-22T08:14:51.003144+0000","last_became_active":"2024-09-22T08:10:49.175817+0000","last_became_peered":"2024-09-22T08:10:49.175817+0000","last_unstale":"2024-09-22T08:14:51.003144+0000","last_undegraded":"2024-09-22T08:14:51.003144+0000","last_fullsized":"2024-09-22T08:14:51.003144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-22T08:14:51.003046+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-22T08:14:51.003046+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.003046+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:30.056044+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:52.177853+0000","last_change":"2024-09-22T08:14:52.177853+0000","last_active":"2024-09-22T08:14:52.177853+0000","last_peered":"2024-09-22T08:14:52.177853+0000","last_clean":"2024-09-22T08:14:52.177853+0000","last_became_active":"2024-09-22T08:10:51.191988+0000","last_became_peered":"2024-09-22T08:10:51.191988+0000","last_unstale":"2024-09-22T08:14:52.177853+0000","last_undegraded":"2024-09-22T08:14:52.177853+0000","last_fullsized":"2024-09-22T08:14:52.177853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:52.177773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:52.177773+0000","last_clean_scrub_stamp":"2024-09-22T08:14:52.177773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:51.750443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:03.070694+0000","last_change":"2024-09-22T08:15:03.070694+0000","last_active":"2024-09-22T08:15:03.070694+0000","last_peered":"2024-09-22T08:15:03.070694+0000","last_clean":"2024-09-22T08:15:03.070694+0000","last_became_active":"2024-09-22T08:10:53.199158+0000","last_became_peered":"2024-09-22T08:10:53.199158+0000","last_unstale":"2024-09-22T08:15:03.070694+0000","last_undegraded":"2024-09-22T08:15:03.070694+0000","last_fullsized":"2024-09-22T08:15:03.070694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.070605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.070605+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.070605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:56.829853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.886211+0000","last_change":"2024-09-22T08:14:23.886211+0000","last_active":"2024-09-22T08:14:23.886211+0000","last_peered":"2024-09-22T08:14:23.886211+0000","last_clean":"2024-09-22T08:14:23.886211+0000","last_became_active":"2024-09-22T08:10:45.165116+0000","last_became_peered":"2024-09-22T08:10:45.165116+0000","last_unstale":"2024-09-22T08:14:23.886211+0000","last_undegraded":"2024-09-22T08:14:23.886211+0000","last_fullsized":"2024-09-22T08:14:23.886211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:23.886075+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:23.886075+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.886075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:31.053533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.266509+0000","last_change":"2024-09-22T08:14:21.266509+0000","last_active":"2024-09-22T08:14:21.266509+0000","last_peered":"2024-09-22T08:14:21.266509+0000","last_clean":"2024-09-22T08:14:21.266509+0000","last_became_active":"2024-09-22T08:10:43.201076+0000","last_became_peered":"2024-09-22T08:10:43.201076+0000","last_unstale":"2024-09-22T08:14:21.266509+0000","last_undegraded":"2024-09-22T08:14:21.266509+0000","last_fullsized":"2024-09-22T08:14:21.266509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:21.266407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:21.266407+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.266407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:15.619690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.961799+0000","last_change":"2024-09-22T08:14:35.961799+0000","last_active":"2024-09-22T08:14:35.961799+0000","last_peered":"2024-09-22T08:14:35.961799+0000","last_clean":"2024-09-22T08:14:35.961799+0000","last_became_active":"2024-09-22T08:10:47.172988+0000","last_became_peered":"2024-09-22T08:10:47.172988+0000","last_unstale":"2024-09-22T08:14:35.961799+0000","last_undegraded":"2024-09-22T08:14:35.961799+0000","last_fullsized":"2024-09-22T08:14:35.961799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:35.961689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:35.961689+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.961689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:47.596270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'38","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.073721+0000","last_change":"2024-09-22T08:14:42.073721+0000","last_active":"2024-09-22T08:14:42.073721+0000","last_peered":"2024-09-22T08:14:42.073721+0000","last_clean":"2024-09-22T08:14:42.073721+0000","last_became_active":"2024-09-22T08:10:49.184860+0000","last_became_peered":"2024-09-22T08:10:49.184860+0000","last_unstale":"2024-09-22T08:14:42.073721+0000","last_undegraded":"2024-09-22T08:14:42.073721+0000","last_fullsized":"2024-09-22T08:14:42.073721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-22T08:14:42.073617+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-22T08:14:42.073617+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.073617+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:51.308231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:17.027912+0000","last_change":"2024-09-22T08:15:17.027912+0000","last_active":"2024-09-22T08:15:17.027912+0000","last_peered":"2024-09-22T08:15:17.027912+0000","last_clean":"2024-09-22T08:15:17.027912+0000","last_became_active":"2024-09-22T08:10:51.199870+0000","last_became_peered":"2024-09-22T08:10:51.199870+0000","last_unstale":"2024-09-22T08:15:17.027912+0000","last_undegraded":"2024-09-22T08:15:17.027912+0000","last_fullsized":"2024-09-22T08:15:17.027912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:17.027821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:17.027821+0000","last_clean_scrub_stamp":"2024-09-22T08:15:17.027821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:45.805630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:11:23.212091+0000","last_change":"2024-09-22T08:10:53.201219+0000","last_active":"2024-09-22T08:11:23.212091+0000","last_peered":"2024-09-22T08:11:23.212091+0000","last_clean":"2024-09-22T08:11:23.212091+0000","last_became_active":"2024-09-22T08:10:53.200904+0000","last_became_peered":"2024-09-22T08:10:53.200904+0000","last_unstale":"2024-09-22T08:11:23.212091+0000","last_undegraded":"2024-09-22T08:11:23.212091+0000","last_fullsized":"2024-09-22T08:11:23.212091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:58.296182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.113489+0000","last_change":"2024-09-22T08:14:41.113489+0000","last_active":"2024-09-22T08:14:41.113489+0000","last_peered":"2024-09-22T08:14:41.113489+0000","last_clean":"2024-09-22T08:14:41.113489+0000","last_became_active":"2024-09-22T08:10:45.165511+0000","last_became_peered":"2024-09-22T08:10:45.165511+0000","last_unstale":"2024-09-22T08:14:41.113489+0000","last_undegraded":"2024-09-22T08:14:41.113489+0000","last_fullsized":"2024-09-22T08:14:41.113489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:41.113388+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:41.113388+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.113388+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:08.634130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.982787+0000","last_change":"2024-09-22T08:14:05.982672+0000","last_active":"2024-09-22T08:14:05.982787+0000","last_peered":"2024-09-22T08:14:05.982787+0000","last_clean":"2024-09-22T08:14:05.982787+0000","last_became_active":"2024-09-22T08:10:43.176954+0000","last_became_peered":"2024-09-22T08:10:43.176954+0000","last_unstale":"2024-09-22T08:14:05.982787+0000","last_undegraded":"2024-09-22T08:14:05.982787+0000","last_fullsized":"2024-09-22T08:14:05.982787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.982575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.982575+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.982575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:15.153255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.835539+0000","last_change":"2024-09-22T08:14:41.835539+0000","last_active":"2024-09-22T08:14:41.835539+0000","last_peered":"2024-09-22T08:14:41.835539+0000","last_clean":"2024-09-22T08:14:41.835539+0000","last_became_active":"2024-09-22T08:10:47.176641+0000","last_became_peered":"2024-09-22T08:10:47.176641+0000","last_unstale":"2024-09-22T08:14:41.835539+0000","last_undegraded":"2024-09-22T08:14:41.835539+0000","last_fullsized":"2024-09-22T08:14:41.835539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:41.835433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:41.835433+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.835433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:24.123944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:09.119219+0000","last_change":"2024-09-22T08:15:09.119219+0000","last_active":"2024-09-22T08:15:09.119219+0000","last_peered":"2024-09-22T08:15:09.119219+0000","last_clean":"2024-09-22T08:15:09.119219+0000","last_became_active":"2024-09-22T08:10:49.187467+0000","last_became_peered":"2024-09-22T08:10:49.187467+0000","last_unstale":"2024-09-22T08:15:09.119219+0000","last_undegraded":"2024-09-22T08:15:09.119219+0000","last_fullsized":"2024-09-22T08:15:09.119219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-22T08:15:09.119130+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-22T08:15:09.119130+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.119130+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:20:39.616422+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:18.005260+0000","last_change":"2024-09-22T08:15:18.005260+0000","last_active":"2024-09-22T08:15:18.005260+0000","last_peered":"2024-09-22T08:15:18.005260+0000","last_clean":"2024-09-22T08:15:18.005260+0000","last_became_active":"2024-09-22T08:10:51.197942+0000","last_became_peered":"2024-09-22T08:10:51.197942+0000","last_unstale":"2024-09-22T08:15:18.005260+0000","last_undegraded":"2024-09-22T08:15:18.005260+0000","last_fullsized":"2024-09-22T08:15:18.005260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:18.005160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:18.005160+0000","last_clean_scrub_stamp":"2024-09-22T08:15:18.005160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:24.954588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:52.573626+0000","last_change":"2024-09-22T08:10:53.204064+0000","last_active":"2024-09-22T08:12:52.573626+0000","last_peered":"2024-09-22T08:12:52.573626+0000","last_clean":"2024-09-22T08:12:52.573626+0000","last_became_active":"2024-09-22T08:10:53.203791+0000","last_became_peered":"2024-09-22T08:10:53.203791+0000","last_unstale":"2024-09-22T08:12:52.573626+0000","last_undegraded":"2024-09-22T08:12:52.573626+0000","last_fullsized":"2024-09-22T08:12:52.573626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:42.795444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.887707+0000","last_change":"2024-09-22T08:14:24.887707+0000","last_active":"2024-09-22T08:14:24.887707+0000","last_peered":"2024-09-22T08:14:24.887707+0000","last_clean":"2024-09-22T08:14:24.887707+0000","last_became_active":"2024-09-22T08:10:45.163402+0000","last_became_peered":"2024-09-22T08:10:45.163402+0000","last_unstale":"2024-09-22T08:14:24.887707+0000","last_undegraded":"2024-09-22T08:14:24.887707+0000","last_fullsized":"2024-09-22T08:14:24.887707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:24.887588+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:24.887588+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.887588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:50.926457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.746542+0000","last_change":"2024-09-22T08:14:09.746483+0000","last_active":"2024-09-22T08:14:09.746542+0000","last_peered":"2024-09-22T08:14:09.746542+0000","last_clean":"2024-09-22T08:14:09.746542+0000","last_became_active":"2024-09-22T08:10:43.184777+0000","last_became_peered":"2024-09-22T08:10:43.184777+0000","last_unstale":"2024-09-22T08:14:09.746542+0000","last_undegraded":"2024-09-22T08:14:09.746542+0000","last_fullsized":"2024-09-22T08:14:09.746542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:09.746395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:09.746395+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.746395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:20.482133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.848918+0000","last_change":"2024-09-22T08:14:42.848918+0000","last_active":"2024-09-22T08:14:42.848918+0000","last_peered":"2024-09-22T08:14:42.848918+0000","last_clean":"2024-09-22T08:14:42.848918+0000","last_became_active":"2024-09-22T08:10:47.176390+0000","last_became_peered":"2024-09-22T08:10:47.176390+0000","last_unstale":"2024-09-22T08:14:42.848918+0000","last_undegraded":"2024-09-22T08:14:42.848918+0000","last_fullsized":"2024-09-22T08:14:42.848918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:14:42.848840+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:14:42.848840+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.848840+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:48.212716+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'42","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:08.142435+0000","last_change":"2024-09-22T08:15:08.142435+0000","last_active":"2024-09-22T08:15:08.142435+0000","last_peered":"2024-09-22T08:15:08.142435+0000","last_clean":"2024-09-22T08:15:08.142435+0000","last_became_active":"2024-09-22T08:10:49.188231+0000","last_became_peered":"2024-09-22T08:10:49.188231+0000","last_unstale":"2024-09-22T08:15:08.142435+0000","last_undegraded":"2024-09-22T08:15:08.142435+0000","last_fullsized":"2024-09-22T08:15:08.142435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'42","last_scrub_stamp":"2024-09-22T08:15:08.142319+0000","last_deep_scrub":"34'42","last_deep_scrub_stamp":"2024-09-22T08:15:08.142319+0000","last_clean_scrub_stamp":"2024-09-22T08:15:08.142319+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:26.959686+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":46,"num_read_kb":60,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:03.058288+0000","last_change":"2024-09-22T08:15:03.058288+0000","last_active":"2024-09-22T08:15:03.058288+0000","last_peered":"2024-09-22T08:15:03.058288+0000","last_clean":"2024-09-22T08:15:03.058288+0000","last_became_active":"2024-09-22T08:10:51.202476+0000","last_became_peered":"2024-09-22T08:10:51.202476+0000","last_unstale":"2024-09-22T08:15:03.058288+0000","last_undegraded":"2024-09-22T08:15:03.058288+0000","last_fullsized":"2024-09-22T08:15:03.058288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.058202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.058202+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.058202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:28:33.729203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:12:51.161803+0000","last_change":"2024-09-22T08:10:53.201417+0000","last_active":"2024-09-22T08:12:51.161803+0000","last_peered":"2024-09-22T08:12:51.161803+0000","last_clean":"2024-09-22T08:12:51.161803+0000","last_became_active":"2024-09-22T08:10:53.201125+0000","last_became_peered":"2024-09-22T08:10:53.201125+0000","last_unstale":"2024-09-22T08:12:51.161803+0000","last_undegraded":"2024-09-22T08:12:51.161803+0000","last_fullsized":"2024-09-22T08:12:51.161803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:10:52.176196+0000","last_clean_scrub_stamp":"2024-09-22T08:10:52.176196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:16.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.837686+0000","last_change":"2024-09-22T08:14:24.837624+0000","last_active":"2024-09-22T08:14:24.837686+0000","last_peered":"2024-09-22T08:14:24.837686+0000","last_clean":"2024-09-22T08:14:24.837686+0000","last_became_active":"2024-09-22T08:10:45.180781+0000","last_became_peered":"2024-09-22T08:10:45.180781+0000","last_unstale":"2024-09-22T08:14:24.837686+0000","last_undegraded":"2024-09-22T08:14:24.837686+0000","last_fullsized":"2024-09-22T08:14:24.837686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:24.837547+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:24.837547+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.837547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:21.114510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.826654+0000","last_change":"2024-09-22T08:14:13.826597+0000","last_active":"2024-09-22T08:14:13.826654+0000","last_peered":"2024-09-22T08:14:13.826654+0000","last_clean":"2024-09-22T08:14:13.826654+0000","last_became_active":"2024-09-22T08:10:43.179693+0000","last_became_peered":"2024-09-22T08:10:43.179693+0000","last_unstale":"2024-09-22T08:14:13.826654+0000","last_undegraded":"2024-09-22T08:14:13.826654+0000","last_fullsized":"2024-09-22T08:14:13.826654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:13.826510+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:13.826510+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.826510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:05.210216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.979010+0000","last_change":"2024-09-22T08:14:27.978947+0000","last_active":"2024-09-22T08:14:27.979010+0000","last_peered":"2024-09-22T08:14:27.979010+0000","last_clean":"2024-09-22T08:14:27.979010+0000","last_became_active":"2024-09-22T08:10:45.164406+0000","last_became_peered":"2024-09-22T08:10:45.164406+0000","last_unstale":"2024-09-22T08:14:27.979010+0000","last_undegraded":"2024-09-22T08:14:27.979010+0000","last_fullsized":"2024-09-22T08:14:27.979010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:27.978856+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:27.978856+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.978856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:45.929432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.893610+0000","last_change":"2024-09-22T08:14:09.893552+0000","last_active":"2024-09-22T08:14:09.893610+0000","last_peered":"2024-09-22T08:14:09.893610+0000","last_clean":"2024-09-22T08:14:09.893610+0000","last_became_active":"2024-09-22T08:10:43.178018+0000","last_became_peered":"2024-09-22T08:10:43.178018+0000","last_unstale":"2024-09-22T08:14:09.893610+0000","last_undegraded":"2024-09-22T08:14:09.893610+0000","last_fullsized":"2024-09-22T08:14:09.893610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:09.893443+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:09.893443+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.893443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:14.018138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.073987+0000","last_change":"2024-09-22T08:14:44.073922+0000","last_active":"2024-09-22T08:14:44.073987+0000","last_peered":"2024-09-22T08:14:44.073987+0000","last_clean":"2024-09-22T08:14:44.073987+0000","last_became_active":"2024-09-22T08:10:45.168526+0000","last_became_peered":"2024-09-22T08:10:45.168526+0000","last_unstale":"2024-09-22T08:14:44.073987+0000","last_undegraded":"2024-09-22T08:14:44.073987+0000","last_fullsized":"2024-09-22T08:14:44.073987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-22T08:14:44.073838+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-22T08:14:44.073838+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.073838+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:01.253414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":86,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.197189+0000","last_change":"2024-09-22T08:14:23.197132+0000","last_active":"2024-09-22T08:14:23.197189+0000","last_peered":"2024-09-22T08:14:23.197189+0000","last_clean":"2024-09-22T08:14:23.197189+0000","last_became_active":"2024-09-22T08:10:43.196221+0000","last_became_peered":"2024-09-22T08:10:43.196221+0000","last_unstale":"2024-09-22T08:14:23.197189+0000","last_undegraded":"2024-09-22T08:14:23.197189+0000","last_fullsized":"2024-09-22T08:14:23.197189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:23.197048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:23.197048+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.197048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:53.693927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.927437+0000","last_change":"2024-09-22T08:14:24.927351+0000","last_active":"2024-09-22T08:14:24.927437+0000","last_peered":"2024-09-22T08:14:24.927437+0000","last_clean":"2024-09-22T08:14:24.927437+0000","last_became_active":"2024-09-22T08:10:45.166432+0000","last_became_peered":"2024-09-22T08:10:45.166432+0000","last_unstale":"2024-09-22T08:14:24.927437+0000","last_undegraded":"2024-09-22T08:14:24.927437+0000","last_fullsized":"2024-09-22T08:14:24.927437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:24.927242+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:24.927242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.927242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:25.223688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.902076+0000","last_change":"2024-09-22T08:14:10.902014+0000","last_active":"2024-09-22T08:14:10.902076+0000","last_peered":"2024-09-22T08:14:10.902076+0000","last_clean":"2024-09-22T08:14:10.902076+0000","last_became_active":"2024-09-22T08:10:43.177673+0000","last_became_peered":"2024-09-22T08:10:43.177673+0000","last_unstale":"2024-09-22T08:14:10.902076+0000","last_undegraded":"2024-09-22T08:14:10.902076+0000","last_fullsized":"2024-09-22T08:14:10.902076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:10.901926+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:10.901926+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.901926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:49.460312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.933843+0000","last_change":"2024-09-22T08:14:26.933779+0000","last_active":"2024-09-22T08:14:26.933843+0000","last_peered":"2024-09-22T08:14:26.933843+0000","last_clean":"2024-09-22T08:14:26.933843+0000","last_became_active":"2024-09-22T08:10:45.171476+0000","last_became_peered":"2024-09-22T08:10:45.171476+0000","last_unstale":"2024-09-22T08:14:26.933843+0000","last_undegraded":"2024-09-22T08:14:26.933843+0000","last_fullsized":"2024-09-22T08:14:26.933843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:26.933687+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:26.933687+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.933687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:15.758235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.868640+0000","last_change":"2024-09-22T08:14:11.868565+0000","last_active":"2024-09-22T08:14:11.868640+0000","last_peered":"2024-09-22T08:14:11.868640+0000","last_clean":"2024-09-22T08:14:11.868640+0000","last_became_active":"2024-09-22T08:10:43.186671+0000","last_became_peered":"2024-09-22T08:10:43.186671+0000","last_unstale":"2024-09-22T08:14:11.868640+0000","last_undegraded":"2024-09-22T08:14:11.868640+0000","last_fullsized":"2024-09-22T08:14:11.868640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:11.868472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:11.868472+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.868472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:04.057150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.851369+0000","last_change":"2024-09-22T08:14:23.851300+0000","last_active":"2024-09-22T08:14:23.851369+0000","last_peered":"2024-09-22T08:14:23.851369+0000","last_clean":"2024-09-22T08:14:23.851369+0000","last_became_active":"2024-09-22T08:10:45.182785+0000","last_became_peered":"2024-09-22T08:10:45.182785+0000","last_unstale":"2024-09-22T08:14:23.851369+0000","last_undegraded":"2024-09-22T08:14:23.851369+0000","last_fullsized":"2024-09-22T08:14:23.851369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:23.851213+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:23.851213+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.851213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:29.971199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.814747+0000","last_change":"2024-09-22T08:14:11.814682+0000","last_active":"2024-09-22T08:14:11.814747+0000","last_peered":"2024-09-22T08:14:11.814747+0000","last_clean":"2024-09-22T08:14:11.814747+0000","last_became_active":"2024-09-22T08:10:43.182824+0000","last_became_peered":"2024-09-22T08:10:43.182824+0000","last_unstale":"2024-09-22T08:14:11.814747+0000","last_undegraded":"2024-09-22T08:14:11.814747+0000","last_fullsized":"2024-09-22T08:14:11.814747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:11.814594+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:11.814594+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.814594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:06.053818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'26","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.938771+0000","last_change":"2024-09-22T08:14:23.938699+0000","last_active":"2024-09-22T08:14:23.938771+0000","last_peered":"2024-09-22T08:14:23.938771+0000","last_clean":"2024-09-22T08:14:23.938771+0000","last_became_active":"2024-09-22T08:10:45.175600+0000","last_became_peered":"2024-09-22T08:10:45.175600+0000","last_unstale":"2024-09-22T08:14:23.938771+0000","last_undegraded":"2024-09-22T08:14:23.938771+0000","last_fullsized":"2024-09-22T08:14:23.938771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-22T08:14:23.938616+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-22T08:14:23.938616+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.938616+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:29.442181+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.753854+0000","last_change":"2024-09-22T08:14:11.753775+0000","last_active":"2024-09-22T08:14:11.753854+0000","last_peered":"2024-09-22T08:14:11.753854+0000","last_clean":"2024-09-22T08:14:11.753854+0000","last_became_active":"2024-09-22T08:10:43.179529+0000","last_became_peered":"2024-09-22T08:10:43.179529+0000","last_unstale":"2024-09-22T08:14:11.753854+0000","last_undegraded":"2024-09-22T08:14:11.753854+0000","last_fullsized":"2024-09-22T08:14:11.753854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:11.753682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:11.753682+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.753682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:24.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.798396+0000","last_change":"2024-09-22T08:14:25.798299+0000","last_active":"2024-09-22T08:14:25.798396+0000","last_peered":"2024-09-22T08:14:25.798396+0000","last_clean":"2024-09-22T08:14:25.798396+0000","last_became_active":"2024-09-22T08:10:45.183901+0000","last_became_peered":"2024-09-22T08:10:45.183901+0000","last_unstale":"2024-09-22T08:14:25.798396+0000","last_undegraded":"2024-09-22T08:14:25.798396+0000","last_fullsized":"2024-09-22T08:14:25.798396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:25.798179+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:25.798179+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.798179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:32.525584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.880245+0000","last_change":"2024-09-22T08:14:12.880179+0000","last_active":"2024-09-22T08:14:12.880245+0000","last_peered":"2024-09-22T08:14:12.880245+0000","last_clean":"2024-09-22T08:14:12.880245+0000","last_became_active":"2024-09-22T08:10:43.177461+0000","last_became_peered":"2024-09-22T08:10:43.177461+0000","last_unstale":"2024-09-22T08:14:12.880245+0000","last_undegraded":"2024-09-22T08:14:12.880245+0000","last_fullsized":"2024-09-22T08:14:12.880245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:12.880088+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:12.880088+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.880088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:57.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'14","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.796120+0000","last_change":"2024-09-22T08:14:28.796120+0000","last_active":"2024-09-22T08:14:28.796120+0000","last_peered":"2024-09-22T08:14:28.796120+0000","last_clean":"2024-09-22T08:14:28.796120+0000","last_became_active":"2024-09-22T08:10:45.169723+0000","last_became_peered":"2024-09-22T08:10:45.169723+0000","last_unstale":"2024-09-22T08:14:28.796120+0000","last_undegraded":"2024-09-22T08:14:28.796120+0000","last_fullsized":"2024-09-22T08:14:28.796120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:28.796011+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:28.796011+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.796011+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:40.829249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.234157+0000","last_change":"2024-09-22T08:14:22.234089+0000","last_active":"2024-09-22T08:14:22.234157+0000","last_peered":"2024-09-22T08:14:22.234157+0000","last_clean":"2024-09-22T08:14:22.234157+0000","last_became_active":"2024-09-22T08:10:43.195587+0000","last_became_peered":"2024-09-22T08:10:43.195587+0000","last_unstale":"2024-09-22T08:14:22.234157+0000","last_undegraded":"2024-09-22T08:14:22.234157+0000","last_fullsized":"2024-09-22T08:14:22.234157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:22.234003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:22.234003+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.234003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:20.685742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.026749+0000","last_change":"2024-09-22T08:14:45.026749+0000","last_active":"2024-09-22T08:14:45.026749+0000","last_peered":"2024-09-22T08:14:45.026749+0000","last_clean":"2024-09-22T08:14:45.026749+0000","last_became_active":"2024-09-22T08:10:45.169366+0000","last_became_peered":"2024-09-22T08:10:45.169366+0000","last_unstale":"2024-09-22T08:14:45.026749+0000","last_undegraded":"2024-09-22T08:14:45.026749+0000","last_fullsized":"2024-09-22T08:14:45.026749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:45.026672+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:45.026672+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.026672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:07.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.867714+0000","last_change":"2024-09-22T08:14:13.867652+0000","last_active":"2024-09-22T08:14:13.867714+0000","last_peered":"2024-09-22T08:14:13.867714+0000","last_clean":"2024-09-22T08:14:13.867714+0000","last_became_active":"2024-09-22T08:10:43.187246+0000","last_became_peered":"2024-09-22T08:10:43.187246+0000","last_unstale":"2024-09-22T08:14:13.867714+0000","last_undegraded":"2024-09-22T08:14:13.867714+0000","last_fullsized":"2024-09-22T08:14:13.867714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:13.867567+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:13.867567+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.867567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:08.637420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.014248+0000","last_change":"2024-09-22T08:14:30.014166+0000","last_active":"2024-09-22T08:14:30.014248+0000","last_peered":"2024-09-22T08:14:30.014248+0000","last_clean":"2024-09-22T08:14:30.014248+0000","last_became_active":"2024-09-22T08:10:45.172080+0000","last_became_peered":"2024-09-22T08:10:45.172080+0000","last_unstale":"2024-09-22T08:14:30.014248+0000","last_undegraded":"2024-09-22T08:14:30.014248+0000","last_fullsized":"2024-09-22T08:14:30.014248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:30.014084+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:30.014084+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.014084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:11.302015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.766020+0000","last_change":"2024-09-22T08:14:14.765941+0000","last_active":"2024-09-22T08:14:14.766020+0000","last_peered":"2024-09-22T08:14:14.766020+0000","last_clean":"2024-09-22T08:14:14.766020+0000","last_became_active":"2024-09-22T08:10:43.178924+0000","last_became_peered":"2024-09-22T08:10:43.178924+0000","last_unstale":"2024-09-22T08:14:14.766020+0000","last_undegraded":"2024-09-22T08:14:14.766020+0000","last_fullsized":"2024-09-22T08:14:14.766020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:14.765846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:14.765846+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.765846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:42.012438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.826577+0000","last_change":"2024-09-22T08:14:30.826514+0000","last_active":"2024-09-22T08:14:30.826577+0000","last_peered":"2024-09-22T08:14:30.826577+0000","last_clean":"2024-09-22T08:14:30.826577+0000","last_became_active":"2024-09-22T08:10:45.172101+0000","last_became_peered":"2024-09-22T08:10:45.172101+0000","last_unstale":"2024-09-22T08:14:30.826577+0000","last_undegraded":"2024-09-22T08:14:30.826577+0000","last_fullsized":"2024-09-22T08:14:30.826577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-22T08:14:30.826439+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-22T08:14:30.826439+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.826439+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:48.777015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.756895+0000","last_change":"2024-09-22T08:14:13.756790+0000","last_active":"2024-09-22T08:14:13.756895+0000","last_peered":"2024-09-22T08:14:13.756895+0000","last_clean":"2024-09-22T08:14:13.756895+0000","last_became_active":"2024-09-22T08:10:43.178876+0000","last_became_peered":"2024-09-22T08:10:43.178876+0000","last_unstale":"2024-09-22T08:14:13.756895+0000","last_undegraded":"2024-09-22T08:14:13.756895+0000","last_fullsized":"2024-09-22T08:14:13.756895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:13.756688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:13.756688+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.756688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:05.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.790830+0000","last_change":"2024-09-22T08:14:27.790763+0000","last_active":"2024-09-22T08:14:27.790830+0000","last_peered":"2024-09-22T08:14:27.790830+0000","last_clean":"2024-09-22T08:14:27.790830+0000","last_became_active":"2024-09-22T08:10:45.180117+0000","last_became_peered":"2024-09-22T08:10:45.180117+0000","last_unstale":"2024-09-22T08:14:27.790830+0000","last_undegraded":"2024-09-22T08:14:27.790830+0000","last_fullsized":"2024-09-22T08:14:27.790830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:27.790679+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:27.790679+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.790679+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:28.087125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.212133+0000","last_change":"2024-09-22T08:14:24.212034+0000","last_active":"2024-09-22T08:14:24.212133+0000","last_peered":"2024-09-22T08:14:24.212133+0000","last_clean":"2024-09-22T08:14:24.212133+0000","last_became_active":"2024-09-22T08:10:43.195770+0000","last_became_peered":"2024-09-22T08:10:43.195770+0000","last_unstale":"2024-09-22T08:14:24.212133+0000","last_undegraded":"2024-09-22T08:14:24.212133+0000","last_fullsized":"2024-09-22T08:14:24.212133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:24.211938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:24.211938+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.211938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:35.988551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.741144+0000","last_change":"2024-09-22T08:14:33.741067+0000","last_active":"2024-09-22T08:14:33.741144+0000","last_peered":"2024-09-22T08:14:33.741144+0000","last_clean":"2024-09-22T08:14:33.741144+0000","last_became_active":"2024-09-22T08:10:45.180098+0000","last_became_peered":"2024-09-22T08:10:45.180098+0000","last_unstale":"2024-09-22T08:14:33.741144+0000","last_undegraded":"2024-09-22T08:14:33.741144+0000","last_fullsized":"2024-09-22T08:14:33.741144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:33.740986+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:33.740986+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.740986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:54.421474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.262188+0000","last_change":"2024-09-22T08:14:25.262115+0000","last_active":"2024-09-22T08:14:25.262188+0000","last_peered":"2024-09-22T08:14:25.262188+0000","last_clean":"2024-09-22T08:14:25.262188+0000","last_became_active":"2024-09-22T08:10:43.201687+0000","last_became_peered":"2024-09-22T08:10:43.201687+0000","last_unstale":"2024-09-22T08:14:25.262188+0000","last_undegraded":"2024-09-22T08:14:25.262188+0000","last_fullsized":"2024-09-22T08:14:25.262188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:25.262020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:25.262020+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.262020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:12.187326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.929258+0000","last_change":"2024-09-22T08:14:26.929258+0000","last_active":"2024-09-22T08:14:26.929258+0000","last_peered":"2024-09-22T08:14:26.929258+0000","last_clean":"2024-09-22T08:14:26.929258+0000","last_became_active":"2024-09-22T08:11:23.215110+0000","last_became_peered":"2024-09-22T08:11:23.215110+0000","last_unstale":"2024-09-22T08:14:26.929258+0000","last_undegraded":"2024-09-22T08:14:26.929258+0000","last_fullsized":"2024-09-22T08:14:26.929258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:26.929163+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:26.929163+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.929163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:29.392032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.790729+0000","last_change":"2024-09-22T08:14:12.790672+0000","last_active":"2024-09-22T08:14:12.790729+0000","last_peered":"2024-09-22T08:14:12.790729+0000","last_clean":"2024-09-22T08:14:12.790729+0000","last_became_active":"2024-09-22T08:10:43.187195+0000","last_became_peered":"2024-09-22T08:10:43.187195+0000","last_unstale":"2024-09-22T08:14:12.790729+0000","last_undegraded":"2024-09-22T08:14:12.790729+0000","last_fullsized":"2024-09-22T08:14:12.790729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:12.790570+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:12.790570+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.790570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:57.729020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.829964+0000","last_change":"2024-09-22T08:14:26.829887+0000","last_active":"2024-09-22T08:14:26.829964+0000","last_peered":"2024-09-22T08:14:26.829964+0000","last_clean":"2024-09-22T08:14:26.829964+0000","last_became_active":"2024-09-22T08:10:45.179150+0000","last_became_peered":"2024-09-22T08:10:45.179150+0000","last_unstale":"2024-09-22T08:14:26.829964+0000","last_undegraded":"2024-09-22T08:14:26.829964+0000","last_fullsized":"2024-09-22T08:14:26.829964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:26.829765+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:26.829765+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.829765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:32.333330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.213279+0000","last_change":"2024-09-22T08:14:26.213227+0000","last_active":"2024-09-22T08:14:26.213279+0000","last_peered":"2024-09-22T08:14:26.213279+0000","last_clean":"2024-09-22T08:14:26.213279+0000","last_became_active":"2024-09-22T08:10:43.200282+0000","last_became_peered":"2024-09-22T08:10:43.200282+0000","last_unstale":"2024-09-22T08:14:26.213279+0000","last_undegraded":"2024-09-22T08:14:26.213279+0000","last_fullsized":"2024-09-22T08:14:26.213279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:26.213130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:26.213130+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.213130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:57.522386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.216393+0000","last_change":"2024-09-22T08:14:27.216341+0000","last_active":"2024-09-22T08:14:27.216393+0000","last_peered":"2024-09-22T08:14:27.216393+0000","last_clean":"2024-09-22T08:14:27.216393+0000","last_became_active":"2024-09-22T08:10:43.189848+0000","last_became_peered":"2024-09-22T08:10:43.189848+0000","last_unstale":"2024-09-22T08:14:27.216393+0000","last_undegraded":"2024-09-22T08:14:27.216393+0000","last_fullsized":"2024-09-22T08:14:27.216393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:27.216242+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:27.216242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.216242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:35.518662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.009987+0000","last_change":"2024-09-22T08:14:31.009987+0000","last_active":"2024-09-22T08:14:31.009987+0000","last_peered":"2024-09-22T08:14:31.009987+0000","last_clean":"2024-09-22T08:14:31.009987+0000","last_became_active":"2024-09-22T08:10:45.183407+0000","last_became_peered":"2024-09-22T08:10:45.183407+0000","last_unstale":"2024-09-22T08:14:31.009987+0000","last_undegraded":"2024-09-22T08:14:31.009987+0000","last_fullsized":"2024-09-22T08:14:31.009987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:31.009901+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:31.009901+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.009901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:51.690389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.836700+0000","last_change":"2024-09-22T08:14:14.836700+0000","last_active":"2024-09-22T08:14:14.836700+0000","last_peered":"2024-09-22T08:14:14.836700+0000","last_clean":"2024-09-22T08:14:14.836700+0000","last_became_active":"2024-09-22T08:10:43.187119+0000","last_became_peered":"2024-09-22T08:10:43.187119+0000","last_unstale":"2024-09-22T08:14:14.836700+0000","last_undegraded":"2024-09-22T08:14:14.836700+0000","last_fullsized":"2024-09-22T08:14:14.836700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:14.836597+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:14.836597+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.836597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:22.845650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.769697+0000","last_change":"2024-09-22T08:14:32.769697+0000","last_active":"2024-09-22T08:14:32.769697+0000","last_peered":"2024-09-22T08:14:32.769697+0000","last_clean":"2024-09-22T08:14:32.769697+0000","last_became_active":"2024-09-22T08:11:23.218693+0000","last_became_peered":"2024-09-22T08:11:23.218693+0000","last_unstale":"2024-09-22T08:14:32.769697+0000","last_undegraded":"2024-09-22T08:14:32.769697+0000","last_fullsized":"2024-09-22T08:14:32.769697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:32.769617+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:32.769617+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.769617+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:14.057548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673024,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673023,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":741411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673023,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":742099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":446464,"data_stored":152009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:15:26.036 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:26.036 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:26.037 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:26.037 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:26.037 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:26.037 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:10:52.176196+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=10, tm_sec=52, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=14, tm_sec=1, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T08:15:26.038 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T08:15:46.039 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:15:46.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.153+0000 7f69b0b52640 1 Processor -- start 2024-09-22T08:15:46.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.153+0000 7f69b0b52640 1 -- start start 2024-09-22T08:15:46.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.153+0000 7f69b0b52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f69ac06f280 0x7f69ac06f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:46.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.153+0000 7f69b0b52640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ac099ee0 con 0x7f69ac06fba0 2024-09-22T08:15:46.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.153+0000 7f69b0b52640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f69ac070d00 con 0x7f69ac06f280 2024-09-22T08:15:46.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.154+0000 7f69aa59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f69ac06f280 0x7f69ac06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:46.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.154+0000 7f69a3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f69ac06fba0 0x7f69ac097070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58262/0 (socket says 172.21.15.53:58262) 2024-09-22T08:15:46.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.154+0000 7f69a3fff640 1 -- 172.21.15.53:0/385401642 learned_addr learned my addr 172.21.15.53:0/385401642 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:15:46.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.154+0000 7f69aa59c640 1 -- 172.21.15.53:0/385401642 >> v1:172.21.15.53:6789/0 conn(0x7f69ac06fba0 legacy=0x7f69ac097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:46.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.154+0000 7f69aa59c640 1 -- 172.21.15.53:0/385401642 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac070f40 con 0x7f69ac06f280 2024-09-22T08:15:46.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.154+0000 7f69a9d9b640 1 -- 172.21.15.53:0/385401642 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391144185 0 0) 0x7f69ac099ee0 con 0x7f69ac06fba0 2024-09-22T08:15:46.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.155+0000 7f69aa59c640 1 --2- 172.21.15.53:0/385401642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 0x7f69ac06f660 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f699c009720 tx=0x7f699c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3575cad63ad91fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.155+0000 7f69a9d9b640 1 -- 172.21.15.53:0/385401642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699c037070 con 0x7f69ac06f280 2024-09-22T08:15:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.155+0000 7f69a9d9b640 1 -- 172.21.15.53:0/385401642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699c02ad90 con 0x7f69ac06f280 2024-09-22T08:15:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.155+0000 7f69a9d9b640 1 -- 172.21.15.53:0/385401642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699c032590 con 0x7f69ac06f280 2024-09-22T08:15:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.155+0000 7f69b0b52640 1 -- 172.21.15.53:0/385401642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 msgr2=0x7f69ac06f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.155+0000 7f69b0b52640 1 --2- 172.21.15.53:0/385401642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 0x7f69ac06f660 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f699c009720 tx=0x7f699c02a110 comp rx=0 tx=0).stop 2024-09-22T08:15:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.155+0000 7f69b0b52640 1 -- 172.21.15.53:0/385401642 shutdown_connections 2024-09-22T08:15:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.155+0000 7f69b0b52640 1 --2- 172.21.15.53:0/385401642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 0x7f69ac06f660 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.155+0000 7f69b0b52640 1 -- 172.21.15.53:0/385401642 >> 172.21.15.53:0/385401642 conn(0x7f69ac09ac80 msgr2=0x7f69ac098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:15:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.155+0000 7f69b0b52640 1 -- 172.21.15.53:0/385401642 shutdown_connections 2024-09-22T08:15:46.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.156+0000 7f69b0b52640 1 -- 172.21.15.53:0/385401642 wait complete. 2024-09-22T08:15:46.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.157+0000 7f69b0b52640 1 Processor -- start 2024-09-22T08:15:46.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.157+0000 7f69b0b52640 1 -- start start 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.157+0000 7f69b0b52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 0x7f69ac1c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.157+0000 7f69b0b52640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac097780 con 0x7f69ac06f280 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.157+0000 7f69aa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 0x7f69ac1c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.157+0000 7f69aa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 0x7f69ac1c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59690/0 (socket says 172.21.15.53:59690) 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.157+0000 7f69aa59c640 1 -- 172.21.15.53:0/739320460 learned_addr learned my addr 172.21.15.53:0/739320460 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.157+0000 7f69aa59c640 1 -- 172.21.15.53:0/739320460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac08fae0 con 0x7f69ac06f280 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.157+0000 7f69aa59c640 1 --2- 172.21.15.53:0/739320460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 0x7f69ac1c46e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f699c035040 tx=0x7f699c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.158+0000 7f69a2ffd640 1 -- 172.21.15.53:0/739320460 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699c037040 con 0x7f69ac06f280 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.158+0000 7f69a2ffd640 1 -- 172.21.15.53:0/739320460 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699c004030 con 0x7f69ac06f280 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.158+0000 7f69a2ffd640 1 -- 172.21.15.53:0/739320460 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f699c004310 con 0x7f69ac06f280 2024-09-22T08:15:46.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.158+0000 7f69b0b52640 1 -- 172.21.15.53:0/739320460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ac091070 con 0x7f69ac06f280 2024-09-22T08:15:46.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.158+0000 7f69b0b52640 1 -- 172.21.15.53:0/739320460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ac1c4c20 con 0x7f69ac06f280 2024-09-22T08:15:46.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.159+0000 7f69a2ffd640 1 -- 172.21.15.53:0/739320460 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f699c03a040 con 0x7f69ac06f280 2024-09-22T08:15:46.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.159+0000 7f69b0b52640 1 -- 172.21.15.53:0/739320460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ac090ea0 con 0x7f69ac06f280 2024-09-22T08:15:46.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.159+0000 7f69a2ffd640 1 --2- 172.21.15.53:0/739320460 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f698c03e710 0x7f698c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:46.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.159+0000 7f69a2ffd640 1 -- 172.21.15.53:0/739320460 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f699c073f80 con 0x7f69ac06f280 2024-09-22T08:15:46.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.160+0000 7f69a3fff640 1 --2- 172.21.15.53:0/739320460 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f698c03e710 0x7f698c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:46.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.160+0000 7f69a3fff640 1 --2- 172.21.15.53:0/739320460 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f698c03e710 0x7f698c040bd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6994000c00 tx=0x7f69940078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:46.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.164+0000 7f69a2ffd640 1 -- 172.21.15.53:0/739320460 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f699c042020 con 0x7f69ac06f280 2024-09-22T08:15:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.351+0000 7f69b0b52640 1 -- 172.21.15.53:0/739320460 --> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69ac097cd0 con 0x7f698c03e710 2024-09-22T08:15:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.362+0000 7f69a2ffd640 1 -- 172.21.15.53:0/739320460 <== mgr.4101 v2:172.21.15.165:6824/2210654445 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666412 (secure 0 0 0) 0x7f69ac097cd0 con 0x7f698c03e710 2024-09-22T08:15:46.371 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-22T08:15:46.376 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-22T08:15:46.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.367+0000 7f69b0b52640 1 -- 172.21.15.53:0/739320460 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f698c03e710 msgr2=0x7f698c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:46.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.367+0000 7f69b0b52640 1 --2- 172.21.15.53:0/739320460 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f698c03e710 0x7f698c040bd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6994000c00 tx=0x7f69940078f0 comp rx=0 tx=0).stop 2024-09-22T08:15:46.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.367+0000 7f69b0b52640 1 -- 172.21.15.53:0/739320460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 msgr2=0x7f69ac1c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:46.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.367+0000 7f69b0b52640 1 --2- 172.21.15.53:0/739320460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 0x7f69ac1c46e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f699c035040 tx=0x7f699c0046c0 comp rx=0 tx=0).stop 2024-09-22T08:15:46.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.367+0000 7f69b0b52640 1 -- 172.21.15.53:0/739320460 shutdown_connections 2024-09-22T08:15:46.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.367+0000 7f69b0b52640 1 --2- 172.21.15.53:0/739320460 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f698c03e710 0x7f698c040bd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:46.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.367+0000 7f69b0b52640 1 --2- 172.21.15.53:0/739320460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ac06f280 0x7f69ac1c46e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:46.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.367+0000 7f69b0b52640 1 -- 172.21.15.53:0/739320460 >> 172.21.15.53:0/739320460 conn(0x7f69ac09ac80 msgr2=0x7f69ac06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:15:46.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.367+0000 7f69b0b52640 1 -- 172.21.15.53:0/739320460 shutdown_connections 2024-09-22T08:15:46.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.367+0000 7f69b0b52640 1 -- 172.21.15.53:0/739320460 wait complete. 2024-09-22T08:15:46.380 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-22T08:15:45.668719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5179,"num_read_kb":4721,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4784,"ondisk_log_size":4784,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156768,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330592,"statfs":{"total":386547056640,"available":386386526208,"internally_reserved":0,"allocated":2981888,"data_stored":1788188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004056"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.888353+0000","last_change":"2024-09-22T08:14:16.888299+0000","last_active":"2024-09-22T08:14:16.888353+0000","last_peered":"2024-09-22T08:14:16.888353+0000","last_clean":"2024-09-22T08:14:16.888353+0000","last_became_active":"2024-09-22T08:10:43.174489+0000","last_became_peered":"2024-09-22T08:10:43.174489+0000","last_unstale":"2024-09-22T08:14:16.888353+0000","last_undegraded":"2024-09-22T08:14:16.888353+0000","last_fullsized":"2024-09-22T08:14:16.888353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:16.888214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:16.888214+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.888214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:50.430915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.772962+0000","last_change":"2024-09-22T08:14:35.772962+0000","last_active":"2024-09-22T08:14:35.772962+0000","last_peered":"2024-09-22T08:14:35.772962+0000","last_clean":"2024-09-22T08:14:35.772962+0000","last_became_active":"2024-09-22T08:10:45.179969+0000","last_became_peered":"2024-09-22T08:10:45.179969+0000","last_unstale":"2024-09-22T08:14:35.772962+0000","last_undegraded":"2024-09-22T08:14:35.772962+0000","last_fullsized":"2024-09-22T08:14:35.772962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:35.772871+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:35.772871+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.772871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:40.663120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.854875+0000","last_change":"2024-09-22T08:14:17.854808+0000","last_active":"2024-09-22T08:14:17.854875+0000","last_peered":"2024-09-22T08:14:17.854875+0000","last_clean":"2024-09-22T08:14:17.854875+0000","last_became_active":"2024-09-22T08:10:43.187128+0000","last_became_peered":"2024-09-22T08:10:43.187128+0000","last_unstale":"2024-09-22T08:14:17.854875+0000","last_undegraded":"2024-09-22T08:14:17.854875+0000","last_fullsized":"2024-09-22T08:14:17.854875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.854715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.854715+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.854715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:57.247272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.994355+0000","last_change":"2024-09-22T08:14:45.994355+0000","last_active":"2024-09-22T08:14:45.994355+0000","last_peered":"2024-09-22T08:14:45.994355+0000","last_clean":"2024-09-22T08:14:45.994355+0000","last_became_active":"2024-09-22T08:10:45.169768+0000","last_became_peered":"2024-09-22T08:10:45.169768+0000","last_unstale":"2024-09-22T08:14:45.994355+0000","last_undegraded":"2024-09-22T08:14:45.994355+0000","last_fullsized":"2024-09-22T08:14:45.994355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:45.994266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:45.994266+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.994266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:43.216896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.201078+0000","last_change":"2024-09-22T08:14:31.201010+0000","last_active":"2024-09-22T08:14:31.201078+0000","last_peered":"2024-09-22T08:14:31.201078+0000","last_clean":"2024-09-22T08:14:31.201078+0000","last_became_active":"2024-09-22T08:10:43.200436+0000","last_became_peered":"2024-09-22T08:10:43.200436+0000","last_unstale":"2024-09-22T08:14:31.201078+0000","last_undegraded":"2024-09-22T08:14:31.201078+0000","last_fullsized":"2024-09-22T08:14:31.201078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.200921+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.200921+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.200921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:27.278821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.014314+0000","last_change":"2024-09-22T08:14:48.014314+0000","last_active":"2024-09-22T08:14:48.014314+0000","last_peered":"2024-09-22T08:14:48.014314+0000","last_clean":"2024-09-22T08:14:48.014314+0000","last_became_active":"2024-09-22T08:10:45.169110+0000","last_became_peered":"2024-09-22T08:10:45.169110+0000","last_unstale":"2024-09-22T08:14:48.014314+0000","last_undegraded":"2024-09-22T08:14:48.014314+0000","last_fullsized":"2024-09-22T08:14:48.014314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:48.014208+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:48.014208+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.014208+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:55.791447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.842269+0000","last_change":"2024-09-22T08:14:15.842211+0000","last_active":"2024-09-22T08:14:15.842269+0000","last_peered":"2024-09-22T08:14:15.842269+0000","last_clean":"2024-09-22T08:14:15.842269+0000","last_became_active":"2024-09-22T08:10:43.180088+0000","last_became_peered":"2024-09-22T08:10:43.180088+0000","last_unstale":"2024-09-22T08:14:15.842269+0000","last_undegraded":"2024-09-22T08:14:15.842269+0000","last_fullsized":"2024-09-22T08:14:15.842269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:15.842123+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:15.842123+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.842123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:45.525671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.022431+0000","last_change":"2024-09-22T08:14:32.022431+0000","last_active":"2024-09-22T08:14:32.022431+0000","last_peered":"2024-09-22T08:14:32.022431+0000","last_clean":"2024-09-22T08:14:32.022431+0000","last_became_active":"2024-09-22T08:11:23.220081+0000","last_became_peered":"2024-09-22T08:11:23.220081+0000","last_unstale":"2024-09-22T08:14:32.022431+0000","last_undegraded":"2024-09-22T08:14:32.022431+0000","last_fullsized":"2024-09-22T08:14:32.022431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:32.022345+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:32.022345+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.022345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:29.472018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.226282+0000","last_change":"2024-09-22T08:14:30.226178+0000","last_active":"2024-09-22T08:14:30.226282+0000","last_peered":"2024-09-22T08:14:30.226282+0000","last_clean":"2024-09-22T08:14:30.226282+0000","last_became_active":"2024-09-22T08:10:43.200013+0000","last_became_peered":"2024-09-22T08:10:43.200013+0000","last_unstale":"2024-09-22T08:14:30.226282+0000","last_undegraded":"2024-09-22T08:14:30.226282+0000","last_fullsized":"2024-09-22T08:14:30.226282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:30.226084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:30.226084+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.226084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:55.632963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.722868+0000","last_change":"2024-09-22T08:14:34.722804+0000","last_active":"2024-09-22T08:14:34.722868+0000","last_peered":"2024-09-22T08:14:34.722868+0000","last_clean":"2024-09-22T08:14:34.722868+0000","last_became_active":"2024-09-22T08:10:45.176491+0000","last_became_peered":"2024-09-22T08:10:45.176491+0000","last_unstale":"2024-09-22T08:14:34.722868+0000","last_undegraded":"2024-09-22T08:14:34.722868+0000","last_fullsized":"2024-09-22T08:14:34.722868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:34.722708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:34.722708+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.722708+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:38.943762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.876961+0000","last_change":"2024-09-22T08:14:17.876908+0000","last_active":"2024-09-22T08:14:17.876961+0000","last_peered":"2024-09-22T08:14:17.876961+0000","last_clean":"2024-09-22T08:14:17.876961+0000","last_became_active":"2024-09-22T08:10:43.172330+0000","last_became_peered":"2024-09-22T08:10:43.172330+0000","last_unstale":"2024-09-22T08:14:17.876961+0000","last_undegraded":"2024-09-22T08:14:17.876961+0000","last_fullsized":"2024-09-22T08:14:17.876961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.876812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.876812+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.876812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:27:40.745057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:50.044313+0000","last_change":"2024-09-22T08:14:50.044221+0000","last_active":"2024-09-22T08:14:50.044313+0000","last_peered":"2024-09-22T08:14:50.044313+0000","last_clean":"2024-09-22T08:14:50.044313+0000","last_became_active":"2024-09-22T08:10:45.175775+0000","last_became_peered":"2024-09-22T08:10:45.175775+0000","last_unstale":"2024-09-22T08:14:50.044313+0000","last_undegraded":"2024-09-22T08:14:50.044313+0000","last_fullsized":"2024-09-22T08:14:50.044313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:50.044107+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:50.044107+0000","last_clean_scrub_stamp":"2024-09-22T08:14:50.044107+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:24:02.834856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.213651+0000","last_change":"2024-09-22T08:14:28.213597+0000","last_active":"2024-09-22T08:14:28.213651+0000","last_peered":"2024-09-22T08:14:28.213651+0000","last_clean":"2024-09-22T08:14:28.213651+0000","last_became_active":"2024-09-22T08:10:43.187858+0000","last_became_peered":"2024-09-22T08:10:43.187858+0000","last_unstale":"2024-09-22T08:14:28.213651+0000","last_undegraded":"2024-09-22T08:14:28.213651+0000","last_fullsized":"2024-09-22T08:14:28.213651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:28.213514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:28.213514+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.213514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:21.439787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.960016+0000","last_change":"2024-09-22T08:14:28.959963+0000","last_active":"2024-09-22T08:14:28.960016+0000","last_peered":"2024-09-22T08:14:28.960016+0000","last_clean":"2024-09-22T08:14:28.960016+0000","last_became_active":"2024-09-22T08:10:45.179870+0000","last_became_peered":"2024-09-22T08:10:45.179870+0000","last_unstale":"2024-09-22T08:14:28.960016+0000","last_undegraded":"2024-09-22T08:14:28.960016+0000","last_fullsized":"2024-09-22T08:14:28.960016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:28.959878+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:28.959878+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.959878+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:57:09.248946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.896554+0000","last_change":"2024-09-22T08:14:16.896554+0000","last_active":"2024-09-22T08:14:16.896554+0000","last_peered":"2024-09-22T08:14:16.896554+0000","last_clean":"2024-09-22T08:14:16.896554+0000","last_became_active":"2024-09-22T08:10:43.178146+0000","last_became_peered":"2024-09-22T08:10:43.178146+0000","last_unstale":"2024-09-22T08:14:16.896554+0000","last_undegraded":"2024-09-22T08:14:16.896554+0000","last_fullsized":"2024-09-22T08:14:16.896554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:16.896443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:16.896443+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.896443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:40.881321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.986998+0000","last_change":"2024-09-22T08:14:29.986942+0000","last_active":"2024-09-22T08:14:29.986998+0000","last_peered":"2024-09-22T08:14:29.986998+0000","last_clean":"2024-09-22T08:14:29.986998+0000","last_became_active":"2024-09-22T08:10:45.177101+0000","last_became_peered":"2024-09-22T08:10:45.177101+0000","last_unstale":"2024-09-22T08:14:29.986998+0000","last_undegraded":"2024-09-22T08:14:29.986998+0000","last_fullsized":"2024-09-22T08:14:29.986998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:29.986860+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:29.986860+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.986860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:27:26.079898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.978208+0000","last_change":"2024-09-22T08:14:46.978156+0000","last_active":"2024-09-22T08:14:46.978208+0000","last_peered":"2024-09-22T08:14:46.978208+0000","last_clean":"2024-09-22T08:14:46.978208+0000","last_became_active":"2024-09-22T08:10:45.169140+0000","last_became_peered":"2024-09-22T08:10:45.169140+0000","last_unstale":"2024-09-22T08:14:46.978208+0000","last_undegraded":"2024-09-22T08:14:46.978208+0000","last_fullsized":"2024-09-22T08:14:46.978208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:46.978074+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:46.978074+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.978074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:33.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.806012+0000","last_change":"2024-09-22T08:14:16.805924+0000","last_active":"2024-09-22T08:14:16.806012+0000","last_peered":"2024-09-22T08:14:16.806012+0000","last_clean":"2024-09-22T08:14:16.806012+0000","last_became_active":"2024-09-22T08:10:43.185301+0000","last_became_peered":"2024-09-22T08:10:43.185301+0000","last_unstale":"2024-09-22T08:14:16.806012+0000","last_undegraded":"2024-09-22T08:14:16.806012+0000","last_fullsized":"2024-09-22T08:14:16.806012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:16.805805+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:16.805805+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.805805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:11.575658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.829212+0000","last_change":"2024-09-22T08:14:29.829126+0000","last_active":"2024-09-22T08:14:29.829212+0000","last_peered":"2024-09-22T08:14:29.829212+0000","last_clean":"2024-09-22T08:14:29.829212+0000","last_became_active":"2024-09-22T08:10:45.172557+0000","last_became_peered":"2024-09-22T08:10:45.172557+0000","last_unstale":"2024-09-22T08:14:29.829212+0000","last_undegraded":"2024-09-22T08:14:29.829212+0000","last_fullsized":"2024-09-22T08:14:29.829212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:29.829030+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:29.829030+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.829030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:18.653579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.821397+0000","last_change":"2024-09-22T08:14:14.821331+0000","last_active":"2024-09-22T08:14:14.821397+0000","last_peered":"2024-09-22T08:14:14.821397+0000","last_clean":"2024-09-22T08:14:14.821397+0000","last_became_active":"2024-09-22T08:10:43.189273+0000","last_became_peered":"2024-09-22T08:10:43.189273+0000","last_unstale":"2024-09-22T08:14:14.821397+0000","last_undegraded":"2024-09-22T08:14:14.821397+0000","last_fullsized":"2024-09-22T08:14:14.821397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:14.821242+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:14.821242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.821242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:39.122357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.727048+0000","last_change":"2024-09-22T08:14:36.726995+0000","last_active":"2024-09-22T08:14:36.727048+0000","last_peered":"2024-09-22T08:14:36.727048+0000","last_clean":"2024-09-22T08:14:36.727048+0000","last_became_active":"2024-09-22T08:10:45.176885+0000","last_became_peered":"2024-09-22T08:10:45.176885+0000","last_unstale":"2024-09-22T08:14:36.727048+0000","last_undegraded":"2024-09-22T08:14:36.727048+0000","last_fullsized":"2024-09-22T08:14:36.727048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:36.726901+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:36.726901+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.726901+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:42.806466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.813457+0000","last_change":"2024-09-22T08:14:15.813396+0000","last_active":"2024-09-22T08:14:15.813457+0000","last_peered":"2024-09-22T08:14:15.813457+0000","last_clean":"2024-09-22T08:14:15.813457+0000","last_became_active":"2024-09-22T08:10:43.183887+0000","last_became_peered":"2024-09-22T08:10:43.183887+0000","last_unstale":"2024-09-22T08:14:15.813457+0000","last_undegraded":"2024-09-22T08:14:15.813457+0000","last_fullsized":"2024-09-22T08:14:15.813457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:15.813300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:15.813300+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.813300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:39.476435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.998514+0000","last_change":"2024-09-22T08:14:28.998449+0000","last_active":"2024-09-22T08:14:28.998514+0000","last_peered":"2024-09-22T08:14:28.998514+0000","last_clean":"2024-09-22T08:14:28.998514+0000","last_became_active":"2024-09-22T08:10:45.171492+0000","last_became_peered":"2024-09-22T08:10:45.171492+0000","last_unstale":"2024-09-22T08:14:28.998514+0000","last_undegraded":"2024-09-22T08:14:28.998514+0000","last_fullsized":"2024-09-22T08:14:28.998514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:28.998358+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:28.998358+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.998358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:54.381452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.797170+0000","last_change":"2024-09-22T08:14:12.797115+0000","last_active":"2024-09-22T08:14:12.797170+0000","last_peered":"2024-09-22T08:14:12.797170+0000","last_clean":"2024-09-22T08:14:12.797170+0000","last_became_active":"2024-09-22T08:10:43.179133+0000","last_became_peered":"2024-09-22T08:10:43.179133+0000","last_unstale":"2024-09-22T08:14:12.797170+0000","last_undegraded":"2024-09-22T08:14:12.797170+0000","last_fullsized":"2024-09-22T08:14:12.797170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-22T08:14:12.797035+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-22T08:14:12.797035+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.797035+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:18:51.512160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13,"num_write":24,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.927202+0000","last_change":"2024-09-22T08:14:27.927145+0000","last_active":"2024-09-22T08:14:27.927202+0000","last_peered":"2024-09-22T08:14:27.927202+0000","last_clean":"2024-09-22T08:14:27.927202+0000","last_became_active":"2024-09-22T08:10:45.173524+0000","last_became_peered":"2024-09-22T08:10:45.173524+0000","last_unstale":"2024-09-22T08:14:27.927202+0000","last_undegraded":"2024-09-22T08:14:27.927202+0000","last_fullsized":"2024-09-22T08:14:27.927202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:27.927054+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:27.927054+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.927054+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:21.773609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.847688+0000","last_change":"2024-09-22T08:14:15.847627+0000","last_active":"2024-09-22T08:14:15.847688+0000","last_peered":"2024-09-22T08:14:15.847688+0000","last_clean":"2024-09-22T08:14:15.847688+0000","last_became_active":"2024-09-22T08:10:43.186739+0000","last_became_peered":"2024-09-22T08:10:43.186739+0000","last_unstale":"2024-09-22T08:14:15.847688+0000","last_undegraded":"2024-09-22T08:14:15.847688+0000","last_fullsized":"2024-09-22T08:14:15.847688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:15.847522+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:15.847522+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.847522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:31.369309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.813512+0000","last_change":"2024-09-22T08:14:31.813445+0000","last_active":"2024-09-22T08:14:31.813512+0000","last_peered":"2024-09-22T08:14:31.813512+0000","last_clean":"2024-09-22T08:14:31.813512+0000","last_became_active":"2024-09-22T08:10:45.170247+0000","last_became_peered":"2024-09-22T08:10:45.170247+0000","last_unstale":"2024-09-22T08:14:31.813512+0000","last_undegraded":"2024-09-22T08:14:31.813512+0000","last_fullsized":"2024-09-22T08:14:31.813512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.813353+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.813353+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.813353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:57.196447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:29.204624+0000","last_change":"2024-09-22T08:14:29.204535+0000","last_active":"2024-09-22T08:14:29.204624+0000","last_peered":"2024-09-22T08:14:29.204624+0000","last_clean":"2024-09-22T08:14:29.204624+0000","last_became_active":"2024-09-22T08:10:43.190674+0000","last_became_peered":"2024-09-22T08:10:43.190674+0000","last_unstale":"2024-09-22T08:14:29.204624+0000","last_undegraded":"2024-09-22T08:14:29.204624+0000","last_fullsized":"2024-09-22T08:14:29.204624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:29.204435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:29.204435+0000","last_clean_scrub_stamp":"2024-09-22T08:14:29.204435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:48.655553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:04.068008+0000","last_change":"2024-09-22T08:15:04.067951+0000","last_active":"2024-09-22T08:15:04.068008+0000","last_peered":"2024-09-22T08:15:04.068008+0000","last_clean":"2024-09-22T08:15:04.068008+0000","last_became_active":"2024-09-22T08:10:53.203146+0000","last_became_peered":"2024-09-22T08:10:53.203146+0000","last_unstale":"2024-09-22T08:15:04.068008+0000","last_undegraded":"2024-09-22T08:15:04.068008+0000","last_fullsized":"2024-09-22T08:15:04.068008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-22T08:15:04.067862+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-22T08:15:04.067862+0000","last_clean_scrub_stamp":"2024-09-22T08:15:04.067862+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:59.488098+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.063740+0000","last_change":"2024-09-22T08:14:38.063669+0000","last_active":"2024-09-22T08:14:38.063740+0000","last_peered":"2024-09-22T08:14:38.063740+0000","last_clean":"2024-09-22T08:14:38.063740+0000","last_became_active":"2024-09-22T08:10:45.168308+0000","last_became_peered":"2024-09-22T08:10:45.168308+0000","last_unstale":"2024-09-22T08:14:38.063740+0000","last_undegraded":"2024-09-22T08:14:38.063740+0000","last_fullsized":"2024-09-22T08:14:38.063740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:38.063566+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:38.063566+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.063566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:58.873201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.270406+0000","last_change":"2024-09-22T08:14:17.270316+0000","last_active":"2024-09-22T08:14:17.270406+0000","last_peered":"2024-09-22T08:14:17.270406+0000","last_clean":"2024-09-22T08:14:17.270406+0000","last_became_active":"2024-09-22T08:10:43.200307+0000","last_became_peered":"2024-09-22T08:10:43.200307+0000","last_unstale":"2024-09-22T08:14:17.270406+0000","last_undegraded":"2024-09-22T08:14:17.270406+0000","last_fullsized":"2024-09-22T08:14:17.270406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:17.270212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:17.270212+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.270212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:29.835254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.034261+0000","last_change":"2024-09-22T08:14:57.034206+0000","last_active":"2024-09-22T08:14:57.034261+0000","last_peered":"2024-09-22T08:14:57.034261+0000","last_clean":"2024-09-22T08:14:57.034261+0000","last_became_active":"2024-09-22T08:10:47.176568+0000","last_became_peered":"2024-09-22T08:10:47.176568+0000","last_unstale":"2024-09-22T08:14:57.034261+0000","last_undegraded":"2024-09-22T08:14:57.034261+0000","last_fullsized":"2024-09-22T08:14:57.034261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:57.034089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:57.034089+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.034089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:08.818189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:07.141137+0000","last_change":"2024-09-22T08:15:07.141075+0000","last_active":"2024-09-22T08:15:07.141137+0000","last_peered":"2024-09-22T08:15:07.141137+0000","last_clean":"2024-09-22T08:15:07.141137+0000","last_became_active":"2024-09-22T08:10:49.188697+0000","last_became_peered":"2024-09-22T08:10:49.188697+0000","last_unstale":"2024-09-22T08:15:07.141137+0000","last_undegraded":"2024-09-22T08:15:07.141137+0000","last_fullsized":"2024-09-22T08:15:07.141137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-22T08:15:07.140983+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-22T08:15:07.140983+0000","last_clean_scrub_stamp":"2024-09-22T08:15:07.140983+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:52.455481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.023803+0000","last_change":"2024-09-22T08:14:57.023727+0000","last_active":"2024-09-22T08:14:57.023803+0000","last_peered":"2024-09-22T08:14:57.023803+0000","last_clean":"2024-09-22T08:14:57.023803+0000","last_became_active":"2024-09-22T08:10:51.201855+0000","last_became_peered":"2024-09-22T08:10:51.201855+0000","last_unstale":"2024-09-22T08:14:57.023803+0000","last_undegraded":"2024-09-22T08:14:57.023803+0000","last_fullsized":"2024-09-22T08:14:57.023803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:57.023611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:57.023611+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.023611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:01.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:05.063883+0000","last_change":"2024-09-22T08:15:05.063827+0000","last_active":"2024-09-22T08:15:05.063883+0000","last_peered":"2024-09-22T08:15:05.063883+0000","last_clean":"2024-09-22T08:15:05.063883+0000","last_became_active":"2024-09-22T08:10:53.204407+0000","last_became_peered":"2024-09-22T08:10:53.204407+0000","last_unstale":"2024-09-22T08:15:05.063883+0000","last_undegraded":"2024-09-22T08:15:05.063883+0000","last_fullsized":"2024-09-22T08:15:05.063883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-22T08:15:05.063718+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-22T08:15:05.063718+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.063718+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:19.232361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'16","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.067301+0000","last_change":"2024-09-22T08:14:39.067176+0000","last_active":"2024-09-22T08:14:39.067301+0000","last_peered":"2024-09-22T08:14:39.067301+0000","last_clean":"2024-09-22T08:14:39.067301+0000","last_became_active":"2024-09-22T08:10:45.170765+0000","last_became_peered":"2024-09-22T08:10:45.170765+0000","last_unstale":"2024-09-22T08:14:39.067301+0000","last_undegraded":"2024-09-22T08:14:39.067301+0000","last_fullsized":"2024-09-22T08:14:39.067301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-22T08:14:39.067085+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-22T08:14:39.067085+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.067085+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:09.486443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.743753+0000","last_change":"2024-09-22T08:14:08.743684+0000","last_active":"2024-09-22T08:14:08.743753+0000","last_peered":"2024-09-22T08:14:08.743753+0000","last_clean":"2024-09-22T08:14:08.743753+0000","last_became_active":"2024-09-22T08:10:43.180600+0000","last_became_peered":"2024-09-22T08:10:43.180600+0000","last_unstale":"2024-09-22T08:14:08.743753+0000","last_undegraded":"2024-09-22T08:14:08.743753+0000","last_fullsized":"2024-09-22T08:14:08.743753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.743587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.743587+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.743587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:44.284655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.913899+0000","last_change":"2024-09-22T08:14:36.913847+0000","last_active":"2024-09-22T08:14:36.913899+0000","last_peered":"2024-09-22T08:14:36.913899+0000","last_clean":"2024-09-22T08:14:36.913899+0000","last_became_active":"2024-09-22T08:10:47.167913+0000","last_became_peered":"2024-09-22T08:10:47.167913+0000","last_unstale":"2024-09-22T08:14:36.913899+0000","last_undegraded":"2024-09-22T08:14:36.913899+0000","last_fullsized":"2024-09-22T08:14:36.913899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:36.913756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:36.913756+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.913756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:18.021625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.961472+0000","last_change":"2024-09-22T08:14:49.961384+0000","last_active":"2024-09-22T08:14:49.961472+0000","last_peered":"2024-09-22T08:14:49.961472+0000","last_clean":"2024-09-22T08:14:49.961472+0000","last_became_active":"2024-09-22T08:10:49.182481+0000","last_became_peered":"2024-09-22T08:10:49.182481+0000","last_unstale":"2024-09-22T08:14:49.961472+0000","last_undegraded":"2024-09-22T08:14:49.961472+0000","last_fullsized":"2024-09-22T08:14:49.961472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-22T08:14:49.961281+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-22T08:14:49.961281+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.961281+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:47:00.050565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.023255+0000","last_change":"2024-09-22T08:14:55.023182+0000","last_active":"2024-09-22T08:14:55.023255+0000","last_peered":"2024-09-22T08:14:55.023255+0000","last_clean":"2024-09-22T08:14:55.023255+0000","last_became_active":"2024-09-22T08:10:51.199837+0000","last_became_peered":"2024-09-22T08:10:51.199837+0000","last_unstale":"2024-09-22T08:14:55.023255+0000","last_undegraded":"2024-09-22T08:14:55.023255+0000","last_fullsized":"2024-09-22T08:14:55.023255+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.023064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.023064+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.023064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:11.887959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:00.056833+0000","last_change":"2024-09-22T08:15:00.056833+0000","last_active":"2024-09-22T08:15:00.056833+0000","last_peered":"2024-09-22T08:15:00.056833+0000","last_clean":"2024-09-22T08:15:00.056833+0000","last_became_active":"2024-09-22T08:10:53.199303+0000","last_became_peered":"2024-09-22T08:10:53.199303+0000","last_unstale":"2024-09-22T08:15:00.056833+0000","last_undegraded":"2024-09-22T08:15:00.056833+0000","last_fullsized":"2024-09-22T08:15:00.056833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:15:00.056727+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:15:00.056727+0000","last_clean_scrub_stamp":"2024-09-22T08:15:00.056727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:55.476963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.101618+0000","last_change":"2024-09-22T08:14:40.101518+0000","last_active":"2024-09-22T08:14:40.101618+0000","last_peered":"2024-09-22T08:14:40.101618+0000","last_clean":"2024-09-22T08:14:40.101618+0000","last_became_active":"2024-09-22T08:10:45.168554+0000","last_became_peered":"2024-09-22T08:10:45.168554+0000","last_unstale":"2024-09-22T08:14:40.101618+0000","last_undegraded":"2024-09-22T08:14:40.101618+0000","last_fullsized":"2024-09-22T08:14:40.101618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:40.101418+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:40.101418+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.101418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:35.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:16.265364+0000","last_change":"2024-09-22T08:14:16.265298+0000","last_active":"2024-09-22T08:14:16.265364+0000","last_peered":"2024-09-22T08:14:16.265364+0000","last_clean":"2024-09-22T08:14:16.265364+0000","last_became_active":"2024-09-22T08:10:43.189333+0000","last_became_peered":"2024-09-22T08:10:43.189333+0000","last_unstale":"2024-09-22T08:14:16.265364+0000","last_undegraded":"2024-09-22T08:14:16.265364+0000","last_fullsized":"2024-09-22T08:14:16.265364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:16.265216+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:16.265216+0000","last_clean_scrub_stamp":"2024-09-22T08:14:16.265216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:42.490080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.937730+0000","last_change":"2024-09-22T08:14:37.937678+0000","last_active":"2024-09-22T08:14:37.937730+0000","last_peered":"2024-09-22T08:14:37.937730+0000","last_clean":"2024-09-22T08:14:37.937730+0000","last_became_active":"2024-09-22T08:10:47.175959+0000","last_became_peered":"2024-09-22T08:10:47.175959+0000","last_unstale":"2024-09-22T08:14:37.937730+0000","last_undegraded":"2024-09-22T08:14:37.937730+0000","last_fullsized":"2024-09-22T08:14:37.937730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:37.937584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:37.937584+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.937584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:50:19.341899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.886570+0000","last_change":"2024-09-22T08:14:42.886512+0000","last_active":"2024-09-22T08:14:42.886570+0000","last_peered":"2024-09-22T08:14:42.886570+0000","last_clean":"2024-09-22T08:14:42.886570+0000","last_became_active":"2024-09-22T08:10:49.185269+0000","last_became_peered":"2024-09-22T08:10:49.185269+0000","last_unstale":"2024-09-22T08:14:42.886570+0000","last_undegraded":"2024-09-22T08:14:42.886570+0000","last_fullsized":"2024-09-22T08:14:42.886570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-22T08:14:42.886419+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-22T08:14:42.886419+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.886419+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:26.711598+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":395,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:16.000693+0000","last_change":"2024-09-22T08:15:16.000632+0000","last_active":"2024-09-22T08:15:16.000693+0000","last_peered":"2024-09-22T08:15:16.000693+0000","last_clean":"2024-09-22T08:15:16.000693+0000","last_became_active":"2024-09-22T08:10:51.196199+0000","last_became_peered":"2024-09-22T08:10:51.196199+0000","last_unstale":"2024-09-22T08:15:16.000693+0000","last_undegraded":"2024-09-22T08:15:16.000693+0000","last_fullsized":"2024-09-22T08:15:16.000693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:15:16.000539+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:15:16.000539+0000","last_clean_scrub_stamp":"2024-09-22T08:15:16.000539+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:36.890358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.997415+0000","last_change":"2024-09-22T08:14:56.997415+0000","last_active":"2024-09-22T08:14:56.997415+0000","last_peered":"2024-09-22T08:14:56.997415+0000","last_clean":"2024-09-22T08:14:56.997415+0000","last_became_active":"2024-09-22T08:10:53.194118+0000","last_became_peered":"2024-09-22T08:10:53.194118+0000","last_unstale":"2024-09-22T08:14:56.997415+0000","last_undegraded":"2024-09-22T08:14:56.997415+0000","last_fullsized":"2024-09-22T08:14:56.997415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:56.997317+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:56.997317+0000","last_clean_scrub_stamp":"2024-09-22T08:14:56.997317+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:24.120944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.867847+0000","last_change":"2024-09-22T08:14:20.867755+0000","last_active":"2024-09-22T08:14:20.867847+0000","last_peered":"2024-09-22T08:14:20.867847+0000","last_clean":"2024-09-22T08:14:20.867847+0000","last_became_active":"2024-09-22T08:10:45.183307+0000","last_became_peered":"2024-09-22T08:10:45.183307+0000","last_unstale":"2024-09-22T08:14:20.867847+0000","last_undegraded":"2024-09-22T08:14:20.867847+0000","last_fullsized":"2024-09-22T08:14:20.867847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:20.867654+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:20.867654+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.867654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:26.987640+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.753445+0000","last_change":"2024-09-22T08:14:05.753375+0000","last_active":"2024-09-22T08:14:05.753445+0000","last_peered":"2024-09-22T08:14:05.753445+0000","last_clean":"2024-09-22T08:14:05.753445+0000","last_became_active":"2024-09-22T08:10:43.187835+0000","last_became_peered":"2024-09-22T08:10:43.187835+0000","last_unstale":"2024-09-22T08:14:05.753445+0000","last_undegraded":"2024-09-22T08:14:05.753445+0000","last_fullsized":"2024-09-22T08:14:05.753445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.753280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.753280+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.753280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:33.618928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:59.113507+0000","last_change":"2024-09-22T08:14:59.113419+0000","last_active":"2024-09-22T08:14:59.113507+0000","last_peered":"2024-09-22T08:14:59.113507+0000","last_clean":"2024-09-22T08:14:59.113507+0000","last_became_active":"2024-09-22T08:10:47.175386+0000","last_became_peered":"2024-09-22T08:10:47.175386+0000","last_unstale":"2024-09-22T08:14:59.113507+0000","last_undegraded":"2024-09-22T08:14:59.113507+0000","last_fullsized":"2024-09-22T08:14:59.113507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:59.113282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:59.113282+0000","last_clean_scrub_stamp":"2024-09-22T08:14:59.113282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:52:28.790957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.905507+0000","last_change":"2024-09-22T08:14:43.905429+0000","last_active":"2024-09-22T08:14:43.905507+0000","last_peered":"2024-09-22T08:14:43.905507+0000","last_clean":"2024-09-22T08:14:43.905507+0000","last_became_active":"2024-09-22T08:10:49.184963+0000","last_became_peered":"2024-09-22T08:10:49.184963+0000","last_unstale":"2024-09-22T08:14:43.905507+0000","last_undegraded":"2024-09-22T08:14:43.905507+0000","last_fullsized":"2024-09-22T08:14:43.905507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-22T08:14:43.905303+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-22T08:14:43.905303+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.905303+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:27.963120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":455,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.166770+0000","last_change":"2024-09-22T08:14:51.166710+0000","last_active":"2024-09-22T08:14:51.166770+0000","last_peered":"2024-09-22T08:14:51.166770+0000","last_clean":"2024-09-22T08:14:51.166770+0000","last_became_active":"2024-09-22T08:10:51.193678+0000","last_became_peered":"2024-09-22T08:10:51.193678+0000","last_unstale":"2024-09-22T08:14:51.166770+0000","last_undegraded":"2024-09-22T08:14:51.166770+0000","last_fullsized":"2024-09-22T08:14:51.166770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:51.166621+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:51.166621+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.166621+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:08.031516+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.079839+0000","last_change":"2024-09-22T08:14:35.079772+0000","last_active":"2024-09-22T08:14:35.079839+0000","last_peered":"2024-09-22T08:14:35.079839+0000","last_clean":"2024-09-22T08:14:35.079839+0000","last_became_active":"2024-09-22T08:10:45.183598+0000","last_became_peered":"2024-09-22T08:10:45.183598+0000","last_unstale":"2024-09-22T08:14:35.079839+0000","last_undegraded":"2024-09-22T08:14:35.079839+0000","last_fullsized":"2024-09-22T08:14:35.079839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:35.079690+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:35.079690+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.079690+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:12:13.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.780468+0000","last_change":"2024-09-22T08:14:07.780412+0000","last_active":"2024-09-22T08:14:07.780468+0000","last_peered":"2024-09-22T08:14:07.780468+0000","last_clean":"2024-09-22T08:14:07.780468+0000","last_became_active":"2024-09-22T08:10:43.173543+0000","last_became_peered":"2024-09-22T08:10:43.173543+0000","last_unstale":"2024-09-22T08:14:07.780468+0000","last_undegraded":"2024-09-22T08:14:07.780468+0000","last_fullsized":"2024-09-22T08:14:07.780468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:07.780321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:07.780321+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.780321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:12:56.960543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.761635+0000","last_change":"2024-09-22T08:14:38.761582+0000","last_active":"2024-09-22T08:14:38.761635+0000","last_peered":"2024-09-22T08:14:38.761635+0000","last_clean":"2024-09-22T08:14:38.761635+0000","last_became_active":"2024-09-22T08:10:47.176657+0000","last_became_peered":"2024-09-22T08:10:47.176657+0000","last_unstale":"2024-09-22T08:14:38.761635+0000","last_undegraded":"2024-09-22T08:14:38.761635+0000","last_fullsized":"2024-09-22T08:14:38.761635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:38.761498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:38.761498+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.761498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:31:54.171137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.965815+0000","last_change":"2024-09-22T08:14:38.965752+0000","last_active":"2024-09-22T08:14:38.965815+0000","last_peered":"2024-09-22T08:14:38.965815+0000","last_clean":"2024-09-22T08:14:38.965815+0000","last_became_active":"2024-09-22T08:10:49.182985+0000","last_became_peered":"2024-09-22T08:10:49.182985+0000","last_unstale":"2024-09-22T08:14:38.965815+0000","last_undegraded":"2024-09-22T08:14:38.965815+0000","last_fullsized":"2024-09-22T08:14:38.965815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-22T08:14:38.965657+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-22T08:14:38.965657+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.965657+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:28:27.222048+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:59.092732+0000","last_change":"2024-09-22T08:14:59.092679+0000","last_active":"2024-09-22T08:14:59.092732+0000","last_peered":"2024-09-22T08:14:59.092732+0000","last_clean":"2024-09-22T08:14:59.092732+0000","last_became_active":"2024-09-22T08:10:51.192623+0000","last_became_peered":"2024-09-22T08:10:51.192623+0000","last_unstale":"2024-09-22T08:14:59.092732+0000","last_undegraded":"2024-09-22T08:14:59.092732+0000","last_fullsized":"2024-09-22T08:14:59.092732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:59.092577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:59.092577+0000","last_clean_scrub_stamp":"2024-09-22T08:14:59.092577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:52.851825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.000633+0000","last_change":"2024-09-22T08:14:54.000565+0000","last_active":"2024-09-22T08:14:54.000633+0000","last_peered":"2024-09-22T08:14:54.000633+0000","last_clean":"2024-09-22T08:14:54.000633+0000","last_became_active":"2024-09-22T08:10:53.198219+0000","last_became_peered":"2024-09-22T08:10:53.198219+0000","last_unstale":"2024-09-22T08:14:54.000633+0000","last_undegraded":"2024-09-22T08:14:54.000633+0000","last_fullsized":"2024-09-22T08:14:54.000633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:54.000480+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:54.000480+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.000480+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:12.877456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.853916+0000","last_change":"2024-09-22T08:14:20.853871+0000","last_active":"2024-09-22T08:14:20.853916+0000","last_peered":"2024-09-22T08:14:20.853916+0000","last_clean":"2024-09-22T08:14:20.853916+0000","last_became_active":"2024-09-22T08:10:45.171911+0000","last_became_peered":"2024-09-22T08:10:45.171911+0000","last_unstale":"2024-09-22T08:14:20.853916+0000","last_undegraded":"2024-09-22T08:14:20.853916+0000","last_fullsized":"2024-09-22T08:14:20.853916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:20.853779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:20.853779+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.853779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:01:02.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.794591+0000","last_change":"2024-09-22T08:14:06.794540+0000","last_active":"2024-09-22T08:14:06.794591+0000","last_peered":"2024-09-22T08:14:06.794591+0000","last_clean":"2024-09-22T08:14:06.794591+0000","last_became_active":"2024-09-22T08:10:43.189780+0000","last_became_peered":"2024-09-22T08:10:43.189780+0000","last_unstale":"2024-09-22T08:14:06.794591+0000","last_undegraded":"2024-09-22T08:14:06.794591+0000","last_fullsized":"2024-09-22T08:14:06.794591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:06.794440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:06.794440+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.794440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:21.869262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.017023+0000","last_change":"2024-09-22T08:14:33.016936+0000","last_active":"2024-09-22T08:14:33.017023+0000","last_peered":"2024-09-22T08:14:33.017023+0000","last_clean":"2024-09-22T08:14:33.017023+0000","last_became_active":"2024-09-22T08:10:47.177695+0000","last_became_peered":"2024-09-22T08:10:47.177695+0000","last_unstale":"2024-09-22T08:14:33.017023+0000","last_undegraded":"2024-09-22T08:14:33.017023+0000","last_fullsized":"2024-09-22T08:14:33.017023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:33.016843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:33.016843+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.016843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:18:37.907092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:04.126384+0000","last_change":"2024-09-22T08:15:04.126276+0000","last_active":"2024-09-22T08:15:04.126384+0000","last_peered":"2024-09-22T08:15:04.126384+0000","last_clean":"2024-09-22T08:15:04.126384+0000","last_became_active":"2024-09-22T08:10:49.185419+0000","last_became_peered":"2024-09-22T08:10:49.185419+0000","last_unstale":"2024-09-22T08:15:04.126384+0000","last_undegraded":"2024-09-22T08:15:04.126384+0000","last_fullsized":"2024-09-22T08:15:04.126384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-22T08:15:04.126166+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-22T08:15:04.126166+0000","last_clean_scrub_stamp":"2024-09-22T08:15:04.126166+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:04:29.312403+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:50.122002+0000","last_change":"2024-09-22T08:14:50.121942+0000","last_active":"2024-09-22T08:14:50.122002+0000","last_peered":"2024-09-22T08:14:50.122002+0000","last_clean":"2024-09-22T08:14:50.122002+0000","last_became_active":"2024-09-22T08:10:51.202564+0000","last_became_peered":"2024-09-22T08:10:51.202564+0000","last_unstale":"2024-09-22T08:14:50.122002+0000","last_undegraded":"2024-09-22T08:14:50.122002+0000","last_fullsized":"2024-09-22T08:14:50.122002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:50.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:50.121854+0000","last_clean_scrub_stamp":"2024-09-22T08:14:50.121854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:40.818719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:59.065099+0000","last_change":"2024-09-22T08:14:59.065044+0000","last_active":"2024-09-22T08:14:59.065099+0000","last_peered":"2024-09-22T08:14:59.065099+0000","last_clean":"2024-09-22T08:14:59.065099+0000","last_became_active":"2024-09-22T08:10:53.196392+0000","last_became_peered":"2024-09-22T08:10:53.196392+0000","last_unstale":"2024-09-22T08:14:59.065099+0000","last_undegraded":"2024-09-22T08:14:59.065099+0000","last_fullsized":"2024-09-22T08:14:59.065099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:59.064959+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:59.064959+0000","last_clean_scrub_stamp":"2024-09-22T08:14:59.064959+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:41.394956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.834343+0000","last_change":"2024-09-22T08:14:18.834249+0000","last_active":"2024-09-22T08:14:18.834343+0000","last_peered":"2024-09-22T08:14:18.834343+0000","last_clean":"2024-09-22T08:14:18.834343+0000","last_became_active":"2024-09-22T08:10:45.177530+0000","last_became_peered":"2024-09-22T08:10:45.177530+0000","last_unstale":"2024-09-22T08:14:18.834343+0000","last_undegraded":"2024-09-22T08:14:18.834343+0000","last_fullsized":"2024-09-22T08:14:18.834343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:18.834156+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.834156+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.834156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:22.288734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:15.250060+0000","last_change":"2024-09-22T08:14:15.250010+0000","last_active":"2024-09-22T08:14:15.250060+0000","last_peered":"2024-09-22T08:14:15.250060+0000","last_clean":"2024-09-22T08:14:15.250060+0000","last_became_active":"2024-09-22T08:10:43.201669+0000","last_became_peered":"2024-09-22T08:10:43.201669+0000","last_unstale":"2024-09-22T08:14:15.250060+0000","last_undegraded":"2024-09-22T08:14:15.250060+0000","last_fullsized":"2024-09-22T08:14:15.250060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:15.249925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:15.249925+0000","last_clean_scrub_stamp":"2024-09-22T08:14:15.249925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:10.670160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.960554+0000","last_change":"2024-09-22T08:14:35.960461+0000","last_active":"2024-09-22T08:14:35.960554+0000","last_peered":"2024-09-22T08:14:35.960554+0000","last_clean":"2024-09-22T08:14:35.960554+0000","last_became_active":"2024-09-22T08:10:47.177613+0000","last_became_peered":"2024-09-22T08:10:47.177613+0000","last_unstale":"2024-09-22T08:14:35.960554+0000","last_undegraded":"2024-09-22T08:14:35.960554+0000","last_fullsized":"2024-09-22T08:14:35.960554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:35.960358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:35.960358+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.960358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:11.564682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'47","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:02.127912+0000","last_change":"2024-09-22T08:15:02.127853+0000","last_active":"2024-09-22T08:15:02.127912+0000","last_peered":"2024-09-22T08:15:02.127912+0000","last_clean":"2024-09-22T08:15:02.127912+0000","last_became_active":"2024-09-22T08:10:49.186941+0000","last_became_peered":"2024-09-22T08:10:49.186941+0000","last_unstale":"2024-09-22T08:15:02.127912+0000","last_undegraded":"2024-09-22T08:15:02.127912+0000","last_fullsized":"2024-09-22T08:15:02.127912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-22T08:15:02.127734+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-22T08:15:02.127734+0000","last_clean_scrub_stamp":"2024-09-22T08:15:02.127734+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:09.059423+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":362,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.146395+0000","last_change":"2024-09-22T08:14:53.146275+0000","last_active":"2024-09-22T08:14:53.146395+0000","last_peered":"2024-09-22T08:14:53.146395+0000","last_clean":"2024-09-22T08:14:53.146395+0000","last_became_active":"2024-09-22T08:10:51.192483+0000","last_became_peered":"2024-09-22T08:10:51.192483+0000","last_unstale":"2024-09-22T08:14:53.146395+0000","last_undegraded":"2024-09-22T08:14:53.146395+0000","last_fullsized":"2024-09-22T08:14:53.146395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:53.146179+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:53.146179+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.146179+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:32:57.244656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.059212+0000","last_change":"2024-09-22T08:14:56.059149+0000","last_active":"2024-09-22T08:14:56.059212+0000","last_peered":"2024-09-22T08:14:56.059212+0000","last_clean":"2024-09-22T08:14:56.059212+0000","last_became_active":"2024-09-22T08:10:53.199273+0000","last_became_peered":"2024-09-22T08:10:53.199273+0000","last_unstale":"2024-09-22T08:14:56.059212+0000","last_undegraded":"2024-09-22T08:14:56.059212+0000","last_fullsized":"2024-09-22T08:14:56.059212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:56.059064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:56.059064+0000","last_clean_scrub_stamp":"2024-09-22T08:14:56.059064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:00.654786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.865187+0000","last_change":"2024-09-22T08:14:21.865126+0000","last_active":"2024-09-22T08:14:21.865187+0000","last_peered":"2024-09-22T08:14:21.865187+0000","last_clean":"2024-09-22T08:14:21.865187+0000","last_became_active":"2024-09-22T08:10:45.165352+0000","last_became_peered":"2024-09-22T08:10:45.165352+0000","last_unstale":"2024-09-22T08:14:21.865187+0000","last_undegraded":"2024-09-22T08:14:21.865187+0000","last_fullsized":"2024-09-22T08:14:21.865187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:21.865034+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:21.865034+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.865034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:43.503660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.210451+0000","last_change":"2024-09-22T08:14:14.210375+0000","last_active":"2024-09-22T08:14:14.210451+0000","last_peered":"2024-09-22T08:14:14.210451+0000","last_clean":"2024-09-22T08:14:14.210451+0000","last_became_active":"2024-09-22T08:10:43.198696+0000","last_became_peered":"2024-09-22T08:10:43.198696+0000","last_unstale":"2024-09-22T08:14:14.210451+0000","last_undegraded":"2024-09-22T08:14:14.210451+0000","last_fullsized":"2024-09-22T08:14:14.210451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:14.210290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:14.210290+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.210290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:59.541262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.990964+0000","last_change":"2024-09-22T08:14:34.990891+0000","last_active":"2024-09-22T08:14:34.990964+0000","last_peered":"2024-09-22T08:14:34.990964+0000","last_clean":"2024-09-22T08:14:34.990964+0000","last_became_active":"2024-09-22T08:10:47.176263+0000","last_became_peered":"2024-09-22T08:10:47.176263+0000","last_unstale":"2024-09-22T08:14:34.990964+0000","last_undegraded":"2024-09-22T08:14:34.990964+0000","last_fullsized":"2024-09-22T08:14:34.990964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:34.990797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:34.990797+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.990797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:43.649921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'65","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:03.077823+0000","last_change":"2024-09-22T08:15:03.077746+0000","last_active":"2024-09-22T08:15:03.077823+0000","last_peered":"2024-09-22T08:15:03.077823+0000","last_clean":"2024-09-22T08:15:03.077823+0000","last_became_active":"2024-09-22T08:10:49.188724+0000","last_became_peered":"2024-09-22T08:10:49.188724+0000","last_unstale":"2024-09-22T08:15:03.077823+0000","last_undegraded":"2024-09-22T08:15:03.077823+0000","last_fullsized":"2024-09-22T08:15:03.077823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-22T08:15:03.077656+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-22T08:15:03.077656+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.077656+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:55.842521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.089931+0000","last_change":"2024-09-22T08:14:49.089869+0000","last_active":"2024-09-22T08:14:49.089931+0000","last_peered":"2024-09-22T08:14:49.089931+0000","last_clean":"2024-09-22T08:14:49.089931+0000","last_became_active":"2024-09-22T08:10:51.194937+0000","last_became_peered":"2024-09-22T08:10:51.194937+0000","last_unstale":"2024-09-22T08:14:49.089931+0000","last_undegraded":"2024-09-22T08:14:49.089931+0000","last_fullsized":"2024-09-22T08:14:49.089931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:49.089786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:49.089786+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.089786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:54.560881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:58.054362+0000","last_change":"2024-09-22T08:14:58.054267+0000","last_active":"2024-09-22T08:14:58.054362+0000","last_peered":"2024-09-22T08:14:58.054362+0000","last_clean":"2024-09-22T08:14:58.054362+0000","last_became_active":"2024-09-22T08:10:53.201289+0000","last_became_peered":"2024-09-22T08:10:53.201289+0000","last_unstale":"2024-09-22T08:14:58.054362+0000","last_undegraded":"2024-09-22T08:14:58.054362+0000","last_fullsized":"2024-09-22T08:14:58.054362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-22T08:14:58.054158+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-22T08:14:58.054158+0000","last_clean_scrub_stamp":"2024-09-22T08:14:58.054158+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:17.183240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.853822+0000","last_change":"2024-09-22T08:14:19.853760+0000","last_active":"2024-09-22T08:14:19.853822+0000","last_peered":"2024-09-22T08:14:19.853822+0000","last_clean":"2024-09-22T08:14:19.853822+0000","last_became_active":"2024-09-22T08:10:45.180762+0000","last_became_peered":"2024-09-22T08:10:45.180762+0000","last_unstale":"2024-09-22T08:14:19.853822+0000","last_undegraded":"2024-09-22T08:14:19.853822+0000","last_fullsized":"2024-09-22T08:14:19.853822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:19.853672+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:19.853672+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.853672+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:03.241087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.884907+0000","last_change":"2024-09-22T08:14:08.884829+0000","last_active":"2024-09-22T08:14:08.884907+0000","last_peered":"2024-09-22T08:14:08.884907+0000","last_clean":"2024-09-22T08:14:08.884907+0000","last_became_active":"2024-09-22T08:10:43.177202+0000","last_became_peered":"2024-09-22T08:10:43.177202+0000","last_unstale":"2024-09-22T08:14:08.884907+0000","last_undegraded":"2024-09-22T08:14:08.884907+0000","last_fullsized":"2024-09-22T08:14:08.884907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:08.884729+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:08.884729+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.884729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:18:59.041707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.999315+0000","last_change":"2024-09-22T08:14:33.999246+0000","last_active":"2024-09-22T08:14:33.999315+0000","last_peered":"2024-09-22T08:14:33.999315+0000","last_clean":"2024-09-22T08:14:33.999315+0000","last_became_active":"2024-09-22T08:10:47.173636+0000","last_became_peered":"2024-09-22T08:10:47.173636+0000","last_unstale":"2024-09-22T08:14:33.999315+0000","last_undegraded":"2024-09-22T08:14:33.999315+0000","last_fullsized":"2024-09-22T08:14:33.999315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:33.999162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:33.999162+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.999162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:41.349638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.922367+0000","last_change":"2024-09-22T08:14:48.922308+0000","last_active":"2024-09-22T08:14:48.922367+0000","last_peered":"2024-09-22T08:14:48.922367+0000","last_clean":"2024-09-22T08:14:48.922367+0000","last_became_active":"2024-09-22T08:10:49.174933+0000","last_became_peered":"2024-09-22T08:10:49.174933+0000","last_unstale":"2024-09-22T08:14:48.922367+0000","last_undegraded":"2024-09-22T08:14:48.922367+0000","last_fullsized":"2024-09-22T08:14:48.922367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-22T08:14:48.922229+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-22T08:14:48.922229+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.922229+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:23.058385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:14.009205+0000","last_change":"2024-09-22T08:15:14.009118+0000","last_active":"2024-09-22T08:15:14.009205+0000","last_peered":"2024-09-22T08:15:14.009205+0000","last_clean":"2024-09-22T08:15:14.009205+0000","last_became_active":"2024-09-22T08:10:51.195308+0000","last_became_peered":"2024-09-22T08:10:51.195308+0000","last_unstale":"2024-09-22T08:15:14.009205+0000","last_undegraded":"2024-09-22T08:15:14.009205+0000","last_fullsized":"2024-09-22T08:15:14.009205+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:14.009028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:14.009028+0000","last_clean_scrub_stamp":"2024-09-22T08:15:14.009028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:20:21.854266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:19.054552+0000","last_change":"2024-09-22T08:15:19.054552+0000","last_active":"2024-09-22T08:15:19.054552+0000","last_peered":"2024-09-22T08:15:19.054552+0000","last_clean":"2024-09-22T08:15:19.054552+0000","last_became_active":"2024-09-22T08:10:53.200458+0000","last_became_peered":"2024-09-22T08:10:53.200458+0000","last_unstale":"2024-09-22T08:15:19.054552+0000","last_undegraded":"2024-09-22T08:15:19.054552+0000","last_fullsized":"2024-09-22T08:15:19.054552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:15:19.054466+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:15:19.054466+0000","last_clean_scrub_stamp":"2024-09-22T08:15:19.054466+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:11.316383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.126752+0000","last_change":"2024-09-22T08:14:36.126687+0000","last_active":"2024-09-22T08:14:36.126752+0000","last_peered":"2024-09-22T08:14:36.126752+0000","last_clean":"2024-09-22T08:14:36.126752+0000","last_became_active":"2024-09-22T08:10:45.183258+0000","last_became_peered":"2024-09-22T08:10:45.183258+0000","last_unstale":"2024-09-22T08:14:36.126752+0000","last_undegraded":"2024-09-22T08:14:36.126752+0000","last_fullsized":"2024-09-22T08:14:36.126752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:36.126603+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:36.126603+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.126603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:16.874250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.213102+0000","last_change":"2024-09-22T08:14:13.213044+0000","last_active":"2024-09-22T08:14:13.213102+0000","last_peered":"2024-09-22T08:14:13.213102+0000","last_clean":"2024-09-22T08:14:13.213102+0000","last_became_active":"2024-09-22T08:10:43.195959+0000","last_became_peered":"2024-09-22T08:10:43.195959+0000","last_unstale":"2024-09-22T08:14:13.213102+0000","last_undegraded":"2024-09-22T08:14:13.213102+0000","last_fullsized":"2024-09-22T08:14:13.213102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:13.212946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:13.212946+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.212946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:31.672558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.984929+0000","last_change":"2024-09-22T08:14:32.984929+0000","last_active":"2024-09-22T08:14:32.984929+0000","last_peered":"2024-09-22T08:14:32.984929+0000","last_clean":"2024-09-22T08:14:32.984929+0000","last_became_active":"2024-09-22T08:11:23.214959+0000","last_became_peered":"2024-09-22T08:11:23.214959+0000","last_unstale":"2024-09-22T08:14:32.984929+0000","last_undegraded":"2024-09-22T08:14:32.984929+0000","last_fullsized":"2024-09-22T08:14:32.984929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:32.984850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:32.984850+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.984850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:17.763676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.862646+0000","last_change":"2024-09-22T08:14:44.862572+0000","last_active":"2024-09-22T08:14:44.862646+0000","last_peered":"2024-09-22T08:14:44.862646+0000","last_clean":"2024-09-22T08:14:44.862646+0000","last_became_active":"2024-09-22T08:10:49.180820+0000","last_became_peered":"2024-09-22T08:10:49.180820+0000","last_unstale":"2024-09-22T08:14:44.862646+0000","last_undegraded":"2024-09-22T08:14:44.862646+0000","last_fullsized":"2024-09-22T08:14:44.862646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-22T08:14:44.862457+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-22T08:14:44.862457+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.862457+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:18.655635+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":445,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:47.876515+0000","last_change":"2024-09-22T08:14:47.876449+0000","last_active":"2024-09-22T08:14:47.876515+0000","last_peered":"2024-09-22T08:14:47.876515+0000","last_clean":"2024-09-22T08:14:47.876515+0000","last_became_active":"2024-09-22T08:10:51.197020+0000","last_became_peered":"2024-09-22T08:10:51.197020+0000","last_unstale":"2024-09-22T08:14:47.876515+0000","last_undegraded":"2024-09-22T08:14:47.876515+0000","last_fullsized":"2024-09-22T08:14:47.876515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:47.876366+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:47.876366+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.876366+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:15.274449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:02.104794+0000","last_change":"2024-09-22T08:15:02.104703+0000","last_active":"2024-09-22T08:15:02.104794+0000","last_peered":"2024-09-22T08:15:02.104794+0000","last_clean":"2024-09-22T08:15:02.104794+0000","last_became_active":"2024-09-22T08:10:53.192481+0000","last_became_peered":"2024-09-22T08:10:53.192481+0000","last_unstale":"2024-09-22T08:15:02.104794+0000","last_undegraded":"2024-09-22T08:15:02.104794+0000","last_fullsized":"2024-09-22T08:15:02.104794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-22T08:15:02.104580+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-22T08:15:02.104580+0000","last_clean_scrub_stamp":"2024-09-22T08:15:02.104580+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:54:14.669621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.823265+0000","last_change":"2024-09-22T08:14:20.823199+0000","last_active":"2024-09-22T08:14:20.823265+0000","last_peered":"2024-09-22T08:14:20.823265+0000","last_clean":"2024-09-22T08:14:20.823265+0000","last_became_active":"2024-09-22T08:10:45.172740+0000","last_became_peered":"2024-09-22T08:10:45.172740+0000","last_unstale":"2024-09-22T08:14:20.823265+0000","last_undegraded":"2024-09-22T08:14:20.823265+0000","last_fullsized":"2024-09-22T08:14:20.823265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:20.823098+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:20.823098+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.823098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:35.363067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.246430+0000","last_change":"2024-09-22T08:14:12.246369+0000","last_active":"2024-09-22T08:14:12.246430+0000","last_peered":"2024-09-22T08:14:12.246430+0000","last_clean":"2024-09-22T08:14:12.246430+0000","last_became_active":"2024-09-22T08:10:43.195355+0000","last_became_peered":"2024-09-22T08:10:43.195355+0000","last_unstale":"2024-09-22T08:14:12.246430+0000","last_undegraded":"2024-09-22T08:14:12.246430+0000","last_fullsized":"2024-09-22T08:14:12.246430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:12.246281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:12.246281+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.246281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:08.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.770224+0000","last_change":"2024-09-22T08:14:39.770164+0000","last_active":"2024-09-22T08:14:39.770224+0000","last_peered":"2024-09-22T08:14:39.770224+0000","last_clean":"2024-09-22T08:14:39.770224+0000","last_became_active":"2024-09-22T08:11:23.221981+0000","last_became_peered":"2024-09-22T08:11:23.221981+0000","last_unstale":"2024-09-22T08:14:39.770224+0000","last_undegraded":"2024-09-22T08:14:39.770224+0000","last_fullsized":"2024-09-22T08:14:39.770224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:39.770060+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:39.770060+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.770060+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:20.877929+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:05.138302+0000","last_change":"2024-09-22T08:15:05.138247+0000","last_active":"2024-09-22T08:15:05.138302+0000","last_peered":"2024-09-22T08:15:05.138302+0000","last_clean":"2024-09-22T08:15:05.138302+0000","last_became_active":"2024-09-22T08:10:49.188444+0000","last_became_peered":"2024-09-22T08:10:49.188444+0000","last_unstale":"2024-09-22T08:15:05.138302+0000","last_undegraded":"2024-09-22T08:15:05.138302+0000","last_fullsized":"2024-09-22T08:15:05.138302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-22T08:15:05.138148+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-22T08:15:05.138148+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.138148+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:45:27.459588+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":482,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:52.962238+0000","last_change":"2024-09-22T08:14:52.962171+0000","last_active":"2024-09-22T08:14:52.962238+0000","last_peered":"2024-09-22T08:14:52.962238+0000","last_clean":"2024-09-22T08:14:52.962238+0000","last_became_active":"2024-09-22T08:10:51.197248+0000","last_became_peered":"2024-09-22T08:10:51.197248+0000","last_unstale":"2024-09-22T08:14:52.962238+0000","last_undegraded":"2024-09-22T08:14:52.962238+0000","last_fullsized":"2024-09-22T08:14:52.962238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:52.962065+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:52.962065+0000","last_clean_scrub_stamp":"2024-09-22T08:14:52.962065+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:58.433161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.044843+0000","last_change":"2024-09-22T08:14:53.044767+0000","last_active":"2024-09-22T08:14:53.044843+0000","last_peered":"2024-09-22T08:14:53.044843+0000","last_clean":"2024-09-22T08:14:53.044843+0000","last_became_active":"2024-09-22T08:10:53.195539+0000","last_became_peered":"2024-09-22T08:10:53.195539+0000","last_unstale":"2024-09-22T08:14:53.044843+0000","last_undegraded":"2024-09-22T08:14:53.044843+0000","last_fullsized":"2024-09-22T08:14:53.044843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:53.044634+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:53.044634+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.044634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:56:54.663936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'8","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.869251+0000","last_change":"2024-09-22T08:14:21.869186+0000","last_active":"2024-09-22T08:14:21.869251+0000","last_peered":"2024-09-22T08:14:21.869251+0000","last_clean":"2024-09-22T08:14:21.869251+0000","last_became_active":"2024-09-22T08:11:23.220943+0000","last_became_peered":"2024-09-22T08:11:23.220943+0000","last_unstale":"2024-09-22T08:14:21.869251+0000","last_undegraded":"2024-09-22T08:14:21.869251+0000","last_fullsized":"2024-09-22T08:14:21.869251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:21.869104+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:21.869104+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.869104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:05.409690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.271932+0000","last_change":"2024-09-22T08:14:11.271839+0000","last_active":"2024-09-22T08:14:11.271932+0000","last_peered":"2024-09-22T08:14:11.271932+0000","last_clean":"2024-09-22T08:14:11.271932+0000","last_became_active":"2024-09-22T08:10:43.196211+0000","last_became_peered":"2024-09-22T08:10:43.196211+0000","last_unstale":"2024-09-22T08:14:11.271932+0000","last_undegraded":"2024-09-22T08:14:11.271932+0000","last_fullsized":"2024-09-22T08:14:11.271932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:11.271716+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:11.271716+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.271716+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:52.551470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15,"num_write":48,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.066265+0000","last_change":"2024-09-22T08:14:54.066212+0000","last_active":"2024-09-22T08:14:54.066265+0000","last_peered":"2024-09-22T08:14:54.066265+0000","last_clean":"2024-09-22T08:14:54.066265+0000","last_became_active":"2024-09-22T08:10:47.176634+0000","last_became_peered":"2024-09-22T08:10:47.176634+0000","last_unstale":"2024-09-22T08:14:54.066265+0000","last_undegraded":"2024-09-22T08:14:54.066265+0000","last_fullsized":"2024-09-22T08:14:54.066265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:54.066126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:54.066126+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.066126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:26:30.827664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:47.903689+0000","last_change":"2024-09-22T08:14:47.903630+0000","last_active":"2024-09-22T08:14:47.903689+0000","last_peered":"2024-09-22T08:14:47.903689+0000","last_clean":"2024-09-22T08:14:47.903689+0000","last_became_active":"2024-09-22T08:10:49.178942+0000","last_became_peered":"2024-09-22T08:10:49.178942+0000","last_unstale":"2024-09-22T08:14:47.903689+0000","last_undegraded":"2024-09-22T08:14:47.903689+0000","last_fullsized":"2024-09-22T08:14:47.903689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-22T08:14:47.903541+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-22T08:14:47.903541+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.903541+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:01.767431+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.886874+0000","last_change":"2024-09-22T08:14:46.886816+0000","last_active":"2024-09-22T08:14:46.886874+0000","last_peered":"2024-09-22T08:14:46.886874+0000","last_clean":"2024-09-22T08:14:46.886874+0000","last_became_active":"2024-09-22T08:10:51.192482+0000","last_became_peered":"2024-09-22T08:10:51.192482+0000","last_unstale":"2024-09-22T08:14:46.886874+0000","last_undegraded":"2024-09-22T08:14:46.886874+0000","last_fullsized":"2024-09-22T08:14:46.886874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:46.886720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:46.886720+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.886720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:57.047573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:58.018821+0000","last_change":"2024-09-22T08:14:58.018748+0000","last_active":"2024-09-22T08:14:58.018821+0000","last_peered":"2024-09-22T08:14:58.018821+0000","last_clean":"2024-09-22T08:14:58.018821+0000","last_became_active":"2024-09-22T08:10:53.193315+0000","last_became_peered":"2024-09-22T08:10:53.193315+0000","last_unstale":"2024-09-22T08:14:58.018821+0000","last_undegraded":"2024-09-22T08:14:58.018821+0000","last_fullsized":"2024-09-22T08:14:58.018821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-22T08:14:58.018659+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-22T08:14:58.018659+0000","last_clean_scrub_stamp":"2024-09-22T08:14:58.018659+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:43.561882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.149945+0000","last_change":"2024-09-22T08:14:33.149878+0000","last_active":"2024-09-22T08:14:33.149945+0000","last_peered":"2024-09-22T08:14:33.149945+0000","last_clean":"2024-09-22T08:14:33.149945+0000","last_became_active":"2024-09-22T08:10:45.176033+0000","last_became_peered":"2024-09-22T08:10:45.176033+0000","last_unstale":"2024-09-22T08:14:33.149945+0000","last_undegraded":"2024-09-22T08:14:33.149945+0000","last_fullsized":"2024-09-22T08:14:33.149945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:33.149785+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:33.149785+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.149785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:44.391078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.711837+0000","last_change":"2024-09-22T08:14:03.711736+0000","last_active":"2024-09-22T08:14:03.711837+0000","last_peered":"2024-09-22T08:14:03.711837+0000","last_clean":"2024-09-22T08:14:03.711837+0000","last_became_active":"2024-09-22T08:10:29.012953+0000","last_became_peered":"2024-09-22T08:10:29.012953+0000","last_unstale":"2024-09-22T08:14:03.711837+0000","last_undegraded":"2024-09-22T08:14:03.711837+0000","last_fullsized":"2024-09-22T08:14:03.711837+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-22T08:14:03.711630+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-22T08:14:03.711630+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.711630+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:19.958877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.254456+0000","last_change":"2024-09-22T08:14:06.254389+0000","last_active":"2024-09-22T08:14:06.254456+0000","last_peered":"2024-09-22T08:14:06.254456+0000","last_clean":"2024-09-22T08:14:06.254456+0000","last_became_active":"2024-09-22T08:10:33.920727+0000","last_became_peered":"2024-09-22T08:10:33.920727+0000","last_unstale":"2024-09-22T08:14:06.254456+0000","last_undegraded":"2024-09-22T08:14:06.254456+0000","last_fullsized":"2024-09-22T08:14:06.254456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:06.254288+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:06.254288+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.254288+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:23:56.951153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001355031,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.286225+0000","last_change":"2024-09-22T08:14:09.286135+0000","last_active":"2024-09-22T08:14:09.286225+0000","last_peered":"2024-09-22T08:14:09.286225+0000","last_clean":"2024-09-22T08:14:09.286225+0000","last_became_active":"2024-09-22T08:10:43.200918+0000","last_became_peered":"2024-09-22T08:10:43.200918+0000","last_unstale":"2024-09-22T08:14:09.286225+0000","last_undegraded":"2024-09-22T08:14:09.286225+0000","last_fullsized":"2024-09-22T08:14:09.286225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:09.286038+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:09.286038+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.286038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:54.829260+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.769140+0000","last_change":"2024-09-22T08:14:37.769086+0000","last_active":"2024-09-22T08:14:37.769140+0000","last_peered":"2024-09-22T08:14:37.769140+0000","last_clean":"2024-09-22T08:14:37.769140+0000","last_became_active":"2024-09-22T08:10:47.175775+0000","last_became_peered":"2024-09-22T08:10:47.175775+0000","last_unstale":"2024-09-22T08:14:37.769140+0000","last_undegraded":"2024-09-22T08:14:37.769140+0000","last_fullsized":"2024-09-22T08:14:37.769140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:37.769007+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:37.769007+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.769007+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:46.451261+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:01.141834+0000","last_change":"2024-09-22T08:15:01.141769+0000","last_active":"2024-09-22T08:15:01.141834+0000","last_peered":"2024-09-22T08:15:01.141834+0000","last_clean":"2024-09-22T08:15:01.141834+0000","last_became_active":"2024-09-22T08:10:49.185661+0000","last_became_peered":"2024-09-22T08:10:49.185661+0000","last_unstale":"2024-09-22T08:15:01.141834+0000","last_undegraded":"2024-09-22T08:15:01.141834+0000","last_fullsized":"2024-09-22T08:15:01.141834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-22T08:15:01.141660+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-22T08:15:01.141660+0000","last_clean_scrub_stamp":"2024-09-22T08:15:01.141660+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:30.650587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:47.089256+0000","last_change":"2024-09-22T08:14:47.089175+0000","last_active":"2024-09-22T08:14:47.089256+0000","last_peered":"2024-09-22T08:14:47.089256+0000","last_clean":"2024-09-22T08:14:47.089256+0000","last_became_active":"2024-09-22T08:10:51.202473+0000","last_became_peered":"2024-09-22T08:10:51.202473+0000","last_unstale":"2024-09-22T08:14:47.089256+0000","last_undegraded":"2024-09-22T08:14:47.089256+0000","last_fullsized":"2024-09-22T08:14:47.089256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:47.089085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:47.089085+0000","last_clean_scrub_stamp":"2024-09-22T08:14:47.089085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:26.142084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":172,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.973413+0000","last_change":"2024-09-22T08:14:54.973341+0000","last_active":"2024-09-22T08:14:54.973413+0000","last_peered":"2024-09-22T08:14:54.973413+0000","last_clean":"2024-09-22T08:14:54.973413+0000","last_became_active":"2024-09-22T08:10:53.191752+0000","last_became_peered":"2024-09-22T08:10:53.191752+0000","last_unstale":"2024-09-22T08:14:54.973413+0000","last_undegraded":"2024-09-22T08:14:54.973413+0000","last_fullsized":"2024-09-22T08:14:54.973413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-09-22T08:14:54.973252+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-09-22T08:14:54.973252+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.973252+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:54.213924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.106995+0000","last_change":"2024-09-22T08:14:34.106915+0000","last_active":"2024-09-22T08:14:34.106995+0000","last_peered":"2024-09-22T08:14:34.106995+0000","last_clean":"2024-09-22T08:14:34.106995+0000","last_became_active":"2024-09-22T08:10:45.167260+0000","last_became_peered":"2024-09-22T08:10:45.167260+0000","last_unstale":"2024-09-22T08:14:34.106995+0000","last_undegraded":"2024-09-22T08:14:34.106995+0000","last_fullsized":"2024-09-22T08:14:34.106995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:34.106788+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:34.106788+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.106788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:08.423619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.233041+0000","last_change":"2024-09-22T08:14:05.232987+0000","last_active":"2024-09-22T08:14:05.233041+0000","last_peered":"2024-09-22T08:14:05.233041+0000","last_clean":"2024-09-22T08:14:05.233041+0000","last_became_active":"2024-09-22T08:10:33.920179+0000","last_became_peered":"2024-09-22T08:10:33.920179+0000","last_unstale":"2024-09-22T08:14:05.233041+0000","last_undegraded":"2024-09-22T08:14:05.233041+0000","last_fullsized":"2024-09-22T08:14:05.233041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.232899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.232899+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.232899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:33.852323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000518564,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.919211+0000","last_change":"2024-09-22T08:14:07.919117+0000","last_active":"2024-09-22T08:14:07.919211+0000","last_peered":"2024-09-22T08:14:07.919211+0000","last_clean":"2024-09-22T08:14:07.919211+0000","last_became_active":"2024-09-22T08:10:43.177928+0000","last_became_peered":"2024-09-22T08:10:43.177928+0000","last_unstale":"2024-09-22T08:14:07.919211+0000","last_undegraded":"2024-09-22T08:14:07.919211+0000","last_fullsized":"2024-09-22T08:14:07.919211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:07.918996+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:07.918996+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.918996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:08.892898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.019752+0000","last_change":"2024-09-22T08:14:53.019667+0000","last_active":"2024-09-22T08:14:53.019752+0000","last_peered":"2024-09-22T08:14:53.019752+0000","last_clean":"2024-09-22T08:14:53.019752+0000","last_became_active":"2024-09-22T08:10:47.176402+0000","last_became_peered":"2024-09-22T08:10:47.176402+0000","last_unstale":"2024-09-22T08:14:53.019752+0000","last_undegraded":"2024-09-22T08:14:53.019752+0000","last_fullsized":"2024-09-22T08:14:53.019752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.019534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.019534+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.019534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:05.290331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'294","reported_seq":520,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.857343+0000","last_change":"2024-09-22T08:14:46.857281+0000","last_active":"2024-09-22T08:14:46.857343+0000","last_peered":"2024-09-22T08:14:46.857343+0000","last_clean":"2024-09-22T08:14:46.857343+0000","last_became_active":"2024-09-22T08:10:49.186277+0000","last_became_peered":"2024-09-22T08:10:49.186277+0000","last_unstale":"2024-09-22T08:14:46.857343+0000","last_undegraded":"2024-09-22T08:14:46.857343+0000","last_fullsized":"2024-09-22T08:14:46.857343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'294","last_scrub_stamp":"2024-09-22T08:14:46.857180+0000","last_deep_scrub":"34'294","last_deep_scrub_stamp":"2024-09-22T08:14:46.857180+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.857180+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:00.503752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:12.028952+0000","last_change":"2024-09-22T08:15:12.028952+0000","last_active":"2024-09-22T08:15:12.028952+0000","last_peered":"2024-09-22T08:15:12.028952+0000","last_clean":"2024-09-22T08:15:12.028952+0000","last_became_active":"2024-09-22T08:10:51.196837+0000","last_became_peered":"2024-09-22T08:10:51.196837+0000","last_unstale":"2024-09-22T08:15:12.028952+0000","last_undegraded":"2024-09-22T08:15:12.028952+0000","last_fullsized":"2024-09-22T08:15:12.028952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:12.028870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:12.028870+0000","last_clean_scrub_stamp":"2024-09-22T08:15:12.028870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:25:23.644284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:01.068279+0000","last_change":"2024-09-22T08:15:01.068213+0000","last_active":"2024-09-22T08:15:01.068279+0000","last_peered":"2024-09-22T08:15:01.068279+0000","last_clean":"2024-09-22T08:15:01.068279+0000","last_became_active":"2024-09-22T08:10:53.199214+0000","last_became_peered":"2024-09-22T08:10:53.199214+0000","last_unstale":"2024-09-22T08:15:01.068279+0000","last_undegraded":"2024-09-22T08:15:01.068279+0000","last_fullsized":"2024-09-22T08:15:01.068279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:15:01.068128+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:15:01.068128+0000","last_clean_scrub_stamp":"2024-09-22T08:15:01.068128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:02:12.262963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'11","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.886692+0000","last_change":"2024-09-22T08:14:19.886625+0000","last_active":"2024-09-22T08:14:19.886692+0000","last_peered":"2024-09-22T08:14:19.886692+0000","last_clean":"2024-09-22T08:14:19.886692+0000","last_became_active":"2024-09-22T08:10:45.175923+0000","last_became_peered":"2024-09-22T08:10:45.175923+0000","last_unstale":"2024-09-22T08:14:19.886692+0000","last_undegraded":"2024-09-22T08:14:19.886692+0000","last_fullsized":"2024-09-22T08:14:19.886692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-22T08:14:19.886532+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-22T08:14:19.886532+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.886532+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:15.270799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.830645+0000","last_change":"2024-09-22T08:14:04.830583+0000","last_active":"2024-09-22T08:14:04.830645+0000","last_peered":"2024-09-22T08:14:04.830645+0000","last_clean":"2024-09-22T08:14:04.830645+0000","last_became_active":"2024-09-22T08:10:33.917676+0000","last_became_peered":"2024-09-22T08:10:33.917676+0000","last_unstale":"2024-09-22T08:14:04.830645+0000","last_undegraded":"2024-09-22T08:14:04.830645+0000","last_fullsized":"2024-09-22T08:14:04.830645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:04.830494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:04.830494+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.830494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:38.025714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052116100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.991784+0000","last_change":"2024-09-22T08:14:04.991725+0000","last_active":"2024-09-22T08:14:04.991784+0000","last_peered":"2024-09-22T08:14:04.991784+0000","last_clean":"2024-09-22T08:14:04.991784+0000","last_became_active":"2024-09-22T08:10:43.186500+0000","last_became_peered":"2024-09-22T08:10:43.186500+0000","last_unstale":"2024-09-22T08:14:04.991784+0000","last_undegraded":"2024-09-22T08:14:04.991784+0000","last_fullsized":"2024-09-22T08:14:04.991784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:04.991648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:04.991648+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.991648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:45:14.250458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.012200+0000","last_change":"2024-09-22T08:14:31.012137+0000","last_active":"2024-09-22T08:14:31.012200+0000","last_peered":"2024-09-22T08:14:31.012200+0000","last_clean":"2024-09-22T08:14:31.012200+0000","last_became_active":"2024-09-22T08:10:47.172041+0000","last_became_peered":"2024-09-22T08:10:47.172041+0000","last_unstale":"2024-09-22T08:14:31.012200+0000","last_undegraded":"2024-09-22T08:14:31.012200+0000","last_fullsized":"2024-09-22T08:14:31.012200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:31.012055+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:31.012055+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.012055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:05.593483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'26","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:39.939185+0000","last_change":"2024-09-22T08:14:39.939132+0000","last_active":"2024-09-22T08:14:39.939185+0000","last_peered":"2024-09-22T08:14:39.939185+0000","last_clean":"2024-09-22T08:14:39.939185+0000","last_became_active":"2024-09-22T08:10:49.180563+0000","last_became_peered":"2024-09-22T08:10:49.180563+0000","last_unstale":"2024-09-22T08:14:39.939185+0000","last_undegraded":"2024-09-22T08:14:39.939185+0000","last_fullsized":"2024-09-22T08:14:39.939185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-22T08:14:39.939028+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-22T08:14:39.939028+0000","last_clean_scrub_stamp":"2024-09-22T08:14:39.939028+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:27.487187+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.104229+0000","last_change":"2024-09-22T08:14:48.104144+0000","last_active":"2024-09-22T08:14:48.104229+0000","last_peered":"2024-09-22T08:14:48.104229+0000","last_clean":"2024-09-22T08:14:48.104229+0000","last_became_active":"2024-09-22T08:10:51.202422+0000","last_became_peered":"2024-09-22T08:10:51.202422+0000","last_unstale":"2024-09-22T08:14:48.104229+0000","last_undegraded":"2024-09-22T08:14:48.104229+0000","last_fullsized":"2024-09-22T08:14:48.104229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:48.104065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:48.104065+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.104065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:38.165541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:20.075768+0000","last_change":"2024-09-22T08:15:20.075711+0000","last_active":"2024-09-22T08:15:20.075768+0000","last_peered":"2024-09-22T08:15:20.075768+0000","last_clean":"2024-09-22T08:15:20.075768+0000","last_became_active":"2024-09-22T08:10:53.199894+0000","last_became_peered":"2024-09-22T08:10:53.199894+0000","last_unstale":"2024-09-22T08:15:20.075768+0000","last_undegraded":"2024-09-22T08:15:20.075768+0000","last_fullsized":"2024-09-22T08:15:20.075768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:20.075619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:20.075619+0000","last_clean_scrub_stamp":"2024-09-22T08:15:20.075619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:35:11.727804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.862687+0000","last_change":"2024-09-22T08:14:18.862623+0000","last_active":"2024-09-22T08:14:18.862687+0000","last_peered":"2024-09-22T08:14:18.862687+0000","last_clean":"2024-09-22T08:14:18.862687+0000","last_became_active":"2024-09-22T08:10:45.166816+0000","last_became_peered":"2024-09-22T08:10:45.166816+0000","last_unstale":"2024-09-22T08:14:18.862687+0000","last_undegraded":"2024-09-22T08:14:18.862687+0000","last_fullsized":"2024-09-22T08:14:18.862687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:18.862531+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:18.862531+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.862531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:46:02.403117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.269417+0000","last_change":"2024-09-22T08:14:04.269311+0000","last_active":"2024-09-22T08:14:04.269417+0000","last_peered":"2024-09-22T08:14:04.269417+0000","last_clean":"2024-09-22T08:14:04.269417+0000","last_became_active":"2024-09-22T08:10:33.918186+0000","last_became_peered":"2024-09-22T08:10:33.918186+0000","last_unstale":"2024-09-22T08:14:04.269417+0000","last_undegraded":"2024-09-22T08:14:04.269417+0000","last_fullsized":"2024-09-22T08:14:04.269417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:14:04.269206+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:14:04.269206+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.269206+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:50.609384+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001151546,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.799010+0000","last_change":"2024-09-22T08:14:03.798946+0000","last_active":"2024-09-22T08:14:03.799010+0000","last_peered":"2024-09-22T08:14:03.799010+0000","last_clean":"2024-09-22T08:14:03.799010+0000","last_became_active":"2024-09-22T08:10:43.187103+0000","last_became_peered":"2024-09-22T08:10:43.187103+0000","last_unstale":"2024-09-22T08:14:03.799010+0000","last_undegraded":"2024-09-22T08:14:03.799010+0000","last_fullsized":"2024-09-22T08:14:03.799010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:03.798857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:03.798857+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.798857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:24.946857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.030556+0000","last_change":"2024-09-22T08:14:32.030496+0000","last_active":"2024-09-22T08:14:32.030556+0000","last_peered":"2024-09-22T08:14:32.030556+0000","last_clean":"2024-09-22T08:14:32.030556+0000","last_became_active":"2024-09-22T08:10:47.168480+0000","last_became_peered":"2024-09-22T08:10:47.168480+0000","last_unstale":"2024-09-22T08:14:32.030556+0000","last_undegraded":"2024-09-22T08:14:32.030556+0000","last_fullsized":"2024-09-22T08:14:32.030556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:32.030385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:32.030385+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.030385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:36.251439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'21","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:00.139702+0000","last_change":"2024-09-22T08:15:00.139646+0000","last_active":"2024-09-22T08:15:00.139702+0000","last_peered":"2024-09-22T08:15:00.139702+0000","last_clean":"2024-09-22T08:15:00.139702+0000","last_became_active":"2024-09-22T08:10:49.184961+0000","last_became_peered":"2024-09-22T08:10:49.184961+0000","last_unstale":"2024-09-22T08:15:00.139702+0000","last_undegraded":"2024-09-22T08:15:00.139702+0000","last_fullsized":"2024-09-22T08:15:00.139702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-22T08:15:00.139531+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-22T08:15:00.139531+0000","last_clean_scrub_stamp":"2024-09-22T08:15:00.139531+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:32:34.103957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:13.040441+0000","last_change":"2024-09-22T08:15:13.040441+0000","last_active":"2024-09-22T08:15:13.040441+0000","last_peered":"2024-09-22T08:15:13.040441+0000","last_clean":"2024-09-22T08:15:13.040441+0000","last_became_active":"2024-09-22T08:10:51.195643+0000","last_became_peered":"2024-09-22T08:10:51.195643+0000","last_unstale":"2024-09-22T08:15:13.040441+0000","last_undegraded":"2024-09-22T08:15:13.040441+0000","last_fullsized":"2024-09-22T08:15:13.040441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:13.040340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:13.040340+0000","last_clean_scrub_stamp":"2024-09-22T08:15:13.040340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:00.026258+0000","last_change":"2024-09-22T08:15:00.026186+0000","last_active":"2024-09-22T08:15:00.026258+0000","last_peered":"2024-09-22T08:15:00.026258+0000","last_clean":"2024-09-22T08:15:00.026258+0000","last_became_active":"2024-09-22T08:10:53.203330+0000","last_became_peered":"2024-09-22T08:10:53.203330+0000","last_unstale":"2024-09-22T08:15:00.026258+0000","last_undegraded":"2024-09-22T08:15:00.026258+0000","last_fullsized":"2024-09-22T08:15:00.026258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:15:00.026100+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:15:00.026100+0000","last_clean_scrub_stamp":"2024-09-22T08:15:00.026100+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:04.621822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:17.790753+0000","last_change":"2024-09-22T08:14:17.790672+0000","last_active":"2024-09-22T08:14:17.790753+0000","last_peered":"2024-09-22T08:14:17.790753+0000","last_clean":"2024-09-22T08:14:17.790753+0000","last_became_active":"2024-09-22T08:10:45.182276+0000","last_became_peered":"2024-09-22T08:10:45.182276+0000","last_unstale":"2024-09-22T08:14:17.790753+0000","last_undegraded":"2024-09-22T08:14:17.790753+0000","last_fullsized":"2024-09-22T08:14:17.790753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:17.790565+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:17.790565+0000","last_clean_scrub_stamp":"2024-09-22T08:14:17.790565+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:25.799618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.787575+0000","last_change":"2024-09-22T08:14:05.787504+0000","last_active":"2024-09-22T08:14:05.787575+0000","last_peered":"2024-09-22T08:14:05.787575+0000","last_clean":"2024-09-22T08:14:05.787575+0000","last_became_active":"2024-09-22T08:10:43.186175+0000","last_became_peered":"2024-09-22T08:10:43.186175+0000","last_unstale":"2024-09-22T08:14:05.787575+0000","last_undegraded":"2024-09-22T08:14:05.787575+0000","last_fullsized":"2024-09-22T08:14:05.787575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:05.787417+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:05.787417+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.787417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:26:42.384319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:03.983831+0000","last_change":"2024-09-22T08:14:03.983783+0000","last_active":"2024-09-22T08:14:03.983831+0000","last_peered":"2024-09-22T08:14:03.983831+0000","last_clean":"2024-09-22T08:14:03.983831+0000","last_became_active":"2024-09-22T08:10:33.920597+0000","last_became_peered":"2024-09-22T08:10:33.920597+0000","last_unstale":"2024-09-22T08:14:03.983831+0000","last_undegraded":"2024-09-22T08:14:03.983831+0000","last_fullsized":"2024-09-22T08:14:03.983831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:03.983713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:03.983713+0000","last_clean_scrub_stamp":"2024-09-22T08:14:03.983713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:58.921961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000545419,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:34.015306+0000","last_change":"2024-09-22T08:14:34.015250+0000","last_active":"2024-09-22T08:14:34.015306+0000","last_peered":"2024-09-22T08:14:34.015306+0000","last_clean":"2024-09-22T08:14:34.015306+0000","last_became_active":"2024-09-22T08:10:47.167620+0000","last_became_peered":"2024-09-22T08:10:47.167620+0000","last_unstale":"2024-09-22T08:14:34.015306+0000","last_undegraded":"2024-09-22T08:14:34.015306+0000","last_fullsized":"2024-09-22T08:14:34.015306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:34.015156+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:34.015156+0000","last_clean_scrub_stamp":"2024-09-22T08:14:34.015156+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:16:40.094721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'79","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.033522+0000","last_change":"2024-09-22T08:14:40.033421+0000","last_active":"2024-09-22T08:14:40.033522+0000","last_peered":"2024-09-22T08:14:40.033522+0000","last_clean":"2024-09-22T08:14:40.033522+0000","last_became_active":"2024-09-22T08:10:49.184753+0000","last_became_peered":"2024-09-22T08:10:49.184753+0000","last_unstale":"2024-09-22T08:14:40.033522+0000","last_undegraded":"2024-09-22T08:14:40.033522+0000","last_fullsized":"2024-09-22T08:14:40.033522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'79","last_scrub_stamp":"2024-09-22T08:14:40.033261+0000","last_deep_scrub":"34'79","last_deep_scrub_stamp":"2024-09-22T08:14:40.033261+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.033261+0000","objects_scrubbed":9,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:08.329565+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.865327+0000","last_change":"2024-09-22T08:14:45.865265+0000","last_active":"2024-09-22T08:14:45.865327+0000","last_peered":"2024-09-22T08:14:45.865327+0000","last_clean":"2024-09-22T08:14:45.865327+0000","last_became_active":"2024-09-22T08:10:51.196724+0000","last_became_peered":"2024-09-22T08:10:51.196724+0000","last_unstale":"2024-09-22T08:14:45.865327+0000","last_undegraded":"2024-09-22T08:14:45.865327+0000","last_fullsized":"2024-09-22T08:14:45.865327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:45.865172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:45.865172+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.865172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:03.500814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.036877+0000","last_change":"2024-09-22T08:14:57.036807+0000","last_active":"2024-09-22T08:14:57.036877+0000","last_peered":"2024-09-22T08:14:57.036877+0000","last_clean":"2024-09-22T08:14:57.036877+0000","last_became_active":"2024-09-22T08:10:53.196406+0000","last_became_peered":"2024-09-22T08:10:53.196406+0000","last_unstale":"2024-09-22T08:14:57.036877+0000","last_undegraded":"2024-09-22T08:14:57.036877+0000","last_fullsized":"2024-09-22T08:14:57.036877+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-22T08:14:57.036723+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-22T08:14:57.036723+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.036723+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:02:08.231558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.830960+0000","last_change":"2024-09-22T08:14:18.830904+0000","last_active":"2024-09-22T08:14:18.830960+0000","last_peered":"2024-09-22T08:14:18.830960+0000","last_clean":"2024-09-22T08:14:18.830960+0000","last_became_active":"2024-09-22T08:10:45.176601+0000","last_became_peered":"2024-09-22T08:10:45.176601+0000","last_unstale":"2024-09-22T08:14:18.830960+0000","last_undegraded":"2024-09-22T08:14:18.830960+0000","last_fullsized":"2024-09-22T08:14:18.830960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:18.830805+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.830805+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.830805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:27:34.352591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.951111+0000","last_change":"2024-09-22T08:14:06.951005+0000","last_active":"2024-09-22T08:14:06.951111+0000","last_peered":"2024-09-22T08:14:06.951111+0000","last_clean":"2024-09-22T08:14:06.951111+0000","last_became_active":"2024-09-22T08:10:43.186758+0000","last_became_peered":"2024-09-22T08:10:43.186758+0000","last_unstale":"2024-09-22T08:14:06.951111+0000","last_undegraded":"2024-09-22T08:14:06.951111+0000","last_fullsized":"2024-09-22T08:14:06.951111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:06.950903+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:06.950903+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.950903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:00.975454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.240086+0000","last_change":"2024-09-22T08:14:08.240026+0000","last_active":"2024-09-22T08:14:08.240086+0000","last_peered":"2024-09-22T08:14:08.240086+0000","last_clean":"2024-09-22T08:14:08.240086+0000","last_became_active":"2024-09-22T08:10:33.918051+0000","last_became_peered":"2024-09-22T08:10:33.918051+0000","last_unstale":"2024-09-22T08:14:08.240086+0000","last_undegraded":"2024-09-22T08:14:08.240086+0000","last_fullsized":"2024-09-22T08:14:08.240086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.239939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.239939+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.239939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:30.468689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00054231500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:52.058236+0000","last_change":"2024-09-22T08:14:52.058180+0000","last_active":"2024-09-22T08:14:52.058236+0000","last_peered":"2024-09-22T08:14:52.058236+0000","last_clean":"2024-09-22T08:14:52.058236+0000","last_became_active":"2024-09-22T08:10:47.173348+0000","last_became_peered":"2024-09-22T08:10:47.173348+0000","last_unstale":"2024-09-22T08:14:52.058236+0000","last_undegraded":"2024-09-22T08:14:52.058236+0000","last_fullsized":"2024-09-22T08:14:52.058236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:52.058080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:52.058080+0000","last_clean_scrub_stamp":"2024-09-22T08:14:52.058080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:37.500789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.847583+0000","last_change":"2024-09-22T08:14:44.847529+0000","last_active":"2024-09-22T08:14:44.847583+0000","last_peered":"2024-09-22T08:14:44.847583+0000","last_clean":"2024-09-22T08:14:44.847583+0000","last_became_active":"2024-09-22T08:10:49.187184+0000","last_became_peered":"2024-09-22T08:10:49.187184+0000","last_unstale":"2024-09-22T08:14:44.847583+0000","last_undegraded":"2024-09-22T08:14:44.847583+0000","last_fullsized":"2024-09-22T08:14:44.847583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-22T08:14:44.847434+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-22T08:14:44.847434+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.847434+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:38.526852+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.958335+0000","last_change":"2024-09-22T08:14:51.958279+0000","last_active":"2024-09-22T08:14:51.958335+0000","last_peered":"2024-09-22T08:14:51.958335+0000","last_clean":"2024-09-22T08:14:51.958335+0000","last_became_active":"2024-09-22T08:10:51.197111+0000","last_became_peered":"2024-09-22T08:10:51.197111+0000","last_unstale":"2024-09-22T08:14:51.958335+0000","last_undegraded":"2024-09-22T08:14:51.958335+0000","last_fullsized":"2024-09-22T08:14:51.958335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:51.958172+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:51.958172+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.958172+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:42.019648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:24.010620+0000","last_change":"2024-09-22T08:15:24.010620+0000","last_active":"2024-09-22T08:15:24.010620+0000","last_peered":"2024-09-22T08:15:24.010620+0000","last_clean":"2024-09-22T08:15:24.010620+0000","last_became_active":"2024-09-22T08:10:53.199612+0000","last_became_peered":"2024-09-22T08:10:53.199612+0000","last_unstale":"2024-09-22T08:15:24.010620+0000","last_undegraded":"2024-09-22T08:15:24.010620+0000","last_fullsized":"2024-09-22T08:15:24.010620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:24.010533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:24.010533+0000","last_clean_scrub_stamp":"2024-09-22T08:15:24.010533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:58.979186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'2","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.199484+0000","last_change":"2024-09-22T08:14:32.199399+0000","last_active":"2024-09-22T08:14:32.199484+0000","last_peered":"2024-09-22T08:14:32.199484+0000","last_clean":"2024-09-22T08:14:32.199484+0000","last_became_active":"2024-09-22T08:10:45.183229+0000","last_became_peered":"2024-09-22T08:10:45.183229+0000","last_unstale":"2024-09-22T08:14:32.199484+0000","last_undegraded":"2024-09-22T08:14:32.199484+0000","last_fullsized":"2024-09-22T08:14:32.199484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:32.199294+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:32.199294+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.199294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:42.593819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.315254+0000","last_change":"2024-09-22T08:14:10.315191+0000","last_active":"2024-09-22T08:14:10.315254+0000","last_peered":"2024-09-22T08:14:10.315254+0000","last_clean":"2024-09-22T08:14:10.315254+0000","last_became_active":"2024-09-22T08:10:43.198637+0000","last_became_peered":"2024-09-22T08:10:43.198637+0000","last_unstale":"2024-09-22T08:14:10.315254+0000","last_undegraded":"2024-09-22T08:14:10.315254+0000","last_fullsized":"2024-09-22T08:14:10.315254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:10.315107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:10.315107+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.315107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:41:31.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:02.966971+0000","last_change":"2024-09-22T08:14:02.966909+0000","last_active":"2024-09-22T08:14:02.966971+0000","last_peered":"2024-09-22T08:14:02.966971+0000","last_clean":"2024-09-22T08:14:02.966971+0000","last_became_active":"2024-09-22T08:10:33.920821+0000","last_became_peered":"2024-09-22T08:10:33.920821+0000","last_unstale":"2024-09-22T08:14:02.966971+0000","last_undegraded":"2024-09-22T08:14:02.966971+0000","last_fullsized":"2024-09-22T08:14:02.966971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:02.966839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:02.966839+0000","last_clean_scrub_stamp":"2024-09-22T08:14:02.966839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:08.371695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059953899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.061262+0000","last_change":"2024-09-22T08:14:51.061185+0000","last_active":"2024-09-22T08:14:51.061262+0000","last_peered":"2024-09-22T08:14:51.061262+0000","last_clean":"2024-09-22T08:14:51.061262+0000","last_became_active":"2024-09-22T08:11:23.216676+0000","last_became_peered":"2024-09-22T08:11:23.216676+0000","last_unstale":"2024-09-22T08:14:51.061262+0000","last_undegraded":"2024-09-22T08:14:51.061262+0000","last_fullsized":"2024-09-22T08:14:51.061262+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:51.061100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:51.061100+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.061100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:02.961951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:58.087045+0000","last_change":"2024-09-22T08:14:58.086988+0000","last_active":"2024-09-22T08:14:58.087045+0000","last_peered":"2024-09-22T08:14:58.087045+0000","last_clean":"2024-09-22T08:14:58.087045+0000","last_became_active":"2024-09-22T08:10:49.188309+0000","last_became_peered":"2024-09-22T08:10:49.188309+0000","last_unstale":"2024-09-22T08:14:58.087045+0000","last_undegraded":"2024-09-22T08:14:58.087045+0000","last_fullsized":"2024-09-22T08:14:58.087045+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-22T08:14:58.086893+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-22T08:14:58.086893+0000","last_clean_scrub_stamp":"2024-09-22T08:14:58.086893+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:13:44.496314+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.105970+0000","last_change":"2024-09-22T08:14:45.105923+0000","last_active":"2024-09-22T08:14:45.105970+0000","last_peered":"2024-09-22T08:14:45.105970+0000","last_clean":"2024-09-22T08:14:45.105970+0000","last_became_active":"2024-09-22T08:10:51.192058+0000","last_became_peered":"2024-09-22T08:10:51.192058+0000","last_unstale":"2024-09-22T08:14:45.105970+0000","last_undegraded":"2024-09-22T08:14:45.105970+0000","last_fullsized":"2024-09-22T08:14:45.105970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:45.105854+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:45.105854+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.105854+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:19.242010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:02.067863+0000","last_change":"2024-09-22T08:15:02.067750+0000","last_active":"2024-09-22T08:15:02.067863+0000","last_peered":"2024-09-22T08:15:02.067863+0000","last_clean":"2024-09-22T08:15:02.067863+0000","last_became_active":"2024-09-22T08:10:53.203670+0000","last_became_peered":"2024-09-22T08:10:53.203670+0000","last_unstale":"2024-09-22T08:15:02.067863+0000","last_undegraded":"2024-09-22T08:15:02.067863+0000","last_fullsized":"2024-09-22T08:15:02.067863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-22T08:15:02.067649+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-22T08:15:02.067649+0000","last_clean_scrub_stamp":"2024-09-22T08:15:02.067649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:21.196732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'17","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.858477+0000","last_change":"2024-09-22T08:14:19.858415+0000","last_active":"2024-09-22T08:14:19.858477+0000","last_peered":"2024-09-22T08:14:19.858477+0000","last_clean":"2024-09-22T08:14:19.858477+0000","last_became_active":"2024-09-22T08:10:45.171667+0000","last_became_peered":"2024-09-22T08:10:45.171667+0000","last_unstale":"2024-09-22T08:14:19.858477+0000","last_undegraded":"2024-09-22T08:14:19.858477+0000","last_fullsized":"2024-09-22T08:14:19.858477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-22T08:14:19.858328+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-22T08:14:19.858328+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.858328+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:20.434578+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":71,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:04.704638+0000","last_change":"2024-09-22T08:14:04.704581+0000","last_active":"2024-09-22T08:14:04.704638+0000","last_peered":"2024-09-22T08:14:04.704638+0000","last_clean":"2024-09-22T08:14:04.704638+0000","last_became_active":"2024-09-22T08:10:43.182161+0000","last_became_peered":"2024-09-22T08:10:43.182161+0000","last_unstale":"2024-09-22T08:14:04.704638+0000","last_undegraded":"2024-09-22T08:14:04.704638+0000","last_fullsized":"2024-09-22T08:14:04.704638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:04.704488+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:04.704488+0000","last_clean_scrub_stamp":"2024-09-22T08:14:04.704488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:26.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.215265+0000","last_change":"2024-09-22T08:14:07.215210+0000","last_active":"2024-09-22T08:14:07.215265+0000","last_peered":"2024-09-22T08:14:07.215265+0000","last_clean":"2024-09-22T08:14:07.215265+0000","last_became_active":"2024-09-22T08:10:34.272364+0000","last_became_peered":"2024-09-22T08:10:34.272364+0000","last_unstale":"2024-09-22T08:14:07.215265+0000","last_undegraded":"2024-09-22T08:14:07.215265+0000","last_fullsized":"2024-09-22T08:14:07.215265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:07.215094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:07.215094+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.215094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:24.079988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012076159999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.032150+0000","last_change":"2024-09-22T08:14:49.032150+0000","last_active":"2024-09-22T08:14:49.032150+0000","last_peered":"2024-09-22T08:14:49.032150+0000","last_clean":"2024-09-22T08:14:49.032150+0000","last_became_active":"2024-09-22T08:10:47.172441+0000","last_became_peered":"2024-09-22T08:10:47.172441+0000","last_unstale":"2024-09-22T08:14:49.032150+0000","last_undegraded":"2024-09-22T08:14:49.032150+0000","last_fullsized":"2024-09-22T08:14:49.032150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:49.032018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:49.032018+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.032018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:39.744849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'99","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.904053+0000","last_change":"2024-09-22T08:14:40.903978+0000","last_active":"2024-09-22T08:14:40.904053+0000","last_peered":"2024-09-22T08:14:40.904053+0000","last_clean":"2024-09-22T08:14:40.904053+0000","last_became_active":"2024-09-22T08:10:49.184942+0000","last_became_peered":"2024-09-22T08:10:49.184942+0000","last_unstale":"2024-09-22T08:14:40.904053+0000","last_undegraded":"2024-09-22T08:14:40.904053+0000","last_fullsized":"2024-09-22T08:14:40.904053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'99","last_scrub_stamp":"2024-09-22T08:14:40.903848+0000","last_deep_scrub":"34'99","last_deep_scrub_stamp":"2024-09-22T08:14:40.903848+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.903848+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:07.358495+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:46.127662+0000","last_change":"2024-09-22T08:14:46.127575+0000","last_active":"2024-09-22T08:14:46.127662+0000","last_peered":"2024-09-22T08:14:46.127662+0000","last_clean":"2024-09-22T08:14:46.127662+0000","last_became_active":"2024-09-22T08:10:51.194912+0000","last_became_peered":"2024-09-22T08:10:51.194912+0000","last_unstale":"2024-09-22T08:14:46.127662+0000","last_undegraded":"2024-09-22T08:14:46.127662+0000","last_fullsized":"2024-09-22T08:14:46.127662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:46.127459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:46.127459+0000","last_clean_scrub_stamp":"2024-09-22T08:14:46.127459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:56.216743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.977114+0000","last_change":"2024-09-22T08:14:55.977006+0000","last_active":"2024-09-22T08:14:55.977114+0000","last_peered":"2024-09-22T08:14:55.977114+0000","last_clean":"2024-09-22T08:14:55.977114+0000","last_became_active":"2024-09-22T08:10:53.192189+0000","last_became_peered":"2024-09-22T08:10:53.192189+0000","last_unstale":"2024-09-22T08:14:55.977114+0000","last_undegraded":"2024-09-22T08:14:55.977114+0000","last_fullsized":"2024-09-22T08:14:55.977114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.976887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.976887+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.976887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:39.042717+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:57.959017+0000","last_change":"2024-09-22T08:14:57.958918+0000","last_active":"2024-09-22T08:14:57.959017+0000","last_peered":"2024-09-22T08:14:57.959017+0000","last_clean":"2024-09-22T08:14:57.959017+0000","last_became_active":"2024-09-22T08:10:53.197799+0000","last_became_peered":"2024-09-22T08:10:53.197799+0000","last_unstale":"2024-09-22T08:14:57.959017+0000","last_undegraded":"2024-09-22T08:14:57.959017+0000","last_fullsized":"2024-09-22T08:14:57.959017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:57.958818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:57.958818+0000","last_clean_scrub_stamp":"2024-09-22T08:14:57.958818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:32:50.464511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.911827+0000","last_change":"2024-09-22T08:14:22.911762+0000","last_active":"2024-09-22T08:14:22.911827+0000","last_peered":"2024-09-22T08:14:22.911827+0000","last_clean":"2024-09-22T08:14:22.911827+0000","last_became_active":"2024-09-22T08:10:45.173916+0000","last_became_peered":"2024-09-22T08:10:45.173916+0000","last_unstale":"2024-09-22T08:14:22.911827+0000","last_undegraded":"2024-09-22T08:14:22.911827+0000","last_fullsized":"2024-09-22T08:14:22.911827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:22.911670+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:22.911670+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.911670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:49:48.789223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:18.225320+0000","last_change":"2024-09-22T08:14:18.225254+0000","last_active":"2024-09-22T08:14:18.225320+0000","last_peered":"2024-09-22T08:14:18.225320+0000","last_clean":"2024-09-22T08:14:18.225320+0000","last_became_active":"2024-09-22T08:10:43.201007+0000","last_became_peered":"2024-09-22T08:10:43.201007+0000","last_unstale":"2024-09-22T08:14:18.225320+0000","last_undegraded":"2024-09-22T08:14:18.225320+0000","last_fullsized":"2024-09-22T08:14:18.225320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:18.225171+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:18.225171+0000","last_clean_scrub_stamp":"2024-09-22T08:14:18.225171+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:48.896171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:40.812962+0000","last_change":"2024-09-22T08:14:40.812893+0000","last_active":"2024-09-22T08:14:40.812962+0000","last_peered":"2024-09-22T08:14:40.812962+0000","last_clean":"2024-09-22T08:14:40.812962+0000","last_became_active":"2024-09-22T08:10:47.175524+0000","last_became_peered":"2024-09-22T08:10:47.175524+0000","last_unstale":"2024-09-22T08:14:40.812962+0000","last_undegraded":"2024-09-22T08:14:40.812962+0000","last_fullsized":"2024-09-22T08:14:40.812962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:40.812810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:40.812810+0000","last_clean_scrub_stamp":"2024-09-22T08:14:40.812810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:50.272803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:06.128511+0000","last_change":"2024-09-22T08:15:06.128454+0000","last_active":"2024-09-22T08:15:06.128511+0000","last_peered":"2024-09-22T08:15:06.128511+0000","last_clean":"2024-09-22T08:15:06.128511+0000","last_became_active":"2024-09-22T08:10:49.185693+0000","last_became_peered":"2024-09-22T08:10:49.185693+0000","last_unstale":"2024-09-22T08:15:06.128511+0000","last_undegraded":"2024-09-22T08:15:06.128511+0000","last_fullsized":"2024-09-22T08:15:06.128511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-22T08:15:06.128366+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-22T08:15:06.128366+0000","last_clean_scrub_stamp":"2024-09-22T08:15:06.128366+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:56.570804+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:14.970896+0000","last_change":"2024-09-22T08:15:14.970812+0000","last_active":"2024-09-22T08:15:14.970896+0000","last_peered":"2024-09-22T08:15:14.970896+0000","last_clean":"2024-09-22T08:15:14.970896+0000","last_became_active":"2024-09-22T08:10:51.199799+0000","last_became_peered":"2024-09-22T08:10:51.199799+0000","last_unstale":"2024-09-22T08:15:14.970896+0000","last_undegraded":"2024-09-22T08:15:14.970896+0000","last_fullsized":"2024-09-22T08:15:14.970896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:14.970699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:14.970699+0000","last_clean_scrub_stamp":"2024-09-22T08:15:14.970699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:40:21.254528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'14","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:04.034975+0000","last_change":"2024-09-22T08:15:04.034975+0000","last_active":"2024-09-22T08:15:04.034975+0000","last_peered":"2024-09-22T08:15:04.034975+0000","last_clean":"2024-09-22T08:15:04.034975+0000","last_became_active":"2024-09-22T08:10:53.201209+0000","last_became_peered":"2024-09-22T08:10:53.201209+0000","last_unstale":"2024-09-22T08:15:04.034975+0000","last_undegraded":"2024-09-22T08:15:04.034975+0000","last_fullsized":"2024-09-22T08:15:04.034975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:15:04.034870+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:15:04.034870+0000","last_clean_scrub_stamp":"2024-09-22T08:15:04.034870+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:48.016764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":69,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'12","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.885324+0000","last_change":"2024-09-22T08:14:22.885259+0000","last_active":"2024-09-22T08:14:22.885324+0000","last_peered":"2024-09-22T08:14:22.885324+0000","last_clean":"2024-09-22T08:14:22.885324+0000","last_became_active":"2024-09-22T08:10:45.182245+0000","last_became_peered":"2024-09-22T08:10:45.182245+0000","last_unstale":"2024-09-22T08:14:22.885324+0000","last_undegraded":"2024-09-22T08:14:22.885324+0000","last_fullsized":"2024-09-22T08:14:22.885324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:22.885177+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:22.885177+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.885177+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:37:18.269445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.706478+0000","last_change":"2024-09-22T08:14:10.706396+0000","last_active":"2024-09-22T08:14:10.706478+0000","last_peered":"2024-09-22T08:14:10.706478+0000","last_clean":"2024-09-22T08:14:10.706478+0000","last_became_active":"2024-09-22T08:10:43.185230+0000","last_became_peered":"2024-09-22T08:10:43.185230+0000","last_unstale":"2024-09-22T08:14:10.706478+0000","last_undegraded":"2024-09-22T08:14:10.706478+0000","last_fullsized":"2024-09-22T08:14:10.706478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:10.706291+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:10.706291+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.706291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:16.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:56.030850+0000","last_change":"2024-09-22T08:14:56.030787+0000","last_active":"2024-09-22T08:14:56.030850+0000","last_peered":"2024-09-22T08:14:56.030850+0000","last_clean":"2024-09-22T08:14:56.030850+0000","last_became_active":"2024-09-22T08:10:47.175747+0000","last_became_peered":"2024-09-22T08:10:47.175747+0000","last_unstale":"2024-09-22T08:14:56.030850+0000","last_undegraded":"2024-09-22T08:14:56.030850+0000","last_fullsized":"2024-09-22T08:14:56.030850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:56.030708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:56.030708+0000","last_clean_scrub_stamp":"2024-09-22T08:14:56.030708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:55:19.490689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.041465+0000","last_change":"2024-09-22T08:14:41.041367+0000","last_active":"2024-09-22T08:14:41.041465+0000","last_peered":"2024-09-22T08:14:41.041465+0000","last_clean":"2024-09-22T08:14:41.041465+0000","last_became_active":"2024-09-22T08:10:49.180921+0000","last_became_peered":"2024-09-22T08:10:49.180921+0000","last_unstale":"2024-09-22T08:14:41.041465+0000","last_undegraded":"2024-09-22T08:14:41.041465+0000","last_fullsized":"2024-09-22T08:14:41.041465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:41.041241+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:41.041241+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.041241+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:34.720660+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:48.923327+0000","last_change":"2024-09-22T08:14:48.923262+0000","last_active":"2024-09-22T08:14:48.923327+0000","last_peered":"2024-09-22T08:14:48.923327+0000","last_clean":"2024-09-22T08:14:48.923327+0000","last_became_active":"2024-09-22T08:10:51.192989+0000","last_became_peered":"2024-09-22T08:10:51.192989+0000","last_unstale":"2024-09-22T08:14:48.923327+0000","last_undegraded":"2024-09-22T08:14:48.923327+0000","last_fullsized":"2024-09-22T08:14:48.923327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:48.923162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:48.923162+0000","last_clean_scrub_stamp":"2024-09-22T08:14:48.923162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:34.528022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:01.097179+0000","last_change":"2024-09-22T08:15:01.097179+0000","last_active":"2024-09-22T08:15:01.097179+0000","last_peered":"2024-09-22T08:15:01.097179+0000","last_clean":"2024-09-22T08:15:01.097179+0000","last_became_active":"2024-09-22T08:10:53.192967+0000","last_became_peered":"2024-09-22T08:10:53.192967+0000","last_unstale":"2024-09-22T08:15:01.097179+0000","last_undegraded":"2024-09-22T08:15:01.097179+0000","last_fullsized":"2024-09-22T08:15:01.097179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:15:01.097092+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:15:01.097092+0000","last_clean_scrub_stamp":"2024-09-22T08:15:01.097092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:35:15.265735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.890549+0000","last_change":"2024-09-22T08:14:25.890489+0000","last_active":"2024-09-22T08:14:25.890549+0000","last_peered":"2024-09-22T08:14:25.890549+0000","last_clean":"2024-09-22T08:14:25.890549+0000","last_became_active":"2024-09-22T08:10:45.171555+0000","last_became_peered":"2024-09-22T08:10:45.171555+0000","last_unstale":"2024-09-22T08:14:25.890549+0000","last_undegraded":"2024-09-22T08:14:25.890549+0000","last_fullsized":"2024-09-22T08:14:25.890549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:25.890395+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:25.890395+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.890395+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:37.923633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.741646+0000","last_change":"2024-09-22T08:14:09.741592+0000","last_active":"2024-09-22T08:14:09.741646+0000","last_peered":"2024-09-22T08:14:09.741646+0000","last_clean":"2024-09-22T08:14:09.741646+0000","last_became_active":"2024-09-22T08:10:43.187044+0000","last_became_peered":"2024-09-22T08:10:43.187044+0000","last_unstale":"2024-09-22T08:14:09.741646+0000","last_undegraded":"2024-09-22T08:14:09.741646+0000","last_fullsized":"2024-09-22T08:14:09.741646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:09.741505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:09.741505+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.741505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:51.031430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.006725+0000","last_change":"2024-09-22T08:14:35.006667+0000","last_active":"2024-09-22T08:14:35.006725+0000","last_peered":"2024-09-22T08:14:35.006725+0000","last_clean":"2024-09-22T08:14:35.006725+0000","last_became_active":"2024-09-22T08:10:47.177735+0000","last_became_peered":"2024-09-22T08:10:47.177735+0000","last_unstale":"2024-09-22T08:14:35.006725+0000","last_undegraded":"2024-09-22T08:14:35.006725+0000","last_fullsized":"2024-09-22T08:14:35.006725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:14:35.006578+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:14:35.006578+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.006578+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:46.461347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.083710+0000","last_change":"2024-09-22T08:14:43.083581+0000","last_active":"2024-09-22T08:14:43.083710+0000","last_peered":"2024-09-22T08:14:43.083710+0000","last_clean":"2024-09-22T08:14:43.083710+0000","last_became_active":"2024-09-22T08:10:49.182557+0000","last_became_peered":"2024-09-22T08:10:49.182557+0000","last_unstale":"2024-09-22T08:14:43.083710+0000","last_undegraded":"2024-09-22T08:14:43.083710+0000","last_fullsized":"2024-09-22T08:14:43.083710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-22T08:14:43.083449+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-22T08:14:43.083449+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.083449+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:56.730021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:53.993806+0000","last_change":"2024-09-22T08:14:53.993720+0000","last_active":"2024-09-22T08:14:53.993806+0000","last_peered":"2024-09-22T08:14:53.993806+0000","last_clean":"2024-09-22T08:14:53.993806+0000","last_became_active":"2024-09-22T08:10:51.198204+0000","last_became_peered":"2024-09-22T08:10:51.198204+0000","last_unstale":"2024-09-22T08:14:53.993806+0000","last_undegraded":"2024-09-22T08:14:53.993806+0000","last_fullsized":"2024-09-22T08:14:53.993806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:53.993609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:53.993609+0000","last_clean_scrub_stamp":"2024-09-22T08:14:53.993609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:44.690474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'4","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:25.940612+0000","last_change":"2024-09-22T08:15:25.940612+0000","last_active":"2024-09-22T08:15:25.940612+0000","last_peered":"2024-09-22T08:15:25.940612+0000","last_clean":"2024-09-22T08:15:25.940612+0000","last_became_active":"2024-09-22T08:10:53.199827+0000","last_became_peered":"2024-09-22T08:10:53.199827+0000","last_unstale":"2024-09-22T08:15:25.940612+0000","last_undegraded":"2024-09-22T08:15:25.940612+0000","last_fullsized":"2024-09-22T08:15:25.940612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:15:25.940523+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:15:25.940523+0000","last_clean_scrub_stamp":"2024-09-22T08:15:25.940523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:12.577601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.086577+0000","last_change":"2024-09-22T08:14:37.086499+0000","last_active":"2024-09-22T08:14:37.086577+0000","last_peered":"2024-09-22T08:14:37.086577+0000","last_clean":"2024-09-22T08:14:37.086577+0000","last_became_active":"2024-09-22T08:10:45.183674+0000","last_became_peered":"2024-09-22T08:10:45.183674+0000","last_unstale":"2024-09-22T08:14:37.086577+0000","last_undegraded":"2024-09-22T08:14:37.086577+0000","last_fullsized":"2024-09-22T08:14:37.086577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:37.086391+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:37.086391+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.086391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:29.610650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:06.769858+0000","last_change":"2024-09-22T08:14:06.769770+0000","last_active":"2024-09-22T08:14:06.769858+0000","last_peered":"2024-09-22T08:14:06.769858+0000","last_clean":"2024-09-22T08:14:06.769858+0000","last_became_active":"2024-09-22T08:10:43.184287+0000","last_became_peered":"2024-09-22T08:10:43.184287+0000","last_unstale":"2024-09-22T08:14:06.769858+0000","last_undegraded":"2024-09-22T08:14:06.769858+0000","last_fullsized":"2024-09-22T08:14:06.769858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:06.769651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:06.769651+0000","last_clean_scrub_stamp":"2024-09-22T08:14:06.769651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:24.233361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.038846+0000","last_change":"2024-09-22T08:14:55.038776+0000","last_active":"2024-09-22T08:14:55.038846+0000","last_peered":"2024-09-22T08:14:55.038846+0000","last_clean":"2024-09-22T08:14:55.038846+0000","last_became_active":"2024-09-22T08:10:47.172816+0000","last_became_peered":"2024-09-22T08:10:47.172816+0000","last_unstale":"2024-09-22T08:14:55.038846+0000","last_undegraded":"2024-09-22T08:14:55.038846+0000","last_fullsized":"2024-09-22T08:14:55.038846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.038699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.038699+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.038699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:17.212237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.916121+0000","last_change":"2024-09-22T08:14:41.916067+0000","last_active":"2024-09-22T08:14:41.916121+0000","last_peered":"2024-09-22T08:14:41.916121+0000","last_clean":"2024-09-22T08:14:41.916121+0000","last_became_active":"2024-09-22T08:10:49.180621+0000","last_became_peered":"2024-09-22T08:10:49.180621+0000","last_unstale":"2024-09-22T08:14:41.916121+0000","last_undegraded":"2024-09-22T08:14:41.916121+0000","last_fullsized":"2024-09-22T08:14:41.916121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-22T08:14:41.915971+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-22T08:14:41.915971+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.915971+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:26.481785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:49.971889+0000","last_change":"2024-09-22T08:14:49.971832+0000","last_active":"2024-09-22T08:14:49.971889+0000","last_peered":"2024-09-22T08:14:49.971889+0000","last_clean":"2024-09-22T08:14:49.971889+0000","last_became_active":"2024-09-22T08:10:51.189640+0000","last_became_peered":"2024-09-22T08:10:51.189640+0000","last_unstale":"2024-09-22T08:14:49.971889+0000","last_undegraded":"2024-09-22T08:14:49.971889+0000","last_fullsized":"2024-09-22T08:14:49.971889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:49.971734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:49.971734+0000","last_clean_scrub_stamp":"2024-09-22T08:14:49.971734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:26:59.141108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.053777+0000","last_change":"2024-09-22T08:14:43.053723+0000","last_active":"2024-09-22T08:14:43.053777+0000","last_peered":"2024-09-22T08:14:43.053777+0000","last_clean":"2024-09-22T08:14:43.053777+0000","last_became_active":"2024-09-22T08:10:45.166591+0000","last_became_peered":"2024-09-22T08:10:45.166591+0000","last_unstale":"2024-09-22T08:14:43.053777+0000","last_undegraded":"2024-09-22T08:14:43.053777+0000","last_fullsized":"2024-09-22T08:14:43.053777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:43.053643+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:43.053643+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.053643+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:54.611177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:19.239403+0000","last_change":"2024-09-22T08:14:19.239338+0000","last_active":"2024-09-22T08:14:19.239403+0000","last_peered":"2024-09-22T08:14:19.239403+0000","last_clean":"2024-09-22T08:14:19.239403+0000","last_became_active":"2024-09-22T08:10:43.195608+0000","last_became_peered":"2024-09-22T08:10:43.195608+0000","last_unstale":"2024-09-22T08:14:19.239403+0000","last_undegraded":"2024-09-22T08:14:19.239403+0000","last_fullsized":"2024-09-22T08:14:19.239403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:19.239245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:19.239245+0000","last_clean_scrub_stamp":"2024-09-22T08:14:19.239245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:39:03.221139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:38.986507+0000","last_change":"2024-09-22T08:14:38.986434+0000","last_active":"2024-09-22T08:14:38.986507+0000","last_peered":"2024-09-22T08:14:38.986507+0000","last_clean":"2024-09-22T08:14:38.986507+0000","last_became_active":"2024-09-22T08:10:47.173043+0000","last_became_peered":"2024-09-22T08:10:47.173043+0000","last_unstale":"2024-09-22T08:14:38.986507+0000","last_undegraded":"2024-09-22T08:14:38.986507+0000","last_fullsized":"2024-09-22T08:14:38.986507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:38.986348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:38.986348+0000","last_clean_scrub_stamp":"2024-09-22T08:14:38.986348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:44.350224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'67","reported_seq":140,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.113790+0000","last_change":"2024-09-22T08:14:44.113790+0000","last_active":"2024-09-22T08:14:44.113790+0000","last_peered":"2024-09-22T08:14:44.113790+0000","last_clean":"2024-09-22T08:14:44.113790+0000","last_became_active":"2024-09-22T08:10:49.181611+0000","last_became_peered":"2024-09-22T08:10:49.181611+0000","last_unstale":"2024-09-22T08:14:44.113790+0000","last_undegraded":"2024-09-22T08:14:44.113790+0000","last_fullsized":"2024-09-22T08:14:44.113790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'67","last_scrub_stamp":"2024-09-22T08:14:44.113701+0000","last_deep_scrub":"34'67","last_deep_scrub_stamp":"2024-09-22T08:14:44.113701+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.113701+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:57.977591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:50.991575+0000","last_change":"2024-09-22T08:14:50.991575+0000","last_active":"2024-09-22T08:14:50.991575+0000","last_peered":"2024-09-22T08:14:50.991575+0000","last_clean":"2024-09-22T08:14:50.991575+0000","last_became_active":"2024-09-22T08:10:51.189592+0000","last_became_peered":"2024-09-22T08:10:51.189592+0000","last_unstale":"2024-09-22T08:14:50.991575+0000","last_undegraded":"2024-09-22T08:14:50.991575+0000","last_fullsized":"2024-09-22T08:14:50.991575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:50.991487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:50.991487+0000","last_clean_scrub_stamp":"2024-09-22T08:14:50.991487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:00.870180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:05.045091+0000","last_change":"2024-09-22T08:15:05.044996+0000","last_active":"2024-09-22T08:15:05.045091+0000","last_peered":"2024-09-22T08:15:05.045091+0000","last_clean":"2024-09-22T08:15:05.045091+0000","last_became_active":"2024-09-22T08:10:53.198999+0000","last_became_peered":"2024-09-22T08:10:53.198999+0000","last_unstale":"2024-09-22T08:15:05.045091+0000","last_undegraded":"2024-09-22T08:15:05.045091+0000","last_fullsized":"2024-09-22T08:15:05.045091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:15:05.044897+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:15:05.044897+0000","last_clean_scrub_stamp":"2024-09-22T08:15:05.044897+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:24.308782+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'22","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.900925+0000","last_change":"2024-09-22T08:14:22.900868+0000","last_active":"2024-09-22T08:14:22.900925+0000","last_peered":"2024-09-22T08:14:22.900925+0000","last_clean":"2024-09-22T08:14:22.900925+0000","last_became_active":"2024-09-22T08:10:45.183173+0000","last_became_peered":"2024-09-22T08:10:45.183173+0000","last_unstale":"2024-09-22T08:14:22.900925+0000","last_undegraded":"2024-09-22T08:14:22.900925+0000","last_fullsized":"2024-09-22T08:14:22.900925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-22T08:14:22.900782+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-22T08:14:22.900782+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.900782+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:29.628187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:07.819077+0000","last_change":"2024-09-22T08:14:07.818995+0000","last_active":"2024-09-22T08:14:07.819077+0000","last_peered":"2024-09-22T08:14:07.819077+0000","last_clean":"2024-09-22T08:14:07.819077+0000","last_became_active":"2024-09-22T08:10:43.177711+0000","last_became_peered":"2024-09-22T08:10:43.177711+0000","last_unstale":"2024-09-22T08:14:07.819077+0000","last_undegraded":"2024-09-22T08:14:07.819077+0000","last_fullsized":"2024-09-22T08:14:07.819077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:07.818910+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:07.818910+0000","last_clean_scrub_stamp":"2024-09-22T08:14:07.818910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:56:11.966919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:37.941417+0000","last_change":"2024-09-22T08:14:37.941323+0000","last_active":"2024-09-22T08:14:37.941417+0000","last_peered":"2024-09-22T08:14:37.941417+0000","last_clean":"2024-09-22T08:14:37.941417+0000","last_became_active":"2024-09-22T08:10:47.171702+0000","last_became_peered":"2024-09-22T08:10:47.171702+0000","last_unstale":"2024-09-22T08:14:37.941417+0000","last_undegraded":"2024-09-22T08:14:37.941417+0000","last_fullsized":"2024-09-22T08:14:37.941417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:37.941178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:37.941178+0000","last_clean_scrub_stamp":"2024-09-22T08:14:37.941178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:08.673150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:10.094334+0000","last_change":"2024-09-22T08:15:10.094334+0000","last_active":"2024-09-22T08:15:10.094334+0000","last_peered":"2024-09-22T08:15:10.094334+0000","last_clean":"2024-09-22T08:15:10.094334+0000","last_became_active":"2024-09-22T08:10:49.182398+0000","last_became_peered":"2024-09-22T08:10:49.182398+0000","last_unstale":"2024-09-22T08:15:10.094334+0000","last_undegraded":"2024-09-22T08:15:10.094334+0000","last_fullsized":"2024-09-22T08:15:10.094334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-22T08:15:10.094227+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-22T08:15:10.094227+0000","last_clean_scrub_stamp":"2024-09-22T08:15:10.094227+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:14.589649+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.991517+0000","last_change":"2024-09-22T08:14:55.991517+0000","last_active":"2024-09-22T08:14:55.991517+0000","last_peered":"2024-09-22T08:14:55.991517+0000","last_clean":"2024-09-22T08:14:55.991517+0000","last_became_active":"2024-09-22T08:10:51.202485+0000","last_became_peered":"2024-09-22T08:10:51.202485+0000","last_unstale":"2024-09-22T08:14:55.991517+0000","last_undegraded":"2024-09-22T08:14:55.991517+0000","last_fullsized":"2024-09-22T08:14:55.991517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.991428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.991428+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.991428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:55.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:24.967503+0000","last_change":"2024-09-22T08:15:24.967450+0000","last_active":"2024-09-22T08:15:24.967503+0000","last_peered":"2024-09-22T08:15:24.967503+0000","last_clean":"2024-09-22T08:15:24.967503+0000","last_became_active":"2024-09-22T08:10:53.201942+0000","last_became_peered":"2024-09-22T08:10:53.201942+0000","last_unstale":"2024-09-22T08:15:24.967503+0000","last_undegraded":"2024-09-22T08:15:24.967503+0000","last_fullsized":"2024-09-22T08:15:24.967503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:15:24.967366+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:15:24.967366+0000","last_clean_scrub_stamp":"2024-09-22T08:15:24.967366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:37:04.418595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.078202+0000","last_change":"2024-09-22T08:14:42.078202+0000","last_active":"2024-09-22T08:14:42.078202+0000","last_peered":"2024-09-22T08:14:42.078202+0000","last_clean":"2024-09-22T08:14:42.078202+0000","last_became_active":"2024-09-22T08:10:45.183576+0000","last_became_peered":"2024-09-22T08:10:45.183576+0000","last_unstale":"2024-09-22T08:14:42.078202+0000","last_undegraded":"2024-09-22T08:14:42.078202+0000","last_fullsized":"2024-09-22T08:14:42.078202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:42.078116+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:42.078116+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.078116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:21.619510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:08.778940+0000","last_change":"2024-09-22T08:14:08.778888+0000","last_active":"2024-09-22T08:14:08.778940+0000","last_peered":"2024-09-22T08:14:08.778940+0000","last_clean":"2024-09-22T08:14:08.778940+0000","last_became_active":"2024-09-22T08:10:43.178403+0000","last_became_peered":"2024-09-22T08:10:43.178403+0000","last_unstale":"2024-09-22T08:14:08.778940+0000","last_undegraded":"2024-09-22T08:14:08.778940+0000","last_fullsized":"2024-09-22T08:14:08.778940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:08.778788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:08.778788+0000","last_clean_scrub_stamp":"2024-09-22T08:14:08.778788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:11.516811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:36.941306+0000","last_change":"2024-09-22T08:14:36.941306+0000","last_active":"2024-09-22T08:14:36.941306+0000","last_peered":"2024-09-22T08:14:36.941306+0000","last_clean":"2024-09-22T08:14:36.941306+0000","last_became_active":"2024-09-22T08:10:47.171973+0000","last_became_peered":"2024-09-22T08:10:47.171973+0000","last_unstale":"2024-09-22T08:14:36.941306+0000","last_undegraded":"2024-09-22T08:14:36.941306+0000","last_fullsized":"2024-09-22T08:14:36.941306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:36.941191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:36.941191+0000","last_clean_scrub_stamp":"2024-09-22T08:14:36.941191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:39.832853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:54.127443+0000","last_change":"2024-09-22T08:14:54.127324+0000","last_active":"2024-09-22T08:14:54.127443+0000","last_peered":"2024-09-22T08:14:54.127443+0000","last_clean":"2024-09-22T08:14:54.127443+0000","last_became_active":"2024-09-22T08:10:49.184885+0000","last_became_peered":"2024-09-22T08:10:49.184885+0000","last_unstale":"2024-09-22T08:14:54.127443+0000","last_undegraded":"2024-09-22T08:14:54.127443+0000","last_fullsized":"2024-09-22T08:14:54.127443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-22T08:14:54.127209+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-22T08:14:54.127209+0000","last_clean_scrub_stamp":"2024-09-22T08:14:54.127209+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:39.670431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:55.082126+0000","last_change":"2024-09-22T08:14:55.082126+0000","last_active":"2024-09-22T08:14:55.082126+0000","last_peered":"2024-09-22T08:14:55.082126+0000","last_clean":"2024-09-22T08:14:55.082126+0000","last_became_active":"2024-09-22T08:10:51.193970+0000","last_became_peered":"2024-09-22T08:10:51.193970+0000","last_unstale":"2024-09-22T08:14:55.082126+0000","last_undegraded":"2024-09-22T08:14:55.082126+0000","last_fullsized":"2024-09-22T08:14:55.082126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:55.082033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:55.082033+0000","last_clean_scrub_stamp":"2024-09-22T08:14:55.082033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:37.412029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:21.075468+0000","last_change":"2024-09-22T08:15:21.075413+0000","last_active":"2024-09-22T08:15:21.075468+0000","last_peered":"2024-09-22T08:15:21.075468+0000","last_clean":"2024-09-22T08:15:21.075468+0000","last_became_active":"2024-09-22T08:10:53.202493+0000","last_became_peered":"2024-09-22T08:10:53.202493+0000","last_unstale":"2024-09-22T08:15:21.075468+0000","last_undegraded":"2024-09-22T08:15:21.075468+0000","last_fullsized":"2024-09-22T08:15:21.075468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-22T08:15:21.075333+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-22T08:15:21.075333+0000","last_clean_scrub_stamp":"2024-09-22T08:15:21.075333+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:41.270670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.900963+0000","last_change":"2024-09-22T08:14:21.900963+0000","last_active":"2024-09-22T08:14:21.900963+0000","last_peered":"2024-09-22T08:14:21.900963+0000","last_clean":"2024-09-22T08:14:21.900963+0000","last_became_active":"2024-09-22T08:10:45.166540+0000","last_became_peered":"2024-09-22T08:10:45.166540+0000","last_unstale":"2024-09-22T08:14:21.900963+0000","last_undegraded":"2024-09-22T08:14:21.900963+0000","last_fullsized":"2024-09-22T08:14:21.900963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:21.900884+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:21.900884+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.900884+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:18.177848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":59,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:20.228481+0000","last_change":"2024-09-22T08:14:20.228380+0000","last_active":"2024-09-22T08:14:20.228481+0000","last_peered":"2024-09-22T08:14:20.228481+0000","last_clean":"2024-09-22T08:14:20.228481+0000","last_became_active":"2024-09-22T08:10:43.199724+0000","last_became_peered":"2024-09-22T08:10:43.199724+0000","last_unstale":"2024-09-22T08:14:20.228481+0000","last_undegraded":"2024-09-22T08:14:20.228481+0000","last_fullsized":"2024-09-22T08:14:20.228481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-22T08:14:20.228266+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-22T08:14:20.228266+0000","last_clean_scrub_stamp":"2024-09-22T08:14:20.228266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:39.492150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.892749+0000","last_change":"2024-09-22T08:14:45.892749+0000","last_active":"2024-09-22T08:14:45.892749+0000","last_peered":"2024-09-22T08:14:45.892749+0000","last_clean":"2024-09-22T08:14:45.892749+0000","last_became_active":"2024-09-22T08:10:47.175541+0000","last_became_peered":"2024-09-22T08:10:47.175541+0000","last_unstale":"2024-09-22T08:14:45.892749+0000","last_undegraded":"2024-09-22T08:14:45.892749+0000","last_fullsized":"2024-09-22T08:14:45.892749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:45.892628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:45.892628+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.892628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:55.127242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:11.072125+0000","last_change":"2024-09-22T08:15:11.072125+0000","last_active":"2024-09-22T08:15:11.072125+0000","last_peered":"2024-09-22T08:15:11.072125+0000","last_clean":"2024-09-22T08:15:11.072125+0000","last_became_active":"2024-09-22T08:10:49.187767+0000","last_became_peered":"2024-09-22T08:10:49.187767+0000","last_unstale":"2024-09-22T08:15:11.072125+0000","last_undegraded":"2024-09-22T08:15:11.072125+0000","last_fullsized":"2024-09-22T08:15:11.072125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-22T08:15:11.072037+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-22T08:15:11.072037+0000","last_clean_scrub_stamp":"2024-09-22T08:15:11.072037+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:49:57.456055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":380,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.999494+0000","last_change":"2024-09-22T08:14:51.999420+0000","last_active":"2024-09-22T08:14:51.999494+0000","last_peered":"2024-09-22T08:14:51.999494+0000","last_clean":"2024-09-22T08:14:51.999494+0000","last_became_active":"2024-09-22T08:10:51.197814+0000","last_became_peered":"2024-09-22T08:10:51.197814+0000","last_unstale":"2024-09-22T08:14:51.999494+0000","last_undegraded":"2024-09-22T08:14:51.999494+0000","last_fullsized":"2024-09-22T08:14:51.999494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-22T08:14:51.999327+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-22T08:14:51.999327+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.999327+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:39:55.424693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:22.071437+0000","last_change":"2024-09-22T08:15:22.071381+0000","last_active":"2024-09-22T08:15:22.071437+0000","last_peered":"2024-09-22T08:15:22.071437+0000","last_clean":"2024-09-22T08:15:22.071437+0000","last_became_active":"2024-09-22T08:10:53.199881+0000","last_became_peered":"2024-09-22T08:10:53.199881+0000","last_unstale":"2024-09-22T08:15:22.071437+0000","last_undegraded":"2024-09-22T08:15:22.071437+0000","last_fullsized":"2024-09-22T08:15:22.071437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:22.071290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:22.071290+0000","last_clean_scrub_stamp":"2024-09-22T08:15:22.071290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:18.465072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.934421+0000","last_change":"2024-09-22T08:14:25.934421+0000","last_active":"2024-09-22T08:14:25.934421+0000","last_peered":"2024-09-22T08:14:25.934421+0000","last_clean":"2024-09-22T08:14:25.934421+0000","last_became_active":"2024-09-22T08:10:45.166103+0000","last_became_peered":"2024-09-22T08:10:45.166103+0000","last_unstale":"2024-09-22T08:14:25.934421+0000","last_undegraded":"2024-09-22T08:14:25.934421+0000","last_fullsized":"2024-09-22T08:14:25.934421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:25.934299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:25.934299+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.934299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:29.868493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.769379+0000","last_change":"2024-09-22T08:14:10.769326+0000","last_active":"2024-09-22T08:14:10.769379+0000","last_peered":"2024-09-22T08:14:10.769379+0000","last_clean":"2024-09-22T08:14:10.769379+0000","last_became_active":"2024-09-22T08:10:43.180097+0000","last_became_peered":"2024-09-22T08:10:43.180097+0000","last_unstale":"2024-09-22T08:14:10.769379+0000","last_undegraded":"2024-09-22T08:14:10.769379+0000","last_fullsized":"2024-09-22T08:14:10.769379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:10.769243+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:10.769243+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.769243+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:28.728155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:43.842396+0000","last_change":"2024-09-22T08:14:43.842396+0000","last_active":"2024-09-22T08:14:43.842396+0000","last_peered":"2024-09-22T08:14:43.842396+0000","last_clean":"2024-09-22T08:14:43.842396+0000","last_became_active":"2024-09-22T08:10:47.175604+0000","last_became_peered":"2024-09-22T08:10:47.175604+0000","last_unstale":"2024-09-22T08:14:43.842396+0000","last_undegraded":"2024-09-22T08:14:43.842396+0000","last_fullsized":"2024-09-22T08:14:43.842396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:43.842274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:43.842274+0000","last_clean_scrub_stamp":"2024-09-22T08:14:43.842274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:12.138578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:51.003204+0000","last_change":"2024-09-22T08:14:51.003144+0000","last_active":"2024-09-22T08:14:51.003204+0000","last_peered":"2024-09-22T08:14:51.003204+0000","last_clean":"2024-09-22T08:14:51.003204+0000","last_became_active":"2024-09-22T08:10:49.175817+0000","last_became_peered":"2024-09-22T08:10:49.175817+0000","last_unstale":"2024-09-22T08:14:51.003204+0000","last_undegraded":"2024-09-22T08:14:51.003204+0000","last_fullsized":"2024-09-22T08:14:51.003204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-22T08:14:51.003046+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-22T08:14:51.003046+0000","last_clean_scrub_stamp":"2024-09-22T08:14:51.003046+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:30.056044+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:52.177921+0000","last_change":"2024-09-22T08:14:52.177853+0000","last_active":"2024-09-22T08:14:52.177921+0000","last_peered":"2024-09-22T08:14:52.177921+0000","last_clean":"2024-09-22T08:14:52.177921+0000","last_became_active":"2024-09-22T08:10:51.191988+0000","last_became_peered":"2024-09-22T08:10:51.191988+0000","last_unstale":"2024-09-22T08:14:52.177921+0000","last_undegraded":"2024-09-22T08:14:52.177921+0000","last_fullsized":"2024-09-22T08:14:52.177921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:52.177773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:52.177773+0000","last_clean_scrub_stamp":"2024-09-22T08:14:52.177773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:51.750443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:03.070751+0000","last_change":"2024-09-22T08:15:03.070694+0000","last_active":"2024-09-22T08:15:03.070751+0000","last_peered":"2024-09-22T08:15:03.070751+0000","last_clean":"2024-09-22T08:15:03.070751+0000","last_became_active":"2024-09-22T08:10:53.199158+0000","last_became_peered":"2024-09-22T08:10:53.199158+0000","last_unstale":"2024-09-22T08:15:03.070751+0000","last_undegraded":"2024-09-22T08:15:03.070751+0000","last_fullsized":"2024-09-22T08:15:03.070751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.070605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.070605+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.070605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:44:56.829853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.886211+0000","last_change":"2024-09-22T08:14:23.886211+0000","last_active":"2024-09-22T08:14:23.886211+0000","last_peered":"2024-09-22T08:14:23.886211+0000","last_clean":"2024-09-22T08:14:23.886211+0000","last_became_active":"2024-09-22T08:10:45.165116+0000","last_became_peered":"2024-09-22T08:10:45.165116+0000","last_unstale":"2024-09-22T08:14:23.886211+0000","last_undegraded":"2024-09-22T08:14:23.886211+0000","last_fullsized":"2024-09-22T08:14:23.886211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:23.886075+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:23.886075+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.886075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:20:31.053533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:21.266597+0000","last_change":"2024-09-22T08:14:21.266509+0000","last_active":"2024-09-22T08:14:21.266597+0000","last_peered":"2024-09-22T08:14:21.266597+0000","last_clean":"2024-09-22T08:14:21.266597+0000","last_became_active":"2024-09-22T08:10:43.201076+0000","last_became_peered":"2024-09-22T08:10:43.201076+0000","last_unstale":"2024-09-22T08:14:21.266597+0000","last_undegraded":"2024-09-22T08:14:21.266597+0000","last_fullsized":"2024-09-22T08:14:21.266597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:21.266407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:21.266407+0000","last_clean_scrub_stamp":"2024-09-22T08:14:21.266407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:15.619690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:35.961799+0000","last_change":"2024-09-22T08:14:35.961799+0000","last_active":"2024-09-22T08:14:35.961799+0000","last_peered":"2024-09-22T08:14:35.961799+0000","last_clean":"2024-09-22T08:14:35.961799+0000","last_became_active":"2024-09-22T08:10:47.172988+0000","last_became_peered":"2024-09-22T08:10:47.172988+0000","last_unstale":"2024-09-22T08:14:35.961799+0000","last_undegraded":"2024-09-22T08:14:35.961799+0000","last_fullsized":"2024-09-22T08:14:35.961799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:35.961689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:35.961689+0000","last_clean_scrub_stamp":"2024-09-22T08:14:35.961689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:47.596270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.073779+0000","last_change":"2024-09-22T08:14:42.073721+0000","last_active":"2024-09-22T08:14:42.073779+0000","last_peered":"2024-09-22T08:14:42.073779+0000","last_clean":"2024-09-22T08:14:42.073779+0000","last_became_active":"2024-09-22T08:10:49.184860+0000","last_became_peered":"2024-09-22T08:10:49.184860+0000","last_unstale":"2024-09-22T08:14:42.073779+0000","last_undegraded":"2024-09-22T08:14:42.073779+0000","last_fullsized":"2024-09-22T08:14:42.073779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-22T08:14:42.073617+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-22T08:14:42.073617+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.073617+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:51.308231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:17.027977+0000","last_change":"2024-09-22T08:15:17.027912+0000","last_active":"2024-09-22T08:15:17.027977+0000","last_peered":"2024-09-22T08:15:17.027977+0000","last_clean":"2024-09-22T08:15:17.027977+0000","last_became_active":"2024-09-22T08:10:51.199870+0000","last_became_peered":"2024-09-22T08:10:51.199870+0000","last_unstale":"2024-09-22T08:15:17.027977+0000","last_undegraded":"2024-09-22T08:15:17.027977+0000","last_fullsized":"2024-09-22T08:15:17.027977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:17.027821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:17.027821+0000","last_clean_scrub_stamp":"2024-09-22T08:15:17.027821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:45.805630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:27.927217+0000","last_change":"2024-09-22T08:15:27.927160+0000","last_active":"2024-09-22T08:15:27.927217+0000","last_peered":"2024-09-22T08:15:27.927217+0000","last_clean":"2024-09-22T08:15:27.927217+0000","last_became_active":"2024-09-22T08:10:53.200904+0000","last_became_peered":"2024-09-22T08:10:53.200904+0000","last_unstale":"2024-09-22T08:15:27.927217+0000","last_undegraded":"2024-09-22T08:15:27.927217+0000","last_fullsized":"2024-09-22T08:15:27.927217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:27.927074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:27.927074+0000","last_clean_scrub_stamp":"2024-09-22T08:15:27.927074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:05:44.992241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.113579+0000","last_change":"2024-09-22T08:14:41.113489+0000","last_active":"2024-09-22T08:14:41.113579+0000","last_peered":"2024-09-22T08:14:41.113579+0000","last_clean":"2024-09-22T08:14:41.113579+0000","last_became_active":"2024-09-22T08:10:45.165511+0000","last_became_peered":"2024-09-22T08:10:45.165511+0000","last_unstale":"2024-09-22T08:14:41.113579+0000","last_undegraded":"2024-09-22T08:14:41.113579+0000","last_fullsized":"2024-09-22T08:14:41.113579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-22T08:14:41.113388+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-22T08:14:41.113388+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.113388+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:39:08.634130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:05.982787+0000","last_change":"2024-09-22T08:14:05.982672+0000","last_active":"2024-09-22T08:14:05.982787+0000","last_peered":"2024-09-22T08:14:05.982787+0000","last_clean":"2024-09-22T08:14:05.982787+0000","last_became_active":"2024-09-22T08:10:43.176954+0000","last_became_peered":"2024-09-22T08:10:43.176954+0000","last_unstale":"2024-09-22T08:14:05.982787+0000","last_undegraded":"2024-09-22T08:14:05.982787+0000","last_fullsized":"2024-09-22T08:14:05.982787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:05.982575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:05.982575+0000","last_clean_scrub_stamp":"2024-09-22T08:14:05.982575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:15.153255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:41.835639+0000","last_change":"2024-09-22T08:14:41.835539+0000","last_active":"2024-09-22T08:14:41.835639+0000","last_peered":"2024-09-22T08:14:41.835639+0000","last_clean":"2024-09-22T08:14:41.835639+0000","last_became_active":"2024-09-22T08:10:47.176641+0000","last_became_peered":"2024-09-22T08:10:47.176641+0000","last_unstale":"2024-09-22T08:14:41.835639+0000","last_undegraded":"2024-09-22T08:14:41.835639+0000","last_fullsized":"2024-09-22T08:14:41.835639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:41.835433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:41.835433+0000","last_clean_scrub_stamp":"2024-09-22T08:14:41.835433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:26:24.123944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:09.119219+0000","last_change":"2024-09-22T08:15:09.119219+0000","last_active":"2024-09-22T08:15:09.119219+0000","last_peered":"2024-09-22T08:15:09.119219+0000","last_clean":"2024-09-22T08:15:09.119219+0000","last_became_active":"2024-09-22T08:10:49.187467+0000","last_became_peered":"2024-09-22T08:10:49.187467+0000","last_unstale":"2024-09-22T08:15:09.119219+0000","last_undegraded":"2024-09-22T08:15:09.119219+0000","last_fullsized":"2024-09-22T08:15:09.119219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-22T08:15:09.119130+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-22T08:15:09.119130+0000","last_clean_scrub_stamp":"2024-09-22T08:15:09.119130+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:20:39.616422+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:18.005260+0000","last_change":"2024-09-22T08:15:18.005260+0000","last_active":"2024-09-22T08:15:18.005260+0000","last_peered":"2024-09-22T08:15:18.005260+0000","last_clean":"2024-09-22T08:15:18.005260+0000","last_became_active":"2024-09-22T08:10:51.197942+0000","last_became_peered":"2024-09-22T08:10:51.197942+0000","last_unstale":"2024-09-22T08:15:18.005260+0000","last_undegraded":"2024-09-22T08:15:18.005260+0000","last_fullsized":"2024-09-22T08:15:18.005260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:18.005160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:18.005160+0000","last_clean_scrub_stamp":"2024-09-22T08:15:18.005160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:24.954588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:26.909117+0000","last_change":"2024-09-22T08:15:26.909061+0000","last_active":"2024-09-22T08:15:26.909117+0000","last_peered":"2024-09-22T08:15:26.909117+0000","last_clean":"2024-09-22T08:15:26.909117+0000","last_became_active":"2024-09-22T08:10:53.203791+0000","last_became_peered":"2024-09-22T08:10:53.203791+0000","last_unstale":"2024-09-22T08:15:26.909117+0000","last_undegraded":"2024-09-22T08:15:26.909117+0000","last_fullsized":"2024-09-22T08:15:26.909117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:15:26.908976+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:15:26.908976+0000","last_clean_scrub_stamp":"2024-09-22T08:15:26.908976+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:32.980620+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.887823+0000","last_change":"2024-09-22T08:14:24.887707+0000","last_active":"2024-09-22T08:14:24.887823+0000","last_peered":"2024-09-22T08:14:24.887823+0000","last_clean":"2024-09-22T08:14:24.887823+0000","last_became_active":"2024-09-22T08:10:45.163402+0000","last_became_peered":"2024-09-22T08:10:45.163402+0000","last_unstale":"2024-09-22T08:14:24.887823+0000","last_undegraded":"2024-09-22T08:14:24.887823+0000","last_fullsized":"2024-09-22T08:14:24.887823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:24.887588+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:24.887588+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.887588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:50.926457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.746542+0000","last_change":"2024-09-22T08:14:09.746483+0000","last_active":"2024-09-22T08:14:09.746542+0000","last_peered":"2024-09-22T08:14:09.746542+0000","last_clean":"2024-09-22T08:14:09.746542+0000","last_became_active":"2024-09-22T08:10:43.184777+0000","last_became_peered":"2024-09-22T08:10:43.184777+0000","last_unstale":"2024-09-22T08:14:09.746542+0000","last_undegraded":"2024-09-22T08:14:09.746542+0000","last_fullsized":"2024-09-22T08:14:09.746542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:09.746395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:09.746395+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.746395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:20.482133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:42.848975+0000","last_change":"2024-09-22T08:14:42.848918+0000","last_active":"2024-09-22T08:14:42.848975+0000","last_peered":"2024-09-22T08:14:42.848975+0000","last_clean":"2024-09-22T08:14:42.848975+0000","last_became_active":"2024-09-22T08:10:47.176390+0000","last_became_peered":"2024-09-22T08:10:47.176390+0000","last_unstale":"2024-09-22T08:14:42.848975+0000","last_undegraded":"2024-09-22T08:14:42.848975+0000","last_fullsized":"2024-09-22T08:14:42.848975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-22T08:14:42.848840+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-22T08:14:42.848840+0000","last_clean_scrub_stamp":"2024-09-22T08:14:42.848840+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:48.212716+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'42","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:08.142435+0000","last_change":"2024-09-22T08:15:08.142435+0000","last_active":"2024-09-22T08:15:08.142435+0000","last_peered":"2024-09-22T08:15:08.142435+0000","last_clean":"2024-09-22T08:15:08.142435+0000","last_became_active":"2024-09-22T08:10:49.188231+0000","last_became_peered":"2024-09-22T08:10:49.188231+0000","last_unstale":"2024-09-22T08:15:08.142435+0000","last_undegraded":"2024-09-22T08:15:08.142435+0000","last_fullsized":"2024-09-22T08:15:08.142435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'42","last_scrub_stamp":"2024-09-22T08:15:08.142319+0000","last_deep_scrub":"34'42","last_deep_scrub_stamp":"2024-09-22T08:15:08.142319+0000","last_clean_scrub_stamp":"2024-09-22T08:15:08.142319+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:26.959686+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":46,"num_read_kb":60,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:03.058288+0000","last_change":"2024-09-22T08:15:03.058288+0000","last_active":"2024-09-22T08:15:03.058288+0000","last_peered":"2024-09-22T08:15:03.058288+0000","last_clean":"2024-09-22T08:15:03.058288+0000","last_became_active":"2024-09-22T08:10:51.202476+0000","last_became_peered":"2024-09-22T08:10:51.202476+0000","last_unstale":"2024-09-22T08:15:03.058288+0000","last_undegraded":"2024-09-22T08:15:03.058288+0000","last_fullsized":"2024-09-22T08:15:03.058288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:15:03.058202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:15:03.058202+0000","last_clean_scrub_stamp":"2024-09-22T08:15:03.058202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:28:33.729203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:15:23.030697+0000","last_change":"2024-09-22T08:15:23.030628+0000","last_active":"2024-09-22T08:15:23.030697+0000","last_peered":"2024-09-22T08:15:23.030697+0000","last_clean":"2024-09-22T08:15:23.030697+0000","last_became_active":"2024-09-22T08:10:53.201125+0000","last_became_peered":"2024-09-22T08:10:53.201125+0000","last_unstale":"2024-09-22T08:15:23.030697+0000","last_undegraded":"2024-09-22T08:15:23.030697+0000","last_fullsized":"2024-09-22T08:15:23.030697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:15:23.030544+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:15:23.030544+0000","last_clean_scrub_stamp":"2024-09-22T08:15:23.030544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:32.846217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.837686+0000","last_change":"2024-09-22T08:14:24.837624+0000","last_active":"2024-09-22T08:14:24.837686+0000","last_peered":"2024-09-22T08:14:24.837686+0000","last_clean":"2024-09-22T08:14:24.837686+0000","last_became_active":"2024-09-22T08:10:45.180781+0000","last_became_peered":"2024-09-22T08:10:45.180781+0000","last_unstale":"2024-09-22T08:14:24.837686+0000","last_undegraded":"2024-09-22T08:14:24.837686+0000","last_fullsized":"2024-09-22T08:14:24.837686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:24.837547+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:24.837547+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.837547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:21:21.114510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.826654+0000","last_change":"2024-09-22T08:14:13.826597+0000","last_active":"2024-09-22T08:14:13.826654+0000","last_peered":"2024-09-22T08:14:13.826654+0000","last_clean":"2024-09-22T08:14:13.826654+0000","last_became_active":"2024-09-22T08:10:43.179693+0000","last_became_peered":"2024-09-22T08:10:43.179693+0000","last_unstale":"2024-09-22T08:14:13.826654+0000","last_undegraded":"2024-09-22T08:14:13.826654+0000","last_fullsized":"2024-09-22T08:14:13.826654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:13.826510+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:13.826510+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.826510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:05.210216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.979010+0000","last_change":"2024-09-22T08:14:27.978947+0000","last_active":"2024-09-22T08:14:27.979010+0000","last_peered":"2024-09-22T08:14:27.979010+0000","last_clean":"2024-09-22T08:14:27.979010+0000","last_became_active":"2024-09-22T08:10:45.164406+0000","last_became_peered":"2024-09-22T08:10:45.164406+0000","last_unstale":"2024-09-22T08:14:27.979010+0000","last_undegraded":"2024-09-22T08:14:27.979010+0000","last_fullsized":"2024-09-22T08:14:27.979010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-22T08:14:27.978856+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-22T08:14:27.978856+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.978856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:45.929432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:09.893610+0000","last_change":"2024-09-22T08:14:09.893552+0000","last_active":"2024-09-22T08:14:09.893610+0000","last_peered":"2024-09-22T08:14:09.893610+0000","last_clean":"2024-09-22T08:14:09.893610+0000","last_became_active":"2024-09-22T08:10:43.178018+0000","last_became_peered":"2024-09-22T08:10:43.178018+0000","last_unstale":"2024-09-22T08:14:09.893610+0000","last_undegraded":"2024-09-22T08:14:09.893610+0000","last_fullsized":"2024-09-22T08:14:09.893610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:09.893443+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:09.893443+0000","last_clean_scrub_stamp":"2024-09-22T08:14:09.893443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:27:14.018138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'22","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:44.073987+0000","last_change":"2024-09-22T08:14:44.073922+0000","last_active":"2024-09-22T08:14:44.073987+0000","last_peered":"2024-09-22T08:14:44.073987+0000","last_clean":"2024-09-22T08:14:44.073987+0000","last_became_active":"2024-09-22T08:10:45.168526+0000","last_became_peered":"2024-09-22T08:10:45.168526+0000","last_unstale":"2024-09-22T08:14:44.073987+0000","last_undegraded":"2024-09-22T08:14:44.073987+0000","last_fullsized":"2024-09-22T08:14:44.073987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-22T08:14:44.073838+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-22T08:14:44.073838+0000","last_clean_scrub_stamp":"2024-09-22T08:14:44.073838+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:01.253414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":86,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.197189+0000","last_change":"2024-09-22T08:14:23.197132+0000","last_active":"2024-09-22T08:14:23.197189+0000","last_peered":"2024-09-22T08:14:23.197189+0000","last_clean":"2024-09-22T08:14:23.197189+0000","last_became_active":"2024-09-22T08:10:43.196221+0000","last_became_peered":"2024-09-22T08:10:43.196221+0000","last_unstale":"2024-09-22T08:14:23.197189+0000","last_undegraded":"2024-09-22T08:14:23.197189+0000","last_fullsized":"2024-09-22T08:14:23.197189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:23.197048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:23.197048+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.197048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:53.693927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.927437+0000","last_change":"2024-09-22T08:14:24.927351+0000","last_active":"2024-09-22T08:14:24.927437+0000","last_peered":"2024-09-22T08:14:24.927437+0000","last_clean":"2024-09-22T08:14:24.927437+0000","last_became_active":"2024-09-22T08:10:45.166432+0000","last_became_peered":"2024-09-22T08:10:45.166432+0000","last_unstale":"2024-09-22T08:14:24.927437+0000","last_undegraded":"2024-09-22T08:14:24.927437+0000","last_fullsized":"2024-09-22T08:14:24.927437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:24.927242+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:24.927242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.927242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:25.223688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:10.902076+0000","last_change":"2024-09-22T08:14:10.902014+0000","last_active":"2024-09-22T08:14:10.902076+0000","last_peered":"2024-09-22T08:14:10.902076+0000","last_clean":"2024-09-22T08:14:10.902076+0000","last_became_active":"2024-09-22T08:10:43.177673+0000","last_became_peered":"2024-09-22T08:10:43.177673+0000","last_unstale":"2024-09-22T08:14:10.902076+0000","last_undegraded":"2024-09-22T08:14:10.902076+0000","last_fullsized":"2024-09-22T08:14:10.902076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:10.901926+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:10.901926+0000","last_clean_scrub_stamp":"2024-09-22T08:14:10.901926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:06:49.460312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.933843+0000","last_change":"2024-09-22T08:14:26.933779+0000","last_active":"2024-09-22T08:14:26.933843+0000","last_peered":"2024-09-22T08:14:26.933843+0000","last_clean":"2024-09-22T08:14:26.933843+0000","last_became_active":"2024-09-22T08:10:45.171476+0000","last_became_peered":"2024-09-22T08:10:45.171476+0000","last_unstale":"2024-09-22T08:14:26.933843+0000","last_undegraded":"2024-09-22T08:14:26.933843+0000","last_fullsized":"2024-09-22T08:14:26.933843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:26.933687+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:26.933687+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.933687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:15.758235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.868640+0000","last_change":"2024-09-22T08:14:11.868565+0000","last_active":"2024-09-22T08:14:11.868640+0000","last_peered":"2024-09-22T08:14:11.868640+0000","last_clean":"2024-09-22T08:14:11.868640+0000","last_became_active":"2024-09-22T08:10:43.186671+0000","last_became_peered":"2024-09-22T08:10:43.186671+0000","last_unstale":"2024-09-22T08:14:11.868640+0000","last_undegraded":"2024-09-22T08:14:11.868640+0000","last_fullsized":"2024-09-22T08:14:11.868640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:11.868472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:11.868472+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.868472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:04.057150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.851369+0000","last_change":"2024-09-22T08:14:23.851300+0000","last_active":"2024-09-22T08:14:23.851369+0000","last_peered":"2024-09-22T08:14:23.851369+0000","last_clean":"2024-09-22T08:14:23.851369+0000","last_became_active":"2024-09-22T08:10:45.182785+0000","last_became_peered":"2024-09-22T08:10:45.182785+0000","last_unstale":"2024-09-22T08:14:23.851369+0000","last_undegraded":"2024-09-22T08:14:23.851369+0000","last_fullsized":"2024-09-22T08:14:23.851369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:23.851213+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:23.851213+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.851213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:16:29.971199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.814747+0000","last_change":"2024-09-22T08:14:11.814682+0000","last_active":"2024-09-22T08:14:11.814747+0000","last_peered":"2024-09-22T08:14:11.814747+0000","last_clean":"2024-09-22T08:14:11.814747+0000","last_became_active":"2024-09-22T08:10:43.182824+0000","last_became_peered":"2024-09-22T08:10:43.182824+0000","last_unstale":"2024-09-22T08:14:11.814747+0000","last_undegraded":"2024-09-22T08:14:11.814747+0000","last_fullsized":"2024-09-22T08:14:11.814747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:11.814594+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:11.814594+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.814594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:06.053818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'26","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:23.938771+0000","last_change":"2024-09-22T08:14:23.938699+0000","last_active":"2024-09-22T08:14:23.938771+0000","last_peered":"2024-09-22T08:14:23.938771+0000","last_clean":"2024-09-22T08:14:23.938771+0000","last_became_active":"2024-09-22T08:10:45.175600+0000","last_became_peered":"2024-09-22T08:10:45.175600+0000","last_unstale":"2024-09-22T08:14:23.938771+0000","last_undegraded":"2024-09-22T08:14:23.938771+0000","last_fullsized":"2024-09-22T08:14:23.938771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-22T08:14:23.938616+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-22T08:14:23.938616+0000","last_clean_scrub_stamp":"2024-09-22T08:14:23.938616+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:29.442181+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":76,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:11.753854+0000","last_change":"2024-09-22T08:14:11.753775+0000","last_active":"2024-09-22T08:14:11.753854+0000","last_peered":"2024-09-22T08:14:11.753854+0000","last_clean":"2024-09-22T08:14:11.753854+0000","last_became_active":"2024-09-22T08:10:43.179529+0000","last_became_peered":"2024-09-22T08:10:43.179529+0000","last_unstale":"2024-09-22T08:14:11.753854+0000","last_undegraded":"2024-09-22T08:14:11.753854+0000","last_fullsized":"2024-09-22T08:14:11.753854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:11.753682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:11.753682+0000","last_clean_scrub_stamp":"2024-09-22T08:14:11.753682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:31:24.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.798396+0000","last_change":"2024-09-22T08:14:25.798299+0000","last_active":"2024-09-22T08:14:25.798396+0000","last_peered":"2024-09-22T08:14:25.798396+0000","last_clean":"2024-09-22T08:14:25.798396+0000","last_became_active":"2024-09-22T08:10:45.183901+0000","last_became_peered":"2024-09-22T08:10:45.183901+0000","last_unstale":"2024-09-22T08:14:25.798396+0000","last_undegraded":"2024-09-22T08:14:25.798396+0000","last_fullsized":"2024-09-22T08:14:25.798396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:25.798179+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:25.798179+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.798179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:32.525584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.880245+0000","last_change":"2024-09-22T08:14:12.880179+0000","last_active":"2024-09-22T08:14:12.880245+0000","last_peered":"2024-09-22T08:14:12.880245+0000","last_clean":"2024-09-22T08:14:12.880245+0000","last_became_active":"2024-09-22T08:10:43.177461+0000","last_became_peered":"2024-09-22T08:10:43.177461+0000","last_unstale":"2024-09-22T08:14:12.880245+0000","last_undegraded":"2024-09-22T08:14:12.880245+0000","last_fullsized":"2024-09-22T08:14:12.880245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:12.880088+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:12.880088+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.880088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:57.732580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'14","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:28.796185+0000","last_change":"2024-09-22T08:14:28.796120+0000","last_active":"2024-09-22T08:14:28.796185+0000","last_peered":"2024-09-22T08:14:28.796185+0000","last_clean":"2024-09-22T08:14:28.796185+0000","last_became_active":"2024-09-22T08:10:45.169723+0000","last_became_peered":"2024-09-22T08:10:45.169723+0000","last_unstale":"2024-09-22T08:14:28.796185+0000","last_undegraded":"2024-09-22T08:14:28.796185+0000","last_fullsized":"2024-09-22T08:14:28.796185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-22T08:14:28.796011+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-22T08:14:28.796011+0000","last_clean_scrub_stamp":"2024-09-22T08:14:28.796011+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:40.829249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:22.234157+0000","last_change":"2024-09-22T08:14:22.234089+0000","last_active":"2024-09-22T08:14:22.234157+0000","last_peered":"2024-09-22T08:14:22.234157+0000","last_clean":"2024-09-22T08:14:22.234157+0000","last_became_active":"2024-09-22T08:10:43.195587+0000","last_became_peered":"2024-09-22T08:10:43.195587+0000","last_unstale":"2024-09-22T08:14:22.234157+0000","last_undegraded":"2024-09-22T08:14:22.234157+0000","last_fullsized":"2024-09-22T08:14:22.234157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:22.234003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:22.234003+0000","last_clean_scrub_stamp":"2024-09-22T08:14:22.234003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:20.685742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'6","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:45.026811+0000","last_change":"2024-09-22T08:14:45.026749+0000","last_active":"2024-09-22T08:14:45.026811+0000","last_peered":"2024-09-22T08:14:45.026811+0000","last_clean":"2024-09-22T08:14:45.026811+0000","last_became_active":"2024-09-22T08:10:45.169366+0000","last_became_peered":"2024-09-22T08:10:45.169366+0000","last_unstale":"2024-09-22T08:14:45.026811+0000","last_undegraded":"2024-09-22T08:14:45.026811+0000","last_fullsized":"2024-09-22T08:14:45.026811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:45.026672+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:45.026672+0000","last_clean_scrub_stamp":"2024-09-22T08:14:45.026672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:07.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.867714+0000","last_change":"2024-09-22T08:14:13.867652+0000","last_active":"2024-09-22T08:14:13.867714+0000","last_peered":"2024-09-22T08:14:13.867714+0000","last_clean":"2024-09-22T08:14:13.867714+0000","last_became_active":"2024-09-22T08:10:43.187246+0000","last_became_peered":"2024-09-22T08:10:43.187246+0000","last_unstale":"2024-09-22T08:14:13.867714+0000","last_undegraded":"2024-09-22T08:14:13.867714+0000","last_fullsized":"2024-09-22T08:14:13.867714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:13.867567+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:13.867567+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.867567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:08.637420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.014248+0000","last_change":"2024-09-22T08:14:30.014166+0000","last_active":"2024-09-22T08:14:30.014248+0000","last_peered":"2024-09-22T08:14:30.014248+0000","last_clean":"2024-09-22T08:14:30.014248+0000","last_became_active":"2024-09-22T08:10:45.172080+0000","last_became_peered":"2024-09-22T08:10:45.172080+0000","last_unstale":"2024-09-22T08:14:30.014248+0000","last_undegraded":"2024-09-22T08:14:30.014248+0000","last_fullsized":"2024-09-22T08:14:30.014248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:30.014084+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:30.014084+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.014084+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:11.302015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.766020+0000","last_change":"2024-09-22T08:14:14.765941+0000","last_active":"2024-09-22T08:14:14.766020+0000","last_peered":"2024-09-22T08:14:14.766020+0000","last_clean":"2024-09-22T08:14:14.766020+0000","last_became_active":"2024-09-22T08:10:43.178924+0000","last_became_peered":"2024-09-22T08:10:43.178924+0000","last_unstale":"2024-09-22T08:14:14.766020+0000","last_undegraded":"2024-09-22T08:14:14.766020+0000","last_fullsized":"2024-09-22T08:14:14.766020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:14.765846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:14.765846+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.765846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:42.012438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:30.826577+0000","last_change":"2024-09-22T08:14:30.826514+0000","last_active":"2024-09-22T08:14:30.826577+0000","last_peered":"2024-09-22T08:14:30.826577+0000","last_clean":"2024-09-22T08:14:30.826577+0000","last_became_active":"2024-09-22T08:10:45.172101+0000","last_became_peered":"2024-09-22T08:10:45.172101+0000","last_unstale":"2024-09-22T08:14:30.826577+0000","last_undegraded":"2024-09-22T08:14:30.826577+0000","last_fullsized":"2024-09-22T08:14:30.826577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-22T08:14:30.826439+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-22T08:14:30.826439+0000","last_clean_scrub_stamp":"2024-09-22T08:14:30.826439+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:48.777015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:13.756895+0000","last_change":"2024-09-22T08:14:13.756790+0000","last_active":"2024-09-22T08:14:13.756895+0000","last_peered":"2024-09-22T08:14:13.756895+0000","last_clean":"2024-09-22T08:14:13.756895+0000","last_became_active":"2024-09-22T08:10:43.178876+0000","last_became_peered":"2024-09-22T08:10:43.178876+0000","last_unstale":"2024-09-22T08:14:13.756895+0000","last_undegraded":"2024-09-22T08:14:13.756895+0000","last_fullsized":"2024-09-22T08:14:13.756895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:13.756688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:13.756688+0000","last_clean_scrub_stamp":"2024-09-22T08:14:13.756688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:05.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.790830+0000","last_change":"2024-09-22T08:14:27.790763+0000","last_active":"2024-09-22T08:14:27.790830+0000","last_peered":"2024-09-22T08:14:27.790830+0000","last_clean":"2024-09-22T08:14:27.790830+0000","last_became_active":"2024-09-22T08:10:45.180117+0000","last_became_peered":"2024-09-22T08:10:45.180117+0000","last_unstale":"2024-09-22T08:14:27.790830+0000","last_undegraded":"2024-09-22T08:14:27.790830+0000","last_fullsized":"2024-09-22T08:14:27.790830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:27.790679+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:27.790679+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.790679+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:31:28.087125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:24.212133+0000","last_change":"2024-09-22T08:14:24.212034+0000","last_active":"2024-09-22T08:14:24.212133+0000","last_peered":"2024-09-22T08:14:24.212133+0000","last_clean":"2024-09-22T08:14:24.212133+0000","last_became_active":"2024-09-22T08:10:43.195770+0000","last_became_peered":"2024-09-22T08:10:43.195770+0000","last_unstale":"2024-09-22T08:14:24.212133+0000","last_undegraded":"2024-09-22T08:14:24.212133+0000","last_fullsized":"2024-09-22T08:14:24.212133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:24.211938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:24.211938+0000","last_clean_scrub_stamp":"2024-09-22T08:14:24.211938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:13:35.988551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:33.741144+0000","last_change":"2024-09-22T08:14:33.741067+0000","last_active":"2024-09-22T08:14:33.741144+0000","last_peered":"2024-09-22T08:14:33.741144+0000","last_clean":"2024-09-22T08:14:33.741144+0000","last_became_active":"2024-09-22T08:10:45.180098+0000","last_became_peered":"2024-09-22T08:10:45.180098+0000","last_unstale":"2024-09-22T08:14:33.741144+0000","last_undegraded":"2024-09-22T08:14:33.741144+0000","last_fullsized":"2024-09-22T08:14:33.741144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-22T08:14:33.740986+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-22T08:14:33.740986+0000","last_clean_scrub_stamp":"2024-09-22T08:14:33.740986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:54.421474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:25.262188+0000","last_change":"2024-09-22T08:14:25.262115+0000","last_active":"2024-09-22T08:14:25.262188+0000","last_peered":"2024-09-22T08:14:25.262188+0000","last_clean":"2024-09-22T08:14:25.262188+0000","last_became_active":"2024-09-22T08:10:43.201687+0000","last_became_peered":"2024-09-22T08:10:43.201687+0000","last_unstale":"2024-09-22T08:14:25.262188+0000","last_undegraded":"2024-09-22T08:14:25.262188+0000","last_fullsized":"2024-09-22T08:14:25.262188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:25.262020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:25.262020+0000","last_clean_scrub_stamp":"2024-09-22T08:14:25.262020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:12.187326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.929258+0000","last_change":"2024-09-22T08:14:26.929258+0000","last_active":"2024-09-22T08:14:26.929258+0000","last_peered":"2024-09-22T08:14:26.929258+0000","last_clean":"2024-09-22T08:14:26.929258+0000","last_became_active":"2024-09-22T08:11:23.215110+0000","last_became_peered":"2024-09-22T08:11:23.215110+0000","last_unstale":"2024-09-22T08:14:26.929258+0000","last_undegraded":"2024-09-22T08:14:26.929258+0000","last_fullsized":"2024-09-22T08:14:26.929258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:26.929163+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:26.929163+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.929163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:03:29.392032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:12.790729+0000","last_change":"2024-09-22T08:14:12.790672+0000","last_active":"2024-09-22T08:14:12.790729+0000","last_peered":"2024-09-22T08:14:12.790729+0000","last_clean":"2024-09-22T08:14:12.790729+0000","last_became_active":"2024-09-22T08:10:43.187195+0000","last_became_peered":"2024-09-22T08:10:43.187195+0000","last_unstale":"2024-09-22T08:14:12.790729+0000","last_undegraded":"2024-09-22T08:14:12.790729+0000","last_fullsized":"2024-09-22T08:14:12.790729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:12.790570+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:12.790570+0000","last_clean_scrub_stamp":"2024-09-22T08:14:12.790570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:57.729020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.829964+0000","last_change":"2024-09-22T08:14:26.829887+0000","last_active":"2024-09-22T08:14:26.829964+0000","last_peered":"2024-09-22T08:14:26.829964+0000","last_clean":"2024-09-22T08:14:26.829964+0000","last_became_active":"2024-09-22T08:10:45.179150+0000","last_became_peered":"2024-09-22T08:10:45.179150+0000","last_unstale":"2024-09-22T08:14:26.829964+0000","last_undegraded":"2024-09-22T08:14:26.829964+0000","last_fullsized":"2024-09-22T08:14:26.829964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:26.829765+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:26.829765+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.829765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:32.333330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:26.213279+0000","last_change":"2024-09-22T08:14:26.213227+0000","last_active":"2024-09-22T08:14:26.213279+0000","last_peered":"2024-09-22T08:14:26.213279+0000","last_clean":"2024-09-22T08:14:26.213279+0000","last_became_active":"2024-09-22T08:10:43.200282+0000","last_became_peered":"2024-09-22T08:10:43.200282+0000","last_unstale":"2024-09-22T08:14:26.213279+0000","last_undegraded":"2024-09-22T08:14:26.213279+0000","last_fullsized":"2024-09-22T08:14:26.213279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:14:26.213130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:14:26.213130+0000","last_clean_scrub_stamp":"2024-09-22T08:14:26.213130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:57.522386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:27.216393+0000","last_change":"2024-09-22T08:14:27.216341+0000","last_active":"2024-09-22T08:14:27.216393+0000","last_peered":"2024-09-22T08:14:27.216393+0000","last_clean":"2024-09-22T08:14:27.216393+0000","last_became_active":"2024-09-22T08:10:43.189848+0000","last_became_peered":"2024-09-22T08:10:43.189848+0000","last_unstale":"2024-09-22T08:14:27.216393+0000","last_undegraded":"2024-09-22T08:14:27.216393+0000","last_fullsized":"2024-09-22T08:14:27.216393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-22T08:14:27.216242+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-22T08:14:27.216242+0000","last_clean_scrub_stamp":"2024-09-22T08:14:27.216242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:35.518662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:31.010061+0000","last_change":"2024-09-22T08:14:31.009987+0000","last_active":"2024-09-22T08:14:31.010061+0000","last_peered":"2024-09-22T08:14:31.010061+0000","last_clean":"2024-09-22T08:14:31.010061+0000","last_became_active":"2024-09-22T08:10:45.183407+0000","last_became_peered":"2024-09-22T08:10:45.183407+0000","last_unstale":"2024-09-22T08:14:31.010061+0000","last_undegraded":"2024-09-22T08:14:31.010061+0000","last_fullsized":"2024-09-22T08:14:31.010061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:31.009901+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:31.009901+0000","last_clean_scrub_stamp":"2024-09-22T08:14:31.009901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:51.690389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:14.836809+0000","last_change":"2024-09-22T08:14:14.836700+0000","last_active":"2024-09-22T08:14:14.836809+0000","last_peered":"2024-09-22T08:14:14.836809+0000","last_clean":"2024-09-22T08:14:14.836809+0000","last_became_active":"2024-09-22T08:10:43.187119+0000","last_became_peered":"2024-09-22T08:10:43.187119+0000","last_unstale":"2024-09-22T08:14:14.836809+0000","last_undegraded":"2024-09-22T08:14:14.836809+0000","last_fullsized":"2024-09-22T08:14:14.836809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-22T08:14:14.836597+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-22T08:14:14.836597+0000","last_clean_scrub_stamp":"2024-09-22T08:14:14.836597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:22.845650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-22T08:14:32.769761+0000","last_change":"2024-09-22T08:14:32.769697+0000","last_active":"2024-09-22T08:14:32.769761+0000","last_peered":"2024-09-22T08:14:32.769761+0000","last_clean":"2024-09-22T08:14:32.769761+0000","last_became_active":"2024-09-22T08:11:23.218693+0000","last_became_peered":"2024-09-22T08:11:23.218693+0000","last_unstale":"2024-09-22T08:14:32.769761+0000","last_undegraded":"2024-09-22T08:14:32.769761+0000","last_fullsized":"2024-09-22T08:14:32.769761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-22T08:14:32.769617+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-22T08:14:32.769617+0000","last_clean_scrub_stamp":"2024-09-22T08:14:32.769617+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:14.057548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673028,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673027,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":741411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673027,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":742099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":446464,"data_stored":152009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:15:46.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-22T08:15:46.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.519+0000 7f42e84d4640 1 Processor -- start 2024-09-22T08:15:46.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.520+0000 7f42e84d4640 1 -- start start 2024-09-22T08:15:46.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.520+0000 7f42e84d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f42e0132910 0x7f42e0134d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:46.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.520+0000 7f42e84d4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e0099890 con 0x7f42e012fb60 2024-09-22T08:15:46.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.520+0000 7f42e84d4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f42e0099b30 con 0x7f42e0132910 2024-09-22T08:15:46.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.520+0000 7f42e6270640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f42e012fb60 0x7f42e012ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58276/0 (socket says 172.21.15.53:58276) 2024-09-22T08:15:46.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.520+0000 7f42e6270640 1 -- 172.21.15.53:0/147639636 learned_addr learned my addr 172.21.15.53:0/147639636 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-22T08:15:46.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.520+0000 7f42e5a6f640 1 --2- 172.21.15.53:0/147639636 >> v2:172.21.15.53:3300/0 conn(0x7f42e0132910 0x7f42e0134d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:46.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.520+0000 7f42e526e640 1 -- 172.21.15.53:0/147639636 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544569534 0 0) 0x7f42e0099890 con 0x7f42e012fb60 2024-09-22T08:15:46.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.520+0000 7f42e526e640 1 -- 172.21.15.53:0/147639636 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42cc003520 con 0x7f42e012fb60 2024-09-22T08:15:46.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.521+0000 7f42e5a6f640 1 -- 172.21.15.53:0/147639636 >> v1:172.21.15.53:6789/0 conn(0x7f42e012fb60 legacy=0x7f42e012ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:46.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.521+0000 7f42e5a6f640 1 -- 172.21.15.53:0/147639636 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e012f7e0 con 0x7f42e0132910 2024-09-22T08:15:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.521+0000 7f42e5a6f640 1 --2- 172.21.15.53:0/147639636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e0132910 0x7f42e0134d00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009720 tx=0x7f42d002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11873b62c47b2740 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.521+0000 7f42e526e640 1 -- 172.21.15.53:0/147639636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d0037070 con 0x7f42e0132910 2024-09-22T08:15:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.521+0000 7f42e526e640 1 -- 172.21.15.53:0/147639636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d0032440 con 0x7f42e0132910 2024-09-22T08:15:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.521+0000 7f42e526e640 1 -- 172.21.15.53:0/147639636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d0032740 con 0x7f42e0132910 2024-09-22T08:15:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.522+0000 7f42e84d4640 1 -- 172.21.15.53:0/147639636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e0132910 msgr2=0x7f42e0134d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.522+0000 7f42e84d4640 1 --2- 172.21.15.53:0/147639636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e0132910 0x7f42e0134d00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009720 tx=0x7f42d002a230 comp rx=0 tx=0).stop 2024-09-22T08:15:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.522+0000 7f42e84d4640 1 -- 172.21.15.53:0/147639636 shutdown_connections 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.522+0000 7f42e84d4640 1 --2- 172.21.15.53:0/147639636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e0132910 0x7f42e0134d00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.522+0000 7f42e84d4640 1 -- 172.21.15.53:0/147639636 >> 172.21.15.53:0/147639636 conn(0x7f42e009fff0 msgr2=0x7f42e00a0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.522+0000 7f42e84d4640 1 -- 172.21.15.53:0/147639636 shutdown_connections 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.522+0000 7f42e84d4640 1 -- 172.21.15.53:0/147639636 wait complete. 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.523+0000 7f42e84d4640 1 Processor -- start 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.523+0000 7f42e84d4640 1 -- start start 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.523+0000 7f42e84d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e012fb60 0x7f42e01c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.523+0000 7f42e84d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f42e01355d0 con 0x7f42e012fb60 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.523+0000 7f42e6270640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e012fb60 0x7f42e01c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.523+0000 7f42e6270640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e012fb60 0x7f42e01c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59712/0 (socket says 172.21.15.53:59712) 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.523+0000 7f42e6270640 1 -- 172.21.15.53:0/322257668 learned_addr learned my addr 172.21.15.53:0/322257668 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.524+0000 7f42e6270640 1 -- 172.21.15.53:0/322257668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e012aca0 con 0x7f42e012fb60 2024-09-22T08:15:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.524+0000 7f42e6270640 1 --2- 172.21.15.53:0/322257668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e012fb60 0x7f42e01c48f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00c480 tx=0x7f42dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.524+0000 7f42d6ffd640 1 -- 172.21.15.53:0/322257668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc017070 con 0x7f42e012fb60 2024-09-22T08:15:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.524+0000 7f42d6ffd640 1 -- 172.21.15.53:0/322257668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42dc005cd0 con 0x7f42e012fb60 2024-09-22T08:15:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.524+0000 7f42e84d4640 1 -- 172.21.15.53:0/322257668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e009c3d0 con 0x7f42e012fb60 2024-09-22T08:15:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.524+0000 7f42d6ffd640 1 -- 172.21.15.53:0/322257668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc007200 con 0x7f42e012fb60 2024-09-22T08:15:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.524+0000 7f42e84d4640 1 -- 172.21.15.53:0/322257668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e012b6b0 con 0x7f42e012fb60 2024-09-22T08:15:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.525+0000 7f42e84d4640 1 -- 172.21.15.53:0/322257668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e012ff40 con 0x7f42e012fb60 2024-09-22T08:15:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.525+0000 7f42d6ffd640 1 -- 172.21.15.53:0/322257668 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f42dc01a070 con 0x7f42e012fb60 2024-09-22T08:15:46.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.525+0000 7f42d6ffd640 1 --2- 172.21.15.53:0/322257668 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f42c403e710 0x7f42c4040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-22T08:15:46.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.525+0000 7f42d6ffd640 1 -- 172.21.15.53:0/322257668 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f42dc052ab0 con 0x7f42e012fb60 2024-09-22T08:15:46.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.525+0000 7f42e5a6f640 1 --2- 172.21.15.53:0/322257668 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f42c403e710 0x7f42c4040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-22T08:15:46.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.526+0000 7f42e5a6f640 1 --2- 172.21.15.53:0/322257668 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f42c403e710 0x7f42c4040bd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f42d0034000 tx=0x7f42d002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-22T08:15:46.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.530+0000 7f42d6ffd640 1 -- 172.21.15.53:0/322257668 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f42dc01b3b0 con 0x7f42e012fb60 2024-09-22T08:15:46.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.717+0000 7f42e84d4640 1 -- 172.21.15.53:0/322257668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f42e012c020 con 0x7f42e012fb60 2024-09-22T08:15:46.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.720+0000 7f42d6ffd640 1 -- 172.21.15.53:0/322257668 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f42dc01b730 con 0x7f42e012fb60 2024-09-22T08:15:46.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.720+0000 7f42d6ffd640 1 -- 172.21.15.53:0/322257668 <== mon.0 v2:172.21.15.53:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f42dc058080 con 0x7f42e012fb60 2024-09-22T08:15:46.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.722+0000 7f42e84d4640 1 -- 172.21.15.53:0/322257668 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f42c403e710 msgr2=0x7f42c4040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:46.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.722+0000 7f42e84d4640 1 --2- 172.21.15.53:0/322257668 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f42c403e710 0x7f42c4040bd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f42d0034000 tx=0x7f42d002e000 comp rx=0 tx=0).stop 2024-09-22T08:15:46.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.722+0000 7f42e84d4640 1 -- 172.21.15.53:0/322257668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e012fb60 msgr2=0x7f42e01c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-22T08:15:46.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.722+0000 7f42e84d4640 1 --2- 172.21.15.53:0/322257668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e012fb60 0x7f42e01c48f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00c480 tx=0x7f42dc00c940 comp rx=0 tx=0).stop 2024-09-22T08:15:46.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.722+0000 7f42e84d4640 1 -- 172.21.15.53:0/322257668 shutdown_connections 2024-09-22T08:15:46.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.722+0000 7f42e84d4640 1 --2- 172.21.15.53:0/322257668 >> [v2:172.21.15.165:6824/2210654445,v1:172.21.15.165:6825/2210654445] conn(0x7f42c403e710 0x7f42c4040bd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:46.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.722+0000 7f42e84d4640 1 --2- 172.21.15.53:0/322257668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42e012fb60 0x7f42e01c48f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-22T08:15:46.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.722+0000 7f42e84d4640 1 -- 172.21.15.53:0/322257668 >> 172.21.15.53:0/322257668 conn(0x7f42e009fff0 msgr2=0x7f42e009b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-22T08:15:46.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.722+0000 7f42e84d4640 1 -- 172.21.15.53:0/322257668 shutdown_connections 2024-09-22T08:15:46.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-22T08:15:46.722+0000 7f42e84d4640 1 -- 172.21.15.53:0/322257668 wait complete. 2024-09-22T08:15:46.735 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-22T08:15:46.735 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-22T08:15:46.735 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-22T08:15:46.735 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:15:46.763 INFO:tasks.ceph.osd.0:Stopped 2024-09-22T08:15:46.763 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-22T08:15:46.763 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:15:46.804 INFO:tasks.ceph.osd.1:Stopped 2024-09-22T08:15:46.804 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-22T08:15:46.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:15:46.844 INFO:tasks.ceph.osd.2:Stopped 2024-09-22T08:15:46.844 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-22T08:15:46.844 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:15:46.914 INFO:tasks.ceph.osd.3:Stopped 2024-09-22T08:15:46.914 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-22T08:15:46.914 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-22T08:15:46.914 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:15:46.984 INFO:tasks.ceph.mgr.x:Stopped 2024-09-22T08:15:46.984 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-22T08:15:46.985 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-22T08:15:46.985 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T08:15:46.995 INFO:tasks.ceph.mon.a:Stopped 2024-09-22T08:15:46.996 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-22T08:15:46.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-22T08:15:47.066 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-22T08:15:47.066 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-22T08:15:47.255 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-22T08:15:47.255 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-22T08:15:47.408 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-22T08:15:47.409 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-22T08:15:47.496 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-22T08:15:47.496 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-22T08:15:47.555 INFO:tasks.ceph:Archiving mon data... 2024-09-22T08:15:47.556 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034/data/mon.a.tgz 2024-09-22T08:15:47.556 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-22T08:15:47.573 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.NbOgCCbFSu 2024-09-22T08:15:47.574 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NbOgCCbFSu 2024-09-22T08:15:47.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.NbOgCCbFSu 2024-09-22T08:15:47.809 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.NbOgCCbFSu is 276KB 2024-09-22T08:15:47.903 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.NbOgCCbFSu 2024-09-22T08:15:47.918 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-22T08:15:47.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T08:15:47.960 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T08:15:48.039 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T08:15:48.057 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T08:15:48.057 INFO:tasks.ceph:Archiving crash dumps... 2024-09-22T08:15:48.059 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034/remote/smithi053/crash 2024-09-22T08:15:48.060 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T08:15:48.104 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034/remote/smithi165/crash 2024-09-22T08:15:48.105 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T08:15:48.179 INFO:tasks.ceph:Compressing logs... 2024-09-22T08:15:48.180 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T08:15:48.182 DEBUG:teuthology.orchestra.run.smithi165:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T08:15:48.204 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-22T08:15:48.205 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31654.log 2024-09-22T08:15:48.211 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74529.log 2024-09-22T08:15:48.223 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31696.log 2024-09-22T08:15:48.223 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31822.log 2024-09-22T08:15:48.223 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31696.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31654.log.gz 2024-09-22T08:15:48.223 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32115.log 2024-09-22T08:15:48.223 INFO:teuthology.orchestra.run.smithi053.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31696.log.gz 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31822.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31822.log.gz 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29255.log 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.audit.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32115.log.gz 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31528.log 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31948.log 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31528.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.29255.log.gz 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30592.log 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31528.log.gz 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30778.log 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.31948.log.gz 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31780.log 2024-09-22T08:15:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30778.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30592.log.gz 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30550.log 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30778.log.gz 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31360.log 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31780.log.gz 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30776.log 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31360.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30550.log.gz 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32075.log 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31360.log.gz 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32033.log 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30776.log.gz 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31113.log 2024-09-22T08:15:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.32033.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32075.log.gz 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31864.log 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32033.log.gz 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30634.log 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31113.log.gz 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31222.log 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30634.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31864.log.gz 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31906.log 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30634.log.gz 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31222.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31222.log.gz 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30474.log 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.a.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31906.log.gz 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31402.log 2024-09-22T08:15:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31738.log 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30474.log.gz 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30418.log 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31402.log.gz 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29373.log 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31738.log: /var/log/ceph/ceph-client.admin.30418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31444.log 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.31738.log.gz 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30418.log.gz 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29373.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29373.log.gz/var/log/ceph/ceph-client.admin.31444.log: 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31054.log 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31444.log.gz 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31612.log 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.31054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31570.log 2024-09-22T08:15:48.227 INFO:teuthology.orchestra.run.smithi053.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31054.log.gz 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31112.log 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30946.log 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31612.log.gz/var/log/ceph/ceph-client.admin.31570.log: 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31112.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31570.log.gz 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30676.log 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31112.log.gz 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31264.log 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30946.log: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5/var/log/ceph/ceph-client.admin.30676.log: --verbose -- /var/log/ceph/ceph-client.admin.31486.log 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30946.log.gz 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31264.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30676.log.gz 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30945.log 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31264.log.gz 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31486.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27534.log 2024-09-22T08:15:48.228 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31486.log.gz 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30361.log 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30945.log: /var/log/ceph/ceph.tmp-client.admin.27534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30886.log 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30945.log.gz 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27534.log.gz 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30777.log 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30361.log.gz 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31991.log 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30886.log.gz 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31114.log 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30777.log: /var/log/ceph/ceph-client.admin.31991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30944.log 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30777.log.gz 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31991.log.gz 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30499.log 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31114.log.gz 2024-09-22T08:15:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29409.log 2024-09-22T08:15:48.230 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30944.log: /var/log/ceph/ceph-client.admin.30499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30775.log 2024-09-22T08:15:48.230 INFO:teuthology.orchestra.run.smithi053.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30944.log.gz 2024-09-22T08:15:48.230 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29409.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30499.log.gz 2024-09-22T08:15:48.230 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31306.log 2024-09-22T08:15:48.230 INFO:teuthology.orchestra.run.smithi053.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29409.log.gz 2024-09-22T08:15:48.230 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30775.log: /var/log/ceph/ceph-client.admin.31306.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30775.log.gz 2024-09-22T08:15:48.230 INFO:teuthology.orchestra.run.smithi053.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31306.log.gz 2024-09-22T08:15:48.271 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40649.log 2024-09-22T08:15:48.271 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48514.log/var/log/ceph/ceph-client.0.74529.log: 2024-09-22T08:15:48.271 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.40649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75739.log 2024-09-22T08:15:48.271 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.48514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96331.log 2024-09-22T08:15:48.271 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.75739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76949.log 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74529.log.gz 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40649.log.gz 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.96331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91439.log 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48514.log.gz 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.76949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90834.log 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75739.log.gz 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.91439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90229.log 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.90834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40044.log 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.76949.log.gz 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46699.log 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.90229.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91439.log.gz 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.40044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36420.log 2024-09-22T08:15:48.272 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.46699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52144.log 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.36420.log: gzip -5 --verbose 91.2% -- replaced with /var/log/ceph/ceph-client.0.90834.log.gz 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.0.78764.log 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.96331.log.gz 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90229.log.gz 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.52144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35546.log 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.40044.log.gz 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.78764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89624.log 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46699.log.gz 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35546.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.36420.log.gz 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84814.log 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.35546.log.gz 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88414.log 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.89624.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52144.log.gz 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.84814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82999.log 2024-09-22T08:15:48.273 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78764.log.gz 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.88414.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.84814.log.gz 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.82999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38235.log 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.89624.log.gz 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.38235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78159.log 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.88414.log.gz 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.82999.log.gz 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86611.log 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64244.log 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.78159.log: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.86611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44884.log 2024-09-22T08:15:48.274 INFO:teuthology.orchestra.run.smithi165.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38235.log.gz 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr: 90.5%/var/log/ceph/ceph-client.0.64244.log: -- replaced with /var/log/ceph/ceph-client.0.86611.log.gz 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65454.log 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80579.log 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.44884.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78159.log.gz 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.65454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70899.log 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.80579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57589.log 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% 91.1% -- replaced with /var/log/ceph/ceph-client.0.64244.log.gz 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.44884.log.gz 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.70899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62429.log 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.57589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77554.log 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.62429.log: gzip -5 91.2% -- replaced with /var/log/ceph/ceph-client.0.80579.log.gz 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr: --verbose -- /var/log/ceph/ceph-client.0.44279.log 91.2% -- replaced with /var/log/ceph/ceph-client.0.65454.log.gz 2024-09-22T08:15:48.275 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.77554.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.70899.log.gz 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31481.log 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.44279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67269.log 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57589.log.gz 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87809.log 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62429.log.gz 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77554.log.gz 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.31481.log.gz 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49119.log 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.67269.log: /var/log/ceph/ceph-client.0.87809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84209.log 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44279.log.gz 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.49119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51539.log 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.84209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58194.log 2024-09-22T08:15:48.276 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.51539.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93859.log 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.87809.log.gz 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67269.log.gz 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49119.log.gz 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.58194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60614.log 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84209.log.gz 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.93859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72109.log 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.60614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63639.log 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51539.log.gz 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1%/var/log/ceph/ceph-client.0.72109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81789.log 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.58194.log.gz 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93859.log.gz 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.63639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52749.log 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50329.log 2024-09-22T08:15:48.277 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.81789.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60614.log.gz 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.52749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93254.log 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.50329.log: gzip -5 --verbose -- 91.3% -- replaced with /var/log/ceph/ceph-client.0.63639.log.gz 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr: /var/log/ceph/ceph-client.0.79974.log 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.93254.log: gzip -5 --verbose -- 91.4% -- replaced with /var/log/ceph/ceph-client.0.52749.log.gz 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr: /var/log/ceph/ceph-client.0.64849.log 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.79974.log: gzip -5 --verbose -- 91.6% -- replaced with /var/log/ceph/ceph-client.0.72109.log.gz 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr: /var/log/ceph/ceph-client.0.38840.log 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50329.log.gz 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.64849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75134.log 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81789.log.gz 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93254.log.gz 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.38840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81184.log 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79974.log.gz 2024-09-22T08:15:48.278 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.75134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83604.log 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.81184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43069.log 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64849.log.gz 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.83604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82394.log 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.43069.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38840.log.gz 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- 91.6% -- replaced with /var/log/ceph/ceph-client.0.75134.log.gz /var/log/ceph/ceph-client.0.54564.log 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.82394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60009.log 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.54564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66664.log 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81184.log.gz 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.43069.log.gz 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr:gzip/var/log/ceph/ceph-client.0.60009.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31441.log 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.66664.log: gzip -5 --verbose -- 91.1% /var/log/ceph/ceph-client.0.55169.log 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.82394.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.0.83604.log.gz 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-22T08:15:48.279 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68479.log 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.31441.log.gz 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.55169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94464.log 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54564.log.gz 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.68479.log: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67874.log 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.66664.log.gz 91.4% -- replaced with /var/log/ceph/ceph-client.0.60009.log.gz 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.94464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55774.log 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.67874.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55169.log.gz 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.55774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35586.log 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.2.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94464.log.gz 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35626.log 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67874.log.gz 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35586.log: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68479.log.gz 2024-09-22T08:15:48.280 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73924.log 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.35586.log.gz 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50934.log 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55774.log.gz 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87210.log 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.35626.log.gz 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.73924.log: /var/log/ceph/ceph-client.0.50934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86012.log 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.87210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58799.log 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.86012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53354.log 90.2% 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.87210.log.gz 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.58799.log: gzip 90.5% -- replaced with /var/log/ceph/ceph-client.0.86012.log.gz 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.73924.log.gz 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50934.log.gz 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.79369.log 2024-09-22T08:15:48.281 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.53354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63034.log 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.79369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61824.log 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.63034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46094.log 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.58799.log.gz 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.61824.log: gzip -5 --verbose -- 91.3% /var/log/ceph/ceph-client.admin.35466.log 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.53354.log.gz 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.46094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31401.log 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41254.log 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% 91.1% -- replaced with /var/log/ceph/ceph-client.0.79369.log.gz 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.63034.log.gz 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.35466.log.gz 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31401.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.46094.log.gz 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.61824.log.gz 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43674.log 2024-09-22T08:15:48.282 INFO:teuthology.orchestra.run.smithi165.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.31401.log.gz 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70294.log 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.41254.log: /var/log/ceph/ceph-client.0.43674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92044.log 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.70294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69689.log 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.92044.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3%/var/log/ceph/ceph-client.0.69689.log: -- replaced with /var/log/ceph/ceph-client.0.43674.log.gz 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47304.log 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41254.log.gz 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5/var/log/ceph/ceph-mgr.x.log: --verbose -- /var/log/ceph/ceph-client.0.45489.log 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.70294.log.gz 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.47304.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47909.log 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.92044.log.gz 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.45489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35506.log 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49724.log 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.47909.log: /var/log/ceph/ceph-client.admin.35506.log: 91.1% 92.5% -- replaced with /var/log/ceph/ceph-client.0.69689.log.gz 2024-09-22T08:15:48.283 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.47304.log.gz 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.35506.log.gz 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45489.log.gz 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66059.log 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.49724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61219.log 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47909.log.gz 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.66059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69084.log 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.61219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73319.log 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.69084.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.49724.log.gz 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.73319.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66059.log.gz 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.61219.log.gz 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39445.log 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/rgw.ceph.client.0.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.73319.log.gz 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37025.log 2024-09-22T08:15:48.284 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.39445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53959.log 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.37025.log: 90.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95069.log 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.39445.log.gz 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.69084.log.gz 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.53959.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37025.log.gz 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53959.log.gz 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89019.log 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.95069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72714.log 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.89019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31521.log 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.72714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76344.log 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31521.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95069.log.gz 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.31521.log.gz 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.89019.log.gz 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71504.log 2024-09-22T08:15:48.285 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.72714.log.gz 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.76344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56379.log 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.71504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92649.log 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.56379.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76344.log.gz 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.92649.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.71504.log.gz 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56984.log 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56379.log.gz/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59404.log 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.56984.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92649.log.gz 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85413.log 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.59404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37630.log 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56984.log.gz 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.85413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41859.log 2024-09-22T08:15:48.286 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.37630.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59404.log.gz 2024-09-22T08:15:48.287 INFO:teuthology.orchestra.run.smithi165.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.85413.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.95674.log 2024-09-22T08:15:48.287 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-22T08:15:48.287 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.41859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42464.log 2024-09-22T08:15:48.287 INFO:teuthology.orchestra.run.smithi165.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37630.log.gz/var/log/ceph/ceph-client.0.95674.log: 2024-09-22T08:15:48.287 INFO:teuthology.orchestra.run.smithi165.stderr: 91.2%/var/log/ceph/ceph-client.0.42464.log: -- replaced with /var/log/ceph/ceph-client.0.41859.log.gz 2024-09-22T08:15:48.287 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95674.log.gz 2024-09-22T08:15:48.287 INFO:teuthology.orchestra.run.smithi165.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42464.log.gz 2024-09-22T08:15:48.293 INFO:teuthology.orchestra.run.smithi165.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-22T08:15:48.308 INFO:teuthology.orchestra.run.smithi165.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-22T08:15:48.392 INFO:teuthology.orchestra.run.smithi053.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-22T08:15:49.115 INFO:teuthology.orchestra.run.smithi165.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-22T08:15:49.241 INFO:teuthology.orchestra.run.smithi165.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-22T08:15:49.256 INFO:teuthology.orchestra.run.smithi165.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-22T08:15:49.258 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-22T08:15:49.258 INFO:teuthology.orchestra.run.smithi165.stderr:real 0m1.057s 2024-09-22T08:15:49.258 INFO:teuthology.orchestra.run.smithi165.stderr:user 0m3.044s 2024-09-22T08:15:49.258 INFO:teuthology.orchestra.run.smithi165.stderr:sys 0m0.207s 2024-09-22T08:15:49.261 INFO:teuthology.orchestra.run.smithi053.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-22T08:15:49.263 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-09-22T08:15:49.263 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m1.068s 2024-09-22T08:15:49.263 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m1.229s 2024-09-22T08:15:49.264 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.074s 2024-09-22T08:15:49.264 INFO:tasks.ceph:Archiving logs... 2024-09-22T08:15:49.264 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034/remote/smithi053/log 2024-09-22T08:15:49.265 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T08:15:49.634 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034/remote/smithi165/log 2024-09-22T08:15:49.641 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T08:15:50.180 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-22T08:15:50.188 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-22T08:15:50.189 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T08:15:50.191 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T08:15:50.268 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-22T08:15:50.276 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-22T08:15:50.276 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:15:50.279 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:15:50.293 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:15:50.294 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:15:50.298 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:15:50.298 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-22T08:15:50.298 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 34 +482us[ +442us] +/- 61ms 2024-09-22T08:15:50.298 INFO:teuthology.orchestra.run.smithi165.stdout:^* hv02.front.sepia.ceph.com 3 6 377 33 +51us[ +10us] +/- 57ms 2024-09-22T08:15:50.298 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -511us[ -511us] +/- 61ms 2024-09-22T08:15:50.298 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:15:50.300 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:15:50.300 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-09-22T08:15:50.300 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 32 +471us[ +498us] +/- 61ms 2024-09-22T08:15:50.300 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 +54us[ +82us] +/- 57ms 2024-09-22T08:15:50.300 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 -521us[ -494us] +/- 61ms 2024-09-22T08:15:50.300 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:15:50.300 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-22T08:15:50.309 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-22T08:15:50.309 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-22T08:15:50.346 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T08:15:50.414 DEBUG:teuthology.orchestra.run.smithi165:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T08:15:50.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:15:50.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:15:50.503 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:15:50.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:15:50.530 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-22T08:15:50.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-22T08:15:50.548 INFO:teuthology.task.internal:Duration was 718.607844 seconds 2024-09-22T08:15:50.548 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-22T08:15:50.557 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-22T08:15:50.557 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T08:15:50.560 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T08:15:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:15:50.609 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:15:50.825 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-22T08:15:50.825 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-09-22T08:15:50.825 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T08:15:50.887 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-09-22T08:15:50.887 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T08:15:50.926 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-22T08:15:50.926 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T08:15:50.930 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T08:15:50.993 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-22T08:15:50.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T08:15:50.998 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T08:15:51.130 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-22T08:15:51.141 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-22T08:15:51.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T08:15:51.167 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T08:15:51.192 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-22T08:15:51.201 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:15:51.209 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:15:51.231 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-09-22T08:15:51.255 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-09-22T08:15:51.273 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:15:51.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:15:51.311 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T08:15:51.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:15:51.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-22T08:15:51.336 INFO:teuthology.task.internal:Transferring archived files... 2024-09-22T08:15:51.337 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034/remote/smithi053 2024-09-22T08:15:51.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T08:15:51.385 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915034/remote/smithi165 2024-09-22T08:15:51.385 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T08:15:51.418 INFO:teuthology.task.internal:Removing archive directory... 2024-09-22T08:15:51.418 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T08:15:51.423 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T08:15:51.468 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-22T08:15:51.479 INFO:teuthology.task.internal:Not uploading archives. 2024-09-22T08:15:51.479 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-22T08:15:51.488 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-22T08:15:51.488 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T08:15:51.491 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T08:15:51.503 INFO:teuthology.orchestra.run.smithi053.stdout: 265613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 08:15 /home/ubuntu/cephtest 2024-09-22T08:15:51.522 INFO:teuthology.orchestra.run.smithi165.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 08:15 /home/ubuntu/cephtest 2024-09-22T08:15:51.523 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-22T08:15:51.533 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-22T08:15:51.555 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 718.6078436374664 flavor: default owner: scheduled_soumyakoduri@teuthology success: true 2024-09-22T08:15:51.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T08:15:51.626 INFO:teuthology.run:pass